WO2018164298A1

WO2018164298A1 - Emotion information providing device based on spatial and time information

Info

Publication number: WO2018164298A1
Application number: PCT/KR2017/002562
Authority: WO
Inventors: 이양우; 황민철; 김삼이
Original assignee: 상명대학교서울산학협력단; (주)브라이트테크; 이양우
Priority date: 2017-03-09
Filing date: 2017-03-09
Publication date: 2018-09-13

Abstract

The present invention relates to an emotion information providing device based on spatial and time information. The emotion information providing device according to the present invention comprises: an input unit for receiving environment information including information on temperature, humidity, illuminance, and noise around a plurality of users, image information obtained by photographing environments around the plurality of users, and emotion information of the plurality of users; a control unit for matching spatial information and time information, in which the environment information, the image information, and the emotion information have been generated, with the environment information, the image information, and the emotion information; a database generation unit for storing the environment information, the image information, and the emotion information, which have been matched with the spatial information and the time information, and generating a database; and an information output unit for outputting an analysis result after analyzing the database according to search information received from a user terminal. As such, since it is possible to provide situations that people encounter in different regions and at different times, and emotion information corresponding to the situations, the users can grasp an objective emotion felt by people in a specific event or phenomenon. The present invention has an advantage in that the users can utilize such information in marketing or as objective data for research and analysis.

Description

Emotional information providing device based on spatial and temporal information

The present invention relates to an emotional information providing apparatus based on spatial and temporal information, and more particularly, to an emotional information providing apparatus based on spatial and temporal information for enhancing accessibility and utilization of emotional information.

Recently, as various attempts have been made to combine human emotions with business, research and development to analyze human emotions is active.

In the past, in order to analyze human emotions, an emotional analysis tool in the form of a questionnaire was used, but human emotions are changed in real time, whereas such emotional analysis technology is difficult to obtain in real time and combines rational judgment to analyze accurate emotional information. It was difficult to do.

However, as sensor devices capable of acquiring a human biosignal or an image have been developed, it is possible to easily acquire data based on emotional analysis. Accordingly, many universities, companies, and research institutes apply big data analysis techniques to multiple information such as lifelogging data.

As the emotional information analyzed in this way is massive and can be used in various fields, a system for providing emotional information according to a systemic framework for utilizing the generated emotional big data is required.

The background technology of the present invention is disclosed in Korean Patent Registration No. 10-1262922 (announced on May 09, 2013).

An object of the present invention is to provide an emotion information providing apparatus based on space and time information for improving accessibility and utilization of emotion information.

According to an embodiment of the present invention for achieving the above technical problem, the emotional information providing apparatus is environmental information, including temperature, humidity, illuminance, and noise information around a plurality of users, image information and a plurality of images of the environment surrounding the plurality of users An input unit for receiving emotion information of a user of the controller, a controller for matching spatial information and time information in which the environment information, image information and emotion information are generated with the environment information, image information and emotion information, and the spatial information and time information And a database generator for storing a matched environment information, image information, and emotion information to generate a database, and an information output unit for analyzing the database according to search information received from a user terminal and outputting an analysis result.

The emotion information is generated by comparing the bio-signal measurement data, behavioral measurement data, and environmental measurement data with respective reference values or using a vocabulary of web content usage data, wherein the emotional information includes a pleasant-discomfort axis and an awakening-relaxation axis. Can be categorized according to dimensional sensitivity.

The controller may match an area and time at which the environment information and image information are generated with the environment information and image information, and match a generation area and time of data used to generate the emotion information with the emotion information. .

The information output unit may calculate and output at least one of a total average value and a total change amount of each category of the database according to at least one of a local unit and a time unit included in the search information.

The information output unit calculates at least one of an average value and a change amount for each category of the database according to at least one of a plurality of local units and a plurality of time units included in the search information, and then calculates the calculated total average value and total change amount. At least one of the comparison results may be generated and output.

As described above, according to the present invention, since a situation in which people face each other and emotional information can be provided according to time, the user can grasp the objective feelings felt by people in a specific event or phenomenon. The user can use this information for marketing or as an objective data for research analysis.

1 is a block diagram of an emotion information providing apparatus according to an embodiment of the present invention.

2 is a diagram for describing two-dimensional emotion information according to the pleasant-discomfort axis and the arousal-relaxation axis according to an embodiment of the present invention.

3 is a flowchart illustrating a method of providing emotion information according to an embodiment of the present invention.

4 is a diagram for describing search information according to an embodiment of the present invention.

5 is a view for explaining a method of outputting an analysis result according to an exemplary embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it may further include other components, except to exclude other components unless specifically stated otherwise.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention.

First, a configuration of an emotion information providing apparatus according to an exemplary embodiment of the present invention will be described with reference to FIG. 1.

As shown in FIG. 1, the emotion information providing apparatus 100 according to an exemplary embodiment of the present invention includes an input unit 110, a controller 120, a database generator 130, and an information output unit 140.

First, the input unit 110 receives environment information including temperature, humidity, illuminance, and noise information around a plurality of users, image information photographing a plurality of user surroundings, and emotion information about a plurality of users.

In detail, the input unit 110 includes environmental information and an image including data about temperature, humidity, illuminance, noise, and gas around the user from a sensor such as a temperature measuring instrument, a humidity measuring instrument, an illuminance measuring instrument, a noise measuring instrument, a gas measuring instrument, and a camera. Receive information in real time. The input unit 110 receives the emotion information from the user terminal.

Here, the emotional information is generated by comparing biosignal measurement data, behavioral measurement data, and environmental measurement data with respective reference values or using a vocabulary of using web content usage data, and includes two-dimensional axes including a pleasant-discomfort axis and an awakening-relaxation axis. Categorized according to emotion.

Next, the controller 120 matches the spatial information and time information in which the environment information, the image information, and the emotion information are generated with the environment information, the image information, and the emotion information.

In detail, the controller 120 matches the region and time at which the environment information and the image information are generated to the environment information and the image information, and the generation region and time of the data used to generate the emotion information to the emotion information.

Next, the database generator 130 generates a database by storing environment information, image information, and emotion information matched with spatial information and time information.

The information output unit 140 analyzes the database according to the search information received from the user terminal and outputs the analysis result.

In detail, the information output unit 140 calculates and outputs at least one of the total average value and the total change amount for each category of the database according to at least one of the region unit and the time unit included in the search information.

In addition, the information output unit 140 calculates at least one of the average value and the change amount of each category of data for the user according to at least one of a plurality of local units and a plurality of time units included in the search information, and then calculates the total The result of comparison with at least one of the average value and the total change amount is generated and output.

In addition, the information output unit 140 may categorize and output sensory stimuli according to environmental information and image information according to two-dimensional emotion.

Next, look at the emotion information according to an embodiment of the present invention through FIG.

As shown in FIG. 2, the two-dimensional emotion information is classified into a total of nine dimensional emotions according to the two-dimensional coordinate system of the comfort-discomfort axis (x axis) and the awakening-relaxation axis (y axis).

Specifically, looking at the nine dimensional emotions, space 1 is unpleasant-wake, space 2 is awakening, space 3 is pleasant-wake, space 4 is unpleasant, space 5 is neutral, space 6 is pleasant, 7 Burn space is discomfort-relaxation, space eight is relaxation. Space nine is space of pleasure-relaxation.

The emotion information may be generated by applying at least one of biometric signal measurement data, behavior measurement data, environmental measurement data, and web content usage data of the subject to an emotion analysis algorithm. In this case, the biosignal measurement data, behavior measurement data, environmental measurement data, and web content usage data may be the same data as the environmental information and the image information input by the input unit 110.

First, the emotion analysis algorithm extracts heart rate variability (HRV) by analyzing the user's heart rate (PPG) or ballistocardiogram (BCG), and then averages and coherences the peak values of the heart rate variability. extract the ratio. In addition, the emotion analysis algorithm may set any one of nine dimensional emotions for each time slot by comparing the average value and unity ratio of the extracted peak point with a preset reference value.

For example, in a time slot between 10 and 11 seconds, if the mean and unity ratio of the peak point is more than 10% larger than each reference value, then the emotional analysis algorithm will use space 1, that is, the dimensional sensitivity of the discomfort-wake, to the corresponding time slot. It can be set as the dimensional sensitivity of.

Next, the emotional analysis algorithm is based on the subject's total moving distance, number of clusters, entropy, periodic movement pattern (transadian), transition time, location diversity from the GPS data. After extracting a variance, a total distance, and the like, the variance and the total distance are compared with each preset reference value, thereby setting any one of nine dimensional emotions for each time slot.

Next, the emotion analysis algorithm extracts the color elements (pixel values) constituting the image from the image data, extracts the magnitude of the noise from the noise measurement data, and compares it with each of the preset reference values. Any one can be set.

In addition, the emotion analysis algorithm extracts the vocabulary of the web content used by the subject from the web content data and compares it with a previously stored database to set any one of nine dimensional emotions for each time slot.

Next, the emotion information providing method using the emotion information providing apparatus according to the embodiment of the present invention will be described with reference to FIG. 3.

First, the input unit 110 receives environmental information including temperature, humidity, illuminance, and noise information around a plurality of users, image information photographing a plurality of user surroundings, and emotion information about a plurality of users (S310). .

Then, the control unit 120 matches the spatial information and time information in which the environment information, the image information, and the emotion information are generated with the environment information, the image information, and the emotion information (S320).

In detail, the controller 120 matches the area and time at which the environment information and the image information are generated to the environment information and the image information, and the generation area and time of the data used to generate the emotion information to the emotion information. That is, the controller 120 tags the region and time information generated in the environment information and the image information.

For example, when data used to generate environmental information, image information, and emotion information is generated by a person A at 13:10 in Gangnam-gu, Seoul, the city of Seoul may be created as an area in the environment information, image information, and emotion information. Gangnam-gu is tagged and 13:10 is tagged at creation time.

Next, the database generation unit 130 generates a database by storing the environment information, image information and emotion information matched with the spatial information and time information (S230).

Then, the information output unit 140 analyzes the database according to the search information received from the user terminal and outputs the analysis result (S240).

In addition, the information output unit 140 calculates at least one of the average value and the change amount for each category of the database according to at least one of the plurality of regional units and the plurality of time units included in the search information, and then calculates the total average value and the total value. A result of comparison with at least one of the amount of change is generated and output.

The information output unit 140 may infer sensory stimuli for each category of the database according to at least one of a plurality of local units and a plurality of time units included in the search information.

In detail, the information output unit 140 compares the average value for each category according to the search information with a preset threshold range, and compares the total value according to the two-dimensional coordinate system of the pleasant-discomfort axis (x-axis) and the awakening-relaxation axis (y-axis). It can be classified into nine sensory stimuli.

For example, when the average value of illuminance is 5 lux, the government output unit 140 may select the unpleasant-relaxing sensory stimulus by comparing 5 lux with a threshold range.

Hereinafter, an analysis result output method according to an exemplary embodiment of the present invention will be described with reference to FIGS. 4 and 5.

As shown in FIG. 4A, the search information includes local information and date information. In this case, the date information includes year, month, day, and time information.

For example, if the user wants to check emotion information about people who were in Gangnam in May 2016, the user may input Gangnam as the local information and May 2016 as the date information as the search information.

In addition, as shown in FIG. 4B, the search information also includes output form information of data to be output by the user. Here, the output form information of the data includes a map data view, an average data view, a change data view, a comparison average data view, and a comparison change data view.

First, the average data view refers to an output form in which an average of data corresponding to local information or date information included in the search information is provided to the user as a graph or a numerical value.

For example, it is assumed that search information is inputted using local information as a whole region and date information as a full date. Then, as shown in (a) of FIG. 5, the information output unit 140 calculates an average value for each category of all regions and all date data, and then outputs it as a graph or a numerical value.

Next, the comparative average data view refers to an output form in which a mean of data corresponding to a plurality of local information or a plurality of date information included in the search information is provided to the user as a graph or a numerical value.

For example, it is assumed that search information has been input with the local information as the entire region, Gangnam, and the date information as the full date and January 1, 2016 at 13:00. Then, as shown in (b) of FIG. 5, the information output unit 140 calculates the average value for each category of the total region and the total date data and the average value for each category of the data tagged with Gangnam, 1 January 2016 all at 13:00. Then print it out as a graph or numerical value.

Next, the map data view refers to an output form in which emotional information is displayed on the map and provided to the user.

For example, it is assumed that search information is input with the local information as Seoul and the date information as January 5, 2017. Then, the information output unit 140 calculates the average value of emotional information tagged with Seoul, January 5, 2017 in each administrative district, and then maps and outputs the color corresponding to the average value on the Seoul map.

Next, the change data view refers to an output form that provides a user with a graph or a numerical value of a change in data corresponding to local information or date information included in the search information.

For example, it is assumed that search information is input using the local information as Busan and the date information as March 5, 2017. Then, the information output unit 140 calculates the average value for each category of the tagged data of Busan, March 5, 2017 for each time zone, and outputs it as a graph or a numerical value.

Next, the comparison change data view refers to an output form in which a change trend of data corresponding to a plurality of local information or a plurality of date information included in the search information is provided to the user as a graph or a numerical value.

For example, it is assumed that search information is input with the local information as Seoul, the date information as January 1, 2016, and January 1, 2017. Then, the information output unit 140 calculates the average value for each category of data tagged with Seoul, January 1, 2016 for each time zone, and calculates the average value for each category of data tagged with Seoul January 1, 2017 for each time zone. do. The information output unit 140 outputs the calculated average values in graphs or numerical values, respectively.

According to an embodiment of the present invention, since the situation of people and emotional information according to the time for each region can be provided, the user can grasp the objective feelings felt by people in a specific event or phenomenon. The user can use this information for marketing or as an objective data for research analysis.

Although the present invention has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

Claims

An input unit for receiving environment information including temperature, humidity, illumination, and noise information of a plurality of users, image information of a plurality of surrounding environments of the user, and emotion information of the plurality of users;

A controller for matching the space information and time information in which the environment information, the image information, and the emotion information are generated with the environment information, the image information, and the emotion information;

A database generator configured to generate a database by storing environment information, image information, and emotion information matched with the spatial information and time information; and

And an information output unit configured to output the analysis result after analyzing the database according to the search information received from the user terminal.
The method of claim 1,

The emotional information,

The bio-signal measurement data, behavioral measurement data, and environmental measurement data are generated by comparing each reference value or using a vocabulary of web content usage data, and categorized according to a two-dimensional emotion including a pleasant-discomfort axis and an awakening-relaxation axis. Emotional information providing device.
The method of claim 1,

The control unit,

And an area in which the environment information and the image information have been matched with a time where the environment information and the image information are generated, and an emotion area providing time which matches the generation area and time of the data used to generate the emotion information with the emotion information.
The method of claim 1,

The information output unit,

Emotion information providing apparatus for calculating and outputting at least one of the total average value and the total change amount for each category of the database according to at least one of the local unit and time unit included in the search information.
The method of claim 4, wherein

The information output unit,

Computing at least one of the average value and the change amount for each category of the database according to at least one of the plurality of local units and the plurality of time units included in the search information, and then comparing at least one of the calculated total average value and the total change amount Emotional information providing device for generating and outputting a result.