WO2017204373A1

WO2017204373A1 - Emotion index determination system using multi-sensory change, and method therefor

Info

Publication number: WO2017204373A1
Application number: PCT/KR2016/005492
Authority: WO
Inventors: 황민철; 이양우; 김삼이
Original assignee: 상명대학교서울산학협력단; (주)브라이트테크
Priority date: 2016-05-24
Filing date: 2016-05-24
Publication date: 2017-11-30

Abstract

The present invention relates to an emotion index determination system using a multi-sensory change, and a method therefor. According to the present invention, the emotion index determination method using a multi-sensory change, that is, the emotion index determination method using an emotion index determination system which includes a plurality of sensors and an emotion index determination server, comprises the steps of: generating a multi-sensory signal by sensing a person to be measured and generating an environment signal by sensing a surrounding environment of the person to be measured, by the plurality of sensors; analyzing the intensity of the multi-sensory signal and the environment signal received from the plurality of sensors and extracting the amount of change in the multi-sensory signal and the amount of change in the environment signal, by the emotion index determination server; calculating a level of change in the multi-sensory signal and a level of change in the environment signal, by using the amount of change in the multi-sensory signal, the amount of change in the environment signal, and each reference value thereof; and determining an emotion index of the person to be measured by using a difference value of the level of change in the multi-sensory signal and a difference value of the level of change in the environment signal. Therefore, according to the present invention, an emotion index is determined in consideration of a change in a multi-sensory signal, a change in an environment signal, and a mutual correlation between the two signals, and can be thus accurately determined. Further, the present invention uses a multi-sensory signal reflecting olfactory, tactile, taste, auditory, and visual information difficult to be artificially controlled, and can thus acquire an objective emotion index.

Description

Emotional Index Determination System using Multi-Sensory Change and Its Method

The present invention relates to a system and method for determining an emotional index using multiple sensory changes, and more particularly, to a system and method for determining an emotional index using multiple sensory changes for determining an emotional index according to a multisensory change of a subject. It is about.

Emotion index is a concept that contrasts with intelligence index and refers to social indexes such as positive thinking about self and interpersonal ability. In the past, there was a tendency to regard the intelligence index on intellectual ability as a measure of personal ability, but recently, as interpersonal relationships become important according to the personalization tendency of members of society, interest in emotional index is increasing. In particular, some companies use the emotional index as a criterion for hiring or evaluating personnel.

However, the research history of the emotional index is shorter than the intelligence index, so the method of evaluating the emotional index is limited, and most of them are evaluated through the response process to the question, so it can be manipulated artificially, so that the objectivity and accuracy of the emotional index are not guaranteed. There is a problem.

The background technology of the present invention is disclosed in Korean Patent Publication No. 10-2015-0001038 (2015.01.06 publication).

SUMMARY OF THE INVENTION The present invention has been made in an effort to provide a system and method for determining an emotional index using multiple sensory changes for determining an emotional index according to a multisensory change of a subject.

According to an embodiment of the present invention for achieving the technical problem, the emotional index determination method using a multi-sensory change in the emotional index determination method using a emotional index determination system comprising a plurality of sensors and the emotional index determination server, A sensor generating a multisensory signal by sensing a subject and generating an environment signal by sensing a surrounding environment of the subject, wherein the emotion index determination server of the multisensory signal and the environmental signal received from the plurality of sensors Extracting the multisensory signal change amount and the environmental signal change amount by analyzing the magnitude, calculating the multisensory signal change level and the environment signal change level using the multisensory signal change amount and the environmental signal change amount and respective reference values, and By using the difference value between the multisensory signal change level and the environment signal change level, Determining the emotional index.

The multi-sensory signal may include at least one of an olfactory signal, a tactile signal, a taste signal, an auditory signal, and a visual signal.

The reference value includes a multisensory signal reference value corresponding to a multisensory signal change amount and an environmental signal reference value corresponding to an environmental signal change amount, and the calculating of the multisensory signal change level and the environmental signal change level comprises: the multisensory signal The multisensory signal change level may be calculated by dividing a change amount by the multisensory signal reference value, and the environment signal change level may be calculated by dividing the change amount of the environmental signal by an environment signal reference value.

The determining of the emotion index of the subject may include calculating a difference value between the multisensory signal change level and an environment signal change level, and converting the calculated difference value into a difference value between the multisensory signal change level and an environment signal change level. Comparing the emotional index values according to the range with the stored look-up table, and as a result of the comparison, determining the emotional index value corresponding to the calculated difference value as the emotional index of the subject.

The method may further include selecting and providing the emotion management service corresponding to the determined emotion index to the user.

According to another embodiment of the present invention, a system for determining an emotional index using a multisensory change generates a multisensory signal by sensing a subject and a plurality of sensors for generating an environment signal by sensing the environment of the subject, and the multisensory And an emotion index determination server for determining the emotion index of the subject by using a signal and an environment signal, wherein the emotion index determination server analyzes the multisensory signals and environmental signals transmitted from the plurality of sensors and multisensory. A change amount extracting unit for extracting a signal change amount and an environmental signal change amount, a change level calculating unit calculating a multi-sensory signal change level and an environment signal change level using the multi-sensory signal change amount and the environmental signal change amount, and respective reference values, and the multi-sensory The emotional index of the subject is determined by using the difference between the signal change level and the environmental signal change level. Emotion index determination unit is included.

As described above, according to the present invention, since the emotional index is determined in consideration of the change in the multisensory signal and the environmental signal and the correlation between each other, the emotional index can be accurately determined. In addition, an objective emotional index can be obtained by using a multisensory signal reflecting olfactory, tactile, taste, auditory, and visual information, which are difficult to control artificially.

1 is a view for explaining an emotional index determination system using a multi-sensory change according to an embodiment of the present invention.

2 is a flowchart illustrating a method of determining an emotional index using the emotional index determining system according to an exemplary embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it may further include other components, except to exclude other components unless specifically stated otherwise.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention.

1 is a view for explaining an emotional index determination system using a multi-sensory change according to an embodiment of the present invention. Emotion index determination system using a multi-sensory change according to an embodiment of the present invention includes a plurality of sensors 100 and the emotional index determination server 200, may further include a user terminal (300).

First, the plurality of sensors 100 generate a multisensory signal by sensing a subject, and generate an environment signal by sensing a surrounding environment of the subject. The sensor 100 includes an EEG measurement sensor for generating a multisensory signal, a camera sensor for generating environmental information, a microphone sensor, and a gas sensor. In addition, the sensor 100 senses information according to the five sense stimulus responses applied to the subject. It may further include a device capable of.

For example, the EEG sensor may generate a multisensory signal by sensing an EEG generated by the five sense stimuli applied to the subject.

The gas sensor may generate an environmental signal by measuring the type and concentration of gas around the subject, and the microphone sensor may generate an environmental signal by measuring the noise level around the subject. In addition, the camera sensor may generate an environmental signal by measuring the degree of congestion around the subject.

The multi-sensory signal may include at least one of an olfactory signal, a tactile signal, a taste signal, an auditory signal, and a visual signal according to the five senses stimulus applied to the subject.

Next, the emotional index determination server 200 determines the emotional index of the subject using the multi-sensory signal and the environmental signal. As shown in FIG. 1, the emotional index determination server 200 includes a variation extracting unit 210, a change level setting unit 220, and an emotional index determining unit 230, and further includes a service providing unit 240. Can be.

First, the change amount extracting unit 210 extracts the multisensory signal change amount and the environmental signal change amount by analyzing the multisensory signals and environmental signals received from the plurality of sensors 100. In detail, the change extracting unit 210 may extract the change in the multisensory signal and the change in the environmental signal by analyzing the change in the magnitude of the multisensory signal and the environment signal. The amount of change in multisensory signals and the amount of change in environmental signals can be extracted.

Next, the change level calculator 220 calculates the multisensory signal change level and the environment signal change level using the multisensory signal change amount and the environment signal change amount and respective reference values. Here, the reference value includes a multisensory signal reference value corresponding to the multisensory signal change amount and an environmental signal reference value corresponding to the environment signal change amount. In detail, the change level setting unit 220 may calculate the multisensory signal change level by dividing the multisensory signal change amount by the multisensory signal reference value, and calculate the environment signal change level by dividing the environment signal change amount by the environment signal reference value.

Next, the emotional index determiner 230 determines the emotional index of the subject using the difference between the multisensory signal change level and the environmental signal change level. Specifically, the emotional index determiner 230 calculates a difference value between the multisensory signal change level and the environmental signal change level, and uses the calculated difference value as an emotion according to the difference value range of the multisensory signal change level and the environmental signal change level. The index value is compared with a stored lookup table, and the emotional index value corresponding to the calculated difference value is determined as the emotional index of the subject.

Next, the service provider 240 selects and provides the emotion management service corresponding to the determined emotion index to the user. Meanwhile, the service provider 240 may communicate with the user terminal 300 by wire or wirelessly, and transmit the selected emotion management service to the user terminal 300.

The user terminal 300 outputs the emotion management service received from the service provider 240 to the subject. Meanwhile, the user terminal 300 may be connected to the plurality of sensors 100 by wire or wirelessly to receive a multisensory signal and an environment signal, and then transmit the same to the emotion index determination server 200.

First, the plurality of sensors 100 generate a multisensory signal by sensing a subject and generate an environment signal by sensing a surrounding environment of the subject (S210). Here, the multisensory signal is a signal for the biological response of the subject according to the five senses stimulus applied to the subject, and the olfactory signal by the olfactory stimulus, the tactile signal by the tactile stimulus, the taste signal by the taste stimulus, and the auditory stimulus. It may include at least one of an audio signal and a visual signal by a visual stimulus. And the environmental signal means a signal for the five senses stimulus applied to the subject by the surrounding environment of the subject.

Then, the emotional index determination server 200 analyzes the multi-sensory signals and environmental signals received from the plurality of sensors 100 to extract the multi-sensory signal change amount and the environmental signal change amount (S220). Specifically, the emotional index determination server 200 may extract the multisensory signal change amount and the environmental signal change amount by analyzing the change in the magnitude of the multisensory signal and the environmental signal.

At this time, the emotional index determination server 200 extracts the multi-sensory signal change amount and the environmental signal change amount during the same time interval corresponding to each other, which is a correlation between the five sense stimuli recognized by the subject in response to external stimuli. This is to reflect the sentiment index. If the time interval from which the multisensory signal change amount is extracted and the time interval from which the environmental signal change amount is extracted are different from each other, the correlation between the multisensory signal and the environmental signal is sparse and thus an incorrect emotional index may be determined.

Meanwhile, since the multisensory signal and the environmental signal may each include a plurality of signals containing various information, the multisensory signal change amount and the environmental signal change amount may be extracted through the sum of the respective signals. For example, if it is assumed that the measured multi-sensory signal includes an auditory signal and a visual signal, the emotion index determination server 200 integrates the magnitude change of the sum of the auditory signal and the visual signal of the same time zone and multi-sensory. The amount of signal change can be extracted.

Next, the emotion index determination server 200 sets the multisensory signal change level and the environmental signal change level using the multisensory signal change amount and the environment signal change amount and respective reference values (S230). Here, the reference value includes a multisensory signal reference value corresponding to the multisensory signal change amount and an environmental signal reference value corresponding to the environment signal change amount.

Specifically, the emotional index determination server 200 calculates the multisensory signal change level by dividing the multisensory signal change amount by the multisensory signal reference value (multisensory signal change level = multisensory signal change amount / multisensory signal reference value), and environmental signal The environmental signal change level is calculated by dividing the change amount by the environmental signal reference value (environmental signal change level = environmental signal change amount / environment signal reference value).

For example, assuming that the multisensory signal change amount is 15 and the multisensory signal reference value is 10, the multisensory signal change level is 1.5. If the environmental signal change amount is 20 and the environmental signal reference value is 15, the environmental signal change level is 4/3.

The emotion index determination server 200 calculates a difference value between the multisensory signal change level and the environment signal change level (S240). In detail, the emotion index determination server 200 calculates a difference value by subtracting the multisensory signal change level from the environment signal change level.

Next, the emotional index determination server 200 compares the calculated difference value with a lookup table in which the emotional index value according to the difference value range of the multisensory signal change level and the environmental signal change level is stored (S250). In accordance with the comparison result, the emotional index value corresponding to the calculated difference value is determined as the emotional index of the subject (S260).

Table 1 is a table showing a lookup table according to an embodiment of the present invention.

For example, assuming that the environmental signal change level is 4/3 and the multisensory signal change level is 1.5, the difference value is -1.667, so the calculated difference value is in the range of -0.17 to -0.16 compared to the lookup table of Table 1. Belongs. Therefore, the emotional index of the subject is determined to be 24.5 points.

In addition, the emotion index determination server 200 selects and provides the emotion management service corresponding to the determined emotion index to the user (S270). Here, the emotion management service is a service that helps to control emotions. For example, when the emotion index of the subject is low, it means that it is difficult to control the emotion change on its own. Or image content.

According to the exemplary embodiment of the present invention, since the emotional index is determined in consideration of the change of the multisensory signal and the environmental signal and the correlation between each other, the emotional index can be accurately determined. In addition, an objective emotional index can be obtained by using a multisensory signal reflecting olfactory, tactile, taste, auditory, and visual information, which are difficult to control artificially.

Although the present invention has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

Claims

In the emotional index determination method using the emotional index determination system including a plurality of sensors and the emotional index determination server,

Generating, by the plurality of sensors, a multi-sensory signal by sensing the subject and generating an environment signal by sensing the surrounding environment of the subject;

Extracting, by the emotion index determination server, the multisensory signal change amount and the environmental signal change amount by analyzing the magnitudes of the multisensory signals and environmental signals received from the plurality of sensors;

Calculating a multisensory signal change level and an environmental signal change level using the multisensory signal change amount and the environmental signal change amount and respective reference values; and

And determining the emotion index of the subject by using the difference between the multiple sensory signal change level and the environment signal change level.
The method of claim 1,

The multisensory signal,

Emotion index determination method using a multi-sensory change comprising at least one of an olfactory signal, tactile signal, taste signal, auditory signal and visual signal.
The method of claim 1,

The reference value is,

A multisensory signal reference value corresponding to the multisensory signal change amount and an environmental signal reference value corresponding to the environment signal change amount,

Computing the multi-sensory signal change level and the environment signal change level,

Method for determining the emotional index by using the multi-sensory change to calculate the multi-sensory signal change level by dividing the multi-sensory signal change amount by the multi-sensory signal reference value, and calculates the environmental signal change level by dividing the environmental signal change amount by an environmental signal reference value .
The method of claim 1,

Determining the emotional index of the subject,

Calculating a difference value between the multisensory signal change level and an environment signal change level,

Comparing the calculated difference value with a lookup table in which an emotional index value corresponding to a difference value range of a multisensory signal change level and an environment signal change level is stored;

And determining an emotional index value corresponding to the calculated difference value as the emotional index of the subject to be measured.
The method of claim 1,

Emotion index determination method using a multi-sensory change further comprising the step of selecting and providing to the user emotion management service corresponding to the determined emotional index.
A plurality of sensors configured to generate a multisensory signal by sensing a subject and generate an environmental signal by sensing the environment of the subject, and

Emotion index determination server for determining the emotional index of the subject using the multi-sensory signal and the environment signal,

The emotional index determination server,

A change amount extracting unit extracting a change amount of a multisensory signal and a change amount of an environmental signal by analyzing the multisensory signals and environmental signals received from the plurality of sensors;

A change level calculator for calculating a multisensory signal change level and an environment signal change level by using the multisensory signal change amount and the environmental signal change amount and respective reference values;

And an emotional index determiner configured to determine an emotional index of the subject by using a difference between the multiple sensory signal change level and an environmental signal change level.
The method of claim 6,

The multisensory signal,

Emotion index determination system using a multi-sensory change, including at least one of an olfactory signal, tactile signal, taste signal, auditory signal and visual signal.
The method of claim 6,

The reference value is,

A multisensory signal reference value corresponding to the multisensory signal change amount and an environmental signal reference value corresponding to the environment signal change amount,

The change level calculator,

Emotion index determination system using the multi-sensory change to calculate the multi-sensory signal change level by dividing the multi-sensory signal change amount by the multi-sensory signal reference value, and calculates the environmental signal change level by dividing the environmental signal change amount by an environmental signal reference value .
The method of claim 6,

The emotional index determination unit,

Computing a difference value between the multisensory signal change level and the environmental signal change level, and compares the calculated difference value with a look-up table stored in the emotional index value according to the difference value range of the multisensory signal change level and environmental signal change level And an emotion index determination system using a multi-sensory change to determine an emotion index value corresponding to the calculated difference value as the emotion index of the subject.
The method of claim 6,

The emotional index determination server,

Emotion index determination system using a multi-sensory change further comprises a service providing unit for selecting and providing a emotion management service corresponding to the determined emotional index to the user.