KR102508163B1 - Method and device for affect evaluation based on new eeg electrode placement reflecting affect sources in the brain - Google Patents

Abstract

An emotional evaluation method and apparatus based on EEG electrode placement on the surface of the head based on emotional origins in the brain are presented. According to an embodiment of the present invention, the emotion evaluation method based on EEG electrode placement on the surface of the head based on emotion origins in the brain is based on the emotion in the brain from functional magnetic resonance imaging (fMRI) obtained by photographing the subject's head. identifying a point of origin of emotion and determining a location of an emotion response electrode on the surface of the head based on the identified point of origin of emotion; and performing emotion evaluation on the subject based on a biosignal input through an electrode attached to the position of the electrode.

Description

Method and device for emotional evaluation based on EEG electrode placement based on emotional origins in the brain

The present invention relates to an emotion evaluation method and apparatus based on EEG electrode placement based on emotion sources in the brain for evaluating emotions felt by humans based on EEG measured on the surface of the head.

In particular, in the present invention, in order to increase the accuracy of the evaluation, based on the activation position in the brain that responds to the emotional stimulus, the position of the electrode on the surface of the head is determined, and the psycho-physiological-behavioral response is multi-dimensionally evaluated to increase the reliability of the evaluation. Emotional evaluation methods and devices are provided that evaluate the consistency of emotions by measuring them objectively.

The background technology of the present invention is disclosed in the following documents.
1) Publication No.: 10-2018-0059161 (2018-06-04) "Method of deriving presentation stimuli to maximize effect of eye movement sensitivity loss and reprocessing therapy based on emotion vector using biological signal measurement"
2) Heller, W., Nitschke, JB, and Lindsay, DL (1997). Neuropsychological correlates of arousal in self-reported emotion. Cogn. Emot. 11, 383-402.
3) Schmidtke, JI, and Heller, W. (2004). Personality, affect and EEG: predicting patterns of regional brain activity related to extraversion and neuroticism. Pers. Individual. Differ. 36, 717-732.
4) Khazi, M., Kumar, A., & Vidya, M.J. (2012). Analysis of EEG using 10: 20 electrode system. International Journal of Innovative Research in Science, Engineering and Technology, 1(2), 185-191.
5) Jurcak, V., Tsuzuki, D., & Dan, I. (2007). 10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems. Neuroimage, 34(4), 1600-1611.
6) Dolcos, F., LaBar, KS, & Cabeza, R. (2004). Dissociable effects of arousal and valence on prefrontal activity indexing emotional evaluation and subsequent memory: an event-related fMRI study. Neuroimage, 23(1), 64-74.
In the existing technology for measuring emotion with brain waves on the surface of the head, electrode positions that respond to emotion were determined based on the Heller model.

The Heller model may be a model in which the specific location of the head surface responding to pleasure, displeasure, arousal, etc. is determined from international standard electrode placement by referring to previous research results related to brain wave measurement. In the Heller model, when the positions of the most sensitive head surface for each of the affect sources that respond to emotional stimuli are determined from the international standard electrode arrangement, the reproducibility is high, but the possibility that the position of the most sensitive head surface matches the international electrode arrangement is high. There are low problems.

In addition, emotional sources responding to emotional stimuli are scattered three-dimensionally in the brain, and different emotional sources may contribute to the same electrode location on the head surface. Accordingly, there is a limitation that the emotion cannot be accurately evaluated by the existing technology.

Therefore, the location most sensitive to each of the emotional sources (pleasure, displeasure, arousal) responding to emotional stimuli is not selected from the existing international standard electrode arrangement electrodes, but based on the three-dimensional coordinates of the emotional sources It is necessary to newly determine the most sensitive specific location for each emotional source on the surface of the head.

In addition, there is an urgent need for the appearance of a new emotion evaluation model that increases the accuracy of emotion evaluation by excluding the redundant contribution of different emotional origins at the same electrode location on the head surface.

Embodiments of the present invention find emotional origins that respond correspondingly to each of the emotional stimuli of pleasure, displeasure, and awakening from activated parts of functional magnetic resonance imaging (fMRI), and spatial location and emotion in the brain for these origins The task to be solved is to provide an EEG electrode arrangement and an emotion evaluation method and device to predict what kind of emotion is induced by analyzing the EEG measured on the surface of the head based on the pattern of response to stimuli.

In addition, embodiments of the present invention aim to estimate the position of the emotional response electrode on the surface of the head that responds most sensitively to the emotional stimulus from the emotional origins in the brain corresponding to the emotional stimulus.

In addition, the embodiment of the present invention increases the accuracy of emotional evaluation by excluding redundant contributions from different emotional origins in the brain by applying an exclusive or (XOR) at the emotional response electrode position on the surface of the head, and psychological -The purpose is to increase reliability by evaluating the consistency of physiological-behavioral responses.

In addition, in an embodiment of the present invention, the exclusive logical sum (XOR) for excluding redundant contributions from different emotional origins in the brain to the emotional response electrode position on the surface of the head derived from the emotional origins in the brain In addition to increasing the reliability by evaluating the consistency of the psycho-physiological-behavioral response, adjusting the derived emotional response electrode position to be the most sensitive position for each independent emotional source through independent component analysis (ICA) The purpose.

In addition, an object of an embodiment of the present invention is to provide a mesh-type electrode cap for increasing the reproducibility of the position of the sensitive response electrode.

In addition, the embodiment of the present invention utilizes the two-dimensional emotional plane and biosignal-based emotional evaluation model (eg, Heller's EEG-based emotional evaluation model) proposed by Russel et al. The purpose of this study is to predict early dementia due to hippocampal atrophy.

In addition, an embodiment of the present invention is intended to evaluate personality and constitution (temperament) according to emotional stimulation-response, provide interactive content that can communicate with humans, and evaluate stress caused by emotional dissonance of emotional workers. do.

In addition, embodiments of the present invention improve the accuracy / reliability of biosignal-based emotion measurement equipment, improve the accuracy / reliability of biosignal-based early prediction of dementia, and improve biosignal-based constitution (temperament) The purpose of this study is to improve the classification accuracy/reliability and to create a blue ocean in the interactive content market through EEG measurement based on emotional origin.

EEG electrode placement-based emotion evaluation method based on emotional origins in the brain according to an embodiment of the present invention, from functional magnetic resonance imaging (fMRI) obtained by photographing the subject's head, the emotional origin point in the brain identifying and determining an electrode position on the head surface based on the identified emotion origin point; and performing emotional evaluation on the subject based on a biosignal input through an electrode attached to the position of the electrode.

In addition, according to an embodiment of the present invention, an emotion evaluation device based on EEG electrode placement based on emotional origins in the brain, from functional magnetic resonance imaging (fMRI) obtained by photographing the subject's head, emotional origins in the brain a processing unit that identifies a point and determines the position of an electrode on the surface of the head based on the identified emotion origin point; and an evaluation unit for performing an emotional evaluation on the subject based on a biosignal input through an electrode attached to the electrode position.

According to one embodiment of the present invention, emotional origins that respond to each of the emotional stimuli of pleasure, displeasure, and awakening are found from activated regions of functional magnetic resonance imaging (fMRI), and spatial locations in the brain for these origins It is possible to provide an EEG electrode arrangement and an emotion evaluation method and device for predicting what kind of emotion is induced by analyzing the EEG measured on the surface of the head based on the pattern of response to emotional stimuli.

In addition, according to one embodiment of the present invention, it is possible to estimate the position of the emotional response electrode on the surface of the head that responds most sensitively to the emotional stimulus from the emotional origins in the brain corresponding to the emotional stimulus.

In addition, according to one embodiment of the present invention, by applying an exclusive or (XOR) at the position of the emotion response electrode on the surface of the head to exclude redundant contributions from different sources of emotion in the brain, the accuracy of emotion evaluation is increased. , reliability can be increased by evaluating the consistency of psycho-physiological-behavioral responses.

In addition, according to one embodiment of the present invention, the exclusive logical sum (or: In addition to applying XOR) and evaluating the consistency of the psycho-physiological-behavioral response to increase its reliability, the derived emotional response electrode position is adjusted to be the most sensitive position for each independent emotional source through independent component analysis (ICA). can

In addition, according to one embodiment of the present invention, it is possible to provide a mesh-type electrode cap for increasing the reproducibility of the position of the sensitive response electrode.

In addition, according to one embodiment of the present invention, by utilizing the two-dimensional emotional plane and biological signal-based emotional evaluation model (eg, Heller's EEG-based emotional evaluation model) proposed by Russel et al., memory due to chronic stress and depression Dementia due to hippocampal atrophy in charge can be predicted early.

In addition, according to one embodiment of the present invention, it is possible to evaluate personality and constitution (temperament) according to emotional stimulation-response, provide interactive contents that can communicate with humans, and evaluate stress due to emotional dissonance of emotional workers. .

In addition, according to an embodiment of the present invention, the accuracy / reliability of biosignal-based emotion measurement equipment is improved, the biosignal-based early prediction of dementia is improved, and the biosignal-based constitution (temperament) is improved. ), and create a blue ocean in the interactive content market through EEG measurement based on emotional origin.

1 is a block diagram showing the configuration of an emotion evaluation device based on EEG electrode placement on the surface of the head based on emotion origins in the brain according to an embodiment of the present invention.
2 is a diagram for illustrating determining the position of an EEG electrode on the surface of the head based on the emotional origin in the brain.
3 is a diagram showing an example of fMRI activated in response to emotional stimuli.
4 is a diagram showing the results of emotion evaluation using EEG electrode placement on the surface of the head based on emotion origins in the brain according to the present invention.
5 is a diagram for comparing Heller's EEG-based emotion model (a) and Montreal Neurological Institute (MNI) coordinate system (b).
6 is a flowchart illustrating a sentiment evaluation method according to an embodiment of the present invention.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes can be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents or substitutes to the embodiments are included within the scope of rights.

Terms used in the examples are used only for descriptive purposes and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

In addition, in the description with reference to the accompanying drawings, the same reference numerals are given to the same components regardless of reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description will be omitted.

1 is a block diagram showing the configuration of an emotion evaluation device based on EEG electrode placement on the surface of the head based on emotion origins in the brain according to an embodiment of the present invention.

Referring to FIG. 1, according to an embodiment of the present invention, an emotion evaluation device based on EEG electrode placement on the surface of the head based on emotion origins in the brain (hereinafter, abbreviated as 'emotion evaluation device') 100 includes a processing unit (110) and an evaluation unit (120). In addition, the emotion evaluation device 100 may be configured to additionally include an acquisition unit 130 according to embodiments.

First of all, the processing unit 110 calculates emotional origin positions in the brain from functional magnetic resonance imaging (fMRI) obtained by photographing the subject's head responding to emotional stimuli in the MNI (Montreal Neurological Institute) cartecian coordinate system. ), and based on the identified emotion origin point, emotion response electrode positions are determined on the surface of the head. That is, the processing unit 110 finds a region activated according to each of the emotional stimuli of pleasure, discomfort, and awakening felt by the subject in the MNI coordinate system from the brain image of the subject, and from this, the pleasure, displeasure, and awakening felt by the subject on the surface of the head It can play a role in deriving the position of the emotional response electrode corresponding to the reaction of the spherical coordinate system.

The functional magnetic resonance imaging (fMRI) is a technology for measuring brain activity by detecting changes related to blood flow, and may be an imaging technology designed based on the fact that when a certain area in the brain is activated, the amount of blood flowing into that area increases. there is.

The electrode may be attached to the head surface of the subject and may be a means for acquiring brain waves and the like from the subject.

The processing unit 110 searches for a brain region activated for a specific emotion in functional magnetic resonance imaging (fMRI), displays the location in the brain as MNI orthogonal coordinates, and derives the location of the emotion response electrode on the surface of the head as spherical coordinates. can do.

To this end, the processing unit 110 may model the subject's head as a sphere of a homogeneous medium. That is, the processing unit 110 may display the location activated for the emotional response in the acquired functional magnetic resonance image (fMRI) as MNI coordinates on a spherical head model of a homogeneous medium.

In the modeling, the processing unit 110 displays a scale from 1 degree to 360 degrees in a counterclockwise direction based on the right ear of the head on the hat in a state where a hat in the form of a mesh is put on the head of the subject can do. That is, the processing unit 110 may draw 360 vertical vertical longitude lines on the surface of the hat after covering the subject with a hat in the form of a net, with the right ear at 0 degrees.

In addition, the processing unit 110 may mark a virtual latitude line from 1 degree to 120 degrees in a downward direction based on the crown of the head. That is, the processing unit 110 may draw 120 virtual latitude lines in the horizontal direction with the top of the head at 0 degrees on the surface of the hat worn on the subject.

Thereafter, the processing unit 110 may model the head in a spherical shape by using a net-shaped hat composed of virtual latitude lines and virtual longitude lines. That is, the processing unit 110 marks the virtual latitude and longitude lines on the surface of the mesh cap worn on the subject, and sets the emotional response EEG electrode coordinate values among the points where the virtual latitude and longitude lines intersect, The subject's head can be modeled as a sphere.

The net-type hat may use a stretchable material such that the intervals between virtual latitude and longitude lines are equal regardless of the size of the subject's head. That is, the net cap may be made of a material (eg, polybutyrene terephthalate: PBT material) such that the distance between the virtual latitude line and the virtual longitude line is maintained at equal intervals regardless of the size of the subject's head.

In addition, the processing unit 110 matches the center of the spherical net cap with the origin of MNI (Montreal Neurological Institute) coordinates, and then the MNI responding to the emotional stimuli of pleasure, discomfort, and awakening in the functional magnetic resonance imaging (fMRI) Rectangular coordinates S _n (x _n , y _n , z _n ) can be identified as the emotional origin point in the brain.

That is, the processing unit 110 partitions the functional magnetic resonance image (fMRI) patterned into a spherical shape into the MNI Cartesian coordinate system, and the MNI Cartesian coordinate S _n (x _n , y _n , z _n ).

MNI (Montreal Neurological Institute) coordinates are a coordinate system based on numerous MRI images. For example, in the same way as the Talairach map, MRI images of 305 adults are averaged to form a basic frame, and other images are rearranged to form a coordinate system. It can be a losing system.

In the present invention, the MNI orthogonal coordinates of positive emotion in response to the emotional stimulus of pleasure are S ₁ (x ₁ , y ₁ , z ₁ ), S ₂ (x ₂ , y _{2 )} , with n being 1 to 3. , z ₂ ), S ₃ (x ₃ , y ₃ , z ₃ ), and the MNI orthogonal coordinates of the negative emotion in response to the unpleasant emotional stimulus are S ₄ (x ₄ , y having n between 4 and 6) ₄ , z ₄ ), S ₅ (x ₅ , y ₅ , z ₅ ), S ₆ (x ₆ , y ₆ , z ₆ ), and the MNI orthogonal coordinates of the degree of arousal in response to the emotional stimulus of the arousal are n It may be S ₇ (x ₇ , y ₇ , z ₇ ) or S ₈ (x ₈ , y ₈ , z ₈ ) having 7 to 8.

Thereafter, the processing unit 110 may convert the MNI Cartesian coordinate system or rectangular coordinate system to a spherical coordinate system. That is, the processing unit 110 transforms the MNI Cartesian coordinates S _n (x _n , y _n , z _n ) into spherical coordinates E _n (r _n , θ _n , φ _n ).

At this time, since r _n does not reflect the subject's head size, the processing unit 110 obtains E _n' (r _n' , θ _n , φ _n ) so that r _{n' reflects} the subject's head size. can be used as an emotional response electrode position considering the subject's head size. That is, the processing unit 110 calculates an angle θ _n (corresponding to geographical 'latitude') away from the z-axis of the spherical coordinate system in a spherical model of radius E _n' and an angle φ away from a point on the sphere in the counterclockwise direction of the z-axis. Through _n (corresponding to 'geographical 'longitude'), it is possible to express the actual position of the electrode. Here, E _1', E _{2', and} E _3' are electrode positions corresponding to positive emotional triggers, E _4', E _{5', and} E _6' are electrode positions corresponding to negative emotional triggers, and E _7', E _8' are electrode positions corresponding to arousal and emotional origins.

In addition, the processing unit 110 calculates the positional error due to the conversion from the MNI orthogonal coordinates to the emotional response EEG electrode coordinates on the surface of a sphere modeling the subject's head in the form of a homogeneous sphere by independent component analysis (ICA). ) can be corrected.

Here, Independent Component Analysis (ICA) is a calculation method for separating multivariate signals into statistically independent subcomponents, and may be an analysis method for separating different types of signals.

That is, the processing unit 110, through independent component analysis (ICA), distributes the eight emotional response EEG electrode positions E _1', . . . distributed on the surface of the spherical model. _, E _{8 ',} eight independent emotional origins contributing to each S _1, ... _, S ₈ and then E _1', . . . _, E _8' E'_{1', . . . E'1',} . _, E'_8' again. That is, E'_1' is most sensitive to S ₁ . E'_8' can minimize errors in the positions of the emotional response EEG electrodes derived by finally adjusting the positions of the emotional response EEG electrodes to be most sensitive to S ₈ .

The evaluation unit 120 may perform emotion evaluation on the subject based on brain waves input through electrodes attached to the electrode positions. That is, the evaluation unit 120 determines what kind of emotion the subject currently has by using the EEG collected by the electrodes attached to the head surface of the response of the emotional origin of pleasure, displeasure, and awakening by the emotional stimulus. can play a role in

That is, with respect to the biosignals collected at the finally determined emotional response EEG electrode position E'_1'(r'_1' , θ' ₁ , φ' ₁ ), the evaluation unit 120 produces a response to the emotional stimulus of pleasure. Assuming that, it can be evaluated that the subject felt positive emotion.

In addition, with respect to the biosignal collected at the spherical electrode position E'_5'(r'_5' , θ' ₅ , φ' ₅ ), the evaluation unit 120 assumes that it is produced in response to an emotional stimulus of discomfort, , it can be evaluated that the subject felt negative emotion.

In addition, for the biosignals collected at the spherical electrode position E'_7'(r'_7' , θ' ₇ , φ' ₇ ), the evaluation unit 120 assumes that they are produced in response to the emotional stimulus of awakening, , the subject can be evaluated as aroused.

Depending on the embodiment, the processing unit 110 may specify one type of stimulus input from the disposed electrode.

To this end, the processing unit 110 performs an exclusive OR (XOR) when a biosignal input through an electrode attached to the electrode position is simultaneously related to two or more emotional sources among pleasure, displeasure, and arousal. By application, only one emotional origin contribution can be selected.

That is, even if the biosignal collected through one electrode is generated by a plurality of sources of emotion, the processing unit 110 selects only the mainstream emotion related to the placement of the electrode, so that the emotion evaluation related to the biosignal is more accurate. can make it happen.

For example, when a biosignal collected at an electrode position E'_1'(r'_1' , θ' ₁ , φ' ₁ ) associated with an emotional stimulus of pleasure is related to the emotional origin of discomfort as well as pleasure, the processing unit ( 110) can apply an exclusive OR so that, except for emotional origins of discomfort, only the sentimental origins of pleasure, which become the mainstream, are maintained in the biosignal.

In addition, the emotion evaluation device 100 may acquire various information such as facial electromyogram, electrocardiogram, psychological rebound, etc., and utilize them for emotion evaluation.

To this end, the emotion evaluation device 100 may further include an acquisition unit 130 that obtains a facial electromyogram, an electrocardiogram, and a psychological response using a questionnaire from the subject.

A facial electromyogram (fEMG) may refer to a signal for recording electrical activity inside facial muscles using electrodes, a signal for measuring facial nerve conduction velocity by electrical stimulation, and the like.

The evaluation unit 120 may further consider the state of the subject's facial muscles by facial EMG, and perform the emotional evaluation of the subject with high reliability.

In addition, when the electrocardiogram (ECG) is acquired by the acquisition unit 130, the evaluation unit 120 analyzes the heart rate variability (HRV) and Poincare plot from the electrocardiogram to determine the degree of activation of the sympathetic nervous system. An arousal assessment may be performed.

An electrocardiogram may refer to a signal recording an action potential generated in a myocardium according to heartbeat.

When the ECG is obtained as a raw signal through the electrodes placed on the subject, the emotional evaluation device 100 of the present invention can visualize it by showing it as a heart rate variability (HRV) and a Poincare Plot.

The evaluation unit 120 may evaluate the degree of arousal of the subject with high reliability by measuring the response of the autonomic nervous system based on the electrocardiogram.

In addition, when a psychological response using a questionnaire is acquired by the acquisition unit 130, the evaluation unit 120 may evaluate the consistency of the emotional evaluation performed in consideration of the psychological response.

That is, the evaluator 120 may determine whether the subject's emotional state is consistent with the emotional state determined from the previously performed bio-signal by determining the subject's emotional state according to the answers to the questionnaire. Through this, the evaluation unit 120 can prove the integrity of the emotional evaluation performed.

According to one embodiment of the present invention, the emotional origins corresponding to the emotional stimuli of pleasure, displeasure, and awakening are found as activated parts of functional magnetic resonance imaging (fMRI), and from the positions of the emotional origins in the brain to the surface of the head. It is possible to provide an emotional evaluation method and apparatus based on EEG electrode placement that determines electrode positions reflecting pleasure, displeasure, and arousal.

In addition, according to one embodiment of the present invention, through independent component analysis (ICA), eight emotional response EEG electrode positions distributed on the head surface of the spherical model E1', ... , E8', eight independent emotional origins contributing to each S1,... , after being separated into S8, E1',... , E8', the electrode positions are arranged so that each position is most sensitive to the corresponding emotional origin among the eight emotional sources. , E'8', it is possible to minimize the error of EEG electrode positions for emotional response.

In addition, according to an embodiment of the present invention, by applying an exclusive logical sum (XOR) at the emotional response electrode position to exclude overlapping contributions of different emotional origins, the accuracy of emotional evaluation is increased and the consistency of psycho-physiological-behavioral responses is increased. can be evaluated to increase reliability.

In addition, according to one embodiment of the present invention, dementia due to atrophy of the hippocampus in charge of memory due to depression can be predicted at an early stage by utilizing a biosignal-based emotion evaluation algorithm.

In addition, according to an embodiment of the present invention, it is possible to evaluate personality and constitution (temperament) according to emotional stimulation-response, provide interactive contents that can communicate with humans, and evaluate stress caused by emotional dissonance of emotional workers. .

In addition, according to an embodiment of the present invention, the accuracy / reliability of biosignal-based emotion measurement equipment is improved, the biosignal-based early prediction of dementia is improved, and the biosignal-based constitution (temperament) is improved. ), and create a blue ocean in the interactive content market through EEG measurement based on emotion origin.

2 is a diagram for illustrating determining the position of an EEG electrode on the surface of the head based on the emotional origin in the brain.

2, P (x, y, z) is the electrode position for measuring positive emotion, N (x, y, z) is the electrode position for measuring negative emotion, and A (x, y, z) represents the position of the electrode for measuring arousal. Here, (x, y, z) may be defined as MNI (Montreal Neurological Institute) coordinates.

In (a) of FIG. 2 , a thick dot in the center of the brain represents the amygdala associated with surprise/fear.

In (b) of FIG. 2, eight orthogonal coordinates (P ₀ , P ₁ , P ₂ , N ₀ , N ₁ , N ₂ , A ₀ , A ₁ ) of MNI orthogonal coordinates (Cartesian coordinate system) corresponding to the origin of emotion are assigned to the left side of the brain. is shown in terms of In (b) of FIG. 2 , y and z coordinates of N ₁ (49, 9, 24) and N ₂ (−38, 9, 24) coincide with each other, indicating only N ₁ .

In (c) of FIG. 2, the amygdala composed of left and right parts is shown.

In (d) of FIG. 2, the MNI Cartesian coordinate system is shown.

2(e) shows eight MNI orthogonal coordinates (Cartesian coordinate system) corresponding to the emotional origin (P ₀ , P ₁ , P ₂ , N ₀ , N ₁ , N ₂ , A ₀ , A ₁ ) from the upper side. it is shown In (e) of FIG. 2, only P ₁ is shown because the y-coordinates of P ₁ (0, 58, -10) and P ₂ (0, 58, 4) coincide with each other.`

FIG. 2(f) shows a diagram in which axes x, y, and z of a Cartesian coordinate system are rotated to coincide with FIG. 2(e) in a spherical coordinate system implemented in MATLAB. In (f) of FIG. 2, small and dark circles are expressed as emotional sources in the brain, and softer and larger circles are expressed as electrode positions on the surface of the sphere.

In (f) of FIG. 2, the positions of the electrodes for measuring positive sensitivity are P ₀ (-41, 21, 48), P ₁ (0, 58, -10), and P ₂ (0, 58, 4), The electrode positions for negative sensitivity measurement are N ₀ (49, 33, -2), N ₁ (49, 9, 24), N ₂ (-38, 9, 24), and the electrode positions for arousal measurement It is exemplified that A ₀ (-4, 52, 19), A ₁ (30, 18, -17).

As shown in (f) of FIG. 2, the coordinates P ₀ , P ₁ , P ₂ corresponding to positive emotion are located in the left frontal lobe, while the coordinates N ₀ , N ₁ corresponding to negative emotion are located in the right frontal lobe. It is herpes. Exceptionally, since N ₂ of negative emotion also exists in the left frontal lobe, in order to exclude the contribution of N2 when evaluating positive emotion, the emotion evaluation apparatus 100 may apply an exclusive OR. That is, the emotion evaluation device 100 may apply an exclusive OR so that the emotion response electrodes on the surface of the head respond only to positive or negative emotion origins.

In addition, the fact that most of the emotional origins corresponding to negative emotions in FIG. 2 (f) are located in the right frontal lobe is consistent with previous studies that the right amygdala is particularly sensitive to negative emotions, so the emotion according to the present invention The validity of the electrode arrangement for measurement can be demonstrated.

3 is a diagram showing an example of fMRI activated in response to emotional stimuli.

3 (a) and (d) show fMRI in which the upper left region of the frontal lobe and the lower middle region of the forehead are activated due to emotional stimuli that induce pleasure (positive emotion), and (b) shows displeasure (negative emotion) ) shows an fMRI in which the lower right region of the frontal lobe is activated due to emotional stimuli that induce an arousal state, and (c) shows an fMRI in which the upper middle region is activated due to an emotional stimulus inducing an arousal state.

[Table 1]

Table 1 exemplifies a matrix for emotion evaluation for classifying pleasure/displeasure/arousal by applying an exclusive logical sum in simultaneously measuring EEG and facial EMG based on emotion origin.

Referring to Table 1, only the emotional stimulus related to pleasure is related to the electrodes located at the coordinates of the P series for brain waves and the M1 coordinates for facial EMG. Similarly, the electrodes located at the coordinates of the N series of EEG and the M2 coordinates of the facial EMG are associated only with emotional stimuli related to discomfort.

That is, in the present invention, in evaluating pleasant-unpleasant emotions by measuring EEG and facial EMG, exclusive OR (XOR) can be applied to exclude cases in which different emotional sources overlap and contribute to the same electrode location.

In the pleasure-discomfort EEG response, by applying the exclusive logical sum (XOR), only when the electrodes corresponding to the pleasure-emotional source respond significantly, among the electrodes, it is evaluated as a pleasure-emotional response, and the electrodes corresponding to the unpleasant-emotional source are evaluated. It can be evaluated as discomfort-sensibility only when it responds significantly ( p <.05).

For example, if the alpha band power is significantly reduced in each of P ₀ , P ₁ , and P ₂ ( P <.05), and the change in alpha band power is not significant in each of N ₀ , N ₁ , and N ₂ ( P >.05), since the power of the alpha band at any electrode position is inversely proportional to the degree of cortical activation at that position, it means that the cortex at each position of P ₀ , P ₁ , and P ₂ is activated, and this region is Since the electrode position corresponds to the source of pleasure-emotion, it can be evaluated that the person felt pleasure-emotion.

If, in each of N ₀ , N ₁ and N ₂ , the alpha band power decreases significantly ( P <.05), and if the change in alpha band power is not significant in each of P ₀ , P ₁ , and P ₂ ( P > .05), it means that the cortex at each location of N ₀ , N ₁ , and N ₂ is activated, and since this area is the electrode location corresponding to the source of discomfort-sensibility, it can be evaluated that it felt discomfort-sensibility.

In the pleasure-discomfort evaluation of the facial EMG, the stronger the EMG, the more activated the region. For the pleasure-discomfort evaluation, the same exclusive OR (XOR) can be applied to the EMG in M1 and M2 as for the emotional evaluation from EEG.

Finally, the emotion evaluation device 100 of the present invention, the alpha band power of the brain wave (pleasure/discomfort: X-axis, arousal: Y-axis) and the intensity of the face EMG (pleasure/unpleasure: X-axis) Its accuracy and reliability can be evaluated by evaluating whether it is consistent with the 5-point scale of the psychological response.

4 is a diagram showing the results of emotion evaluation using EEG electrode placement on the surface of the head based on emotion origins in the brain according to the present invention.

In FIG. 4, the results of emotion measurement when viewing abstract art of neoplasticism (AbNP) and Kandinsky's representative expressionism (abstract art of expressionism: AbEX) as abstract paintings was expressed as SPECTROGRAM (X-axis: time, Y-axis: frequency, color: Power).

The AbNP is neoplasticism, which is a work that suppresses the artist's emotion in abstract painting, and the AbEX, which is expressionism, can mean a work that expresses the artist's emotion in abstract painting.

Figure 4(a) shows a comparison of alpha-band power in the left prefrontal cortex in a stable state (left) and when appreciating a Mondrian abstract painting (right). As shown in (a) of FIG. 4, the evaluation result shows that the alpha-band power in the left prefrontal cortex when appreciating the Mondrian abstraction (right) is lower than that in the resting state (left).

Figure 4(b) shows a comparison of the alpha band power in the left prefrontal cortex in a stable state (left) and when appreciating Kandinsky's abstraction (right). As shown in (b) of FIG. 4, the alpha-band power in the left prefrontal cortex at the time of appreciation of Kandinsky's abstraction (right) shows lower evaluation results than in the resting state (left).

Figure 4(c) shows a comparison of the alpha-band power in the right prefrontal cortex in a stable state (left) and when appreciating a Mondrian abstract painting (right). As shown in (c) of FIG. 4, the alpha-band power in the right prefrontal lobe when appreciating the Mondrian abstraction (right) shows lower evaluation results than in the resting state (left).

Figure 4(d) shows a comparison of alpha-band power in the right prefrontal cortex in a stable state (left) and when appreciating Kandinsky's abstraction (right). As shown in (d) of FIG. 4, the alpha-band power in the right prefrontal cortex at the time of appreciation of Kandinsky's abstraction (right) shows lower evaluation results than in the resting state (left).

Figure 4(e) compares the alpha band power in the upper part of the forehead in the stable state (left) and when viewing the Mondrian abstract painting (right). As shown in (e) of FIG. 4, the alpha band power in the upper part of the center of the forehead when viewing the Mondrian abstraction (right) shows an evaluation result that is lower than that in the stable state (left).

Figure 4(f) compares the alpha band power in the upper part of the forehead in the stable state (left) and when appreciating Kandinsky's abstract painting (right). As shown in FIG. 4(f), the alpha band power in the upper part of the center of the forehead when appreciating Kandinsky's abstract painting (right) shows lower evaluation results than in the stable state (left).

5 is a diagram for comparing Heller's EEG-based emotion model (a) and Montreal Neurological Institute (MNI) coordinate system (b).

Heller's EEG-based emotion model in (a) of FIG. 5 can be expressed as a two-dimensional plane consisting of an x-axis for arousal and a y-axis for pleasant/unpleasant. Happy, anxious, depressed, and calm are sequentially assigned to each quadrant in this two-dimensional plane in the order of quadrants I, II, III, and IV, and can be used for emotional evaluation of the subject.

The MNI Cartesian coordinates of FIG. 5 (b) represent the subject's head in a three-dimensional Cartesian coordinate system of x, y, and z, and the x-axis passing through the subject's right ear, the y-axis passing through the subject's forehead, and the subject's It may consist of a z-axis passing through the crown of the head.

[Equation 1]

[Formula 2]

[Formula 3]

[Formula 4]

[Formula 5]

P _n (r) ≡ mean power ratio

P _n (θ) ≡ theta-band power; P _n (α) ≡ alpha-band power ; P _n (β) ≡ beta-band power

P _n (t) ≡ {P _n (θ) + P _n (α) + P _n (β)}: total power at electrode n

Aff(Va.c), Aff(Ar.c): conventional indices for affective-valence and affective-arousal (based on Heller et al., 1997 paper)

Aff(Va.n) , Aff(Ar.n): novel indices for affective-valence and affective-arousal (based on Dolcos et al., 2004 paper)

In [Equation 1], P _n (r) is the average power ratio at electrode number n of 128 channels, and can indicate the degree of activation of the brain cortex at this position. That is, the alpha band (8-13 Hz) power P _n (α) at electrode position n needs to be divided by the total power P _n (t) to reduce individual differences. Since the degree of activation of the brain cortex and the power of the alpha band are in inverse proportion, it is finally expressed as [Equation 1].

[Equation 2] is a formula for affective-valence calculated based on the Heller model used by most EEG researchers.

[Equation 3] converts the MNI Cartesian coordinates (Cartesian coordinate system) corresponding to the origin of affective-valence from the fMRI paper of Dolcos et al. (2004) into a spherical coordinate system, and then converts the corresponding This is the formula for the affective-valence calculated for the electrodes of the position.

[Equation 4] is an equation for affective-arousal calculated based on the Heller model.

[Equation 5] converts the MNI Cartesian coordinates (Cartesian coordinate system) corresponding to the origin of affective-arousal from the fMRI paper of Dolcos et al. (2004) into a spherical coordinate system, and then converts the corresponding This is the formula for the affective-arousal calculated for the electrode at the location.

Looking at the affective-valence calculated from [Equation 1] and [Equation 2] based on the Heller model from the EEG measured with 128 channels, Aff (Va.c) increased when listening to Mondrian abstraction (AbNP) compared to the resting state. There is no significant difference between the degree and the degree of increase in Aff (Va.c) when appreciating the Kandinsky abstraction (AbEX) ( p >.05). That is, there is no interaction between Session and Group.

In addition, by converting the MNI Cartesian coordinates (Cartesian coordinate system) corresponding to the origin of affective-valence from the fMRI paper of Dolcos et al. (2004) into a spherical coordinate system, the electrodes at the corresponding positions in the 128-channel (10-10 system) electrode arrangement , there is no interaction between Session and Group even in the case of affective-valence calculated from [Equation 1] and [Equation 3], that is, Aff(Va.n). There is no significant difference in affective-valence for the two abstractions in subjective evaluation ( p >.05).

In the present invention, standard electrode locations are not used as EEG electrode positions on the surface of the head, but are rearranged to correspond to emotional origins, and power is calculated only when pleasant or unpleasant emotions contribute to the corresponding electrodes by using exclusive OR (XOR). made to be considered.

In addition, by assuming the head as a sphere of a homogeneous medium, the present invention is intended to solve the problem that the position of the EEG electrode on the surface of the sphere corresponding to the emotional origin may not be the most sensitive position to the actual emotional origin.

That is, since the position of the surface of the sphere corresponding to the emotional origin may not be the most sensitive position to the emotional origin by assuming the head as a sphere of a homogeneous medium, the emotion evaluation device 100 converts the sphere into a spherical coordinate system having a constant radius r Through independent component analysis (ICA), which uses 8 emotional sources in the brain as independent EEG generators so that the points on the surface are most sensitive to the corresponding emotional sources in the brain, each of the 8 head surface electrodes corresponds to the corresponding emotion in the brain. The position can be corrected so that it is most sensitive to the source (that is, so that each of the EEG electrodes on the surface of the head best reflects the contribution of each corresponding emotional source in the brain).

The affective-arousal calculated from [Equation 1] and [Equation 4] is the degree of increase in Aff(Ar.c) when viewing Mondrian abstraction (AbNP) compared to the stable state, and Aff (Ar.c) when viewing Kandinsky abstraction (AbEX). There is no significant difference between the degree of increase in .c) ( p >.05). That is, there is no interaction between Session and Group.

However, in the case of affective-arousal calculated from [Equation 1] and [Equation 5], compared to the stable state, the degree of increase in Aff (Ar.n) when watching Mondrian abstraction (AbNP) and when watching Kandinsky abstraction (AbEX) There is a significant difference between the degree of increase in Aff(Ar.n) ( p < .05). That is, there is interaction between Session and Group.

This result can be in good agreement with the results that showed a significant difference in subjective evaluation ( p <.05).

Hereinafter, in FIG. 6, a workflow of the emotion evaluation device 100 according to embodiments of the present invention will be described in detail.

The emotion evaluation method according to the present embodiment may be performed by the emotion evaluation device 100 .

6 is a flowchart illustrating a sentiment evaluation method according to an embodiment of the present invention.

First, the emotion evaluation device 100 identifies the emotional origin point in the brain from functional magnetic resonance imaging (fMRI) obtained by photographing the subject's head, and then determines the emotional response electrode positions on the surface of the head based on this. Do (610). In step 610, from functional magnetic resonance imaging (fMRI) of the subject, emotional origin sites activated according to each of the subject's emotional stimuli of pleasure, displeasure, and awakening are searched in the brain, and the found emotional origin positions are MNI (Montreal Neurological Institute), it can be a process of converting the electrode positions on the surface of the head into a spherical coordinate system to correspond to the emotional origin in the brain based on this after expressing it in a Cartesian coordinate system.

The functional magnetic resonance imaging (fMRI) is a technology for measuring brain activity by detecting changes related to blood flow, and may be an imaging technology designed based on the fact that when a brain region is activated, the amount of blood flow flowing into that region increases.

The electrode may be attached to the surface of the subject's body and may be a means for acquiring biosignals such as brain waves and electromyography from the subject.

The emotion evaluation device 100 searches for the brain region activated for a specific emotion with MNI orthogonal coordinates in the brain from functional magnetic resonance imaging (fMRI), converts the MNI coordinates into spherical coordinates, and converts the MNI coordinates into spherical coordinates to form an electrode where electrodes are placed on the surface of the head. location can be determined.

To this end, the emotion evaluation device 100 may model the subject's head as a sphere of a homogeneous medium. That is, the emotion evaluation device 100 expresses emotional origins in the brain activated by emotion in functional magnetic resonance imaging (fMRI) as MNI orthogonal coordinates, and then converts these emotion origins into spherical coordinates in a sphere model of a homogeneous medium. Then, in order to attach electrodes to the head surface, the electrode positions can be placed on the surface of the sphere model by making the radii r of all spherical coordinates in the sphere model the same.

In the modeling, the emotion evaluation device 100, in a state in which a hat in the form of a net is put on the head of the subject, on the hat, a scale from 1 degree to 360 degrees in a counterclockwise direction based on the right ear of the head can be marked. That is, the emotion evaluation apparatus 100 may mark 360 vertical virtual longitude lines on the surface of the hat after covering the target person with a hat in the form of a net, with the right ear at 0 degrees.

In addition, the emotion evaluation device 100 may mark a virtual latitude line ranging from 1 degree to 120 degrees in a downward direction based on the crown of the head. That is, the emotion evaluation device 100 may mark 120 virtual latitude lines in the horizontal direction with the top of the head at 0 degrees on the surface of the hat in the form of a mesh covering the subject.

Thereafter, the emotion evaluation device 100 may model the head into the spherical shape using a net-shaped hat composed of virtual latitude lines and virtual longitude lines. That is, the emotion evaluation device 100 may place EEG electrodes on the surface of a hat covered with a net, at points reflecting the source of emotion in the brain among points where the virtual latitude line and the virtual longitude line intersect.

The cap may use an elastic material so that the 120 virtual latitude lines are equally spaced and the 360 virtual longitude lines are equally spaced regardless of the size of the head. That is, the hat in the form of a mesh may be made of a material (eg, PBT material, etc.) such that the distances between the virtual latitude lines and the virtual longitude lines constituting the mesh are maintained at equal intervals regardless of the head size of the subject.

In addition, the emotion evaluation device 100 matches the center of the mesh hat with the origin of MNI (Montreal Neurological Institute) orthogonal coordinates, and then determines the emotional stimuli of pleasure, displeasure, and awakening in the functional magnetic resonance imaging (fMRI). MNI Cartesian coordinates S _n (x _n , y _n , z _n ) of the responding emotion origins in the brain (where n is at least one of 1 to 8) can be identified as an emotion origin point in the brain.

That is, the emotion evaluation device 100 partitions the functional magnetic resonance imaging (fMRI) standardized into a spherical shape into the MNI Cartesian coordinate system, and the point activated according to the subject's feeling of pleasure, discomfort, or arousal is defined as the MNI Cartesian coordinate S _n ( x _n , y _n , z _n ).

MNI (Montreal Neurological Institute) Cartesian coordinates are a coordinate system created based on numerous MRI images, and may be a system created by realigning other images on a plate obtained by averaging 305 MRI images in the same manner as, for example, a Talairach map.

In the present invention, the MNI orthogonal coordinates of positive emotion in response to the emotional stimulus of pleasure are S ₁ (x ₁ , y ₁ , z ₁ ), S ₂ (x ₂ , y _{2 )} , with n being 1 to 3. , z ₂ ), S ₃ (x ₃ , y ₃ , z ₃ ), and the MNI orthogonal coordinates of the negative emotion in response to the unpleasant emotional stimulus are S ₄ (x ₄ , y having n between 4 and 6) ₄ , z ₄ ), S ₅ (x ₅ , y ₅ , z ₅ ), S ₆ (x ₆ , y ₆ , z ₆ ), and the MNI orthogonal coordinates of the degree of arousal in response to the emotional stimulus of the arousal are n It may be S ₇ (x ₇ , y ₇ , z ₇ ) or S ₈ (x ₈ , y ₈ , z ₈ ) having 7 to 8.

Thereafter, the emotion evaluation apparatus 100 may convert the MNI rectangular coordinates S _n (x _n , y _n , z _n ) into spherical coordinates E _n (r _n , θ _n , φ _n ). That is, the emotion evaluation device 100 converts the MNI 3-dimensional orthogonal coordinates S _n (x _n , y _n , z _n ) into spherical coordinates E _n (r _n θ _n , φ _n ) by converting the coordinate system to obtain the actual head shape It can be expressed in spherical coordinates in three dimensions similar to

At this time, since r _n does not reflect the subject's head size, the emotion evaluation apparatus 100 obtains E _n' (r _n' , θ _n , φ _n ) so that r _n' reflects the subject's head size. E _n' can be used as the location of the emotional response electrode considering the subject's head size. That is, the emotion evaluation device 100 has an angle θ _n (corresponding to geographical 'latitude') away from the positive z-axis and an angle φ _n (corresponding to geographic 'longitude') away from a point on the sphere in the counterclockwise direction of the z-axis. Corresponding to), it is possible to express the electrode position where the electrode is actually disposed.

In addition, the emotion evaluation device 100 performs independent component analysis (ICA) on the positional error due to conversion from the MNI orthogonal coordinates to the coordinates of the emotional response EEG electrodes on the surface of a sphere modeling the subject's head in a homogeneous sphere shape. can be corrected through

Independent Component Analysis (ICA) is a calculation method for separating multivariate signals into statistically independent sub-components, and may be an analysis method for separating different types of signals.

That is, the emotion evaluation device 100 has eight emotional response EEG electrode positions E _{1', .} . . distributed on the surface of the spherical model through independent component analysis (ICA). _, E _8' Eight independent emotional origins contributing to each S _1, ... _, S ₈ and then E _1', . . . E'_{1' , . ,} E'_8' again. That is, E'_1' is most sensitive to S ₁ . E'_8' can minimize errors in the positions of the emotional response EEG electrodes derived by finally adjusting the positions of the emotional response EEG electrodes to be most sensitive to S ₈ .

In addition, the emotion evaluation device 100 evaluates the emotion of the subject based on the biosignal input through the electrode attached to the electrode position (620). Step 620 may be a process of estimating what emotion the subject currently has, using biosignals collected by electrodes attached to the surface of the head where emotional stimuli of pleasure, displeasure, and awakening are directly generated. there is.

That is, with respect to the biological signals collected at the finally determined emotional response EEG electrode position E'_1'(r'_1' , θ' ₁ , φ' ₁ ), the emotion evaluation device 100 responds to the emotional stimulus of pleasure and produces It can be estimated that the subject has a positive emotion.

In addition, with respect to the biosignal collected at the spherical electrode position E'_5'(r'_5' , θ' ₅ , φ' ₅ ), the evaluation unit 120 assumes that it is produced in response to an emotional stimulus of discomfort, , it can be evaluated that the subject felt negative emotion.

In addition, for the biosignals collected at the spherical electrode position E'_7'(r'_7' , θ' ₇ , φ' ₇ ), the evaluation unit 120 assumes that they are produced in response to the emotional stimulus of awakening, , the subject can be evaluated as aroused.

Depending on the embodiment, the emotion evaluation device 100 may specify one type of stimulus input from the disposed electrode.

To this end, the emotion evaluation device 100 generates an exclusive logical sum (eXclusive OR, XOR) when a biosignal input through an electrode attached to the electrode position is simultaneously related to two or more emotion sources among pleasure, displeasure, and arousal. ), it is possible to maintain only one emotional origin.

That is, even if the biosignal collected through one electrode is generated by a plurality of sources of emotion, the emotion evaluation device 100 selects only the mainstream emotion related to the placement of the electrode, so that the emotion evaluation related to the biosignal is performed. It can be made more precise.

For example, when the biosignal collected at the electrode position E'_1'(r'_1' , θ' ₁ , φ' ₁ ) related to the emotional stimulus of pleasure is related to the emotional origin of not only pleasure but also discomfort, emotion evaluation The apparatus 100 may apply an exclusive OR so that, except for emotional origins of discomfort, only mainstream sentimental origins of pleasure are maintained in the bio-signal.

In addition, the emotion evaluation device 100 may acquire various information such as facial electromyogram, electrocardiogram, psychological rebound, etc., and utilize them for emotion evaluation.

When the facial EMG is obtained, the emotion evaluation apparatus 100 may increase the reliability of the pleasure/discomfort evaluation by performing the emotion evaluation in consideration of the facial EMG.

A facial EMG may refer to a signal for recording electrical activity inside facial muscles using electrodes, a signal for measuring facial nerve conduction speed by electrical stimulation, and the like.

The emotion evaluation apparatus 100 may perform emotion evaluation of the subject with high reliability by further considering the state of the facial muscles of the subject by facial electromyography.

In addition, when the electrocardiogram is acquired, the emotion evaluation device 100 analyzes the heart rate variability (HRV) and Poincare plot from the electrocardiogram to evaluate arousal corresponding to the activation degree of the sympathetic nervous system.

An electrocardiogram (ECG) may refer to a signal recording an action voltage generated in a myocardium according to heartbeat.

When the ECG is obtained as a raw signal through the electrodes placed on the subject, the emotional evaluation device 100 of the present invention can visualize it by showing it as a heart rate variability (HRV) and a Poincare Plot.

In addition, when a psychological response using a questionnaire is obtained, the emotion evaluation apparatus 100 may evaluate the consistency of the emotional evaluation performed in consideration of the psychological response.

That is, the emotion evaluation device 100 may determine whether the subject's emotional state is consistent with the result of the emotion evaluation by measuring the bio-signal previously performed by grasping the subject's emotional state according to the answers to the questionnaire. Through this, the emotion evaluation device 100 can prove the integrity of the emotion evaluation performed.

According to one embodiment of the present invention, emotional origins corresponding to emotional stimuli of pleasure, displeasure, and awakening are found as activated parts of functional magnetic resonance imaging (fMRI), and the found locations in the brain are represented by MNI orthogonal coordinates. It is possible to provide an emotion evaluation method and device based on EEG electrode placement on the head surface based on emotion origins in the brain, which can derive the position of the emotional response electrode on the head surface in spherical coordinates.

In addition, according to an embodiment of the present invention, by applying an exclusive logical sum (XOR) at the emotional response electrode position to exclude overlapping contributions of different emotional origins, the accuracy of emotional evaluation is increased and the consistency of psycho-physiological-behavioral responses is increased. can be evaluated to increase reliability.

In addition, according to an embodiment of the present invention, dementia due to atrophy of the hippocampus in charge of memory due to depression can be predicted at an early stage by utilizing a biosignal-based emotion evaluation algorithm.

In addition, according to one embodiment of the present invention, it is possible to evaluate personality and constitution (temperament) according to emotional stimulation-response, provide interactive contents that can communicate with humans, and evaluate stress caused by emotional dissonance of emotional workers. .

In addition, according to an embodiment of the present invention, the accuracy/reliability of bio-signal-based emotional measurement equipment is improved, the bio-signal-based early prediction of dementia is improved, and the bio-signal-based constitution/temperament is improved. It is possible to improve classification accuracy/reliability for and create a blue ocean in the interactive content market through EEG measurement based on emotion origin.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. The device can be commanded. Software and/or data may be any tangible machine, component, physical device, virtual equipment, computer storage medium or device, intended to be interpreted by or provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques may be performed in an order different from the method described, and/or the components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

100: emotion evaluation device
110: processing unit 120: evaluation unit
130: acquisition unit

Claims (19)

In the emotion evaluation evaluation method implemented by the emotion evaluation device,
modeling the subject's head into a spherical shape of a homogeneous medium in the processing unit of the emotion evaluation device;
In the processing unit, after matching the center of the sphere with the origin of MNI (Montreal Neurological Institute) Cartesian coordinates, each emotion of pleasure, discomfort, and arousal in functional magnetic resonance imaging (fMRI) obtained by photographing the subject's head The spherical MNI Cartesian coordinates S _n (x _n , y _n , z _n ) (where n is at least one of 1 to 8) in response to stimuli are the emotional origin points of pleasure, displeasure, and awakening in the brain. identifying as;
Converting, by the processor, the MNI Cartesian coordinates S _n (x _n , y _n , z _n ) on the sphere into spherical coordinates E _n (r _n , θ _n , φ _n ) in the spherical model;
In the processing unit, in order to arrange the spherical coordinates E _n (r _n , θ _n , φ _n ) in the spherical model on the surface of the head, the spherical coordinates E _{n '} ( r _n' , θ _n , φ _n ) to determine the position of the electrode on the head surface; and
In the evaluation unit of the emotion evaluation device, among the electrodes attached to the electrodes, pleasure, displeasure, and arousal for the subject are determined by using electrode positions of electrodes that collect biosignals by responses to emotional origins of pleasure, displeasure, and awakening. The step of evaluating each emotion of displeasure and arousal
including,
Evaluating each emotion of pleasure, displeasure, and arousal for the subject using the electrode position of the electrode,
estimating that the biosignals collected at the electrode positions E _1' (r _1' , θ ₁ , φ ₁ ) are produced in response to emotional stimuli of pleasure and evaluating them as positive emotions;
estimating that the biosignal collected at the electrode position E _5' (r _5' , θ ₅ , φ ₅ ) is produced in response to an emotional stimulus of discomfort and evaluating it as negative emotion; and
Evaluating biosignals collected at the electrode location E _7' (r _7' , θ ₇ , φ ₇ ) as arousal by estimating that they are produced in response to emotional stimuli of arousal
An emotional evaluation method based on EEG electrode placement based on emotional origins in the brain including. delete According to claim 1,
The modeling step is
In a state where a net-shaped hat is put on the subject's head,
Marking a virtual longitude line from 1 degree to 360 degrees in a counterclockwise direction based on the right ear of the head on the net-shaped hat;
marking an imaginary line of latitude from 1 degree to 120 degrees in a downward direction based on the crown of the head on the net-shaped hat; and
Modeling the head in the spherical shape using a net-shaped hat composed of the virtual latitude line and the virtual longitude line
An emotional evaluation method based on EEG electrode placement based on emotional origins in the brain including. According to claim 3,
the hat,
Regardless of the size of the head, elastic materials are used so that the distance between each of the virtual latitude lines and each of the virtual longitude lines is equal.
An emotional evaluation method based on EEG electrode placement based on emotional sources in the brain. According to claim 1,
The step of determining the position of the electrode,
A process of arranging the spherical coordinates on the surface of the spherical model to determine the position of the electrode on the surface of the subject's head after conversion from MNI Cartesian coordinates on the sphere to spherical coordinates in the spherical model through independent component analysis (ICA) Step of correcting the positional error generated in
EEG electrode placement-based emotion evaluation method based on emotional origins in the brain further comprising. delete According to claim 1,
The EEG electrode placement-based emotion evaluation method,
When a biosignal input through an electrode attached to the electrode position is simultaneously related to two or more emotional sources among pleasure, displeasure, and arousal,
Maintaining one emotion origin by applying an exclusive OR (XOR) in the processing unit of the emotion evaluation device
EEG electrode placement-based emotion evaluation method based on emotional origins in the brain further comprising. According to claim 1,
The EEG electrode placement-based emotion evaluation method,
acquiring an electrocardiogram from the target person in the acquisition unit of the emotion evaluation device; and
In the evaluation unit, analyzing heart rate variability (HRV) and Poincare plot from the electrocardiogram to evaluate arousal corresponding to the degree of activation of the sympathetic nervous system.
EEG electrode placement-based emotion evaluation method based on emotional origins in the brain further comprising. According to claim 1,
The EEG electrode placement-based emotion evaluation method,
acquiring a psychological response using a questionnaire from the target person in the acquisition unit of the emotion evaluation device; and
In the evaluation unit, evaluating whether the alpha band power of the brain wave (pleasure/discomfort: X-axis, arousal: Y-axis) is consistent with the 5-point scale of psychological response
EEG electrode placement-based emotion evaluation method based on emotional origins in the brain further comprising. A functional magnetic resonance image obtained by modeling the subject's head as a spherical in a homogeneous medium, matching the center of the sphere with the origin of MNI (Montreal Neurological Institute) orthogonal coordinates, and then photographing the subject's head. In (fMRI), the spherical MNI orthogonal coordinates S _n (x _n , y _n , z _n ) (where n is at least one of 1 to 8) responding to each of the emotional stimuli of pleasure, displeasure, and awakening are captured in the brain. , Pleasure, Displeasure, and Awakening are identified as the emotional origin points, and MNI Cartesian coordinates S _n (x _n , y _n , z _n ) on the sphere are spherical coordinates E _n (r _n , θ _n , φ _n ), and the spherical coordinates E _n (r _n , θ _n , φ _n ) in the spherical model are modified to be r _n' reflecting the head size of the subject in order to place the spherical coordinates E n (r n , θ n , φ n ) on the surface of the head. a processing unit that derives _n' (r _n' , θ _n , φ _n ) to determine the position of the electrode on the head surface; and
Of the electrodes attached to the electrode position, using the electrode position of the head surface electrode that collects the biosignal by the emotional origin response of pleasure, discomfort, and awakening, Evaluate the emotions of each of the pleasure, discomfort, and awakening of the subject evaluation department
including,
The evaluation unit,
Regarding the biosignal collected at the electrode position E _1' (r _1' , θ ₁ , φ ₁ ), it is estimated that it was produced in response to the emotional stimulus of pleasure and evaluated as positive emotion;
Regarding the biosignal collected at the electrode position E _5' (r _5' , θ ₅ , φ ₅ ), it is estimated that it is produced in response to an emotional stimulus of discomfort and evaluated as negative emotion,
Regarding the biosignals collected at the electrode position E _{7 '} (r _7' , θ ₇ , φ ₇ ), it is estimated that they are produced in response to emotional stimuli of arousal and evaluated as arousal.
An emotional evaluation device based on EEG electrode placement based on emotional sources in the brain. delete According to claim 10,
The processing unit,
In a state where a net-shaped hat is put on the subject's head,
On the net-shaped hat, a virtual longitude line from 1 degree to 360 degrees is marked in a counterclockwise direction based on the right ear of the head,
On the net-shaped hat, a virtual latitude line from 1 degree to 120 degrees is marked downward with respect to the crown of the head,
Modeling the head into the sphere using a net-shaped hat composed of the virtual latitude line and the virtual longitude line
An emotional evaluation device based on EEG electrode placement. According to claim 12,
the hat,
Regardless of the size of the head, elastic materials are used so that the distance between each of the virtual latitude lines and each of the virtual longitude lines is equal.
An emotional evaluation device based on EEG electrode placement. According to claim 10,
The processing unit,
A process of arranging the spherical coordinates on the surface of the spherical model to determine the position of the electrode on the surface of the subject's head after conversion from MNI Cartesian coordinates on the sphere to spherical coordinates in the spherical model through independent component analysis (ICA) correcting the positional error caused by
An emotional evaluation device based on EEG electrode placement. delete According to claim 10,
When a biosignal input through an electrode attached to the electrode position is simultaneously related to two or more emotional sources among pleasure, displeasure, and arousal,
The processing unit,
Applying exclusive logical sum (XOR) to maintain one emotional source
An emotional evaluation device based on EEG electrode placement. According to claim 10,
The EEG electrode placement-based emotion evaluation device,
Obtaining unit for obtaining an electrocardiogram from the subject
Including more,
The evaluation unit,
Analyzing heart rate variability (HRV) and Poincare plot from the electrocardiogram to evaluate arousal corresponding to the degree of activation of the sympathetic nervous system
An emotional evaluation device based on EEG electrode placement. According to claim 10,
The EEG electrode placement-based emotion evaluation device,
Acquisition unit for obtaining emotional response information from the subject using a questionnaire
Including more,
The evaluation unit,
In the evaluation unit, to evaluate whether the alpha band power of the brain wave (pleasure / displeasure: X-axis, arousal: Y-axis) is consistent with the 5-point scale of psychological response
An emotional evaluation device based on EEG electrode placement. According to claim 1,
In the emotional evaluation step,
Through the following [Equation 1] to [Equation 5], the step of evaluating the emotion of the subject
including,
[Formula 1] above,

, and Pn(r) in [Equation 1] is the average power ratio at electrode number n of 128 channels, and represents the degree of activation of the brain cortex at electrode number n of 128 channels,
[Formula 2] above,

[Equation 2] is a formula for affective-valence calculated based on the Heller model,
[Formula 3] above,

, and [Equation 3] converts the MNI Cartesian coordinates (Cartesian coordinate system) corresponding to the origin of affective-valence into a spherical coordinate system, and then for the electrodes at positions corresponding to the 128-channel (10-10 system) electrode arrangement It is a formula for the calculated affective-valence,
[Formula 4] above,

[Equation 4] is a formula for affective-arousal calculated based on the Heller model,
[Formula 5] above,

, and [Equation 5] converts the MNI Cartesian coordinates (Cartesian coordinate system) corresponding to the origin of affective-arousal into a spherical coordinate system, and then calculates the electrodes at positions corresponding to the 128-channel (10-10 system) electrode arrangement. modifier for an affective-arousal
An emotional evaluation method based on EEG electrode placement based on emotional sources in the brain.

Images