KR20180059388A - Method tracking affect triggering immersion based on affect vector by measuring biomedical signals in real-time - Google Patents

Abstract

The present invention relates to a method to track an immersion triggering emotion in real time based on an emotion vector by measuring a biometric signal, capable of inducing/triggering positive immersion. According to the present invention, the method to track an immersion triggering emotion in real time based on an emotion vector comprises a biometric signal measurement step of measuring a biometric signal of an examinee at a predetermined time interval; a step of analyzing the biometric signal of the examinee measured in the biometric signal measurement step to determine an attention step and a concentration step during an immersion progressing process of the examinee; a vectorization step of analyzing and vectorizing a biometric signal of the attention and concentration steps on a two-dimensional (2D) emotion plane to extract a 2D emotion vector; and a source emotion tracking step of analyzing the 2D emotion vector extracted in the vectorization step to estimate the direction and size of the emotion vector corresponding to an initial stage of entering the concentration step so as to determine a source emotion triggering immersion.

Description

[0001] The present invention relates to a method and a device for real-time tracking of an emotional vector based on an emotion vector using a bio-

The present invention relates to an emotional vector-based sensory-triggering emotional real-time tracking method using bio-signal measurement, and more particularly, to a method and apparatus for tracking emotions that induce entry by immersion, thereby suppressing negative entry, And to a real - time tracking method of emotional vector - based sensation triggering sensation using bio - signal measurement which can be induced by positive immersion entry.

Patients with post-traumatic stress disorder (PTSD) refer to patients who suddenly come up with shocked event memories and are nervous and nervous and do not want to go outside. The memory of gaming or gambling, as opposed to earning money or vice versa, is similar to the traumatic event memory of trauma. Individuals who are sensitive to the behavioral activation system (BAS) as a personal tendency are sensitive to compensation, and those with extreme BAS (BAS) types are very likely to become addicted to curiosity or adventurous psychology.

In this case, it is necessary to trace the emotions that trigger the poisoning, that is, the negative emotional entry, to grasp the causal emotions, and to facilitate the psychological counseling to heal the addicts according to the causal emotions. Purpose.

In this regard, there has been a study to classify the severity of immobility and the degree of event-induced dislocation of EEG (Jae-Yoon Lee, Kang, Bong-Kyung, Game and immersion analysis')

However, as suggested in the present invention, no research has been conducted to track the emotions that can inhibit the negative immersion process and induce / trigger positive immersion.

Korea Multimedia Society Volume 17 Issue 11 (November, 2014) pp.1325-1334 1229-7771 KCI

SUMMARY OF THE INVENTION The present invention has been made in order to solve the problems of the prior art as described above, and it is an object of the present invention to provide a method and apparatus for controlling intrusion, Time tracking method based on emotion vector based on bio-signal measurement which can be induced / triggered by intensive immersion.

The emotion-based triggering emotional real-time tracking method using bio-signal measurement according to an embodiment of the present invention includes a bio-signal measurement step of measuring a bio-signal of a subject at predetermined time intervals, a step of measuring a bio- Analyzing a biological signal to determine a care stage and a concentration stage of the process of immersion of the subject, analyzing the bio signal of the attention stage and the concentration stage, and vectorizing the biological signal to a two-dimensional sensing plane, Dimensional emotional vector derived from the vectorization step and evaluating the direction and magnitude of the emotional vector corresponding to the initial stage of entry into the concentration step to determine the causal emotion as the causal emotion of the immersion trigger .

Here, the bio-signal measurement step may utilize the bio-signal measurement, wherein the bio-signal of the frontal lobe and the bio-signal of the parietal lobe are used as the bio-signal of the subject.

The vectorization step may include calculating an asymmetric AS (Va) of the frontal lobe expressing pleasantness and an asymmetric AS (Ar) of the parietal lobe showing arousal-relaxation; And calculating the emotion vector Aff (x, y) representing the pleasure-discomfort as the x-coordinate on the two-dimensional sensibility plane and the y-coordinate of the arousal-relaxation on the two-dimensional sensibility plane, respectively.

The asymmetric AS (Va) of the frontal lobe is calculated from the following equation (1), and the asymmetric AS (Ar) of the parietal lobe exhibiting arousal-relaxation can be calculated from the following equation (2).

Further, the emotion vector Aff (x, y) can be calculated from the following equation (3).

In the step of determining the attention and concentration steps, when the subject's biological signal increases in respiratory-gating arrhythmia and at the same time the power of the 8-10 Hz alpha wave band EEG decreases in the frontal lobe, the RSA The power of the 8-10 Hz Alfa wave band EEG is further reduced and the intensity of the EEG power of the right parietal lobe of the 8-13 Hz Alfa band decreases.

The emotional vector-based immersion triggered emotional real-time tracking method using the bio-signal measurement of the present invention as described above can determine the causal emotions of negative immersion by tracking the emotions that trigger entry by immersion, thereby suppressing the negative immersion progress And it can induce / stimulate positive immersion which can show a distinctiveness in a specific field.

In addition, there is an advantage that it is possible to facilitate the counseling / psychological healing of the addiction according to the causal emotions by using the causal emotion which is presumed to be the emotional triggering the immersion.

More specifically, the emotion vector can be derived using the bio-signal measurement value of the brain wave to determine the immersion progress information with respect to time. Thus, the technology for solving the problem of social addiction can be secured, Not only can it partially contribute to alleviating socioeconomic costs, but it can also partially help to heal about 2 million gambling addicts annually.

FIG. 1 is a flow chart illustrating an immersion process of a sensory vector-based immersion-triggered emotional real-time tracking method using bio-signal measurement according to an embodiment of the present invention.
FIG. 2 shows five regions for attention / concentration, pleasure-unpleasantness, and arousal-relaxation evaluation in a 64-channel electrode placement montage, and shows electrode positions of 10-20 electrode systems at important positions of these regions.
FIG. 3 is a diagram illustrating a two-dimensional emotional structure of Feldman Barrett and Russell expressing an emotional vector corresponding to a careful step and a concentrated step of a sensory real-time tracking method based on an emotion vector based on an emotion vector according to an embodiment of the present invention. Fig.
FIG. 4 is a graph showing a measurement value of a bio-signal and a change of an emotion vector according to a bio-signal measurement value in an emotion-based triggered emotional real-time tracking method using bio-signal measurement according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an emotional vector-based immersion triggering emotion real-time tracking method using bio-signal measurement according to the present invention will be described in detail with reference to the accompanying drawings. The following drawings are provided by way of example so that those skilled in the art can fully understand the spirit of the present invention. Therefore, the present invention is not limited to the following drawings, but may be embodied in other forms. In addition, like reference numerals designate like elements throughout the specification.

In this case, unless otherwise defined, technical terms and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. In the following description and the accompanying drawings, A description of known functions and configurations that may unnecessarily obscure the description of the present invention will be omitted.

FIG. 1 is a flow chart showing a process of immersion progress of a sensory vector-based sensory real-time tracking method based on emotion vector using bio-signal measurement according to an embodiment of the present invention. FIG. FIG. 3 is a graph showing the five areas for the arousal-relaxation evaluation and showing the positions of the electrodes of the 10-20 electrode system at important positions of the regions. FIG. FIG. 4 is a view showing 'a two-dimensional sensibility structure of Feldman Barrett and Russell' expressing an emotional vector corresponding to a caution phase and a concentrated phase of the immersion-triggered real-time tracking method in Hangul, and FIG. 4 is a view showing a biometric signal according to an embodiment of the present invention. A sensory vector based impression-triggered emotion real-time tracking method using a measurement, and a sensitivity vector change according to a bio-signal measurement value.

The sensory vector-based immersion triggered emotional real-time tracking method using the bio-signal measurement according to an embodiment of the present invention tracks the process of immersion of the subject using the immersion-related multidimensional bio-signal measurement system, The present invention relates to an emotional vector-based immersion triggering emotion real-time tracking method using bio-signal measurement capable of facilitating the counseling / psychotherapy of addiction based on the emotional cause of the subject.

In addition, it is possible to trace the process of the immersion of the subject in real time, which can lead to a positive immersion state in which negative progress can be suppressed and a certain area can stand out. Thus, the problem of social addiction such as gambling industry and illegal gambling can be solved It is expected to be utilized as the base technology of

The emotion-based triggering emotional real-time tracking method using the bio-signal measurement according to an embodiment of the present invention analyzes bio-signals of a subject measured at a bio-signal measurement step of the subject and the bio-signal measurement step, A vectorization step of extracting a two-dimensional emotion vector by analyzing a bio-signal of the attention step and a concentrated step, and vectorizing the two-dimensional emotion plane by a vectorization step derived from the vectorization step, Dimensional emotional vector, evaluating the direction and size of the emotional vector corresponding to the initial stage of entering the concentration step, and judging the emotional vector as the causal emotion of the immersion trigger.

FIG. 1 is a flowchart showing a process of a general human being's immersion process. As shown in FIG. 1, in order to enter the concentration stage after the stage of attention, the stage of caution, a sensation of spontaneous or positive immersion is required. The reason for this is that as a result of performing a number of tests through emotion-based sensory-triggered emotional real-time tracking method using emotion vector-based bio-signal measurement according to an embodiment of the present invention, the content of presentation stimulus, intentionally or intentionally, It is because the desire to understand it has arisen and it has been confirmed that the emotion that triggers to move to the step of concentrating more effort and time.

In this way, the ability to track the emotional emotions in the process of transitioning to the concentration stage can be used to induce positive emotions, which can eventually lead to positive emotions in a particular field.

At this time, the general human is likely to be distracted at the stage of attention or state of attention, but the subjects of the present invention have a strong behavioral activation system (extreme BAS) type or a strong behavior inhibition system (extreme BIS) The possibility is very high.

Here, the type of behavior activation system refers to the tendency of individuals who are sensitive to success / victory and achievement experience in the BAS type, and the behavior inhibition system type refers to a person who is sensitive to failure / .

In the case of the type of behavior activation system and the type of behavior suppression system, it is determined that the possibility of falling into a positive or negative immersion state due to a very high sensitivity to success / victory or failure / defeat experience is very high. Based on the emotional vector-based emotion triggered emotion-based real-time tracking method using the bio-signal measurement, by analyzing the subjects who are likely to fall into such a state of immersion, by tracking the emotional sensation leading to the immersive state, The purpose of this study is to not only induce the negative commitment state to the positive commitment but also facilitate the counseling / psychotherapy of the addiction to the subjects with negative commitment.

To learn more about each step,

The bio-signal measurement step may analyze the subject's bio-signal while moving with a predetermined time with a specific window.

At this time, it is preferable that the subject's bio-signals are the brain waves of the frontal lobe and parietal lobe, and it is preferable to analyze the signals included in the width of 1 second on the time axis by moving them by 0.5. However, this is only an example and can be changed by the setting of the experimenter.

In the bio-signal measurement step, the subject's EEG is measured at predetermined time intervals, and the EEG occurring in the frontal lobe and the parietal lobe can be measured in real time.

In the vectorization step, the subject's bio-signal measured in the bio-signal measurement step may be analyzed and vectorized into a two-dimensional sensory plane to derive a two-dimensional sensory vector.

At this time, it is preferable that the x-axis of the two-dimensional sensibility plane exhibits pleasant-unpleasantness, and the y-axis exhibits arousal-relaxation.

As shown in FIG. 4, since the biological signal of the subject is analyzed at predetermined time intervals, it is natural that the biological signal of the subject, which changes according to the passage of time, can be determined.

In other words, as shown in Fig. 4, the vectorization step can be schematized how much the emotion of the subject changes in any direction in the course of time.

In this case, it is desirable to analyze the movement of the x axis through the asymmetry evaluation of the frontal lobe, and the motion of the y axis should be analyzed through the asymmetry evaluation of the parietal lobe.

In the emotional measurement step, the two-dimensional emotional vector derived from the vectorization step is analyzed, and the direction and size of the emotional vector corresponding to the initial stage of the introgression into the concentration stage are evaluated to determine the causal emotion of the immersion trigger.

In detail, as shown in Fig. 3, the causal emotional measurement step is a step of analyzing the biological signals of the attention step and the concentrated step, vectorizing the two-dimensional sensibility plane, analyzing the two-dimensional sensibility vector, The direction and size of the emotional vector corresponding to the subject can be judged to be the causal sensation of the triggering of the immersion and it can be judged to be the cause that caused the subject to be immersed.

The sensory vector-based immersion triggering emotional real-time tracking method using the bio-signal measurement according to the embodiment of the present invention tracks the change of the emotional vector upon entering from the 'attention step' to the 'concentrated step' according to the flowchart of FIG. 1 . In detail, the asymmetric AS (Va) of the frontal lobe expressing pleasantness-discomfort is obtained from the equation (1), and the asymmetric AS (Ar) of the parietal lobe showing the awakening-relaxation is obtained from the equation (2) (X, y) representing the arousal-relaxation by the y coordinate and the y-coordinate by the x-coordinate, respectively, from Equation (3) to track how the emotion vector changes when the emotion vector changes from the 'attention state' to the 'concentrated state'.

In this case, the bio-signal feature of the 'caution phase' is characterized by an increase in the respiratory sinus arrhythmia (RSA) caused by irregular respiration, while the power of the lower alpha wave band (8-10 Hz) And the intensity of the 'intensive phase' bio-signal decreases as the RSA decreases, the power of the lower ALP band decreases further, and the increase in the alertness (ie, the EEG power of the right parietal lobe (8-13 Hz) ).

More specifically, FIG. 3 shows 'Feldman Barrett and Russell's two-dimensional emotional structure'. In FIG. 3, it is shown that a subject in the emotional state of 'stressed' The bio signal characteristics of the 'concentrated' phase were observed at the magnitude of <2> 0.8, while the bio signal characteristics of the 'concentrated phase' were observed at the magnitude of <3> If the subject's biological signal is not observed, the subject's immersion trigger sensibility can be estimated to be about 0.8 in size as "god-like".

From here,

: 2차원 감성 평면에서 쾌-불쾌 축 좌표

에 상응하는 전두엽의 비대칭적 활성화 점수

: Pleasant-offensive axis coordinates in a two-dimensional sensibility plane

Asymmetric activation score of the corresponding frontal lobe

: 도 2의 영역 RF에 해당하는 6개 전극위치 각각에서의 알파파 대역 뇌파 파워를 평균한 값

: The average value of the alpha wave band EEG power at each of the six electrode positions corresponding to the region RF in FIG. 2

: 도 2의 영역 LF에 해당하는 6개 전극위치 각각에서의 알파파 대역 뇌파 파워를 평균한 값

: The average value of the alpha wave band EEG power at each of the six electrode positions corresponding to the region LF in Fig. 2

: 2차원 감성 평면에서 각성-이완 축 좌표

에 상응하는 두정엽의 비대칭적 활성화 점수

: Awareness - Relaxation Axis Coordinates in Two Dimensional Sensibility Planes

Asymmetric activation score of the parietal lobes corresponding to

: 도 2의 영역 LP에 해당하는 5개 전극위치 각각에서의 알파파 대역 뇌파 파워를 평균한 값

: The average value of the alpha wave band EEG power at each of the five electrode positions corresponding to the region LP in FIG. 2

: 도 2의 영역 RP에 해당하는 5개 전극위치 각각에서의 알파파 대역 뇌파 파워를 평균한 값

: The average value of the alpha wave band EEG power at each of the five electrode positions corresponding to the region RP in Fig. 2

From here,

: 2차원 감성 평면에서 쾌-불쾌 축 좌표가

이고 각성-이완 축 좌표가

인 감성벡터

: Pleasant-offensive axis coordinates in a two-dimensional sensibility plane

And arousal-relaxation axis coordinates

Emotional vector

: 수학식 1의

를 Z변환한 값

: Equation 1

Z-converted value

: 수학식 2의

를 Z변환한 값

: Equation 2

Z-converted value

Referring to FIG. 2, the left medial and lateral frontal lobes (LF) include F3 and F7 of a 10-20 electrode system and include 11, 12, 13, 14, 18, and 19 of a 64-channel electrode system . The right RF (right medial and lateral frontal lobes) include F4 and F8 of 10-20 electrode systems and include 2, 56, 57, 58, 59 and 60 of the 64 channel electrode system. The region MF (mid-frontal lobe) contains Fz of 10-20 electrode systems and includes 3, 6, 8, and 9 of the 64-channel electrode system. The region FR (frontal lobe) includes both regions LF, RF, and MF. The regions LP (left parietal and posterior temporal) include P3 and T5 of 10-20 electrode systems and include 26, 27, 28, 30 and 31 of the 64 channel electrode system. The right parietal and posterior temporal lobes (RP) include P4 and T6 of 10-20 electrode systems and include 40, 42, 44, 45, and 46 of the 64 channel electrode system.

Through this, it is possible not only to induce the immersion of the subjects into a positive immersion by tracking the triggering emotions leading to the immersive state, the so-called cause emotions, but also to facilitate the counseling / psychotherapy of the addiction to the subjects in the negative immersion state .

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, And various modifications and changes may be made thereto by those skilled in the art to which the present invention pertains.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

Claims (6)

A bio-signal measurement step of measuring a bio-signal of the subject every predetermined time;
Analyzing a subject's bio-signal measured in the bio-signal measurement step to determine a state of attention and a concentration stage of the subject's immersion process;
A vectorization step of extracting a two-dimensional emotion vector by analyzing the bio-signals of the attention step and the concentrated step and vectorizing the two-dimensional emotion plane; And
A causal emotional tracking step of analyzing the two-dimensional emotional vector derived in the vectorization step and evaluating the direction and size of the emotional vector corresponding to the initial stage of the concentration step to determine the causal emotional state of the immersion trigger;
Wherein the sensed vector-based impression-triggered emotional real-time tracking method is used. The method according to claim 1,
Wherein the bio-signal measurement step uses a bio-signal of a frontal lobe and a bio-signal of a parietal lobe as a subject's bio-signal, and a sensory vector-based immersion triggered emotion real-time tracking method using bio-signal measurement. 3. The method of claim 2,
Wherein the vectorization step comprises:
Calculating the asymmetric AS (Va) of the frontal lobe expressing pleasure-unpleasantness and the asymmetric AS (Ar) of the parietal lobe showing the awakening-relaxation; And
Calculating a sensitivity vector Aff (x, y) representing a pleasant-discomfort with an x coordinate and a wake-relax with a y coordinate on a two-dimensional sensibility plane, Immersive Sensitivity Real - time Tracking Method. The method of claim 3,
The asymmetric AS (Va) of the frontal lobe is calculated from the following equation (1), and the asymmetric AS (Ar) of the parietal lobe exhibiting arousal-relaxation is calculated from the following equation Emotion - based vector based immersion triggered emotional real - time tracking method.
[Equation 1]

From here,

: Pleasant-offensive axis coordinates in a two-dimensional sensibility plane

Asymmetric activation score of the corresponding frontal lobe

: Mean value of alpha wave band EEG power at each of 6 electrode positions corresponding to region RF

: The mean value of the alpha wave band EEG power at each of the six electrode positions corresponding to the region LF
&Quot; (2) &quot;

From here,

: Awareness - Relaxation Axis Coordinates in Two Dimensional Sensibility Planes

Asymmetric activation score of the parietal lobes corresponding to

: Mean value of the alpha wave band EEG power at each of the five electrode positions corresponding to the region LP

: Mean value of the alpha wave band EEG power at each of the five electrode positions corresponding to the region RP 5. The method of claim 4,
Wherein the emotion vector Aff (x, y) is calculated from the following equation (3).
&Quot; (3) &quot;

From here,

: Pleasant-offensive axis coordinates in a two-dimensional sensibility plane

And arousal-relaxation axis coordinates

Emotional vector

: In Equation (1)

Z-converted value

: In Equation (2)

Z-converted value 3. The method of claim 2,
The step of determining the attention step and the concentration step includes:
If the subject's vital signs increase respiratory syncope and the power of the 8-10 Hz alpha wave band EEG decreases in the frontal lobe,
RSA decreases, and the power of the 8-10 Hz Alfa wave band EEG decreases further, and when the EEG power of the right parietal lobe of the 8-13 Hz Alpa band decreases, Impression - based Sensitivity Real - time Tracking Method Based on Sensitivity Vector Using Signal Measurements.

Images