TWI642407B - Brainwave emotion detecting device - Google Patents

Abstract

The embodiment of the invention provides a brain wave detecting emotion device using color display, which comprises: a brain wave detecting module, a display module, a storage module and a processing module. The brain wave detection module detects a plurality of brain wave parameters of a user. A display module for displaying a plurality of colors to correspond to a plurality of emotions. The storage module is configured to store a plurality of emotional patterns and a plurality of emotional reference values corresponding to a user. The processing module is electrically connected to the brain wave detecting module, the display module and the storage module, and determines a user's emotion according to the brain wave parameter. Wherein, the processing module compares the brainwave parameter with the emotional mode to determine a category of the user's emotion, and compares the brainwave parameter with the emotional reference value to determine the intensity of the user's emotion, and The display module is controlled to display a corresponding color category and color intensity according to the determined category and intensity of the user's emotion.

Description

Brain wave detection emotion device

The invention relates to a brain wave detecting emotion device, and in particular to a brain wave detecting emotion device using a brain wave detecting module.

Brainwave detection technology has made great progress in recent years, and it is possible to obtain quite accurate brainwave detection results without using a large number of electrode patches or heavy helmet-type detection devices, and in recent years, wearable devices Popular, brainwave detection devices tend to be light and easy to carry. Therefore, in the current development of advanced technology for brainwave detection, how to effectively use brain waves to detect human emotions more accurately, and clearly and clearly present technology is the subject of academic and industry research.

The invention provides an electroencephalogram detecting emotion device which can effectively detect human emotions and can be widely used by the general public, and the invention can be widely applied to the fields of enterprises, health, medicine and the like.

In view of this, an embodiment of the present invention provides a brain wave detecting emotion device that uses color display, and includes: a brain wave detecting module, a display module, a storage module, and a processing module. The brain wave detection module detects a plurality of brain wave parameters of a user. A display module for displaying a plurality of colors to correspond to a plurality of emotions. The storage module is configured to store a plurality of emotional patterns and an emotional reference value corresponding to a user. The processing module is electrically connected to the brain wave detecting module, the display module, and the storage module, and determines a user's emotion according to the brain wave parameter. Wherein the processing module determines the current mood of the user by comparing the brain wave parameter with the emotional mode a class that compares the brainwave parameter with the emotion reference value to determine an intensity of the user's emotion, and controls the display module to display a correspondence according to the determined category and intensity of the user's current mood The type of color and color intensity.

In summary, the brain wave detecting emotion device of the embodiment of the present invention can perform emotion recognition according to the brain wave parameters of the user, and can also display the user's emotional category and emotional intensity through the display module, thereby effectively improving medical care. The quality and level of care in the field can be applied to improve communication with patients who are disabled, or interact with seniors, or interact with physicians and patients, or between businesses and customers.

The above described features and advantages of the present invention will be more apparent from the following description.

1, 1'‧‧‧ brain wave detection emotion device

2‧‧‧Remote Server

11, 11'‧‧‧ brain wave detection module

12‧‧‧Processing module

13, 13'‧‧‧ display module

14‧‧‧Storage module

15‧‧‧Communication module

16‧‧‧ rechargeable battery

17‧‧‧Warning module

18, 18’‧‧‧ head-mounted structure

I, II, III‧‧‧ emotional map

FIG. 1A is a schematic diagram showing the configuration of a brain wave detecting emotion device according to an embodiment of the present invention.

FIG. 1B is a schematic diagram showing the configuration of a brain wave detecting emotion device according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of an electroencephalogram detecting emotion device according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of a brain wave detecting emotion device for detecting different brain wave parameters by detecting a brain wave signal of a user according to an embodiment of the present invention.

FIG. 4 is a schematic diagram showing a ping test mode of an electroencephalogram detecting emotion device according to an embodiment of the present invention.

FIG. 5 is a schematic diagram of an emotional feature map corresponding to an emotional mode according to an embodiment of the present invention.

FIG. 6 is a schematic diagram showing emotional parameters and emotional intensity according to an embodiment of the present invention.

Various illustrative embodiments are described more fully hereinafter with reference to the accompanying drawings. However, the concept of the present invention may be The invention is in many different forms and should not be construed as being limited to the illustrative embodiments set forth herein. Rather, these exemplary embodiments are provided so that this invention will be in the In the drawings, the size and relative sizes of layers and regions may be exaggerated for clarity. Similar numbers always indicate similar components.

It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, such elements are not limited by the terms. These terms are used to distinguish one element from another. Thus, a first element discussed below could be termed a second element without departing from the teachings of the inventive concept. As used herein, the term "and/or" includes any of the associated listed items and all combinations of one or more.

The brain wave detecting emotion device will be described below with reference to the drawings in at least one embodiment. However, the following embodiments are not intended to limit the disclosure.

[Embodiment of Brain Wave Detection Emotion Device of the Present Invention]

Please refer to FIG. 1A , FIG. 1B and FIG. 2 . FIG. 1A is a schematic diagram of a brain wave detecting emotion device according to an embodiment of the present invention. FIG. 1B is a schematic diagram showing the configuration of a brain wave detecting emotion device according to an embodiment of the present invention. FIG. 2 is a schematic diagram of an electroencephalogram detecting emotion device according to an embodiment of the present invention.

The brain wave detecting emotion device 1 includes an brain wave detecting module 11, a processing module 12, a display module 13, a storage module 14, a communication module 15, a rechargeable battery 16, and a warning mode. Group 17 and a head mounted structure 18. In this embodiment, the brain wave detecting module 11 of the brain wave detecting emotion device 1 , the processing module 12 , the display module 13 , the storage module 14 , the communication module 15 , the rechargeable battery 16 , and the warning module 17 is disposed on the head mounted structure 18, wherein the display module 13 is disposed outside the head mounted structure 18, and the brain wave detecting module 11 is disposed inside the head mounted structure 18. In this embodiment, the head-mounted structure is a headband, and the material of the headband may be cloth or other materials, which is not limited in the present invention. In FIG. 1B, the structure of the head-mounted structure 18' of the brain wave detecting emotion device 1' is different from the head-mounted structure 18 of FIG. 1A, and the structure of the head-mounted structure 18' is composed of two arcs. Metal sheet structure, in this embodiment, the display module 13' is set On the outside of an arcuate metal piece of the head-mounted structure 18', the brain wave detecting module 11' is disposed inside the other arc-shaped metal piece of the head-mounted structure 18'. In other embodiments, the display module 13 and the brain wave detecting module 11 can adjust the setting position according to actual needs, which is not limited in the present invention.

Please refer to FIG. 3 to FIG. 6 . FIG. 3 is a schematic diagram of a brain wave detecting emotion device for detecting different brain wave parameters by detecting a brain wave signal of a user according to an embodiment of the present invention. FIG. 4 is a schematic diagram showing a ping test mode of an electroencephalogram detecting emotion device according to an embodiment of the present invention. FIG. 5 is a schematic diagram of an emotional feature map corresponding to an emotional mode according to an embodiment of the present invention. FIG. 6 is a schematic diagram showing emotional parameters and emotional intensity according to an embodiment of the present invention.

The brain wave detecting module 11 detects a plurality of brain wave parameters of a user. The processing module 12 detects a plurality of brainwave parameters of the user detected by the brain wave detecting module 11. In the embodiment, the brain wave detecting module 11 detects a first brain wave parameter of the user. a second brain wave parameter, a third brain wave parameter, and a fourth brain wave parameter. In the present embodiment, four brain wave parameters are used. In other embodiments, more different brain wave parameters may be used, which are not limited in the present invention.

The cerebral cortex of the human body has a vertical distribution of vertebral neurons, and the neurons produce a potential change when they move, which is called a physiological potential. The physiological potential of brain waves is usually quite weak, about 5~30uV, and the type of brain wave signal is an alternating signal of 0.5~60Hz.

In this embodiment, the first brain wave parameter is an alpha wave, the second brain wave parameter is a beta wave, the third brain wave parameter is a theta wave, and the fourth brain wave parameter is a delta wave. In other embodiments, more detailed classification may be performed for different brainwave parameters, such as High alpha waves and Low alpha waves, which are not limited in the present invention.

The first brain wave parameter (α wave) is a brain wave waveform between 8 and 14 Hz. When the first brain wave parameter (α wave) is the dominant brain wave, the user's consciousness is clear and the body is more relaxed. Therefore, the brain gets more energy, the brain works faster and smoother, and the brain activity is relative to other brains in the first brain wave parameter (α wave). The wave parameters are more lively. The second brain wave parameter (β wave) is a brain wave waveform of 14 Hz or more. When the second brain wave parameter (β wave) is a dominant brain wave, the body gradually becomes in a state of tension, ready to respond to the external environment at any time. In addition to maintaining its own function, brain energy must also direct the defense system. In this case, physical and mental energy consumption will be more severe, so it is easier to get tired. If you do not get enough rest, it will be easier to accumulate stress. The third brain wave parameter (θ wave) is a brain wave waveform of 4-8 Hz. When the third brain wave parameter (θ wave) is the dominant brain wave, the human consciousness is usually in an interrupted state, and the body will enter deep relaxation. The state, while the third brainwave parameter (theta wave) is extremely helpful for enhancing long-term memory. The fourth brain wave parameter (δ wave) is a brain wave waveform of 0.4-4 Hz. When the fourth brain wave parameter (δ wave) is a dominant brain wave, it is usually in a state of deep sleep or unconsciousness. Therefore, the quality of human sleep is directly related to the fourth brain wave parameter (δ wave). The storage module 14 stores a plurality of emotional patterns and a plurality of emotional reference values corresponding to a user. The processing module 12 is electrically connected to the brain wave detecting module 11, the display module 13, the storage module 14, the communication module 15, the rechargeable battery 16, and the warning module 17, according to the first brain wave parameter of the corresponding user. (α wave), second brain wave parameter (β wave), third brain wave parameter (γ wave), and fourth brain wave parameter (δ wave) generate a plurality of emotional patterns.

Since the user generates different emotions, such as when the user generates an angry or happy mood, different emotions, the first brain wave parameter (α wave) and the second brain wave parameter (β wave) in the brain wave signal. The composition of the third brain wave parameter (γ wave) and the fourth brain wave parameter (δ wave) may be significantly different. Therefore, according to the user brain wave detected by the brain wave detecting module 11, each analysis is performed. a first brain wave parameter (α wave), a second brain wave parameter (β wave), a third brain wave parameter (θ wave), and a fourth brain wave parameter (δ wave) of a user brain wave, For further classification, if the brain wave parameter analysis result is presented mathematically or graphically, it can be represented by at least a 1×4 matrix or a 2×2 matrix, or an emotional feature map as shown in FIG. 4, with the first brain wave. The parameters (α wave), the second brain wave parameter (β wave), the third brain wave parameter (θ wave), and the fourth brain wave parameter (δ wave) are graphical representations of an axial index, respectively.

Since the brain wave parameters of the user under the same type of emotion are represented by the graphical representation of FIG. 4, relatively similar figures can be obtained, and therefore, the emotions can be classified into different emotions according to the degree of approximation of the figure, for example: joy, anger Surprise, disgust, fear, sadness, etc.

In addition, a plurality of emotional parameters may be generated according to the first brain wave parameter (α wave), the second brain wave parameter (β wave), the third brain wave parameter (θ wave), or the fourth brain wave parameter (δ wave). . In this embodiment, the design of the emotional parameters may be based on different needs, different brain wave analysis methods or psychoanalytic theory, and is not limited in the present invention. That is, in the present embodiment, the emotional parameters are the first brain wave parameter (α wave), the second brain wave parameter (β wave), the third brain wave parameter (θ wave), or the fourth brain wave parameter (δ The wave is determined by one of them, or it can be determined by two to three brain wave parameters. For example, the emotional parameter (joy) can be designed according to the first brain wave parameter (α wave), and it will have a physical and mental relaxation due to the generation of human joy. Or the emotional parameter (fear) can be designed according to the first brain wave parameter (α wave) or the second brain wave parameter (β wave), because the second brain wave parameter (β wave) is the dominant brain wave, the body It is easier to get tired and the pressure is easy to accumulate. In addition, since the first brain wave parameter (α wave) is more dominant, the body and mind are easier to relax, so if you think backwards, you can set an upper limit value and subtract a function designed according to the first brain wave parameter (α wave). Value, you can also get the value of the emotional parameter (fear). Therefore, if presented mathematically, the emotional parameters are at least the first brain wave parameter (α wave), the second brain wave parameter (β wave), the third brain wave parameter (θ wave) or the fourth brain wave parameter (δ Wave) one of the functions. This is shown below (Equation 1).

Emotional parameter = f (first brain wave parameter or second brain wave parameter or third brain wave parameter or fourth brain wave parameter) - (Formula 1)

However, the function design of the emotional parameters is not limited in the present invention.

In the present embodiment, the Supper Vector Machine (SVM) classification method is used for calculation and analysis, and the brain wave parameters of different emotions can be identified. The brain wave signal detected by the brain wave detecting module 11 can utilize the fast Fourier The Fourier Transform (FFT) is converted from the Time Domain to the Frequency Domain. Then, the amplitude of the frequency segment corresponding to each brain wave parameter can be calculated, and the emotion can be detected as a brain wave. Brain wave parameters of device 1. Then, the rules of the support vector machine can be used to classify a plurality of brain wave parameters, that is, to find a plurality of hyperplanes capable of segmenting a plurality of emotions in a high dimensional space of brain wave feature values. Further, the plurality of brainwave parameters of the user can be classified according to a plurality of emotional parameters.

The processing module 12 calculates and analyzes the brain wave parameters belonging to the same emotional mode according to the function of the corresponding emotional parameters, and the plurality of emotional parameters have a change interval of the emotional parameters, for example, processing the corresponding emotional parameters ( In the case of joy, the processing module 12 divides the brain waves belonging to the same emotional mode (joy) into the same emotional category. However, since the brainwave parameters of different users may have a certain degree of difference, different users may There will also be differences in emotional benchmark values. Moreover, even if the same user, the brainwave parameters will be different due to the difference in the degree of emotion, so the emotional parameters may be different. However, the classification and calculation of the emotional parameters may be performed in advance according to the brainwave parameters of the user to generate User-specific emotional benchmark values and mood change intervals.

According to the above, since there are differences in the range of different mood change intervals, in the present embodiment, the normalization process is performed on the mood change interval, so that a more consistent display manner can be obtained in subsequent display. In the present embodiment, as described above, the brain wave detecting emotion device 1 can perform a device calibration process in which the user performs a flat test mode in a calibration mode. As shown in FIG. 1 , the user can first Equipped with brainwave detection and emotion device 1, and then watch or hear different videos, pictures or music, such as colors, landscapes, people, sports and other types of videos or pictures, and record brainwave detection with different emotional responses. And the detection and classification of emotional reactions can be dictated by the user's memory, filled out by questionnaires or supplemented by other wearable electronic devices to detect physiological reactions of the user's body, such as: myoelectric signal enhancement, muscle stiffness, face Facial expressions, physical movements, such as smiles, high-fives, etc. Row classification is not limited in the present invention. After the basic emotional response of the user is recorded through the learning step, the brain wave detecting emotion device 1 can be used to detect the user's emotion and display the corresponding emotional intensity. In this embodiment, the device calibration process of the peace test mode is performed in the form of a questionnaire as shown in FIG. 4, and in other embodiments, the sensor can be jointly detected by combining other sensors and body features. Emotional changes for emotional classification are not limited in the present invention. In this embodiment, the user's emotional reference value is a brainwave parameter that is tested according to the user's questionnaire in the peace test mode.

Therefore, in this embodiment, the processing module 12 determines the category of the user's emotion and the emotional intensity corresponding to the emotion according to a brain wave of the user and a plurality of emotional patterns and a plurality of emotional reference values. In this embodiment, the processing module 12 determines the intensity of the user's emotion based on the relative difference between the brain wave parameter and the emotional reference value.

As shown in FIG. 5, the emotional feature map I, the emotional feature map II, and the emotional feature map III are classified into the same type of emotional pattern because the graphs are similar and belong to the same emotional category in the questionnaire classification, wherein the emotional feature map I is used. The brain wave parameters tested in the peace mode, that is, the emotional reference value, while the emotional feature map II and the emotional feature map III represent the same type of emotion as the emotional feature map I, but have different degrees of emotional intensity, and therefore, respectively The relative difference calculation is performed using the brain wave parameters of the emotional feature map II, the emotional feature map III, and the emotional feature map I to obtain the emotional strength corresponding to the emotional feature map II and the emotional feature map III, respectively. As shown in the dot area of Fig. 5, it is the relative difference between the emotional feature map II and the emotional feature map I.

The different emotional categories of the user, such as: joy, anger, surprise, nausea, fear, and sadness, respectively, the corresponding emotional intensity, after normalization, for example, the emotional reference value of different emotional categories is the origin, the emotional intensity After normalization, it can be as shown in Figure 6.

Then, the analysis is further performed. When the detected brainwave parameters of the user change, the processing module 12 adjusts the displayed color according to the change of the brain wave parameters. That is, the processing module 12 uses the display module 13 to display the emotion category corresponding to the user. And the emotional intensity corresponding to the emotion. When the brain wave parameter detected by the brain wave detecting module 11 exceeds a threshold value, the warning module 17 sends a warning message. In this embodiment, the warning module 17 can be a light emitting diode module, an organic light emitting diode module, a liquid crystal display module, a buzzer, or a combination thereof. There is no limitation in the present invention.

In this embodiment, the display module 13 is a display screen, an LED display, a light emitting diode module, an organic light emitting diode module, a liquid crystal display module, or a combination thereof. Therefore, in the embodiment, the display mode of the emotion mode is displayed by the color of the display module 13, for example, yellow represents happiness, red represents anger, blue represents depression, dark blue represents depression, white represents general state, etc. Wait. In addition, the emotional intensity of different emotions is expressed by the brightness of the display module 13 in this embodiment, and the higher the emotional intensity, the higher the brightness. The lower the emotional intensity, the lower the brightness. In other embodiments, the manner in which the emotions and the emotions are displayed may be adjusted according to actual needs, and is not limited in the present invention.

In addition, the communication module 15 is configured to transmit at least one communication signal to a remote server, and the brain wave detecting emotion device 1 can transmit the user's emotional record and the corresponding emotional intensity to a remote servo through the communication module 15. Device 2 performs data storage and performs immediate observation. The rechargeable battery 16 is used to provide power to drive the brainwave detecting emotion device 1. In this embodiment, the communication module 15 is a wireless communication module, which may be a WiFi wireless communication module, a Bluetooth communication module (Bluetooth) or a Zigbee communication module (Zigbee), which is not limited in the present invention. .

[Possible effects of the examples]

In summary, the brain wave detecting emotion device of the embodiment of the present invention can perform emotion recognition according to the brain wave parameters of the user, and can also display the user's emotional category and emotional intensity through the display module, thereby effectively improving medical care. The quality and standard of care in the field can be applied to improve communication effectiveness and quality in interaction with disabled patients, or with older people, or in the process of interacting with physicians and patients, or between businesses and customers.

The above description is only an embodiment of the present invention, and is not intended to limit the patent of the present invention. range.

Claims (9)

A brain wave detecting emotion device using color display, comprising: a brain wave detecting module for detecting a plurality of brain wave parameters of a user; and a display module for displaying a plurality of colors to correspond to a plurality of emotions; a storage module for storing a plurality of emotional patterns and a plurality of emotional reference values corresponding to a user; a processing module electrically connected to the brain wave detecting module, the display module, and the a storage module, determining a user emotion according to the brain wave parameter; and a head-mounted structure, internally setting the processing module, the brain wave detecting module, the display module, and the a storage module, wherein the display module exposes an outer side of the head-mounted structure, the brain wave detecting module is disposed at an inner side of the head-mounted structure; wherein the processing module compares the brain wave The parameter and the emotional mode determine a category of the current mood of the user, and the brainwave parameter and the emotion reference value are used to determine the strength of the current mood of the user, and according to the determined current mood of the user Category and intensity, control The display module displays a corresponding color type and color intensity; wherein the plurality of brain wave parameters are selected from a first brain wave parameter (α wave), a second brain wave parameter (β wave), and a A group consisting of a third brain wave parameter (θ wave) and a fourth brain wave parameter (δ wave). The brain wave detecting emotion device using color display according to claim 1, wherein the brain wave detecting emotion device detects a plurality of image data and a plurality of test color data when the brain wave detecting emotion device is in a calibration mode The brain wave parameter generated at the time, and the emotion pattern and the emotion reference value are obtained according to the detected brain wave parameter, wherein each emotion pattern is composed of at least two brain wave parameters, and the emotion reference value corresponds to The brainwave parameters that make up the emotional pattern. The brain wave detecting emotion device displayed by color according to claim 1, wherein each emotion pattern corresponds to an emotion feature map composed of a plurality of corresponding brain wave parameters. The brain wave detecting emotion device using color display according to claim 1, wherein the emotion mode includes joy, anger, surprise, nausea, fear, sadness, and the emotion reference value is the user in a peace test. The brainwave parameters of the pattern. The brain wave detecting emotion device using color display according to claim 1, wherein the processing module is based on comparing the brain wave parameter and the emotion reference value to determine the intensity of the user emotion The difference between the brain wave parameter and the emotion reference value determines the intensity of the user's emotion. The brain wave detecting emotion device of the color display according to claim 1, wherein the brain wave detecting emotion device further comprises a rechargeable battery electrically coupled to the processing module, the brain wave detection Measuring module, the display module and the storage module. The brain wave detecting emotion device using color display according to claim 1, wherein when the detected brain wave parameter is changed, the processing module adjusts the displayed according to the change of the brain wave parameter. colour. The brain wave detecting emotion device using the color display according to claim 1 further includes a warning module electrically connected to the processing module, when the detected brain wave parameter exceeds a threshold value The warning module sends a warning message. The brain wave detecting emotion device displayed by using the color according to claim 1, wherein the display module is a display screen or an LED display.