GB2608690A - Personalized mental state adjustment system and method based on brainwave music - Google Patents

Personalized mental state adjustment system and method based on brainwave music Download PDF

Info

Publication number
GB2608690A
GB2608690A GB2207261.5A GB202207261A GB2608690A GB 2608690 A GB2608690 A GB 2608690A GB 202207261 A GB202207261 A GB 202207261A GB 2608690 A GB2608690 A GB 2608690A
Authority
GB
United Kingdom
Prior art keywords
brainwave
mental state
music
module
signals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
GB2207261.5A
Other versions
GB202207261D0 (en
Inventor
Zhang Tong
Jia Xue
L Phillip Chen C
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Publication of GB202207261D0 publication Critical patent/GB202207261D0/en
Publication of GB2608690A publication Critical patent/GB2608690A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165Evaluating the state of mind, e.g. depression, anxiety
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/372Analysis of electroencephalograms
    • A61B5/374Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/375Electroencephalography [EEG] using biofeedback
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/377Electroencephalography [EEG] using evoked responses
    • A61B5/38Acoustic or auditory stimuli
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/40Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4058Detecting, measuring or recording for evaluating the nervous system for evaluating the central nervous system
    • A61B5/4064Evaluating the brain
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M21/02Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0027Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00General characteristics of the apparatus
    • A61M2205/35Communication
    • A61M2205/3576Communication with non implanted data transmission devices, e.g. using external transmitter or receiver
    • A61M2205/3592Communication with non implanted data transmission devices, e.g. using external transmitter or receiver using telemetric means, e.g. radio or optical transmission
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2230/00Measuring parameters of the user
    • A61M2230/08Other bio-electrical signals
    • A61M2230/10Electroencephalographic signals

Abstract

A personalized mental state adjustment system based on brainwave music, comprising: an electroencephalogram collection module, a brainwave music generation module, a mental state evaluation module, a mental state adjustment module, and a brainwave music playing module. The electroencephalogram collection module is in signal connection with the brainwave music generation module and the mental state evaluation module, separately; the mental state evaluation module, the mental state adjustment module, and the brainwave music playing module are in signal connection in sequence. According to the mental state adjustment system, emotion adjustment is performed by using the brainwave music generated by the electroencephalogram of a subject, thereby avoiding affecting the emotion adjustment effect due to different sensitivity of individuals to conventional music, having good pertinence to the subject, and realizing personalized emotion adjustment. Also provided is a mental state adjustment method applied in the mental state adjustment system.

Description

DESCRIPTION
PERSONALIZED MENTAL STATE ADJUSTMENT SYSTEM AND METHOD BASED ON BRAINWAVE MUSIC
FIELD OF THE INVENTION
The present invention relates to the technical field of mental state regulation, in particular to a personalized mental state regulation system based on brainwave music and a mental state regulation method used therein.
BACKGROUND OF THE INVENTION
With the increasingly fast life pace, life pressure increases, so the mental health C\I has received more and more attention. Emotion regulation methods commonly used C\i in daily life include video regulation, music regulation, transcranial stimulation, etc..
The equipment used for transcranial stimulation regulation is relatively expensive and complicated to operate; regulating mental state through video
CO
0 stimulation can achieve better effects, but it also requires equipment for playing video.
Emotion regulation through music is a common method. Psychologists believe that music can regulate the function of human cerebral cortex, causing the human body to secrete healthy hormones, acetylcholine and the like, thereby increasing the activity of biological enzymes in the body; music can also regulate blood circulation and activate nerve cells, and can regularize the body's functional state, thereby promoting the body's metabolism and increasing the ability to resist stress and disease.
In the existing systems and methods for regulating emotions through music, it is mainly based on people's mental state to choose some existing music to regulate people's emotions. Although music can induce physiological arousal, it rarely directly causes an individual's specific external reactions; the individual's final emotion performance still depends on the overall cognition of music, that is, emotion is the result of an individual's integrated interpretation of music composed of different harmony, rhythm, melody, timbre, and so on. However, due to the differences between individuals, each person's feelings and understanding of music are not the same Therefore, the use of ready-made music for emotion regulation is not highly targeted, and cannot achieve personalized emotion regulation.
CONTENTS OF THE INVENTION
In order to overcome the shortcomings and deficiencies of the prior art, the present invention has an object to provide a personalized mental state regulation system, which is based on brainwave music and uses the brainwave music generated by an individual's own brainwave to regulate the individual's emotions; this personalized mental state regulation system can avoid the influence of the individual's different sensitivity to conventional music on the effect of emotion regulation, is well targeted to the subject, and can individually regulate emotion. Another object of the present invention is to provide a mental state regulation method used in the above-mentioned personalized mental state regulation system; this mental state regulation method can avoid the influence of the individual's different sensitivity to conventional music on the effect of emotion regulation, is well targeted to the subject, and can individually regulate emotion.
In order to achieve the above objects, the present invention adopts the following technical solution: A personalized mental state regulation system based on brainwave music is provided, characterized in that the system comprises: a brainwave acquisition module, used to collect, amplify and filter a subject's brainwave signals; a brainwave music generation module, used to map the brainwave signals into brainwave music, and store the brainwave music and mark it with a corresponding emotion tag, so as to generate a personal emotion music library; a mental state evaluation module, used to analyze the brainwave signals to obtain mental state evaluation results of the subject; a mental state regulation module, used to generate a playback control instruction or a stop playback instruction according to the mental state evaluation results; and a brainwave music playback module, used to call out the corresponding brainwave music from the personal emotion music library to play according to the playback control instruction, or stop the brainwave music playback according to the stop playback instruction.
The brainwave acquisition module is signally connected with the brainwave music generation module and the mental state evaluation module, respectively; the mental state evaluation module, the mental state regulation module and the brainwave music playback module are connected signally in sequence; the brainwave music playback module is two-way signally connected with the brainwave music generation module; and the mental state evaluation module is signally connected with the brainwave music generation module.
The regulation principle of the present invention is as follows: brainwave signals are bioelectric signals generated during the transmission of information between neuron cells, electric wave signals generated by the ion exchange produced during the activity of pyramidal cell synapses in the cerebral cortex, and a comprehensive manifestation of the electrical activity of the human brain neuron group. Brainwave signals and music are similar in signal form and both the results of brain functional activities, and they both obey certain common scientific laws. Therefore, brainwave signals can be converted into brainwave music. In a state of tension, stress and fatigue, the brain will produce beta waves; in a state of consciousness and relaxation, the brain will produce alpha waves; in a state of interrupted consciousness and deep relaxation, the brain will produce theta waves; and in a state of deep sleep, the brain will produce delta waves. Brainwave signals can bring people into different states of consciousness in a short period of time. The frequency (alpha, beta, theta and delta) of the brainwave signals is synchronized with the frequency of the subject's brain, so as to make the brain enter the corresponding state. Having a strong role in the regulation of human emotions, music can affect the types and frequency bands of the generated brainwave, and affect the subject's mental state in the form of resonance.
The mental state regulation system of the present invention first collects the brainwave signals of a subject in different emotions, and then maps the brainwave signals into brainwave music of the corresponding emotions, so as to generate a personal emotion music library. When you need to regulate your mental state, you can use the brainwave music generated by your own brainwave to regulate your emotions. This mental state regulation method can avoid the influence of the individual's different sensitivity to conventional music on the effect of emotion regulation, is well targeted to the subject, and can individually regulate emotion.
Preferably, in the brainwave music generation module, mapping the brainwave signals into brainwave music means as follows: extracting the period, frequency, amplitude and average power of brainwave signals of the left and right brains within a set duration, and mapping the brainwave signals of the left and right brains into brainwave music of the left and right brains, respectively: mapping the period or frequency of the brainwave signals into the length of the brainwave music, and mapping the amplitude and average power of the brainwave signals into the pitch and intensity of the brainwave music, respectively; using music synthesis software to generate the brainwave music of the left and right brains; and integrating the brainwave music of the left and right brains to fonn a piece of two-channel stereo brainwave music.
The period of the brainwave signals refers to the time interval between two adjacent wave troughs or peaks, with the unit in "ms". The frequency of the brainwave signals refers to the number of times the brainwave signals of the same period reappear within 1 s, with the unit in "Hz" or "cycle/second". The period or frequency of the brainwave signals is mapped into the length of the brainwave music, and the speed of music rhythm is used to express the different frequencies of the brainwave signals.
The amplitude of the brainwave signals refers to the magnitude of the fluctuation range of the brainwave signals. The rhythm of the brainwave signals varies with the activity state of the cerebral cortex. When the brain activity is relatively low, the electrical activity pace of many neurons in the cerebral cortex tends to be consistent, resulting in a rhythm with lower frequency and higher amplitude, which is called "synchronization"; when the brain activity is relatively intense and the electrical activity of neurons is not consistent, a rhythm with higher frequency and lower amplitude is obtained, which is called "desynchronization". There is a logarithmic relationship between the pitch and frequency of music, and the extent of pitch is called "range". The music with a higher range sounds brighter and more cheerful, while the music with a lower range sounds deeper and more stable. Based on the similarity between the amplitude and the pitch, the amplitude of the brainwave signals is mapped into the pitch of the brainwave music, such that the pitch is used to reflect the intensity of neuronal activity in the brain.
The average power of the brainwave signals is the energy characteristic of the brainwave signals and reflects the energy distribution of the brainwave signals, while the intensity of the music reflects the energy level of the sound source. Therefore, the average power of the brainwave signals is mapped into the intensity of the brainwave music, so as to use the intensity to emphasize the more intense neuronal activity.
In summary, the period/frequency, amplitude and average power of the brainwave signals are mapped into the length, pitch and intensity of the brainwave music, respectively; according to the period/frequency, amplitude and average power of the brainwave signals, brainwave music of different speeds, different cheerfulness and brightness levels, and different intensities can be generated, and then can be used to regulate the subject's mental state in a targeted manner.
In order to make the brainwave music more stereo and audible, two-channel brainwave signals from symmetrical electrodes of left and right hemispheres are used to generate two pieces of brainwave music, then the brainwave music of one of the channels is raised by an octave above the original pitch so as to divide the two-channel brainwave music into bass and treble, and then the left and right channels are set respectively to get the stereo brainwave music.
Preferably, the mental state evaluation module performs time segmentation on the brainwave signals with time T as the period, so as to obtain a number of brainwave fragments; and then the time-domain features and frequency-domain features of the individual brainwave fragments are extracted, and the emotions are classified by a classifier, such that the subject's mental state is evaluated to obtain the mental state evaluation results.
Preferably, the time-domain features include mean value, median value, variance and peak value; the frequency-domain features include power spectrum and differential entropy; and the classifier refers to any one of an SVM classifier, a random forest classifier, and a width learning system classifier.
Preferably, in the mental state regulation module, the subject's target emotion is set, and the mental state evaluation result is compared with the target emotion: if the mental state evaluation result is the same as the target emotion, a stop playback instruction is generated, or else a playback control instruction for playing the target emotion brainwave music is generated.
Preferably, the personalized mental state regulation system based on brainwave music also comprises the following components: a terminal module that is used for storing and displaying the brainwave signals and mental state evaluation results; and a brainwave acquisition module and a mental state evaluation module that are signally connected with the terminal module, respectively.
Preferably, the terminal module is signally connected with a cloud platform through wireless communication to realize data management and storage.
The mental state regulation method used in the above-mentioned personalized mental state regulation system based on brainwave music is characterized by comprising a personal emotion music library construction stage and a mental state regulation stage.
The personal emotion music library construction stage comprises the following steps: step S1: a device with the brainwave acquisition module is worn on the subject's head; step S2: a number of stimulus emotions, as well as an initialization evaluation model and stimulus videos corresponding to the various stimulus emotions are set; the stimulus videos corresponding to the various stimulus emotions are played to the subject in turn; and meanwhile the brainwave acquisition module collects, amplifies and filters the subject's brainwave signals, and then transmits the amplified and filtered brainwave signals to the mental state evaluation module and the brainwave music generation module; and step S3: the mental state evaluation module fine-tunes the evaluation model by the collected brainwave signals, so as to obtain an emotion tag; the brainwave music generation module maps the brainwave signals into brainwave music, and stores the brainwave music and marks it with a corresponding emotion tag, so as to generate a personal emotion music library.
The mental state regulation stage comprises the following steps: step Ll: a device with the brainwave acquisition module is worn on the subject's head; step L2: the brainwave acquisition module collects the subject's brainwave signals in real time and amplifies and filters the subject's brainwave signals, and then transmits the amplified and filtered brainwave signals to the mental state evaluation module; step L3: the mental state evaluation module analyzes the brainwave signals to evaluate the subject's mental state so as to obtain the mental state evaluation results, and then transmits the mental state evaluation results to the mental state regulation module; step L4: the mental state regulation module generates a playback control instruction or a stop playback instruction according to the mental state evaluation results, and sends the instruction to the brainwave music playback module; and step LS: the brainwave music playback module calls out the corresponding brainwave music from the personal emotion music library to play according to the playback control instruction, so as to regulate the subject's emotions, or the brainwave music playback module stops playing the brainwave music according to the stop playback instruction to complete the mental state regulation.
Preferably, in step L3, the mental state evaluation module analyzes the brainwave signals as follows: the mental state evaluation module performs time segmentation on the brainwave signals with time T as the period, so as to obtain a number of brainwave fragments; and then the time-domain features and frequency-domain features of the individual brainwave fragments are extracted, and the emotions are classified by a classifier, such that the subject's mental state is evaluated to obtain the mental state evaluation results.
Preferably, in step L4, the subject's target emotion is set in the mental state regulation module; the mental state evaluation result is compared with the target emotion: if the mental state evaluation result is the same as the target emotion, a stop playback instruction is generated, or else a playback control instruction for playing the target emotion brainwave music is generated.
In step L5, the brainwave music playback module calls out the brainwave music with the emotion tag of the target emotion from the personal emotion music library to play according to the playback control instruction, so as to regulate the subject's emotions; Compared with the prior art, the present invention has the following advantages and beneficial effects: 1. The present invention first collects the brainwave signals of a subject in different emotions, and then maps the brainwave signals into brainwave music of the corresponding emotions, so as to generate a personal emotion music library; when you need to regulate your mental state, you can use the brainwave music generated by your own brainwave to regulate your emotions. hi this way, this mental state regulation method can avoid the influence of the individual's different sensitivity to conventional music on the effect of emotion regulation, is well targeted to the subject, and can individually regulate emotion.
2. In the present invention, according to the period/frequency, amplitude and average power of the brainwave signals, brainwave music of different speeds, different cheerfulness and brightness levels, and different intensities can be generated, and then can be used to regulate the subject's mental state in a targeted manner.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram showing the structure of the mental state regulation system of the present invention; Fig. 2 is a block diagram showing the principle of the brainwave acquisition module in the mental state regulation system of the present invention; Fig. 3 is a block diagram showing the principle of the brainwave music generation module in the mental state regulation system of the present invention; Fig. 4 is a block diagram showing the principle of the mental state evaluation module in the mental state regulation system of the present invention; Fig. 5 is a block diagram showing the principle of the mental state regulation module in the mental state regulation system of the present invention; Fig. 6 is a block diagram showing the principle of the brainwave music playback module in the mental state regulation system of the present invention; and Fig. 7 is a block diagram showing the structure of the mental state regulation system of Example 2.
DETAILED DESCRIPTION OF THE EMBODIMENTS
The present invention will be further described below in detail with reference to drawings and specific embodiments.
Example 1
A personalized mental state regulation system based on brainwave music in Example 1 has a structure as shown in Figs. 1 to 6, and comprises the following components: a brainwave acquisition module, used to collect, amplify and filter a subject's brainwave signals; a brainwave music generation module, used to map the brainwave signals into brainwave music, and store the brainwave music and mark it with a corresponding emotion tag, so as to generate a personal emotion music library; a mental state evaluation module, used to analyze the brainwave signals to obtain mental state evaluation results of the subject; a mental state regulation module, used to generate a playback control instruction or a stop playback instruction according to the mental state evaluation results; and a brainwave music playback module, used to call out the corresponding brainwave music from the personal emotion music library to play according to the playback control instruction, or stop the brainwave music playback according to the stop playback instruction.
The brainwave acquisition module is signally connected with the brainwave music generation module and the mental state evaluation module, respectively; the mental state evaluation module, the mental state regulation module and the brainwave music playback module are connected signally in sequence; the brainwave music playback module is two-way signally connected with the brainwave music generation module; and the mental state evaluation module is signally connected with the brainwave music generation module.
The regulation principle of the present invention is as follows: brainwave signals are bioelectric signals generated during the transmission of information between neuron cells, electric wave signals generated by the ion exchange produced during the activity of pyramidal cell synapses in the cerebral cortex, and a comprehensive manifestation of the electrical activity of the human brain neuron group. Brainwave signals and music are similar in signal form and both the results of brain functional activities, and they both obey certain common scientific laws. Therefore, brainwave signals can be converted into brainwave music. In a state of tension, stress and fatigue, the brain will produce beta waves; in a state of consciousness and relaxation, the brain will produce alpha waves; in a state of interrupted consciousness and deep relaxation, the brain will produce theta waves; and in a state of deep sleep, the brain will produce delta waves. Brainwave signals can bring people into different states of consciousness in a short period of time. The frequency (alpha, beta, theta and delta) of the brainwave signals is synchronized with the frequency of the subject's brain, so as to make the brain enter the corresponding state. Having a strong role in the regulation of human emotions, music can affect the types and frequency bands of the generated brainwave, and affect the subject's mental state in the form of resonance.
The mental state regulation method used in the above-mentioned personalized mental state regulation system based on brainwave music comprises a personal emotion music library construction stage and a mental state regulation stage.
The personal emotion music library construction stage comprises the following steps: step S1: a device with the brainwave acquisition module is worn on the subject's head; step S2: a number of stimulus emotions, as well as an initialization evaluation model and stimulus videos corresponding to the various stimulus emotions are set; the stimulus videos corresponding to the various stimulus emotions are played to the subject in turn; and meanwhile the brainwave acquisition module collects, amplifies and filters the subject's brainwave signals, and then transmits the amplified and filtered brainwave signals to the mental state evaluation module and the brainwave music generation module; and step S3: the mental state evaluation module fine-tunes the evaluation model by the collected brainwave signals, so as to obtain an emotion tag; the brainwave music generation module maps the brainwave signals into brainwave music, and stores the brainwave music and marks it with a corresponding emotion tag, so as to generate a personal emotion music library.
The mental state regulation stage comprises the following steps: step L1: a device with the brainwave acquisition module is worn on the subject's head; step L2: the brainwave acquisition module collects the subject's brainwave signals in real time and amplifies and filters the subject's brainwave signals, and then transmits the amplified and filtered brainwave signals to the mental state evaluation module; step L3: the mental state evaluation module analyzes the brainwave signals to evaluate the subject's mental state so as to obtain the mental state evaluation results, and then transmits the mental state evaluation results to the mental state regulation module; step L4: the mental state regulation module generates a playback control instruction or a stop playback instruction according to the mental state evaluation results, and sends the instruction to the brainwave music playback module; and step L5: the brainwave music playback module calls out the corresponding brainwave music from the personal emotion music library to play according to the playback control instruction, so as to regulate the subject's emotions, or the brainwave music playback module stops playing the brainwave music according to the stop playback instruction to complete the mental state regulation.
The mental state regulation system of the present invention first collects the brainwave signals of a subject in different emotions, and then maps the brainwave signals into brainwave music of the corresponding emotions, so as to generate a personal emotion music library. When you need to regulate your mental state, you can use the brainwave music generated by your own brainwave to regulate your emotions. This mental state regulation method can avoid the influence of the individual's different sensitivity to conventional music on the effect of emotion regulation, is well targeted to the subject, and can individually regulate emotion.
As shown in Fig. 2, a brainwave acquisition module is used to collect, amplify and filter a subject's brainwave signals; the brainwave acquisition module may be wearable devices such as brainwave acquisition headbands, helmets, and hats. The brainwave acquisition module can be controlled and processed by an STM32 chip. First the wearable device is worn on the subject's head, so that the electrode stably contacts the subject's scalp surface; then lead selection is performed, and multi-lead brainwave signals are collected and then pre-amplified to obtain relatively strong signals; then post-amplification and filtering operation are carried out, and finally the brainwave signals are output.
As shown in Fig. 3, in the brainwave music generation module, mapping the brainwave signals into brainwave music means as follows: extracting the period, frequency, amplitude and average power of the brainwave signals of the left and right brains within a set duration, and mapping the brainwave signals of the left and right brains into the brainwave music of the left and right brains, respectively: mapping the period or frequency of the brainwave signals into the length of the brainwave music, and mapping the amplitude and average power of the brainwave signals into the pitch and intensity of the brainwave music, respectively; using music synthesis software to generate the brainwave music of the left and right brains; and integrating the brainwave music of the left and right brains to form a piece of two-channel stereo brainwave music.
The brainwave signals of the left and right brains are obtained by extracting the signals of the symmetrical electrodes of the left and right brains.
The period of the brainwave signals refers to the time interval between two adjacent wave troughs or peaks, with the unit in "ms". The frequency of the brainwave signals refers to the number of times the brainwave signals of the same period reappear within 1 s, with the unit in "Hz" or "cycle/second". The period or frequency of the brainwave signals is mapped into the length of the brainwave music, and the speed of music rhythm is used to express the different frequencies of the brainwave signals.
The amplitude of the brainwave signals refers to the magnitude of the fluctuation range of the brainwave signals. The rhythm of the brainwave signals varies with the activity state of the cerebral cortex. When the brain activity is relatively low, the electrical activity pace of many neurons in the cerebral cortex tends to be consistent, resulting in a rhythm with lower frequency and higher amplitude, which is called "synchronization"; when the brain activity is relatively intense and the electrical activity of neurons is not consistent, a rhythm with higher frequency and lower amplitude is obtained, which is called "desynchronization". There is a logarithmic relationship between the pitch and frequency of music, and the extent of pitch is called "range". The music with a higher range sounds brighter and more cheerful, while the music with a lower range sounds deeper and more stable. Based on the similarity between the amplitude and the pitch, the amplitude of the brainwave signals is mapped into the pitch of the brainwave music, such that the pitch is used to reflect the intensity of neuronal activity in the brain.
The average power of the brainwave signals is the energy characteristic of the brainwave signals and reflects the energy distribution of the brainwave signals, while the intensity of the music reflects the energy level of the sound source. Therefore, the average power of the brainwave signals is mapped into the intensity of the brainwave music, so as to use the intensity to emphasize the more intense neuronal activity.
In summary, the period/frequency, amplitude and average power of the brainwave signals are mapped into the length, pitch and intensity of the brainwave music, respectively; according to the period/frequency, amplitude and average power of the brainwave signals, brainwave music of different speeds, different cheerfulness and brightness levels, and different intensities can be generated, and then can be used to regulate the subject's mental state in a targeted manner.
In order to make the brainwave music more stereo and audible, two-channel brainwave signals from symmetrical electrodes of left and right hemispheres are used to generate two pieces of brainwave music, then the brainwave music of one of the channels is raised by an octave above the original pitch so as to divide the two-channel brainwave music into bass and treble, and then the left and right channels are set respectively to get the stereo brainwave music.
As shown in Fig. 4, the mental state evaluation module is used to perform time segmentation on the brainwave signals with time T as the period so as to obtain a number of brainwave fragments; and then the time-domain features and frequency-domain features of the individual brainwave fragments are extracted, and the emotions are classified by a classifier, such that the subject's mental state is evaluated to obtain the mental state evaluation results.
The time-domain features include mean value, median value, variance and peak value; the frequency-domain features include power spectrum and differential entropy; and the classifier refers to any one of an SVM classifier, a random forest classifier, and a width learning system classifier.
As shown in Fig. 5, in the mental state regulation module, the subject's target emotion is set, and the mental state evaluation result is compared with the target emotion: if the mental state evaluation result is the same as the target emotion, a stop playback instruction is generated, or else a playback control instruction for playing the target emotion brainwave music is generated.
As shown in Fig. 6, the brainwave music playback module selects the corresponding brainwave music from the personal emotion music library according to the playback control instructions generated by the mental state regulation module, and plays the selected brainwave music through speakers, earphones or bone conduction earphones, etc., to regulate the subject's emotional state.
The following is an example of constructing and regulating positive emotions: Personal emotion music library construction stage: A personal emotion music library with positive emotion tags is constructed.
Mental state regulation stage: In the mental state regulation module, the subject's target emotion is set as positive emotion; when the mental state evaluation result is, for example, negative emotion or calm emotion, instead of positive emotion, the mental state regulation module generate a playback control instruction for playing positive emotion brainwave music; the brainwave music playback module randomly selects positive emotion brainwave music from the personal emotion music library to play until the mental state evaluation result becomes positive emotion, when the mental state regulation module generates a stop playback instruction, so that the brainwave music playback module stops playing music.
The constructed personal emotion music library and the classification of emotion regulation can be defined according to the actual situation, such as constructing an emotion music library in a relaxed state to relieve anxiety and other emotions, and constructing an emotion music library in a sleepy state to assist in the treatment of insomnia The effects of the mental state regulation system and method of this example are verified in the following by experiments.
The relief of sadness was taken as an example for the experiments. The subjects were 10 college students who had not undergone systematic music training, and they started the experiments after signing an informed consent form.
Firstly, a personal emotion music library was constructed for each of the subjects. A brainwave acquisition cap was worn on each of the subjects, and 3 positive video clips were played to the subjects, each of the video clips being about 4 minutes long; after watching one of the video clips, the subjects filled out an emotion self-rating scale and rested for one minute before watching the next video clip; with the subjects' brainwave signals collected in the process of watching the video clips, the mental state evaluation system evaluated the mental state according to the brainwave signals, and then selected samples with the emotion self-rating scale results consistent with the mental state evaluation results to generate brainwave music, so as to ensure the emotion accuracy of the brainwave music; thus, a personal emotion music library of positive emotions was constructed.
Afterwards, mental state regulation experiments were carried out. A brainwave acquisition cap was worn on each of the subjects, and sadness video clips were played to the subjects, each of the video clips being about 4 minutes long; after watching one of the video clips, the subjects filled out an emotion self-rating scale; if the result of the emotion self-rating scale showed sadness, the subject was considered to be in a sad state at this time, and then the subject's brainwave signals were collected for evaluation and regulation; the mental state evaluation module detected that the mental state at this time was sadness, and sent the result to the mental state regulation module; the mental state regulation module generated an instruction to play positive emotion brainwave music and sent the instruction to the brainwave music playback module, which selected positive emotion brainwave music from the current subject's personal emotion music library to play; after the 10 subjects listened to the brainwave music for a period of time, the mental state evaluation module showed that their emotions at that time were calm emotions; after the 10 subjects continued listening to the brainwave music for a period of time, the mental state evaluation module showed that their emotions at that time were positive emotions, and here the mental state regulation module sent a stop playback instruction to the brainwave music playback module to stop playing the music.
The experiments could show that the system was effective in regulating emotion and could effectively regulate the subjects' mental state.
Example 2
A personalized mental state regulation system based on brainwave music in Example 2 is different from that in Example 1 in the following aspects: As shown in Fig. 7, the mental state regulation system in Example 2 further comprised a terminal module, which was used for storing and displaying the brainwave signals and mental state evaluation results; the brainwave acquisition module and the mental state evaluation module were signally connected with the terminal module, respectively. The terminal module could be a mobile APP or a PC. The collected brainwave signals and mental state evaluation results could be sent to the mobile APP or PC for display in real time. The terminal module was signally connected with a cloud platform through wireless communication to realize data management and storage. The rest of the structure of Example 2 was the same as that of Example 1.
The above examples are preferred embodiments of the present invention, but the embodiments of the present invention are not limited thereto, and any other alterations, modifications, replacements, combinations and simplifications should be equivalent substitutions and included in the scope of protection of the present invention.

Claims (10)

  1. CLAIMS1. A personalized mental state regulation system based on brainwave music, characterized in that the system comprises: a brainwave acquisition module, used to collect, amplify and filter a subject's brainwave signals; a brainwave music generation module, used to map the brainwave signals into brainwave music, and store the brainwave music and mark it with a corresponding emotion tag, so as to generate a personal emotion music library; a mental state evaluation module, used to analyze the brainwave signals to obtain mental state evaluation results of the subject; a mental state regulation module, used to generate a playback control instruction or a stop playback instruction according to the mental state evaluation results; and a brainwave music playback module, used to call out the corresponding brainwave music from the personal emotion music library to play according to the playback control instruction, or stop the brainwave music playback according to the stop playback instruction; the brainwave acquisition module is signally connected with the brainwave music generation module and the mental state evaluation module, respectively; the mental state evaluation module, the mental state regulation module and the brainwave music playback module are connected signally in sequence; the brainwave music playback module is two-way signally connected with the brainwave music generation module; and the mental state evaluation module is signally connected with the brainwave music generation module.
  2. 2. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: in the brainwave music generation module, mapping the brainwave signals into brainwave music means as follows: extracting the period, frequency, amplitude and average power of the brainwave signals of the left and right brains within a set duration, and mapping the brainwave signals of the left and right brains into the brainwave music of the left and right brains, respectively: mapping the period or frequency of the brainwave signals into the length of the brainwave music, and mapping the amplitude and average power of the brainwave signals into the pitch and intensity of the brainwave music, respectively; using music synthesis software to generate the brainwave music of the left and right brains; and integrating the brainwave music of the left and right brains to form a piece of two-channel stereo brainwave music.
  3. 3. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: the mental state evaluation module performs time segmentation on the brainwave signals with time T as the period, so as to obtain a number of brainwave fragments; and then the time-domain features and frequency-domain features of the individual brainwave fragments are extracted, and the emotions are classified by a classifier, such that the subject's mental state is evaluated to obtain the mental state evaluation results.
  4. 4. The personalized mental state regulation system based on brainwave music according to claim 3, characterized in that: the time-domain features include mean value, median value, variance and peak value; the frequency-domain features include power spectrum and differential entropy; and the classifier refers to any one of an SVM classifier, a random forest classifier, and a width learning system classifier.
  5. 5. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: in the mental state regulation module, the subject's target emotion is set, and the mental state evaluation result is compared with the target emotion: if the mental state evaluation result is the same as the target emotion, a stop playback instruction is generated, or else a playback control instruction for playing the target emotion brainwave music is generated.
  6. 6. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: the system further comprises the following components: a terminal module that is used for storing and displaying the brainwave signals and mental state evaluation results; and a brainwave acquisition module and a mental state evaluation module that are signally connected with the terminal module, respectively.
  7. 7. The personalized mental state regulation system based on brainwave music according to claim 6, characterized in that: the terminal module is signally connected with a cloud platform through wireless communication.
  8. 8. A mental state regulation method used in the personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: the method comprises a personal emotion music library construction stage and a mental state regulation stage; the personal emotion music library construction stage comprises the following steps: step Si: a device with the brainwave acquisition module is worn on the subject's head; step S2: a number of stimulus emotions, as well as an initialization evaluation model and stimulus videos corresponding to the various stimulus emotions are set; the stimulus videos corresponding to the various stimulus emotions are played to the subject in turn; and meanwhile the brainwave acquisition module collects, amplifies and filters the subject's brainwave signals, and then transmits the amplified and filtered brainwave signals to the mental state evaluation module and the brainwave music generation module; and step S3: the mental state evaluation module fine-tunes the evaluation model by the collected brainwave signals, so as to obtain an emotion tag; the brainwave music generation module maps the brainwave signals into brainwave music, and stores the brainwave music and marks it with a corresponding emotion tag, so as to generate a personal emotion music library; the mental state regulation stage comprises the following steps: step Ll: a device with the brainwave acquisition module is worn on the subject's head; step L2: the brainwave acquisition module collects the subject's brainwave signals in real time and amplifies and filters the subject's brainwave signals, and then transmits the amplified and filtered brainwave signals to the mental state evaluation module; step L3: the mental state evaluation module analyzes the brainwave signals to evaluate the subject's mental state so as to obtain the mental state evaluation results, and then transmits the mental state evaluation results to the mental state regulation module; step L4: the mental state regulation module generates a playback control instruction or a stop playback instruction according to the mental state evaluation results, and sends the instruction to the brainwave music playback module; and step L5: the brainwave music playback module calls out the corresponding brainwave music from the personal emotion music library to play according to the playback control instruction, so as to regulate the subject's emotions, or the brainwave music playback module stops playing the brainwave music according to the stop playback instruction to complete the mental state regulation.
  9. 9. The mental state regulation method according to claim 8, characterized in that: in step L3, the mental state evaluation module analyzes the brainwave signals as follows: the mental state evaluation module performs time segmentation on the brainwave signals with time T as the period, so as to obtain a number of brainwave fragments; and then the time-domain features and frequency-domain features of the individual brainwave fragments are extracted, and the emotions are classified by a classifier, such that the subject's mental state is evaluated to obtain the mental state evaluation results.
  10. 10. The mental state regulation method according to claim 8, characterized in that: in step L4, the subject's target emotion is set in the mental state regulation module; the mental state evaluation result is compared with the target emotion: if the mental state evaluation result is the same as the target emotion, a stop playback instruction is generated, or else a playback control instruction for playing the target emotion brainwave music is generated; in step L5, the brainwave music playback module calls out the brainwave music with the emotion tag of the target emotion from the personal emotion music library to play according to the playback control instruction, so as to regulate the subject's emotions.
GB2207261.5A 2019-11-27 2020-10-15 Personalized mental state adjustment system and method based on brainwave music Pending GB2608690A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911179106.1A CN110947075A (en) 2019-11-27 2019-11-27 Personalized mental state adjusting system and method based on brainwave music
PCT/CN2020/121029 WO2021103829A1 (en) 2019-11-27 2020-10-15 Personalized mental state adjustment system and method based on brainwave music

Publications (2)

Publication Number Publication Date
GB202207261D0 GB202207261D0 (en) 2022-06-29
GB2608690A true GB2608690A (en) 2023-01-11

Family

ID=69976863

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2207261.5A Pending GB2608690A (en) 2019-11-27 2020-10-15 Personalized mental state adjustment system and method based on brainwave music

Country Status (3)

Country Link
CN (1) CN110947075A (en)
GB (1) GB2608690A (en)
WO (1) WO2021103829A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112773376A (en) * 2019-11-07 2021-05-11 简世纬 Brain intelligent development detection system
CN110947075A (en) * 2019-11-27 2020-04-03 华南理工大学 Personalized mental state adjusting system and method based on brainwave music
CN111569226B (en) * 2020-05-13 2023-06-16 西安慧脑智能科技有限公司 Sleep aiding method and device based on audio processing
CN111839508A (en) * 2020-07-30 2020-10-30 陕西科技大学 Vehicle safe driving system based on mental state detection and control
CN112354064B (en) * 2020-11-30 2021-11-02 上海交通大学 Music auxiliary treatment system
CN112546391B (en) * 2020-12-04 2022-11-11 中国科学院深圳先进技术研究院 Method for determining emotional processing tendency and related product
CN112870522A (en) * 2021-01-12 2021-06-01 谭新杰 Attention adjusting method and system based on binaural-difference brain wave audio
CN112905835B (en) * 2021-02-26 2022-11-11 成都潜在人工智能科技有限公司 Multi-mode music title generation method and device and storage medium
CN115445050B (en) * 2022-08-30 2024-03-12 东南大学 Physical and mental state adjusting system based on bidirectional closed-loop brain-computer music interface
CN116671900B (en) * 2023-05-17 2024-03-19 安徽理工大学 Blink recognition and control method based on brain wave instrument

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102999701A (en) * 2012-11-28 2013-03-27 电子科技大学 Brain wave music generation method
US20130338429A1 (en) * 2012-06-13 2013-12-19 LifeMusic, Inc. Producing Audio Output for Music Therapy
CN105268080A (en) * 2014-06-04 2016-01-27 王振兴 Emotion regulation and control system and method
CN108877749A (en) * 2018-04-25 2018-11-23 杭州回车电子科技有限公司 A kind of generation method and system of E.E.G AI music
CN109350051A (en) * 2018-11-28 2019-02-19 华南理工大学 The head wearable device and its working method with adjusting are assessed for the state of mind
CN110947075A (en) * 2019-11-27 2020-04-03 华南理工大学 Personalized mental state adjusting system and method based on brainwave music
CN110947076A (en) * 2019-11-27 2020-04-03 华南理工大学 Intelligent brain wave music wearable device capable of adjusting mental state

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1420466A (en) * 2001-11-20 2003-05-28 罗一峰 Video music elextroencephalic biologic feedback method
CN100453036C (en) * 2007-02-13 2009-01-21 电子科技大学 Music brain electricity analytical method
EP2661301B1 (en) * 2011-01-07 2015-08-12 Koninklijke Philips N.V. Personalized healing sounds database
CN203108014U (en) * 2012-11-16 2013-08-07 邵加奎 Music brainwave cardio cerebral vascular therapy instrument
CN103071226A (en) * 2013-01-21 2013-05-01 北京大学 Method for increasing deep sleep time based on personalized pink noises
CN105725332A (en) * 2014-12-08 2016-07-06 西安天动数字科技有限公司 Sun helmet realizing automatic music switching according to brainwave detection
CN204319224U (en) * 2014-12-16 2015-05-13 蒋玉宏 A kind of multi-functional cerebrovascular and cardiovascular health care therapeutic instrument
KR20160082109A (en) * 2014-12-30 2016-07-08 주식회사 마카비즈 Brain wave and sound device helping development of emotion
CN104548309A (en) * 2015-01-05 2015-04-29 浙江工业大学 Device and method for adjusting driver emotional state through different affective characteristic music
CN204498301U (en) * 2015-02-16 2015-07-22 陈鹏 E.E.G music player
CN106345034A (en) * 2016-11-09 2017-01-25 武汉智普天创科技有限公司 Device based on brain electricity acquisition terminal for cognitive emotion regulation
CN106620990A (en) * 2016-11-24 2017-05-10 深圳创达云睿智能科技有限公司 Method and device for monitoring mood
CN107644661B (en) * 2017-09-22 2020-10-30 林万佳 Device and method for outputting binaural frequency difference music
CN109171645A (en) * 2018-07-10 2019-01-11 安徽省宇鸿纺织工艺制品有限公司 A kind of sleep monitor and sleeping cloud service system
CN108939249A (en) * 2018-07-20 2018-12-07 广州狄卡视觉科技有限公司 A kind of self-closing disease Cognitive education reinforcing intelligent evaluation rehabilitation training system
CN109394209B (en) * 2018-10-15 2021-07-06 汕头大学 Personalized emotion adjusting system and method for pregnant woman music treatment
CN109864750A (en) * 2019-01-31 2019-06-11 华南理工大学 Based on the state of mind assessment and regulating system and its working method stimulated through cranium
CN109621153A (en) * 2019-02-21 2019-04-16 曾雪娜 A kind of potential activating system and its method based on biauricular wave difference E.E.G music
CN110075409B (en) * 2019-04-17 2021-07-23 重庆大学 Personalized music sleep assisting method based on brain waves

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130338429A1 (en) * 2012-06-13 2013-12-19 LifeMusic, Inc. Producing Audio Output for Music Therapy
CN102999701A (en) * 2012-11-28 2013-03-27 电子科技大学 Brain wave music generation method
CN105268080A (en) * 2014-06-04 2016-01-27 王振兴 Emotion regulation and control system and method
CN108877749A (en) * 2018-04-25 2018-11-23 杭州回车电子科技有限公司 A kind of generation method and system of E.E.G AI music
CN109350051A (en) * 2018-11-28 2019-02-19 华南理工大学 The head wearable device and its working method with adjusting are assessed for the state of mind
CN110947075A (en) * 2019-11-27 2020-04-03 华南理工大学 Personalized mental state adjusting system and method based on brainwave music
CN110947076A (en) * 2019-11-27 2020-04-03 华南理工大学 Intelligent brain wave music wearable device capable of adjusting mental state

Also Published As

Publication number Publication date
GB202207261D0 (en) 2022-06-29
CN110947075A (en) 2020-04-03
WO2021103829A1 (en) 2021-06-03

Similar Documents

Publication Publication Date Title
WO2021103829A1 (en) Personalized mental state adjustment system and method based on brainwave music
CN106725462B (en) Acousto-optic Sleep intervention system and method based on EEG signals
CN110947076B (en) Intelligent brain wave music wearable device capable of adjusting mental state
CN109224242B (en) Psychological relaxation system and method based on VR interaction
US7769439B2 (en) Brain balancing by binaural beat
CN109585021B (en) Mental state evaluation method based on holographic projection technology
Baier et al. Event-based sonification of EEG rhythms in real time
CN109620257B (en) Mental state intervention and regulation system based on biofeedback and working method thereof
US20130177883A1 (en) Systems and Methods for Directing Brain Activity
US20030225340A1 (en) Repetitive visual stimulation to EEG neurofeedback protocols
Chalfoun et al. Subliminal cues while teaching: HCI technique for enhanced learning
US10029067B2 (en) Devices, systems and methods for monitoring brain activity and for enabling brain to rebalance
CN110742603A (en) Brain wave audible mental state detection method and system for realizing same
KR20190049442A (en) System and method for inducing sleep based on auditory stimulation
CN111569226A (en) Sleep aiding method and device based on audio processing
Sharma et al. Survey on binaural beats and background music for increased focus and relaxation
CN109567936B (en) Brain-computer interface system based on auditory attention and multi-focus electrophysiology and implementation method
CN114081511A (en) Brain-computer interface device and method induced by double-ear frequency division hearing
CN113143289A (en) Intelligent brain wave music earphone capable of being interconnected and interacted
Hu et al. Modulating emotion processing using transcranial alternating current stimulation (tACS)-A sham-controlled study in healthy human participants
KR20060007335A (en) A method and device of generating adaptive brainwave inducing signals which can be changed adaptively according to physiological status
CN112716453A (en) Blood pressure and nerve signal collecting and analyzing method
Gohari et al. Neural correlates of concurrent sound perception: A review and guidelines for future research
Song et al. The effect of a binaural beat combined with autonomous sensory meridian response triggers on brainwave entrainment
US11809488B2 (en) Method and system for generating a personalized playlist of sounds

Legal Events

Date Code Title Description
789A Request for publication of translation (sect. 89(a)/1977)

Ref document number: 2021103829

Country of ref document: WO