CN112618913A - Multi-mode-based self-adaptive emotion adjusting system and method - Google Patents
Multi-mode-based self-adaptive emotion adjusting system and method Download PDFInfo
- Publication number
- CN112618913A CN112618913A CN202110015234.3A CN202110015234A CN112618913A CN 112618913 A CN112618913 A CN 112618913A CN 202110015234 A CN202110015234 A CN 202110015234A CN 112618913 A CN112618913 A CN 112618913A
- Authority
- CN
- China
- Prior art keywords
- physiological data
- processor
- user
- data
- physiological
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M21/02—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/021—Measuring pressure in heart or blood vessels
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0022—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the tactile sense, e.g. vibrations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0027—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0044—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0044—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
- A61M2021/005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense images, e.g. video
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0072—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus with application of electrical currents
Abstract
The invention discloses a multi-mode-based self-adaptive emotion regulation system and a method, wherein a physiological data collection device collects blood pressure, heart rate and skin electrophysiological data of a user; the signal transmission device transmits the physiological data of the user collected by the physiological data collection device in real time; the data processor is embedded with a physiological data normal threshold, receives physiological data acquired by the physiological data acquisition device in real time through the signal transmission device, and compares and calculates the physiological data with the physiological data normal threshold to obtain the emotional state of a user and the physiological data required to be adjusted; the regulation and control terminal is used for receiving the physiological data regulation signal of the data processor, controlling the stimulation terminal corresponding to the regulated physiological data to provide multi-sense emotional stimulation for the user, and providing proper regulation and control stimulation and corresponding frequency/intensity for the user until the physiological data of the user falls within a normal threshold value, so that the user reaches a normal or good emotional state.
Description
Technical Field
The invention relates to the technical field of emotion regulation, in particular to a multi-mode-based self-adaptive emotion regulation system and method.
Background
Mood regulation is divided into endogenous and exogenous, with endogenous mood regulation referring to the process by which an individual maintains or alters its internal emotional or emotional state. Internal emotional or emotional states include not only those caused by external objective emotional stimuli, but also those that the individual induces itself. Effective endogenous mood-regulating measures include distraction and active reassessment of stimuli. Good mood regulation plays an important role for an individual, affecting for example social/interpersonal relationships, memory etc. of the individual. Reasonable emotional regulation is considered to be an important sign of "emotional maturity" and is also the basis for people to adapt to emotions and society. However, not all people can utilize endogenous emotional regulation to change or maintain mood to be in good condition. Some people adopt ineffective or even negative strategies in regulating emotion, such as excessive abreaction, emotion suppression, rumination and the like, and some are caused by sudden external objective emotional stimulation exceeding the adaptation range of individual endogenous emotional regulation, such as hand separation or dissimilarity, accidents, the absence of relatives and the like. Lack of effective mood regulation plays a central role in the development of many psychiatric disorders, such as depression, anxiety and the like.
Various psychiatric diseases and mood disorders have been shown to be associated with a lack of effective mood regulation, which greatly affects the personal well-being and social stability of people. For these people, it is essential to introduce a suitably effective external mood regulation. The existing external mood adjusting means mainly comprise psychological treatment, drug treatment and physical treatment (such as electroconvulsive treatment, deep brain stimulation treatment, transcranial magnetic stimulation treatment and the like). These existing approaches have the disadvantages of high price, high availability threshold, etc., which prevent people with dysregulated mood from getting timely help and treatment. Such low accessibility of treatments, especially for the less sick population, often prevents them from seeking help and treatment in the first instance, may cause their mood regulation to fail normally for a long time, progressing to more serious mood disorders and even mental illness.
Disclosure of Invention
In order to solve the technical problems, the emotion regulation of people with abnormal emotion regulation is realized, so that the people can reach a normal or good emotion state. Therefore, the invention provides a multi-mode-based self-adaptive emotion adjusting system and method, which can provide proper stimulation for regulation and control and corresponding frequency/intensity to a user by acquiring physiological data and comparing the physiological data with normal physiological data so as to adjust the emotion of the user and enable the user to reach a normal or good emotion state.
The invention adopts the following technical scheme:
in one aspect, the present invention provides a multi-modal based adaptive emotion adjusting system, which includes:
a physiological data collection device for collecting blood pressure, heart rate and skin electrophysiological data of a user;
the signal transmission device is used for transmitting the user physiological data acquired by the physiological data acquisition device in real time;
the data processor is internally embedded with a physiological data normal threshold, receives the physiological data acquired by the physiological data acquisition device in real time through the signal transmission device, and compares and calculates the physiological data with the physiological data normal threshold to obtain the emotional state of the user and the physiological data required to be adjusted;
and the regulation and control terminal comprises a plurality of physiological stimulation terminals which are respectively connected with the data processor and used for receiving the physiological data regulation signal of the data processor and controlling the physiological stimulation terminals corresponding to the regulated physiological data to provide multi-sense emotional stimulation for the user until the physiological data of the user falls into a normal threshold value.
Furthermore, the physiological data collection device comprises a blood pressure monitoring unit, a heart rate monitoring unit and a skin electric monitoring unit which are respectively used for monitoring the blood pressure, the heart rate and the skin electric physiological data of the user in real time.
Furthermore, a first wireless communication unit, a second wireless communication unit, a third wireless communication unit and a fourth wireless communication unit are arranged in the signal transmission device;
the data processor comprises a first processor, a second processor, a third processor and a fourth processor; the first wireless communication unit and the first processor are arranged in the physiological data collecting device, and the first processor is used for processing the collected physiological data, determining the emotional state of the user and generating emotion regulating physiological data; the second processor, the third processor and the fourth processor are respectively connected with the regulation and control terminal and are used for correspondingly regulating the physiological data provided by each physiological stimulation terminal;
the second wireless communication unit is connected with the second processor, the third wireless communication unit is connected with the third processor, the fourth wireless communication unit is connected with the fourth processor, and the first wireless communication unit realizes data transmission with the second wireless communication unit, the third wireless communication unit and the fourth wireless communication unit respectively;
the emotion regulating physiological data generated by the first processor is transmitted through the first wireless communication unit and transmitted to the corresponding second processor, third processor and fourth processor through the second wireless communication unit, the third wireless communication unit and the fourth wireless communication unit respectively.
The regulation and control terminal comprises a display, a player, a memory, a vibrator and an electric stimulator; music and picture data used for adjusting the emotion of a user are stored in the memory, the display is used for displaying the picture data in the memory, and the player is used for playing the music data in the memory; the second processor is connected with the display, the player and the memory, the vibrator is connected with the third processor, and the electric stimulator is connected with the fourth processor.
The display, the player, the memory, the second processor and the second wireless communication unit are integrated in the tablet computer.
The vibrator is a wrist strap with a vibrating motor, and the third wireless communication unit and the third processor are integrated in the wrist strap; the fourth wireless communication unit and the fourth processor are integrated within the electrical stimulator.
In another aspect, the present invention further provides a multi-modal based adaptive emotion adjusting method, including the following steps:
and 5, repeatedly executing the steps 1 to 4 until the physiological data of the user is adjusted to be within the normal threshold range of the physiological data, and finishing the adjustment.
The multi-sense emotion stimulation provided by the regulation and control terminal comprises audio and video stimulation, picture stimulation, vibration stimulation and electric stimulation.
If the physiological index of the user calculated by the data processor in the step 2 is higher than the normal threshold of the physiological data, executing a step 4, wherein the data processor controls the vibrator to provide the vibration frequency for the user as a lower threshold of the heart rate;
if the physiological index of the user calculated by the data processor in the step 2 is lower than the normal threshold of the physiological data, the step 4 is executed, the data processor controls the player to play music for the user, and simultaneously controls the vibration frequency provided by the vibrator to keep consistent with the music rhythm played by the player.
Further, if the physiological index of the user calculated by the data processor in the step 2 is higher than the normal threshold of the physiological data, executing a step 4, playing music with the speed lower than 80bpm for the user by the data processor through the control player, displaying a low-emotion awakening picture on the display, and controlling the electrical stimulator to provide electrical nerve stimulation;
if the physiological index of the user calculated by the data processor in the step 2 is lower than the normal threshold of the physiological data, the step 4 is executed, the data processor plays music with the speed higher than 80bpm for the user by controlling the player, and positive emotion pictures are displayed on the display.
The technical scheme of the invention has the following advantages:
A. the invention provides a system for judging the emotion state of a user by utilizing multi-modal physiological data and providing an emotion regulation system in a self-adaptive manner, wherein the regulation method adopted by the system can simultaneously acquire blood pressure, heart rate and skin electrical three-dimensional physiological data of the user, judge the emotion state of the user, calculate the deviation value of the current emotion state and the normal threshold value of the physiological data, and automatically judge whether to execute emotion regulation or not by combining the emotion state and the deviation value; the invention provides proper stimulation for regulation and control and corresponding frequency/intensity for the user based on the collected physiological signals of the user, and regulates the emotion of the user, so that the user achieves normal physiological data and a good emotion state.
B. When the emotion is regulated, the regulation and control terminal combines audio frequency, pictures, vibration and electrical stimulation to stimulate the user from multiple senses of vision, hearing and body sensation, and has good effects on improving emotion awakening and emotion calming of the user; the content, frequency and strength of the adopted stimulation for adjusting the emotion are self-adaptively adjusted according to the real-time physiological data of the user, and the method has stronger pertinence and convenience.
Drawings
In order to more clearly illustrate the embodiments of the present invention, the drawings which are needed to be used in the embodiments will be briefly described below, and it is apparent that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained from the drawings without inventive labor to those skilled in the art.
FIG. 1 is a flow chart of a mood regulating method provided by the present invention;
FIG. 2 is a schematic diagram of a mood regulating method provided by the present invention;
FIG. 3 is a block diagram of a mood regulating system provided in accordance with the present invention;
FIG. 4 is a graphical representation of the results of example 1 of the application of the present invention;
fig. 5 is a graph showing the results of application example 2 of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 3, the present invention provides a multi-modal based adaptive emotion adjusting system, including: physiological data collection device, signal transmission device, data processor and regulation and control terminal. The physiological data collecting device is used for collecting blood pressure, heart rate and skin electrophysiological data of a user; the signal transmission device is used for transmitting the user physiological data acquired by the physiological data acquisition device in real time; the data processor is internally embedded with a physiological data normal threshold, receives physiological data acquired by the physiological data acquisition device in real time through the signal transmission device, and compares and calculates the physiological data with the physiological data normal threshold to obtain the emotional state of a user and the physiological data required to be adjusted; the regulation and control terminal comprises a plurality of physiological stimulation terminals which are respectively connected with the data processor and used for receiving the physiological data regulation signal of the data processor and controlling the stimulation terminals corresponding to the regulated physiological data to provide multi-sense emotional stimulation for the user until the physiological data of the user falls into a normal threshold value.
The physiological data collection device comprises a blood pressure monitoring unit, a heart rate monitoring unit and a skin electricity monitoring unit which are respectively used for monitoring blood pressure, heart rate and skin electricity physiological data of a user in real time, and common equipment is adopted for monitoring blood oxygen, heart rate and skin electricity and collecting data.
The invention can collect the physiological signal of the user through the physiological data collecting device, provide proper regulation and control multi-sense stimulation and corresponding frequency/intensity based on the physiological signal of the user, and regulate the emotion of the user so as to ensure that the user achieves a normal or good emotional state.
The signal transmission device is provided with a first wireless communication unit, a second wireless communication unit, a third wireless communication unit and a fourth wireless communication unit; the data processor comprises a first processor, a second processor, a third processor and a fourth processor; the first wireless communication unit and the first processor are arranged in the physiological data collecting device, and the first processor is used for processing the collected physiological data, determining the emotional state of the user and generating emotional regulation physiological data; the second processor, the third processor and the fourth processor are respectively connected with the regulation and control terminal and are used for correspondingly regulating the physiological data provided by each physiological stimulation terminal to the user; the second wireless communication unit is connected with the second processor, the third wireless communication unit is connected with the third processor, the fourth wireless communication unit is connected with the fourth processor, and the first wireless communication unit realizes data transmission with the second wireless communication unit, the third wireless communication unit and the fourth wireless communication unit respectively; the emotion regulating physiological data generated by the first processor is transmitted by the first wireless communication unit and transmitted to the corresponding second processor, third processor and fourth processor through the second wireless communication unit, the third wireless communication unit and the fourth wireless communication unit.
The regulation and control terminal comprises a display, a player, a memory, a vibrator and an electric stimulator; the memory stores music and picture data for adjusting the emotion of the user, the display is used for displaying the picture data in the memory, and the player is used for playing the music data in the memory; the second processor is connected with the display, the player and the memory, and is integrated in the tablet personal computer with the second wireless communication unit, the vibrator is connected with the third processor, and the electric stimulator is connected with the fourth processor. As used herein, the stimulation terminal, such as the display, the player, the memory and the electrical stimulator, the vibrator, preferably a wrist band with a vibrating motor, is used as a prior art device, the third wireless communication unit and the third processor are integrated in the wrist band, and the fourth wireless communication unit and the fourth processor are integrated in the electrical stimulator. Therefore, the tablet personal computer, the electric stimulator and the vibrator respectively realize data communication with the first processor in the physiological data collecting device through respective communication units, receive the physiological regulation task generated by the first processor, control the corresponding physiological stimulation terminal, achieve the purpose of regulating the physiological parameters of the user, adopt personalized regulation and have stronger pertinence.
The display, the player, the memory, the vibrator and the electric stimulator are all the prior art. Each wireless communication unit can be communication equipment such as WIFI, 4G, 5G and the like.
The blood pressure monitoring unit in the physiological data collecting device measures the blood pressure of a user, the blood pressure can be a mechanism for linking the long-term health state of the body with the emotional response of the user, the emotional regulation condition of the user can be effectively reflected, and the physiological data collecting device is the first physiological feedback parameter of the system.
The heart rate monitoring unit in the physiological data collecting device is used for measuring the real-time heart rate of the user, the heart rate deviation from the baseline and the measurement of the heart rate deviation from the baseline are related to emotional reactions such as anxiety, fear, excitation and the like, are reliable physiological indexes for responding to emotional awakening in a short period and serve as second physiological feedback parameters in the system.
The skin electricity monitoring unit in the physiological data collecting device is used for detecting skin electricity activity of a user. Electrodermal activity is a measure of the user's sympathetic nervous system activity, which is associated with increased emotional arousal, and is highly sensitive to changes in excitability system-related emotions, such as positive and neutral emotions. Electrodermal activity is used in the present system as a third physiological feedback parameter.
Through the physiological signal of gathering the user to transmit for first treater, first treater will gather physiological data and blood pressure, rhythm of the heart, the normal upper and lower threshold value of skin electricity and compare, judge user's emotional state according to user's real-time physiological data. The first processor adaptively makes an emotion adjustment scheme according to the physiological data of the user and sends information to the second wireless communication unit, the third wireless communication unit and the fourth wireless communication unit through the first wireless communication unit; the second, third and fourth wireless communication units receive the corresponding information and transmit the information to the second, third and fourth processors, and the second, third and fourth processors control the corresponding display unit, the playing unit, the vibration unit and the electrical stimulation unit to output picture, sound, vibration and nerve electrical stimulation information so as to adjust the emotion of the user. In the process, the physiological data collection system continuously monitors the physiological data of the user, and adjusts the multi-sense stimulation output by the regulation and control terminal according to the physiological data until all the physiological data of the user are within the normal threshold value of the physiological data, the system stops working, and the emotion adjustment of the user is completed.
Referring to fig. 1 and fig. 2, the specific emotion adjusting method comprises the following steps:
(S1) collecting the blood pressure, heart rate, skin electrophysiological data of the user by a physiological data collection device.
Collect user's blood pressure, real-time rhythm of the heart and skin electricity respectively through blood pressure monitor cell, rhythm of the heart monitor cell and skin electricity monitor cell, compare physiological data and normal threshold value through first treater. The normal threshold here is measured by the user under calm and self-reporting abnormal mood; the normal threshold may also be determined based on the normal range of blood pressure, heart rate and electrodermal in clinical use.
And (S2) the data processor determines the emotional state of the user according to the collected physiological data and the physiological data normal threshold value, and calculates the deviation value of the physiological data and the physiological data normal threshold value.
The first processor combines the collected physiological data to judge whether the physiological data of the user is within a normal threshold value, and calculates a difference deviation value between the physiological data and the upper threshold value and the lower threshold value.
And (S3) the data processor combines the emotional state of the user and the deviation value calculated in the step (S2) to generate the physiological data to be adjusted. If the physiological data of the user is judged to be within the normal threshold value, the physiological data of the subsequent user does not need to be adjusted, and the regulation and control terminal does not need to do any stimulation operation on the user; if the physiological data of the user is not within the normal threshold value, a scheme for subsequently adjusting the physiological data is made, and the step (S4) is executed.
And (S4) the regulating terminal receives the physiological data to be regulated generated in the step (S3) and controls the physiological stimulation terminal corresponding to the physiological data to be regulated so as to present the multi-sense emotion regulating stimulation to the user.
Here, the physiological data to be adjusted can also be expressed as physiological data that does not need to be adjusted, and in this case, the physiological stimulation terminal does not need to be controlled to present any sensory stimulation to the user.
Through monitoring, when the emotion state of the user needs to be adjusted, the second processor and the third processor receive the emotion adjusting signal and the emotion state of the user through the second wireless communication unit and the third wireless communication unit, and play set music and pictures according to the received information, start vibration of the bracelet, provide nerve electrical stimulation and the like. In some embodiments, the music in the memory is a favorite music set provided by the user, and may also be music that is directly selected from a database and is known to have a better control effect on human emotion, such as military travel songs, classical music, and the like, and is not specifically limited herein; similarly, in some embodiments, the pictures in the memory are a set of favorite pictures provided by the user, and may include pictures taken by the user, or network pictures collected by the user, etc.; of course, the picture set that is known to have a significant emotion regulating effect on humans and is directly selected from the database, such as positive pictures in the chinese emotion picture library, etc., which is not specifically limited herein. The strength of the electrical nerve stimulation is determined according to the user's feeling, and in some embodiments, the parameters of the electrical nerve stimulation adopt the frequency of 25Hz and the pulse width of 250 mus; in other embodiments, the electrical nerve stimulation may also use other parameters that can adjust the mood of the user, such as frequency 8Hz, pulse width 250 μ s, etc., and is not limited herein. As for the vibration frequency of the bracelet vibration motor, it depends on the emotion of the user and the music played.
Specifically, the system obtains the adjustment signal when the physiological indicator of the user is not within the normal threshold of the physiological data. If the physiological index of the user is higher than the upper threshold and the lower threshold, the user is in a state of high emotional arousal. Higher physiological indicators are also directly associated with higher anxiety or stress, where reduced emotional arousal in the user, producing sedation to the user is a primary goal of the present system. At the moment, the vibration frequency of the wrist strap vibration motor is lower threshold limit of the heart rate, and the slower vibration rhythm can effectively reduce the awakening degree of a user and enable the user to reach a subjective calm state. If the physiological indicator of the user is lower than the upper and lower thresholds, which means that the user is in a state of low emotional arousal, the main objective of the system is to increase the emotional arousal of the user. The vibration frequency of the wrist strap vibration motor keeps consistent with the rhythm of music.
Certainly, when the physiological index of the user is monitored to be higher than the upper threshold and the lower threshold, on the basis of wrist strap vibration, a music playing stimulation mode, a picture stimulation mode and an electrical stimulation mode are adopted, music with the playing speed of less than 80bpm is adopted, and the picture is awakened by using a low-emotion picture, so that nerve electrical stimulation is provided for the user; when the physiological indexes of the user are monitored to be lower than upper and lower threshold values, on the basis of applying wrist strap vibration, music with the playing speed higher than 80bpm and positive emotion pictures are adopted, and the nerve electrical stimulation is not provided for the user.
And (S5) repeatedly executing the steps from (S1) to (S4) until the physiological data of the user are adjusted to be within the normal threshold range of the physiological data, and finishing the adjustment.
In step S2, when all the physiological data of the user are within the normal threshold, the system stops operating. In some embodiments, the user can return various physiological data to be within a normal threshold value through one round of adjustment of the system, the system stops running, and the emotion adjustment of the user is completed; in some embodiments, the user needs to go through multiple rounds of adjustment of the system to return the physiological data to within normal thresholds, and even the emotional adjustment direction of two consecutive rounds may be opposite; in other embodiments, the physiological data of the user is initially within a threshold value, indicating that the user does not need to undergo emotional adjustments by the present system.
When the emotion is regulated, the regulation and control terminal combines audio frequency, pictures, vibration and electrical stimulation to stimulate the user from multiple senses of vision, hearing and body sensation, and has good effects on improving emotion awakening and emotion calming of the user; the content, frequency and strength of the adopted stimulation for adjusting the emotion are self-adaptively adjusted according to the real-time physiological data of the user, and the method has stronger pertinence and convenience.
Application example 1
20 healthy subjects aged 18-35 years are recruited, at least one round of emotion regulation is carried out by using the system, self-reporting and evaluation of emotion are carried out by the subjects before and after the subjects respectively, wherein the self-reporting and evaluation comprise emotional arousal and valence (0-10 points), and a commonly used emotion evaluation scale, namely a positive negative emotion scale (0-5 points), is used. In this application example, the music in the memory is a user-preferred music collection provided by the user. The results are shown in fig. 4, and the higher the score is, the stronger the dimension strength of the emotion is represented. It can be seen that through the regulation of the system, the awakening and the potency of the user are both remarkably improved (p is less than 0.001); positive mood rises were extremely significant and negative mood decreases were significant (p < 0.05). Thus, after at least one round of adjustment, the mood of the user is significantly improved.
Application example 2
18 healthy subjects aged 18-35 years are recruited, at least one round of emotion regulation is carried out by using the system, self-assessment of emotion is carried out by the subjects before and after, and a commonly used emotion assessment scale, namely a positive and negative emotion scale (0-5 points) is used. In this application example, the parameters of the electrical stimulator were chosen to be 25Hz with a pulse width of 250 μ s. The results are shown in fig. 5, and the higher the score is, the stronger the dimension strength of the emotion is represented. It can be seen that through the adjustment of the present system, the user's positive mood decreased significantly (p <0.001) and negative mood decreased significantly (p < 0.05). Thus, after at least one round of adjustment, the mood of the user is remarkably calmed.
By combining the two application examples, the invention has good effects on improving the emotional arousal and emotional tranquilization of the user.
It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are intended to be within the scope of the invention.
Claims (10)
1. An adaptive emotion adjusting system based on multiple modalities, the system comprising:
a physiological data collection device for collecting blood pressure, heart rate and skin electrophysiological data of a user;
the signal transmission device is used for transmitting the user physiological data acquired by the physiological data acquisition device in real time;
the data processor is internally embedded with a physiological data normal threshold, receives the physiological data acquired by the physiological data acquisition device in real time through the signal transmission device, and compares and calculates the physiological data with the physiological data normal threshold to obtain the emotional state of the user and the physiological data required to be adjusted;
and the regulation and control terminal comprises a plurality of physiological stimulation terminals which are respectively connected with the data processor and used for receiving the physiological data regulation signal of the data processor and controlling the physiological stimulation terminals corresponding to the regulated physiological data to provide multi-sense emotional stimulation for the user until the physiological data of the user falls into a normal threshold value.
2. The multi-modality-based adaptive mood conditioning system of claim 1, wherein the physiological data collection device includes a blood pressure monitoring unit, a heart rate monitoring unit, and a electrodermal monitoring unit for monitoring blood pressure, heart rate, and electrodermal data of the user in real-time, respectively.
3. The multi-modality-based adaptive emotion adjusting system of claim 2, wherein the signal transmission means includes a first wireless communication unit, a second wireless communication unit, a third wireless communication unit and a fourth wireless communication unit;
the data processor comprises a first processor, a second processor, a third processor and a fourth processor; the first wireless communication unit and the first processor are arranged in the physiological data collecting device, and the first processor is used for processing the collected physiological data, determining the emotional state of the user and generating emotion regulating physiological data; the second processor, the third processor and the fourth processor are respectively connected with the regulation and control terminal and are used for correspondingly regulating the physiological data provided by each physiological stimulation terminal;
the second wireless communication unit is connected with the second processor, the third wireless communication unit is connected with the third processor, the fourth wireless communication unit is connected with the fourth processor, and the first wireless communication unit realizes data transmission with the second wireless communication unit, the third wireless communication unit and the fourth wireless communication unit respectively;
the emotion regulating physiological data generated by the first processor is transmitted through the first wireless communication unit and transmitted to the corresponding second processor, third processor and fourth processor through the second wireless communication unit, the third wireless communication unit and the fourth wireless communication unit respectively.
4. The multi-modality-based adaptive emotion modulation system of claim 3, wherein the regulation terminal comprises a display, a player, a memory, a vibrator, and an electrical stimulator; music and picture data used for adjusting the emotion of a user are stored in the memory, the display is used for displaying the picture data in the memory, and the player is used for playing the music data in the memory; the second processor is connected with the display, the player and the memory, the vibrator is connected with the third processor, and the electric stimulator is connected with the fourth processor.
5. The multi-modality-based adaptive mood adjustment system of claim 4, wherein the display, player, memory, and second processor and second wireless communication unit are integrated into a tablet.
6. The multi-modality-based adaptive mood adjustment system of claim 4, wherein the vibrator is a wrist band with a vibration motor, the third wireless communication unit and third processor being integrated in the wrist band; the fourth wireless communication unit and the fourth processor are integrated within the electrical stimulator.
7. A multi-modal-based adaptive emotion adjusting method is characterized by comprising the following steps of:
step 1, collecting blood pressure, heart rate and skin electrophysiological data of a user by a physiological data collection device;
step 2, the data processor determines the emotional state of the user according to the collected physiological data and the normal threshold value of the physiological data, and calculates the deviation value of the physiological data and the normal threshold value of the physiological data;
step 3, the data processor combines the emotional state of the user and the deviation value calculated in the step 2 to generate the physiological data to be regulated;
step 4, the regulation and control terminal receives the physiological data to be regulated generated in the step 3, and controls the physiological stimulation terminal corresponding to the physiological data to be regulated so as to present multi-sense emotion regulation stimulation to the user;
and 5, repeatedly executing the steps 1 to 4 until the physiological data of the user is adjusted to be within the normal threshold range of the physiological data, and finishing the adjustment.
8. The multi-modality-based adaptive emotion modulation system of claim 7, wherein the multi-sensory emotional stimuli provided by the regulation terminal include audio-visual stimuli, picture stimuli, vibration stimuli, and electrical stimuli.
9. The multi-modality-based adaptive emotion adjusting method of claim 8, wherein if the physiological index of the user calculated by the data processor in step 2 is higher than the normal threshold of the physiological data, step 4 is executed, and the data processor sets the vibration frequency provided to the user by controlling the vibrator to be the lower threshold of the heart rate;
if the physiological index of the user calculated by the data processor in the step 2 is lower than the normal threshold of the physiological data, the step 4 is executed, the data processor controls the player to play music for the user, and simultaneously controls the vibration frequency provided by the vibrator to keep consistent with the music rhythm played by the player.
10. The multi-modality-based adaptive emotion adjusting method as claimed in claim 9, wherein if the physiological index of the user calculated by the data processor in step 2 is higher than the normal threshold of the physiological data, step 4 is executed, the data processor controls the player to play music with a speed lower than 80bpm for the user, displays a low emotion wake-up picture on the display, and controls the electrical stimulator to provide electrical stimulation to nerves;
if the physiological index of the user calculated by the data processor in the step 2 is lower than the normal threshold of the physiological data, the step 4 is executed, the data processor plays music with the speed higher than 80bpm for the user by controlling the player, and positive emotion pictures are displayed on the display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110015234.3A CN112618913A (en) | 2021-01-06 | 2021-01-06 | Multi-mode-based self-adaptive emotion adjusting system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110015234.3A CN112618913A (en) | 2021-01-06 | 2021-01-06 | Multi-mode-based self-adaptive emotion adjusting system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112618913A true CN112618913A (en) | 2021-04-09 |
Family
ID=75290947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110015234.3A Pending CN112618913A (en) | 2021-01-06 | 2021-01-06 | Multi-mode-based self-adaptive emotion adjusting system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112618913A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114053550A (en) * | 2021-11-19 | 2022-02-18 | 东南大学 | Earphone type emotional pressure adjusting device based on high-frequency electrocardio |
| CN114617555A (en) * | 2022-03-16 | 2022-06-14 | 山东大学 | Psychological assessment system, medium, and apparatus based on physiological characteristic stability detection |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1723839A (en) * | 2005-07-21 | 2006-01-25 | 高春平 | Method and device for testing health-index of individualized and three-D type |
| WO2009018374A1 (en) * | 2007-07-30 | 2009-02-05 | Neurofocus, Inc. | Neuro-response stimulus and stimulus attribute resonance estimator |
| CN104548309A (en) * | 2015-01-05 | 2015-04-29 | 浙江工业大学 | Device and method for adjusting driver emotional state through different affective characteristic music |
| CN205095217U (en) * | 2015-11-16 | 2016-03-23 | 江西华城科技有限公司 | Intelligence body and mind feedback training system |
| CN108289630A (en) * | 2015-10-05 | 2018-07-17 | Mc10股份有限公司 | Method and system for nerve modulation and stimulation |
| CN109620257A (en) * | 2018-11-28 | 2019-04-16 | 华南理工大学 | State of mind intervention and regulating system and its working method based on biofeedback |
| CN109620262A (en) * | 2018-12-12 | 2019-04-16 | 华南理工大学 | A kind of Emotion identification system and method based on wearable bracelet |
| CN112120719A (en) * | 2020-09-24 | 2020-12-25 | 西交利物浦大学 | Wearable system and method for emotion adjustment |
-
2021
- 2021-01-06 CN CN202110015234.3A patent/CN112618913A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1723839A (en) * | 2005-07-21 | 2006-01-25 | 高春平 | Method and device for testing health-index of individualized and three-D type |
| WO2009018374A1 (en) * | 2007-07-30 | 2009-02-05 | Neurofocus, Inc. | Neuro-response stimulus and stimulus attribute resonance estimator |
| CN104548309A (en) * | 2015-01-05 | 2015-04-29 | 浙江工业大学 | Device and method for adjusting driver emotional state through different affective characteristic music |
| CN108289630A (en) * | 2015-10-05 | 2018-07-17 | Mc10股份有限公司 | Method and system for nerve modulation and stimulation |
| CN205095217U (en) * | 2015-11-16 | 2016-03-23 | 江西华城科技有限公司 | Intelligence body and mind feedback training system |
| CN109620257A (en) * | 2018-11-28 | 2019-04-16 | 华南理工大学 | State of mind intervention and regulating system and its working method based on biofeedback |
| CN109620262A (en) * | 2018-12-12 | 2019-04-16 | 华南理工大学 | A kind of Emotion identification system and method based on wearable bracelet |
| CN112120719A (en) * | 2020-09-24 | 2020-12-25 | 西交利物浦大学 | Wearable system and method for emotion adjustment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114053550A (en) * | 2021-11-19 | 2022-02-18 | 东南大学 | Earphone type emotional pressure adjusting device based on high-frequency electrocardio |
| CN114617555A (en) * | 2022-03-16 | 2022-06-14 | 山东大学 | Psychological assessment system, medium, and apparatus based on physiological characteristic stability detection |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220273896A1 (en) | Methods and apparatus for assessing sleep quality | |
| CN110522983B (en) | Brain stimulation system, method, device and storage medium based on artificial intelligence | |
| JP5684828B2 (en) | Automatic sleep therapy system | |
| Delplanque et al. | Sequential unfolding of novelty and pleasantness appraisals of odors: evidence from facial electromyography and autonomic reactions. | |
| JP4721451B2 (en) | Automated system and apparatus for facilitating behavioral therapy using information indicating awake / sleep state of a subject | |
| JP2022517752A (en) | Wave generation system and method for percutaneous vibration | |
| US11185281B2 (en) | System and method for delivering sensory stimulation to a user based on a sleep architecture model | |
| EP3723598B1 (en) | System and method for determining sleep onset latency | |
| KR102383921B1 (en) | Methods and system for customized sleep management | |
| CN112618913A (en) | Multi-mode-based self-adaptive emotion adjusting system and method | |
| KR20160085577A (en) | Apparatus and method for decision of psychological state using bio signals | |
| US20210205574A1 (en) | Systems and methods for delivering sensory stimulation to facilitate sleep onset | |
| CN113646845A (en) | Method and system for delivering sensory simulation based on evoked response quantification | |
| CN115298746A (en) | Characterizing stimulus response to detect sleep disorders | |
| JP2023153785A (en) | Treatment device | |
| US11141093B2 (en) | System and method for delivering sensory stimulation to a user to enhance a cognitive domain in the user | |
| KR20230051194A (en) | Methods and systems for measuring anxiety levels associated with and/or correlated with modified state of consciousness levels and/or pain levels | |
| US20240041397A1 (en) | An apparatus and method of controlling a pain alleviating sleep assistance device | |
| EP3918986A1 (en) | A method and system for monitoring a level of modified consciousness and a level of pain | |
| JP2023532626A (en) | Methods and systems for monitoring pain levels | |
| JP2022117633A (en) | Score calculation device and method, and control program for score calculation device | |
| CN116570283A (en) | Perioperative patient emotion monitoring system and method | |
| CN115336993A (en) | Body and mind state estimation system, body and mind state estimation method, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |