KR20220074744A - Driver stress relief system using sound source corresponding to stable electrocardiogram waveform - Google Patents

Abstract

The present invention monitors the heart rate of a driver at all times, collects ECG waveforms at rest, and reproduces a sound source corresponding to the ECG waveform at rest in a situation where it is determined that the stress is increased, thereby relieving stress. It relates to a driver stress relief system using a sound source corresponding to a waveform.

Description

Driver stress relief system using sound source corresponding to stable electrocardiogram waveform

The present invention relates to a stress relief system, and more particularly, by constantly monitoring the driver's ECG signal, collecting the ECG waveform at rest, and reproducing a sound source corresponding to the ECG waveform at rest in a situation where it is determined that the stress is increased It relates to a driver stress relief system using a sound source corresponding to the ECG waveform at rest, which can relieve

In modern society, anxiety and stress are increasing due to the occurrence of various social problems such as rapidly changing social environment, excessive competition, dehumanization, social and psychological crimes, the emergence of infectious diseases and aging, and it is acting as a factor that greatly threatens mental and physical health. .

Such stress causes persistent and excessive anxiety, maintains body homeostasis, adversely affects physical reactions such as cardiovascular and musculoskeletal systems, and emotional stability, causes instability of immune function, hypertension, sleep disturbance, etc. It can also cause a lot of damage to society.

The electrocardiogram (ECG), which clinically records the periodic activity of the heart, reflects the health condition of the subject, and the degree of action of the body's autonomic nervous system (sympathetic and parasympathetic) can be determined through heart rate analysis. , active research is being conducted on biosignal information analysis technology necessary for health maintenance and disease prevention.

In order to monitor the stress experienced while driving, basic research for measuring an electrocardiogram from a vehicle steering wheel and a study for attempting to measure a biosignal by placing an electrocardiogram electrode used clinically on the vehicle steering wheel are also being conducted.

However, it simply provides a form of understanding the driver's condition through the measurement of a biosignal called an electrocardiogram, and does not clearly show the degree of correlation between the value calculated through electrocardiogram analysis and the driver's condition. Although limited, only methods limited to the difference between before and after treatment were suggested, and the effect was not known in most cases.

Republic of Korea Patent Publication No. 10-2008-0038512 (2008.05.07)

The present invention was created to solve the above problems, and an object of the present invention is to collect and monitor the driver's electrocardiogram, obtain an electrocardiogram waveform in a stable state, and obtain an electrocardiogram obtained in a situation where it is determined that the stress is increased. It is to provide a driver stress relief system using a sound source corresponding to the ECG waveform at rest, which relieves stress to a stable level by providing a sound wave reconstructed by reflecting the ECG waveform.

For the above purpose, the present invention provides a sensor module for measuring an electrocardiogram signal of a driver; an analysis module that collects and analyzes waveform information including the amplitude and frequency of the heartbeat through the measured electrocardiogram signal and extracts the waveform information of the psychological stabilizer; A sound source management module having a sound wave generator for generating sound waves with the same sound wave characteristics by extracting feature vectors for the amplitude and frequency of the waveform information of the ballast, and a sound source storage unit for receiving and storing a plurality of sound sources having a BPM within a set range ; a monitoring module for monitoring and analyzing the electrocardiogram signal measured through the sensor module to confirm a change in driver's stress; As it is determined that the driver's stress increases, a search unit that searches the sound source storage for the same sound source as the BPM according to the waveform information of the psychological stabilizer, and a sound source that processes the searched sound source by reflecting the sound wave generated through the sound wave generator an output module for outputting a processing unit and an output unit for outputting the processed sound source so that a driver can hear it; characterized in that it consists of

At this time, a collection unit for collecting driving information including the speed and operation state of the vehicle being driven, a recognition unit for determining the driving state of the vehicle through the driving information and recognizing the driver's stress rising situation, and the monitoring module A linkage unit for deriving correlation information by linking the stress change analyzed through the driving state with the driving state, and a setting unit for generating reference information that the analysis module can determine as a stable period by analyzing the accumulated correlation information interlocking module; may further include.

In addition, a control module comprising: a control module comprising: a pattern analysis unit for generating driving pattern information based on the collected driving information; and a preemptive operation unit for operating the output unit by using driving pattern information and correlation information according to the current driving state of the vehicle; may further include.

In addition, an identification unit that operates the output unit and correspondingly identifies a driver who has boarded through an electrocardiogram signal measured from the driver, and collects and analyzes an electrocardiogram signal in a state where the vehicle is not started for the identified driver Identification module having a correction unit for generating reference information that the module can determine the ballast; may further include.

In addition, a first tracking unit that collects real-time changes in the ECG signal collected through the sensor module in response to the sound source output through the output unit, and a converted sound source to which BPM and sound wave characteristics of the upper and lower ranges are applied to the output sound source A second tracking unit for generating and outputting and correspondingly collecting real-time changes in the ECG signal collected through the sensor module, and analyzing the collection results of the first and second tracking units to generate a real-time ECG signal as a waveform of a stabilizer a feedback module having a calculator for calculating a sound source corresponding to the information; may further include.

According to the present invention, stress monitoring for the driver is performed without a separate operation, and stress can be effectively alleviated by reproducing a sound source optimized for the driver as the increase in stress is sensed.

In particular, it is possible to suppress reckless driving and promote safe driving by monitoring the driver's stress state in connection with the driving state of the vehicle and promptly relieving the stress increase.

1 is a conceptual diagram of the present invention;
2 is a block diagram showing a configuration and a connection relationship according to an embodiment of the present invention;
3 is a graph showing a typical electrocardiogram waveform;
4 is a block diagram showing the configuration and connection relationship according to the second embodiment of the present invention.

Hereinafter, the configuration of a driver stress relief system using a sound source corresponding to an electrocardiogram waveform at rest according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram of the present invention, and the present invention is to relieve mental stability and stress by using a sound source optimized by reflecting the heart rate of a driver's mental stability in various stresses or tensions occurring while driving. In the present invention, a vehicle is exemplified as an embodiment for this purpose, but the present invention may be applied to various transportation means that are exposed to a relatively long-time driving environment, including aircraft and ships, and can listen to sound sources, especially configured in connection with a car audio system, etc. You may.

2 is a block diagram showing the configuration and connection relationship according to an embodiment of the present invention. The main components are a sensor module 110 , an analysis module 120 , a monitoring module 140 , and a sound source management module 130 . ) and an output module 150 are provided.

The sensor module 110 is configured to measure the driver's ECG signal, and is a vehicle internal structure that has the most physical contact with the driver, and is typically configured to obtain an ECG signal by attaching sensor electrodes to the steering wheel or the like.

The ECG signal induces the active current generated in the myocardium according to the heartbeat to two suitable points on the body surface and records it with an ammeter. In order to obtain a signal, it is desirable to obtain a record of myocardial activity current by placing electrodes at regular intervals along a part that can be touched by hands on the steering wheel. do.

3 is a graph showing a typical electrocardiogram waveform. In the curve, P represents the contraction of the atrium, and QRST is derived from the contraction of the ventricle.

At this time, the interval of PQ shows the time for excitation to occur in the sinus node and conduction to the atrioventricular node of the stimulus conduction system.

Also, in the QRS group, R shows the largest voltage change in time, as it almost coincides with the start of the apical beat and the first heart sound, and the portion between S and T shows the average contraction of the entire ventricle. When this happens, the elevation of T occurs because the contraction of the base of the heart remains even after the contraction of the apex is finished. The end of T coincides with the beginning of the second heart sound in time.

The analysis module 120 is configured to collect and analyze waveform information including the amplitude and frequency of the heartbeat through the measured electrocardiogram signal, and extract the waveform information of the psychological stabilizer.

In order to obtain an electrocardiogram signal in a stable state or as close to it as possible, it is necessary to obtain an electrocardiogram signal determined to be in the most stable state through multiple measurements over a period in a state in which the stress source is removed, rather than a one-time measurement as much as possible.

For this, preferably, before the driver uses the vehicle, the electrocardiogram signal is continuously measured in a state in which there is no stress source or is removed as much as possible, and the heartbeat information is input together, or the heartbeat is measured continuously for a set time using an autonomic nervous system measuring device. Based on the Heart Rate Variability (HRV), the balance of the Autonomic Nervous System can be quantified by a standard derivation method and the displayed value can be used as mental information.

In addition, if this method is not used, by using the sensor module 110 installed in the vehicle, the ECG signals accumulated over a period of time are compared and analyzed, and similarly, the heart rate information is received and the ECG signal of the psychological stabilization period corresponding to the psychological stability period is obtained. It can also be obtained, and the ECG waveform information as shown in FIG. 3 is extracted from the ECG signal of the psychological stabilization phase.

The sound source management module 130 receives and stores a sound source to be used for stress relief, and includes a sound wave generator 131 and a sound source storage unit 132 as detailed configurations.

The sound wave generator 131 is configured to extract a feature vector for the amplitude and frequency of the wave information of the ballast to generate a sound wave having the same sound wave characteristic. That is, through analysis of the normal rhythm P-QRS-T waveform change analysis of the electrocardiogram in the driver's steady state, the feature vectors for amplitude and frequency are extracted and then converted into the same sound wave.

The sound source storage unit 132 is configured to receive and store a plurality of sound sources having a BPM within a set range, and may receive and utilize sound sources such as various music or natural sounds that can provide mental and physical stability in advance. In particular, since a sound source having the same BPM as the resting heart rate is effective, it is possible to artificially adjust the speed of a specific sound source to have a certain BPM, but it is desirable to collect and store a separate sound source having the corresponding BPM as much as possible.

That is, since the normal heart rate of a person is 60 to 100 beats per minute, a plurality of sound sources having a BPM therebetween are input based on this.

It can be configured to provide and manage sound source information including scale, chord and chord progression, and musical instruments composing the sound source, and receive sound source recommendations suitable for sound source information set by a pre-expert or systematically exclude sound sources inappropriate for sound source information It can also be configured to

This is to provide music with an optimal effect as the scale of music, chords and chord progressions, and musical instruments may affect the stress relief effect. In the embodiment of the present invention, repetitive G-C-D-G Although keyboard and guitar ensemble music was used as a rhythm pattern composed of chords, it is natural that sound sources with various characteristics can be used.

The scale used for the sound source refers to the arrangement from a certain note to an octave higher note. The sound used varies depending on the scale used to make music, and the mood is determined accordingly. Most of the music we listen to uses the Ionian scale or the Aeolian scale, and these are called the Major and Minor scales, respectively.

This means that the music most familiar to our ears is made using the two scales above. Healing beat's music uses a major scale to create a familiar yet bright atmosphere to our ears.

The chords used are called Diatonic Chords, which are stacked on top of each note of the scale mentioned above. Since it is a code made using the notes belonging to the scale, it can be said that there is no sense of heterogeneity in the given scale. Healing beat uses music composed based on the G major scale, and the corresponding diatonic chords are G, Am, Bm, C, D, Em, F#m7(b5). Among them, except for F#m7(b5), which can be said to be unstable in composition, it was made with the remaining six chords.

The chord's progression is 1-6-4-5, a type that can be easily found in many songs. The bridge part selects the most natural progression within the Diatonic Chord by using the commonly seen progression of 4-5-3-6 degrees and 2-1-4-5 degrees. The previous 1-6-4-5 progression appears again, ending the song with a familiar feeling.

Melody's progression uses music composed to be predictable enough, and avoid using too much jump (over 8 degrees) or notes that are not included in the scale. Progression of 4th degree, which may feel anxious, is also excluded.

It was composed mainly for easy listening using sequential progressions (up and down), and to make the BPM from 60 to 100, you need to maintain a moderate speed. don't feel it

When selecting an instrument, the guitar and piano, which are the most easily accessible instruments around, are selected, and the piano is used to play the background with a chord, and music that plays melody with the guitar is used on top of that.

The monitoring module 140 is configured to monitor and analyze the ECG signal measured through the sensor module to check the driver's stress change. In particular, the monitoring module 140 detects the driver's stress increase while driving and induces a mitigation action to be performed. .

The output unit 153 operates as it is determined that the driver's stress increases through the monitoring module 140 and operates to relieve stress through a sound source. A 152 and an output unit 153 are provided.

The search unit 151 searches the sound source storage unit 132 for the same sound source as the BPM according to the waveform information of the psychological stabilizer. That is, the heart rate BPM of the driver's psychological stabilizer and the BPM of the sound source retrieved from the sound source storage unit are matched.

Thereafter, the sound source processing unit 152 processes the sound source found through the search unit by reflecting the sound wave generated through the sound wave generating unit 131 . That is, the sound wave characteristics of the sound source are corrected to be the same as the sound wave extracted from the feature vector of the driver's resting heartbeat waveform.

The output unit 153 is configured to correspond to a speaker, and may operate in conjunction with a separate speaker installed so that the driver can hear it or a car audio system installed in the vehicle, and the sound source processed through the sound processing unit 152 is transmitted to the driver. It is output at an appropriate volume so that it can be heard.

In summary, the present invention implements a Beat induction intervention program using beat and sound waves, which is named Healing Beat Program, by applying to a vehicle, and outputs a sound source with the same waveform characteristics as the ECG waveform at rest to the driver exposed to the stress source and calms down The effect of relieving stress through these sound sources by inducing

4 is a block diagram showing the configuration and connection relationship according to the second embodiment of the present invention. As the present invention is applied to a driving situation of a vehicle in particular, in the second embodiment of the present invention, more precise stress in connection with the operation of a vehicle The interlocking module 160, the control module 170, and the identification module are additional components that can not only support situation analysis, but also maximize the stress relief effect by accurately selecting the optimized sound source through the driver's individual characteristics, that is, the ECG signal. 180 and a feedback module 190 are provided.

The interlocking module 160 is a configuration for analyzing stress in connection with vehicle driving information. The detailed configuration includes a collection unit 161 , a recognition unit 162 , a connection unit 163 , and a setting unit 164 . to provide In other words, most of the stress that occurs while driving occurs due to an increase in the risk of accidents, reckless driving of other vehicles, and dangerous situations for pedestrians. This is an important factor to consider.

To this end, the collection unit 161 collects driving information including the speed and operation state of the vehicle being driven. A separate sensor capable of measuring acceleration and inertia can be provided to measure the vehicle's forward and backward speed and turn direction and the corresponding acceleration conditions. A collection of the driving environment may be made.

The recognition unit 162 is configured to determine the driving state of the vehicle through the driving information collected through the collection unit 161 and to recognize the driver's stress rising situation. In other words, it determines the driving condition that causes stress. Typically, situations that occur less frequently during driving, such as sudden deceleration due to sudden braking, sudden turns through rapid handling, shaking of the vehicle, continuous reverse or repeated forward and backward situations, are selected. The reflected driving condition is checked. Basically, stress is inevitably increased in such a situation, but it is possible to recognize a situation in which stress is actually increased by linking with the aforementioned sensor module.

The linkage unit 163 is configured to derive correlation information by linking the stress change analyzed through the monitoring module 140 with the driving state, and the stress change collected from the driver and the collection unit 161 are configured to derive correlation information. As the collected driving conditions are accumulated, it is possible to derive correlations by analyzing them.

The setting unit 164 is configured to generate reference information that the analysis module can determine as a stable period according to the analysis of the correlation information derived and accumulated through the linkage unit 163 .

As mentioned above, in identifying the electrocardiogram signal in the driver's stable state through the analysis module, reference information is generated in advance in a specific situation where the stress source is blocked while not driving and applying it while driving to determine the stable state However, if this method is not smooth, it is possible to generate reference information by determining that the driver is in a psychologically stable state through the information collected while driving.

To this end, it is possible to determine that the driver is in a stable state based on the ECG signal collected in the absence of any stress-inducing factors through vehicle driving information. do.

The control module 170 analyzes the previously collected driving information to operate a customized stress relief function reflecting the driver's tendency, and includes a pattern analysis unit 171 and a preemptive operation unit 172 as detailed configurations.

The pattern analysis unit 171 is configured to generate driving pattern information through the driving information collected through the collection unit 161 . Unless it is a commercial vehicle that randomly carries passengers, most vehicles, including personal vehicles, tend to have driving patterns including frequently traveled routes, and each driver also has unique driving habits. The pattern analysis unit 171 is for identifying such a pattern through the accumulated driving information, and by analyzing the driving information, driving pattern information reflecting frequently moving routes and driving habits is generated through the analysis.

The preemptive operation unit 172 is configured to operate the output unit 153 using driving pattern information and correlation information according to the current driving state of the vehicle. That is, as the driving pattern and driving habits of the vehicle included in the driving pattern information are identified and the related stress increase factors are identified, the preemptive operation unit 172 outputs a sound source through the output unit 153 in a situation in which the stress is increased. It is possible to effectively control stress through sound source output in advance.

The identification module 180 not only responds to a case where the driver may be different in operating the vehicle, but also enables stress control that more accurately reflects the driver's characteristics, and includes an identification unit 181 and a correction unit ( 182) is provided.

The identification unit 181 operates the output unit 153 and is configured to identify the driver who has boarded through the electrocardiogram signal measured from the driver in response. According to the results of the applicant's research published in a number of papers, the sound source reflecting the electrocardiogram waveform of the above-mentioned stabilizing phase clearly shows the effect of relieving tension and stress. This can be done.

The compensator 182 collects and analyzes an electrocardiogram signal in a state in which the vehicle is not started for the driver identified through the identification unit 181 , and the analysis module 120 determines that the vehicle is stable. information will be created. That is, as mentioned above, in addition to using an electrocardiogram waveform obtained in advance in a psychologically stable state or acquiring an electrocardiogram waveform in a stable state according to the analysis of the electrocardiogram signal accumulated during driving and the correlation with the driving information, the correction unit 182 through the Criteria for the analysis module 120 to determine that the vehicle is in a stable state using the ECG signals collected in a state where the vehicle is boarded but does not drive in earnest, that is, in a state where there is no stress source due to driving, such as before and after starting. to generate information.

The feedback module 190 is to find an optimal sound source within a set range and correct the condition, and includes a first tracking unit 191 , a second tracking unit 192 , and a calculation unit 193 as detailed configurations. do.

The first tracking unit 191 collects real-time changes in the ECG signal collected through the sensor module 110 in response to the sound source output through the output unit 153 . If it is a sound source that normally reflects the sound wave according to the electrocardiogram waveform at rest, the change in the electrocardiogram shows the result that the stress is quickly relieved.

The second tracking unit 192 generates and outputs a converted sound source to which the BPM and sound wave characteristics of the upper and lower set ranges are applied to the sound source output through the output unit 153 and is collected through the sensor module 110 in response. Real-time changes in ECG signals are collected.

Thereafter, the calculator 193 analyzes the collection results of the first tracker 191 and the second tracker 192 to re-calculate a sound source corresponding to the real-time electrocardiogram signal of the stabilizer waveform information.

That is, it is possible to extract the ECG waveform of the initial stabilization phase while in the vehicle, but it may be difficult to create a stress-free situation. This can be done.

The right of the present invention is not limited to the above-described embodiments, but is defined by the claims, and a person of ordinary skill in the art can make various modifications and adaptations within the scope of the claims. it is self-evident

110: sensor module 120: analysis module
130: sound management module 131: sound wave generator
132: sound storage unit 140: monitoring module
150: output module 151: search unit
152: sound processing unit 153: output unit
160: interlocking module 161: collecting unit
162: cognitive unit 163: linkage unit
164: setting unit 170: control module
171: pattern analysis unit 172: preemptive operation unit
180: identification module 181: identification unit
182: correction unit 190: feedback module
191: first tracking unit 192: second tracking unit
193: output unit

Claims (4)

a sensor module 110 for measuring the driver's ECG signal;
an analysis module 120 that collects and analyzes waveform information including the amplitude and frequency of the heartbeat through the measured electrocardiogram signal and extracts the waveform information of the psychological stabilizer;
A sound wave generator 131 that generates a sound wave of the same sound wave characteristic by extracting a feature vector for the amplitude and frequency of the waveform information of the ballast, and a sound source storage unit 132 that receives and stores a plurality of sound sources having a BPM in a set range ) a sound source management module 130 having;
a monitoring module 140 that monitors and analyzes the electrocardiogram signal measured through the sensor module 110 to check the driver's stress change;
As it is determined that the driver's stress increases, the search unit 151 that searches the sound source storage unit 132 for the same sound source as the BPM according to the waveform information of the psychological stabilizer, and the sound wave generator 131 for the searched sound source an output module 150 for outputting a sound source processing unit 152 for processing the sound wave generated through the reflection and an output unit 153 for outputting the processed sound source so that the driver can hear it;
An identification unit 181 that operates the output unit 153 and correspondingly identifies a driver who has boarded through an electrocardiogram signal measured from the driver, and collects an electrocardiogram signal in a state in which the vehicle is not started for the identified driver and an identification module 180 having a correction unit 182 that analyzes and generates reference information that can be determined by the analysis module 120 as a stabilizer; Driver stress relief system, characterized in that consisting of.
The method of claim 1,
A collection unit 161 that collects driving information including the speed and operation state of the vehicle being driven, and a recognition unit 162 that determines the driving state of the vehicle through the driving information and recognizes the driver's stress rising situation; A linkage unit 163 for deriving correlation information by linking the stress change analyzed through the monitoring module with the driving state, and reference information that the analysis module can determine as a stable period by analyzing the accumulated correlation information an interlocking module 160 having a setting unit 164 for generating; Driver stress relief system, characterized in that it further comprises.
3. The method of claim 2,
A pattern analysis unit 171 that generates driving pattern information through the collected driving information, and a preemptive operation unit that operates the output unit 153 using driving pattern information and correlation information according to the current driving state of the vehicle ( 172) having a control module 170; Driver stress relief system, characterized in that it further comprises.
The method of claim 1,
A first tracking unit 191 that collects real-time changes in the ECG signal collected through the sensor module 110 in response to the sound source output through the output unit 153, and a range set up and down for the output sound source A second tracker 192 that generates and outputs a converted sound source to which BPM and sound wave characteristics are applied, and correspondingly collects real-time changes in the ECG signal collected through the sensor module 110, and the first tracker 191 and a feedback module 190 having a calculation unit 193 that analyzes the collection result of the second tracking unit 192 and calculates a sound source corresponding to the waveform information of the real-time electrocardiogram signal of the stabilizer; Driver stress relief system, characterized in that it further comprises.

Images