KR20230148990A - Driver's biological signal measurement and driving condition analysis system based on real-time electrocardiogram signal - Google Patents

Abstract

The present invention measures real-time biological signals while driving based on electrocardiogram signals (BPM, HRV, QRS complex modulation), chest movement, and skin temperature, and can also measure symptoms that interfere with the driver's driving, such as acute heart disease and drowsy driving. It relates to a real-time electrocardiogram signal-based driver biosignal measurement and driving condition analysis system. More specifically, vehicle parts that can directly measure ECG signals (e.g. steering wheel, acceleration/deceleration pedals, gear knob, driver's seat, etc.) It is located on vehicle parts that can measure chest movements (e.g. seat belts, driver's seats, etc.) and determines the driver's driving condition in real time through signal processing and complex signal analysis in hardware and firmware, thereby reducing driving disturbance symptoms that occur while driving ( This is about a driver bio-signal measurement device that can immediately notify and monitor the occurrence of acute heart disease, apnea, parasympathetic nerve activity, etc.).

Description

Driver's biological signal measurement and driving condition analysis system based on real-time electrocardiogram signal}

The present invention is a device that can be attached to the steering wheel of a vehicle and measure the driver's real-time electrocardiogram signal. It can measure BPM, HRV, and respiratory rate based on the measured electrocardiogram signal, and can additionally measure the temperature to measure the driver's body temperature. It is a system that includes sensors. The driver's biosignals, including the ECG signal, can be measured through sensors (electrocardiogram electrodes, temperature sensor) attached to the vehicle's steering wheel, and analyzed to provide biosignals such as the driver's pulse, HRV, and respiratory rate in real time. , Furthermore, by combining the collected biometric signals, the biometric system can detect changes in the driver's condition that may occur while driving (drowsiness, neglect of attention, emergency medical conditions, etc.) and take action at the stage before an emergency occurs to ensure the safety of the driver. It is about signal measurement systems.

Currently, the mobility industry is developing in a direction that pursues driver safety and convenience, focusing on electric vehicles. To this end, big data of traffic information, deep learning of events that may occur while driving, advancement of data processing devices, and driver's driving It is being developed for the next generation of transportation based on a variety of cutting-edge sensor technologies that can determine status. Among them, driver safety technology is being developed to prevent accidents caused by external factors while driving, such as vehicle gap detection, lane and obstacle detection, and braking assistance. However, driver safety cannot be secured by identifying the driver's driving status. Development progress toward a driver monitoring system is relatively low, because it is very difficult to measure subtle bio-signals from the body of a driver while driving, and the types of bio-signals that can be measured are very limited.

However, considering that most of the causes of traffic accident deaths are due to drivers' driving condition abnormalities (67.6%, 729 people, 2015-2019), such as drowsy driving and negligence in paying attention to the front, drivers must be careful to prevent large-scale traffic accidents leading to death. It is very important to determine the driving condition by measuring biosignals. By complexly analyzing the driver's real-time biometric signals (electrocardiogram, HRV, respiratory rate, body temperature, etc.) and the acceleration signal of the driver's body, it can detect driving conditions such as the driver's drowsiness, neglect of attention, and worsening health condition. Traffic accidents can be reduced.

Therefore, in the present invention, the driver's real-time ECG information is collected by attaching a capacitive ECG electrode to a device capable of measuring the driver's electrocardiogram (steering wheel, gear knob, etc.) inside the vehicle, and BPM and HRV are calculated based on the measured ECG signal. It analyzes in real time and measures respiratory rate with high accuracy in conjunction with an acceleration sensor that can be installed additionally in the device. In addition, the driver's bio-signals are analyzed multiple times using the temperature sensor installed on the electrode, and based on this, it provides not only the driver's basic bio-signals but also the drivability status such as acute heart disease and the degree of parasympathetic nerve activation, Includes systems that can reduce accidents.

Republic of Korea Patent Publication No. 10-2020-0027195 (publication date: March 12, 2020) Republic of Korea Patent Publication No. 10-2010-0063651 (publication date: June 11, 2010)

The purpose of the present invention is to improve the problems in the prior art. The driver's BPM can be confirmed by measuring the driver's real-time electrocardiogram signal and skin temperature through an ECG measurement electrode containing a temperature sensor, HRV is analyzed and real-time respiratory rate is measured by simultaneously analyzing changes in the amplitude of the QRS complex and chest movement due to breathing by comparing it with the measured ECG signal using an acceleration sensor additionally installed in the device. The purpose of the signal is to analyze acute heart disease, degree of parasympathetic nerve activation, etc. through an algorithm, and provide the signal to the driver in real time through a device (smartphone, vehicle display, etc.) that can provide an alarm if the driver is unable to drive.

The driver's bio-signal measurement and driving status analysis system based on real-time electrocardiogram signals measures the driver's bio-signals while driving to provide driving safety for the user, and measures parts that come into contact with the driver's body (e.g. steering wheel, gear, etc.) A measuring unit consisting of an ECG measurement electrode 110 that can be installed on a knob, driver's seat, etc., a temperature sensor 120 that can be included therein, and an acceleration sensor 130 that can measure the mechanical movement of the user's chest. (100), a signal control unit 300 that can process the measured bio-signals and convert them into digital signals, and a monitoring device (e.g. smartphone, tablet, in-vehicle display, etc.) that can check the driver's status using the processed digital signals. ) and consists of a communication unit 400 capable of wireless communication.

The real-time electrocardiogram signal-based driver biosignal measurement and driving condition analysis system of the present invention consists of an ECG sensor, an acceleration sensor, and a temperature sensor that can check the driver's driving disturbance phenomenon (acute heart disease, drowsy driving due to parasympathetic nerve activation, etc.) Through this, various bio-signals of the driver are measured and the measured bio-signals are analyzed to detect when the driver is in a difficult driving condition and linked to a monitoring or alarm device (e.g. smartphone, tablet, in-vehicle display, etc.) This has the effect of preventing traffic accidents that may occur by providing real-time driver's biometric signals and driving conditions.

1 is a diagram of a sensor unit of a real-time electrocardiogram signal-based driver biosignal measurement and driving state analysis system according to the present invention.
Figure 2 is a system layout diagram according to the present invention.
Figure 3 is a signal processing block diagram of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, but the examples are provided for clear understanding of the present invention and the present invention is not limited thereto.

The real-time electrocardiogram signal-based driver biosignal measurement and driving condition analysis system includes two or more ECG electrodes (110) and a temperature sensor (120) to measure biosignals (ECG, BPM, HRV, skin temperature, chest movement) generated while driving. ), a case 200 in which a measurement unit 100 consisting of an acceleration sensor 130 and a circuit and a data processing device can be embedded, and is built into the case to control and process signals received from each sensor to convert them into digital signals. It consists of a control unit 300 capable of wireless communication with an external terminal (smart phone, tablet, in-vehicle display, etc.), a communication unit 400 capable of wireless communication, and a power supply unit 500 for driving the system. The main body control unit receives the measured ECG signal. As a standard, it includes a filter for detecting external noise and a specific frequency of the signal, and the temperature sensor 110 can measure the user's real-time skin temperature by attaching it directly to the ECG electrode 110 in contact with the living body. Considering convenience, the proposal is limited to the steering wheel and gear knob in the vehicle, but various sensors for measuring biosignals are installed in locations where the user's body comes into contact with vehicle parts (driver's seat, acceleration/deceleration pedals, seat belt, etc.). It can be used fixedly, and considering the user's demand and measurement method, it can be used by fixing it to the body inside the clothes as a separate device.

Figure 1 shows the shape of a vehicle steering wheel (example) installed with ECG electrodes capable of measuring ECG and skin temperature of the present invention. Since signals are measured from both hands of the driver, it is manufactured as a patch-shaped electrode that can be attached to the steering wheel. In the signal measurement unit, electrodes are installed at both extremes of the steering wheel to smoothly measure signals while driving. The installed electrodes include a temperature sensor, so they can measure electrocardiogram and skin temperature at the same time.

Figure 2 is an acceleration sensor unit that can be installed on a seat belt (example) to detect the driver's chest movement. It is connected to the control unit inside the case and is installed so that it can be analyzed simultaneously with the ECG signal. The combination of signals received from each measuring unit and Through analysis, the driver's driving condition can be determined, and furthermore, abnormal pulse signals (tachycardia/bradycardia/arrhythmia) can be detected by comparing and analyzing the signals measured from the ECG measurement electrodes.

In addition, the measured signal can be stored in a separate storage device (internal memory, storage space of an external terminal), and through this, changes in the signal over time are analyzed to determine the time and frequency of occurrence of each symptom and the driver's biometric information. By diversifying and comparing driving status information, the quality of driving can be improved. If the driver's biosignals are judged to be in a dangerous state, the driving mode is changed to autonomous driving mode so that the vehicle can drive on its own. At the same time, police officers such as 112 and 119 By connecting to public institutions, including fire departments, or guardians through wireless communication, future measures can be taken.

Each sensor unit is located in an existing accessory inside the vehicle, causing no inconvenience in use, and the ECG measurement electrode is electrically insulated through an insulating material coating (e.g. SiO2, TiO2, cotton, polymer, etc.), reducing the driver's motion noise. It is designed to minimize the impact of foreign substances such as sweat and eliminate as much as possible the performance reduction caused by foreign substances such as sweat. Each sensor is designed to be closely attached to vehicle accessories using a device, making it easy to accurately measure bio-signals and receive signals. Its characteristic is to minimize losses.

In addition, this device has a circuit for wireless communication inside the main body, so it can communicate with external devices (smartphones, tablets, in-vehicle displays, etc.), especially Bluetooth, Wi-Fi, ZigBee, and Z-wave. Not only can it be used by all personal and ubiquitous wireless communication methods, but based on these functions, it is possible to maximize wearability by wirelessly connecting its own monitor (display) and sensor without wires, and displaying measured signals using only external devices. do.

The internal power source of this device can use both fixed and rechargeable batteries, and the batteries used include alkaline batteries, manganese batteries, carbon-zinc batteries, sodium sulfur batteries, lead acid batteries, nickel cadmium batteries, nickel hydride batteries, It can include all batteries that can be used as a power source for devices, such as lithium-ion batteries and lithium polymer batteries.

In addition, this measuring device is equipped with a charging terminal (e.g. C type USB) that can charge the power, so that it can be charged and used when discharged, and biometric information stored in the server is accumulated to enable management of the driver's personal biometric signal records while driving. By combining sensors for biosignals (blood pressure, oxygen saturation in blood vessels, etc.) that indicate the status of various individual diseases, various symptoms that may occur while driving can be identified as well as precursor symptoms of various diseases by analyzing them in a complex manner. It can be used as disease-related big data, and the biosignals measured from the biosignal measurement unit 100 can also be transmitted to an external terminal (smart watch, smartphone, tablet, in-vehicle display, etc.) for storage and analysis. .

100: Biosignal measurement unit (ECG, temperature, chest movement)
110: ECG measurement electrode
120: Temperature sensor
130: Acceleration sensor
200: case
300: control unit
400: Department of Communications
500: Power unit

Claims (10)

In the driver's real-time biosignal-based driving condition analysis system,
ECG measurement electrodes 110; and
Temperature sensor 120 capable of measuring skin temperature;
An acceleration sensor (130) capable of measuring chest movement;
A biosignal measuring unit 100 consisting of the sensors 110, 120, and 130; and
A signal control unit 300 capable of amplifying and controlling the received signal; and a wireless communication unit 400 capable of transmitting a measurement signal to an external terminal;
A real-time biosignal-based driver driving condition analysis system comprising a power supply unit 500 capable of driving the system.
According to paragraph 1,
The ECG measurement electrode 110 is a real-time biosignal-based driver driving condition analysis system characterized in that it measures cardiovascular biosignals including BPM, HRV, and pulse modulation.
According to paragraph 1,
A real-time biosignal-based driver driving condition analysis system characterized by measuring biosignals by fixing ECG measurement electrodes 110 and temperature sensors 120 to vehicle parts that come into contact with the driver's body.
According to paragraph 1,
The acceleration sensor 130 is installed in an area where the driver's chest movement can be detected and communicates wired or wirelessly with the ECG measurement electrode units 110 and 120 to measure the driver's breathing rate. A real-time biosignal-based driver driving condition analysis system.
According to paragraph 3,
A real-time biosignal-based driver driving condition analysis system, wherein the area capable of detecting the driver's chest movement is the driver's seat or seat belt.
According to paragraph 1,
A real-time bio-signal-based driver driving-state analysis system characterized in that data on the driver's bio-signals and driving conditions measured from the bio-signal measurement unit 100 can be transmitted to an external terminal for storage, analysis, and monitoring.
According to paragraph 1,
A real-time biosignal-based driver driving condition analysis system, characterized in that it is possible to measure the driver's breathing rate in real time by simultaneously comparing and analyzing the signals measured from the ECG sensor 110 and the acceleration sensor 130.
According to paragraph 1,
A real-time biosignal-based driver driving condition analysis system, characterized in that the ECG measurement electrodes 110 consist of two or more.
According to paragraph 1,
The biosignal measurement unit 100 is a real-time biosignal-based sleeping posture correction system characterized in that real-time diagnosis can be made by complexly analyzing the measured biosignals by adding a sensor for measuring biosignals including blood pressure and intravascular oxygen saturation. .
According to paragraph 7 or 9,
A real-time bio-signal-based sleep posture correction system that replaces the driving mode with autonomous driving mode when the bio-signals measured in real-time are judged to be dangerous and simultaneously notifies public institutions through wireless communication.