CN109431498A - Wearable multi-modal physiological driver's condition monitoring system - Google Patents
Wearable multi-modal physiological driver's condition monitoring system Download PDFInfo
- Publication number
- CN109431498A CN109431498A CN201811353853.8A CN201811353853A CN109431498A CN 109431498 A CN109431498 A CN 109431498A CN 201811353853 A CN201811353853 A CN 201811353853A CN 109431498 A CN109431498 A CN 109431498A
- Authority
- CN
- China
- Prior art keywords
- signal
- acquisition
- human
- computer interaction
- modal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/14542—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring blood gases
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
- A61B2562/02—Details of sensors specially adapted for in-vivo measurements
- A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Physiology (AREA)
- Cardiology (AREA)
- Optics & Photonics (AREA)
- Pulmonology (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Ophthalmology & Optometry (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The present invention relates to a kind of wearable multi-modal physiological driver's condition monitoring systems, comprising: wearable multi-modal biological signal collecting device, human-computer interaction terminal；It is characterized in that, the wearable multi-modal biological signal collecting device acquires multi-modal bio signal from wearer's head, eye and wrist respectively, for the monitoring to wearer's physiological status；The human-computer interaction terminal for the selection of acquisition parameter and acquisition unit enable signal to be arranged, and stores display bio signal.The wearable multi-modal biological signal collecting device includes: EEG acquisition unit, eye tracker unit, PPG acquisition unit, signal integration module, mobile microsever.
Description
Technical field
The present invention relates to vehicle driving safety fields, refer specifically to a kind of wearable multi-modal physiological driver's status monitoring system
System.
Background technique
Body and mental status of the bus driver when driving are related to passenger and other vehicle drivers
Life security.With the sharp increase of China's automobile quantity in the past 10 years, traffic accident is consequently increased.And driver is driving
When physical fatigue or the state of mind it is bad be the main reason for leading to traffic accident.Therefore real-time and accurately to the physiology of driver
State is monitored the security of the lives and property important in inhibiting to avoid traffic accident, protect driver and passenger.
But due to particular job environment of driver, traditional physiological detection instrument can not be in narrow driver's cabin to driving
The person's of sailing physiological status is detected.In addition single monitoring index can not also reflect the practical driving condition of driver.
Summary of the invention
For prior art defect, it is an object of the present invention to provide a kind of wearable multi-modal physiological driver's status monitoring systems
System is more from driver's acquisition brain electricity, pulse, blood oxygen concentration, eye movement and pupil contraction etc. using wearable acquisition device
Mode biological information realizes that driver's driving condition real-time and accurately monitors.Technical solution is as follows:
A kind of wearable multi-modal physiological driver's condition monitoring system, comprising: wearable multi-modal biological signal collecting
Device, human-computer interaction terminal；It is characterized in that,
The wearable multi-modal biological signal collecting device is multi-modal from wearer's head, eye and wrist acquisition respectively
Bio signal, for the monitoring to wearer's physiological status；
The human-computer interaction terminal for the selection of acquisition parameter and acquisition unit enable signal to be arranged, and stores
Show bio signal.
The wearable multi-modal biological signal collecting device includes: EEG acquisition unit, eye tracker unit, PPG acquisition
Unit, signal integration module, mobile microsever；
EEG acquisition unit, acquisition parameter and acquisition for being arranged according to human-computer interaction terminal make to can control signal acquisition
EEG signals, and the EEG signals of acquisition are transferred to signal integration module；
Eye tracker unit, acquisition parameter and acquisition for being arranged according to human-computer interaction terminal make to can control signal acquisition eye
Ball moving image, and by the image transmitting of acquisition to signal integration module；
PPG acquisition unit, acquisition parameter and acquisition for being arranged according to human-computer interaction terminal make to can control signal acquisition
Heart rate and blood oxygen concentration signal, and the signal of acquisition is transferred to signal integration module；
The signal integration module, the signal acquisition control signal caching EEG for being issued according to human-computer interaction terminal are adopted
Collect unit, eye tracker unit and the collected biological information of PPG acquisition unit, and by three kinds of biologies in a chronomere
Information is integrated into unified data format, while the data after integration are sent to mobile microsever；
The mobile microsever is joined for receiving the acquisition control signal issued by human-computer interaction terminal and acquisition
Number, and issued to signal integration module and acquire enabled and signal integration parameter instruction, control system acquires bio signal, simultaneously
Bio signal after receiving the integration spread out of by signal integration module, is transferred to human-computer interaction terminal after being pre-processed.
The beneficial effects of the invention are as follows the monitorings realized under particular surroundings to the multi-modal physiological status of driver, by wearing
The multi-modal acquisition equipment of formula is worn, realizes the multi-angle real-time monitoring of driver's physiological status when driving, monitoring personnel is having found
It can implement corresponding measure when abnormality at once, guarantee the driving safety of vehicle.
Detailed description of the invention
Fig. 1 is system schematic of the invention；
Fig. 2 is system construction drawing of the invention；
Fig. 3 is EEG acquisition unit structure chart；
Fig. 4 is eye tracker cellular construction figure；
Fig. 5 is PPG acquisition unit structure chart；
In figure
1. wearable 2. human-computer interaction terminal 3.EEG acquisition unit of multi-modal biological signal collecting device, 4. eye tracker unit
Mobile 9. electrod-array 10. of microsever of 6. signal integration module of 5.PPG acquisition unit, 7. power supply module 8. amplifies filtered electrical
Road 11.A/D converts 12. infrared cameras 13. and caches 14. image processing module, 15. infrared transmitter, 16. infrared detector 17.
Signal processing module 18.A/D converts 19. three-axis gyroscopes
Specific embodiment
In conjunction with attached drawing to wearable multi-modal physiological driver's condition monitoring system of the invention.
Present system schematic diagram and system construction drawing difference are as shown in Figure 1 and Figure 2, and system is by wearable multi-modal biology
Signal pickup assembly 1 and 2 two large divisions of human-computer interaction terminal composition.The wherein wearable multi-modal biological signal collecting
Device 1 includes: EEG acquisition unit 3, eye tracker unit 4, PPG acquisition unit 5, signal integration module 6, power supply module 7, movement
Microsever 8.Mobile microsever 8 is issued to signal integration module 6 acquires enabled and signal integration parameter instruction, letter
It number integrates module 6 and controls EEG acquisition unit 3, eye tracker unit 4 and the collaboration acquisition bio signal of PPG acquisition unit 5, simultaneously
Cache EEG acquisition unit 9, eye tracker unit 4 and the collected biological information of PPG acquisition unit 5, and by a chronomere
Interior all biological informations are integrated into unified data format, and the data after integration are sent to mobile microsever 8.It is described
Human-computer interaction terminal 2 is used to be arranged the selection of acquisition parameter and acquisition unit enable signal, and stores display bio signal.Make
User can be configured the acquisition parameter of multi-modal bio signal and the type of signal by human-computer interaction terminal 2.Together
When, collected bio signal also can in human-computer interaction terminal 2 real-time display.
EEG acquisition unit structure chart of the invention as shown in figure 3, include altogether electrod-array 9, amplification filter module 10 and
A/D conversion module 11.Electrod-array 9 acquires original EEG signals；Amplification filter module amplifies original EEG signals, filters
Hz noise and the input range for making signal meet A/D conversion module 11 in signal are eliminated in wave and trap processing.
Eye tracker cellular construction figure of the invention as shown in figure 4, include altogether infrared camera 12, image buffer storage module 13 with
And image processing module 14.Infrared camera 12 records the motion state of left and right eyeball respectively, and image data is transferred to figure
As cache module 13；Image processing module 14 constantly reads image data from image buffer storage module 13 and extracts blinkpunkt, eye
Hop the physiologic informations such as several and pupil contraction.
PPG acquisition unit of the invention as shown in figure 5, include infrared transmitter 15, infrared detector 16, A/D conversion altogether
Module 17, signal processing module 18 and three-axis gyroscope 19.The infrared ray that infrared transmitter 15 emits is passed through according on human skin
Received after skin reflex by infrared detector 16, then by A D conversion module 17 be converted into PPG signal and be transferred to signal processing module
18；Three-axis gyroscope 19 is used to measure the motion state of wrist, and is transferred to signal processing module 18；Signal processing module according to
Wrist-sport state carries out data analysis to PPG signal, extracts the physical signs such as heart rate, blood oxygen concentration.
Claims (1)
1. a kind of wearable multi-modal physiological driver's condition monitoring system, comprising: wearable multi-modal biological signal collecting dress
It sets, human-computer interaction terminal；It is characterized in that,
The wearable multi-modal biological signal collecting device acquires multi-modal biology from wearer's head, eye and wrist respectively
Signal, for the monitoring to wearer's physiological status；
The human-computer interaction terminal for the selection of acquisition parameter and acquisition unit enable signal to be arranged, and stores display
Bio signal.
The wearable multi-modal biological signal collecting device includes: EEG acquisition unit, eye tracker unit, PPG acquisition list
Member, signal integration module, mobile microsever；
EEG acquisition unit, acquisition parameter and acquisition for being arranged according to human-computer interaction terminal make to can control signal acquisition brain electricity
Signal, and the EEG signals of acquisition are transferred to signal integration module；
Eye tracker unit, acquisition parameter and acquisition for being arranged according to human-computer interaction terminal make to can control signal acquisition eyeball fortune
Motion video, and by the image transmitting of acquisition to signal integration module；
PPG acquisition unit, acquisition parameter and acquisition for being arranged according to human-computer interaction terminal make to can control signal acquisition heart rate
With blood oxygen concentration signal, and the signal of acquisition is transferred to signal integration module；
The signal integration module, the signal acquisition control signal caching EEG acquisition for being issued according to human-computer interaction terminal are single
Member, eye tracker unit and the collected biological information of PPG acquisition unit, and by three kinds of biological informations in a chronomere
It is integrated into unified data format, while the data after integration are sent to mobile microsever；
The mobile microsever, for receiving by the acquisition control signal and acquisition parameter of human-computer interaction terminal sending,
And issued to signal integration module and acquire enabled and signal integration parameter instruction, control system acquires bio signal, connects simultaneously
Bio signal after receiving the integration spread out of by signal integration module, is transferred to human-computer interaction terminal after being pre-processed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811353853.8A CN109431498A (en) | 2018-11-14 | 2018-11-14 | Wearable multi-modal physiological driver's condition monitoring system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811353853.8A CN109431498A (en) | 2018-11-14 | 2018-11-14 | Wearable multi-modal physiological driver's condition monitoring system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109431498A true CN109431498A (en) | 2019-03-08 |
Family
ID=65553405
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811353853.8A Pending CN109431498A (en) | 2018-11-14 | 2018-11-14 | Wearable multi-modal physiological driver's condition monitoring system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109431498A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111369853A (en) * | 2020-03-19 | 2020-07-03 | 上海梦之路数字科技有限公司 | Medical integrated experimental teaching system and implementation method thereof |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101480339A (en) * | 2009-01-09 | 2009-07-15 | 清华大学深圳研究生院 | Method and system for realizing measurements of various physiological parameters |
| CN104997500A (en) * | 2015-08-31 | 2015-10-28 | 奇瑞汽车股份有限公司 | Vehicle-mounted health monitoring system based on wearable device |
| US20160090097A1 (en) * | 2014-09-29 | 2016-03-31 | The Boeing Company | System for fatigue detection using a suite of physiological measurement devices |
| CN106491104A (en) * | 2016-10-25 | 2017-03-15 | 湖南大学 | Driver status intelligent real time monitoring system and method based on Intelligent worn device |
| CN107233103A (en) * | 2017-05-27 | 2017-10-10 | 西南交通大学 | High ferro dispatcher's fatigue state assessment method and system |
| CN107669283A (en) * | 2017-10-29 | 2018-02-09 | 吉林大学 | Spectacle driving fatigue monitoring warning device based on multi-feature fusion and method |
| CN108478207A (en) * | 2018-01-09 | 2018-09-04 | 南京航空航天大学 | A kind of multi-modal physiological brain monitoring system |
| CN108615110A (en) * | 2018-04-23 | 2018-10-02 | 吉林大学 | The driving risk evaluating system of view-based access control model characteristic |
| CN108765876A (en) * | 2018-05-31 | 2018-11-06 | 东北大学 | Driving fatigue depth analysis early warning system based on multimode signal and method |
-
2018
- 2018-11-14 CN CN201811353853.8A patent/CN109431498A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101480339A (en) * | 2009-01-09 | 2009-07-15 | 清华大学深圳研究生院 | Method and system for realizing measurements of various physiological parameters |
| US20160090097A1 (en) * | 2014-09-29 | 2016-03-31 | The Boeing Company | System for fatigue detection using a suite of physiological measurement devices |
| CN104997500A (en) * | 2015-08-31 | 2015-10-28 | 奇瑞汽车股份有限公司 | Vehicle-mounted health monitoring system based on wearable device |
| CN106491104A (en) * | 2016-10-25 | 2017-03-15 | 湖南大学 | Driver status intelligent real time monitoring system and method based on Intelligent worn device |
| CN107233103A (en) * | 2017-05-27 | 2017-10-10 | 西南交通大学 | High ferro dispatcher's fatigue state assessment method and system |
| CN107669283A (en) * | 2017-10-29 | 2018-02-09 | 吉林大学 | Spectacle driving fatigue monitoring warning device based on multi-feature fusion and method |
| CN108478207A (en) * | 2018-01-09 | 2018-09-04 | 南京航空航天大学 | A kind of multi-modal physiological brain monitoring system |
| CN108615110A (en) * | 2018-04-23 | 2018-10-02 | 吉林大学 | The driving risk evaluating system of view-based access control model characteristic |
| CN108765876A (en) * | 2018-05-31 | 2018-11-06 | 东北大学 | Driving fatigue depth analysis early warning system based on multimode signal and method |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111369853A (en) * | 2020-03-19 | 2020-07-03 | 上海梦之路数字科技有限公司 | Medical integrated experimental teaching system and implementation method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021174618A1 (en) | Training method for electroencephalography mode classification model, classification method and system | |
| Pratama et al. | A review on driver drowsiness based on image, bio-signal, and driver behavior | |
| CN108615110B (en) | Driving risk assessment system based on visual characteristics | |
| RU2395228C2 (en) | Biosensors, communicators and controllers for eye movement monitoring and methods of their application | |
| US10039445B1 (en) | Biosensors, communicators, and controllers monitoring eye movement and methods for using them | |
| KR20130130803A (en) | Dry sensor eeg/emg and motion sensing system for seizure detection and monitoring | |
| CN105446492A (en) | Information interaction system based on brainwave sensing headset and intelligent wearable apparatus | |
| CN209063895U (en) | Tired driver combined of multi-sensor information drives early warning and pro-active intervention system | |
| WO2020029814A1 (en) | Doctor health monitoring system based on medical apparatus | |
| CN105708480A (en) | Driver attention testing device based on detection response task | |
| CN110710978A (en) | Multi-mode immersive synchronous acquisition system based on eye movement tracking-brain function activity detection | |
| CN103637511A (en) | Wristband capable of intelligently monitoring human health status and method thereof | |
| Chen et al. | A wearable sensor system for neonatal seizure monitoring | |
| CN114652532B (en) | Multifunctional brain-controlled wheelchair system based on SSVEP and attention detection | |
| Ma et al. | Design and application of mental fatigue detection system using non-contact ECG and BCG measurement | |
| CN109431498A (en) | Wearable multi-modal physiological driver's condition monitoring system | |
| CN105534498A (en) | Organism moving monitor based on Internet-of-Things piezoelectric cable application technology | |
| CN216021048U (en) | Bimodal multichannel brain function monitoring devices | |
| CN110930641A (en) | Fatigue driving early warning system and method based on physiological information analysis | |
| CN114259243A (en) | Multi-mode human body parameter synchronous acquisition system and method | |
| CN207029275U (en) | The automobile steering disc system of human health status can be monitored in real time | |
| CN106859599B (en) | Magnetoencephalogram system based on all-optical atomic magnetic detection and acquisition method | |
| CN206080499U (en) | Multi -functional medical wrist strap | |
| CN205862535U (en) | A kind of driver fatigue monitor system | |
| CN105852887A (en) | Steering wheel and system and method for detecting fatigue |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190308 |
|
| RJ01 | Rejection of invention patent application after publication |