CN108186034B - Driver fatigue detection device and working method - Google Patents

Driver fatigue detection device and working method Download PDF

Info

Publication number
CN108186034B
CN108186034B CN201810102175.1A CN201810102175A CN108186034B CN 108186034 B CN108186034 B CN 108186034B CN 201810102175 A CN201810102175 A CN 201810102175A CN 108186034 B CN108186034 B CN 108186034B
Authority
CN
China
Prior art keywords
driver
sensor
pulse
control unit
fatigue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810102175.1A
Other languages
Chinese (zh)
Other versions
CN108186034A (en
Inventor
罗堪
都可钦
李建兴
黄靖
苏凌霄
檀甫贵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujian University of Technology
Original Assignee
Fujian University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujian University of Technology filed Critical Fujian University of Technology
Priority to CN201810102175.1A priority Critical patent/CN108186034B/en
Publication of CN108186034A publication Critical patent/CN108186034A/en
Application granted granted Critical
Publication of CN108186034B publication Critical patent/CN108186034B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02405Determining heart rate variability
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25Bioelectric electrodes therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813Specially adapted to be attached to a specific body part
    • A61B5/6814Head
    • A61B5/6815Ear
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813Specially adapted to be attached to a specific body part
    • A61B5/6823Trunk, e.g., chest, back, abdomen, hip
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/683Means for maintaining contact with the body
    • A61B5/6835Supports or holders, e.g., articulated arms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms

Abstract

The invention discloses a driver fatigue detection device, which comprises an auricle fixing bracket, wherein the bottom of the auricle fixing bracket is connected with a metal supporting electrode through a flexible hose, the metal supporting electrode is connected through the flexible hose, and the middle part of the flexible hose is provided with a control unit; a reflection-type ear lobe pulse sensor is arranged at the bottom of the auricle fixing support; a three-axis acceleration sensor and a gyroscope are arranged at the rear part of the first auricle fixing bracket; the metal support electrode is provided with an electrocardio sensor; the control unit comprises a conditioning circuit, a vibration motor, a lithium battery and a control chip. The invention extracts the driving electrocardio, two paths of pulses and head movement signals of the driver without influencing the normal driving operation; credible signals are screened according to the signal correlation, and the reliability of the system for judging fatigue driving by utilizing physiological signals is improved; the system judgment accuracy is high; the fatigue early prediction and the fatigue prediction have high accuracy.

Description

Driver fatigue detection device and working method
Technical Field
The invention relates to the field of human body state detection devices, in particular to a driver fatigue detection device and a working method.
Background
At present, china has become the global automobile manufacturing center and the largest automobile consumption market globally. Fatigue driving refers to the phenomenon that when a driver drives continuously for a long time, the physiological function and the psychological function are disordered, and the driving skill is reduced. The driver has poor or insufficient sleeping quality, and is easy to fatigue when driving the vehicle for a long time. Fatigue driving affects the attention, thinking, and physical movement of the driver. When the vehicle is driven continuously after fatigue, the vehicle can feel sleepy, weak limbs, inattentive attention, reduced judgment capability, even absentmindedness or instant memory loss, delayed or early action, operation pause or improper correction and other unsafe factors, and road traffic accidents are easy to happen. Therefore, effective detection of whether the driver is tired or not is an important means for preventing road traffic accidents. The traditional detection means analyzes the blinking motion through the image of the driver or analyzes the driving operation of the driver, such as the deviation of the vehicle from a central line and the acceleration information of the pedal brake during the braking of the vehicle, but the methods detect the performance in the later period of fatigue, and the result has limited effect on preventing traffic accidents; the early fatigue can be effectively identified by adopting the physiological signals, but the traditional detection method needs to wear a special medical device for detection (such as an electroencephalogram mode), and a heavy device and a complex circuit can also have certain influence on the operation and driving safety of a driver. The physiological signals are easily affected by noise in the actual driving environment, and if the collected physiological signals are not processed, a large amount of false alarms and missed alarms can be generated. It is therefore highly desirable to design a quick and lightweight device to enable reliable and accurate detection of driver fatigue.
Disclosure of Invention
The invention aims to overcome the defects, and provides a portable and simple device and a working method for detecting fatigue driving of a driver, which can detect the fatigue degree in real time.
In order to achieve the purpose, the technical scheme of the invention is as follows: a driver fatigue detection device comprises a first auricle fixing bracket and a second auricle fixing bracket, wherein the first auricle fixing bracket and the second auricle fixing bracket are respectively fixed on the left auricle and the right auricle of a driver; the bottom of the first auricle fixing bracket is connected with a first metal supporting electrode through a first flexible hose, and the bottom of the second auricle fixing bracket is connected with a second metal supporting electrode through a second flexible hose; the first metal supporting electrode and the second metal supporting electrode are connected through a third flexible hose, and a control unit is arranged in the middle of the third flexible hose;
a first reflection type ear lobe pulse sensor is arranged at the bottom of the first ear lobe fixing support corresponding to the ear lobe of the driver, and a second reflection type ear lobe pulse sensor is arranged at the bottom of the second ear lobe fixing support corresponding to the ear lobe of the driver; the first reflection type ear lobe pulse sensor and the second reflection type ear lobe pulse sensor respectively collect pulse data of the left ear and the right ear of the driver; a three-axis acceleration sensor and a gyroscope are arranged at the rear part of the first auricle fixing support, and the three-axis acceleration sensor and the gyroscope collect acceleration data of head swing of a driver;
the inner side surfaces of the first metal supporting electrode and the second supporting electrode are respectively provided with a first electrocardio sensor and a second electrocardio sensor, and the first metal supporting electrode and the second supporting electrode are respectively worn on a left clavicle and a right clavicle of a driver to support the whole device and collect electrocardio data of the driver in real time;
the control unit comprises a conditioning circuit for processing pulse data, acceleration data and electrocardiogram data, a vibration motor responding according to a detection result, a lithium battery capable of being charged wirelessly and a control chip for judging a fatigue value of a driver and controlling the vibration motor; the control unit is worn at the back neck of the driver;
the first reflection type ear lobe pulse sensor and the second reflection type ear lobe pulse sensor are electrically connected with the control unit through wires arranged in the first flexible hose, the second flexible hose and the third flexible hose respectively, and transmit the acquired pulse data of the left ear and the right ear to the control unit; the three-axis acceleration sensor and the gyroscope are electrically connected with the control unit through leads arranged in the first flexible hose and the third flexible hose, and transmit the acquired acceleration data of the head swing of the driver to the control unit; the first electrocardiogram sensor and the second electrocardiogram sensor are respectively and electrically connected with the control unit through leads arranged in the third flexible hose and transmit the acquired electrocardiogram data to the control unit;
the first reflection type ear lobe pulse sensor, the second reflection type ear lobe pulse sensor, the three-axis acceleration sensor, the gyroscope, the first electrocardio sensor, the second electrocardio sensor, the conditioning circuit, the vibration motor and the control chip are all powered by lithium batteries.
The first auricle fixing bracket and the second auricle fixing bracket are made of silica gel materials; a light PVC material shell is arranged outside the control unit; the first metal supporting electrode and the second supporting electrode adopt conductive metal shells.
The detection method of the driver fatigue detection device comprises the following steps
The method comprises the following steps: collecting the ear lobe pulse data of a driver through a first reflection type ear lobe pulse sensor and a second reflection type ear lobe pulse sensor, and transmitting the ear lobe pulse data to a control unit, wherein the control unit calculates the correlation coefficient rho of the left ear pulse data and the right ear pulse data e
a) If the correlation coefficient p e If the pulse rate is more than or equal to 0.9, confirming that the pulse signals of the left ear and the right ear are effective, extracting peak-to-peak interval sequences of two paths of pulse signals, and carrying out pulse rate variability analysis;
b) If the correlation coefficient p e Respectively calculating two pulse signals and the peak-to-peak intervals of the electrocardiosignals collected by the first and second electrocardio sensors when the pulse rate is less than or equal to 0.9, calculating correlation coefficients pairwise, selecting two signals with the maximum correlation coefficient, and analyzing the pulse rate/heart rate variability;
when all the correlation coefficients are less than 0.5, the signals are interfered by strong noise and cannot be used as a judgment basis for fatigue driving;
step three: calculating the pulse rate/heart rate variability by calculating a PSD spectrum of the RR interphase sequence, calculating LF/HF by taking 0.15Hz as a decomposition point of HF and LF, and further fusing the LF/HF calculated by two paths of signals;
step four: the acceleration in three directions of a space coordinate system caused by the swing of the head is collected through a three-axis acceleration sensor and a gyroscope, and data are transmitted to a control unit for processing;
step five: outputting acceleration values and LF/HF values of the head in three directions to judge the fatigue degree of the driver; if the LF/HF is in the normal range, whether the head swing amplitude exceeds a threshold value or not is judged that the driver is not tired; if the LF/HF exceeds a threshold value, judging to be moderate fatigue and early warning; if both exceed the threshold value, the fatigue is judged to be serious and an alarm is given.
The invention has the beneficial effects that:
(1) Extracting driving electrocardio, two paths of pulse and head movement signals of a driver without influencing normal driving operation;
(2) An electrocardio sensor and two pulse sensors are adopted to screen credible signals according to signal correlation, so that the reliability of the system for judging fatigue driving by utilizing physiological signals is improved;
(3) The LF/HF energy ratio calculated by the two sequences is fused in a fuzzy manner, so that the accuracy of system judgment is improved;
(4) Fatigue judgment indexes of physiological signals and head movement signals are added in the judgment decision, and compared with a single index, the fatigue early prediction and fatigue prediction accuracy are further improved.
Drawings
FIG. 1 is a schematic structural view of the present invention;
FIG. 2 is a schematic structural view of a first auricle fixing bracket;
FIG. 3 is a schematic view of a first metal supporting electrode structure;
FIG. 4 is a schematic view of a second metal supporting electrode structure;
FIG. 5 is a flow chart of the generation of sequences A and B;
FIG. 6 is a flow chart of the fusion of sequences A and B to generate a T sequence;
fig. 7 is a flowchart for determining whether to drive fatigue.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
As shown in fig. 1 to 3, a driver fatigue detection device includes a first auricle fixing bracket 1 and a second auricle fixing bracket 2, wherein the first auricle fixing bracket 1 and the second auricle fixing bracket 2 are respectively fixed on a left auricle and a right auricle of a driver; the bottom of the first auricle fixing bracket 1 is connected with a first metal supporting electrode 5 through a first flexible hose 3, and the bottom of the second auricle fixing bracket 2 is connected with a second metal supporting electrode 6 through a second flexible hose 4; the first metal supporting electrode 5 and the second metal supporting electrode 6 are connected through a third flexible hose 7, and a control unit 8 is arranged in the middle of the third flexible hose 7.
A first reflection type ear lobe pulse sensor 9 is arranged at the bottom of the first ear pinna fixing support 1 corresponding to the ear lobe of the driver, and a second reflection type ear lobe pulse sensor (not shown) is arranged at the bottom of the second ear pinna fixing support 2 corresponding to the ear lobe of the driver; the first reflection-type ear lobe pulse sensor 9 and the second reflection-type ear lobe pulse sensor respectively collect pulse data of the left ear and the right ear of the driver; the rear portion of the first auricle fixing support 1 is provided with a three-axis acceleration sensor 10 and a gyroscope 11, and the three-axis acceleration sensor 10 and the gyroscope 11 collect acceleration data of head swing of a driver.
First metal support electrode 5, second support electrode 6 medial surface install first electrocardio sensor 12, second electrocardio sensor 13 respectively, first metal support electrode 5, second support electrode 6 are worn respectively on driver's left clavicle, right clavicle, support whole device and gather driver electrocardio data in real time.
The control unit 8 comprises a conditioning circuit (not shown) for processing pulse data, acceleration data and electrocardiogram data, a vibration motor (not shown) responding according to a detection result, a lithium battery (not shown) capable of being charged wirelessly, and a control chip (not shown) for judging the fatigue value of a driver and controlling the vibration motor; the control unit 8 is worn at the back neck of the driver.
The first reflection-type ear lobe pulse sensor 9 and the second reflection-type ear lobe pulse sensor are electrically connected with the control unit 8 through wires arranged in the first flexible hose 3, the second flexible hose 4 and the third flexible hose 7 respectively, and transmit the acquired pulse data of the left ear and the right ear to the control unit 8; the three-axis acceleration sensor 10 and the gyroscope 11 are electrically connected with the control unit 8 through leads arranged in the first flexible hose 3 and the third flexible hose 4, and transmit the acquired acceleration data of the head swing of the driver to the control unit 8; the first and second electrocardiograph sensors 12 and 13 are electrically connected to the control unit 8 through wires disposed in the third flexible hose 7, respectively, and transmit the acquired electrocardiograph data to the control unit 8.
The first reflection type ear lobe pulse sensor 9, the second reflection type ear lobe pulse sensor, the three-axis acceleration sensor 10, the gyroscope 11, the first electrocardio sensor 12, the second electrocardio sensor 13, the conditioning circuit, the vibration motor and the control chip are all powered by lithium batteries.
The first auricle fixing bracket 1 and the second auricle fixing bracket 2 are made of silica gel materials; a light PVC material shell is arranged outside the control unit 8; the first metal supporting electrode 5 and the second metal supporting electrode 6 adopt conductive metal shells.
The detection method of the driver fatigue detection device comprises the following steps
Step S1: and starting the device after the monitoring device is worn by the driver.
Step S2: a first electrocardio sensor 12 of the first metal supporting electrode 5, a second electrocardio sensor 13 of the second metal supporting electrode 6, a first reflection type ear lobe pulse sensor 9 of the first ear lobe fixing support 1 and a second reflection type ear lobe pulse sensor of the second ear lobe fixing support 2 start to collect data, meanwhile, a three-axis acceleration sensor 10 and a gyroscope 11 collect acceleration data of head swing, and the collected data are transmitted to a control unit 8 located behind the neck. The data processing is performed by algorithms and processing circuitry.
In step S2, the fatigue value of the driver is determined by the following steps.
Step S2-1: the data are transmitted to the control unit 8 for processing through the first reflection type ear lobe pulse sensor 9 and the second reflection type ear lobe pulse sensor ear lobe pulse sensors, and the correlation coefficient of the left (Le) and right ear (Re) pulses is judged.
Step S2-2: and analyzing the signal effectiveness, and acquiring an RR interval sequence T.
Step S2-2-1: if the correlation coefficient is more than or equal to 0.9, confirming that the pulse signal is credible, extracting an RR interval sequence, naming the Le and Re interval sequences as X and Y, and then respectively assigning to the A sequence and the B sequence so as to carry out fuzzy fusion later.
If the correlation coefficient is less than or equal to 0.9, detecting the peak positions of the electrocardiosignal R wave and the two pulse signals, extracting two pulse signals and an electrocardiosignal RR interval sequence, pairwise calculating the correlation coefficients of the three sequences, and taking the maximum correlation coefficient rho 1 And the next largest correlation coefficient ρ 2 . Extraction of rho 1 And ρ 2 Calculating a common sequence, assigning to the A sequence, and generating rho 1 Is assigned to the B sequence.
Step S2-2-2: fusing the two RR interval sequences A and B according to a preset weight distribution strategy, further carrying out heart rate variability analysis, outputting a sequence T finally used for the heartbeat interval when the difference of the ith interval in the two RR sequences A and B is less than 50ms i =0.5A i +0.5B i (ii) a Otherwise, T i =0.7A i +0.3B i
Finally obtaining the fused RR interphase sequence T.
Step S2-3: and calculating the PSD spectrum of the RR interval sequence of the fused T sequence, and calculating LF/HF by taking 0.15Hz as an HF (high frequency) and LF decomposition point. Where the length of sequence T is N (N is required to be greater than 256) Power Spectral Density (PSD), which can be determined by Fast Fourier Transform (FFT) method or autoregressive sliding model (AR), etc.
Step S2-4: the head swing acceleration data is collected through the three-axis acceleration sensor 10 and the gyroscope 11, and the data is transmitted to the control unit 8 for processing. The acceleration a in the directions of the x, y and z axes can be measured by the three-axis acceleration sensor 10 x ,a y ,a z By the formula
Figure SMS_1
The resultant acceleration s is calculated, and the angular velocity ω in the x, y, and z-axis directions is measured by the gyroscope 11 x ,ω y And omega z The radian θ of the head movement in the x, y and z-axis directions is calculated by the following formula by integrating the head movement over a predetermined time x ,θ y And theta z
θ=∑ω i
Theta being general reference to theta x ,θ y And theta z And i is a sampling point, and the head motion range can be estimated by the formula.
Step S2-5: the control unit 8 will continuously calculate the theta, s and LF/HF results from the acquired signals and send them to the decision making rules.
When the driver is tired, dozing and involuntary head shaking amplitude is increased, and LF/HF is increased along with the increase of physiological fatigue under the regulation of internal sympathetic and parasympathetic nerve regulation mechanisms. A fatigue judgment decision rule is provided by integrating the head motion state and the physiological indexes of a driver as follows:
(1) When LF/HF is less than 0.6, s and theta are not judged in a decision-making manner, the system mainly judges physiological signals, and the driver is judged to be in a non-fatigue state at the moment;
(2) LF/HF >0.6, judging that the driver has fatigue moderate early warning, and reminding the driver to take a rest through interaction by the system; starting head motion detection, namely s and theta participate in decision judgment;
(3)LF/HF>0.6, counting the times K1 that s exceeds a set acceleration threshold value sT (sT suggests that 3G acceleration values can be taken, and can also be determined through a plurality of experimental results) in a time window of 1 minute, and counting the radian theta of the movement in the directions of x, y and z axes in 1s x ,θ y And theta z And (3) when the number of times K2 exceeds 25 degrees and any one of K1 and K2 exceeds a threshold value Km times (the threshold value Km is recommended to be taken for 3 times and can also be set according to specific conditions), judging the state to be a severe fatigue state. The system requires the driver to take a forced rest through interaction. If K1 and K2 do not exceed Km times, the fatigue state is determined to be moderate. The system reminds the driver of the need of rest through interaction.
The described embodiments are only some embodiments of the invention, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Claims (2)

1. The fatigue detection method based on the driver fatigue detection device is characterized in that the fatigue detection device comprises a first auricle fixing bracket and a second auricle fixing bracket, wherein the first auricle fixing bracket and the second auricle fixing bracket are respectively fixed on the left auricle and the right auricle of a driver; the bottom of the first auricle fixing bracket is connected with a first metal supporting electrode through a first flexible hose, and the bottom of the second auricle fixing bracket is connected with a second metal supporting electrode through a second flexible hose; the first metal supporting electrode and the second metal supporting electrode are connected through a third flexible hose, and a control unit is arranged in the middle of the third flexible hose;
a first reflection type ear lobe pulse sensor is arranged at the bottom of the first ear lobe fixing support corresponding to the ear lobe of the driver, and a second reflection type ear lobe pulse sensor is arranged at the bottom of the second ear lobe fixing support corresponding to the ear lobe of the driver; the first reflection-type ear lobe pulse sensor and the second reflection-type ear lobe pulse sensor respectively collect pulse data of the left ear and the right ear of the driver; a three-axis acceleration sensor and a gyroscope are arranged at the rear part of the first auricle fixing support, and the three-axis acceleration sensor and the gyroscope collect acceleration data of head swing of a driver;
the inner side surfaces of the first metal supporting electrode and the second metal supporting electrode are respectively provided with a first electrocardio sensor and a second electrocardio sensor, and the first metal supporting electrode and the second metal supporting electrode are respectively worn on a left clavicle and a right clavicle of a driver to support the whole device and collect electrocardio data of the driver in real time;
the control unit comprises a conditioning circuit for processing pulse data, acceleration data and electrocardiogram data, a vibration motor responding according to a detection result, a lithium battery capable of being charged wirelessly and a control chip for judging a fatigue value of a driver and controlling the vibration motor; the control unit is worn at the back neck of the driver;
the first reflection type ear lobe pulse sensor and the second reflection type ear lobe pulse sensor are electrically connected with the control unit through wires arranged in the first flexible hose, the second flexible hose and the third flexible hose respectively, and transmit the acquired pulse data of the left ear and the right ear to the control unit; the three-axis acceleration sensor and the gyroscope are electrically connected with the control unit through leads arranged in the first flexible hose and the third flexible hose, and transmit the acquired acceleration data of the head swing of the driver to the control unit; the first electrocardiogram sensor and the second electrocardiogram sensor are respectively and electrically connected with the control unit through leads arranged in the third flexible hose and transmit the acquired electrocardiogram data to the control unit;
the first reflection type ear lobe pulse sensor, the second reflection type ear lobe pulse sensor, the three-axis acceleration sensor, the gyroscope, the first electrocardio sensor, the second electrocardio sensor, the conditioning circuit, the vibration motor and the control chip are all powered by lithium batteries;
the fatigue detection method comprises the following steps:
the method comprises the following steps: collecting the ear lobe pulse data of a driver through a first reflection type ear lobe pulse sensor and a second reflection type ear lobe pulse sensor, and transmitting the ear lobe pulse data to a control unit, wherein the control unit calculates the correlation coefficient rho of the left ear pulse data and the right ear pulse data e
a) If the correlation coefficient p e If the pulse rate is more than or equal to 0.9, confirming that the pulse signals of the left ear and the right ear are effective, extracting peak-to-peak interval sequences of two paths of pulse signals, and carrying out pulse rate variability analysis;
b) If the correlation coefficient p e If the pulse rate is less than 0.9, respectively calculating peak-to-peak intervals of the two pulse signals and electrocardiosignals collected by the first and second electrocardio sensors, calculating correlation coefficients pairwise, selecting the two signals with the maximum correlation coefficient, and analyzing the pulse rate/heart rate variability;
when all the correlation coefficients are less than 0.5, the signals are interfered by strong noise and cannot be used as a fatigue driving judgment basis;
step three: calculating the pulse rate/heart rate variability by calculating a PSD spectrum of the RR interphase sequence, calculating LF/HF by taking 0.15Hz as a decomposition point of HF and LF, and further fusing the LF/HF calculated by two paths of signals;
step four: according to the acceleration a collected by a triaxial acceleration sensor and a gyroscope x ,a y ,a z And angular velocity ω x ,ω y And ω z The data is used for calculating the total acceleration values of the three directions of a space coordinate system caused by head swing and radians theta x, theta y and theta z of the head moving in the directions of x, y and z axes, and transmitting the data to the control unit for processing;
step five: outputting the combined acceleration values, the radians theta x, theta y and theta z and LF/HF values of the head in three directions, and judging the fatigue degree of the driver; if the LF/HF is in the normal range, whether the head swing amplitude exceeds a threshold value or not is judged that the driver is not tired;
if the LF/HF exceeds the threshold, counting the times K1 that the combined acceleration value exceeds the set acceleration threshold in the time window of 1 minute, and counting the movement radians theta of the x-axis direction, the y-axis direction and the z-axis direction in 1s x ,θ y And theta z The times K2 of exceeding the set radian threshold value are determined as serious fatigue states when any one of the times K1 and the times K2 exceeds the threshold value; otherwise, the fatigue state is determined to be moderate.
2. The fatigue detecting method according to claim 1, wherein the first auricle fixing bracket and the second auricle fixing bracket are made of a silica gel material; a light PVC material shell is arranged outside the control unit; the first metal supporting electrode and the second metal supporting electrode adopt conductive metal shells.
CN201810102175.1A 2018-02-01 2018-02-01 Driver fatigue detection device and working method Active CN108186034B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810102175.1A CN108186034B (en) 2018-02-01 2018-02-01 Driver fatigue detection device and working method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810102175.1A CN108186034B (en) 2018-02-01 2018-02-01 Driver fatigue detection device and working method

Publications (2)

Publication Number Publication Date
CN108186034A CN108186034A (en) 2018-06-22
CN108186034B true CN108186034B (en) 2023-04-07

Family

ID=62591720

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810102175.1A Active CN108186034B (en) 2018-02-01 2018-02-01 Driver fatigue detection device and working method

Country Status (1)

Country Link
CN (1) CN108186034B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108186034B (en) * 2018-02-01 2023-04-07 福建工程学院 Driver fatigue detection device and working method
CN109147951A (en) * 2018-09-19 2019-01-04 中国人民解放军第三0五医院 A kind of alarming method by monitoring of mental alertness
JP6670413B1 (en) * 2019-06-25 2020-03-18 株式会社疲労科学研究所 Information processing apparatus, information processing method and program
CN110720903B (en) * 2019-10-22 2022-08-23 深圳旭宏医疗科技有限公司 Electrocardiosignal processing method and device
CN112641440A (en) * 2019-10-28 2021-04-13 西安邮电大学 Method for detecting fatigue of Bluetooth headset

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010201113A (en) * 2009-03-06 2010-09-16 Hiro Kagaku Kenkyusho:Kk Fatigue degree determination processing system
CN105769222A (en) * 2016-02-16 2016-07-20 北京博研智通科技有限公司 Method, device and wearable device for detecting drive state based on heart rate variability
CN107438210A (en) * 2017-07-28 2017-12-05 京东方科技集团股份有限公司 A kind of sign test earphone and sign detection method
CN108186034A (en) * 2018-02-01 2018-06-22 福建工程学院 A kind of driver fatigue detection device and method of work

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3400873A1 (en) * 2013-06-28 2018-11-14 Murata Manufacturing Co., Ltd. Biological state estimating apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010201113A (en) * 2009-03-06 2010-09-16 Hiro Kagaku Kenkyusho:Kk Fatigue degree determination processing system
CN105769222A (en) * 2016-02-16 2016-07-20 北京博研智通科技有限公司 Method, device and wearable device for detecting drive state based on heart rate variability
CN107438210A (en) * 2017-07-28 2017-12-05 京东方科技集团股份有限公司 A kind of sign test earphone and sign detection method
CN108186034A (en) * 2018-02-01 2018-06-22 福建工程学院 A kind of driver fatigue detection device and method of work

Also Published As

Publication number Publication date
CN108186034A (en) 2018-06-22

Similar Documents

Publication Publication Date Title
CN108186034B (en) Driver fatigue detection device and working method
Zheng et al. V2iFi: In-vehicle vital sign monitoring via compact RF sensing
US10640122B2 (en) Driving consciousness estimation device
KR101642697B1 (en) Biometrics measuring system of the driver and Biometrics measuring method for the same
CN111166357A (en) Fatigue monitoring device system with multi-sensor fusion and monitoring method thereof
US10046618B2 (en) System and method for vehicle control integrating environmental conditions
CN101976495B (en) System and method for detecting fatigue driving
US20160317042A1 (en) System and method for determining changes in a body state
CN105996990A (en) Fatigue driving early warning bracelet integrating heart rate and driving action and early warning method
CN105809893B (en) A kind of anti-fatigue-driving system and method
KR20230034973A (en) Motion sickness detection system for autonomous vehicles
CN105678959A (en) Monitoring and early-warning method and system for fatigue driving
CN106571015A (en) Driving behavior data collection method based on Internet
EP3188569A1 (en) Method for detecting fall-off of wearable device, and wearable device
CN105799509A (en) Fatigue driving preventing system and method
JP6662080B2 (en) Driver status judgment device
CN103021134A (en) Monitoring and alarm device for fatigue driving of automobile
CN105615878A (en) Fatigue driving electroencephalographic monitoring method
WO2015174963A1 (en) Driver health and fatigue monitoring system and method
JP2017131445A (en) Biological information measurement device, on-vehicle device, and biological information measurement system
KR20110105411A (en) Safe driving system using remote bio radar sensor
CN111938599B (en) Driver physical characteristic recognition-based fatigue driving monitoring system
Yang et al. A wearable real-time fall detector based on Naive Bayes classifier
Jiang et al. Driversonar: Fine-grained dangerous driving detection using active sonar
CN107554293A (en) A kind of safe driving prior-warning device and safe driving method for early warning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant