CN106683344A - Anti-fatigue driving system and working method thereof - Google Patents

Anti-fatigue driving system and working method thereof Download PDF

Info

Publication number
CN106683344A
CN106683344A CN201710047532.4A CN201710047532A CN106683344A CN 106683344 A CN106683344 A CN 106683344A CN 201710047532 A CN201710047532 A CN 201710047532A CN 106683344 A CN106683344 A CN 106683344A
Authority
CN
China
Prior art keywords
fatigue
driver
image
module
fatigue state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710047532.4A
Other languages
Chinese (zh)
Inventor
陈俊
郑明魁
吴海金
陈旭恒
李奥奇
张祎文
黄志坤
李毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN201710047532.4A priority Critical patent/CN106683344A/en
Publication of CN106683344A publication Critical patent/CN106683344A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02438Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20Workers
    • A61B2503/22Motor vehicles operators, e.g. drivers, pilots, captains

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • General Physics & Mathematics (AREA)
  • Cardiology (AREA)
  • Physiology (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Emergency Management (AREA)
  • Theoretical Computer Science (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

The invention provides an anti-fatigue driving system and a working method thereof. The anti-fatigue driving system comprises a fatigue state detection system and a prompting system which are connected with each other, wherein power supply ends of the fatigue state detection system and the prompting system are connected with an automobile battery power supply module; the fatigue state detection system comprises an eye detection subsystem; and the eye detection subsystem comprises an MCU and an image acquisition module connected with the MCU. The anti-fatigue driving system can monitor a fatigue state without a wearing monitoring device; and when the system detects that a driver is in a fatigue driving state, the system transmits a signal to control a warning apparatus to generate prompting noise, an electronic patch is controlled to generate stimulation signals such as hammering, light electric stimulation, vibration and the like to awaken the driver, so that the traffic accident can be avoided.

Description

Anti-fatigue-driving system and its method of work
Technical field
The present invention relates to intelligent driving application, at connected applications embedded technology, singlechip technology and image Reason technology etc., particularly a kind of intelligent anti-fatigue-driving system and its method of work.
Background technology
Vehicle accident is one of serious problem of society today that our times various countries are faced, and world today's harm has been acknowledged as First big public hazards of human life's safety, every year because at least making 500,000 people dead the reason for vehicle accident.According to calendar year 2001 China The statistics of Ministry of Communications, the traffic accident of the % of China 48 is caused by driver tired driving, and direct economic loss reaches hundreds of thousands of dollars. have The fatigue detecting problem of driver is closed, with the development and the raising of speed of highway, has become automotive safety at present An important ring of research.
Real-time driving fatigue monitoring system traditional at present, mainly there is hangers piece formula, watch style and spectacle, and steering wheel is touch And image recognition type.They need to dress monitoring device mostly, could realize the monitoring of fatigue state.
The content of the invention
It is an object of the invention to provide a kind of anti-fatigue-driving system, when driver is in fatigue driving, can be exactly Driver's is clear-headed to avoid fatigue driving from bringing to keep to judge driver in fatigue state and by appropriate prompting Serious consequence.
For achieving the above object, the present invention is employed the following technical solutions:A kind of anti-fatigue-driving system, it includes being connected Fatigue state detecting system and system for prompting;The feeder ear and automobile batteries of fatigue state detecting system and system for prompting Supply module connects;The fatigue state detecting system includes eye-detection subsystem;The eye-detection subsystem includes MCU And want the image collection module that is connected with it.
Further, the fatigue state detecting system also includes heartbeat detection subsystem;The heartbeat detection subsystem Including the heart beating collection sensor being connected with MCU.
Further, the system for prompting includes sound prompting module and the electronics patch with output stimulus signal function Piece.
The present invention also provides a kind of method of work of anti-fatigue-driving system, and it is comprised the following steps:Step S1:There is provided One fatigue state detecting system, the fatigue state detecting system includes eye-detection subsystem and heartbeat detection subsystem;Eyes Detection subsystem is divided into collection human eye area module and human eye closure measurement module;Heartbeat detection subsystem is surveyed including heart rate value Amount module;Step S2:Collection human eye area module tackles varying environment using the system initialization mode of semi-automatic renewal, often When secondary driver opens system, system can all pass through the photo that image collection module is first obtained on current driver's seat, and with it is prior The image having is compared, and by comparison result human eye area, the i.e. regions module only containing eyebrow and eyes are confirmed;Step S3:Human eye closure measurement module can be judged according to the fatigue state of driver by the state change of eyes, when human eye exists When percentage ratio Perclos in timing statisticses shared by closing time is more than 0.4, judge that driver, in fatigue state, is needed to department Machine proposes corresponding prompting;Because the frame number of the reality in video and image sequence is mutually corresponding, so perclos values pass through Number of image frames to closing eyes within the unit interval is counted to get, i.e.,
Perclos=
Wherein n is eyes closed frame number, and m is totalframes;Step S4:In heart rate value measurement module, examined using Worn type heart beating Measurement equipment gathers real-time heart rate;Real time data is compared with threshold value, when heart rate exceedes the 10% of threshold value, will be sent out Go out alarm condition;Step S5:The integration of all parameters is carried out by a parameter integration module, the human eye closure of unit interval is obtained Degree and heart rate value, generate bivector, and substantial amounts of sample data is tested using the method for cross validation, improve multiparameter Detecting system accuracy rate and real-time.
Further, the image sources having in advance in step S2 mainly have two:One is that every subsystem is opened, record automatically Enter current driver's cabin image, if 70% should be not above with image library similarity, done new images and be stored in image library;Two It is driver's automatic input image in image library.
Compared with prior art, the present invention can be achieved with the monitoring of fatigue state without needing to dress monitoring device;Work as system Detect driver in fatigue driving state when, system can send signal, and control caution device is produced reminds noise, while can control Electronics paster processed produces the stimulus signals such as hammering, slight electricity irritation, vibrations to wake up driver, it is to avoid traffic accident occurs.
Description of the drawings
Fig. 1 is the system construction drawing of the present invention.
Fig. 2 is the system circuit diagram of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawings explanation is further explained to the present invention with specific embodiment.
The present invention provides a kind of anti-fatigue-driving system, and it includes the fatigue state detecting system being connected and reminds system System;The feeder ear of fatigue state detecting system and system for prompting is connected with automobile batteries supply module;The fatigue state inspection Examining system includes eye-detection subsystem;The eye-detection subsystem includes MCU and wants the image collection module that is connected with it. System structure is as shown in Figure 1.
The fatigue state detecting system also includes heartbeat detection subsystem;The heartbeat detection subsystem includes and MCU The heart beating collection sensor of connection.
Further, the system for prompting includes sound prompting module and the electronics patch with output stimulus signal function Piece.
The system detects the state of driver using image procossing and heartbeat detection jointly, using automobile batteries to system It is powered, electric power system reaches system power supply requirement using Power convert.Electronics paster circuit using Minimotor unit come Driver is reminded, by supply voltage through conversion for drive motor rotation, electronics paster effect can pass through rheostat In the way of adjusting to find suitable driver, when driver tired driving is detected, electronics paster is opened by control system To reach the purpose for reminding driver.
In specific embodiment, in the circuit system of the present invention, pulse is detected using MAX30100, MAX30100 Fast, the technology maturation with response speed, measures accurate advantage, and image procossing is detected using photographic head to driver, this One technology is more ripe, and accuracy and reliability have guarantee well, and electronics paster carries out prompting function using vibrating motor, Vibrating motor small volume, control is simple, with multiple-working mode, can be very good the function of realizing reminding, control system side Face, realizes the set of system to reach system requirements using MCU.When system detectio to driver is in fatigue driving state, it is System can send signal, and control caution device is produced reminds noise, at the same can control electronics paster produce hammering, slight electricity irritation, The physical actions such as vibrations are waking up driver, it is to avoid traffic accident occurs.
The present invention also provides a kind of method of work of anti-fatigue-driving system, and it is comprised the following steps:Step S1:There is provided One fatigue state detecting system, the fatigue state detecting system includes eye-detection subsystem and heartbeat detection subsystem;Eyes Detection subsystem is divided into collection human eye area module and human eye closure measurement module;Heartbeat detection subsystem is surveyed including heart rate value Amount module;Step S2:Collection human eye area module tackles varying environment using the system initialization mode of semi-automatic renewal, often When secondary driver opens system, system can all pass through the photo that image collection module is first obtained on current driver's seat, and with it is prior The image having is compared, and by comparison result human eye area, the i.e. regions module only containing eyebrow and eyes are confirmed;Step S3:Human eye closure measurement module can be judged according to the fatigue state of driver by the state change of eyes, when human eye exists When percentage ratio Perclos in timing statisticses shared by closing time is more than 0.4, judge that driver, in fatigue state, is needed to department Machine proposes corresponding prompting;Because the frame number of the reality in video and image sequence is mutually corresponding, so perclos values pass through Number of image frames to closing eyes within the unit interval is counted to get, i.e.,
Perclos=
Wherein n is eyes closed frame number, and m is totalframes;Step S4:In heart rate value measurement module, examined using Worn type heart beating Measurement equipment gathers real-time heart rate;Real time data is compared with threshold value, when heart rate exceedes the 10% of threshold value, will be sent out Go out alarm condition;Step S5:The integration of all parameters is carried out by a parameter integration module, the human eye closure of unit interval is obtained Degree and heart rate value, generate bivector, and substantial amounts of sample data is tested using the method for cross validation, improve multiparameter Detecting system accuracy rate and real-time.
Further, the image sources having in advance in step S2 mainly have two:One is that every subsystem is opened, record automatically Enter current driver's cabin image, if 70% should be not above with image library similarity, done new images and be stored in image library;Two It is driver's automatic input image in image library.
It is more than presently preferred embodiments of the present invention, all changes made according to technical solution of the present invention, produced function is made During with scope without departing from technical solution of the present invention, protection scope of the present invention is belonged to.

Claims (5)

1. a kind of anti-fatigue-driving system, it is characterised in that:Including the fatigue state detecting system and system for prompting that are connected; The feeder ear of fatigue state detecting system and system for prompting is connected with automobile batteries supply module;
The fatigue state detecting system includes eye-detection subsystem;The eye-detection subsystem includes MCU and thinks with it The image collection module of connection.
2. anti-fatigue-driving system according to claim 1, it is characterised in that:The fatigue state detecting system also includes Heartbeat detection subsystem;The heartbeat detection subsystem includes the heart beating collection sensor being connected with MCU.
3. anti-fatigue-driving system according to claim 1, it is characterised in that:The system for prompting includes sound prompting mould Block and the electronics paster with output stimulus signal function.
4. a kind of method of work of anti-fatigue-driving system, it is characterised in that:Comprise the following steps:
Step S1:A fatigue state detecting system is provided, the fatigue state detecting system includes eye-detection subsystem and heart beating Detection subsystem;Eye-detection subsystem is divided into collection human eye area module and human eye closure measurement module;Heartbeat detection System includes heart rate value measurement module;
Step S2:Collection human eye area module tackles varying environment using the system initialization mode of semi-automatic renewal, every time When driver opens system, system can all pass through image collection module and first obtain photo on current driver's seat, and with deposit in advance Some images are compared, and by comparison result human eye area, the i.e. regions module only containing eyebrow and eyes are confirmed;
Step S3:Human eye closure measurement module can be judged according to the fatigue state of driver by the state change of eyes, When percentage ratio Perclos of the human eye in timing statisticses shared by closing time is more than 0.4, driver is judged in fatigue state, Need to propose driver corresponding prompting;Because the frame number of the reality in video and image sequence is mutually corresponding, so Perclos values are counted to get by the number of image frames to closing eyes within the unit interval, i.e.,
Perclos=
Wherein n is eyes closed frame number, and m is totalframes;
Step S4:In heart rate value measurement module, using Worn type heartbeat detection apparatus real-time heart rate is gathered;Will be real-time Data compare with threshold value, when heart rate exceedes the 10% of threshold value, will send alarm condition;
Step S5:The integration of all parameters is carried out by a parameter integration module, the human eye closure and the heart of unit interval is obtained Rate value, generates bivector, and substantial amounts of sample data is tested using the method for cross validation, improves the detection of multiparameter The accuracy rate and real-time of system.
5. the method for work of anti-fatigue-driving system according to claim 4, it is characterised in that:Have in advance in step S2 Image sources mainly have two:One is that every subsystem is opened, the current driver's cabin image of automatic input, if should be similar to image library Degree is not above 70%, then done new images and be stored in image library;Two is driver's automatic input image in image library.
CN201710047532.4A 2017-01-22 2017-01-22 Anti-fatigue driving system and working method thereof Pending CN106683344A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710047532.4A CN106683344A (en) 2017-01-22 2017-01-22 Anti-fatigue driving system and working method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710047532.4A CN106683344A (en) 2017-01-22 2017-01-22 Anti-fatigue driving system and working method thereof

Publications (1)

Publication Number Publication Date
CN106683344A true CN106683344A (en) 2017-05-17

Family

ID=58859963

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710047532.4A Pending CN106683344A (en) 2017-01-22 2017-01-22 Anti-fatigue driving system and working method thereof

Country Status (1)

Country Link
CN (1) CN106683344A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107194346A (en) * 2017-05-19 2017-09-22 福建师范大学 A kind of fatigue drive of car Forecasting Methodology
CN109887239A (en) * 2019-03-16 2019-06-14 南京英诺微盛光学科技有限公司 It is a kind of for monitoring the wearable device and application method of fatigue driving
CN112401908A (en) * 2020-12-02 2021-02-26 中国人民解放军海军特色医学中心 Fatigue monitoring device, fatigue monitoring method, computing equipment and storage medium
CN114469035A (en) * 2022-01-05 2022-05-13 清华大学 Anti-driving fatigue safety auxiliary system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009028239A (en) * 2007-07-26 2009-02-12 Nissan Motor Co Ltd Drowsy driving detector
CN103714660A (en) * 2013-12-26 2014-04-09 苏州清研微视电子科技有限公司 System for achieving fatigue driving judgment on basis of image processing and fusion between heart rate characteristic and expression characteristic
CN105389948A (en) * 2015-11-11 2016-03-09 上海斐讯数据通信技术有限公司 System and method for preventing fatigue driving of driver
US20160159217A1 (en) * 2014-12-08 2016-06-09 Hyundai Motor Company System and method for determining drowsy state of driver
CN105761431A (en) * 2016-05-05 2016-07-13 中晟国计科技有限公司 Behavior monitor early-warning method and system
CN206460590U (en) * 2017-01-22 2017-09-01 福州大学 Anti-fatigue-driving system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009028239A (en) * 2007-07-26 2009-02-12 Nissan Motor Co Ltd Drowsy driving detector
CN103714660A (en) * 2013-12-26 2014-04-09 苏州清研微视电子科技有限公司 System for achieving fatigue driving judgment on basis of image processing and fusion between heart rate characteristic and expression characteristic
US20160159217A1 (en) * 2014-12-08 2016-06-09 Hyundai Motor Company System and method for determining drowsy state of driver
CN105389948A (en) * 2015-11-11 2016-03-09 上海斐讯数据通信技术有限公司 System and method for preventing fatigue driving of driver
CN105761431A (en) * 2016-05-05 2016-07-13 中晟国计科技有限公司 Behavior monitor early-warning method and system
CN206460590U (en) * 2017-01-22 2017-09-01 福州大学 Anti-fatigue-driving system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
周凌霄: "多源生理信号融合的驾驶疲劳检测预警系统研究", pages 68 *
毛须伟等: "一种基于眼部状态的疲劳驾驶检测方法", 《长春理工大学学报(自然科学版)》 *
毛须伟等: "一种基于眼部状态的疲劳驾驶检测方法", 《长春理工大学学报(自然科学版)》, vol. 39, no. 02, 30 April 2016 (2016-04-30), pages 125 - 136 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107194346A (en) * 2017-05-19 2017-09-22 福建师范大学 A kind of fatigue drive of car Forecasting Methodology
CN109887239A (en) * 2019-03-16 2019-06-14 南京英诺微盛光学科技有限公司 It is a kind of for monitoring the wearable device and application method of fatigue driving
CN112401908A (en) * 2020-12-02 2021-02-26 中国人民解放军海军特色医学中心 Fatigue monitoring device, fatigue monitoring method, computing equipment and storage medium
CN114469035A (en) * 2022-01-05 2022-05-13 清华大学 Anti-driving fatigue safety auxiliary system and method

Similar Documents

Publication Publication Date Title
CN106683344A (en) Anti-fatigue driving system and working method thereof
CN104183091B (en) System for adjusting sensitivity of fatigue driving early warning system in self-adaptive mode
CN104146722B (en) Driving fatigue detecting and grading early warning method based on head signals
CN102848918B (en) Based on fatigue driving detecting and controlling system and the control method thereof of physiological signal collection
CN105615878B (en) A kind of fatigue driving eeg monitoring method
CN103318023B (en) Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device
CN204028500U (en) Fatigue driving alarm glasses with function
CN104257392B (en) The method of a kind of fatigue driving detection prompting and detection alarm set
CN105595996B (en) A kind of fatigue driving eeg monitoring method of electricity and brain electricity comprehensive judgement
CN106691443A (en) Electroencephalogram-based wearable anti-fatigue intelligent monitoring and pre-warning system for driver
CN209063895U (en) Tired driver combined of multi-sensor information drives early warning and pro-active intervention system
WO2017193272A1 (en) Vehicle-mounted fatigue pre-warning system based on human face recognition and pre-warning method
CN110334592A (en) A kind of monitoring of driver's abnormal behaviour and safety control system and safety control method
CN205405810U (en) Driver fatigue detection alarm system based on brain wave
CN103948394A (en) Fatigue driving detecting system and fatigue relief device
CN104142583A (en) Intelligent glasses with blinking detection function and implementation method thereof
CN104044460A (en) Alarm method and device for preventing fatigue driving of motor vehicle
CN103927848A (en) Safe driving assisting system based on biological recognition technology
CN203941599U (en) Prevent the device of driver's drowsiness
CN104068868A (en) Method and device for monitoring driver fatigue on basis of machine vision
CN105595997B (en) A kind of fatigue driving eeg monitoring method determined based on step fatigue
CN208126407U (en) Anti-fatigue-driving system based on software-hardware synergism image procossing
CN106236047A (en) The control method of driver fatigue monitoring system
CN209220256U (en) Fatigue driving based on pulse blood oxygen real-time monitoring monitors alarm set
CN109953763A (en) A kind of vehicle carried driving behavioral value early warning system and method based on deep learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination