CN111145497A - Portable driver fatigue detection equipment - Google Patents

Portable driver fatigue detection equipment Download PDF

Info

Publication number
CN111145497A
CN111145497A CN202010010820.4A CN202010010820A CN111145497A CN 111145497 A CN111145497 A CN 111145497A CN 202010010820 A CN202010010820 A CN 202010010820A CN 111145497 A CN111145497 A CN 111145497A
Authority
CN
China
Prior art keywords
driver
fatigue driving
eyes
detection
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010010820.4A
Other languages
Chinese (zh)
Inventor
冯桑
黄越诚
欧阳洁榆
胡熊辉
呙腾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong University of Technology
Original Assignee
Guangdong University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong University of Technology filed Critical Guangdong University of Technology
Priority to CN202010010820.4A priority Critical patent/CN111145497A/en
Publication of CN111145497A publication Critical patent/CN111145497A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Auxiliary Drives, Propulsion Controls, And Safety Devices (AREA)

Abstract

The invention discloses portable fatigue driving detection equipment which comprises a camera, a microprocessor, a storage module, a buzzer alarm, a Bluetooth module, a GPS (global positioning system) positioning module, a touch screen, a power supply module, an integrated circuit and a shell, wherein the camera is connected with the microprocessor through the storage module; the device takes a fatigue driving detection system as a core, detects fatigue driving by detecting the opening and closing of eyes of a driver during driving, and can detect the fatigue driving without contacting the driver; the portable fatigue driving detection equipment comprises three kinds of fatigue detection, in addition to the conventional fatigue driving detection, the detection of the drowsy phenomenon in the severe fatigue driving state and the detection of the vague phenomenon in the 'highway hypnosis' state are also added, and if the fatigue driving of a driver is detected, a warning is sent out; the invention has the characteristics of reliability and high precision.

Description

Portable driver fatigue detection equipment
Technical Field
The invention relates to the technical field of automobile safety, in particular to portable fatigue driving detection equipment.
Background
With the improvement of living standard, more and more families own one or two or even more automobiles. As automobile reserves increase, traffic safety issues become more acute. According to related researches, fatigue driving is one of the main causes of traffic accidents, the proportion of the fatigue driving reaches 48%, and the direct economic loss reaches hundreds of thousands of dollars. The research related to fatigue driving detection can be developed to effectively reduce the occurrence of traffic accidents.
Fatigue driving detection can be divided into two categories: one is direct detection based on driver physiological information, and the other is indirect detection based on driver physical information; among them, indirect detection can be classified into three types: head pose detection, eye state detection, and driving behavior detection.
In the prior art, the two fatigue driving detection methods of the Chinese patent CN103606245A and the Chinese patent CN205405809U need to directly contact with a driver, and the problem of potential safety hazard influencing the driving of the driver exists.
Disclosure of Invention
The present invention has been made to overcome the drawbacks and disadvantages of the prior art, and an object of the present invention is to provide a portable fatigue driving detection apparatus that detects fatigue driving based on detection of the opening and closing of the eyes of a driver while driving, and that has advantages of immediacy, non-contact, consistency, and the like.
The purpose of the invention is realized by the following technical scheme:
the utility model provides a portable driver fatigue check out test set, includes the casing, and sets up camera, microprocessor, storage module, buzzer siren, bluetooth module, GPS orientation module, touch display screen, power supply system and integrated circuit in the casing, wherein:
the camera is used for acquiring an image of the head of a driver;
a fatigue driving detection system is arranged in the microprocessor, the collected images are preprocessed, the face of the driver and the eyes of the driver are identified, and whether the driver is in a fatigue state is judged according to the opening and closing sizes of the eyes of the driver;
the storage module stores images shot by the camera, and the microprocessor reads the images from the storage module for processing;
the buzzer alarm sends out alarm sound after receiving the signal of the microprocessor;
the Bluetooth module is used for being connected with a mobile phone and vehicle-mounted equipment;
the GPS positioning module can receive satellite information, and can send positioning information to family members or a rescue center when an accident occurs;
the touch display screen can be used for a driver to select a menu and can also be used as a display screen to check whether the camera is aligned with the touch display screen;
the power supply system comprises an integrated circuit, the integrated circuit bears a camera, a microprocessor, a buzzer alarm, a Bluetooth module and a GPS positioning module, and is connected with all the components into a whole through a printed circuit; the power supply system supplies power to the camera, the microprocessor, the buzzer alarm, the Bluetooth module and the GPS positioning module through the integrated circuit;
the fatigue driving detection system can detect three fatigue driving states, including a normal fatigue driving state detection program, a severe fatigue driving doze state detection program and an expressway hypnosis vague state detection program;
wherein the normal fatigue driving state detection program is capable of detecting the opening and closing of the eyes of the driver; by calculating the PERCLOS value, when the PERCLOS value reaches the set threshold value, the driver is judged to be in fatigue driving, a common alarm sound is sent out, the alarm sound is automatically turned off after the driver goes wrong, and if the driver continuously sends out an alarm, the driver needs to stop to turn off the alarm sound;
according to the detection program of the drowsy state of the severe fatigue driving, the drowsy state can appear after the eyes of the driver are closed for a period of time; after the eyes of the driver are closed, the equipment can detect whether the closing of the eyes of the driver exceeds the set time or not, when the closing of the eyes of the driver exceeds the set time, the equipment can give out a sharp alarm sound, and the driver needs to stop and turn off the alarm sound; if the equipment does not detect that the driver is in a heavy fatigue driving doze state, entering a normal fatigue driving state detection program;
in the detection program of the vague state of the 'highway hypnosis', the driver can have a vague phenomenon in the driving process, the eyes become dull, but the eyes are still open, and the eyes can be opened without detection; after the eyes of the driver are opened, the equipment can detect whether the eyes of the driver are opened for more than set time, when the eyes of the driver are opened for more than set time, the equipment can give out a sharp alarm sound, and then the alarm sound is automatically turned off; if the device does not detect that the driver is in the "highway hypnosis" state of mind, the normal tiredness driving state detection procedure is entered.
Preferably, the camera comprises an infrared light supplement function.
Preferably, the power supply system comprises a rechargeable lithium battery, which can be powered and charged with a USB connection.
Preferably, the shell is made of plastic, and the back part of the shell is provided with a clamp which can be connected with the inside rear-view mirror of the vehicle.
The working principle of the invention is as follows:
and after the vehicle is started, starting the fatigue driving detection equipment. The driver selects to start fatigue driving detection on the touch display screen, places the equipment at a position where the front face of the driver can be shot, and observes whether the front face of the driver can be normally displayed on the touch display screen. During detection, the camera transmits a shot image into the storage module, the microprocessor reads the image from the storage module, a series of preprocessing is carried out on the image, the face and the eyes are identified and positioned through the trained AdaBoost classifier, whether a driver is in a fatigue driving state or not is judged through a PERCLOS algorithm, the microprocessor transmits an obtained result to the buzzer alarm, the buzzer alarm does not give out an alarm sound, gives out a common alarm sound and gives out a sharp alarm sound according to information, if a serious accident occurs, the microprocessor reads a reserved contact way in the storage module, reads a GPS positioning system and gives out GPS positioning information to contacts and a rescue center. When the driver stops the vehicle for rest, the equipment can be closed.
Compared with the prior art, the invention has the following beneficial effects:
the invention can detect fatigue driving by detecting the opening and closing of eyes of a driver when driving, thus detecting the fatigue driving without contacting the driver; besides conventional fatigue driving detection, the method also increases the detection of the drowsy phenomenon of the severe driving fatigue state and the detection of the vague phenomenon of the highway hypnosis state, so that the designed fatigue driving detection equipment is more reliable and more accurate.
Drawings
FIG. 1 is a block diagram of the present invention;
FIG. 2 is a flow chart of the present invention.
Detailed Description
The present invention will be described in further detail with reference to examples and drawings, but the present invention is not limited thereto.
As shown in fig. 1-2, a portable fatigue driving detection device comprises a housing made of plastic, a clamp at the back and capable of being connected with a vehicle interior rearview mirror; and set up camera, microprocessor, storage module, buzzer siren, bluetooth module, GPS orientation module, touch display screen, power supply system and integrated circuit in the casing, wherein: the camera is used for acquiring an image of the head of a driver; the camera comprises an infrared light supplementing function. A fatigue driving detection system is arranged in the microprocessor, the collected images are preprocessed, the face of the driver and the eyes of the driver are identified, and whether the driver is in a fatigue state is judged according to the opening and closing sizes of the eyes of the driver; the storage module stores images shot by the camera, and the microprocessor reads the images from the storage module for processing; the buzzer alarm sends out alarm sound after receiving the signal of the microprocessor; the Bluetooth module is used for being connected with a mobile phone and vehicle-mounted equipment; the GPS positioning module can receive satellite information, and can send positioning information to family members or a rescue center when an accident occurs; the touch display screen can be used for a driver to select a menu and can also be used as a display screen to check whether the camera is aligned with the touch display screen; the power supply system comprises an integrated circuit, the integrated circuit bears a camera, a microprocessor, a buzzer alarm, a Bluetooth module and a GPS positioning module, and is connected with all the components into a whole through a printed circuit; the power supply system supplies power to the camera, the microprocessor, the buzzer alarm, the Bluetooth module and the GPS positioning module through the integrated circuit; the power supply system comprises a rechargeable lithium battery which can be connected with a USB for power supply and charging.
The fatigue driving detection system can detect three fatigue driving states, including a normal fatigue driving state detection program, a severe fatigue driving doze state detection program and an expressway hypnosis vague state detection program; (1) a normal fatigue driving state detection program capable of detecting opening and closing of the eyes of the driver; by calculating the PERCLOS value, when the PERCLOS value reaches the set threshold value, the driver is judged to be in fatigue driving, a common alarm sound is sent out, the alarm sound is automatically turned off after the driver goes wrong, and if the driver continuously sends out an alarm, the driver needs to stop to turn off the alarm sound; (2) the method comprises the steps of detecting the drowsy state of severe fatigue driving, wherein the drowsy state can appear after the eyes of a driver are closed for a period of time; after the eyes of the driver are closed, the equipment can detect whether the closing of the eyes of the driver exceeds the set time or not, when the closing of the eyes of the driver exceeds the set time, the equipment can give out a sharp alarm sound, and the driver needs to stop and turn off the alarm sound; if the equipment does not detect that the driver is in a heavy fatigue driving doze state, entering a normal fatigue driving state detection program; (3) the method comprises the following steps of (1) detecting the vague state of 'highway hypnosis', wherein the vague phenomenon can occur in the driving process of a driver, the eyes become dull, but the eyes are still open, and the eyes can be opened without detection; after the eyes of the driver are opened, the equipment can detect whether the eyes of the driver are opened for more than set time, when the eyes of the driver are opened for more than set time, the equipment can give out a sharp alarm sound, and then the alarm sound is automatically turned off; if the device does not detect that the driver is in the "highway hypnosis" state of mind, the normal tiredness driving state detection procedure is entered.
Specifically, as shown in fig. 1, the invention is provided with a camera and a touch display screen, wherein the touch display screen can display a menu and an image shot by the camera, and the camera has high pixel and an infrared light supplement function and automatically adjusts an aperture according to ambient illumination. The surface of the equipment is protected by toughened glass, and the shell is made of high-strength carbon fiber. The shell back has the spring, and the telescopic anchor clamps can be installed anywhere according to driver's needs, and the prerequisite is that the camera can aim at driver face front. The device is connected and charged with a vehicle-mounted power supply or other devices through a type-c interface on the side face. The device comprises a camera, a microprocessor, a storage module, a buzzer alarm, a Bluetooth module, a GPS positioning module, a touch display screen, a power supply system and other electronic elements which are connected and powered through an integrated circuit.
The working process of the invention is as follows: and after the vehicle is started, starting the fatigue driving detection equipment. The driver selects to start fatigue driving detection on the touch display screen, places the equipment at a position where the front face of the driver can be shot, and observes whether the front face of the driver can be normally displayed on the touch display screen. During detection, the camera transmits a shot image into the storage module, the microprocessor reads the image from the storage module, a series of preprocessing is carried out on the image, the face and the eyes are identified and positioned through the trained AdaBoost classifier, whether a driver is in a fatigue driving state or not is judged through a PERCLOS algorithm, the microprocessor transmits an obtained result to the buzzer alarm, the buzzer alarm does not give out an alarm sound, gives out a common alarm sound and gives out a sharp alarm sound according to information, if a serious accident occurs, the microprocessor reads a reserved contact way in the storage module, reads a GPS positioning system and gives out GPS positioning information to contacts and a rescue center. When the driver stops the vehicle for rest, the equipment can be closed.
Fig. 2 shows a flow chart for determining the fatigue state of a portable fatigue driving detection device according to the present invention. The program carries out face and eye recognition and positioning through preprocessing the image and a trained AdaBoost classifier, and judges whether the driver is in a fatigue driving state through a PERCLOS algorithm. Wherein after the eyes of the driver are closed and reach the set threshold value, a common alarm sound can be sent to remind the driver to take a rest, the alarm can be automatically turned off after the rest, and if the alarm is continuously given, the driver needs to stop and manually turn off the equipment. Besides conventional fatigue driving detection, two types of fatigue driving detection are added, and detection of a severe fatigue driving drowsy state and detection of 'highway hypnosis' vague state are increased. The program will first detect a state of heavy driver drowsiness and a state of "highway hypnosis" nervousness. After the eyes of the driver are closed, the program can detect whether the closing of the eyes of the driver exceeds the set time or not, when the closing of the eyes of the driver exceeds the set time, the equipment can give out a sharp alarm sound, and the driver needs to stop and turn off the alarm sound. If the routine does not detect that the driver is in a state of being heavily tired to drive drowsy, the routine proceeds to a normal fatigue driving detection routine. After the eyes of the driver are opened, the program firstly detects whether the eyes of the driver are opened for more than a set time, when the eyes of the driver are opened for more than the set time, the device gives out a sharp alarm sound, and then the alarm sound is automatically turned off. If the routine does not detect that the driver is in the "highway hypnosis" vagal state detection, the routine will enter a normal driver fatigue detection routine.
The invention can detect fatigue driving by detecting the opening and closing of eyes of a driver when driving, thus detecting the fatigue driving without contacting the driver; besides conventional fatigue driving detection, the method also increases the detection of the drowsy phenomenon of the severe driving fatigue state and the detection of the vague phenomenon of the highway hypnosis state, so that the designed fatigue driving detection equipment is more reliable and more accurate.
The present invention is not limited to the above embodiments, and any other changes, modifications, substitutions, combinations, and simplifications which do not depart from the spirit and principle of the present invention should be construed as equivalents and are included in the scope of the present invention.

Claims (4)

1. The utility model provides a portable driver fatigue check out test set, its characterized in that, includes the casing, and sets up camera, microprocessor, storage module, buzzer siren, bluetooth module, GPS orientation module, touch display screen, power supply system and integrated circuit in the casing, wherein:
the camera is used for acquiring an image of the head of a driver;
a fatigue driving detection system is arranged in the microprocessor, the collected images are preprocessed, the face of the driver and the eyes of the driver are identified, and whether the driver is in a fatigue state is judged according to the opening and closing sizes of the eyes of the driver;
the storage module stores images shot by the camera, and the microprocessor reads the images from the storage module for processing;
the buzzer alarm sends out alarm sound after receiving the signal of the microprocessor;
the Bluetooth module is used for being connected with a mobile phone and vehicle-mounted equipment;
the GPS positioning module can receive satellite information, and can send positioning information to family members or a rescue center when an accident occurs;
the touch display screen can be used for a driver to select a menu and can also be used as a display screen to check whether the camera is aligned with the touch display screen;
the power supply system comprises an integrated circuit, the integrated circuit bears a camera, a microprocessor, a buzzer alarm, a Bluetooth module and a GPS positioning module, and is connected with all the components into a whole through a printed circuit; the power supply system supplies power to the camera, the microprocessor, the buzzer alarm, the Bluetooth module and the GPS positioning module through the integrated circuit;
the fatigue driving detection system can detect three fatigue driving states, including a normal fatigue driving state detection program, a severe fatigue driving doze state detection program and an expressway hypnosis vague state detection program;
wherein the normal fatigue driving state detection program is capable of detecting the opening and closing of the eyes of the driver; by calculating the PERCLOS value, when the PERCLOS value reaches the set threshold value, the driver is judged to be in fatigue driving, a common alarm sound is sent out, the alarm sound is automatically turned off after the driver goes wrong, and if the driver continuously sends out an alarm, the driver needs to stop to turn off the alarm sound;
according to the detection program of the drowsy state of the severe fatigue driving, the drowsy state can appear after the eyes of the driver are closed for a period of time; after the eyes of the driver are closed, the equipment can detect whether the closing of the eyes of the driver exceeds the set time or not, when the closing of the eyes of the driver exceeds the set time, the equipment can give out a sharp alarm sound, and the driver needs to stop and turn off the alarm sound; if the equipment does not detect that the driver is in a heavy fatigue driving doze state, entering a normal fatigue driving state detection program;
in the detection program of the vague state of the 'highway hypnosis', the driver can have a vague phenomenon in the driving process, the eyes become dull, but the eyes are still open, and the eyes can be opened without detection; after the eyes of the driver are opened, the equipment can detect whether the eyes of the driver are opened for more than set time, when the eyes of the driver are opened for more than set time, the equipment can give out a sharp alarm sound, and then the alarm sound is automatically turned off; if the device does not detect that the driver is in the "highway hypnosis" state of mind, the normal tiredness driving state detection procedure is entered.
2. The portable fatigue driving detection apparatus of claim 1, wherein the camera includes an infrared fill-in function.
3. The portable fatigue driving detection apparatus of claim 1, wherein the power supply system comprises a rechargeable lithium battery that can be powered and recharged using a USB connection.
4. The portable fatigue driving detection apparatus of claim 1, wherein the housing is made of plastic, and the back portion of the housing is provided with a clamp and can be connected with a vehicle interior mirror.
CN202010010820.4A 2020-01-06 2020-01-06 Portable driver fatigue detection equipment Pending CN111145497A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010010820.4A CN111145497A (en) 2020-01-06 2020-01-06 Portable driver fatigue detection equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010010820.4A CN111145497A (en) 2020-01-06 2020-01-06 Portable driver fatigue detection equipment

Publications (1)

Publication Number Publication Date
CN111145497A true CN111145497A (en) 2020-05-12

Family

ID=70523702

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010010820.4A Pending CN111145497A (en) 2020-01-06 2020-01-06 Portable driver fatigue detection equipment

Country Status (1)

Country Link
CN (1) CN111145497A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113060145A (en) * 2021-04-13 2021-07-02 龙岩学院 Driver vagal behavior analysis method
CN113180671A (en) * 2021-04-19 2021-07-30 维沃移动通信有限公司 Fatigue detection device and fatigue detection method
CN113607505A (en) * 2021-08-24 2021-11-05 鲁东大学 Medical science virus detection device in air

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140300478A1 (en) * 2013-04-08 2014-10-09 Denso Corporation Awareness level improvement device
CN104240446A (en) * 2014-09-26 2014-12-24 长春工业大学 Fatigue driving warning system on basis of human face recognition
CN104574817A (en) * 2014-12-25 2015-04-29 清华大学苏州汽车研究院(吴江) Machine vision-based fatigue driving pre-warning system suitable for smart phone
CN104732723A (en) * 2013-12-20 2015-06-24 西安发威电子科技有限公司 Fatigue driving detector
CN107563346A (en) * 2017-09-20 2018-01-09 南京栎树交通互联科技有限公司 One kind realizes that driver fatigue sentences method for distinguishing based on eye image processing

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140300478A1 (en) * 2013-04-08 2014-10-09 Denso Corporation Awareness level improvement device
CN104732723A (en) * 2013-12-20 2015-06-24 西安发威电子科技有限公司 Fatigue driving detector
CN104240446A (en) * 2014-09-26 2014-12-24 长春工业大学 Fatigue driving warning system on basis of human face recognition
CN104574817A (en) * 2014-12-25 2015-04-29 清华大学苏州汽车研究院(吴江) Machine vision-based fatigue driving pre-warning system suitable for smart phone
CN107563346A (en) * 2017-09-20 2018-01-09 南京栎树交通互联科技有限公司 One kind realizes that driver fatigue sentences method for distinguishing based on eye image processing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
毛须伟等: "一种基于眼部状态的疲劳驾驶检测方法", 《长春理工大学学报(自然科学版)》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113060145A (en) * 2021-04-13 2021-07-02 龙岩学院 Driver vagal behavior analysis method
CN113180671A (en) * 2021-04-19 2021-07-30 维沃移动通信有限公司 Fatigue detection device and fatigue detection method
CN113607505A (en) * 2021-08-24 2021-11-05 鲁东大学 Medical science virus detection device in air

Similar Documents

Publication Publication Date Title
CN111145497A (en) Portable driver fatigue detection equipment
CN106585629B (en) A kind of control method for vehicle and device
CN104183091B (en) System for adjusting sensitivity of fatigue driving early warning system in self-adaptive mode
CN102310771B (en) Motor vehicle safety control method and system based on driver face identification
US9922558B2 (en) Driving support device
US20200346658A1 (en) Distracted driving elimination system
CN106448221B (en) Pushing method of online driving assistance information pushing system and application of pushing method
CN113568509A (en) Portable electronic device and operation method thereof
CN106157537A (en) Anti-fatigue-driving system
CN108021875A (en) A kind of vehicle driver's personalization fatigue monitoring and method for early warning
CN109849925A (en) In the method for physiology monitoring combination vehicle control
CN108327627A (en) A kind of passenger vehicle intelligent and safe early warning system and its method for early warning
CN114872713A (en) Device and method for monitoring abnormal driving state of driver
CN106541915A (en) A kind of electric automobile safety pre-warning system and its method for early warning
CN111645694A (en) Driver driving state monitoring system and method based on attitude estimation
CN113947828A (en) Multifunctional automobile key control system and method
CN112438728A (en) Safe driving detection device and detection method
CN205405809U (en) Driver fatigue detection alarm system based on intelligence wrist -watch
CN110263602B (en) UBI data collection method, device, equipment and medium
CN207972581U (en) A kind of room mirror with fatigue driving monitoring function
CN206312336U (en) A kind of fatigue driving detects early-warning apparatus
CN210836483U (en) Vehicle-mounted ETC intelligent terminal equipment with driver state detection function
CN210402638U (en) Vehicle-mounted safety monitoring system based on Internet of vehicles technology
CN112712043A (en) Intelligent cabin image processing system
CN210639724U (en) Fatigue detection and driving behavior recognition early warning system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200512