CN108961678A - One kind being based on Face datection Study in Driver Fatigue State Surveillance System and its detection method - Google Patents
One kind being based on Face datection Study in Driver Fatigue State Surveillance System and its detection method Download PDFInfo
- Publication number
- CN108961678A CN108961678A CN201810386903.6A CN201810386903A CN108961678A CN 108961678 A CN108961678 A CN 108961678A CN 201810386903 A CN201810386903 A CN 201810386903A CN 108961678 A CN108961678 A CN 108961678A
- Authority
- CN
- China
- Prior art keywords
- face
- driver
- state
- fatigue
- output end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
- A61B5/1114—Tracking parts of the body
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
- A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6893—Cars
Abstract
The invention discloses one kind to be based on Face datection Study in Driver Fatigue State Surveillance System and its detection method, including infrared camera, the signal output end of the infrared camera is electrically connected the output end of picture signal Acquisition Circuit, the output end of described image signal acquisition circuit is electrically connected the input terminal of video decoding circuit, the output end of the video decoding circuit is electrically connected the input terminal of Face datection engine, and the output end of the Face datection engine is electrically connected the input terminal of alarm；The video data of crawl driver is realized using infrared camera, infrared camera can provide clearly image in the insufficient situation of illumination condition, this method facilitates motor vehicle to absorb video in daytime, evening or tunnel, can accurately judge driver status.
Description
Technical field
The invention belongs to Face datection driver fatigue detection fields, more specifically, more particularly to it is a kind of based on face
Detect Study in Driver Fatigue State Surveillance System.Meanwhile the invention further relates to a kind of methods based on the detection of Face datection driver fatigue.
Background technique
Driver's operating motor vehicles in fatigue can carry out serious disaster to the property even life zone of personnel.Previous
Electronic product (such as navigator) only provides voice warning in continuous driving vehicle for a long time, and whether does not detect driver
It really handles in fatigue state, fatigue state is not dependent on the time that driver drives vehicle.
The characteristic point that face can be accurately identified currently based on the recognition of face of artificial intelligence, such as eyes and mouth
The Eulerian coordinates position of shape and head is indicated with pitching, yaw and rolling, can judge driver using these parameters
It is whether in a state of fatigue.Eyes can be closed or partly be closed, yawn and bow for a long time when such as people dozes off, and thus be proposed
It is a kind of for detecting the system and method for driver fatigue, it is dangerous to solve the problems, such as that driver tired driving causes.
Summary of the invention
The purpose of the present invention is to provide one kind to be based on Face datection Study in Driver Fatigue State Surveillance System and its detection method, with
Solve the problems mentioned above in the background art.
To achieve the above object, the invention provides the following technical scheme:
One kind being based on Face datection Study in Driver Fatigue State Surveillance System, including infrared camera, the letter of the infrared camera
Number output end is electrically connected the output end of picture signal Acquisition Circuit, and the output end of described image signal acquisition circuit is electrically connected
The input terminal of video decoding circuit, the output end of the video decoding circuit are electrically connected the input terminal of Face datection engine, institute
The output end for stating Face datection engine is electrically connected the input terminal of alarm；
The Face datection engine, including face's terrestrial reference detection, face's terrestrial reference and head position tracking, facial action unit
Identification and eye tracking；Position judgement of the face in the visual field, occupy in the middle part of image, contains entire face element in the visual field；
The crucial point data for calculating face characteristic judges whether driver is in a state of fatigue according to the time value that system is arranged.
Preferably, crucial point data calculates the Eulerian coordinates position on head, obtains pitching, yaw and rolling data.
Preferably, calculate whether eyes are in closed-eye state according to crucial point data.
Preferably, according to crucial point data calculate mouth shape aspect ratio data, judge driver whether be in yawn or
Long-term state of opening one's mouth.
The present invention also provides a kind of methods based on the detection of Face datection driver fatigue, include the following steps: to open
Camera, obtain face image, using artificial intelligence convolutional Neural net method to image sequence carry out dynamic human face detection and
Tracking, including face's terrestrial reference detection, face's terrestrial reference and head position tracking, the identification of facial action unit, eye tracking etc.；
The coordinate position that head is calculated after obtaining face's key point obtains the angle of pitching, yaw and rolling, according to this
Whether a little parameter judgement drivers are in a state of fatigue, such as bow more than the time span of default, it is believed that and it is fatigue state,
Issue fatigue driving alarm；
Driver is obtained according to the aspect ratio that crucial point data calculates mouth shape whether to yawn or open one's mouth for a long time, if it is
It alarms at once in state of yawning；If it is the long-term state of opening one's mouth of processing, the time is more than sending fatigue after the systemic presupposition time
Drive alarm；
Obtain whether driver handles closed-eye state according to the aspect ratio that crucial point data calculates eyes, if closed-eye time
It has been more than to issue fatigue driving alarm after the systemic presupposition time.
Compared with prior art, the beneficial effects of the present invention are: realizing the video of crawl driver using infrared camera
Data, infrared camera can provide clearly image in the insufficient situation of illumination condition, and this method facilitates motor vehicle to exist
Video is absorbed in daytime, evening or tunnel, can accurately judge driver status.
Detailed description of the invention
Fig. 1 is system diagram of the invention；
Fig. 2 is flow chart of the method for the present invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with specific embodiment, to this
Invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, not
For limiting the present invention.
One kind being based on Face datection Study in Driver Fatigue State Surveillance System, including infrared camera, the letter of the infrared camera
Number output end is electrically connected the output end of picture signal Acquisition Circuit, and the output end of described image signal acquisition circuit is electrically connected
The input terminal of video decoding circuit, the output end of the video decoding circuit are electrically connected the input terminal of Face datection engine, institute
The output end for stating Face datection engine is electrically connected the input terminal of alarm；
The Face datection engine, including face's terrestrial reference detection, face's terrestrial reference and head position tracking, facial action unit
Identification and eye tracking；Position judgement of the face in the visual field, occupy in the middle part of image, contains entire face element in the visual field；
The crucial point data for calculating face characteristic judges whether driver is in a state of fatigue according to the time value that system is arranged.
Specifically, crucial point data calculates the Eulerian coordinates position on head, pitching, yaw and rolling data are obtained.
Specifically, calculating whether eyes are in closed-eye state according to crucial point data.
Specifically, according to crucial point data calculate mouth shape aspect ratio data, judge driver whether be in yawn or
Long-term state of opening one's mouth.
The present invention also provides a kind of methods based on the detection of Face datection driver fatigue, include the following steps: to open
Camera, obtain face image, using artificial intelligence convolutional Neural net method to image sequence carry out dynamic human face detection and
Tracking, including face's terrestrial reference detection, face's terrestrial reference and head position tracking, the identification of facial action unit, eye tracking etc.；
The coordinate position that head is calculated after obtaining face's key point obtains the angle of pitching, yaw and rolling, according to this
Whether a little parameter judgement drivers are in a state of fatigue, such as bow more than the time span of default, it is believed that and it is fatigue state,
Issue fatigue driving alarm；
Driver is obtained according to the aspect ratio that crucial point data calculates mouth shape whether to yawn or open one's mouth for a long time, if it is
It alarms at once in state of yawning；If it is the long-term state of opening one's mouth of processing, the time is more than sending fatigue after the systemic presupposition time
Drive alarm；
Obtain whether driver handles closed-eye state according to the aspect ratio that crucial point data calculates eyes, if closed-eye time
It has been more than to issue fatigue driving alarm after the systemic presupposition time.
Driver fatigue alarm is sent to monitoring system using a kind of method based on the detection of Face datection driver fatigue
And time, monitoring system record driver status and send audio alert to driver.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
Anyone skilled in the art in the technical scope disclosed by the present invention, according to the technique and scheme of the present invention and its
Inventive concept is subject to equivalent substitution or change, should be covered by the protection scope of the present invention.
Claims (5)
1. one kind is based on Face datection Study in Driver Fatigue State Surveillance System, including infrared camera, it is characterised in that: described infrared to take the photograph
As the signal output end of head is electrically connected the output end of picture signal Acquisition Circuit, the output end of described image signal acquisition circuit
It is electrically connected the input terminal of video decoding circuit, the output end of the video decoding circuit is electrically connected the defeated of Face datection engine
Enter end, the output end of the Face datection engine is electrically connected the input terminal of alarm；
The Face datection engine, including face's terrestrial reference detection, face's terrestrial reference and head position tracking, the identification of facial action unit
And eye tracking；Position judgement of the face in the visual field, occupy in the middle part of image, contains entire face element in the visual field；It calculates
The crucial point data of face characteristic judges whether driver is in a state of fatigue according to the time value that system is arranged.
2. according to claim 1 a kind of based on Face datection Study in Driver Fatigue State Surveillance System, it is characterised in that: key point
Data calculate the Eulerian coordinates position on head, obtain pitching, yaw and rolling data.
3. according to claim 1 a kind of based on Face datection Study in Driver Fatigue State Surveillance System, it is characterised in that: according to pass
Key point data calculates whether eyes are in closed-eye state.
4. according to claim 1 a kind of based on Face datection Study in Driver Fatigue State Surveillance System, it is characterised in that: according to pass
Key point data calculates the aspect ratio data of mouth shape, judges whether driver is in and yawns or state of opening one's mouth for a long time.
5. the method according to claim 1 based on the detection of Face datection driver fatigue, which is characterized in that including as follows
Step: opening camera, obtains face image, carries out dynamic people to image sequence using the method for artificial intelligence convolutional Neural net
Face detection and tracking, including face's terrestrial reference detection, face's terrestrial reference and head position tracking, facial action unit identification, sight with
Track etc.；
The coordinate position that head is calculated after obtaining face's key point obtains the angle of pitching, yaw and rolling, according to these ginsengs
Whether number judgement driver is in a state of fatigue, such as bows more than the time span of default, it is believed that is fatigue state, issues
Fatigue driving alarm；
It obtains driver according to the aspect ratio that crucial point data calculates mouth shape whether to yawn or open one's mouth for a long time, if it is being in
State of yawning is alarmed at once；If it is the long-term state of opening one's mouth of processing, the time is more than sending fatigue driving after the systemic presupposition time
Alarm；
Obtain whether driver handles closed-eye state according to the aspect ratio that crucial point data calculates eyes, if closed-eye time is more than
After systemic presupposition time, fatigue driving alarm is issued.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810386903.6A CN108961678A (en) | 2018-04-26 | 2018-04-26 | One kind being based on Face datection Study in Driver Fatigue State Surveillance System and its detection method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810386903.6A CN108961678A (en) | 2018-04-26 | 2018-04-26 | One kind being based on Face datection Study in Driver Fatigue State Surveillance System and its detection method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108961678A true CN108961678A (en) | 2018-12-07 |
Family
ID=64498899
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810386903.6A Pending CN108961678A (en) | 2018-04-26 | 2018-04-26 | One kind being based on Face datection Study in Driver Fatigue State Surveillance System and its detection method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108961678A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109740472A (en) * | 2018-12-25 | 2019-05-10 | 武汉纺织大学 | A kind of photographic method of anti-eye closing |
| CN110021147A (en) * | 2019-05-07 | 2019-07-16 | 四川九洲视讯科技有限责任公司 | A kind of method for detecting fatigue driving demarcated based on machine learning and numerical value |
| CN110200601A (en) * | 2019-06-17 | 2019-09-06 | 广东工业大学 | A kind of pulse condition acquisition device and system |
| CN110334600A (en) * | 2019-06-03 | 2019-10-15 | 武汉工程大学 | A kind of multiple features fusion driver exception expression recognition method |
| CN110491091A (en) * | 2019-09-08 | 2019-11-22 | 湖北汽车工业学院 | A kind of commercial vehicle driver fatigue state monitoring and warning system |
| CN110738190A (en) * | 2019-10-28 | 2020-01-31 | 北京经纬恒润科技有限公司 | fatigue driving judgment method, device and equipment |
| CN110826521A (en) * | 2019-11-15 | 2020-02-21 | 爱驰汽车有限公司 | Driver fatigue state recognition method, system, electronic device, and storage medium |
| CN111292509A (en) * | 2018-12-10 | 2020-06-16 | 丰田自动车株式会社 | Abnormality detection device, abnormality detection system, and recording medium |
| CN111950522A (en) * | 2020-08-27 | 2020-11-17 | 长沙理工大学 | Fatigue driving detection method based on human face features |
| CN113536967A (en) * | 2021-06-25 | 2021-10-22 | 武汉极目智能技术有限公司 | Driver state identification method and device based on head motion posture and human eye opening and closing degree of driver, and electronic equipment |
| CN113795069A (en) * | 2021-11-18 | 2021-12-14 | 深圳市奥新科技有限公司 | Tunnel illumination control method and tunnel illumination system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006131254A1 (en) * | 2005-06-09 | 2006-12-14 | Daimlerchrysler Ag | Method and device for recognizing tiredness |
| CN101540090A (en) * | 2009-04-14 | 2009-09-23 | 华南理工大学 | Driver fatigue monitoring device based on multivariate information fusion and monitoring method thereof |
| CN103839046A (en) * | 2013-12-26 | 2014-06-04 | 苏州清研微视电子科技有限公司 | Automatic driver attention identification system and identification method thereof |
| CN105354987A (en) * | 2015-11-26 | 2016-02-24 | 南京工程学院 | Vehicle fatigue driving detection and identity authentication apparatus, and detection method thereof |
| CN107679468A (en) * | 2017-09-19 | 2018-02-09 | 浙江师范大学 | A kind of embedded computer vision detects fatigue driving method and device |
-
2018
- 2018-04-26 CN CN201810386903.6A patent/CN108961678A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006131254A1 (en) * | 2005-06-09 | 2006-12-14 | Daimlerchrysler Ag | Method and device for recognizing tiredness |
| CN101540090A (en) * | 2009-04-14 | 2009-09-23 | 华南理工大学 | Driver fatigue monitoring device based on multivariate information fusion and monitoring method thereof |
| CN103839046A (en) * | 2013-12-26 | 2014-06-04 | 苏州清研微视电子科技有限公司 | Automatic driver attention identification system and identification method thereof |
| CN105354987A (en) * | 2015-11-26 | 2016-02-24 | 南京工程学院 | Vehicle fatigue driving detection and identity authentication apparatus, and detection method thereof |
| CN107679468A (en) * | 2017-09-19 | 2018-02-09 | 浙江师范大学 | A kind of embedded computer vision detects fatigue driving method and device |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11232313B2 (en) | 2018-12-10 | 2022-01-25 | Toyota Jidosha Kabushiki Kaisha | Abnormality detection device, abnormality detection system, and abnormality detection program |
| CN111292509A (en) * | 2018-12-10 | 2020-06-16 | 丰田自动车株式会社 | Abnormality detection device, abnormality detection system, and recording medium |
| CN109740472A (en) * | 2018-12-25 | 2019-05-10 | 武汉纺织大学 | A kind of photographic method of anti-eye closing |
| CN110021147A (en) * | 2019-05-07 | 2019-07-16 | 四川九洲视讯科技有限责任公司 | A kind of method for detecting fatigue driving demarcated based on machine learning and numerical value |
| CN110334600A (en) * | 2019-06-03 | 2019-10-15 | 武汉工程大学 | A kind of multiple features fusion driver exception expression recognition method |
| CN110200601A (en) * | 2019-06-17 | 2019-09-06 | 广东工业大学 | A kind of pulse condition acquisition device and system |
| CN110200601B (en) * | 2019-06-17 | 2022-04-19 | 广东工业大学 | Pulse condition acquisition device and system |
| CN110491091A (en) * | 2019-09-08 | 2019-11-22 | 湖北汽车工业学院 | A kind of commercial vehicle driver fatigue state monitoring and warning system |
| CN110738190A (en) * | 2019-10-28 | 2020-01-31 | 北京经纬恒润科技有限公司 | fatigue driving judgment method, device and equipment |
| CN110826521A (en) * | 2019-11-15 | 2020-02-21 | 爱驰汽车有限公司 | Driver fatigue state recognition method, system, electronic device, and storage medium |
| CN111950522A (en) * | 2020-08-27 | 2020-11-17 | 长沙理工大学 | Fatigue driving detection method based on human face features |
| CN113536967A (en) * | 2021-06-25 | 2021-10-22 | 武汉极目智能技术有限公司 | Driver state identification method and device based on head motion posture and human eye opening and closing degree of driver, and electronic equipment |
| CN113795069A (en) * | 2021-11-18 | 2021-12-14 | 深圳市奥新科技有限公司 | Tunnel illumination control method and tunnel illumination system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108961678A (en) | One kind being based on Face datection Study in Driver Fatigue State Surveillance System and its detection method | |
| CN108791299B (en) | Driving fatigue detection and early warning system and method based on vision | |
| CN106709420B (en) | Method for monitoring driving behavior of commercial vehicle driver | |
| US9460601B2 (en) | Driver distraction and drowsiness warning and sleepiness reduction for accident avoidance | |
| CN102696041B (en) | The system and method that the cost benefit confirmed for eye tracking and driver drowsiness is high and sane | |
| US8164463B2 (en) | Driver management apparatus and travel management system | |
| CN104786934B (en) | Vehicle driving data management system and realization method | |
| CN102930693A (en) | Early warning system and method for safe driving | |
| CN105788176A (en) | Fatigue driving monitoring and prompting method and system | |
| CN102201148A (en) | Driver fatigue detecting method and system based on vision | |
| CN203838770U (en) | Automobile data recorder | |
| Anjali et al. | Real-time nonintrusive monitoring and detection of eye blinking in view of accident prevention due to drowsiness | |
| CN109543577A (en) | A kind of fatigue driving detection method for early warning based on facial expression feature | |
| CN109435844A (en) | A kind of driving auxiliary and drivers ' behavior detection method | |
| Charniya et al. | Drunk driving and drowsiness detection | |
| CN108573210A (en) | A kind of alarming method for fatigue drive and device | |
| CN107403541A (en) | The system of real-time eye recognition monitoring fatigue driving | |
| CN104299363A (en) | Fatigue driving pre-warning system based on multi-feature fusion | |
| Kailasam et al. | Accident alert system for driver using face recognition | |
| Ali et al. | A novel and efficient real time driver fatigue and yawn detection-alert system | |
| CN107506698A (en) | The method of public transportation vehicle anti-fatigue-driving management based on Internet of Things | |
| CN111627131A (en) | Driving recording device and method with driver auxiliary monitoring warning function | |
| CN103569084B (en) | Drive arrangement for detecting and method thereof | |
| CN106874831A (en) | Driving behavior method for detecting and its system | |
| US11433916B1 (en) | System to generate an alert to wake a driver of a vehicle and a method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |
|
| RJ01 | Rejection of invention patent application after publication |