GB2284582A - Vehicle safety device to warn driver of fatigue - Google Patents
Vehicle safety device to warn driver of fatigue Download PDFInfo
- Publication number
- GB2284582A GB2284582A GB9423501A GB9423501A GB2284582A GB 2284582 A GB2284582 A GB 2284582A GB 9423501 A GB9423501 A GB 9423501A GB 9423501 A GB9423501 A GB 9423501A GB 2284582 A GB2284582 A GB 2284582A
- Authority
- GB
- United Kingdom
- Prior art keywords
- driver
- fatigue
- eye
- characteristic
- vehicle according
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 210000003128 head Anatomy 0.000 claims abstract description 8
- 238000012544 monitoring process Methods 0.000 claims abstract description 6
- 208000019749 Eye movement disease Diseases 0.000 claims abstract description 3
- 230000035790 physiological processes and functions Effects 0.000 claims abstract description 3
- 210000000744 eyelid Anatomy 0.000 claims description 3
- 230000004397 blinking Effects 0.000 claims description 2
- 206010016256 fatigue Diseases 0.000 description 4
- 238000000034 method Methods 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 208000032140 Sleepiness Diseases 0.000 description 1
- 206010041349 Somnolence Diseases 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 231100000430 skin reaction Toxicity 0.000 description 1
- 230000037321 sleepiness Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 208000016255 tiredness Diseases 0.000 description 1
- 230000003867 tiredness Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
Landscapes
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
A vehicle comprises a camera for monitoring the driver, an image processor for monitoring a characteristic of the driver's physiological state as an indication of the driver's level of fatigue, and means for alerting the driver when said level exceeds a predetermined value associated with said characteristics. The head of the driver may be monitored eg in respect of the frequency of eye-blinking, eye-rolling, nodding of the head or extent of closure of the eyes.
Description
SAFETY DEVICE
This invention relates to safety devices and in particular to a device which alerts an individual to the fact he is in a fatigued or tired state.
Sleepiness in a hazardous environment can be highly dangerous. Such dangerous situations are experienced by machine operators, chemical plant works and drivers of motor vehicles, especially if driving on a motorway.
There are no reliable systems currently available which can alert an individual to the fact that he is in danger of falling asleep. The general feeling of tiredness can creep up individuals, and small sleep events called "microsleeps" can occur where an individual loses consciousness momentarily and is unaware of it.
In a vehicle, unlike other dangerous situations of the type described above, the operator/driver is in a fixed position and is not required to wear face protection.
According to the present invention, this is utilised by providing a camera for monitoring the driver, an image processor for monitoring a characteristic of the driver's physiological state as an indication of the driver's level of fatigue, and means for alerting the driver when said level exceeds a predetermined value associated with said characteristics. The relevant level of fatigue can be determined by parameters such as frequency of blink rate, the percentage of the eye area occluded by the eyelids, eye-rolling frequency, etc. An image-processing unit is provided, to determine that physiological signs of fatigue are being exhibited by the individual being monitored. A warning or alert can be given. For example, an alarm bell could operate or a visual signal could be achieved.
A system according to the invention may comprise a camera, camera lens, image-processing electronics and image-tracking systems so that, for example, the face of the subject can be kept in the field of view of the camera continually. Nothing needs to be attached to the individual's body, unlike a device recording brainwave activity or galvanic skin response. The system relies on collecting "visual" data by a non-invasive method and can operate in darkness and view through glass by using a polariser on the lens.
The components of the novel system can be fitted into a small box, and so are readily portable and easily fitted to a number of sites. The system can therefore be concealed, if this is needed.
In use, the device needs to have its "target" assigned. When this is done, the equipment monitors the target, e.g. the head and notes the changes in it.
Examples can be blinking, nodding, etc. The rate and magnitude of these changes can be measured and, if the measured value passes a certain level, then a warning system can be activated.
To detect when a driver has fallen asleep, image processing can detect whether the facial area is no longer fully visible or, in a higher resolution system, whether the eyes are closed. If the eyes remain shut over a period of time, it is a fair indication that the driver has fallen asleep.
Alternatively or in addition, the facial area may be monitored. If it is obscured from view for any long period of time, this can be taken as a reliable indication that the head has slumped onto the chest or slipped back against the headrest, indicating that the driver has fallen asleep.
This would then give a positive test result, causing the alarm system to be activated.
Image processing can detect differences in contrast and difference in brightness, and can these can be exploited both for:
1. detecting whites of eyes as opposed to eyelids,
and
2. detecting the face being directed towards the
windscreen as opposed to the top of the head or
underneath of the chin, both which have
different reflectivities and brightnesses of
image.
More sophisticated techniques can be used to detect fatigue, but the above technique would reliably indicate when a driver's head had dropped to a level which was unusual when driving, indicating sleep. The processing system can be modified, as required, to prevent false alarms when the driver is looking over the shoulder.
By way of example, the processing system may be programmed to give an alert, for a period of eyes being completely closed lasting more than 3 seconds. When first entering the vehicle, the driver would activate the system and hold the head steady until the device had calibrated itself to deal with the relative contrasts between the face and hair. This can be updated as time goes on throughout the day, to allow for slow changes in lighting conditions.
At night, the face could be illuminated with an array of infra-red diodes, so preventing distraction to the driver, and enabling this difference in contrast to be measured even when no visible light is present.
Claims (6)
1. A vehicle comprising a camera for monitoring the driver, an image processor for monitoring a characteristic of the driver's physiological state as an indication of the driver's level of fatigue, and means for alerting the driver when said level exceeds a predetermined value associated with said characteristics.
2. A vehicle according to claim 1, wherein the characteristic is the frequency of eye blinking.
3. A vehicle according to claim 1, wherein the characteristic is eye-rolling.
4. A vehicle according to claim 1, wherein the processor monitors the fraction of an eye covered by eye-lids.
5. A vehicle according to claim 1, wherein the characteristic is the head nodding either forwards or backwards, out of position.
6. A vehicle according to claim 1, wherein the characteristic is the eyes' closing.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB939323970A GB9323970D0 (en) | 1993-11-22 | 1993-11-22 | Safety device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| GB9423501D0 GB9423501D0 (en) | 1995-01-11 |
| GB2284582A true GB2284582A (en) | 1995-06-14 |
Family
ID=10745496
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| GB939323970A Pending GB9323970D0 (en) | 1993-11-22 | 1993-11-22 | Safety device |
| GB9423501A Withdrawn GB2284582A (en) | 1993-11-22 | 1994-11-21 | Vehicle safety device to warn driver of fatigue |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| GB939323970A Pending GB9323970D0 (en) | 1993-11-22 | 1993-11-22 | Safety device |
Country Status (1)
| Country | Link |
|---|---|
| GB (2) | GB9323970D0 (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6049747A (en) * | 1996-06-12 | 2000-04-11 | Yazaki Corporation | Driver monitoring device |
| WO2000044580A1 (en) * | 1999-01-27 | 2000-08-03 | Compumedics Sleep Pty. Ltd. | Vigilance monitoring system |
| GB2371396A (en) * | 2000-10-04 | 2002-07-24 | John William Thomas Harris | Driver drowsiness monitor and recognition system |
| WO2002080127A1 (en) * | 2001-03-30 | 2002-10-10 | Koninklijke Philips Electronics N.V. | System for monitoring a driver's attention to driving |
| WO2003012758A1 (en) * | 2001-07-30 | 2003-02-13 | Sankaran Manoj | A device for detecting sleep |
| EP1284432A1 (en) * | 2001-08-14 | 2003-02-19 | Ford Global Technologies, Inc., A subsidiary of Ford Motor Company | Device and process for operating a driver assistance system |
| WO2005052878A1 (en) * | 2003-11-30 | 2005-06-09 | Volvo Technology Corporation | Method and system for recognizing driver impairment |
| ES2259527A1 (en) * | 2004-11-24 | 2006-10-01 | Universidad De Alcala | MULTINSENSORIAL SYSTEM FOR MONITORING THE STATUS OF ALERT OF THE DRIVER OF A VEHICLE. |
| SG143034A1 (en) * | 2001-11-08 | 2008-06-27 | Sleep Diagnostics Pty Ltd | Alertness monitor |
| USRE42471E1 (en) | 1996-08-19 | 2011-06-21 | Torch William C | System and method for monitoring eye movement |
| CN103318023A (en) * | 2013-06-21 | 2013-09-25 | 同济大学 | Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device |
| CN103886288A (en) * | 2014-03-13 | 2014-06-25 | 惠州Tcl移动通信有限公司 | Sleepy state detecting method and system |
| US8885877B2 (en) | 2011-05-20 | 2014-11-11 | Eyefluence, Inc. | Systems and methods for identifying gaze tracking scene reference locations |
| US8890946B2 (en) | 2010-03-01 | 2014-11-18 | Eyefluence, Inc. | Systems and methods for spatially controlled scene illumination |
| US8911087B2 (en) | 2011-05-20 | 2014-12-16 | Eyefluence, Inc. | Systems and methods for measuring reactions of head, eyes, eyelids and pupils |
| WO2014204567A1 (en) * | 2013-06-19 | 2014-12-24 | Raytheon Company | Imaging-based monitoring of stress and fatigue |
| US8929589B2 (en) | 2011-11-07 | 2015-01-06 | Eyefluence, Inc. | Systems and methods for high-resolution gaze tracking |
| US10039445B1 (en) | 2004-04-01 | 2018-08-07 | Google Llc | Biosensors, communicators, and controllers monitoring eye movement and methods for using them |
| CN110910610A (en) * | 2019-11-22 | 2020-03-24 | 辽宁工程技术大学 | A Fatigue Driving Warning System Based on DSP |
| EP3142902B1 (en) * | 2014-05-16 | 2021-02-10 | Ricoh Company, Ltd. | Display device and vehicle |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4144531A (en) * | 1976-10-12 | 1979-03-13 | Anbergen Henricus J | Drowsiness detecting apparatus |
| EP0284225A1 (en) * | 1987-03-18 | 1988-09-28 | Rasaat | Apparatus for monitoring the eyes of an operator |
| WO1989007537A1 (en) * | 1988-02-09 | 1989-08-24 | Messerschmitt Boelkow Blohm | Process and device for determining the fitness to drive of the driver of a vehicle |
| GB2215040A (en) * | 1988-02-13 | 1989-09-13 | William George David Ritchie | A method and apparatus for monitoring the driver of a vehicle |
| US5218387A (en) * | 1990-05-21 | 1993-06-08 | Nissan Motor Co., Ltd. | Eye position detecting apparatus |
| US5293427A (en) * | 1990-12-14 | 1994-03-08 | Nissan Motor Company, Ltd. | Eye position detecting system and method therefor |
-
1993
- 1993-11-22 GB GB939323970A patent/GB9323970D0/en active Pending
-
1994
- 1994-11-21 GB GB9423501A patent/GB2284582A/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4144531A (en) * | 1976-10-12 | 1979-03-13 | Anbergen Henricus J | Drowsiness detecting apparatus |
| EP0284225A1 (en) * | 1987-03-18 | 1988-09-28 | Rasaat | Apparatus for monitoring the eyes of an operator |
| WO1989007537A1 (en) * | 1988-02-09 | 1989-08-24 | Messerschmitt Boelkow Blohm | Process and device for determining the fitness to drive of the driver of a vehicle |
| GB2215040A (en) * | 1988-02-13 | 1989-09-13 | William George David Ritchie | A method and apparatus for monitoring the driver of a vehicle |
| US5218387A (en) * | 1990-05-21 | 1993-06-08 | Nissan Motor Co., Ltd. | Eye position detecting apparatus |
| US5293427A (en) * | 1990-12-14 | 1994-03-08 | Nissan Motor Company, Ltd. | Eye position detecting system and method therefor |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6049747A (en) * | 1996-06-12 | 2000-04-11 | Yazaki Corporation | Driver monitoring device |
| USRE42471E1 (en) | 1996-08-19 | 2011-06-21 | Torch William C | System and method for monitoring eye movement |
| WO2000044580A1 (en) * | 1999-01-27 | 2000-08-03 | Compumedics Sleep Pty. Ltd. | Vigilance monitoring system |
| US8096946B2 (en) | 1999-01-27 | 2012-01-17 | Compumedics Limited | Vigilance monitoring system |
| US6575902B1 (en) | 1999-01-27 | 2003-06-10 | Compumedics Limited | Vigilance monitoring system |
| GB2371396A (en) * | 2000-10-04 | 2002-07-24 | John William Thomas Harris | Driver drowsiness monitor and recognition system |
| WO2002080127A1 (en) * | 2001-03-30 | 2002-10-10 | Koninklijke Philips Electronics N.V. | System for monitoring a driver's attention to driving |
| WO2003012758A1 (en) * | 2001-07-30 | 2003-02-13 | Sankaran Manoj | A device for detecting sleep |
| EP1284432A1 (en) * | 2001-08-14 | 2003-02-19 | Ford Global Technologies, Inc., A subsidiary of Ford Motor Company | Device and process for operating a driver assistance system |
| SG143034A1 (en) * | 2001-11-08 | 2008-06-27 | Sleep Diagnostics Pty Ltd | Alertness monitor |
| US7463157B2 (en) | 2003-11-30 | 2008-12-09 | Volvo Technology Corp. | Method and system for recognizing driver impairment |
| WO2005052878A1 (en) * | 2003-11-30 | 2005-06-09 | Volvo Technology Corporation | Method and system for recognizing driver impairment |
| US10039445B1 (en) | 2004-04-01 | 2018-08-07 | Google Llc | Biosensors, communicators, and controllers monitoring eye movement and methods for using them |
| ES2259527A1 (en) * | 2004-11-24 | 2006-10-01 | Universidad De Alcala | MULTINSENSORIAL SYSTEM FOR MONITORING THE STATUS OF ALERT OF THE DRIVER OF A VEHICLE. |
| ES2259527B1 (en) * | 2004-11-24 | 2007-06-01 | Universidad De Alcala | MULTINSENSORIAL SYSTEM FOR MONITORING THE STATUS OF ALERT OF THE DRIVER OF A VEHICLE. |
| US8890946B2 (en) | 2010-03-01 | 2014-11-18 | Eyefluence, Inc. | Systems and methods for spatially controlled scene illumination |
| US8911087B2 (en) | 2011-05-20 | 2014-12-16 | Eyefluence, Inc. | Systems and methods for measuring reactions of head, eyes, eyelids and pupils |
| US8885877B2 (en) | 2011-05-20 | 2014-11-11 | Eyefluence, Inc. | Systems and methods for identifying gaze tracking scene reference locations |
| US8929589B2 (en) | 2011-11-07 | 2015-01-06 | Eyefluence, Inc. | Systems and methods for high-resolution gaze tracking |
| WO2014204567A1 (en) * | 2013-06-19 | 2014-12-24 | Raytheon Company | Imaging-based monitoring of stress and fatigue |
| US20140375785A1 (en) * | 2013-06-19 | 2014-12-25 | Raytheon Company | Imaging-based monitoring of stress and fatigue |
| JP2016524939A (en) * | 2013-06-19 | 2016-08-22 | レイセオン カンパニー | Image-based monitoring of stress and fatigue |
| CN103318023B (en) * | 2013-06-21 | 2015-10-28 | 同济大学 | Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device |
| CN103318023A (en) * | 2013-06-21 | 2013-09-25 | 同济大学 | Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device |
| CN103886288A (en) * | 2014-03-13 | 2014-06-25 | 惠州Tcl移动通信有限公司 | Sleepy state detecting method and system |
| CN103886288B (en) * | 2014-03-13 | 2017-08-08 | 惠州Tcl移动通信有限公司 | A kind of sleepy detection method and its system |
| EP3142902B1 (en) * | 2014-05-16 | 2021-02-10 | Ricoh Company, Ltd. | Display device and vehicle |
| CN110910610A (en) * | 2019-11-22 | 2020-03-24 | 辽宁工程技术大学 | A Fatigue Driving Warning System Based on DSP |
Also Published As
| Publication number | Publication date |
|---|---|
| GB9323970D0 (en) | 1994-01-12 |
| GB9423501D0 (en) | 1995-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| GB2284582A (en) | Vehicle safety device to warn driver of fatigue | |
| US7202793B2 (en) | Apparatus and method of monitoring a subject and providing feedback thereto | |
| KR100905167B1 (en) | Warning monitor | |
| US8314707B2 (en) | Eye closure detection using structured illumination | |
| CN105144199B (en) | Imaging device-based occupant monitoring system supporting multiple functions | |
| US8552850B2 (en) | Near-to-eye tracking for adaptive operation | |
| US8063786B2 (en) | Method of detecting drowsiness of a vehicle operator | |
| Dong et al. | Driver inattention monitoring system for intelligent vehicles: A review | |
| US10023199B2 (en) | Method and device for ascertaining a state of drowsiness of a driver | |
| WO2015175435A1 (en) | Driver health and fatigue monitoring system and method | |
| Anjali et al. | Real-time nonintrusive monitoring and detection of eye blinking in view of accident prevention due to drowsiness | |
| Arunasalam et al. | Real-time drowsiness detection system for driver monitoring | |
| CN104376684A (en) | Monitoring system capable of preventing fatigue driving | |
| Kumari et al. | A survey on drowsy driver detection system | |
| Chatterjee et al. | Driving fitness detection: A holistic approach for prevention of drowsy and drunk driving using computer vision techniques | |
| Bhaskar | EyeAwake: A cost effective drowsy driver alert and vehicle correction system | |
| CN112438728A (en) | Safe driving detection device and detection method | |
| Rizwan et al. | Development of an efficient system for vehicle accident warning | |
| CN108492528A (en) | A kind of real-time driving fatigue monitoring system and vehicle | |
| KR20100120633A (en) | An ir sensor equipped glasses | |
| US11587335B2 (en) | Method for influencing systems for monitoring alertness | |
| Bhargava et al. | Drowsiness detection while driving using eye tracking | |
| Budiyanto et al. | Eye Detection System Based on Image Processing for Vehicle Safety | |
| Ibrahim et al. | The Application of Driving Fatigue Detection and Monitoring Technologies in Transportation Sector: A Review | |
| KR960013874A (en) | Driver's drowsiness prevention system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WAP | Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1) |