GB2284582A - Vehicle safety device to warn driver of fatigue - Google Patents

Vehicle safety device to warn driver of fatigue Download PDF

Info

Publication number
GB2284582A
GB2284582A GB9423501A GB9423501A GB2284582A GB 2284582 A GB2284582 A GB 2284582A GB 9423501 A GB9423501 A GB 9423501A GB 9423501 A GB9423501 A GB 9423501A GB 2284582 A GB2284582 A GB 2284582A
Authority
GB
United Kingdom
Prior art keywords
driver
fatigue
eye
characteristic
vehicle according
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB9423501A
Other versions
GB9423501D0 (en
Inventor
Edward James Snow
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TOAD INNOVATIONS Ltd
Original Assignee
TOAD INNOVATIONS Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TOAD INNOVATIONS Ltd filed Critical TOAD INNOVATIONS Ltd
Publication of GB9423501D0 publication Critical patent/GB9423501D0/en
Publication of GB2284582A publication Critical patent/GB2284582A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A vehicle comprises a camera for monitoring the driver, an image processor for monitoring a characteristic of the driver's physiological state as an indication of the driver's level of fatigue, and means for alerting the driver when said level exceeds a predetermined value associated with said characteristics. The head of the driver may be monitored eg in respect of the frequency of eye-blinking, eye-rolling, nodding of the head or extent of closure of the eyes.

Description

SAFETY DEVICE This invention relates to safety devices and in particular to a device which alerts an individual to the fact he is in a fatigued or tired state.
Sleepiness in a hazardous environment can be highly dangerous. Such dangerous situations are experienced by machine operators, chemical plant works and drivers of motor vehicles, especially if driving on a motorway.
There are no reliable systems currently available which can alert an individual to the fact that he is in danger of falling asleep. The general feeling of tiredness can creep up individuals, and small sleep events called "microsleeps" can occur where an individual loses consciousness momentarily and is unaware of it.
In a vehicle, unlike other dangerous situations of the type described above, the operator/driver is in a fixed position and is not required to wear face protection.
According to the present invention, this is utilised by providing a camera for monitoring the driver, an image processor for monitoring a characteristic of the driver's physiological state as an indication of the driver's level of fatigue, and means for alerting the driver when said level exceeds a predetermined value associated with said characteristics. The relevant level of fatigue can be determined by parameters such as frequency of blink rate, the percentage of the eye area occluded by the eyelids, eye-rolling frequency, etc. An image-processing unit is provided, to determine that physiological signs of fatigue are being exhibited by the individual being monitored. A warning or alert can be given. For example, an alarm bell could operate or a visual signal could be achieved.
A system according to the invention may comprise a camera, camera lens, image-processing electronics and image-tracking systems so that, for example, the face of the subject can be kept in the field of view of the camera continually. Nothing needs to be attached to the individual's body, unlike a device recording brainwave activity or galvanic skin response. The system relies on collecting "visual" data by a non-invasive method and can operate in darkness and view through glass by using a polariser on the lens.
The components of the novel system can be fitted into a small box, and so are readily portable and easily fitted to a number of sites. The system can therefore be concealed, if this is needed.
In use, the device needs to have its "target" assigned. When this is done, the equipment monitors the target, e.g. the head and notes the changes in it.
Examples can be blinking, nodding, etc. The rate and magnitude of these changes can be measured and, if the measured value passes a certain level, then a warning system can be activated.
To detect when a driver has fallen asleep, image processing can detect whether the facial area is no longer fully visible or, in a higher resolution system, whether the eyes are closed. If the eyes remain shut over a period of time, it is a fair indication that the driver has fallen asleep.
Alternatively or in addition, the facial area may be monitored. If it is obscured from view for any long period of time, this can be taken as a reliable indication that the head has slumped onto the chest or slipped back against the headrest, indicating that the driver has fallen asleep.
This would then give a positive test result, causing the alarm system to be activated.
Image processing can detect differences in contrast and difference in brightness, and can these can be exploited both for: 1. detecting whites of eyes as opposed to eyelids, and 2. detecting the face being directed towards the windscreen as opposed to the top of the head or underneath of the chin, both which have different reflectivities and brightnesses of image.
More sophisticated techniques can be used to detect fatigue, but the above technique would reliably indicate when a driver's head had dropped to a level which was unusual when driving, indicating sleep. The processing system can be modified, as required, to prevent false alarms when the driver is looking over the shoulder.
By way of example, the processing system may be programmed to give an alert, for a period of eyes being completely closed lasting more than 3 seconds. When first entering the vehicle, the driver would activate the system and hold the head steady until the device had calibrated itself to deal with the relative contrasts between the face and hair. This can be updated as time goes on throughout the day, to allow for slow changes in lighting conditions.
At night, the face could be illuminated with an array of infra-red diodes, so preventing distraction to the driver, and enabling this difference in contrast to be measured even when no visible light is present.

Claims (6)

1. A vehicle comprising a camera for monitoring the driver, an image processor for monitoring a characteristic of the driver's physiological state as an indication of the driver's level of fatigue, and means for alerting the driver when said level exceeds a predetermined value associated with said characteristics.
2. A vehicle according to claim 1, wherein the characteristic is the frequency of eye blinking.
3. A vehicle according to claim 1, wherein the characteristic is eye-rolling.
4. A vehicle according to claim 1, wherein the processor monitors the fraction of an eye covered by eye-lids.
5. A vehicle according to claim 1, wherein the characteristic is the head nodding either forwards or backwards, out of position.
6. A vehicle according to claim 1, wherein the characteristic is the eyes' closing.
GB9423501A 1993-11-22 1994-11-21 Vehicle safety device to warn driver of fatigue Withdrawn GB2284582A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB939323970A GB9323970D0 (en) 1993-11-22 1993-11-22 Safety device

Publications (2)

Publication Number Publication Date
GB9423501D0 GB9423501D0 (en) 1995-01-11
GB2284582A true GB2284582A (en) 1995-06-14

Family

ID=10745496

Family Applications (2)

Application Number Title Priority Date Filing Date
GB939323970A Pending GB9323970D0 (en) 1993-11-22 1993-11-22 Safety device
GB9423501A Withdrawn GB2284582A (en) 1993-11-22 1994-11-21 Vehicle safety device to warn driver of fatigue

Family Applications Before (1)

Application Number Title Priority Date Filing Date
GB939323970A Pending GB9323970D0 (en) 1993-11-22 1993-11-22 Safety device

Country Status (1)

Country Link
GB (2) GB9323970D0 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6049747A (en) * 1996-06-12 2000-04-11 Yazaki Corporation Driver monitoring device
WO2000044580A1 (en) * 1999-01-27 2000-08-03 Compumedics Sleep Pty. Ltd. Vigilance monitoring system
GB2371396A (en) * 2000-10-04 2002-07-24 John William Thomas Harris Driver drowsiness monitor and recognition system
WO2002080127A1 (en) * 2001-03-30 2002-10-10 Koninklijke Philips Electronics N.V. System for monitoring a driver's attention to driving
WO2003012758A1 (en) * 2001-07-30 2003-02-13 Sankaran Manoj A device for detecting sleep
EP1284432A1 (en) * 2001-08-14 2003-02-19 Ford Global Technologies, Inc., A subsidiary of Ford Motor Company Device and process for operating a driver assistance system
WO2005052878A1 (en) * 2003-11-30 2005-06-09 Volvo Technology Corporation Method and system for recognizing driver impairment
ES2259527A1 (en) * 2004-11-24 2006-10-01 Universidad De Alcala MULTINSENSORIAL SYSTEM FOR MONITORING THE STATUS OF ALERT OF THE DRIVER OF A VEHICLE.
SG143034A1 (en) * 2001-11-08 2008-06-27 Sleep Diagnostics Pty Ltd Alertness monitor
USRE42471E1 (en) 1996-08-19 2011-06-21 Torch William C System and method for monitoring eye movement
CN103318023A (en) * 2013-06-21 2013-09-25 同济大学 Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device
CN103886288A (en) * 2014-03-13 2014-06-25 惠州Tcl移动通信有限公司 Sleepy state detecting method and system
US8885877B2 (en) 2011-05-20 2014-11-11 Eyefluence, Inc. Systems and methods for identifying gaze tracking scene reference locations
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8911087B2 (en) 2011-05-20 2014-12-16 Eyefluence, Inc. Systems and methods for measuring reactions of head, eyes, eyelids and pupils
WO2014204567A1 (en) * 2013-06-19 2014-12-24 Raytheon Company Imaging-based monitoring of stress and fatigue
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US10039445B1 (en) 2004-04-01 2018-08-07 Google Llc Biosensors, communicators, and controllers monitoring eye movement and methods for using them
CN110910610A (en) * 2019-11-22 2020-03-24 辽宁工程技术大学 A Fatigue Driving Warning System Based on DSP
EP3142902B1 (en) * 2014-05-16 2021-02-10 Ricoh Company, Ltd. Display device and vehicle

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4144531A (en) * 1976-10-12 1979-03-13 Anbergen Henricus J Drowsiness detecting apparatus
EP0284225A1 (en) * 1987-03-18 1988-09-28 Rasaat Apparatus for monitoring the eyes of an operator
WO1989007537A1 (en) * 1988-02-09 1989-08-24 Messerschmitt Boelkow Blohm Process and device for determining the fitness to drive of the driver of a vehicle
GB2215040A (en) * 1988-02-13 1989-09-13 William George David Ritchie A method and apparatus for monitoring the driver of a vehicle
US5218387A (en) * 1990-05-21 1993-06-08 Nissan Motor Co., Ltd. Eye position detecting apparatus
US5293427A (en) * 1990-12-14 1994-03-08 Nissan Motor Company, Ltd. Eye position detecting system and method therefor

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4144531A (en) * 1976-10-12 1979-03-13 Anbergen Henricus J Drowsiness detecting apparatus
EP0284225A1 (en) * 1987-03-18 1988-09-28 Rasaat Apparatus for monitoring the eyes of an operator
WO1989007537A1 (en) * 1988-02-09 1989-08-24 Messerschmitt Boelkow Blohm Process and device for determining the fitness to drive of the driver of a vehicle
GB2215040A (en) * 1988-02-13 1989-09-13 William George David Ritchie A method and apparatus for monitoring the driver of a vehicle
US5218387A (en) * 1990-05-21 1993-06-08 Nissan Motor Co., Ltd. Eye position detecting apparatus
US5293427A (en) * 1990-12-14 1994-03-08 Nissan Motor Company, Ltd. Eye position detecting system and method therefor

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6049747A (en) * 1996-06-12 2000-04-11 Yazaki Corporation Driver monitoring device
USRE42471E1 (en) 1996-08-19 2011-06-21 Torch William C System and method for monitoring eye movement
WO2000044580A1 (en) * 1999-01-27 2000-08-03 Compumedics Sleep Pty. Ltd. Vigilance monitoring system
US8096946B2 (en) 1999-01-27 2012-01-17 Compumedics Limited Vigilance monitoring system
US6575902B1 (en) 1999-01-27 2003-06-10 Compumedics Limited Vigilance monitoring system
GB2371396A (en) * 2000-10-04 2002-07-24 John William Thomas Harris Driver drowsiness monitor and recognition system
WO2002080127A1 (en) * 2001-03-30 2002-10-10 Koninklijke Philips Electronics N.V. System for monitoring a driver's attention to driving
WO2003012758A1 (en) * 2001-07-30 2003-02-13 Sankaran Manoj A device for detecting sleep
EP1284432A1 (en) * 2001-08-14 2003-02-19 Ford Global Technologies, Inc., A subsidiary of Ford Motor Company Device and process for operating a driver assistance system
SG143034A1 (en) * 2001-11-08 2008-06-27 Sleep Diagnostics Pty Ltd Alertness monitor
US7463157B2 (en) 2003-11-30 2008-12-09 Volvo Technology Corp. Method and system for recognizing driver impairment
WO2005052878A1 (en) * 2003-11-30 2005-06-09 Volvo Technology Corporation Method and system for recognizing driver impairment
US10039445B1 (en) 2004-04-01 2018-08-07 Google Llc Biosensors, communicators, and controllers monitoring eye movement and methods for using them
ES2259527A1 (en) * 2004-11-24 2006-10-01 Universidad De Alcala MULTINSENSORIAL SYSTEM FOR MONITORING THE STATUS OF ALERT OF THE DRIVER OF A VEHICLE.
ES2259527B1 (en) * 2004-11-24 2007-06-01 Universidad De Alcala MULTINSENSORIAL SYSTEM FOR MONITORING THE STATUS OF ALERT OF THE DRIVER OF A VEHICLE.
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8911087B2 (en) 2011-05-20 2014-12-16 Eyefluence, Inc. Systems and methods for measuring reactions of head, eyes, eyelids and pupils
US8885877B2 (en) 2011-05-20 2014-11-11 Eyefluence, Inc. Systems and methods for identifying gaze tracking scene reference locations
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
WO2014204567A1 (en) * 2013-06-19 2014-12-24 Raytheon Company Imaging-based monitoring of stress and fatigue
US20140375785A1 (en) * 2013-06-19 2014-12-25 Raytheon Company Imaging-based monitoring of stress and fatigue
JP2016524939A (en) * 2013-06-19 2016-08-22 レイセオン カンパニー Image-based monitoring of stress and fatigue
CN103318023B (en) * 2013-06-21 2015-10-28 同济大学 Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device
CN103318023A (en) * 2013-06-21 2013-09-25 同济大学 Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device
CN103886288A (en) * 2014-03-13 2014-06-25 惠州Tcl移动通信有限公司 Sleepy state detecting method and system
CN103886288B (en) * 2014-03-13 2017-08-08 惠州Tcl移动通信有限公司 A kind of sleepy detection method and its system
EP3142902B1 (en) * 2014-05-16 2021-02-10 Ricoh Company, Ltd. Display device and vehicle
CN110910610A (en) * 2019-11-22 2020-03-24 辽宁工程技术大学 A Fatigue Driving Warning System Based on DSP

Also Published As

Publication number Publication date
GB9323970D0 (en) 1994-01-12
GB9423501D0 (en) 1995-01-11

Similar Documents

Publication Publication Date Title
GB2284582A (en) Vehicle safety device to warn driver of fatigue
US7202793B2 (en) Apparatus and method of monitoring a subject and providing feedback thereto
KR100905167B1 (en) Warning monitor
US8314707B2 (en) Eye closure detection using structured illumination
CN105144199B (en) Imaging device-based occupant monitoring system supporting multiple functions
US8552850B2 (en) Near-to-eye tracking for adaptive operation
US8063786B2 (en) Method of detecting drowsiness of a vehicle operator
Dong et al. Driver inattention monitoring system for intelligent vehicles: A review
US10023199B2 (en) Method and device for ascertaining a state of drowsiness of a driver
WO2015175435A1 (en) Driver health and fatigue monitoring system and method
Anjali et al. Real-time nonintrusive monitoring and detection of eye blinking in view of accident prevention due to drowsiness
Arunasalam et al. Real-time drowsiness detection system for driver monitoring
CN104376684A (en) Monitoring system capable of preventing fatigue driving
Kumari et al. A survey on drowsy driver detection system
Chatterjee et al. Driving fitness detection: A holistic approach for prevention of drowsy and drunk driving using computer vision techniques
Bhaskar EyeAwake: A cost effective drowsy driver alert and vehicle correction system
CN112438728A (en) Safe driving detection device and detection method
Rizwan et al. Development of an efficient system for vehicle accident warning
CN108492528A (en) A kind of real-time driving fatigue monitoring system and vehicle
KR20100120633A (en) An ir sensor equipped glasses
US11587335B2 (en) Method for influencing systems for monitoring alertness
Bhargava et al. Drowsiness detection while driving using eye tracking
Budiyanto et al. Eye Detection System Based on Image Processing for Vehicle Safety
Ibrahim et al. The Application of Driving Fatigue Detection and Monitoring Technologies in Transportation Sector: A Review
KR960013874A (en) Driver's drowsiness prevention system

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)