WO2003049967A1 - Verfahren und vorrichtung zur erkennung des schläfrigkeitszustandes von führern bewegter objekte - Google Patents
Verfahren und vorrichtung zur erkennung des schläfrigkeitszustandes von führern bewegter objekte Download PDFInfo
- Publication number
- WO2003049967A1 WO2003049967A1 PCT/EP2002/014116 EP0214116W WO03049967A1 WO 2003049967 A1 WO2003049967 A1 WO 2003049967A1 EP 0214116 W EP0214116 W EP 0214116W WO 03049967 A1 WO03049967 A1 WO 03049967A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- sleepiness
- eyelid
- state
- drowsiness
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
- B60K28/066—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L3/00—Electric devices on electrically-propelled vehicles for safety purposes; Monitoring operating variables, e.g. speed, deceleration or energy consumption
- B60L3/02—Dead-man's devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2200/00—Type of vehicles
- B60L2200/26—Rail vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W2050/0001—Details of the control system
- B60W2050/0019—Control system elements or transfer functions
- B60W2050/0022—Gains, weighting coefficients or weighting functions
- B60W2050/0025—Transfer function weighting factor
Definitions
- the present invention relates to a method and a device for monitoring the sleepy state of
- Devices for the detection of the sleepy state are known from GB 2 145 262 A and US 5,402,109.
- the condition of the eyelid (opened or closed) is determined with the help of special glasses.
- the condition of the eyelid is determined with a video camera.
- DE 32 29 773 uses a sequence of optical pulses for the above-mentioned determination, which are reflected differently depending on the condition of the eyelid.
- the invention is based on the object of reliably recognizing the drowsiness of the driver of moving objects and avoiding accidents by subsequently taking suitable measures, such as waking the driver and / or influencing the movement behavior of the moving object.
- This object is achieved by the method according to claim 1 or by the device according to claim 6.
- Several measured variables such as eyelid frequency, yaw rate and state of facial muscle relaxation are determined and processed into a sum signal according to FIG. 1:
- Each comparator supplies a status signal (z) which can assume the logical values 0 (zero) or 1 (one).
- the eyelid duty cycle changes in the case of sleepiness ie the temporal relationship between closed and open eyelid.
- sleepiness ie the temporal relationship between closed and open eyelid.
- long phases with the lid open are interrupted by short phases with the lid closed.
- sleepiness increases, the phases lengthen with the eyelid closed.
- a yawning of the driver of moving objects, ie eyes closed completely or partially for a short time and mouth wide open, can be determined by optical recognition with an electronic camera and subsequent image processing, such as pattern recognition and comparison with stored images from an awake state.
- the facial muscle relaxation is performed, for example, with strain gauges applied to the facial skin or with the help of electronic image processing, such as Camera, pattern recognition and comparison with images from a waking state, determined.
- electronic image processing such as Camera
- a combination of the aforementioned signals e.g. Eyelid duty cycle and state of facial muscle relaxation form an independent measurement signal.
- the device according to the invention can be expanded as desired, so that further physiological measurement signals can be taken into account.
- the end status signal 8 can be used as a wake-up signal, an acoustic and / or optical alarm and / or a vibration alarm being used.
- this signal can be used for moderate influence on the movement behavior of the moving object when sleepiness is determined. Measures such as Separation between engine and gearbox (disengagement), engine shutdown and / or gentle braking. In the case of railways, this signal can be used directly to trigger the so-called dead man's brake.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Educational Technology (AREA)
- Biophysics (AREA)
- Power Engineering (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Sustainable Development (AREA)
- General Physics & Mathematics (AREA)
- Veterinary Medicine (AREA)
- Child & Adolescent Psychology (AREA)
- Developmental Disabilities (AREA)
- Public Health (AREA)
- Hospice & Palliative Care (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Sustainable Energy (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Traffic Control Systems (AREA)
- Auxiliary Drives, Propulsion Controls, And Safety Devices (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP02795166A EP1397268A1 (de) | 2001-12-12 | 2002-12-12 | Verfahren und vorrichtung zur erkennung des schläfrigkeitszustandes von führern bewegter objekte |
US10/498,659 US20050024212A1 (en) | 2001-12-12 | 2002-12-12 | Method and device for detecting the drowsiness state of drivers of moving objects |
JP2003551003A JP4024756B2 (ja) | 2001-12-12 | 2002-12-12 | 移動物体の運転者の居眠り状態を識別する方法と装置 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
LU90879A LU90879B1 (de) | 2001-12-12 | 2001-12-12 | Verfahren und Vorrichtung zur Erkennung des Schlaefrigkeitszustandes von Fuehrern bewegter Objekte |
LU90879 | 2001-12-12 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2003049967A1 true WO2003049967A1 (de) | 2003-06-19 |
WO2003049967B1 WO2003049967B1 (de) | 2003-09-18 |
Family
ID=19732030
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2002/014116 WO2003049967A1 (de) | 2001-12-12 | 2002-12-12 | Verfahren und vorrichtung zur erkennung des schläfrigkeitszustandes von führern bewegter objekte |
Country Status (5)
Country | Link |
---|---|
US (1) | US20050024212A1 (de) |
EP (1) | EP1397268A1 (de) |
JP (1) | JP4024756B2 (de) |
LU (1) | LU90879B1 (de) |
WO (1) | WO2003049967A1 (de) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1665188A1 (de) * | 2003-09-15 | 2006-06-07 | David Cohen | Notsituations-detektor |
DE102006050017A1 (de) * | 2006-10-24 | 2008-04-30 | Volkswagen Ag | Kraftfahrzeug mit einer Sensoranordnung zur Bestimmung eines Zustandes eines Fahrers des Kraftfahrzeuges |
JP2009018091A (ja) * | 2007-07-13 | 2009-01-29 | Toyota Motor Corp | 居眠り検知装置 |
JP4825132B2 (ja) * | 2003-11-26 | 2011-11-30 | ダイムラー・アクチェンゲゼルシャフト | 車両の運転者による不注意を識別する方法及びコンピュータプログラム |
EP2708793A1 (de) * | 2012-09-15 | 2014-03-19 | ABB Technology AG | Sicherheitseinrichtung für eine technische Anlage oder einen technischen Prozess |
KR20160100654A (ko) | 2015-02-16 | 2016-08-24 | 주식회사 바이브라시스템 | 동영상 기반 생리 신호를 이용한 졸음 검출 방법 및 장치 |
CN107038435A (zh) * | 2017-05-24 | 2017-08-11 | 成都跟驰科技有限公司 | 减轻操作时用户疲劳的红外感应装置 |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10370012B2 (en) | 2017-03-09 | 2019-08-06 | Ge Global Sourcing Llc | Adaptive vehicle control system |
US10457281B2 (en) | 2017-01-23 | 2019-10-29 | Ge Global Sourcing Llc | Vehicle communication system |
US7317615B2 (en) | 2005-05-23 | 2008-01-08 | Intel Corporation | Integrated circuit coolant microchannel assembly with manifold member that facilitates coolant line attachment |
US7423540B2 (en) | 2005-12-23 | 2008-09-09 | Delphi Technologies, Inc. | Method of detecting vehicle-operator state |
JP5292671B2 (ja) * | 2006-03-06 | 2013-09-18 | トヨタ自動車株式会社 | 覚醒度推定装置及びシステム並びに方法 |
US8045766B2 (en) * | 2007-02-16 | 2011-10-25 | Denso Corporation | Device, program, and method for determining sleepiness |
JP4743137B2 (ja) * | 2007-03-01 | 2011-08-10 | 株式会社豊田中央研究所 | 眠気判定装置及びプログラム |
JP4375420B2 (ja) * | 2007-03-26 | 2009-12-02 | 株式会社デンソー | 眠気警報装置、及びプログラム |
JP5343631B2 (ja) * | 2009-03-04 | 2013-11-13 | 日産自動車株式会社 | 運転支援装置 |
US8369608B2 (en) * | 2009-06-22 | 2013-02-05 | Toyota Motor Engineering & Manufacturing North America, Inc. | System and method for detecting drowsy facial expressions of vehicle drivers under changing illumination conditions |
CN102791556B (zh) * | 2010-03-11 | 2015-10-07 | 丰田自动车株式会社 | 生物体状态判定装置 |
US10279825B2 (en) | 2017-01-10 | 2019-05-07 | General Electric Company | Transfer of vehicle control system and method |
US11065958B2 (en) | 2017-01-03 | 2021-07-20 | Transportation Ip Holdings, Llc | Control system and method |
JP2018149941A (ja) * | 2017-03-14 | 2018-09-27 | オムロン株式会社 | 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム |
WO2020121425A1 (ja) * | 2018-12-12 | 2020-06-18 | 三菱電機株式会社 | 状態判定装置、状態判定方法、及び状態判定プログラム |
CN116115878A (zh) * | 2023-02-22 | 2023-05-16 | 王华虎 | 一种情景式营造犯困氛围的智能化快速催眠方法及装置 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6049747A (en) * | 1996-06-12 | 2000-04-11 | Yazaki Corporation | Driver monitoring device |
US6265978B1 (en) * | 1996-07-14 | 2001-07-24 | Atlas Researches, Ltd. | Method and apparatus for monitoring states of consciousness, drowsiness, distress, and performance |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6070098A (en) * | 1997-01-11 | 2000-05-30 | Circadian Technologies, Inc. | Method of and apparatus for evaluation and mitigation of microsleep events |
US5930751A (en) * | 1997-05-30 | 1999-07-27 | Lucent Technologies Inc. | Method of implicit confirmation for automatic speech recognition |
US6584439B1 (en) * | 1999-05-21 | 2003-06-24 | Winbond Electronics Corporation | Method and apparatus for controlling voice controlled devices |
US6415258B1 (en) * | 1999-10-06 | 2002-07-02 | Microsoft Corporation | Background audio recovery system |
US7027621B1 (en) * | 2001-03-15 | 2006-04-11 | Mikos, Ltd. | Method and apparatus for operator condition monitoring and assessment |
US6927694B1 (en) * | 2001-08-20 | 2005-08-09 | Research Foundation Of The University Of Central Florida | Algorithm for monitoring head/eye motion for driver alertness with one camera |
-
2001
- 2001-12-12 LU LU90879A patent/LU90879B1/de active
-
2002
- 2002-12-12 US US10/498,659 patent/US20050024212A1/en not_active Abandoned
- 2002-12-12 JP JP2003551003A patent/JP4024756B2/ja not_active Expired - Fee Related
- 2002-12-12 EP EP02795166A patent/EP1397268A1/de not_active Withdrawn
- 2002-12-12 WO PCT/EP2002/014116 patent/WO2003049967A1/de active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6049747A (en) * | 1996-06-12 | 2000-04-11 | Yazaki Corporation | Driver monitoring device |
US6265978B1 (en) * | 1996-07-14 | 2001-07-24 | Atlas Researches, Ltd. | Method and apparatus for monitoring states of consciousness, drowsiness, distress, and performance |
Non-Patent Citations (1)
Title |
---|
UENO H ET AL: "Development of drowsiness detection system", VEHICLE NAVIGATION AND INFORMATION SYSTEMS CONFERENCE, 1994. PROCEEDINGS., 1994 YOKOHAMA, JAPAN 31 AUG.-2 SEPT. 1994, NEW YORK, NY, USA,IEEE, PAGE(S) 15-20, ISBN: 0-7803-2105-7, XP010136606 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1665188A1 (de) * | 2003-09-15 | 2006-06-07 | David Cohen | Notsituations-detektor |
EP1665188A4 (de) * | 2003-09-15 | 2009-05-06 | David Cohen | Notsituations-detektor |
JP4825132B2 (ja) * | 2003-11-26 | 2011-11-30 | ダイムラー・アクチェンゲゼルシャフト | 車両の運転者による不注意を識別する方法及びコンピュータプログラム |
DE102006050017A1 (de) * | 2006-10-24 | 2008-04-30 | Volkswagen Ag | Kraftfahrzeug mit einer Sensoranordnung zur Bestimmung eines Zustandes eines Fahrers des Kraftfahrzeuges |
DE102006050017B4 (de) | 2006-10-24 | 2019-07-11 | Volkswagen Ag | Kraftfahrzeug mit einer Sensoranordnung zur Bestimmung eines Zustandes eines Fahrers des Kraftfahrzeuges |
JP2009018091A (ja) * | 2007-07-13 | 2009-01-29 | Toyota Motor Corp | 居眠り検知装置 |
EP2708793A1 (de) * | 2012-09-15 | 2014-03-19 | ABB Technology AG | Sicherheitseinrichtung für eine technische Anlage oder einen technischen Prozess |
US9311800B2 (en) | 2012-09-15 | 2016-04-12 | Abb Technology Ag | Safety device for a technical installation or a technical process |
KR20160100654A (ko) | 2015-02-16 | 2016-08-24 | 주식회사 바이브라시스템 | 동영상 기반 생리 신호를 이용한 졸음 검출 방법 및 장치 |
CN107038435A (zh) * | 2017-05-24 | 2017-08-11 | 成都跟驰科技有限公司 | 减轻操作时用户疲劳的红外感应装置 |
Also Published As
Publication number | Publication date |
---|---|
JP4024756B2 (ja) | 2007-12-19 |
WO2003049967B1 (de) | 2003-09-18 |
JP2005525142A (ja) | 2005-08-25 |
EP1397268A1 (de) | 2004-03-17 |
LU90879B1 (de) | 2003-06-13 |
US20050024212A1 (en) | 2005-02-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1397268A1 (de) | Verfahren und vorrichtung zur erkennung des schläfrigkeitszustandes von führern bewegter objekte | |
EP3248179B1 (de) | Verfahren und vorrichtung zum erkennen von sekundenschlaf eines fahrers eines fahrzeugs | |
DE602005001627T2 (de) | Vorrichtung zur Extraktion von Fussgängern | |
DE102014004395B3 (de) | Verfahren zum Betrieb eines Fahrerassistenzsystems und Kraftfahrzeug | |
DE102005039680A1 (de) | Vorrichtung zur Bestimmung der Schläfrigkeit sowie Verfahren hierfür | |
DE202015002316U1 (de) | Vorrichtung zur Detektion eines Sekundenschlafs | |
DE102008007149B4 (de) | Verfahren und Vorrichtung zum Erzeugen, Steuern und Auslösen eines Warnsignals in einem Kraftfahrzeug | |
CN107392153B (zh) | 人体疲劳度判定方法 | |
WO2017125211A1 (de) | Verfahren zur klassifikation von fahrerbewegungen | |
DE102015001686B4 (de) | Verfahren und Vorrichtung zur Erkennung einer Reaktionsfähigkeit eines Fahrers beim automatisierten Fahren | |
EP2423052B1 (de) | Vorrichtung und Verfahren zur Erkennung von Personen | |
CN109094458A (zh) | 车辆安全驾驶的控制方法及用于车辆安全驾驶的控制装置 | |
DE102011011221A1 (de) | Verfahren zur Erkennung der Aufmerksamkeit des Fahrers eines Kraftfahrzeugs | |
Chang et al. | Driver fatigue surveillance via eye detection | |
DE102014215461B4 (de) | Verfahren und Vorrichtung zum Betreiben eines Fahrzeugs, insbesondere Eisenbahnfahrzeugs | |
Lin et al. | An early warning system for predicting driver fatigue | |
Bin et al. | A fatigue driving detection method based on multi facial features fusion | |
DE102020206972A1 (de) | System zum Erkennen und Beeinflussen eines Schlaganfalls eines Fahrzeuginsassen | |
DE102018206237A1 (de) | Verfahren und Vorrichtung zur Müdigkeitserkennung einer Person | |
CN109145890A (zh) | 一种基于单模态生理信号的驾驶员心理应激强度智能识别的模型 | |
DE102013005882A1 (de) | Erkennen und Bestimmen der Position von teilverdeckten Objekten | |
WO2019238820A1 (de) | Verfahren zur beeinflussung von systemen zur aufmerksamkeitsüberwachung | |
DE102019215691A1 (de) | Verfahren und Vorrichtung zur Zustandserkennung eines Fahrzeuginsassen | |
JP7443283B2 (ja) | 覚醒度推定方法、覚醒度推定装置及び覚醒度推定プログラム | |
Ngasri et al. | Automated Stand-alone Video-based Microsleep Detection System by using EAR Technique |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): JP US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SI SK TR |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
B | Later publication of amended claims |
Free format text: 20030617 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2002795166 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2002795166 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2003551003 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10498659 Country of ref document: US |