EP3316231B1 - Alarmauslösungskorrelation zwischen kopfmontierten bilddaten und externer vorrichtung - Google Patents
Alarmauslösungskorrelation zwischen kopfmontierten bilddaten und externer vorrichtung Download PDFInfo
- Publication number
- EP3316231B1 EP3316231B1 EP17205375.3A EP17205375A EP3316231B1 EP 3316231 B1 EP3316231 B1 EP 3316231B1 EP 17205375 A EP17205375 A EP 17205375A EP 3316231 B1 EP3316231 B1 EP 3316231B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- driver
- vehicle
- optionally
- image data
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims description 3
- 238000000034 method Methods 0.000 claims description 31
- 238000012545 processing Methods 0.000 claims description 21
- 230000004886 head movement Effects 0.000 claims description 4
- 210000003128 head Anatomy 0.000 description 37
- 238000001514 detection method Methods 0.000 description 22
- 230000033001 locomotion Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 13
- 238000004590 computer program Methods 0.000 description 9
- 238000003860 storage Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000007246 mechanism Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000003909 pattern recognition Methods 0.000 description 3
- 210000001747 pupil Anatomy 0.000 description 3
- 208000012661 Dyskinesia Diseases 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000007619 statistical method Methods 0.000 description 2
- 206010041349 Somnolence Diseases 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000036626 alertness Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000003449 preventive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60C—VEHICLE TYRES; TYRE INFLATION; TYRE CHANGING; CONNECTING VALVES TO INFLATABLE ELASTIC BODIES IN GENERAL; DEVICES OR ARRANGEMENTS RELATED TO TYRES
- B60C9/00—Reinforcements or ply arrangement of pneumatic tyres
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
- B60K28/066—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/22—Psychological state; Stress level or workload
Claims (2)
- Verfahren zum Warnen eines Fahrers (206) eines Fahrzeugs, umfassend:Empfangen eines ersten Satzes von Bilddaten, die eine Perspektive des Fahrers abbilden, wobei der erste Satz von Bilddaten von einem ersten Bilderfassungsmodul (214) erfasst wird, das mit einer primären Vorrichtung (202) gekoppelt ist, die am Fahrer angeordnet ist, und die es dem ersten Bilderfassungsmodul ermöglicht, Bilder aus der Perspektive des Fahrers aufzunehmen;Empfangen eines zweiten Satzes von Bilddaten, wobei der zweite Satz von Bilddaten von einer zweiten Erfassungsvorrichtung (216) erfasst wird, die an einem Fahrzeug, das von dem Fahrer gefahren wird, montiert ist und auf eine Bewegungsrichtung des Fahrzeugs ausgerichtet ist;Verarbeiten des ersten und des zweiten Satzes von Bilddaten, um ein Vergleichsergebnis zu ermitteln, wobei das Vergleichsergebnis gemäß der Bildähnlichkeit zwischen dem ersten und dem zweiten Satz von Bilddaten ermittelt wird;Erzeugen einer Warnung gemäß dem Vergleichsergebnis; undautomatisches Darstellen der Warnung für den Fahrer (206).
- System zum Warnen eines Fahrers (206) eines Fahrzeugs, umfassend:eine tragbare Halterung, die so konfiguriert ist, dass sie an einem Kopf des Fahrers (206) zum Messen von Kopfbewegungen des Fahrers (206) angebracht werden kann;ein erstes Bilderfassungsmodul, das mit der tragbaren Halterung gekoppelt ist, wobei das erste Bilderfassungsmodul darauf ausgerichtet ist, dass es Bilder aus einer Fahrerperspektive des Fahrers (206) erfasst;eine zweite Erfassungsvorrichtung, die mit dem Fahrzeug gekoppelt ist und auf eine Bewegungsrichtung des Fahrzeugs ausgerichtet ist; undeinen Prozessor, der so konfiguriert ist, dass er Code-Anweisungen ausführt, die Folgendes umfassen:Code-Anweisungen zum Empfangen eines ersten Satzes von Bilddaten, der von dem ersten Bilderfassungsmodul erfasst wird;Code-Anweisungen zum Empfangen eines zweiten Satzes von Bilddaten, der von der zweiten Erfassungsvorrichtung erfasst wird;Code-Anweisungen zum Verarbeiten des ersten und des zweiten Satzes von Bilddaten, um ein Vergleichsergebnis zu ermitteln, wobei das Vergleichsergebnis gemäß einer Bildähnlichkeit zwischen dem ersten und dem zweiten Satz von Bilddaten ermittelt wird;Code-Anweisungen zum Erzeugen einer Warnung gemäß dem Vergleichsergebnis; undCode-Anweisungen zum automatischen Darstellen der Warnung für den Fahrer (206).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201461923877P | 2014-01-06 | 2014-01-06 | |
EP14200139.5A EP2892036B1 (de) | 2014-01-06 | 2014-12-23 | Alarmauslösungskorrelation zwischen kopfmontierten Bilddaten und externer Vorrichtung |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14200139.5A Division EP2892036B1 (de) | 2014-01-06 | 2014-12-23 | Alarmauslösungskorrelation zwischen kopfmontierten Bilddaten und externer Vorrichtung |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3316231A1 EP3316231A1 (de) | 2018-05-02 |
EP3316231B1 true EP3316231B1 (de) | 2021-11-10 |
Family
ID=52347116
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17205375.3A Active EP3316231B1 (de) | 2014-01-06 | 2014-12-23 | Alarmauslösungskorrelation zwischen kopfmontierten bilddaten und externer vorrichtung |
EP14200139.5A Active EP2892036B1 (de) | 2014-01-06 | 2014-12-23 | Alarmauslösungskorrelation zwischen kopfmontierten Bilddaten und externer Vorrichtung |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14200139.5A Active EP2892036B1 (de) | 2014-01-06 | 2014-12-23 | Alarmauslösungskorrelation zwischen kopfmontierten Bilddaten und externer Vorrichtung |
Country Status (2)
Country | Link |
---|---|
US (2) | US9818283B2 (de) |
EP (2) | EP3316231B1 (de) |
Families Citing this family (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104756173B (zh) * | 2012-09-17 | 2018-02-06 | 沃尔沃拉斯特瓦格纳公司 | 用于将基于背景的指导消息提供给汽车驾驶员的方法 |
US10115164B1 (en) * | 2013-10-04 | 2018-10-30 | State Farm Mutual Automobile Insurance Company | Systems and methods to quantify and differentiate individual insurance risk based on actual driving behavior and driving environment |
US20150309562A1 (en) * | 2014-04-25 | 2015-10-29 | Osterhout Group, Inc. | In-vehicle use in head worn computing |
US9189692B2 (en) | 2014-02-14 | 2015-11-17 | GM Global Technology Operations LLC | Methods and systems for detecting driver attention to objects |
US20160187651A1 (en) * | 2014-03-28 | 2016-06-30 | Osterhout Group, Inc. | Safety for a vehicle operator with an hmd |
DE102014213422A1 (de) * | 2014-07-10 | 2016-01-14 | Robert Bosch Gmbh | Verfahren und Vorrichtung zur Vermeidung eines Tunnelblicks |
US9767373B2 (en) * | 2014-09-05 | 2017-09-19 | Ford Global Technologies, Llc | Head-mounted display head pose and activity estimation |
KR101867915B1 (ko) * | 2015-01-16 | 2018-07-19 | 현대자동차주식회사 | 차량에서 웨어러블 기기를 이용한 기능 실행 방법 및 이를 수행하는 차량 |
US9811993B2 (en) * | 2015-04-23 | 2017-11-07 | Wichita State University | Vehicle operator impairment detection system and method |
WO2017042608A2 (en) * | 2015-09-08 | 2017-03-16 | Continental Automotive Gmbh | An improved vehicle message display device |
CN105894734A (zh) * | 2015-10-19 | 2016-08-24 | 乐卡汽车智能科技(北京)有限公司 | 用于交通工具的疲劳驾驶预警方法及系统 |
CN105405252B (zh) * | 2015-11-20 | 2018-08-24 | 广州视源电子科技股份有限公司 | 一种驾驶状态检测方法及装置 |
DE102016208405A1 (de) * | 2015-12-16 | 2017-06-22 | Robert Bosch Gmbh | Verfahren und Vorrichtung zum Betreiben eines Fahrerassistenzsystems, Fahrerassistenzsystem |
US10460600B2 (en) * | 2016-01-11 | 2019-10-29 | NetraDyne, Inc. | Driver behavior monitoring |
JP6358270B2 (ja) * | 2016-01-14 | 2018-07-18 | マツダ株式会社 | 運転支援装置 |
WO2017138940A1 (en) * | 2016-02-11 | 2017-08-17 | Ford Global Technologies, Llc | Spatial clustering of personal devices in vehicles |
US20170345274A1 (en) * | 2016-05-27 | 2017-11-30 | General Scientific Corporation | Neck posture recording and warning device |
US20180031849A1 (en) * | 2016-07-29 | 2018-02-01 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | Augmented reality head-up display road correction |
US11322018B2 (en) | 2016-07-31 | 2022-05-03 | NetraDyne, Inc. | Determining causation of traffic events and encouraging good driving behavior |
WO2018034651A1 (en) * | 2016-08-16 | 2018-02-22 | Ford Global Technologies, Llc | Methods and apparatus to present anticipated vehicle maneuvers to a passenger |
US10140690B2 (en) * | 2017-02-03 | 2018-11-27 | Harman International Industries, Incorporated | System and method for image presentation by a vehicle driver assist module |
AU2018225666B2 (en) * | 2017-02-23 | 2024-03-14 | Modular Mining Systems, Inc. | Vehicle slide detection |
US11117515B2 (en) * | 2017-05-19 | 2021-09-14 | Yazaki Corporation | Monitoring system |
US10268903B2 (en) * | 2017-06-11 | 2019-04-23 | Jungo Connectivity Ltd. | Method and system for automatic calibration of an operator monitor |
WO2019068042A1 (en) | 2017-09-29 | 2019-04-04 | Netradyne Inc. | MULTIPLE EXPOSURE EVENT DETERMINATION |
EP3695666B1 (de) | 2017-10-12 | 2023-11-29 | Netradyne, Inc. | Detektion von fahraktionen zur verringerung des risikos |
JP7069725B2 (ja) * | 2018-01-04 | 2022-05-18 | 富士通株式会社 | 不審者検出装置、不審者検出方法及び不審者検出用コンピュータプログラム |
US11017249B2 (en) | 2018-01-29 | 2021-05-25 | Futurewei Technologies, Inc. | Primary preview region and gaze based driver distraction detection |
US10528832B2 (en) * | 2018-04-17 | 2020-01-07 | GM Global Technology Operations LLC | Methods and systems for processing driver attention data |
CN109725714B (zh) * | 2018-11-14 | 2022-06-14 | 北京七鑫易维信息技术有限公司 | 视线确定方法、装置、系统、以及头戴式眼动设备 |
JP6852045B2 (ja) * | 2018-12-28 | 2021-03-31 | Kddi株式会社 | 電子機器、制御方法及びプログラム |
CN113994403B (zh) * | 2019-03-13 | 2023-12-29 | 联邦快递公司 | 缓解飞行器的操作风险 |
FR3119145B1 (fr) * | 2021-01-22 | 2023-10-27 | Renault Sas | Procédé de détermination d’un niveau de distraction d’un conducteur de véhicule |
JP7447853B2 (ja) * | 2021-03-22 | 2024-03-12 | トヨタ自動車株式会社 | 覚醒状態判定システム及び自動運転装置 |
CN113173168A (zh) * | 2021-04-30 | 2021-07-27 | 重庆工程职业技术学院 | 车辆智能驾驶控制系统及方法 |
US20230080085A1 (en) * | 2021-09-10 | 2023-03-16 | Aptiv Technologies Limited | Driver vision assistance systems and methods |
Family Cites Families (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6272431B1 (en) * | 1997-04-29 | 2001-08-07 | Thomas Zamojdo | Method for displaying a map in a vehicle en-route guidance system |
DE19734307C2 (de) | 1997-08-08 | 1999-06-10 | Bosch Gmbh Robert | Verfahren und Vorrichtung zur Überwachung und/oder Beeinflussung des Fahrzeugverhaltens eines fahrergesteuerten Kraftfahrzeugs |
JP2003240574A (ja) * | 2002-02-14 | 2003-08-27 | Mitsubishi Electric Corp | ナビゲーション装置及びナビゲーション方法 |
US6559770B1 (en) * | 2002-03-02 | 2003-05-06 | Edward George Zoerb | Eyelash activated drowsy alarm |
US6906619B2 (en) * | 2003-02-27 | 2005-06-14 | Motorola, Inc. | Visual attention influenced condition indicia apparatus and method |
AU2003296243A1 (en) * | 2003-11-30 | 2005-06-17 | Volvo Technology Corporation | Method and system for recognizing driver impairment |
US7301465B2 (en) * | 2005-03-24 | 2007-11-27 | Tengshe Vishwas V | Drowsy driving alarm system |
US20060271286A1 (en) * | 2005-05-27 | 2006-11-30 | Outland Research, Llc | Image-enhanced vehicle navigation systems and methods |
DE102005045017A1 (de) * | 2005-09-21 | 2007-03-22 | Robert Bosch Gmbh | Verfahren und Fahrerassistenzsystem zur sensorbasierten Anfahrtsteuerung eines Kraftfahrzeugs |
NL1030943C2 (nl) * | 2006-01-18 | 2007-07-19 | Tomtom Int Bv | Werkwijze voor het opslaan van de positie van een geparkeerd voertuig en navigatieapparaat dat daarvoor is ingericht. |
US7970534B2 (en) * | 2006-08-24 | 2011-06-28 | Blackbird Technologies, Inc. | Mobile unit and system having integrated mapping, communications and tracking |
GB2446616B (en) | 2006-12-06 | 2011-12-07 | Sony Uk Ltd | Motion adaptive image processing |
US7792328B2 (en) * | 2007-01-12 | 2010-09-07 | International Business Machines Corporation | Warning a vehicle operator of unsafe operation behavior based on a 3D captured image stream |
US8022831B1 (en) * | 2008-01-03 | 2011-09-20 | Pamela Wood-Eyre | Interactive fatigue management system and method |
JP5499277B2 (ja) | 2008-01-22 | 2014-05-21 | 株式会社国際電気通信基礎技術研究所 | 危険運転予防意識判定システムおよび危険運転予防意識判定方法 |
JP5354514B2 (ja) * | 2008-03-31 | 2013-11-27 | 現代自動車株式会社 | 脇見運転検出警報システム |
US8907887B2 (en) * | 2008-05-19 | 2014-12-09 | Honeywell International Inc. | Methods and systems for operating avionic systems based on user gestures |
DE102009005730A1 (de) | 2009-01-22 | 2010-07-29 | Hella Kgaa Hueck & Co. | Verfahren und Vorrichtung zur Überwachung der Aufmerksamkeit eines Fahrzeugführers |
KR101276871B1 (ko) * | 2009-12-14 | 2013-06-18 | 안동대학교 산학협력단 | 차량 충돌 방지 장치 및 방법 |
US8384534B2 (en) * | 2010-01-14 | 2013-02-26 | Toyota Motor Engineering & Manufacturing North America, Inc. | Combining driver and environment sensing for vehicular safety systems |
US20130278631A1 (en) * | 2010-02-28 | 2013-10-24 | Osterhout Group, Inc. | 3d positioning of augmented reality information |
US8184983B1 (en) * | 2010-11-12 | 2012-05-22 | Google Inc. | Wireless directional identification and subsequent communication between wearable electronic devices |
WO2012150591A2 (en) * | 2011-05-03 | 2012-11-08 | Alon Atsmon | Automatic content analysis method and system |
US8612137B2 (en) * | 2011-07-18 | 2013-12-17 | Ituran Usa | System, method and apparatus for tracking parking behavior of a vehicle |
JP6026088B2 (ja) * | 2011-08-09 | 2016-11-16 | 株式会社トプコン | 遠隔操作システム |
US8538402B2 (en) * | 2012-02-12 | 2013-09-17 | Joel Vidal | Phone that prevents texting while driving |
US9426447B2 (en) * | 2012-10-09 | 2016-08-23 | Electronics And Telecommunications Research Institute | Apparatus and method for eye tracking |
US9007198B2 (en) * | 2012-11-02 | 2015-04-14 | Toyota Motor Engineering & Manufacturing North America, Inc. | Adaptive Actuator interface for active driver warning |
US8972178B2 (en) * | 2012-11-30 | 2015-03-03 | Chrysler Group Llc | Method of using a computing device to identify an occupied parking spot |
US8847771B2 (en) * | 2013-01-25 | 2014-09-30 | Toyota Motor Engineering & Manufacturing North America, Inc. | Method and apparatus for early detection of dynamic attentive states for providing an inattentive warning |
US20140272811A1 (en) * | 2013-03-13 | 2014-09-18 | Mighty Carma, Inc. | System and method for providing driving and vehicle related assistance to a driver |
DE102013206739A1 (de) * | 2013-04-16 | 2014-10-16 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zur Bestimmung, ob ein Insasse eines Fahrzeugs relevante Objekte im Umfeld des Fahrzeugs bemerkt |
US10380799B2 (en) * | 2013-07-31 | 2019-08-13 | Splunk Inc. | Dockable billboards for labeling objects in a display having a three-dimensional perspective of a virtual or real environment |
KR102094965B1 (ko) * | 2013-12-30 | 2020-03-31 | 삼성디스플레이 주식회사 | 각성 안경, 차량용 미러 유닛 및 표시장치 |
-
2014
- 2014-12-23 EP EP17205375.3A patent/EP3316231B1/de active Active
- 2014-12-23 EP EP14200139.5A patent/EP2892036B1/de active Active
-
2015
- 2015-01-05 US US14/589,914 patent/US9818283B2/en active Active
-
2017
- 2017-11-09 US US15/808,782 patent/US10217343B2/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
US10217343B2 (en) | 2019-02-26 |
EP3316231A1 (de) | 2018-05-02 |
EP2892036B1 (de) | 2017-12-06 |
US20150194035A1 (en) | 2015-07-09 |
US20180075727A1 (en) | 2018-03-15 |
US9818283B2 (en) | 2017-11-14 |
EP2892036A1 (de) | 2015-07-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3316231B1 (de) | Alarmauslösungskorrelation zwischen kopfmontierten bilddaten und externer vorrichtung | |
US11661075B2 (en) | Inward/outward vehicle monitoring for remote reporting and in-cab warning enhancements | |
US10848913B2 (en) | Method for smartphone-based accident detection | |
CN112389448B (zh) | 一种基于车辆状态和驾驶员状态的异常驾驶行为识别方法 | |
KR102051142B1 (ko) | 차량용 운전자 위험 지수 관리 시스템 및 그 방법 | |
CN102712317B (zh) | 使驾驶员与环境感测结合的车辆安全性系统 | |
JP5179686B2 (ja) | 運転行動危険度演算装置 | |
KR20200113202A (ko) | 정보 처리 장치, 이동 장치, 및 방법, 그리고 프로그램 | |
JPH08178712A (ja) | 漫然運転検出装置 | |
JP2016028318A (ja) | 乗り物の自動緊急応答システムのためのコンピュータ記憶媒体及び方法 | |
JP2004259069A (ja) | 車両危険度に応じた警報信号を出力する警報装置 | |
US20240000354A1 (en) | Driving characteristic determination device, driving characteristic determination method, and recording medium | |
Smirnov et al. | Smartphone-based identification of dangerous driving situations: Algorithms and implementation | |
US11608070B2 (en) | System and method for monitoring driver | |
JP7376996B2 (ja) | 車両の危険状況判別装置、車両の危険状況判別方法、及びプログラム | |
Kashevnik et al. | Context-based driver support system development: Methodology and case study | |
JP7298351B2 (ja) | 状態判定装置、車載機、運転評価システム、状態判定方法、及びプログラム | |
RU2703341C1 (ru) | Способ определения опасных состояний на дорогах общего пользования на основе мониторинга ситуации в кабине транспортного средства | |
CN112261581A (zh) | 基于 gis 地图和多种定位的旅游大巴监管系统 | |
WO2021024495A1 (ja) | 運転中インシデント通知システム、方法及びプログラム | |
JP2023147200A (ja) | 危険通知方法及び実装するためのシステム | |
JP2013120573A (ja) | 車両用歩行者検出装置及び車両用危険報知装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20171205 |
|
AC | Divisional application: reference to earlier application |
Ref document number: 2892036 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: IONROAD TECHNOLOGIES, LIMITED |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20200508 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20210625 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AC | Divisional application: reference to earlier application |
Ref document number: 2892036 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1446795 Country of ref document: AT Kind code of ref document: T Effective date: 20211115 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014081250 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20211110 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1446795 Country of ref document: AT Kind code of ref document: T Effective date: 20211110 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220210 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220310 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220310 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220210 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220211 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014081250 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20211231 |
|
26N | No opposition filed |
Effective date: 20220811 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20220210 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211223 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211223 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220110 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220210 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20141223 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230527 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20231121 Year of fee payment: 10 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211110 |