TW202332608A - 用於增強協同駕駛監督的意識檢查器 - Google Patents

用於增強協同駕駛監督的意識檢查器 Download PDF

Info

Publication number
TW202332608A
TW202332608A TW111147620A TW111147620A TW202332608A TW 202332608 A TW202332608 A TW 202332608A TW 111147620 A TW111147620 A TW 111147620A TW 111147620 A TW111147620 A TW 111147620A TW 202332608 A TW202332608 A TW 202332608A
Authority
TW
Taiwan
Prior art keywords
driver
vehicle
awareness
state
attention
Prior art date
Application number
TW111147620A
Other languages
English (en)
Chinese (zh)
Inventor
夏賓 馬哈迪萬
瑞秋格雷 亞歷山大
史蒂芬 孔恩
Original Assignee
美商到達者軟體有限責任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美商到達者軟體有限責任公司 filed Critical 美商到達者軟體有限責任公司
Publication of TW202332608A publication Critical patent/TW202332608A/zh

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W40/09—Driving style or behaviour
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005—Handover processes
    • B60W60/0053—Handover processes from vehicle to occupant
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005—Handover processes
    • B60W60/0059—Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/408—Radar; Laser, e.g. lidar
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00—Input parameters relating to overall vehicle dynamics
    • B60W2520/10—Longitudinal speed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/225—Direction of gaze
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00—Input parameters relating to objects
    • B60W2554/20—Static objects
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00—Input parameters relating to objects
    • B60W2554/40—Dynamic objects, e.g. animals, windblown objects
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00—Input parameters relating to objects
    • B60W2554/80—Spatial relation or speed relative to objects
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20—Ambient conditions, e.g. wind or rain
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00—Input parameters relating to data
    • B60W2556/40—High definition maps
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00—Input parameters relating to data
    • B60W2556/45—External transmission of data to or from the vehicle
    • B60W2556/50—External transmission of data to or from the vehicle of positioning data, e.g. GPS [Global Positioning System] data

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)
  • Emergency Alarm Devices (AREA)
TW111147620A 2021-12-22 2022-12-12 用於增強協同駕駛監督的意識檢查器 TW202332608A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US17/559,733 US12600363B2 (en) 2021-12-22 2021-12-22 Awareness checker for enhancing collaborative driving supervision
US17/559,733 2021-12-22

Publications (1)

Publication Number Publication Date
TW202332608A true TW202332608A (zh) 2023-08-16

Family

ID=84981769

Family Applications (1)

Application Number Title Priority Date Filing Date
TW111147620A TW202332608A (zh) 2021-12-22 2022-12-12 用於增強協同駕駛監督的意識檢查器

Country Status (7)

Country Link
US (1) US12600363B2 (https=)
EP (1) EP4452720A1 (https=)
JP (1) JP2025500379A (https=)
KR (1) KR20240122452A (https=)
CN (1) CN118434612A (https=)
TW (1) TW202332608A (https=)
WO (1) WO2023122439A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI906705B (zh) * 2023-12-05 2025-12-01 優車智能股份有限公司 駕駛員介入引導系統及駕駛員介入引導方法

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4162336B1 (en) * 2020-06-09 2024-05-15 Volvo Autonomous Solutions AB Method and control unit for handling safe stop mode of a vehicle
US20240067110A1 (en) * 2022-08-31 2024-02-29 Qualcomm Incorporated Power management integrated circuit (pmic) power supply monitoring without external monitoring circuitry
EP4484242B1 (en) * 2023-06-27 2025-09-10 Volvo Car Corporation Method for preparing a human driver to take over control of a vehicle from an autonomous driving system, data processing apparatus, computer program, computer-readable storage medium, and vehicle
CN116691700A (zh) * 2023-07-26 2023-09-05 广汽本田汽车有限公司 自动驾驶车辆应急辅助接管方法、系统、装置及存储介质
US12365354B2 (en) * 2023-08-24 2025-07-22 GM Global Technology Operations LLC Driver attention detection
DE102024208567B3 (de) * 2024-09-10 2025-12-31 Volkswagen Aktiengesellschaft Verfahren zur Prüfung einer Aufmerksamkeit eines Insassen eines Fahrzeuges und Vorrichtung sowie Fahrzeug umfassend eine entsprechende Vorrichtung

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008056343B4 (de) * 2008-11-07 2024-07-25 Bayerische Motoren Werke Aktiengesellschaft Warnsystem für ein Kraftfahrzeug
DE102009041187A1 (de) * 2009-08-13 2011-02-17 Volkswagen Ag Verfahren und Vorrichtung zur Adaption von Parametern eines Fahrerassistenzsystems
JP2013242763A (ja) 2012-05-22 2013-12-05 Clarion Co Ltd 対話装置、対話システム、および対話制御方法
DE102012215397B4 (de) 2012-08-30 2025-10-23 Robert Bosch Gmbh Interaktive Aufmerksamkeitssteigerung
JP6213282B2 (ja) * 2014-02-12 2017-10-18 株式会社デンソー 運転支援装置
JP2016057814A (ja) * 2014-09-09 2016-04-21 セイコーエプソン株式会社 頭部装着型表示装置、頭部装着型表示装置の制御方法、情報システム、および、コンピュータープログラム
US10241509B1 (en) * 2014-11-13 2019-03-26 State Farm Mutual Automobile Insurance Company Autonomous vehicle control assessment and selection
DE102015013319B4 (de) 2015-10-14 2017-10-12 Audi Ag Verfahren zum Betrieb eines Kraftfahrzeuges, Kraftfahrzeug und Computerprogramm
JP7080598B2 (ja) * 2017-07-21 2022-06-06 ソニーセミコンダクタソリューションズ株式会社 車両制御装置および車両制御方法
US11188074B1 (en) * 2017-11-29 2021-11-30 United Services Automobile Association (Usaa) Systems and methods for remotely controlling operation of a vehicle
DE112019002145T5 (de) * 2018-04-26 2021-03-04 Sony Semiconductor Solutions Corporation Informationsverarbeitungsvorrichtung, mobile vorrichtung, informationsverarbeitungssystem, verfahren und programm
US10576994B1 (en) * 2018-08-22 2020-03-03 Nio Usa, Inc. Autonomous system operator cognitive state detection and alerting
US10647333B1 (en) * 2018-08-31 2020-05-12 Uatc, Llc Vehicle operator awareness system
WO2020054458A1 (ja) * 2018-09-13 2020-03-19 ソニーセミコンダクタソリューションズ株式会社 情報処理装置、移動装置、および方法、並びにプログラム
EP3910612A4 (en) 2019-01-08 2022-03-09 Sony Semiconductor Solutions Corporation INFORMATION PROCESSING DEVICE, MOBILE DEVICE, METHOD AND PROGRAM
US11345415B2 (en) * 2019-03-14 2022-05-31 lEE INTERNATIONAL ELECTRONICS & ENGINEERING S.A. Vehicle occupant detection
US11772671B2 (en) * 2019-06-03 2023-10-03 Toyota Research Institute, Inc. Systems and methods for predicting control handback
EP4042322A4 (en) 2019-10-01 2023-10-25 Telelingo d/b/a Dreyev METHODS AND SYSTEMS FOR USING ARTIFICIAL INTELLIGENCE TO ASSESS, CORRECT AND MONITOR A USER'S ATTENTION
US11587461B2 (en) * 2019-10-23 2023-02-21 GM Global Technology Operations LLC Context-sensitive adjustment of off-road glance time
DE102020003018B4 (de) 2020-05-19 2025-12-31 Mercedes-Benz Group AG Verfahren zur Ermittlung einer Reaktionsfähigkeit
KR20220063856A (ko) * 2020-11-10 2022-05-18 현대자동차주식회사 자율 주행 제어 방법 및 장치
US12077165B2 (en) * 2021-08-02 2024-09-03 Allstate Insurance Company Real-time driver analysis and notification system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI906705B (zh) * 2023-12-05 2025-12-01 優車智能股份有限公司 駕駛員介入引導系統及駕駛員介入引導方法

Also Published As

Publication number Publication date
KR20240122452A (ko) 2024-08-12
US20230192100A1 (en) 2023-06-22
US12600363B2 (en) 2026-04-14
JP2025500379A (ja) 2025-01-09
CN118434612A (zh) 2024-08-02
WO2023122439A1 (en) 2023-06-29
EP4452720A1 (en) 2024-10-30

Similar Documents

Publication Publication Date Title
US12600363B2 (en) Awareness checker for enhancing collaborative driving supervision
US11295143B2 (en) Information processing apparatus, information processing method, and program
US11873007B2 (en) Information processing apparatus, information processing method, and program
CN112699721B (zh) 离开道路扫视时间的情境相关调整
US10773731B2 (en) Driving assistance apparatus
CN112534487B (zh) 信息处理设备、移动体、信息处理方法和程序
US11794645B2 (en) Apparatus and method for giving warning about vehicle in violation of traffic signal at intersection
EP4279350B1 (en) Lane keeping based on lane position unawareness
CN108860153B (zh) 用于确定驾驶员的状态的系统和方法
CN114347996A (zh) 车辆行为监控
US20210389760A1 (en) Exploitation of automotive automated driving systems to cause motor vehicles to perform follow-me low-speed manoeuvres controllable from the outside of the motor vehicles by user terminals
CN118103268A (zh) 使用数字地图和车载感测来确认安全车辆运行的高级驾驶员辅助系统特征激活控制
US12125167B2 (en) Image processing device, image processing method, and image processing system
US12179752B1 (en) Autonomous vehicle entity vector-based situational awareness scoring matrix
EP4412884B1 (en) Human machine interaction monitor
KR20200135588A (ko) 차량 및 그 제어 방법
US10363871B2 (en) Vehicle notification apparatus
US20260045152A1 (en) Information processing apparatus, information processing method, and program
KR20210038791A (ko) 고령 운전자를 위한 후방 경보 장치 및 방법
WO2024252912A1 (ja) 情報処理装置、情報処理方法、および情報処理システム
CN120431760A (zh) 一种基于5g-v2x智能终端交叉路口车辆碰撞预警方法及系统
CN117325862A (zh) 一种车辆变道方法、装置、设备及计算机可读存储介质