JP2025500379A - 協調型運転監督を強化するための意識度チェッカ - Google Patents

協調型運転監督を強化するための意識度チェッカ Download PDF

Info

Publication number
JP2025500379A
JP2025500379A JP2024537534A JP2024537534A JP2025500379A JP 2025500379 A JP2025500379 A JP 2025500379A JP 2024537534 A JP2024537534 A JP 2024537534A JP 2024537534 A JP2024537534 A JP 2024537534A JP 2025500379 A JP2025500379 A JP 2025500379A
Authority
JP
Japan
Prior art keywords
driver
vehicle
attention
awareness
checker
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2024537534A
Other languages
English (en)
Japanese (ja)
Other versions
JP2025500379A5 (https=
Inventor
シャビン・マハデヴァン
レイチェル・グレイ・アレクサンダー
ステッフェン・クーン
Original Assignee
アライバー ソフトウェア エルエルシー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アライバー ソフトウェア エルエルシー filed Critical アライバー ソフトウェア エルエルシー
Publication of JP2025500379A publication Critical patent/JP2025500379A/ja
Publication of JP2025500379A5 publication Critical patent/JP2025500379A5/ja
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W40/09Driving style or behaviour
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005Handover processes
    • B60W60/0053Handover processes from vehicle to occupant
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005Handover processes
    • B60W60/0059Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/408Radar; Laser, e.g. lidar
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00Input parameters relating to overall vehicle dynamics
    • B60W2520/10Longitudinal speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/225Direction of gaze
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/20Static objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/40Dynamic objects, e.g. animals, windblown objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/80Spatial relation or speed relative to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20Ambient conditions, e.g. wind or rain
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/40High definition maps
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/45External transmission of data to or from the vehicle
    • B60W2556/50External transmission of data to or from the vehicle of positioning data, e.g. GPS [Global Positioning System] data

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)
  • Emergency Alarm Devices (AREA)
JP2024537534A 2021-12-22 2022-12-09 協調型運転監督を強化するための意識度チェッカ Pending JP2025500379A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/559,733 US12600363B2 (en) 2021-12-22 2021-12-22 Awareness checker for enhancing collaborative driving supervision
US17/559,733 2021-12-22
PCT/US2022/081290 WO2023122439A1 (en) 2021-12-22 2022-12-09 Awareness checker for enhancing collaborative driving supervision

Publications (2)

Publication Number Publication Date
JP2025500379A true JP2025500379A (ja) 2025-01-09
JP2025500379A5 JP2025500379A5 (https=) 2025-12-04

Family

ID=84981769

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2024537534A Pending JP2025500379A (ja) 2021-12-22 2022-12-09 協調型運転監督を強化するための意識度チェッカ

Country Status (7)

Country Link
US (1) US12600363B2 (https=)
EP (1) EP4452720A1 (https=)
JP (1) JP2025500379A (https=)
KR (1) KR20240122452A (https=)
CN (1) CN118434612A (https=)
TW (1) TW202332608A (https=)
WO (1) WO2023122439A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4162336B1 (en) * 2020-06-09 2024-05-15 Volvo Autonomous Solutions AB Method and control unit for handling safe stop mode of a vehicle
US20240067110A1 (en) * 2022-08-31 2024-02-29 Qualcomm Incorporated Power management integrated circuit (pmic) power supply monitoring without external monitoring circuitry
EP4484242B1 (en) * 2023-06-27 2025-09-10 Volvo Car Corporation Method for preparing a human driver to take over control of a vehicle from an autonomous driving system, data processing apparatus, computer program, computer-readable storage medium, and vehicle
CN116691700A (zh) * 2023-07-26 2023-09-05 广汽本田汽车有限公司 自动驾驶车辆应急辅助接管方法、系统、装置及存储介质
US12365354B2 (en) * 2023-08-24 2025-07-22 GM Global Technology Operations LLC Driver attention detection
TWI906705B (zh) * 2023-12-05 2025-12-01 優車智能股份有限公司 駕駛員介入引導系統及駕駛員介入引導方法
DE102024208567B3 (de) * 2024-09-10 2025-12-31 Volkswagen Aktiengesellschaft Verfahren zur Prüfung einer Aufmerksamkeit eines Insassen eines Fahrzeuges und Vorrichtung sowie Fahrzeug umfassend eine entsprechende Vorrichtung

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008056343B4 (de) * 2008-11-07 2024-07-25 Bayerische Motoren Werke Aktiengesellschaft Warnsystem für ein Kraftfahrzeug
DE102009041187A1 (de) * 2009-08-13 2011-02-17 Volkswagen Ag Verfahren und Vorrichtung zur Adaption von Parametern eines Fahrerassistenzsystems
JP2013242763A (ja) 2012-05-22 2013-12-05 Clarion Co Ltd 対話装置、対話システム、および対話制御方法
DE102012215397B4 (de) 2012-08-30 2025-10-23 Robert Bosch Gmbh Interaktive Aufmerksamkeitssteigerung
JP6213282B2 (ja) * 2014-02-12 2017-10-18 株式会社デンソー 運転支援装置
JP2016057814A (ja) * 2014-09-09 2016-04-21 セイコーエプソン株式会社 頭部装着型表示装置、頭部装着型表示装置の制御方法、情報システム、および、コンピュータープログラム
US10241509B1 (en) * 2014-11-13 2019-03-26 State Farm Mutual Automobile Insurance Company Autonomous vehicle control assessment and selection
DE102015013319B4 (de) 2015-10-14 2017-10-12 Audi Ag Verfahren zum Betrieb eines Kraftfahrzeuges, Kraftfahrzeug und Computerprogramm
JP7080598B2 (ja) * 2017-07-21 2022-06-06 ソニーセミコンダクタソリューションズ株式会社 車両制御装置および車両制御方法
US11188074B1 (en) * 2017-11-29 2021-11-30 United Services Automobile Association (Usaa) Systems and methods for remotely controlling operation of a vehicle
DE112019002145T5 (de) * 2018-04-26 2021-03-04 Sony Semiconductor Solutions Corporation Informationsverarbeitungsvorrichtung, mobile vorrichtung, informationsverarbeitungssystem, verfahren und programm
US10576994B1 (en) * 2018-08-22 2020-03-03 Nio Usa, Inc. Autonomous system operator cognitive state detection and alerting
US10647333B1 (en) * 2018-08-31 2020-05-12 Uatc, Llc Vehicle operator awareness system
WO2020054458A1 (ja) * 2018-09-13 2020-03-19 ソニーセミコンダクタソリューションズ株式会社 情報処理装置、移動装置、および方法、並びにプログラム
EP3910612A4 (en) 2019-01-08 2022-03-09 Sony Semiconductor Solutions Corporation INFORMATION PROCESSING DEVICE, MOBILE DEVICE, METHOD AND PROGRAM
US11345415B2 (en) * 2019-03-14 2022-05-31 lEE INTERNATIONAL ELECTRONICS & ENGINEERING S.A. Vehicle occupant detection
US11772671B2 (en) * 2019-06-03 2023-10-03 Toyota Research Institute, Inc. Systems and methods for predicting control handback
EP4042322A4 (en) 2019-10-01 2023-10-25 Telelingo d/b/a Dreyev METHODS AND SYSTEMS FOR USING ARTIFICIAL INTELLIGENCE TO ASSESS, CORRECT AND MONITOR A USER'S ATTENTION
US11587461B2 (en) * 2019-10-23 2023-02-21 GM Global Technology Operations LLC Context-sensitive adjustment of off-road glance time
DE102020003018B4 (de) 2020-05-19 2025-12-31 Mercedes-Benz Group AG Verfahren zur Ermittlung einer Reaktionsfähigkeit
KR20220063856A (ko) * 2020-11-10 2022-05-18 현대자동차주식회사 자율 주행 제어 방법 및 장치
US12077165B2 (en) * 2021-08-02 2024-09-03 Allstate Insurance Company Real-time driver analysis and notification system

Also Published As

Publication number Publication date
KR20240122452A (ko) 2024-08-12
TW202332608A (zh) 2023-08-16
US20230192100A1 (en) 2023-06-22
US12600363B2 (en) 2026-04-14
CN118434612A (zh) 2024-08-02
WO2023122439A1 (en) 2023-06-29
EP4452720A1 (en) 2024-10-30

Similar Documents

Publication Publication Date Title
JP2025500379A (ja) 協調型運転監督を強化するための意識度チェッカ
US11295143B2 (en) Information processing apparatus, information processing method, and program
US11873007B2 (en) Information processing apparatus, information processing method, and program
CN112699721B (zh) 离开道路扫视时间的情境相关调整
CN107544518B (zh) 基于拟人驾驶的acc/aeb系统及车辆
CN112534487B (zh) 信息处理设备、移动体、信息处理方法和程序
CN115503728A (zh) 用于预测人类驾驶操纵并减少人类驾驶错误的驾驶员和环境监测
US11926259B1 (en) Alert modality selection for alerting a driver
EP4279350B1 (en) Lane keeping based on lane position unawareness
CN110371018B (zh) 使用其他车辆车灯的信息改善车辆行为
US20220111867A1 (en) Vehicle behavioral monitoring
CN108860153B (zh) 用于确定驾驶员的状态的系统和方法
Koo et al. A method for driving control authority transition for cooperative autonomous vehicle
CN118973889A (zh) 移动对象控制装置、移动对象控制方法和移动对象
EP4412884B1 (en) Human machine interaction monitor
DE102023132343A1 (de) Vorrichtung zum steuern von autonomen fahren eines fahrzeugs und verfahren zum ermitteln eines zustands eines fahrers
Eichberger et al. Review of recent patents in integrated vehicle safety, advanced driver assistance systems and intelligent transportation systems
EP4516613A1 (en) Autonomous vehicle and operating method thereof
US20260045152A1 (en) Information processing apparatus, information processing method, and program
WO2026038489A1 (ja) 車両制御システム、車両制御方法及び車両制御プログラム
WO2024252912A1 (ja) 情報処理装置、情報処理方法、および情報処理システム
CN121399678A (zh) 控制设备、方法及计算机程序产品
Amditis et al. Real-time traffic and environment risk estimation for the optimisation of human-machine interaction

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20251125

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20251125