KR20240122452A - 협업형 주행 감독을 강화하기 위한 인식 검사기 - Google Patents

협업형 주행 감독을 강화하기 위한 인식 검사기 Download PDF

Info

Publication number
KR20240122452A
KR20240122452A KR1020247019521A KR20247019521A KR20240122452A KR 20240122452 A KR20240122452 A KR 20240122452A KR 1020247019521 A KR1020247019521 A KR 1020247019521A KR 20247019521 A KR20247019521 A KR 20247019521A KR 20240122452 A KR20240122452 A KR 20240122452A
Authority
KR
South Korea
Prior art keywords
driver
vehicle
attention
perception
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020247019521A
Other languages
English (en)
Korean (ko)
Inventor
샤빈 마하데반
레이첼 그레이 알렉산더
슈테펜 쿤
Original Assignee
어라이버 소프트웨어 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 어라이버 소프트웨어 엘엘씨 filed Critical 어라이버 소프트웨어 엘엘씨
Publication of KR20240122452A publication Critical patent/KR20240122452A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W40/09Driving style or behaviour
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005Handover processes
    • B60W60/0053Handover processes from vehicle to occupant
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005Handover processes
    • B60W60/0059Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/408Radar; Laser, e.g. lidar
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00Input parameters relating to overall vehicle dynamics
    • B60W2520/10Longitudinal speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/225Direction of gaze
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/20Static objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/40Dynamic objects, e.g. animals, windblown objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/80Spatial relation or speed relative to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20Ambient conditions, e.g. wind or rain
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/40High definition maps
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/45External transmission of data to or from the vehicle
    • B60W2556/50External transmission of data to or from the vehicle of positioning data, e.g. GPS [Global Positioning System] data

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)
  • Emergency Alarm Devices (AREA)
KR1020247019521A 2021-12-22 2022-12-09 협업형 주행 감독을 강화하기 위한 인식 검사기 Pending KR20240122452A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/559,733 US12600363B2 (en) 2021-12-22 2021-12-22 Awareness checker for enhancing collaborative driving supervision
US17/559,733 2021-12-22
PCT/US2022/081290 WO2023122439A1 (en) 2021-12-22 2022-12-09 Awareness checker for enhancing collaborative driving supervision

Publications (1)

Publication Number Publication Date
KR20240122452A true KR20240122452A (ko) 2024-08-12

Family

ID=84981769

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020247019521A Pending KR20240122452A (ko) 2021-12-22 2022-12-09 협업형 주행 감독을 강화하기 위한 인식 검사기

Country Status (7)

Country Link
US (1) US12600363B2 (https=)
EP (1) EP4452720A1 (https=)
JP (1) JP2025500379A (https=)
KR (1) KR20240122452A (https=)
CN (1) CN118434612A (https=)
TW (1) TW202332608A (https=)
WO (1) WO2023122439A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4162336B1 (en) * 2020-06-09 2024-05-15 Volvo Autonomous Solutions AB Method and control unit for handling safe stop mode of a vehicle
US20240067110A1 (en) * 2022-08-31 2024-02-29 Qualcomm Incorporated Power management integrated circuit (pmic) power supply monitoring without external monitoring circuitry
EP4484242B1 (en) * 2023-06-27 2025-09-10 Volvo Car Corporation Method for preparing a human driver to take over control of a vehicle from an autonomous driving system, data processing apparatus, computer program, computer-readable storage medium, and vehicle
CN116691700A (zh) * 2023-07-26 2023-09-05 广汽本田汽车有限公司 自动驾驶车辆应急辅助接管方法、系统、装置及存储介质
US12365354B2 (en) * 2023-08-24 2025-07-22 GM Global Technology Operations LLC Driver attention detection
TWI906705B (zh) * 2023-12-05 2025-12-01 優車智能股份有限公司 駕駛員介入引導系統及駕駛員介入引導方法
DE102024208567B3 (de) * 2024-09-10 2025-12-31 Volkswagen Aktiengesellschaft Verfahren zur Prüfung einer Aufmerksamkeit eines Insassen eines Fahrzeuges und Vorrichtung sowie Fahrzeug umfassend eine entsprechende Vorrichtung

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008056343B4 (de) * 2008-11-07 2024-07-25 Bayerische Motoren Werke Aktiengesellschaft Warnsystem für ein Kraftfahrzeug
DE102009041187A1 (de) * 2009-08-13 2011-02-17 Volkswagen Ag Verfahren und Vorrichtung zur Adaption von Parametern eines Fahrerassistenzsystems
JP2013242763A (ja) 2012-05-22 2013-12-05 Clarion Co Ltd 対話装置、対話システム、および対話制御方法
DE102012215397B4 (de) 2012-08-30 2025-10-23 Robert Bosch Gmbh Interaktive Aufmerksamkeitssteigerung
JP6213282B2 (ja) * 2014-02-12 2017-10-18 株式会社デンソー 運転支援装置
JP2016057814A (ja) * 2014-09-09 2016-04-21 セイコーエプソン株式会社 頭部装着型表示装置、頭部装着型表示装置の制御方法、情報システム、および、コンピュータープログラム
US10241509B1 (en) * 2014-11-13 2019-03-26 State Farm Mutual Automobile Insurance Company Autonomous vehicle control assessment and selection
DE102015013319B4 (de) 2015-10-14 2017-10-12 Audi Ag Verfahren zum Betrieb eines Kraftfahrzeuges, Kraftfahrzeug und Computerprogramm
JP7080598B2 (ja) * 2017-07-21 2022-06-06 ソニーセミコンダクタソリューションズ株式会社 車両制御装置および車両制御方法
US11188074B1 (en) * 2017-11-29 2021-11-30 United Services Automobile Association (Usaa) Systems and methods for remotely controlling operation of a vehicle
DE112019002145T5 (de) * 2018-04-26 2021-03-04 Sony Semiconductor Solutions Corporation Informationsverarbeitungsvorrichtung, mobile vorrichtung, informationsverarbeitungssystem, verfahren und programm
US10576994B1 (en) * 2018-08-22 2020-03-03 Nio Usa, Inc. Autonomous system operator cognitive state detection and alerting
US10647333B1 (en) * 2018-08-31 2020-05-12 Uatc, Llc Vehicle operator awareness system
WO2020054458A1 (ja) * 2018-09-13 2020-03-19 ソニーセミコンダクタソリューションズ株式会社 情報処理装置、移動装置、および方法、並びにプログラム
EP3910612A4 (en) 2019-01-08 2022-03-09 Sony Semiconductor Solutions Corporation INFORMATION PROCESSING DEVICE, MOBILE DEVICE, METHOD AND PROGRAM
US11345415B2 (en) * 2019-03-14 2022-05-31 lEE INTERNATIONAL ELECTRONICS & ENGINEERING S.A. Vehicle occupant detection
US11772671B2 (en) * 2019-06-03 2023-10-03 Toyota Research Institute, Inc. Systems and methods for predicting control handback
EP4042322A4 (en) 2019-10-01 2023-10-25 Telelingo d/b/a Dreyev METHODS AND SYSTEMS FOR USING ARTIFICIAL INTELLIGENCE TO ASSESS, CORRECT AND MONITOR A USER'S ATTENTION
US11587461B2 (en) * 2019-10-23 2023-02-21 GM Global Technology Operations LLC Context-sensitive adjustment of off-road glance time
DE102020003018B4 (de) 2020-05-19 2025-12-31 Mercedes-Benz Group AG Verfahren zur Ermittlung einer Reaktionsfähigkeit
KR20220063856A (ko) * 2020-11-10 2022-05-18 현대자동차주식회사 자율 주행 제어 방법 및 장치
US12077165B2 (en) * 2021-08-02 2024-09-03 Allstate Insurance Company Real-time driver analysis and notification system

Also Published As

Publication number Publication date
TW202332608A (zh) 2023-08-16
US20230192100A1 (en) 2023-06-22
US12600363B2 (en) 2026-04-14
JP2025500379A (ja) 2025-01-09
CN118434612A (zh) 2024-08-02
WO2023122439A1 (en) 2023-06-29
EP4452720A1 (en) 2024-10-30

Similar Documents

Publication Publication Date Title
US12600363B2 (en) Awareness checker for enhancing collaborative driving supervision
US12400271B2 (en) Electronic system for forward-looking measurements of frequencies and/or probabilities of accident occurrences based on localized automotive device measurements, and corresponding method thereof
CN112699721B (zh) 离开道路扫视时间的情境相关调整
US10558217B2 (en) Method and apparatus for monitoring of an autonomous vehicle
US10678247B2 (en) Method and apparatus for monitoring of an autonomous vehicle
US9493116B2 (en) Alert systems and methods for a vehicle
US9132774B2 (en) Alert systems and methods for a vehicle
US11926259B1 (en) Alert modality selection for alerting a driver
US9701245B2 (en) Alert systems and methods for a vehicle
US8970358B2 (en) Alert systems and methods for a vehicle
US11708090B2 (en) Vehicle behavioral monitoring
US20130342365A1 (en) Alert systems and methods for a vehicle
US20130342364A1 (en) Alert systems and methods for a vehicle
WO2023189578A1 (ja) 移動体制御装置、移動体制御方法、及び、移動体
EP4412884B1 (en) Human machine interaction monitor
US11155260B1 (en) Autonomous vehicle entity vector-based situational awareness scoring matrix
CN119339565A (zh) 车辆交通标志预测
Eichberger et al. Review of recent patents in integrated vehicle safety, advanced driver assistance systems and intelligent transportation systems
Barakoti Enhancing driving safety using artificial intelligence technology
CN121399678A (zh) 控制设备、方法及计算机程序产品
CN120431760A (zh) 一种基于5g-v2x智能终端交叉路口车辆碰撞预警方法及系统

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

D18 Deferred examination requested

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D18-EXM-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

D18-X000 Deferred examination requested

St.27 status event code: A-1-2-D10-D18-exm-X000