JP2024538536A - 車両乗員支援のための車両及びモバイルデバイスインターフェース - Google Patents

車両乗員支援のための車両及びモバイルデバイスインターフェース Download PDF

Info

Publication number
JP2024538536A
JP2024538536A JP2024518163A JP2024518163A JP2024538536A JP 2024538536 A JP2024538536 A JP 2024538536A JP 2024518163 A JP2024518163 A JP 2024518163A JP 2024518163 A JP2024518163 A JP 2024518163A JP 2024538536 A JP2024538536 A JP 2024538536A
Authority
JP
Japan
Prior art keywords
vehicle
occupant
virtual content
event
mobile device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2024518163A
Other languages
English (en)
Japanese (ja)
Other versions
JP2024538536A5 (cg-RX-API-DMAC7.html
Inventor
アスガル、ジアド
ホーランド、ウェスリー・ジェームス
オグズ、セイフラー・ハリト
ラマサミー、バラ
シェインブラット、レオニド
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2024538536A publication Critical patent/JP2024538536A/ja
Publication of JP2024538536A5 publication Critical patent/JP2024538536A5/ja
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30268—Vehicle interior

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Architecture (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Traffic Control Systems (AREA)
  • User Interface Of Digital Computer (AREA)
JP2024518163A 2021-10-06 2022-10-03 車両乗員支援のための車両及びモバイルデバイスインターフェース Pending JP2024538536A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/495,738 US11562550B1 (en) 2021-10-06 2021-10-06 Vehicle and mobile device interface for vehicle occupant assistance
US17/495,738 2021-10-06
PCT/US2022/077485 WO2023060048A1 (en) 2021-10-06 2022-10-03 Vehicle and mobile device interface for vehicle occupant assistance

Publications (2)

Publication Number Publication Date
JP2024538536A true JP2024538536A (ja) 2024-10-23
JP2024538536A5 JP2024538536A5 (cg-RX-API-DMAC7.html) 2025-09-11

Family

ID=83903120

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2024518163A Pending JP2024538536A (ja) 2021-10-06 2022-10-03 車両乗員支援のための車両及びモバイルデバイスインターフェース

Country Status (7)

Country Link
US (1) US11562550B1 (cg-RX-API-DMAC7.html)
EP (1) EP4413448A1 (cg-RX-API-DMAC7.html)
JP (1) JP2024538536A (cg-RX-API-DMAC7.html)
KR (1) KR20240067906A (cg-RX-API-DMAC7.html)
CN (1) CN118103798A (cg-RX-API-DMAC7.html)
TW (1) TW202323931A (cg-RX-API-DMAC7.html)
WO (1) WO2023060048A1 (cg-RX-API-DMAC7.html)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7207434B2 (ja) * 2018-12-27 2023-01-18 日本電気株式会社 余所見判定装置、余所見判定システム、余所見判定方法、プログラム
US11897334B2 (en) 2020-11-19 2024-02-13 Ford Global Technologies, Llc Vehicle having pet bowl communication
US11950582B2 (en) 2020-11-19 2024-04-09 Ford Global Technologies, Llc Pet bowl having integrated sensing
US11999232B2 (en) * 2020-12-17 2024-06-04 Ford Global Technologies, Llc Vehicle having pet monitoring and related controls
US11904794B2 (en) 2021-01-28 2024-02-20 Ford Global Technologies, Llc Pet restraint system for a vehicle
US11951878B2 (en) 2021-05-04 2024-04-09 Ford Global Technologies, Llc Vehicle having seat control based on monitored pet location
US12103547B2 (en) 2021-05-04 2024-10-01 Ford Global Technologies, Llc Vehicle having user inputs controlled based on monitored pet location
US11687155B2 (en) * 2021-05-13 2023-06-27 Toyota Research Institute, Inc. Method for vehicle eye tracking system
US11932156B2 (en) 2021-05-17 2024-03-19 Ford Global Technologies, Llc Vehicle having sliding console
US12277779B2 (en) 2021-10-06 2025-04-15 Qualcomm Incorporated Vehicle and mobile device interface for vehicle occupant assistance
US11670060B1 (en) * 2021-10-11 2023-06-06 Meta Platforms Technologies, Llc Auto-generating an artificial reality environment based on access to personal user content
US12128881B1 (en) 2021-11-12 2024-10-29 Zoox, Inc. Vehicle-event application notifications
US11950316B1 (en) * 2021-11-12 2024-04-02 Zoox, Inc. Vehicle-passenger assistance facilitation
FR3135856A1 (fr) * 2022-05-23 2023-11-24 Ary Procede d’ancrage d’un objet virtuel, systeme associe
US12423900B1 (en) 2022-09-24 2025-09-23 Apple Inc. Methods and user interfaces based on motion
US20240144608A1 (en) * 2022-11-02 2024-05-02 Mercedes-Benz Group AG Context-sensitive overlay of content via augmented reality device
US20240282057A1 (en) * 2023-02-21 2024-08-22 International Business Machines Corporation Augmentation of volumetric video with non-visual information in a virtual reality environment
JP7625627B2 (ja) * 2023-03-08 2025-02-03 本田技研工業株式会社 車両制御装置
KR20240156680A (ko) * 2023-04-24 2024-10-31 현대자동차주식회사 라이다 센서를 이용한 주차제어장치 및 그 제어방법
DE102023002181B3 (de) * 2023-05-30 2024-03-14 Mercedes-Benz Group AG Adaptive Filterkette zum Anzeigen eines Umfeldmodells in einem Fahrzeug
JP2025015109A (ja) * 2023-07-20 2025-01-30 トヨタ自動車株式会社 退出支援装置、退出支援用コンピュータプログラム及び退出支援方法
CN117193530B (zh) * 2023-09-04 2024-06-11 深圳达普信科技有限公司 基于虚拟现实技术的智能座舱沉浸式用户体验方法及系统
US12515522B2 (en) 2023-09-29 2026-01-06 Motorola Solutions, Inc. Device, system, and method for controlling a vehicle-related display into an exited occupant support mode
EP4785585A1 (en) * 2023-09-30 2026-08-05 Apple Inc. Techniques for displaying content with a live video feed
US12594887B2 (en) * 2023-09-30 2026-04-07 Apple Inc. Techniques for displaying content with a live video feed
US12524069B2 (en) 2023-09-30 2026-01-13 Apple Inc. Techniques for motion compensation
TWI913605B (zh) 2023-11-07 2026-02-01 群創光電股份有限公司 顯示系統
US20250332995A1 (en) * 2024-04-25 2025-10-30 Ford Global Technologies, Llc Systems and methods for detecting obstructions in driver's view and performing remidial actions
US20250349026A1 (en) * 2024-05-08 2025-11-13 Blink Technologies Inc. Multi-user occupant location determination and gaze tracking in a vehicle space using optical surface reflections
CN118524192B (zh) * 2024-07-25 2024-10-22 江苏欧帝电子科技有限公司 一种便携式移动摄制终端多路显示、导播方法
US20260116387A1 (en) * 2024-10-28 2026-04-30 GM Global Technology Operations LLC Voice activated lane change with driver monitoring system validatation
NL4000406A (en) * 2024-11-21 2026-06-15 Mobileye Vision Technologies Ltd Altering lane keep assist behavior based on whether a driver is gazing at a target lane
US12700245B1 (en) * 2025-05-27 2026-08-04 Geotab Inc. Systems for calibrating vehicle-based image capture devices

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004106596A (ja) * 2002-09-13 2004-04-08 Canon Inc 画像表示装置、及び画像表示方法、計測装置、及び計測方法
JP2004219664A (ja) * 2003-01-14 2004-08-05 Sumitomo Electric Ind Ltd 情報表示システム及び情報表示方法
CN102910130A (zh) * 2012-10-24 2013-02-06 浙江工业大学 一种现实增强型的驾驶辅助预警系统
US20130194110A1 (en) * 2012-02-01 2013-08-01 Electronics And Telecommunications Research Institute Automotive augmented reality head-up display apparatus and method
JP2018005005A (ja) * 2016-07-04 2018-01-11 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
US20190005727A1 (en) * 2017-06-30 2019-01-03 Panasonic Intellectual Property Management Co., Ltd. Display system, information presentation system, control method of display system, storage medium, and mobile body
JP2020095350A (ja) * 2018-12-10 2020-06-18 トヨタ自動車株式会社 支援装置、支援方法およびプログラム

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2251751A (en) * 1990-10-09 1992-07-15 Gaertner W W Res Position and orientation measurement
DE102016120427A1 (de) * 2015-10-26 2017-04-27 Active Knowledge Ltd. Anwendung einer Videodurchsicht, um einem Insassen eines Fahrzeugs ein bevorstehendes Ereignis bewusst zu machen, das eine plötzliche Abnahme des Fahrkomforts bewirken wird
KR101916993B1 (ko) * 2015-12-24 2018-11-08 엘지전자 주식회사 차량용 디스플레이 장치 및 그 제어방법
US9786104B2 (en) * 2016-01-25 2017-10-10 Smartdrive Systems, Inc. Systems and method to trigger vehicle events based on contextual information
US11074827B2 (en) * 2017-08-25 2021-07-27 Aurora Flight Sciences Corporation Virtual reality system for aerial vehicle
EP3663941B1 (en) * 2018-12-07 2022-07-13 Volvo Car Corporation Evaluation of a simulated vehicle-related feature
US10767997B1 (en) * 2019-02-25 2020-09-08 Qualcomm Incorporated Systems and methods for providing immersive extended reality experiences on moving platforms
IT201900017429A1 (it) * 2019-09-27 2021-03-27 Milano Politecnico Metodo e sistema per l'assistenza alla guida di un veicolo

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004106596A (ja) * 2002-09-13 2004-04-08 Canon Inc 画像表示装置、及び画像表示方法、計測装置、及び計測方法
JP2004219664A (ja) * 2003-01-14 2004-08-05 Sumitomo Electric Ind Ltd 情報表示システム及び情報表示方法
US20130194110A1 (en) * 2012-02-01 2013-08-01 Electronics And Telecommunications Research Institute Automotive augmented reality head-up display apparatus and method
CN102910130A (zh) * 2012-10-24 2013-02-06 浙江工业大学 一种现实增强型的驾驶辅助预警系统
JP2018005005A (ja) * 2016-07-04 2018-01-11 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
US20190005727A1 (en) * 2017-06-30 2019-01-03 Panasonic Intellectual Property Management Co., Ltd. Display system, information presentation system, control method of display system, storage medium, and mobile body
JP2019012237A (ja) * 2017-06-30 2019-01-24 パナソニックIpマネジメント株式会社 表示システム、情報提示システム、表示システムの制御方法、プログラム、及び移動体
JP2020095350A (ja) * 2018-12-10 2020-06-18 トヨタ自動車株式会社 支援装置、支援方法およびプログラム

Also Published As

Publication number Publication date
KR20240067906A (ko) 2024-05-17
TW202323931A (zh) 2023-06-16
WO2023060048A1 (en) 2023-04-13
US11562550B1 (en) 2023-01-24
EP4413448A1 (en) 2024-08-14
CN118103798A (zh) 2024-05-28

Similar Documents

Publication Publication Date Title
EP4412852B1 (en) Head-mounted display for use in vehicle and method
US11562550B1 (en) Vehicle and mobile device interface for vehicle occupant assistance
JP7638613B2 (ja) 情報処理システム、情報処理方法及びプログラム
JP7680897B2 (ja) 歩行者横断危険性評価及び指向性警報のためのシステム及び方法
JP7764919B2 (ja) 情報処理装置、および情報処理方法、プログラム、並びに車両
KR102938894B1 (ko) 표시 시스템, 표시 장치, 표시 방법 및 이동 장치
US11295143B2 (en) Information processing apparatus, information processing method, and program
JP7696764B2 (ja) 入力としてグレアを使用する注視判定
KR102366723B1 (ko) 운송 수단으로 시야 확보 영상을 제공하는 방법, 이를 위한 전자 장치 및 컴퓨터 판독 가능한 기록 매체
KR101895485B1 (ko) 운전 보조 장치 및 그 제어 방법
EP2857886B1 (en) Display control apparatus, computer-implemented method, storage medium, and projection apparatus
JP2022039884A (ja) 空間モデルを使用したニューラルネットワークに基づく視線方向の決定
JP2021195124A5 (cg-RX-API-DMAC7.html)
JP2022519895A (ja) ユーザの注目方向および外観を相関させるシステムおよび方法
CN115344117A (zh) 适配的眼睛追踪机器学习模型引擎
US12552320B2 (en) Camera module, information processing system, information processing method, and information processing apparatus
US12296740B2 (en) Vehicle
KR20190088133A (ko) 입출력 장치 및 그것을 포함하는 차량
US20250292687A1 (en) Environmental text perception and toll evaluation using vision language models
CN117916139A (zh) 车辆控制系统、车辆控制方法和程序
US20240004075A1 (en) Time-of-flight object detection circuitry and time-of-flight object detection method
US20260045152A1 (en) Information processing apparatus, information processing method, and program
US20260105761A1 (en) Heat map-based facial feature key point occlusion detection for occupant monitoring systems and applications

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250903

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20250903

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20260626

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260707