JP7713517B2 - 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム - Google Patents

眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム

Info

Publication number
JP7713517B2
JP7713517B2 JP2023524125A JP2023524125A JP7713517B2 JP 7713517 B2 JP7713517 B2 JP 7713517B2 JP 2023524125 A JP2023524125 A JP 2023524125A JP 2023524125 A JP2023524125 A JP 2023524125A JP 7713517 B2 JP7713517 B2 JP 7713517B2
Authority
JP
Japan
Prior art keywords
extended reality
reality environment
display
user
environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2023524125A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023548795A5 (https=
JP2023548795A (ja
Inventor
アンクル アニル アヘル，
スサント セン，
アール バラジ，
サイ ドゥルガ ヴェンカット レディ プリクンタ，
ジョゼ， ジェフリー コップス ロバート
ブイ， アルン クマール ティー
さくら 齋藤
Original Assignee
アデイア ガイズ インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/075,229 external-priority patent/US11281291B1/en
Priority claimed from US17/075,232 external-priority patent/US11392198B2/en
Priority claimed from US17/075,227 external-priority patent/US11747896B2/en
Priority claimed from US17/075,224 external-priority patent/US11609629B2/en
Priority claimed from US17/075,222 external-priority patent/US11320903B1/en
Application filed by アデイア ガイズ インコーポレイテッド filed Critical アデイア ガイズ インコーポレイテッド
Publication of JP2023548795A publication Critical patent/JP2023548795A/ja
Publication of JP2023548795A5 publication Critical patent/JP2023548795A5/ja
Priority to JP2025118393A priority Critical patent/JP2025142019A/ja
Application granted granted Critical
Publication of JP7713517B2 publication Critical patent/JP7713517B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0381—Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Position Input By Displaying (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2023524125A 2020-10-20 2020-12-29 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム Active JP7713517B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025118393A JP2025142019A (ja) 2020-10-20 2025-07-14 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム

Applications Claiming Priority (11)

Application Number Priority Date Filing Date Title
US17/075,232 US11392198B2 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,229 2020-10-20
US17/075,227 US11747896B2 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,224 US11609629B2 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,227 2020-10-20
US17/075,229 US11281291B1 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,224 2020-10-20
US17/075,232 2020-10-20
US17/075,222 2020-10-20
US17/075,222 US11320903B1 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
PCT/US2020/067335 WO2022086577A1 (en) 2020-10-20 2020-12-29 Methods and systems of extended reality environment interaction based on eye motions

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025118393A Division JP2025142019A (ja) 2020-10-20 2025-07-14 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム

Publications (3)

Publication Number Publication Date
JP2023548795A JP2023548795A (ja) 2023-11-21
JP2023548795A5 JP2023548795A5 (https=) 2024-01-15
JP7713517B2 true JP7713517B2 (ja) 2025-07-25

Family

ID=74236295

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2023524125A Active JP7713517B2 (ja) 2020-10-20 2020-12-29 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム
JP2025118393A Pending JP2025142019A (ja) 2020-10-20 2025-07-14 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2025118393A Pending JP2025142019A (ja) 2020-10-20 2025-07-14 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム

Country Status (6)

Country Link
EP (1) EP4232881A1 (https=)
JP (2) JP7713517B2 (https=)
KR (1) KR20230088436A (https=)
AU (1) AU2020473277A1 (https=)
CA (1) CA3199085A1 (https=)
WO (1) WO2022086577A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12597213B2 (en) * 2022-03-16 2026-04-07 Tata Consultancy Services Limited Gesture based tactile interaction in extended reality using form factor of a physical object
US12437471B2 (en) * 2022-12-02 2025-10-07 Adeia Guides Inc. Personalized user engagement in a virtual reality environment
WO2025009226A1 (ja) * 2023-07-03 2025-01-09 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および情報処理方法
WO2025023451A1 (ko) * 2023-07-21 2025-01-30 삼성전자주식회사 사용자 시선과의 인터랙션을 위한 웨어러블 장치, 방법, 및 비-일시적 컴퓨터 판독 가능 저장 매체
WO2025023455A1 (ko) * 2023-07-24 2025-01-30 삼성전자주식회사 음성 신호 처리 방법 및 상기 방법을 수행하는 전자 장치
KR20250030856A (ko) * 2023-08-25 2025-03-05 삼성전자주식회사 타겟 객체의 위치를 식별하기 위한 웨어러블 장치 및 방법
WO2026005387A1 (ko) * 2024-06-28 2026-01-02 삼성전자 주식회사 모달리티 결정에 기반한 응답 제공 방법 및 이를 위한 전자 장치

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001154794A (ja) 1999-11-29 2001-06-08 Nec Fielding Ltd まばたきによるクリック機能を有するポインティング装置
JP2005038008A (ja) 2003-07-15 2005-02-10 Canon Inc 画像処理方法、画像処理装置
JP2014174747A (ja) 2013-03-08 2014-09-22 Sony Corp 情報処理装置、情報処理方法およびプログラム
JP2015087921A (ja) 2013-10-30 2015-05-07 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
JP2017058971A (ja) 2015-09-16 2017-03-23 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
WO2018016464A1 (ja) 2016-07-19 2018-01-25 富士フイルム株式会社 画像表示システム、並びにヘッドマウントディスプレイの制御装置とその作動方法および作動プログラム
JP2018190380A (ja) 2018-01-09 2018-11-29 株式会社 ディー・エヌ・エー 仮想空間の立体視映像を提供するためのプログラム、システム、及び方法
US20190156535A1 (en) 2017-11-21 2019-05-23 International Business Machines Corporation Changing view order of augmented reality objects based on user gaze

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9329682B2 (en) * 2013-06-18 2016-05-03 Microsoft Technology Licensing, Llc Multi-step virtual object selection
WO2016005649A1 (en) * 2014-07-09 2016-01-14 Nokia Technologies Oy Device control
US10248192B2 (en) * 2014-12-03 2019-04-02 Microsoft Technology Licensing, Llc Gaze target application launcher
US10186086B2 (en) * 2015-09-02 2019-01-22 Microsoft Technology Licensing, Llc Augmented reality control of computing device
JP6583043B2 (ja) * 2016-02-19 2019-10-02 富士通株式会社 画像表示装置、表示制御方法および表示制御プログラム
US10444987B2 (en) * 2016-12-19 2019-10-15 Microsoft Technology Licensing, Llc Facilitating selection of holographic keyboard keys
US10803832B2 (en) * 2017-08-01 2020-10-13 Samsung Electronics Co., Ltd. Synchronizing holographic displays and 3D objects with physical video panels
JP6714632B2 (ja) * 2018-03-20 2020-06-24 マクセル株式会社 情報表示端末及び情報表示方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001154794A (ja) 1999-11-29 2001-06-08 Nec Fielding Ltd まばたきによるクリック機能を有するポインティング装置
JP2005038008A (ja) 2003-07-15 2005-02-10 Canon Inc 画像処理方法、画像処理装置
JP2014174747A (ja) 2013-03-08 2014-09-22 Sony Corp 情報処理装置、情報処理方法およびプログラム
JP2015087921A (ja) 2013-10-30 2015-05-07 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
JP2017058971A (ja) 2015-09-16 2017-03-23 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
WO2018016464A1 (ja) 2016-07-19 2018-01-25 富士フイルム株式会社 画像表示システム、並びにヘッドマウントディスプレイの制御装置とその作動方法および作動プログラム
US20190156535A1 (en) 2017-11-21 2019-05-23 International Business Machines Corporation Changing view order of augmented reality objects based on user gaze
JP2018190380A (ja) 2018-01-09 2018-11-29 株式会社 ディー・エヌ・エー 仮想空間の立体視映像を提供するためのプログラム、システム、及び方法

Also Published As

Publication number Publication date
WO2022086577A1 (en) 2022-04-28
JP2025142019A (ja) 2025-09-29
CA3199085A1 (en) 2022-04-28
EP4232881A1 (en) 2023-08-30
AU2020473277A9 (en) 2024-10-03
JP2023548795A (ja) 2023-11-21
KR20230088436A (ko) 2023-06-19
AU2020473277A1 (en) 2023-06-08

Similar Documents

Publication Publication Date Title
US12436609B2 (en) Methods and systems of extended reality environment interaction based on eye motions
JP7713517B2 (ja) 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム
US11782506B2 (en) Methods and systems of extended reality environment interaction based on eye motions
US12026308B2 (en) Methods and systems of extended reality environment interaction based on eye motions
JP7778127B2 (ja) ユーザインターフェースメニューのコンテキスト認識
US11281291B1 (en) Methods and systems of extended reality environment interaction based on eye motions
US11320903B1 (en) Methods and systems of extended reality environment interaction based on eye motions
US12145060B2 (en) Methods and systems to activate selective navigation or magnification of screen content
US12594496B2 (en) Translation of sign language in a virtual environment
US11579752B1 (en) Augmented reality placement for user feedback
US20240226734A1 (en) Using game state data for semantic understanding by an ai image generation model
US12373029B2 (en) Methods and systems of extended reality environment interaction based on eye motions
WO2025075728A1 (en) Reverse auto generation of generative ai engine prompts based on output results for self-validation
US20250345712A1 (en) Methods and systems for enhanced bookmarking for video games
CN121712564A (zh) 基于旁观者反馈的玩家化身修改
WO2025085248A1 (en) User interface for providing editing of storyline using thumbnails showing objects, each of which can be displayed with their variations to allow for on-the-fly generation of objects
GB2634061A (en) Sign language in games

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240104

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240104

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20241220

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250117

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250417

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250613

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250714

R150 Certificate of patent or registration of utility model

Ref document number: 7713517

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150