KR20230088436A - 눈 움직임에 기반한 확장된 현실 환경 상호작용의 방법 및 시스템 - Google Patents

눈 움직임에 기반한 확장된 현실 환경 상호작용의 방법 및 시스템 Download PDF

Info

Publication number
KR20230088436A
KR20230088436A KR1020237016286A KR20237016286A KR20230088436A KR 20230088436 A KR20230088436 A KR 20230088436A KR 1020237016286 A KR1020237016286 A KR 1020237016286A KR 20237016286 A KR20237016286 A KR 20237016286A KR 20230088436 A KR20230088436 A KR 20230088436A
Authority
KR
South Korea
Prior art keywords
display
user
augmented reality
reality environment
environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020237016286A
Other languages
English (en)
Korean (ko)
Inventor
안쿠르 안일 아헤르
수산토 센
알 바라지
사이 더가 벤캣 레디 푸리쿤타
호세 제프리 콥스 로버트
브이 아룬 쿠마르 티
사쿠라 사이토
Original Assignee
로비 가이드스, 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/075,232 external-priority patent/US11392198B2/en
Priority claimed from US17/075,227 external-priority patent/US11747896B2/en
Priority claimed from US17/075,224 external-priority patent/US11609629B2/en
Priority claimed from US17/075,229 external-priority patent/US11281291B1/en
Priority claimed from US17/075,222 external-priority patent/US11320903B1/en
Application filed by 로비 가이드스, 인크. filed Critical 로비 가이드스, 인크.
Publication of KR20230088436A publication Critical patent/KR20230088436A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0381—Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Position Input By Displaying (AREA)
  • Controls And Circuits For Display Device (AREA)
KR1020237016286A 2020-10-20 2020-12-29 눈 움직임에 기반한 확장된 현실 환경 상호작용의 방법 및 시스템 Pending KR20230088436A (ko)

Applications Claiming Priority (11)

Application Number Priority Date Filing Date Title
US17/075,232 US11392198B2 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,229 2020-10-20
US17/075,227 US11747896B2 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,224 US11609629B2 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,227 2020-10-20
US17/075,229 US11281291B1 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
US17/075,224 2020-10-20
US17/075,232 2020-10-20
US17/075,222 2020-10-20
US17/075,222 US11320903B1 (en) 2020-10-20 2020-10-20 Methods and systems of extended reality environment interaction based on eye motions
PCT/US2020/067335 WO2022086577A1 (en) 2020-10-20 2020-12-29 Methods and systems of extended reality environment interaction based on eye motions

Publications (1)

Publication Number Publication Date
KR20230088436A true KR20230088436A (ko) 2023-06-19

Family

ID=74236295

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020237016286A Pending KR20230088436A (ko) 2020-10-20 2020-12-29 눈 움직임에 기반한 확장된 현실 환경 상호작용의 방법 및 시스템

Country Status (6)

Country Link
EP (1) EP4232881A1 (https=)
JP (2) JP7713517B2 (https=)
KR (1) KR20230088436A (https=)
AU (1) AU2020473277A1 (https=)
CA (1) CA3199085A1 (https=)
WO (1) WO2022086577A1 (https=)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025023451A1 (ko) * 2023-07-21 2025-01-30 삼성전자주식회사 사용자 시선과의 인터랙션을 위한 웨어러블 장치, 방법, 및 비-일시적 컴퓨터 판독 가능 저장 매체
WO2025023455A1 (ko) * 2023-07-24 2025-01-30 삼성전자주식회사 음성 신호 처리 방법 및 상기 방법을 수행하는 전자 장치
WO2025048141A1 (ko) * 2023-08-25 2025-03-06 삼성전자주식회사 타겟 객체의 위치를 식별하기 위한 웨어러블 장치 및 방법
WO2026005387A1 (ko) * 2024-06-28 2026-01-02 삼성전자 주식회사 모달리티 결정에 기반한 응답 제공 방법 및 이를 위한 전자 장치

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12597213B2 (en) * 2022-03-16 2026-04-07 Tata Consultancy Services Limited Gesture based tactile interaction in extended reality using form factor of a physical object
US12437471B2 (en) * 2022-12-02 2025-10-07 Adeia Guides Inc. Personalized user engagement in a virtual reality environment
WO2025009226A1 (ja) * 2023-07-03 2025-01-09 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および情報処理方法

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001154794A (ja) 1999-11-29 2001-06-08 Nec Fielding Ltd まばたきによるクリック機能を有するポインティング装置
JP2005038008A (ja) 2003-07-15 2005-02-10 Canon Inc 画像処理方法、画像処理装置
JP5962547B2 (ja) 2013-03-08 2016-08-03 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
JP6277673B2 (ja) 2013-10-30 2018-02-14 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
US9329682B2 (en) * 2013-06-18 2016-05-03 Microsoft Technology Licensing, Llc Multi-step virtual object selection
WO2016005649A1 (en) * 2014-07-09 2016-01-14 Nokia Technologies Oy Device control
US10248192B2 (en) * 2014-12-03 2019-04-02 Microsoft Technology Licensing, Llc Gaze target application launcher
US10186086B2 (en) * 2015-09-02 2019-01-22 Microsoft Technology Licensing, Llc Augmented reality control of computing device
JP6684559B2 (ja) 2015-09-16 2020-04-22 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
JP6583043B2 (ja) * 2016-02-19 2019-10-02 富士通株式会社 画像表示装置、表示制御方法および表示制御プログラム
JP6966443B2 (ja) 2016-07-19 2021-11-17 富士フイルム株式会社 画像表示システム、並びにヘッドマウントディスプレイの制御装置とその作動方法および作動プログラム
US10444987B2 (en) * 2016-12-19 2019-10-15 Microsoft Technology Licensing, Llc Facilitating selection of holographic keyboard keys
US10803832B2 (en) * 2017-08-01 2020-10-13 Samsung Electronics Co., Ltd. Synchronizing holographic displays and 3D objects with physical video panels
US10586360B2 (en) * 2017-11-21 2020-03-10 International Business Machines Corporation Changing view order of augmented reality objects based on user gaze
JP2018190380A (ja) 2018-01-09 2018-11-29 株式会社 ディー・エヌ・エー 仮想空間の立体視映像を提供するためのプログラム、システム、及び方法
JP6714632B2 (ja) * 2018-03-20 2020-06-24 マクセル株式会社 情報表示端末及び情報表示方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025023451A1 (ko) * 2023-07-21 2025-01-30 삼성전자주식회사 사용자 시선과의 인터랙션을 위한 웨어러블 장치, 방법, 및 비-일시적 컴퓨터 판독 가능 저장 매체
WO2025023455A1 (ko) * 2023-07-24 2025-01-30 삼성전자주식회사 음성 신호 처리 방법 및 상기 방법을 수행하는 전자 장치
WO2025048141A1 (ko) * 2023-08-25 2025-03-06 삼성전자주식회사 타겟 객체의 위치를 식별하기 위한 웨어러블 장치 및 방법
US12541251B2 (en) 2023-08-25 2026-02-03 Samsung Electronics Co., Ltd. Wearable device and method for identifying location of target object
WO2026005387A1 (ko) * 2024-06-28 2026-01-02 삼성전자 주식회사 모달리티 결정에 기반한 응답 제공 방법 및 이를 위한 전자 장치

Also Published As

Publication number Publication date
WO2022086577A1 (en) 2022-04-28
JP2025142019A (ja) 2025-09-29
CA3199085A1 (en) 2022-04-28
EP4232881A1 (en) 2023-08-30
JP7713517B2 (ja) 2025-07-25
AU2020473277A9 (en) 2024-10-03
JP2023548795A (ja) 2023-11-21
AU2020473277A1 (en) 2023-06-08

Similar Documents

Publication Publication Date Title
US12436609B2 (en) Methods and systems of extended reality environment interaction based on eye motions
US12265655B2 (en) Moving windows between a virtual display and an extended reality environment
JP7846736B2 (ja) 三次元環境と相互作用するためのデバイス、方法、及びグラフィカルユーザインタフェース
US11782506B2 (en) Methods and systems of extended reality environment interaction based on eye motions
JP7713517B2 (ja) 眼運動に基づくエクステンデッドリアリティ環境相互作用の方法およびシステム
US12026308B2 (en) Methods and systems of extended reality environment interaction based on eye motions
US11281291B1 (en) Methods and systems of extended reality environment interaction based on eye motions
US11320903B1 (en) Methods and systems of extended reality environment interaction based on eye motions
US20160018985A1 (en) Holographic keyboard display
CN117122890A (zh) 用于激活屏幕内容的选择性导航或放大的方法和系统
JP2026502519A (ja) Ａｉ画像生成モデルによるセマンティック理解のためのゲームステートデータの使用
US12373029B2 (en) Methods and systems of extended reality environment interaction based on eye motions
US20260029842A1 (en) Interaction method, storage medium and terminal device
US20250108296A1 (en) Sign language in games

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

D21 Rejection of application intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D21-EXM-PE0902 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P13-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000