JP7693673B2 - 仮想、拡張、および複合現実システムおよび方法 - Google Patents

仮想、拡張、および複合現実システムおよび方法 Download PDF

Info

Publication number
JP7693673B2
JP7693673B2 JP2022533463A JP2022533463A JP7693673B2 JP 7693673 B2 JP7693673 B2 JP 7693673B2 JP 2022533463 A JP2022533463 A JP 2022533463A JP 2022533463 A JP2022533463 A JP 2022533463A JP 7693673 B2 JP7693673 B2 JP 7693673B2
Authority
JP
Japan
Prior art keywords
user
depth
image
path
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022533463A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023505230A (ja
JP2023505230A5 (enExample
Inventor
ロバート ブレイク テイラー，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023505230A publication Critical patent/JP2023505230A/ja
Publication of JP2023505230A5 publication Critical patent/JP2023505230A5/ja
Priority to JP2024184880A priority Critical patent/JP2025013901A/ja
Application granted granted Critical
Publication of JP7693673B2 publication Critical patent/JP7693673B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
JP2022533463A 2019-12-06 2020-12-03 仮想、拡張、および複合現実システムおよび方法 Active JP7693673B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024184880A JP2025013901A (ja) 2019-12-06 2024-10-21 仮想、拡張、および複合現実システムおよび方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962945027P 2019-12-06 2019-12-06
US62/945,027 2019-12-06
PCT/US2020/063155 WO2021113540A1 (en) 2019-12-06 2020-12-03 Virtual, augmented, and mixed reality systems and methods

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024184880A Division JP2025013901A (ja) 2019-12-06 2024-10-21 仮想、拡張、および複合現実システムおよび方法

Publications (3)

Publication Number Publication Date
JP2023505230A JP2023505230A (ja) 2023-02-08
JP2023505230A5 JP2023505230A5 (enExample) 2023-11-09
JP7693673B2 true JP7693673B2 (ja) 2025-06-17

Family

ID=76210464

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022533463A Active JP7693673B2 (ja) 2019-12-06 2020-12-03 仮想、拡張、および複合現実システムおよび方法
JP2024184880A Withdrawn JP2025013901A (ja) 2019-12-06 2024-10-21 仮想、拡張、および複合現実システムおよび方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024184880A Withdrawn JP2025013901A (ja) 2019-12-06 2024-10-21 仮想、拡張、および複合現実システムおよび方法

Country Status (5)

Country Link
US (3) US11662808B2 (enExample)
EP (1) EP4070153A4 (enExample)
JP (2) JP7693673B2 (enExample)
CN (1) CN114830011B (enExample)
WO (1) WO2021113540A1 (enExample)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023111647A (ja) * 2022-01-31 2023-08-10 富士フイルムビジネスイノベーション株式会社 情報処理装置及び情報処理プログラム
CN115562496B (zh) * 2022-11-04 2023-12-15 浙江舜为科技有限公司 Xr设备及基于xr设备的字符输入方法和字符修改方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014219621A (ja) 2013-05-10 2014-11-20 株式会社タイトー 表示装置、表示制御プログラム
JP2018534687A (ja) 2015-10-20 2018-11-22 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． ３次元空間内の仮想オブジェクトの選択

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US11138793B2 (en) * 2014-03-14 2021-10-05 Magic Leap, Inc. Multi-depth plane display system with reduced switching between depth planes
US10268041B2 (en) * 2014-05-24 2019-04-23 Amalgamated Vision Llc Wearable display for stereoscopic viewing
KR101844883B1 (ko) * 2014-12-23 2018-04-03 메타 컴퍼니 관심 객체의 임의의 깊이에 있는 동일한 평면으로 시각적 조절과 시각적 수렴을 결합시키는 장치, 방법 및 시스템
US10368059B2 (en) * 2015-10-02 2019-07-30 Atheer, Inc. Method and apparatus for individualized three dimensional display calibration
US9984507B2 (en) * 2015-11-19 2018-05-29 Oculus Vr, Llc Eye tracking for mitigating vergence and accommodation conflicts
US10241569B2 (en) * 2015-12-08 2019-03-26 Facebook Technologies, Llc Focus adjustment method for a virtual reality headset
US10025060B2 (en) * 2015-12-08 2018-07-17 Oculus Vr, Llc Focus adjusting virtual reality headset
KR102438052B1 (ko) * 2016-03-31 2022-08-29 매직 립, 인코포레이티드 포즈들 및 멀티-dof 제어기들을 사용하는 3d 가상 객체들과 상호작용들
EP3249497A1 (en) * 2016-05-24 2017-11-29 Harman Becker Automotive Systems GmbH Eye tracking
EP3494695B1 (en) * 2016-08-04 2023-09-27 Dolby Laboratories Licensing Corporation Single depth tracked accommodation-vergence solutions
CN106412556B (zh) * 2016-10-21 2018-07-17 京东方科技集团股份有限公司 一种图像生成方法及装置
US10928638B2 (en) * 2016-10-31 2021-02-23 Dolby Laboratories Licensing Corporation Eyewear devices with focus tunable lenses
EP3603058B1 (en) * 2017-03-22 2024-07-03 Magic Leap, Inc. Depth based foveated rendering for display systems
US10345600B1 (en) * 2017-06-08 2019-07-09 Facebook Technologies, Llc Dynamic control of optical axis location in head-mounted displays
CN107229340B (zh) * 2017-06-29 2020-04-24 联想(北京)有限公司 一种信息处理方法以及电子设备
GB2569574B (en) * 2017-12-20 2021-10-06 Sony Interactive Entertainment Inc Head-mountable apparatus and methods
CN114935974B (zh) * 2018-03-30 2025-04-25 托比股份公司 用于确定注视关注目标的对物体映射的多线迹注视
JP6884123B2 (ja) * 2018-05-15 2021-06-09 Kddi株式会社 ユーザの注視点を推定する注視点推定装置、プログラム及び方法
US11170212B2 (en) * 2018-09-28 2021-11-09 Apple Inc. Sensor fusion eye tracking
CN109491508B (zh) 2018-11-27 2022-08-26 北京七鑫易维信息技术有限公司 一种确定注视对象的方法和装置
CN110095870B (zh) * 2019-05-28 2022-04-19 京东方科技集团股份有限公司 光学显示系统、显示控制装置和增强现实设备
US11132056B2 (en) * 2019-12-04 2021-09-28 Facebook Technologies, Llc Predictive eye tracking systems and methods for foveated rendering for electronic displays

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014219621A (ja) 2013-05-10 2014-11-20 株式会社タイトー 表示装置、表示制御プログラム
JP2018534687A (ja) 2015-10-20 2018-11-22 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． ３次元空間内の仮想オブジェクトの選択

Also Published As

Publication number Publication date
US12158986B2 (en) 2024-12-03
US11662808B2 (en) 2023-05-30
EP4070153A4 (en) 2023-01-18
WO2021113540A1 (en) 2021-06-10
US20250044865A1 (en) 2025-02-06
JP2023505230A (ja) 2023-02-08
US20210173478A1 (en) 2021-06-10
CN114830011A (zh) 2022-07-29
JP2025013901A (ja) 2025-01-28
EP4070153A1 (en) 2022-10-12
CN114830011B (zh) 2025-04-25
US20230251710A1 (en) 2023-08-10

Similar Documents

Publication Publication Date Title
JP7550222B2 (ja) 仮想、拡張、および複合現実システムおよび方法
CN108369457B (zh) 用于混合现实的现实混合器
CA3054619C (en) Mixed reality system with virtual content warping and method of generating virtual content using same
CN110419061B (zh) 混合现实系统及使用该系统生成虚拟内容的方法
US11818325B2 (en) Blended mode three dimensional display systems and methods
US11562529B2 (en) Generating and modifying an artificial reality environment using occlusion surfaces at predetermined distances
EP3596705A1 (en) Mixed reality system with color virtual content warping and method of generating virtual content using same
JP2025013901A (ja) 仮想、拡張、および複合現実システムおよび方法
WO2025208065A1 (en) Augmented and mixed reality systems and methods

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231030

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20231030

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20231030

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240207

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240213

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240513

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240723

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20241206

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250327

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250507

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250605

R150 Certificate of patent or registration of utility model

Ref document number: 7693673

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150