JP7496424B2 - 単一コントローラを使用したコンテンツ移動および相互作用 - Google Patents

単一コントローラを使用したコンテンツ移動および相互作用 Download PDF

Info

Publication number
JP7496424B2
JP7496424B2 JP2022544290A JP2022544290A JP7496424B2 JP 7496424 B2 JP7496424 B2 JP 7496424B2 JP 2022544290 A JP2022544290 A JP 2022544290A JP 2022544290 A JP2022544290 A JP 2022544290A JP 7496424 B2 JP7496424 B2 JP 7496424B2
Authority
JP
Japan
Prior art keywords
user
content
interactive content
location
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022544290A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023511905A5 (cg-RX-API-DMAC7.html
JP2023511905A (ja
Inventor
カレン ストールゼンバーグ,
マーク アラン マッコール,
フランク アレクサンダー ザ フォース ハミルトン,
コール パーカー ハイナー,
ジョン オースティン デイ,
エリック ノーマン イスキス,
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023511905A publication Critical patent/JP2023511905A/ja
Publication of JP2023511905A5 publication Critical patent/JP2023511905A5/ja
Priority to JP2024074313A priority Critical patent/JP7788491B2/ja
Application granted granted Critical
Publication of JP7496424B2 publication Critical patent/JP7496424B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
JP2022544290A 2020-01-24 2021-01-20 単一コントローラを使用したコンテンツ移動および相互作用 Active JP7496424B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024074313A JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062965708P 2020-01-24 2020-01-24
US62/965,708 2020-01-24
PCT/US2021/014208 WO2021150623A1 (en) 2020-01-24 2021-01-20 Content movement and interaction using a single controller

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024074313A Division JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Publications (3)

Publication Number Publication Date
JP2023511905A JP2023511905A (ja) 2023-03-23
JP2023511905A5 JP2023511905A5 (cg-RX-API-DMAC7.html) 2024-01-29
JP7496424B2 true JP7496424B2 (ja) 2024-06-06

Family

ID=76971189

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022544290A Active JP7496424B2 (ja) 2020-01-24 2021-01-20 単一コントローラを使用したコンテンツ移動および相互作用
JP2024074313A Active JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024074313A Active JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Country Status (5)

Country Link
US (3) US11294461B2 (cg-RX-API-DMAC7.html)
EP (1) EP4094119B1 (cg-RX-API-DMAC7.html)
JP (2) JP7496424B2 (cg-RX-API-DMAC7.html)
CN (1) CN115380236B (cg-RX-API-DMAC7.html)
WO (1) WO2021150623A1 (cg-RX-API-DMAC7.html)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115380236B (zh) 2020-01-24 2025-05-06 奇跃公司 使用单个控制器的内容移动和交互
US20240087156A1 (en) * 2021-02-04 2024-03-14 Sony Interactive Entertainment Inc. Information processing system, information processing device, control method of information processing device, and program
US12353673B2 (en) 2022-07-15 2025-07-08 Samsung Electronics Co., Ltd. Control-deck graphical user interface in XR
US20240386817A1 (en) * 2023-05-15 2024-11-21 Apple Inc. Head mountable display
IT202300019182A1 (it) * 2023-09-19 2025-03-19 Khymeia S R L Apparato di interazione virtuale

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013507052A (ja) 2009-09-30 2013-02-28 ユナイテッド ビデオ プロパティーズ, インコーポレイテッド 3次元メディアガイダンスアプリケーションをナビゲートするためのシステムおよび方法
WO2014162762A1 (ja) 2013-04-02 2014-10-09 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
JP2017004357A (ja) 2015-06-12 2017-01-05 株式会社コロプラ フローティング・グラフィカルユーザインターフェース
JP2018517967A (ja) 2015-08-26 2018-07-05 グーグル エルエルシー 仮想現実における、頭部、ジェスチャ、およびタッチ入力の動的な切り替えならびにマージ
WO2018195099A1 (en) 2017-04-19 2018-10-25 Magic Leap, Inc. Multimodal task execution and text editing for a wearable system

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
US6091395A (en) 1997-12-15 2000-07-18 International Business Machines Corporation Computer system and method of manipulating a graphical user interface component on a computer display through collision with a pointer
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20090083628A1 (en) * 2007-09-26 2009-03-26 Autodesk, Inc. navigation system for a 3d virtual scene
US20120249797A1 (en) * 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
KR101171660B1 (ko) 2010-03-01 2012-08-09 이문기 증강현실의 포인팅 장치
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
EP4036630A1 (en) 2010-12-24 2022-08-03 Magic Leap, Inc. Image display system
JP6316186B2 (ja) 2011-05-06 2018-04-25 マジック リープ, インコーポレイテッドMagic Leap,Inc. 広範囲同時遠隔ディジタル提示世界
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
US10795448B2 (en) 2011-09-29 2020-10-06 Magic Leap, Inc. Tactile glove for human-computer interaction
US9255813B2 (en) * 2011-10-14 2016-02-09 Microsoft Technology Licensing, Llc User controlled real object disappearance in a mixed reality display
EP4404537A3 (en) 2011-10-28 2024-10-16 Magic Leap, Inc. System and method for augmented and virtual reality
JP5938977B2 (ja) * 2012-03-23 2016-06-22 ソニー株式会社 ヘッドマウントディスプレイ及び手術システム
US8795080B1 (en) * 2012-03-30 2014-08-05 Zynga Inc. Gaming platform providing a game action sweep mechanic
CN104541201B (zh) 2012-04-05 2018-05-25 奇跃公司 具有主动中央凹能力的宽视场(fov)成像设备
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
WO2014043196A1 (en) 2012-09-11 2014-03-20 Magic Leap, Inc Ergonomic head mounted display device and optical system
JP2014127987A (ja) * 2012-12-27 2014-07-07 Sony Corp 情報処理装置および記録媒体
AU2014229004B2 (en) 2013-03-15 2017-09-21 Magic Leap, Inc. Display system and method
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US9129430B2 (en) * 2013-06-25 2015-09-08 Microsoft Technology Licensing, Llc Indicating out-of-view augmented reality images
JP6479785B2 (ja) 2013-10-16 2019-03-06 マジック リープ, インコーポレイテッドMagic Leap,Inc. 調節可能な瞳孔間距離を有する仮想または拡張現実ヘッドセット
CN113433700B (zh) 2013-11-27 2024-03-22 奇跃公司 虚拟和增强现实系统与方法
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
JP6550460B2 (ja) 2014-05-09 2019-07-24 グーグル エルエルシー 眼信号を識別するためのシステムおよび方法、ならびに連続バイオメトリック認証
EP3023863A1 (en) * 2014-11-20 2016-05-25 Thomson Licensing Device and method for processing visual data, and related computer program product
CN105425955A (zh) * 2015-11-06 2016-03-23 中国矿业大学 多用户沉浸式全互动虚拟现实工程培训系统
CA3018758A1 (en) * 2016-03-31 2017-10-05 Magic Leap, Inc. Interactions with 3d virtual objects using poses and multiple-dof controllers
US20180024623A1 (en) * 2016-07-22 2018-01-25 Google Inc. Detecting user range of motion for virtual reality user interfaces
US10290152B2 (en) * 2017-04-03 2019-05-14 Microsoft Technology Licensing, Llc Virtual object user interface display
CN111684495B (zh) 2017-12-22 2025-01-21 奇跃公司 用于在混合现实系统中管理和显示虚拟内容的方法和系统
US10540941B2 (en) * 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
CN111712780B (zh) * 2018-02-06 2025-02-25 奇跃公司 用于增强现实的系统和方法
US11875012B2 (en) * 2018-05-25 2024-01-16 Ultrahaptics IP Two Limited Throwable interface for augmented reality and virtual reality environments
JP7136931B2 (ja) * 2018-06-05 2022-09-13 マジック リープ, インコーポレイテッド 空間3d環境へのコンテンツのマッチング
JP7519742B2 (ja) * 2018-07-23 2024-07-22 マジック リープ, インコーポレイテッド 位置ベクトルを使用して半球曖昧性を解決するための方法およびシステム
CN115380236B (zh) 2020-01-24 2025-05-06 奇跃公司 使用单个控制器的内容移动和交互

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013507052A (ja) 2009-09-30 2013-02-28 ユナイテッド ビデオ プロパティーズ, インコーポレイテッド 3次元メディアガイダンスアプリケーションをナビゲートするためのシステムおよび方法
WO2014162762A1 (ja) 2013-04-02 2014-10-09 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
JP2017004357A (ja) 2015-06-12 2017-01-05 株式会社コロプラ フローティング・グラフィカルユーザインターフェース
JP2018517967A (ja) 2015-08-26 2018-07-05 グーグル エルエルシー 仮想現実における、頭部、ジェスチャ、およびタッチ入力の動的な切り替えならびにマージ
WO2018195099A1 (en) 2017-04-19 2018-10-25 Magic Leap, Inc. Multimodal task execution and text editing for a wearable system

Also Published As

Publication number Publication date
EP4094119B1 (en) 2026-06-17
JP7788491B2 (ja) 2025-12-18
JP2024105391A (ja) 2024-08-06
CN115380236A (zh) 2022-11-22
US11294461B2 (en) 2022-04-05
EP4094119A4 (en) 2024-04-10
US11619996B2 (en) 2023-04-04
JP2023511905A (ja) 2023-03-23
US20220171457A1 (en) 2022-06-02
US20230214015A1 (en) 2023-07-06
US20210232220A1 (en) 2021-07-29
EP4094119A1 (en) 2022-11-30
US12287916B2 (en) 2025-04-29
CN115380236B (zh) 2025-05-06
WO2021150623A1 (en) 2021-07-29

Similar Documents

Publication Publication Date Title
JP7596436B2 (ja) 深度平面間の低減された切り替えを伴う多深度平面ディスプレイシステム
US11138793B2 (en) Multi-depth plane display system with reduced switching between depth planes
JP7788491B2 (ja) 単一コントローラを使用したコンテンツ移動および相互作用
JP2025092587A (ja) 仮想および拡張現実システムおよび方法
US20220276700A1 (en) Converting a 2d positional input into a 3d point in space
JP7538871B2 (ja) アンカベースのクロスリアリティアプリケーションのための向上された状態制御
JP2023517281A (ja) 仮想および拡張現実ディスプレイシステムのための仮想オブジェクト移動速度曲線

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240119

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240119

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20240119

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240202

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240501

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240514

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240527

R150 Certificate of patent or registration of utility model

Ref document number: 7496424

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150