JP7496424B2 - 単一コントローラを使用したコンテンツ移動および相互作用 - Google Patents

単一コントローラを使用したコンテンツ移動および相互作用 Download PDF

Info

Publication number
JP7496424B2
JP7496424B2 JP2022544290A JP2022544290A JP7496424B2 JP 7496424 B2 JP7496424 B2 JP 7496424B2 JP 2022544290 A JP2022544290 A JP 2022544290A JP 2022544290 A JP2022544290 A JP 2022544290A JP 7496424 B2 JP7496424 B2 JP 7496424B2
Authority
JP
Japan
Prior art keywords
user
content
interactive content
location
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022544290A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023511905A5 (https=
JP2023511905A (ja
Inventor
カレン ストールゼンバーグ，
マーク アラン マッコール，
フランク アレクサンダー ザ フォース ハミルトン，
コール パーカー ハイナー，
ジョン オースティン デイ，
エリック ノーマン イスキス，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023511905A publication Critical patent/JP2023511905A/ja
Publication of JP2023511905A5 publication Critical patent/JP2023511905A5/ja
Priority to JP2024074313A priority Critical patent/JP7788491B2/ja
Application granted granted Critical
Publication of JP7496424B2 publication Critical patent/JP7496424B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
JP2022544290A 2020-01-24 2021-01-20 単一コントローラを使用したコンテンツ移動および相互作用 Active JP7496424B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024074313A JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062965708P 2020-01-24 2020-01-24
US62/965,708 2020-01-24
PCT/US2021/014208 WO2021150623A1 (en) 2020-01-24 2021-01-20 Content movement and interaction using a single controller

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024074313A Division JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Publications (3)

Publication Number Publication Date
JP2023511905A JP2023511905A (ja) 2023-03-23
JP2023511905A5 JP2023511905A5 (https=) 2024-01-29
JP7496424B2 true JP7496424B2 (ja) 2024-06-06

Family

ID=76971189

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022544290A Active JP7496424B2 (ja) 2020-01-24 2021-01-20 単一コントローラを使用したコンテンツ移動および相互作用
JP2024074313A Active JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024074313A Active JP7788491B2 (ja) 2020-01-24 2024-05-01 単一コントローラを使用したコンテンツ移動および相互作用

Country Status (5)

Country Link
US (3) US11294461B2 (https=)
EP (1) EP4094119A4 (https=)
JP (2) JP7496424B2 (https=)
CN (1) CN115380236B (https=)
WO (1) WO2021150623A1 (https=)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115380236B (zh) 2020-01-24 2025-05-06 奇跃公司 使用单个控制器的内容移动和交互
JP7603724B2 (ja) * 2021-02-04 2024-12-20 株式会社ソニー・インタラクティブエンタテインメント 情報処理システム、情報処理装置、情報処理装置の制御方法、及びプログラム
US12353673B2 (en) 2022-07-15 2025-07-08 Samsung Electronics Co., Ltd. Control-deck graphical user interface in XR
US20240386817A1 (en) * 2023-05-15 2024-11-21 Apple Inc. Head mountable display
IT202300019182A1 (it) * 2023-09-19 2025-03-19 Khymeia S R L Apparato di interazione virtuale

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013507052A (ja) 2009-09-30 2013-02-28 ユナイテッド ビデオ プロパティーズ， インコーポレイテッド ３次元メディアガイダンスアプリケーションをナビゲートするためのシステムおよび方法
WO2014162762A1 (ja) 2013-04-02 2014-10-09 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
JP2017004357A (ja) 2015-06-12 2017-01-05 株式会社コロプラ フローティング・グラフィカルユーザインターフェース
JP2018517967A (ja) 2015-08-26 2018-07-05 グーグル エルエルシー 仮想現実における、頭部、ジェスチャ、およびタッチ入力の動的な切り替えならびにマージ
WO2018195099A1 (en) 2017-04-19 2018-10-25 Magic Leap, Inc. Multimodal task execution and text editing for a wearable system

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
US6091395A (en) * 1997-12-15 2000-07-18 International Business Machines Corporation Computer system and method of manipulating a graphical user interface component on a computer display through collision with a pointer
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8314789B2 (en) * 2007-09-26 2012-11-20 Autodesk, Inc. Navigation system for a 3D virtual scene
US20120249797A1 (en) * 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
KR101171660B1 (ko) 2010-03-01 2012-08-09 이문기 증강현실의 포인팅 장치
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
NZ706893A (en) 2010-12-24 2017-02-24 Magic Leap Inc An ergonomic head mounted display device and optical system
CA3035118C (en) 2011-05-06 2022-01-04 Magic Leap, Inc. Massive simultaneous remote digital presence world
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
US9255813B2 (en) * 2011-10-14 2016-02-09 Microsoft Technology Licensing, Llc User controlled real object disappearance in a mixed reality display
RU2017115669A (ru) 2011-10-28 2019-01-28 Мэджик Лип, Инк. Система и способ для дополненной и виртуальной реальности
JP5938977B2 (ja) * 2012-03-23 2016-06-22 ソニー株式会社 ヘッドマウントディスプレイ及び手術システム
US8795080B1 (en) * 2012-03-30 2014-08-05 Zynga Inc. Gaming platform providing a game action sweep mechanic
BR112014024941A2 (pt) 2012-04-05 2017-09-19 Magic Leap Inc dispositivo de imagem de campo de visão amplo com capacidade de focalização ativa
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
JP2015534108A (ja) 2012-09-11 2015-11-26 マジック リープ， インコーポレイテッド 人間工学的な頭部搭載型ディスプレイデバイスおよび光学システム
JP2014127987A (ja) * 2012-12-27 2014-07-07 Sony Corp 情報処理装置および記録媒体
CN105229719B (zh) 2013-03-15 2018-04-27 奇跃公司 显示系统和方法
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US9129430B2 (en) * 2013-06-25 2015-09-08 Microsoft Technology Licensing, Llc Indicating out-of-view augmented reality images
EP3058418B1 (en) 2013-10-16 2023-10-04 Magic Leap, Inc. Virtual or augmented reality headsets having adjustable interpupillary distance
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
KR102651578B1 (ko) 2013-11-27 2024-03-25 매직 립, 인코포레이티드 가상 및 증강 현실 시스템들 및 방법들
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP3140779A4 (en) 2014-05-09 2017-11-29 Google LLC Systems and methods for using eye signals with secure mobile communications
EP3023863A1 (en) * 2014-11-20 2016-05-25 Thomson Licensing Device and method for processing visual data, and related computer program product
CN105425955A (zh) * 2015-11-06 2016-03-23 中国矿业大学 多用户沉浸式全互动虚拟现实工程培训系统
KR102438052B1 (ko) * 2016-03-31 2022-08-29 매직 립, 인코포레이티드 포즈들 및 멀티-dof 제어기들을 사용하는 3d 가상 객체들과 상호작용들
CN109478101B (zh) 2016-07-22 2022-05-03 谷歌有限责任公司 用于为虚拟现实用户界面检测运动范围的方法和系统
US10290152B2 (en) 2017-04-03 2019-05-14 Microsoft Technology Licensing, Llc Virtual object user interface display
CN119919611A (zh) 2017-12-22 2025-05-02 奇跃公司 用于在混合现实系统中管理和显示虚拟内容的方法和系统
US10540941B2 (en) * 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
KR102689931B1 (ko) 2018-02-06 2024-07-29 매직 립, 인코포레이티드 증강 현실을 위한 시스템들 및 방법들
US11875012B2 (en) 2018-05-25 2024-01-16 Ultrahaptics IP Two Limited Throwable interface for augmented reality and virtual reality environments
JP7136931B2 (ja) 2018-06-05 2022-09-13 マジック リープ， インコーポレイテッド 空間３ｄ環境へのコンテンツのマッチング
CN116300091A (zh) 2018-07-23 2023-06-23 奇跃公司 用于使用位置向量解析半球模糊度的方法和系统
CN115380236B (zh) 2020-01-24 2025-05-06 奇跃公司 使用单个控制器的内容移动和交互

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013507052A (ja) 2009-09-30 2013-02-28 ユナイテッド ビデオ プロパティーズ， インコーポレイテッド ３次元メディアガイダンスアプリケーションをナビゲートするためのシステムおよび方法
WO2014162762A1 (ja) 2013-04-02 2014-10-09 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
JP2017004357A (ja) 2015-06-12 2017-01-05 株式会社コロプラ フローティング・グラフィカルユーザインターフェース
JP2018517967A (ja) 2015-08-26 2018-07-05 グーグル エルエルシー 仮想現実における、頭部、ジェスチャ、およびタッチ入力の動的な切り替えならびにマージ
WO2018195099A1 (en) 2017-04-19 2018-10-25 Magic Leap, Inc. Multimodal task execution and text editing for a wearable system

Also Published As

Publication number Publication date
US20220171457A1 (en) 2022-06-02
US11619996B2 (en) 2023-04-04
CN115380236B (zh) 2025-05-06
EP4094119A1 (en) 2022-11-30
US20210232220A1 (en) 2021-07-29
JP7788491B2 (ja) 2025-12-18
JP2023511905A (ja) 2023-03-23
EP4094119A4 (en) 2024-04-10
US12287916B2 (en) 2025-04-29
US20230214015A1 (en) 2023-07-06
WO2021150623A1 (en) 2021-07-29
JP2024105391A (ja) 2024-08-06
US11294461B2 (en) 2022-04-05
CN115380236A (zh) 2022-11-22

Similar Documents

Publication Publication Date Title
JP7596436B2 (ja) 深度平面間の低減された切り替えを伴う多深度平面ディスプレイシステム
JP7788491B2 (ja) 単一コントローラを使用したコンテンツ移動および相互作用
US11138793B2 (en) Multi-depth plane display system with reduced switching between depth planes
JP2025092587A (ja) 仮想および拡張現実システムおよび方法
JP7538871B2 (ja) アンカベースのクロスリアリティアプリケーションのための向上された状態制御
JP2023517281A (ja) 仮想および拡張現実ディスプレイシステムのための仮想オブジェクト移動速度曲線

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240119

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240119

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20240119

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240202

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240501

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240514

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240527

R150 Certificate of patent or registration of utility model

Ref document number: 7496424

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150