JP7888462B2 - ウェアラブルシステムのための手およびトーテム入力融合 - Google Patents

ウェアラブルシステムのための手およびトーテム入力融合

Info

Publication number
JP7888462B2
JP7888462B2 JP2022550932A JP2022550932A JP7888462B2 JP 7888462 B2 JP7888462 B2 JP 7888462B2 JP 2022550932 A JP2022550932 A JP 2022550932A JP 2022550932 A JP2022550932 A JP 2022550932A JP 7888462 B2 JP7888462 B2 JP 7888462B2
Authority
JP
Japan
Prior art keywords
hand
handheld device
orientation
posture
difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022550932A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023515526A5 (cg-RX-API-DMAC7.html
JP2023515526A (ja
Inventor
ユー-リン ユージン チャン,
リー ジョナサン ナウ,
アミート ジェイン,
ピーター アンドレアス クリンクミューラー,
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023515526A publication Critical patent/JP2023515526A/ja
Publication of JP2023515526A5 publication Critical patent/JP2023515526A5/ja
Application granted granted Critical
Publication of JP7888462B2 publication Critical patent/JP7888462B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
JP2022550932A 2020-02-26 2021-02-24 ウェアラブルシステムのための手およびトーテム入力融合 Active JP7888462B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062981930P 2020-02-26 2020-02-26
US62/981,930 2020-02-26
PCT/US2021/019483 WO2021173725A1 (en) 2020-02-26 2021-02-24 Hand and totem input fusion for wearable systems

Publications (3)

Publication Number Publication Date
JP2023515526A JP2023515526A (ja) 2023-04-13
JP2023515526A5 JP2023515526A5 (cg-RX-API-DMAC7.html) 2024-02-16
JP7888462B2 true JP7888462B2 (ja) 2026-07-13

Family

ID=77366947

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022550932A Active JP7888462B2 (ja) 2020-02-26 2021-02-24 ウェアラブルシステムのための手およびトーテム入力融合

Country Status (5)

Country Link
US (2) US12061743B2 (cg-RX-API-DMAC7.html)
EP (1) EP4111442B1 (cg-RX-API-DMAC7.html)
JP (1) JP7888462B2 (cg-RX-API-DMAC7.html)
CN (1) CN115176306A (cg-RX-API-DMAC7.html)
WO (1) WO2021173725A1 (cg-RX-API-DMAC7.html)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11320896B2 (en) * 2020-08-03 2022-05-03 Facebook Technologies, Llc. Systems and methods for object tracking using fused data
GB2608186B (en) * 2021-06-25 2026-01-07 Thermoteknix Systems Ltd Augmented Reality System
JP7781663B2 (ja) * 2022-02-09 2025-12-08 本田技研工業株式会社 制御装置
US11815687B2 (en) * 2022-03-02 2023-11-14 Google Llc Controlling head-mounted device with gestures into wearable device
CN116185201A (zh) 2023-03-07 2023-05-30 北京字跳网络技术有限公司 扩展现实交互方法、装置、电子设备和存储介质
US12340628B2 (en) * 2023-03-20 2025-06-24 Htc Corporation Hand tracking method, host, and hand tracking system utilizing a hand-held device
CN116977405B (zh) * 2023-03-31 2025-10-03 广东花至美容科技有限公司 基于电磁的人脸区域定位方法、装置及可穿戴设备

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005165665A (ja) 2003-12-02 2005-06-23 Canon Inc 仮想物体の操作補助装置、方法、コンピュータプログラム、及びコンピュータ読み取り可能な記録媒体
JP4298407B2 (ja) 2002-09-30 2009-07-22 キヤノン株式会社 映像合成装置及び映像合成方法
JP6094782B2 (ja) 2013-08-22 2017-03-15 ソニー株式会社 近距離自然ユーザインタフェースシステム及びその作動の方法
US20170357332A1 (en) 2016-06-09 2017-12-14 Alexandru Octavian Balan Six dof mixed reality input by fusing inertial handheld controller with hand tracking
US20170371403A1 (en) 2015-02-22 2017-12-28 Technion Research & Development Foundation Ltd. Gesture recognition using multi-sensory data
JP6355978B2 (ja) 2014-06-09 2018-07-11 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
WO2019142329A1 (ja) 2018-01-19 2019-07-25 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、情報処理方法、及びプログラム
US20190250708A1 (en) 2018-02-09 2019-08-15 Samsung Electronics Co., Ltd. Method for tracking hand pose and electronic device thereof
JP2019522832A (ja) 2016-04-26 2019-08-15 マジック リープ, インコーポレイテッドMagic Leap,Inc. 拡張現実システムを用いた電磁追跡
WO2019161312A1 (en) 2018-02-15 2019-08-22 Magic Leap, Inc. Mixed reality musical instrument
JP2019139465A (ja) 2018-02-09 2019-08-22 ソニー株式会社 制御装置、制御方法及びプログラム
US20190318501A1 (en) 2018-04-16 2019-10-17 Microsoft Technology Licensing, Llc Tracking pose of handheld object

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160098095A1 (en) * 2004-01-30 2016-04-07 Electronic Scripting Products, Inc. Deriving Input from Six Degrees of Freedom Interfaces
US9111351B2 (en) * 2011-12-15 2015-08-18 Sony Corporation Minimizing drift using depth camera images
US20150247729A1 (en) * 2012-09-04 2015-09-03 Deborah Meduna System and method for device bearing estimation
CN104662435A (zh) * 2012-09-27 2015-05-27 Metaio有限公司 确定与用于捕获至少一个图像的捕获装置关联的装置的位置和方向的方法
US10262462B2 (en) * 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US10180734B2 (en) * 2015-03-05 2019-01-15 Magic Leap, Inc. Systems and methods for augmented reality
US10198874B2 (en) * 2016-05-13 2019-02-05 Google Llc Methods and apparatus to align components in virtual reality environments
US10545584B2 (en) * 2016-05-17 2020-01-28 Google Llc Virtual/augmented reality input device
US10146334B2 (en) 2016-06-09 2018-12-04 Microsoft Technology Licensing, Llc Passive optical and inertial tracking in slim form-factor
US10249090B2 (en) * 2016-06-09 2019-04-02 Microsoft Technology Licensing, Llc Robust optical disambiguation and tracking of two or more hand-held controllers with passive optical and inertial tracking
KR102630774B1 (ko) * 2016-12-29 2024-01-30 매직 립, 인코포레이티드 외부 조건들에 기초한 웨어러블 디스플레이 디바이스의자동 제어
WO2018187171A1 (en) * 2017-04-04 2018-10-11 Usens, Inc. Methods and systems for hand tracking
US10496157B2 (en) * 2017-05-09 2019-12-03 Microsoft Technology Licensing, Llc Controlling handheld object light sources for tracking
EP3542252B1 (en) * 2017-08-10 2023-08-02 Google LLC Context-sensitive hand interaction
US11481030B2 (en) * 2019-03-29 2022-10-25 Meta Platforms Technologies, Llc Methods and apparatus for gesture detection and classification
US11107242B2 (en) * 2019-01-11 2021-08-31 Microsoft Technology Licensing, Llc Detecting pose using floating keypoint(s)
US11340756B2 (en) * 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4298407B2 (ja) 2002-09-30 2009-07-22 キヤノン株式会社 映像合成装置及び映像合成方法
JP2005165665A (ja) 2003-12-02 2005-06-23 Canon Inc 仮想物体の操作補助装置、方法、コンピュータプログラム、及びコンピュータ読み取り可能な記録媒体
JP6094782B2 (ja) 2013-08-22 2017-03-15 ソニー株式会社 近距離自然ユーザインタフェースシステム及びその作動の方法
JP6355978B2 (ja) 2014-06-09 2018-07-11 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
US20170371403A1 (en) 2015-02-22 2017-12-28 Technion Research & Development Foundation Ltd. Gesture recognition using multi-sensory data
JP2019522832A (ja) 2016-04-26 2019-08-15 マジック リープ, インコーポレイテッドMagic Leap,Inc. 拡張現実システムを用いた電磁追跡
US20170357332A1 (en) 2016-06-09 2017-12-14 Alexandru Octavian Balan Six dof mixed reality input by fusing inertial handheld controller with hand tracking
WO2019142329A1 (ja) 2018-01-19 2019-07-25 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、情報処理方法、及びプログラム
US20190250708A1 (en) 2018-02-09 2019-08-15 Samsung Electronics Co., Ltd. Method for tracking hand pose and electronic device thereof
JP2019139465A (ja) 2018-02-09 2019-08-22 ソニー株式会社 制御装置、制御方法及びプログラム
WO2019161312A1 (en) 2018-02-15 2019-08-22 Magic Leap, Inc. Mixed reality musical instrument
US20190318501A1 (en) 2018-04-16 2019-10-17 Microsoft Technology Licensing, Llc Tracking pose of handheld object

Also Published As

Publication number Publication date
US12061743B2 (en) 2024-08-13
CN115176306A (zh) 2022-10-11
US20240370095A1 (en) 2024-11-07
EP4111442A1 (en) 2023-01-04
EP4111442A4 (en) 2023-08-16
EP4111442B1 (en) 2026-07-15
WO2021173725A1 (en) 2021-09-02
US20210263592A1 (en) 2021-08-26
JP2023515526A (ja) 2023-04-13

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240207

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240207

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20240613

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20240626

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20241219

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250121

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250418

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250729

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20251028

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260224

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260521

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20260601

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20260701

R150 Certificate of patent or registration of utility model

Ref document number: 7888462

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150