JP2023515526A - ウェアラブルシステムのための手およびトーテム入力融合 - Google Patents

ウェアラブルシステムのための手およびトーテム入力融合 Download PDF

Info

Publication number
JP2023515526A
JP2023515526A JP2022550932A JP2022550932A JP2023515526A JP 2023515526 A JP2023515526 A JP 2023515526A JP 2022550932 A JP2022550932 A JP 2022550932A JP 2022550932 A JP2022550932 A JP 2022550932A JP 2023515526 A JP2023515526 A JP 2023515526A
Authority
JP
Japan
Prior art keywords
hand
handheld device
pose
pose data
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022550932A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023515526A5 (enExample
Inventor
ユー－リン ユージン チャン，
リー ジョナサン ナウ，
アミート ジェイン，
ピーター アンドレアス クリンクミューラー，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023515526A publication Critical patent/JP2023515526A/ja
Publication of JP2023515526A5 publication Critical patent/JP2023515526A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
JP2022550932A 2020-02-26 2021-02-24 ウェアラブルシステムのための手およびトーテム入力融合 Pending JP2023515526A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062981930P 2020-02-26 2020-02-26
US62/981,930 2020-02-26
PCT/US2021/019483 WO2021173725A1 (en) 2020-02-26 2021-02-24 Hand and totem input fusion for wearable systems

Publications (2)

Publication Number Publication Date
JP2023515526A true JP2023515526A (ja) 2023-04-13
JP2023515526A5 JP2023515526A5 (enExample) 2024-02-16

Family

ID=77366947

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022550932A Pending JP2023515526A (ja) 2020-02-26 2021-02-24 ウェアラブルシステムのための手およびトーテム入力融合

Country Status (5)

Country Link
US (2) US12061743B2 (enExample)
EP (1) EP4111442A4 (enExample)
JP (1) JP2023515526A (enExample)
CN (1) CN115176306A (enExample)
WO (1) WO2021173725A1 (enExample)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11320896B2 (en) * 2020-08-03 2022-05-03 Facebook Technologies, Llc. Systems and methods for object tracking using fused data
GB2608186B (en) * 2021-06-25 2026-01-07 Thermoteknix Systems Ltd Augmented Reality System
JP7781663B2 (ja) * 2022-02-09 2025-12-08 本田技研工業株式会社 制御装置
US11815687B2 (en) * 2022-03-02 2023-11-14 Google Llc Controlling head-mounted device with gestures into wearable device
CN116185201A (zh) 2023-03-07 2023-05-30 北京字跳网络技术有限公司 扩展现实交互方法、装置、电子设备和存储介质
US12340628B2 (en) * 2023-03-20 2025-06-24 Htc Corporation Hand tracking method, host, and hand tracking system utilizing a hand-held device
CN116977405B (zh) * 2023-03-31 2025-10-03 广东花至美容科技有限公司 基于电磁的人脸区域定位方法、装置及可穿戴设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170357332A1 (en) * 2016-06-09 2017-12-14 Alexandru Octavian Balan Six dof mixed reality input by fusing inertial handheld controller with hand tracking
US20170371403A1 (en) * 2015-02-22 2017-12-28 Technion Research & Development Foundation Ltd. Gesture recognition using multi-sensory data
US20190250708A1 (en) * 2018-02-09 2019-08-15 Samsung Electronics Co., Ltd. Method for tracking hand pose and electronic device thereof

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160098095A1 (en) * 2004-01-30 2016-04-07 Electronic Scripting Products, Inc. Deriving Input from Six Degrees of Freedom Interfaces
US9111351B2 (en) * 2011-12-15 2015-08-18 Sony Corporation Minimizing drift using depth camera images
WO2014039552A1 (en) * 2012-09-04 2014-03-13 Sensor Platforms, Inc. System and method for estimating the direction of motion of an entity associated with a device
WO2014048475A1 (en) * 2012-09-27 2014-04-03 Metaio Gmbh Method of determining a position and orientation of a device associated with a capturing device for capturing at least one image
US10262462B2 (en) * 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US10180734B2 (en) * 2015-03-05 2019-01-15 Magic Leap, Inc. Systems and methods for augmented reality
NZ747815A (en) * 2016-04-26 2023-05-26 Magic Leap Inc Electromagnetic tracking with augmented reality systems
US10198874B2 (en) * 2016-05-13 2019-02-05 Google Llc Methods and apparatus to align components in virtual reality environments
US10545584B2 (en) * 2016-05-17 2020-01-28 Google Llc Virtual/augmented reality input device
US10249090B2 (en) * 2016-06-09 2019-04-02 Microsoft Technology Licensing, Llc Robust optical disambiguation and tracking of two or more hand-held controllers with passive optical and inertial tracking
US10146334B2 (en) 2016-06-09 2018-12-04 Microsoft Technology Licensing, Llc Passive optical and inertial tracking in slim form-factor
EP3563215A4 (en) * 2016-12-29 2020-08-05 Magic Leap, Inc. AUTOMATIC CONTROL OF A WEARABLE DISPLAY DEVICE BASED ON EXTERNAL CONDITIONS
WO2018187171A1 (en) * 2017-04-04 2018-10-11 Usens, Inc. Methods and systems for hand tracking
US10503247B2 (en) * 2017-05-09 2019-12-10 Microsoft Technology Licensing, Llc Calibration of stereo cameras and handheld object
EP3542252B1 (en) * 2017-08-10 2023-08-02 Google LLC Context-sensitive hand interaction
US11302029B2 (en) * 2018-01-19 2022-04-12 Sony Interactive Entertainment Inc. Information processing apparatus, information processing system, information processing method, and program
US11481030B2 (en) * 2019-03-29 2022-10-25 Meta Platforms Technologies, Llc Methods and apparatus for gesture detection and classification
US10740924B2 (en) * 2018-04-16 2020-08-11 Microsoft Technology Licensing, Llc Tracking pose of handheld object
US11107242B2 (en) * 2019-01-11 2021-08-31 Microsoft Technology Licensing, Llc Detecting pose using floating keypoint(s)
US11340756B2 (en) * 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170371403A1 (en) * 2015-02-22 2017-12-28 Technion Research & Development Foundation Ltd. Gesture recognition using multi-sensory data
US20170357332A1 (en) * 2016-06-09 2017-12-14 Alexandru Octavian Balan Six dof mixed reality input by fusing inertial handheld controller with hand tracking
US20190250708A1 (en) * 2018-02-09 2019-08-15 Samsung Electronics Co., Ltd. Method for tracking hand pose and electronic device thereof

Also Published As

Publication number Publication date
US20240370095A1 (en) 2024-11-07
US12061743B2 (en) 2024-08-13
US20210263592A1 (en) 2021-08-26
WO2021173725A1 (en) 2021-09-02
EP4111442A4 (en) 2023-08-16
EP4111442A1 (en) 2023-01-04
CN115176306A (zh) 2022-10-11

Similar Documents

Publication Publication Date Title
US12061743B2 (en) Hand and totem input fusion for wearable systems
JP7592024B2 (ja) 電磁追跡のためのセンサ融合
JP6785385B2 (ja) 周辺デバイスの視覚的追跡
JP7455121B2 (ja) 電磁追跡のための周囲電磁歪み補正
US11709544B2 (en) Pose estimation using electromagnetic tracking
CN108139815B (zh) 用于虚拟现实内容的显示的场景和对象的分立时间扭曲
US11994676B2 (en) Method and system for resolving hemisphere ambiguity in six degree of freedom pose measurements

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240207

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240207

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20240613

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20240626

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20241219

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250121

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250418

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250729

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20251028

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260224