JP7888462B2 - ウェアラブルシステムのための手およびトーテム入力融合 - Google Patents
ウェアラブルシステムのための手およびトーテム入力融合Info
- Publication number
- JP7888462B2 JP7888462B2 JP2022550932A JP2022550932A JP7888462B2 JP 7888462 B2 JP7888462 B2 JP 7888462B2 JP 2022550932 A JP2022550932 A JP 2022550932A JP 2022550932 A JP2022550932 A JP 2022550932A JP 7888462 B2 JP7888462 B2 JP 7888462B2
- Authority
- JP
- Japan
- Prior art keywords
- hand
- handheld device
- orientation
- posture
- difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202062981930P | 2020-02-26 | 2020-02-26 | |
| US62/981,930 | 2020-02-26 | ||
| PCT/US2021/019483 WO2021173725A1 (en) | 2020-02-26 | 2021-02-24 | Hand and totem input fusion for wearable systems |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2023515526A JP2023515526A (ja) | 2023-04-13 |
| JP2023515526A5 JP2023515526A5 (cg-RX-API-DMAC7.html) | 2024-02-16 |
| JP7888462B2 true JP7888462B2 (ja) | 2026-07-13 |
Family
ID=77366947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2022550932A Active JP7888462B2 (ja) | 2020-02-26 | 2021-02-24 | ウェアラブルシステムのための手およびトーテム入力融合 |
Country Status (5)
| Country | Link |
|---|---|
| US (2) | US12061743B2 (cg-RX-API-DMAC7.html) |
| EP (1) | EP4111442B1 (cg-RX-API-DMAC7.html) |
| JP (1) | JP7888462B2 (cg-RX-API-DMAC7.html) |
| CN (1) | CN115176306A (cg-RX-API-DMAC7.html) |
| WO (1) | WO2021173725A1 (cg-RX-API-DMAC7.html) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11320896B2 (en) * | 2020-08-03 | 2022-05-03 | Facebook Technologies, Llc. | Systems and methods for object tracking using fused data |
| GB2608186B (en) * | 2021-06-25 | 2026-01-07 | Thermoteknix Systems Ltd | Augmented Reality System |
| JP7781663B2 (ja) * | 2022-02-09 | 2025-12-08 | 本田技研工業株式会社 | 制御装置 |
| US11815687B2 (en) * | 2022-03-02 | 2023-11-14 | Google Llc | Controlling head-mounted device with gestures into wearable device |
| CN116185201A (zh) | 2023-03-07 | 2023-05-30 | 北京字跳网络技术有限公司 | 扩展现实交互方法、装置、电子设备和存储介质 |
| US12340628B2 (en) * | 2023-03-20 | 2025-06-24 | Htc Corporation | Hand tracking method, host, and hand tracking system utilizing a hand-held device |
| CN116977405B (zh) * | 2023-03-31 | 2025-10-03 | 广东花至美容科技有限公司 | 基于电磁的人脸区域定位方法、装置及可穿戴设备 |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005165665A (ja) | 2003-12-02 | 2005-06-23 | Canon Inc | 仮想物体の操作補助装置、方法、コンピュータプログラム、及びコンピュータ読み取り可能な記録媒体 |
| JP4298407B2 (ja) | 2002-09-30 | 2009-07-22 | キヤノン株式会社 | 映像合成装置及び映像合成方法 |
| JP6094782B2 (ja) | 2013-08-22 | 2017-03-15 | ソニー株式会社 | 近距離自然ユーザインタフェースシステム及びその作動の方法 |
| US20170357332A1 (en) | 2016-06-09 | 2017-12-14 | Alexandru Octavian Balan | Six dof mixed reality input by fusing inertial handheld controller with hand tracking |
| US20170371403A1 (en) | 2015-02-22 | 2017-12-28 | Technion Research & Development Foundation Ltd. | Gesture recognition using multi-sensory data |
| JP6355978B2 (ja) | 2014-06-09 | 2018-07-11 | 株式会社バンダイナムコエンターテインメント | プログラムおよび画像生成装置 |
| WO2019142329A1 (ja) | 2018-01-19 | 2019-07-25 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置、情報処理システム、情報処理方法、及びプログラム |
| US20190250708A1 (en) | 2018-02-09 | 2019-08-15 | Samsung Electronics Co., Ltd. | Method for tracking hand pose and electronic device thereof |
| JP2019522832A (ja) | 2016-04-26 | 2019-08-15 | マジック リープ, インコーポレイテッドMagic Leap,Inc. | 拡張現実システムを用いた電磁追跡 |
| WO2019161312A1 (en) | 2018-02-15 | 2019-08-22 | Magic Leap, Inc. | Mixed reality musical instrument |
| JP2019139465A (ja) | 2018-02-09 | 2019-08-22 | ソニー株式会社 | 制御装置、制御方法及びプログラム |
| US20190318501A1 (en) | 2018-04-16 | 2019-10-17 | Microsoft Technology Licensing, Llc | Tracking pose of handheld object |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160098095A1 (en) * | 2004-01-30 | 2016-04-07 | Electronic Scripting Products, Inc. | Deriving Input from Six Degrees of Freedom Interfaces |
| US9111351B2 (en) * | 2011-12-15 | 2015-08-18 | Sony Corporation | Minimizing drift using depth camera images |
| US20150247729A1 (en) * | 2012-09-04 | 2015-09-03 | Deborah Meduna | System and method for device bearing estimation |
| CN104662435A (zh) * | 2012-09-27 | 2015-05-27 | Metaio有限公司 | 确定与用于捕获至少一个图像的捕获装置关联的装置的位置和方向的方法 |
| US10262462B2 (en) * | 2014-04-18 | 2019-04-16 | Magic Leap, Inc. | Systems and methods for augmented and virtual reality |
| US10180734B2 (en) * | 2015-03-05 | 2019-01-15 | Magic Leap, Inc. | Systems and methods for augmented reality |
| US10198874B2 (en) * | 2016-05-13 | 2019-02-05 | Google Llc | Methods and apparatus to align components in virtual reality environments |
| US10545584B2 (en) * | 2016-05-17 | 2020-01-28 | Google Llc | Virtual/augmented reality input device |
| US10146334B2 (en) | 2016-06-09 | 2018-12-04 | Microsoft Technology Licensing, Llc | Passive optical and inertial tracking in slim form-factor |
| US10249090B2 (en) * | 2016-06-09 | 2019-04-02 | Microsoft Technology Licensing, Llc | Robust optical disambiguation and tracking of two or more hand-held controllers with passive optical and inertial tracking |
| KR102630774B1 (ko) * | 2016-12-29 | 2024-01-30 | 매직 립, 인코포레이티드 | 외부 조건들에 기초한 웨어러블 디스플레이 디바이스의자동 제어 |
| WO2018187171A1 (en) * | 2017-04-04 | 2018-10-11 | Usens, Inc. | Methods and systems for hand tracking |
| US10496157B2 (en) * | 2017-05-09 | 2019-12-03 | Microsoft Technology Licensing, Llc | Controlling handheld object light sources for tracking |
| EP3542252B1 (en) * | 2017-08-10 | 2023-08-02 | Google LLC | Context-sensitive hand interaction |
| US11481030B2 (en) * | 2019-03-29 | 2022-10-25 | Meta Platforms Technologies, Llc | Methods and apparatus for gesture detection and classification |
| US11107242B2 (en) * | 2019-01-11 | 2021-08-31 | Microsoft Technology Licensing, Llc | Detecting pose using floating keypoint(s) |
| US11340756B2 (en) * | 2019-09-27 | 2022-05-24 | Apple Inc. | Devices, methods, and graphical user interfaces for interacting with three-dimensional environments |
-
2021
- 2021-02-24 EP EP21760169.9A patent/EP4111442B1/en active Active
- 2021-02-24 WO PCT/US2021/019483 patent/WO2021173725A1/en not_active Ceased
- 2021-02-24 CN CN202180016973.2A patent/CN115176306A/zh active Pending
- 2021-02-24 US US17/184,473 patent/US12061743B2/en active Active
- 2021-02-24 JP JP2022550932A patent/JP7888462B2/ja active Active
-
2024
- 2024-07-11 US US18/769,763 patent/US20240370095A1/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4298407B2 (ja) | 2002-09-30 | 2009-07-22 | キヤノン株式会社 | 映像合成装置及び映像合成方法 |
| JP2005165665A (ja) | 2003-12-02 | 2005-06-23 | Canon Inc | 仮想物体の操作補助装置、方法、コンピュータプログラム、及びコンピュータ読み取り可能な記録媒体 |
| JP6094782B2 (ja) | 2013-08-22 | 2017-03-15 | ソニー株式会社 | 近距離自然ユーザインタフェースシステム及びその作動の方法 |
| JP6355978B2 (ja) | 2014-06-09 | 2018-07-11 | 株式会社バンダイナムコエンターテインメント | プログラムおよび画像生成装置 |
| US20170371403A1 (en) | 2015-02-22 | 2017-12-28 | Technion Research & Development Foundation Ltd. | Gesture recognition using multi-sensory data |
| JP2019522832A (ja) | 2016-04-26 | 2019-08-15 | マジック リープ, インコーポレイテッドMagic Leap,Inc. | 拡張現実システムを用いた電磁追跡 |
| US20170357332A1 (en) | 2016-06-09 | 2017-12-14 | Alexandru Octavian Balan | Six dof mixed reality input by fusing inertial handheld controller with hand tracking |
| WO2019142329A1 (ja) | 2018-01-19 | 2019-07-25 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置、情報処理システム、情報処理方法、及びプログラム |
| US20190250708A1 (en) | 2018-02-09 | 2019-08-15 | Samsung Electronics Co., Ltd. | Method for tracking hand pose and electronic device thereof |
| JP2019139465A (ja) | 2018-02-09 | 2019-08-22 | ソニー株式会社 | 制御装置、制御方法及びプログラム |
| WO2019161312A1 (en) | 2018-02-15 | 2019-08-22 | Magic Leap, Inc. | Mixed reality musical instrument |
| US20190318501A1 (en) | 2018-04-16 | 2019-10-17 | Microsoft Technology Licensing, Llc | Tracking pose of handheld object |
Also Published As
| Publication number | Publication date |
|---|---|
| US12061743B2 (en) | 2024-08-13 |
| CN115176306A (zh) | 2022-10-11 |
| US20240370095A1 (en) | 2024-11-07 |
| EP4111442A1 (en) | 2023-01-04 |
| EP4111442A4 (en) | 2023-08-16 |
| EP4111442B1 (en) | 2026-07-15 |
| WO2021173725A1 (en) | 2021-09-02 |
| US20210263592A1 (en) | 2021-08-26 |
| JP2023515526A (ja) | 2023-04-13 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240207 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20240207 |
|
| RD03 | Notification of appointment of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7423 Effective date: 20240613 |
|
| RD04 | Notification of resignation of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7424 Effective date: 20240626 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20241219 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20250121 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20250418 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20250729 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20251028 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20260224 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20260521 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20260601 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20260701 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 7888462 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |