JPWO2021173839A5 - - Google Patents

Download PDF

Info

Publication number
JPWO2021173839A5
JPWO2021173839A5 JP2022550931A JP2022550931A JPWO2021173839A5 JP WO2021173839 A5 JPWO2021173839 A5 JP WO2021173839A5 JP 2022550931 A JP2022550931 A JP 2022550931A JP 2022550931 A JP2022550931 A JP 2022550931A JP WO2021173839 A5 JPWO2021173839 A5 JP WO2021173839A5
Authority
JP
Japan
Prior art keywords
user
feature points
gesture
location
hand
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2022550931A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023515525A (ja
JP7731362B2 (ja
JP2023515525A5 (https=
Publication date
Application filed filed Critical
Priority claimed from PCT/US2021/019677 external-priority patent/WO2021173839A1/en
Publication of JP2023515525A publication Critical patent/JP2023515525A/ja
Publication of JP2023515525A5 publication Critical patent/JP2023515525A5/ja
Publication of JPWO2021173839A5 publication Critical patent/JPWO2021173839A5/ja
Priority to JP2025136614A priority Critical patent/JP2025186251A/ja
Application granted granted Critical
Publication of JP7731362B2 publication Critical patent/JP7731362B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

JP2022550931A 2020-02-26 2021-02-25 ウェアラブルシステムのための手のジェスチャ入力 Active JP7731362B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025136614A JP2025186251A (ja) 2020-02-26 2025-08-19 ウェアラブルシステムのための手のジェスチャ入力

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202062981934P 2020-02-26 2020-02-26
US62/981,934 2020-02-26
US202063027272P 2020-05-19 2020-05-19
US63/027,272 2020-05-19
PCT/US2021/019677 WO2021173839A1 (en) 2020-02-26 2021-02-25 Hand gesture input for wearable system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025136614A Division JP2025186251A (ja) 2020-02-26 2025-08-19 ウェアラブルシステムのための手のジェスチャ入力

Publications (4)

Publication Number Publication Date
JP2023515525A JP2023515525A (ja) 2023-04-13
JP2023515525A5 JP2023515525A5 (https=) 2024-02-13
JPWO2021173839A5 true JPWO2021173839A5 (https=) 2024-02-13
JP7731362B2 JP7731362B2 (ja) 2025-08-29

Family

ID=77365449

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022550931A Active JP7731362B2 (ja) 2020-02-26 2021-02-25 ウェアラブルシステムのための手のジェスチャ入力
JP2025136614A Pending JP2025186251A (ja) 2020-02-26 2025-08-19 ウェアラブルシステムのための手のジェスチャ入力

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2025136614A Pending JP2025186251A (ja) 2020-02-26 2025-08-19 ウェアラブルシステムのための手のジェスチャ入力

Country Status (5)

Country Link
US (2) US11983326B2 (https=)
EP (1) EP4111291A4 (https=)
JP (2) JP7731362B2 (https=)
CN (1) CN115443445A (https=)
WO (1) WO2021173839A1 (https=)

Families Citing this family (89)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2020105606A1 (ja) * 2018-11-21 2021-09-30 ソニーグループ株式会社 表示制御装置、表示装置、表示制御方法及びプログラム
US11442549B1 (en) * 2019-02-07 2022-09-13 Apple Inc. Placement of 3D effects based on 2D paintings
US11275453B1 (en) 2019-09-30 2022-03-15 Snap Inc. Smart ring for manipulating virtual objects displayed by a wearable device
US11983326B2 (en) 2020-02-26 2024-05-14 Magic Leap, Inc. Hand gesture input for wearable system
US11277597B1 (en) 2020-03-31 2022-03-15 Snap Inc. Marker-based guided AR experience
US11798429B1 (en) 2020-05-04 2023-10-24 Snap Inc. Virtual tutorials for musical instruments with finger tracking in augmented reality
US11520399B2 (en) 2020-05-26 2022-12-06 Snap Inc. Interactive augmented reality experiences using positional tracking
US11475634B2 (en) 2020-07-02 2022-10-18 Meta Platforms Technologies, Llc Generating an extended-reality lobby window for communication between networking system users
US11302063B2 (en) 2020-07-21 2022-04-12 Facebook Technologies, Llc 3D conversations in an artificial reality environment
CN116719413A (zh) 2020-09-11 2023-09-08 苹果公司 用于操纵环境中的对象的方法
US11925863B2 (en) 2020-09-18 2024-03-12 Snap Inc. Tracking hand gestures for interactive game control in augmented reality
US12236546B1 (en) 2020-09-24 2025-02-25 Apple Inc. Object manipulations with a pointing device
EP4718404A2 (en) 2020-09-25 2026-04-01 Apple Inc. Methods for manipulating objects in an environment
WO2022067342A2 (en) 2020-09-25 2022-03-31 Apple Inc. Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments
US11520456B2 (en) 2020-09-25 2022-12-06 Apple Inc. Methods for adjusting and/or controlling immersion associated with user interfaces
US11556172B1 (en) * 2020-12-22 2023-01-17 Meta Platforms Technologies, Llc Viewpoint coordination on artificial reality models
CN116724285A (zh) 2020-12-29 2023-09-08 美国斯耐普公司 用于控制虚拟和图形元素的微手势
WO2022146673A1 (en) 2020-12-30 2022-07-07 Snap Inc. Augmented reality precision tracking and display
CN116670627A (zh) 2020-12-31 2023-08-29 苹果公司 对环境中的用户界面进行分组的方法
US11995230B2 (en) 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
US11531402B1 (en) 2021-02-25 2022-12-20 Snap Inc. Bimanual gestures for controlling virtual and graphical elements
US11908243B2 (en) * 2021-03-16 2024-02-20 Snap Inc. Menu hierarchy navigation on electronic mirroring devices
EP4295218A1 (en) 2021-03-22 2023-12-27 Apple Inc. Methods for manipulating objects in an environment
EP4320502A1 (en) * 2021-04-08 2024-02-14 Snap, Inc. Bimanual interactions between mapped hand regions for controlling virtual and graphical elements
CN117178247A (zh) 2021-04-19 2023-12-05 斯纳普公司 用于动画化及控制虚拟和图形元素的手势
US11461962B1 (en) 2021-06-28 2022-10-04 Meta Platforms Technologies, Llc Holographic calling for artificial reality
US12554221B2 (en) 2021-06-28 2026-02-17 Meta Platforms Technologies, Llc Holographic calling for artificial reality
US12099327B2 (en) 2021-06-28 2024-09-24 Meta Platforms Technologies, Llc Holographic calling for artificial reality
US12288285B2 (en) 2021-07-28 2025-04-29 Apple Inc. System and method for interactive three-dimensional preview
US12242706B2 (en) 2021-07-28 2025-03-04 Apple Inc. Devices, methods and graphical user interfaces for three-dimensional preview of objects
CN113885695A (zh) * 2021-08-12 2022-01-04 青岛小鸟看看科技有限公司 基于人工现实的手势交互方法、系统
US11831814B2 (en) 2021-09-03 2023-11-28 Meta Platforms Technologies, Llc Parallel video call and artificial reality spaces
KR20260006060A (ko) 2021-09-25 2026-01-12 애플 인크. 가상 환경들에서 가상 객체들을 제시하기 위한 디바이스들, 방법들, 및 그래픽 사용자 인터페이스들
US11921970B1 (en) 2021-10-11 2024-03-05 Meta Platforms Technologies, Llc Coordinating virtual interactions with a mini-map
CN114063772B (zh) * 2021-10-26 2024-05-31 深圳市鸿合创新信息技术有限责任公司 手势识别方法、装置、设备及介质
KR20230072757A (ko) * 2021-11-18 2023-05-25 삼성전자주식회사 웨어러블 전자 장치 및 웨어러블 전자 장치의 동작 방법
US12456271B1 (en) 2021-11-19 2025-10-28 Apple Inc. System and method of three-dimensional object cleanup and text annotation
US11676329B1 (en) 2022-01-07 2023-06-13 Meta Platforms Technologies, Llc Mobile device holographic calling with front and back camera capture
EP4463754A1 (en) 2022-01-12 2024-11-20 Apple Inc. Methods for displaying, selecting and moving objects and containers in an environment
JP7843357B2 (ja) 2022-01-19 2026-04-09 アップル インコーポレイテッド 環境内にオブジェクトを表示及び再位置決めするための方法
US12321468B2 (en) 2022-02-02 2025-06-03 Meta Platforms Technologies, Llc Obscuring objects in data streams using machine learning
US12541280B2 (en) 2022-02-28 2026-02-03 Apple Inc. System and method of three-dimensional placement and refinement in multi-user communication sessions
US12272005B2 (en) 2022-02-28 2025-04-08 Apple Inc. System and method of three-dimensional immersive applications in multi-user communication sessions
US11815687B2 (en) * 2022-03-02 2023-11-14 Google Llc Controlling head-mounted device with gestures into wearable device
US12321666B2 (en) 2022-04-04 2025-06-03 Apple Inc. Methods for quick message response and dictation in a three-dimensional environment
CN119404170A (zh) 2022-04-20 2025-02-07 苹果公司 三维环境中的被遮蔽对象
JP7837043B2 (ja) * 2022-05-02 2026-03-30 ディープインサイト株式会社 コンピュータプログラム、画像処理装置、画像処理方法及び車載インタフェース装置
CN114911384B (zh) * 2022-05-07 2023-05-12 青岛海信智慧生活科技股份有限公司 镜子显示器及其远程控制方法
US20230377300A1 (en) 2022-05-17 2023-11-23 Apple Inc. Systems, methods, and user interfaces for generating a three-dimensional virtual representation of an object
US12212705B2 (en) 2022-06-15 2025-01-28 Meta Platforms Technologies, Llc Controlling an augmented call based on user gaze
US11687228B1 (en) * 2022-06-17 2023-06-27 Truist Bank Drag and drop functions to start the process of applying for financial services
US12394167B1 (en) 2022-06-30 2025-08-19 Apple Inc. Window resizing and virtual object rearrangement in 3D environments
KR102844226B1 (ko) * 2022-07-29 2025-08-11 서울대학교산학협력단 건설 현장 작업지시를 위한 증강현실 기반 작업자 로봇 인터페이스 장치
CN115344121A (zh) * 2022-08-10 2022-11-15 北京字跳网络技术有限公司 用于处理手势事件的方法、装置、设备和存储介质
US12200409B2 (en) 2022-08-26 2025-01-14 Meta Platforms Technologies, Llc Authentic eye region capture through artificial reality headset
US12518490B2 (en) 2022-08-31 2026-01-06 Snap Inc. Wrist rotation manipulation of virtual objects
CN119790369A (zh) * 2022-09-07 2025-04-08 索尼集团公司 信息处理装置及信息处理方法
US12112011B2 (en) 2022-09-16 2024-10-08 Apple Inc. System and method of application-based three-dimensional refinement in multi-user communication sessions
US12510973B2 (en) * 2022-09-23 2025-12-30 Apple Inc. Motion mapping for continuous gestures using user-centric coordinate system
US12405704B1 (en) 2022-09-23 2025-09-02 Apple Inc. Interpreting user movement as direct touch user interface interactions
CN119923616A (zh) * 2022-09-23 2025-05-02 苹果公司 用于操纵虚拟对象的方法
WO2024064950A1 (en) 2022-09-24 2024-03-28 Apple Inc. Methods for time of day adjustments for environments and environment presentation during communication sessions
US20240233288A1 (en) 2022-09-24 2024-07-11 Apple Inc. Methods for controlling and interacting with a three-dimensional environment
US20240103704A1 (en) 2022-09-24 2024-03-28 Apple Inc. Methods for interacting with user interfaces based on attention
US12536762B2 (en) 2022-09-24 2026-01-27 Apple Inc. Systems and methods of creating and editing virtual objects using voxels
US20240161651A1 (en) * 2022-11-11 2024-05-16 VoiceSign LLC Sign to speech device
US20240161419A1 (en) * 2022-11-14 2024-05-16 Rockwell Automation Technologies, Inc. Virtual object interaction in augmented reality
US12437491B2 (en) 2022-12-13 2025-10-07 Snap Inc. Scaling a 3D volume in extended reality
CN116126143A (zh) * 2023-01-10 2023-05-16 北京字跳网络技术有限公司 交互方法、装置、电子设备、存储介质及程序产品
CN120813918A (zh) 2023-01-30 2025-10-17 苹果公司 用于响应于注视和/或手势输入来显示多组控件的设备、方法和图形用户界面
US12536750B1 (en) 2023-02-06 2026-01-27 Meta Platforms Technologies, Llc Systems and methods for streaming artificial reality data
US12405672B2 (en) * 2023-05-18 2025-09-02 Snap Inc. Rotating a 3D volume in extended reality
US12443286B2 (en) 2023-06-02 2025-10-14 Apple Inc. Input recognition based on distinguishing direct and indirect user interactions
US20240402826A1 (en) * 2023-06-02 2024-12-05 Apple Inc. Indirect Motion Mapping Pipeline and Pinch Centroid
US20240402800A1 (en) * 2023-06-02 2024-12-05 Apple Inc. Input Recognition in 3D Environments
WO2024254096A1 (en) 2023-06-04 2024-12-12 Apple Inc. Methods for managing overlapping windows and applying visual effects
WO2025018638A1 (ko) * 2023-07-20 2025-01-23 삼성전자 주식회사 핸드 트래킹을 수행하는 방법 및 이를 지원하는 웨어러블 전자 장치
CN116820251B (zh) * 2023-08-28 2023-11-07 中数元宇数字科技(上海)有限公司 一种手势轨迹交互方法、智能眼镜及存储介质
CN118113151B (zh) * 2023-10-16 2024-11-12 潍坊幻视软件科技有限公司 一种给手部设定碰撞器进行输入的系统
TWI872764B (zh) * 2023-10-30 2025-02-11 慧術科技股份有限公司 適用於混合實境的人體及物件狀態三維定位與動作偵測系統及其方法
CN117348737A (zh) * 2023-12-06 2024-01-05 之江实验室 一种基于多通道交互的数据处理系统及方法
CN120103961A (zh) * 2023-12-06 2025-06-06 北京字跳网络技术有限公司 交互方法、装置、存储介质、设备及程序产品
CN117373135B (zh) * 2023-12-07 2024-03-15 湖北星纪魅族集团有限公司 基于视觉的滑动手势识别方法、系统及相关设备
JP7733158B1 (ja) * 2024-03-14 2025-09-02 ソフトバンク株式会社 電子機器、プログラム、及び制御方法
JP7657998B1 (ja) 2024-03-14 2025-04-07 ソフトバンク株式会社 電子機器、プログラム、及び制御方法
WO2025224616A1 (en) * 2024-04-24 2025-10-30 Raven Spades Inc. Hand posture and hand gesture determination system
US20250377719A1 (en) 2024-06-09 2025-12-11 Apple Inc. Methods of interacting with content in a virtual environment
US12468381B1 (en) * 2024-09-06 2025-11-11 Snap Inc. Dynamic interaction zone system for accurate 3D button selection in augmented reality environments
CN120179080A (zh) * 2025-05-22 2025-06-20 杭州电子科技大学 一种基于多通道手势融合的模拟驾驶训练交互方法及系统

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7983450B2 (en) * 2009-03-16 2011-07-19 The Boeing Company Method, apparatus and computer program product for recognizing a gesture
WO2011142317A1 (ja) * 2010-05-11 2011-11-17 日本システムウエア株式会社 ジェスチャー認識装置、方法、プログラム、および該プログラムを格納したコンピュータ可読媒体
CN102402680B (zh) * 2010-09-13 2014-07-30 株式会社理光 人机交互系统中手部、指示点定位方法和手势确定方法
US8638989B2 (en) 2012-01-17 2014-01-28 Leap Motion, Inc. Systems and methods for capturing motion in three-dimensional space
US8854433B1 (en) * 2012-02-03 2014-10-07 Aquifi, Inc. Method and system enabling natural user interface gestures with an electronic system
JP6271444B2 (ja) * 2012-02-24 2018-01-31 トーマス ジェイ モスカリッロＭＯＳＣＡＲＩＬＬＯ， Ｔｈｏｍａｓ， Ｊ． ジェスチャー認識装置及び方法
US20130293454A1 (en) * 2012-05-04 2013-11-07 Samsung Electronics Co. Ltd. Terminal and method for controlling the same based on spatial interaction
US9383895B1 (en) * 2012-05-05 2016-07-05 F. Vinayak Methods and systems for interactively producing shapes in three-dimensional space
EP2680228B1 (en) * 2012-06-25 2014-11-26 Softkinetic Software Improvements in or relating to three dimensional close interactions.
EP3007039B1 (en) 2012-07-13 2018-12-05 Sony Depthsensing Solutions SA/NV Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand
US9696867B2 (en) 2013-01-15 2017-07-04 Leap Motion, Inc. Dynamic user interactions for display control and identifying dominant gestures
WO2014128749A1 (ja) * 2013-02-19 2014-08-28 株式会社ブリリアントサービス 形状認識装置、形状認識プログラム、および形状認識方法
US20140282274A1 (en) * 2013-03-15 2014-09-18 Qualcomm Incorporated Detection of a gesture performed with at least two control objects
JP6480434B2 (ja) * 2013-06-27 2019-03-13 アイサイト モバイル テクノロジーズ リミテッド デジタルデバイスとの対話のための直接的なポインティング検出のためのシステムおよび方法
US10281987B1 (en) * 2013-08-09 2019-05-07 Leap Motion, Inc. Systems and methods of free-space gestural interaction
US10168873B1 (en) * 2013-10-29 2019-01-01 Leap Motion, Inc. Virtual interactions for machine control
US9996797B1 (en) * 2013-10-31 2018-06-12 Leap Motion, Inc. Interactions with virtual objects for machine control
EP3090331B1 (en) * 2014-01-03 2020-03-04 Intel Corporation Systems with techniques for user interface control
WO2016099561A1 (en) 2014-12-19 2016-06-23 Hewlett-Packard Development Company, Lp Gesture library
US10452195B2 (en) * 2014-12-30 2019-10-22 Samsung Electronics Co., Ltd. Electronic system with gesture calibration mechanism and method of operation thereof
US9696795B2 (en) * 2015-02-13 2017-07-04 Leap Motion, Inc. Systems and methods of creating a realistic grab experience in virtual reality/augmented reality environments
US10606341B2 (en) * 2015-02-22 2020-03-31 Technion Research & Development Foundation Limited Gesture recognition using multi-sensory data
JP6488946B2 (ja) 2015-08-21 2019-03-27 富士通株式会社 制御方法、プログラム及び制御装置
JP6658188B2 (ja) * 2016-03-24 2020-03-04 富士通株式会社 画像処理装置、画像処理方法および画像処理プログラム
WO2017172982A1 (en) 2016-03-31 2017-10-05 Magic Leap, Inc. Interactions with 3d virtual objects using poses and multiple-dof controllers
KR101807241B1 (ko) * 2016-09-12 2017-12-08 주식회사 딥픽셀 단일 카메라 기반의 3차원 영상 해석 장치 및 방법, 3차원 영상 해석을 위한 프로그램이 기록된 컴퓨터로 읽을 수 있는 매체
CN106355598B (zh) * 2016-09-14 2019-09-10 南通大学 一种腕部及手指关节活动度的自动测量方法
JP2018169720A (ja) 2017-03-29 2018-11-01 富士通株式会社 動き検出システム
US10692287B2 (en) * 2017-04-17 2020-06-23 Microsoft Technology Licensing, Llc Multi-step placement of virtual objects
EP3542252B1 (en) 2017-08-10 2023-08-02 Google LLC Context-sensitive hand interaction
US11544871B2 (en) * 2017-12-13 2023-01-03 Google Llc Hand skeleton learning, lifting, and denoising from 2D images
US10739861B2 (en) * 2018-01-10 2020-08-11 Facebook Technologies, Llc Long distance interaction with artificial reality objects using a near eye display interface
US10296102B1 (en) * 2018-01-31 2019-05-21 Piccolo Labs Inc. Gesture and motion recognition using skeleton tracking
KR20200121304A (ko) 2018-02-20 2020-10-23 소니 주식회사 정보 처리 장치, 정보 처리 방법 및 프로그램
JP7341166B2 (ja) 2018-05-22 2023-09-08 マジック リープ， インコーポレイテッド ウェアラブルシステムのためのトランスモード入力融合
US10606364B2 (en) * 2018-06-14 2020-03-31 Dell Products, L.P. Two-handed gesture sequences in virtual, augmented, and mixed reality (xR) applications
US11107265B2 (en) * 2019-01-11 2021-08-31 Microsoft Technology Licensing, Llc Holographic palm raycasting for targeting virtual objects
US11320911B2 (en) * 2019-01-11 2022-05-03 Microsoft Technology Licensing, Llc Hand motion and orientation-aware buttons and grabbable objects in mixed reality
US11397463B2 (en) * 2019-01-12 2022-07-26 Microsoft Technology Licensing, Llc Discrete and continuous gestures for enabling hand rays
US11043192B2 (en) * 2019-06-07 2021-06-22 Facebook Technologies, Llc Corner-identifiying gesture-driven user interface element gating for artificial reality systems
US11189099B2 (en) * 2019-09-20 2021-11-30 Facebook Technologies, Llc Global and local mode virtual object interactions
US11983326B2 (en) 2020-02-26 2024-05-14 Magic Leap, Inc. Hand gesture input for wearable system

Similar Documents

Publication Publication Date Title
JPWO2021173839A5 (https=)
CN106846403B (zh) 一种三维空间中手部定位的方法、装置及智能设备
CN106933343B (zh) 用于识别虚拟现实头戴装置中的手势的设备和方法
JP2021512353A5 (https=)
CN104023802B (zh) 使用神经分析的电子装置的控制
Kharlamov et al. TickTockRay: smartwatch-based 3D pointing for smartphone-based virtual reality
TWI403922B (zh) 徒手人機介面操作系統及其方法
JP2014503085A5 (https=)
JP2022502800A5 (https=)
EP3188075B1 (en) Apparatus and method for recognizing hand gestures in a virtual reality headset
JPWO2019152286A5 (https=)
WO2014106219A1 (en) User centric interface for interaction with visual display that recognizes user intentions
JP2010108500A (ja) 着用型コンピューティング環境基盤のユーザインターフェース装置およびその方法
JPWO2020069006A5 (https=)
JP2013029958A5 (https=)
EP2146271A3 (en) Information processing device, information processing method, and information processing program
JP2017195552A5 (https=)
JP7156397B2 (ja) 制御装置
WO2016008265A1 (zh) 一种定位位置的方法及装置
CN110045829A (zh) 利用用户接口的事件的设备和方法
CN103309466A (zh) 指向性影像操控装置及其方法
CN114063768B (zh) 信息处理方法、非暂时性记录介质以及信息处理装置
CN104704449B (zh) 用户界面设备和用户界面方法
Roig-Maimó et al. Face Me! Head-tracker interface evaluation on mobile devices
JP2022118501A5 (https=)