JP7252252B2 - 手の位置に基づいたモーダル制御の開始 - Google Patents

手の位置に基づいたモーダル制御の開始 Download PDF

Info

Publication number
JP7252252B2
JP7252252B2 JP2020554878A JP2020554878A JP7252252B2 JP 7252252 B2 JP7252252 B2 JP 7252252B2 JP 2020554878 A JP2020554878 A JP 2020554878A JP 2020554878 A JP2020554878 A JP 2020554878A JP 7252252 B2 JP7252252 B2 JP 7252252B2
Authority
JP
Japan
Prior art keywords
hand
view
field
computing device
outside
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020554878A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021521512A (ja
JP2021521512A5 (enExample
Inventor
ジェラード トーキル アイフォア アンドリュー，フェリックス
エドワード ハーニッシュ，マイケル
チェン，リャン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of JP2021521512A publication Critical patent/JP2021521512A/ja
Publication of JP2021521512A5 publication Critical patent/JP2021521512A5/ja
Application granted granted Critical
Publication of JP7252252B2 publication Critical patent/JP7252252B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
JP2020554878A 2018-05-03 2019-04-22 手の位置に基づいたモーダル制御の開始 Active JP7252252B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201862666494P 2018-05-03 2018-05-03
US62/666,494 2018-05-03
US16/119,098 US10860088B2 (en) 2018-05-03 2018-08-31 Method and system for initiating application and system modal control based on hand locations
US16/119,098 2018-08-31
PCT/US2019/028599 WO2019212793A1 (en) 2018-05-03 2019-04-22 Initiating modal control based on hand locations

Publications (3)

Publication Number Publication Date
JP2021521512A JP2021521512A (ja) 2021-08-26
JP2021521512A5 JP2021521512A5 (enExample) 2022-03-25
JP7252252B2 true JP7252252B2 (ja) 2023-04-04

Family

ID=68385186

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020554878A Active JP7252252B2 (ja) 2018-05-03 2019-04-22 手の位置に基づいたモーダル制御の開始

Country Status (5)

Country Link
US (1) US10860088B2 (enExample)
EP (1) EP3788460A1 (enExample)
JP (1) JP7252252B2 (enExample)
KR (1) KR102732803B1 (enExample)
WO (1) WO2019212793A1 (enExample)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102808499B1 (ko) * 2019-11-11 2025-05-16 엘지전자 주식회사 Xr 디바이스 및 그 제어 방법
KR102918416B1 (ko) * 2020-05-13 2026-01-28 삼성전자 주식회사 증강 현실 서비스를 제공하기 위한 전자 장치 및 그의 동작 방법
US12105868B2 (en) 2021-02-12 2024-10-01 Sony Group Corporation Information processing device, information processing method, and program
GB2614330B (en) * 2021-12-31 2024-10-02 Sony Interactive Entertainment Europe Ltd Peripheral tracking system and method
CN119769100A (zh) 2022-08-24 2025-04-04 三星电子株式会社 控制相机模块的可穿戴电子装置及其操作方法
WO2024043438A1 (ko) * 2022-08-24 2024-02-29 삼성전자주식회사 카메라 모듈을 제어하는 웨어러블 전자 장치 및 그 동작 방법
KR102780716B1 (ko) * 2022-10-06 2025-03-14 재단법인 아산사회복지재단 햅틱 피드백 장치 및 방법
EP4730085A1 (en) * 2023-07-21 2026-04-22 Samsung Electronics Co., Ltd. Method and device for determining operation command of controller

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013012158A (ja) 2011-06-30 2013-01-17 Toshiba Corp 電子機器および制御方法
JP2013178645A (ja) 2012-02-28 2013-09-09 Onkyo Corp 電子機器の入力装置
US20140204002A1 (en) 2013-01-21 2014-07-24 Rotem Bennet Virtual interaction with image projection
JP2015520471A (ja) 2012-06-20 2015-07-16 アマゾン・テクノロジーズ、インコーポレイテッド ジェスチャー入力のための指先の場所特定
US20160274732A1 (en) 2015-03-16 2016-09-22 Elliptic Laboratories As Touchless user interfaces for electronic devices
JP2017083916A (ja) 2014-03-12 2017-05-18 コニカミノルタ株式会社 ジェスチャー認識装置、ヘッドマウントディスプレイ、および携帯端末
JP2017191496A (ja) 2016-04-14 2017-10-19 株式会社東海理化電機製作所 ジェスチャ判定装置
JP2018022426A (ja) 2016-08-05 2018-02-08 セイコーエプソン株式会社 表示装置、頭部装着型表示装置、及び、表示装置の制御方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7148913B2 (en) * 2001-10-12 2006-12-12 Hrl Laboratories, Llc Vision-based pointer tracking and object classification method and apparatus
US8488888B2 (en) * 2010-12-28 2013-07-16 Microsoft Corporation Classification of posture states
US8217856B1 (en) * 2011-07-27 2012-07-10 Google Inc. Head-mounted display that displays a visual representation of physical interaction with an input interface located outside of the field of view
KR102010782B1 (ko) * 2012-09-18 2019-08-14 삼성전자주식회사 멀티미디어 장치의 인식 범위로 컨트롤러의 위치를 보정하도록 유도하는 방법, 이를 위한 멀티미디어 장치 및 타겟 추적 장치
US9838573B2 (en) * 2012-09-18 2017-12-05 Samsung Electronics Co., Ltd Method for guiding controller to move to within recognizable range of multimedia apparatus, the multimedia apparatus, and target tracking apparatus thereof
US9911361B2 (en) * 2013-03-10 2018-03-06 OrCam Technologies, Ltd. Apparatus and method for analyzing images
KR102360176B1 (ko) * 2014-03-21 2022-02-09 삼성전자주식회사 웨어러블 디바이스에서 가상의 입력 인터페이스를 제공하는 방법 및 이를 위한 웨어러블 디바이스
US10564714B2 (en) * 2014-05-09 2020-02-18 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
CN108431728A (zh) * 2015-12-16 2018-08-21 索尼公司 信息处理设备、信息处理方法以及程序
US10410360B2 (en) * 2017-12-15 2019-09-10 United States Of America As Represented By Secretary Of The Navy Method for displaying off-screen target indicators in motion video

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013012158A (ja) 2011-06-30 2013-01-17 Toshiba Corp 電子機器および制御方法
JP2013178645A (ja) 2012-02-28 2013-09-09 Onkyo Corp 電子機器の入力装置
JP2015520471A (ja) 2012-06-20 2015-07-16 アマゾン・テクノロジーズ、インコーポレイテッド ジェスチャー入力のための指先の場所特定
US20140204002A1 (en) 2013-01-21 2014-07-24 Rotem Bennet Virtual interaction with image projection
JP2017083916A (ja) 2014-03-12 2017-05-18 コニカミノルタ株式会社 ジェスチャー認識装置、ヘッドマウントディスプレイ、および携帯端末
US20160274732A1 (en) 2015-03-16 2016-09-22 Elliptic Laboratories As Touchless user interfaces for electronic devices
JP2017191496A (ja) 2016-04-14 2017-10-19 株式会社東海理化電機製作所 ジェスチャ判定装置
JP2018022426A (ja) 2016-08-05 2018-02-08 セイコーエプソン株式会社 表示装置、頭部装着型表示装置、及び、表示装置の制御方法

Also Published As

Publication number Publication date
US20190339767A1 (en) 2019-11-07
JP2021521512A (ja) 2021-08-26
KR20210005041A (ko) 2021-01-13
US10860088B2 (en) 2020-12-08
KR102732803B1 (ko) 2024-11-20
EP3788460A1 (en) 2021-03-10
WO2019212793A1 (en) 2019-11-07

Similar Documents

Publication Publication Date Title
US11023035B1 (en) Virtual pinboard interaction using a peripheral device in artificial reality environments
KR102732803B1 (ko) 손 위치에 기초한 모달 제어 개시 기법
US12400414B2 (en) Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US10976804B1 (en) Pointer-based interaction with a virtual surface using a peripheral device in artificial reality environments
CN109891368B (zh) 活动对象在增强和/或虚拟现实环境中的切换
US11054894B2 (en) Integrated mixed-input system
JP2022540315A (ja) 人工現実環境において周辺デバイスを使用する仮想ユーザインターフェース
US20180143693A1 (en) Virtual object manipulation
US11023036B1 (en) Virtual drawing surface interaction using a peripheral device in artificial reality environments
CN116594497A (zh) 虚拟现实中的滚动和导航
WO2020146122A1 (en) Context-aware system menu behavior for mixed reality
CN111771180A (zh) 增强现实环境中对象的混合放置
US12504812B2 (en) Method and device for processing user input for multiple devices
US20240281071A1 (en) Simultaneous Controller and Touch Interactions
US10331340B2 (en) Device and method for receiving character input through the same
EP3811186B1 (en) Input scaling to keep controller inside field of view
WO2024175006A1 (zh) 虚拟环境中的交互方法、装置、设备和存储介质
WO2024085996A1 (en) Overlay on an artificial reality environment
US20220086580A1 (en) Audio sample phase alignment in an artificial reality system
US20210318790A1 (en) Snapping range for augmented reality
CN110520826B (zh) 增强和/或虚拟现实环境中的智能命令合批
US12423926B2 (en) XR multi-window control
US12602864B2 (en) Event routing in 3D graphical environments
US10809794B2 (en) 3D navigation mode
US12105926B2 (en) XR manipulation feature with smart watch

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220316

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220316

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230228

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230306

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230323

R150 Certificate of patent or registration of utility model

Ref document number: 7252252

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150