KR102732803B1 - 손 위치에 기초한 모달 제어 개시 기법 - Google Patents

손 위치에 기초한 모달 제어 개시 기법 Download PDF

Info

Publication number
KR102732803B1
KR102732803B1 KR1020207031557A KR20207031557A KR102732803B1 KR 102732803 B1 KR102732803 B1 KR 102732803B1 KR 1020207031557 A KR1020207031557 A KR 1020207031557A KR 20207031557 A KR20207031557 A KR 20207031557A KR 102732803 B1 KR102732803 B1 KR 102732803B1
Authority
KR
South Korea
Prior art keywords
hand
view
field
command
outside
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020207031557A
Other languages
English (en)
Korean (ko)
Other versions
KR20210005041A (ko
Inventor
펠릭스 제라드 토르킬 이포르 앤드류
마이클 에드워드 하니쉬
리앙 첸
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20210005041A publication Critical patent/KR20210005041A/ko
Application granted granted Critical
Publication of KR102732803B1 publication Critical patent/KR102732803B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
KR1020207031557A 2018-05-03 2019-04-22 손 위치에 기초한 모달 제어 개시 기법 Active KR102732803B1 (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201862666494P 2018-05-03 2018-05-03
US62/666,494 2018-05-03
US16/119,098 US10860088B2 (en) 2018-05-03 2018-08-31 Method and system for initiating application and system modal control based on hand locations
US16/119,098 2018-08-31
PCT/US2019/028599 WO2019212793A1 (en) 2018-05-03 2019-04-22 Initiating modal control based on hand locations

Publications (2)

Publication Number Publication Date
KR20210005041A KR20210005041A (ko) 2021-01-13
KR102732803B1 true KR102732803B1 (ko) 2024-11-20

Family

ID=68385186

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020207031557A Active KR102732803B1 (ko) 2018-05-03 2019-04-22 손 위치에 기초한 모달 제어 개시 기법

Country Status (5)

Country Link
US (1) US10860088B2 (enExample)
EP (1) EP3788460A1 (enExample)
JP (1) JP7252252B2 (enExample)
KR (1) KR102732803B1 (enExample)
WO (1) WO2019212793A1 (enExample)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102808499B1 (ko) * 2019-11-11 2025-05-16 엘지전자 주식회사 Xr 디바이스 및 그 제어 방법
KR102918416B1 (ko) * 2020-05-13 2026-01-28 삼성전자 주식회사 증강 현실 서비스를 제공하기 위한 전자 장치 및 그의 동작 방법
US12105868B2 (en) 2021-02-12 2024-10-01 Sony Group Corporation Information processing device, information processing method, and program
GB2614330B (en) * 2021-12-31 2024-10-02 Sony Interactive Entertainment Europe Ltd Peripheral tracking system and method
CN119769100A (zh) 2022-08-24 2025-04-04 三星电子株式会社 控制相机模块的可穿戴电子装置及其操作方法
WO2024043438A1 (ko) * 2022-08-24 2024-02-29 삼성전자주식회사 카메라 모듈을 제어하는 웨어러블 전자 장치 및 그 동작 방법
KR102780716B1 (ko) * 2022-10-06 2025-03-14 재단법인 아산사회복지재단 햅틱 피드백 장치 및 방법
EP4730085A1 (en) * 2023-07-21 2026-04-22 Samsung Electronics Co., Ltd. Method and device for determining operation command of controller

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170123492A1 (en) * 2014-05-09 2017-05-04 Eyefluence, Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7148913B2 (en) * 2001-10-12 2006-12-12 Hrl Laboratories, Llc Vision-based pointer tracking and object classification method and apparatus
US8488888B2 (en) * 2010-12-28 2013-07-16 Microsoft Corporation Classification of posture states
JP5865615B2 (ja) 2011-06-30 2016-02-17 株式会社東芝 電子機器および制御方法
US8217856B1 (en) * 2011-07-27 2012-07-10 Google Inc. Head-mounted display that displays a visual representation of physical interaction with an input interface located outside of the field of view
JP2013178645A (ja) 2012-02-28 2013-09-09 Onkyo Corp 電子機器の入力装置
US9213436B2 (en) 2012-06-20 2015-12-15 Amazon Technologies, Inc. Fingertip location for gesture input
KR102010782B1 (ko) * 2012-09-18 2019-08-14 삼성전자주식회사 멀티미디어 장치의 인식 범위로 컨트롤러의 위치를 보정하도록 유도하는 방법, 이를 위한 멀티미디어 장치 및 타겟 추적 장치
US9838573B2 (en) * 2012-09-18 2017-12-05 Samsung Electronics Co., Ltd Method for guiding controller to move to within recognizable range of multimedia apparatus, the multimedia apparatus, and target tracking apparatus thereof
US9202313B2 (en) 2013-01-21 2015-12-01 Microsoft Technology Licensing, Llc Virtual interaction with image projection
US9911361B2 (en) * 2013-03-10 2018-03-06 OrCam Technologies, Ltd. Apparatus and method for analyzing images
JP2017083916A (ja) 2014-03-12 2017-05-18 コニカミノルタ株式会社 ジェスチャー認識装置、ヘッドマウントディスプレイ、および携帯端末
KR102360176B1 (ko) * 2014-03-21 2022-02-09 삼성전자주식회사 웨어러블 디바이스에서 가상의 입력 인터페이스를 제공하는 방법 및 이를 위한 웨어러블 디바이스
GB201504362D0 (en) 2015-03-16 2015-04-29 Elliptic Laboratories As Touchless user interfaces for electronic devices
CN108431728A (zh) * 2015-12-16 2018-08-21 索尼公司 信息处理设备、信息处理方法以及程序
JP2017191496A (ja) 2016-04-14 2017-10-19 株式会社東海理化電機製作所 ジェスチャ判定装置
JP2018022426A (ja) 2016-08-05 2018-02-08 セイコーエプソン株式会社 表示装置、頭部装着型表示装置、及び、表示装置の制御方法
US10410360B2 (en) * 2017-12-15 2019-09-10 United States Of America As Represented By Secretary Of The Navy Method for displaying off-screen target indicators in motion video

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170123492A1 (en) * 2014-05-09 2017-05-04 Eyefluence, Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects

Also Published As

Publication number Publication date
US20190339767A1 (en) 2019-11-07
JP7252252B2 (ja) 2023-04-04
JP2021521512A (ja) 2021-08-26
KR20210005041A (ko) 2021-01-13
US10860088B2 (en) 2020-12-08
EP3788460A1 (en) 2021-03-10
WO2019212793A1 (en) 2019-11-07

Similar Documents

Publication Publication Date Title
US10860088B2 (en) Method and system for initiating application and system modal control based on hand locations
US11023035B1 (en) Virtual pinboard interaction using a peripheral device in artificial reality environments
US10976804B1 (en) Pointer-based interaction with a virtual surface using a peripheral device in artificial reality environments
US11494000B2 (en) Touch free interface for augmented reality systems
US12189861B2 (en) Augmented reality experiences with object manipulation
US12093704B2 (en) Devices, methods, systems, and media for an extended screen distributed user interface in augmented reality
US9430041B2 (en) Method of controlling at least one function of device by using eye action and device for performing the method
Garber Gestural technology: Moving interfaces in a new direction [technology news]
US20140049558A1 (en) Augmented reality overlay for control devices
US11023036B1 (en) Virtual drawing surface interaction using a peripheral device in artificial reality environments
CN110832450A (zh) 用于基于用户特性在虚拟或半虚拟空间中提供对象的方法和系统
US10049625B1 (en) Context-based rendering
US20160098160A1 (en) Sensor-based input system for mobile devices
US10331340B2 (en) Device and method for receiving character input through the same
EP3811186B1 (en) Input scaling to keep controller inside field of view
US9904444B2 (en) Method of providing user interface of device and device including the user interface
US20140111551A1 (en) Information-processing device, storage medium, information-processing method, and information-processing system
US12423926B2 (en) XR multi-window control
US12468383B2 (en) Gaze and head pose interaction
CN107924276B (zh) 电子设备及其文本输入方法
US10809794B2 (en) 3D navigation mode
US12105926B2 (en) XR manipulation feature with smart watch
JP7246390B2 (ja) ウェアラブルコンピューティングデバイスを用いた表示デバイスの直接操作
CN103116449A (zh) 一种提供用户界面的方法和装置
HK40097707A (zh) 虚拟现实中的滚动和导航

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20201102

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20220322

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20231229

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20240829

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20241118

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20241118

End annual number: 3

Start annual number: 1

PG1601 Publication of registration