CN112437909A - 虚拟现实手势生成 - Google Patents

虚拟现实手势生成 Download PDF

Info

Publication number
CN112437909A
CN112437909A CN201980041061.3A CN201980041061A CN112437909A CN 112437909 A CN112437909 A CN 112437909A CN 201980041061 A CN201980041061 A CN 201980041061A CN 112437909 A CN112437909 A CN 112437909A
Authority
CN
China
Prior art keywords
data
controller
touch
force
gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980041061.3A
Other languages
English (en)
Chinese (zh)
Inventor
S·D·尼特菲尔德
J·范登赫费尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valve Corp
Original Assignee
Valve Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/195,718 external-priority patent/US10987573B2/en
Application filed by Valve Corp filed Critical Valve Corp
Publication of CN112437909A publication Critical patent/CN112437909A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/218—Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
CN201980041061.3A 2018-06-20 2019-05-17 虚拟现实手势生成 Pending CN112437909A (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201862687780P 2018-06-20 2018-06-20
US62/687,780 2018-06-20
US16/195,718 US10987573B2 (en) 2016-10-11 2018-11-19 Virtual reality hand gesture generation
US16/195,718 2018-11-19
PCT/US2019/032928 WO2019245681A1 (en) 2018-06-20 2019-05-17 Virtual reality hand gesture generation

Publications (1)

Publication Number Publication Date
CN112437909A true CN112437909A (zh) 2021-03-02

Family

ID=68982963

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980041061.3A Pending CN112437909A (zh) 2018-06-20 2019-05-17 虚拟现实手势生成

Country Status (5)

Country Link
EP (1) EP3807747A4 (https=)
JP (1) JP7337857B2 (https=)
KR (1) KR102810896B1 (https=)
CN (1) CN112437909A (https=)
WO (1) WO2019245681A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116650950A (zh) * 2023-06-08 2023-08-29 廊坊市珍圭谷科技有限公司 一种用于vr游戏的控制系统及方法

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10890983B2 (en) 2019-06-07 2021-01-12 Facebook Technologies, Llc Artificial reality system having a sliding menu
US11334212B2 (en) 2019-06-07 2022-05-17 Facebook Technologies, Llc Detecting input in artificial reality systems based on a pinch and pull gesture
US11448884B2 (en) * 2020-11-25 2022-09-20 Sony Interactive Entertainment Inc. Image based finger tracking plus controller tracking
US20240173616A1 (en) * 2021-03-10 2024-05-30 Bungie, Inc. Controller state management for client-server networking
US11726578B1 (en) 2022-02-11 2023-08-15 Meta Platforms Technologies, Llc Scrolling and navigation in virtual reality
KR102904217B1 (ko) * 2022-08-30 2025-12-26 에스케이텔레콤 주식회사 게임 리플레이 지원 방법 및 이를 지원하는 서버 장치
GB2639478A (en) * 2022-10-17 2025-09-24 Univ Istanbul Gelisim A system for learning to play old in a meta verse environment using virtual reality technology
US12387449B1 (en) 2023-02-08 2025-08-12 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US12400414B2 (en) 2023-02-08 2025-08-26 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US11991222B1 (en) 2023-05-02 2024-05-21 Meta Platforms Technologies, Llc Persistent call control user interface element in an artificial reality environment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130154952A1 (en) * 2011-12-16 2013-06-20 Microsoft Corporation Gesture combining multi-touch and movement
US20140281964A1 (en) * 2013-03-14 2014-09-18 Maung Han Method and system for presenting guidance of gesture input on a touch pad
US20150359457A1 (en) * 2012-12-17 2015-12-17 Reflx Labs, Inc. Foot-mounted sensor systems for tracking body movement
CN106168851A (zh) * 2015-05-20 2016-11-30 意美森公司 基于预测的接触的触觉效果
US20160357261A1 (en) * 2015-06-03 2016-12-08 Oculus Vr, Llc Virtual Reality System with Head-Mounted Display, Camera and Hand-Held Controllers
US20160364002A1 (en) * 2015-06-09 2016-12-15 Dell Products L.P. Systems and methods for determining emotions based on user gestures
US20170351345A1 (en) * 2015-02-27 2017-12-07 Hewlett-Packard Development Company, L.P. Detecting finger movements
US20180067545A1 (en) * 2015-03-01 2018-03-08 Tactical Haptics Embedded grasp sensing devices, systems, and methods
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing
CN108140360A (zh) * 2015-07-29 2018-06-08 森赛尔股份有限公司 用于操纵虚拟环境的系统和方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1364362A1 (en) * 2001-01-24 2003-11-26 Interlink Electronics, Inc. Game and home entertainment device remote control
US8717291B2 (en) * 2009-10-07 2014-05-06 AFA Micro Co. Motion sensitive gesture device
US9529523B2 (en) * 2010-04-23 2016-12-27 Handscape Inc. Method using a finger above a touchpad for controlling a computerized system
US8761437B2 (en) * 2011-02-18 2014-06-24 Microsoft Corporation Motion recognition
US10307669B2 (en) * 2016-10-11 2019-06-04 Valve Corporation Electronic controller with finger sensing and an adjustable hand retainer
KR20180056998A (ko) * 2016-11-21 2018-05-30 엘지전자 주식회사 디바이스 컨트롤러 및 그 데이터 처리 방법
WO2019142329A1 (ja) 2018-01-19 2019-07-25 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、情報処理方法、及びプログラム

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130154952A1 (en) * 2011-12-16 2013-06-20 Microsoft Corporation Gesture combining multi-touch and movement
US20150359457A1 (en) * 2012-12-17 2015-12-17 Reflx Labs, Inc. Foot-mounted sensor systems for tracking body movement
US20140281964A1 (en) * 2013-03-14 2014-09-18 Maung Han Method and system for presenting guidance of gesture input on a touch pad
US20170351345A1 (en) * 2015-02-27 2017-12-07 Hewlett-Packard Development Company, L.P. Detecting finger movements
US20180067545A1 (en) * 2015-03-01 2018-03-08 Tactical Haptics Embedded grasp sensing devices, systems, and methods
CN106168851A (zh) * 2015-05-20 2016-11-30 意美森公司 基于预测的接触的触觉效果
US20160357261A1 (en) * 2015-06-03 2016-12-08 Oculus Vr, Llc Virtual Reality System with Head-Mounted Display, Camera and Hand-Held Controllers
US20160364002A1 (en) * 2015-06-09 2016-12-15 Dell Products L.P. Systems and methods for determining emotions based on user gestures
CN108140360A (zh) * 2015-07-29 2018-06-08 森赛尔股份有限公司 用于操纵虚拟环境的系统和方法
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
PAUL G. KRY等: "Grasp Recognition and Manipulation with the Tango", EXPERIMENTAL ROBOTICS, pages 1 - 10 *
SEUNGJU HAN等: "Grip-Ball: A Spherical Multi-Touch Interface for Interacting with Virtual Worlds", 2013 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), pages 600 - 601 *
SVEN MAYER等: "Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks", PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE SURFACES AND SPACES, pages 220 - 229 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116650950A (zh) * 2023-06-08 2023-08-29 廊坊市珍圭谷科技有限公司 一种用于vr游戏的控制系统及方法
CN116650950B (zh) * 2023-06-08 2024-02-06 廊坊市珍圭谷科技有限公司 一种用于vr游戏的控制系统及方法

Also Published As

Publication number Publication date
JP7337857B2 (ja) 2023-09-04
JP2021527896A (ja) 2021-10-14
EP3807747A4 (en) 2022-03-09
KR20210021533A (ko) 2021-02-26
WO2019245681A1 (en) 2019-12-26
EP3807747A1 (en) 2021-04-21
KR102810896B1 (ko) 2025-05-20

Similar Documents

Publication Publication Date Title
US11992751B2 (en) Virtual reality hand gesture generation
KR102810896B1 (ko) 가상 현실 핸드 제스처 생성
US12042718B2 (en) Holding and releasing virtual objects
US11625898B2 (en) Holding and releasing virtual objects
EP3265895B1 (en) Embedded grasp sensing devices, systems, and methods
JP7802846B2 (ja) 動的センサ割当
CN112512648B (zh) 握住和释放虚拟对象
JP2025063132A (ja) 力検知抵抗器（ｆｓｒ）を含むハンドヘルドコントローラのセンサ融合アルゴリズム
CN112219246B (zh) 具有聚酰亚胺衬底的力感测电阻器(fsr)、系统和其方法
CN113474748B (zh) 用于包括力感测电阻器(fsr)的手持式控制器的传感器融合算法
CN112437910B (zh) 用于握住和释放虚拟对象的方法和系统

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination