EP3807747A4 - GENERATION OF HAND GESTURES OF VIRTUAL REALITY - Google Patents

GENERATION OF HAND GESTURES OF VIRTUAL REALITY Download PDF

Info

Publication number
EP3807747A4
EP3807747A4 EP19822879.3A EP19822879A EP3807747A4 EP 3807747 A4 EP3807747 A4 EP 3807747A4 EP 19822879 A EP19822879 A EP 19822879A EP 3807747 A4 EP3807747 A4 EP 3807747A4
Authority
EP
European Patent Office
Prior art keywords
generation
virtual reality
hand gestures
reality hand
gestures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19822879.3A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3807747A1 (en
Inventor
Scott Douglas Nietfeld
Joe van den Heuvel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valve Corp
Original Assignee
Valve Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/195,718 external-priority patent/US10987573B2/en
Application filed by Valve Corp filed Critical Valve Corp
Publication of EP3807747A1 publication Critical patent/EP3807747A1/en
Publication of EP3807747A4 publication Critical patent/EP3807747A4/en
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/218—Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
EP19822879.3A 2018-06-20 2019-05-17 GENERATION OF HAND GESTURES OF VIRTUAL REALITY Pending EP3807747A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862687780P 2018-06-20 2018-06-20
US16/195,718 US10987573B2 (en) 2016-10-11 2018-11-19 Virtual reality hand gesture generation
PCT/US2019/032928 WO2019245681A1 (en) 2018-06-20 2019-05-17 Virtual reality hand gesture generation

Publications (2)

Publication Number Publication Date
EP3807747A1 EP3807747A1 (en) 2021-04-21
EP3807747A4 true EP3807747A4 (en) 2022-03-09

Family

ID=68982963

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19822879.3A Pending EP3807747A4 (en) 2018-06-20 2019-05-17 GENERATION OF HAND GESTURES OF VIRTUAL REALITY

Country Status (5)

Country Link
EP (1) EP3807747A4 (https=)
JP (1) JP7337857B2 (https=)
KR (1) KR102810896B1 (https=)
CN (1) CN112437909A (https=)
WO (1) WO2019245681A1 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10890983B2 (en) 2019-06-07 2021-01-12 Facebook Technologies, Llc Artificial reality system having a sliding menu
US11334212B2 (en) 2019-06-07 2022-05-17 Facebook Technologies, Llc Detecting input in artificial reality systems based on a pinch and pull gesture
US11448884B2 (en) * 2020-11-25 2022-09-20 Sony Interactive Entertainment Inc. Image based finger tracking plus controller tracking
US20240173616A1 (en) * 2021-03-10 2024-05-30 Bungie, Inc. Controller state management for client-server networking
US11726578B1 (en) 2022-02-11 2023-08-15 Meta Platforms Technologies, Llc Scrolling and navigation in virtual reality
KR102904217B1 (ko) * 2022-08-30 2025-12-26 에스케이텔레콤 주식회사 게임 리플레이 지원 방법 및 이를 지원하는 서버 장치
GB2639478A (en) * 2022-10-17 2025-09-24 Univ Istanbul Gelisim A system for learning to play old in a meta verse environment using virtual reality technology
US12387449B1 (en) 2023-02-08 2025-08-12 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US12400414B2 (en) 2023-02-08 2025-08-26 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US11991222B1 (en) 2023-05-02 2024-05-21 Meta Platforms Technologies, Llc Persistent call control user interface element in an artificial reality environment
CN116650950B (zh) * 2023-06-08 2024-02-06 廊坊市珍圭谷科技有限公司 一种用于vr游戏的控制系统及方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031502A1 (en) * 2014-09-26 2017-02-02 Sensel Inc. Systems and methods for manipulating a virtual environment
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1364362A1 (en) * 2001-01-24 2003-11-26 Interlink Electronics, Inc. Game and home entertainment device remote control
US8717291B2 (en) * 2009-10-07 2014-05-06 AFA Micro Co. Motion sensitive gesture device
US9529523B2 (en) * 2010-04-23 2016-12-27 Handscape Inc. Method using a finger above a touchpad for controlling a computerized system
US8761437B2 (en) * 2011-02-18 2014-06-24 Microsoft Corporation Motion recognition
US20130154952A1 (en) * 2011-12-16 2013-06-20 Microsoft Corporation Gesture combining multi-touch and movement
WO2014100045A1 (en) * 2012-12-17 2014-06-26 Qi2 ELEMENTS II, LLC Foot-mounted sensor systems for tracking body movement
US20140281964A1 (en) * 2013-03-14 2014-09-18 Maung Han Method and system for presenting guidance of gesture input on a touch pad
US10310632B2 (en) * 2015-02-27 2019-06-04 Hewlett-Packard Development Company, L.P. Wearable devices for detecting finger movements and related methods
WO2016140924A1 (en) * 2015-03-01 2016-09-09 Tactical Haptics Embedded grasp sensing devices, systems, and methods
US20160342208A1 (en) * 2015-05-20 2016-11-24 Immersion Corporation Haptic effects based on predicted contact
US9898091B2 (en) * 2015-06-03 2018-02-20 Oculus Vr, Llc Virtual reality system with head-mounted display, camera and hand-held controllers
US10514766B2 (en) * 2015-06-09 2019-12-24 Dell Products L.P. Systems and methods for determining emotions based on user gestures
US10307669B2 (en) * 2016-10-11 2019-06-04 Valve Corporation Electronic controller with finger sensing and an adjustable hand retainer
KR20180056998A (ko) * 2016-11-21 2018-05-30 엘지전자 주식회사 디바이스 컨트롤러 및 그 데이터 처리 방법
WO2019142329A1 (ja) 2018-01-19 2019-07-25 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、情報処理方法、及びプログラム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031502A1 (en) * 2014-09-26 2017-02-02 Sensel Inc. Systems and methods for manipulating a virtual environment
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
"Experimental Robotics", vol. 39, 1 January 2006, SPRINGER BERLIN HEIDELBERG, Berlin, Heidelberg, ISBN: 978-3-540-77457-0, article KRY PAUL G. ET AL: "Grasp Recognition and Manipulation with the Tango", pages: 551 - 559, XP055883837, DOI: 10.1007/978-3-540-77457-0_52 *
HINCKLEY KEN KENH@MICROSOFT COM ET AL: "Pre-Touch Sensing for Mobile Interaction", HUMAN FACTORS IN COMPUTING SYSTEMS, ACM, 2 PENN PLAZA, SUITE 701 NEW YORK NY 10121-0701 USA, 7 May 2016 (2016-05-07), pages 2869 - 2881, XP058628221, ISBN: 978-1-4503-3362-7, DOI: 10.1145/2858036.2858095 *
MAYER, SVEN ET AL: "Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks", PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE SURFACES AND SPACES, ACMPUB27, NEW YORK, NY, USA, 17 October 2017 (2017-10-17), pages 220 - 229, XP058458482, ISBN: 978-1-4503-4691-7, DOI: 10.1145/3132272.3134130 *
See also references of WO2019245681A1 *
SEUNGJU HAN ET AL: "Grip-Ball: A spherical multi-touch interface for interacting with virtual worlds", CONSUMER ELECTRONICS (ICCE), 2013 IEEE INTERNATIONAL CONFERENCE ON, IEEE, 11 January 2013 (2013-01-11), pages 600 - 601, XP032348905, ISBN: 978-1-4673-1361-2, DOI: 10.1109/ICCE.2013.6487035 *

Also Published As

Publication number Publication date
JP7337857B2 (ja) 2023-09-04
JP2021527896A (ja) 2021-10-14
KR20210021533A (ko) 2021-02-26
WO2019245681A1 (en) 2019-12-26
CN112437909A (zh) 2021-03-02
EP3807747A1 (en) 2021-04-21
KR102810896B1 (ko) 2025-05-20

Similar Documents

Publication Publication Date Title
EP3807747A4 (en) GENERATION OF HAND GESTURES OF VIRTUAL REALITY
EP3888047A4 (en) INTERACTIVE VIRTUAL INTERFACE
EP3740809A4 (en) INTERACTIVE AUGMENTED OR VIRTUAL REALITY DEVICES
IL268926A (en) Waveguide for an augmented reality or virtual reality display
EP3533025A4 (en) COMMON EXPERIENCE IN VIRTUAL REALITY
IL261349B (en) Virtual reality system for aerial vehicle
EP3659076A4 (en) VIRTUAL RESTAURANT SYSTEM
EP3646309C0 (en) VIRTUAL REALITY LAPAROSCOPIC TOOLS
EP3874351A4 (en) BRAIN COMPUTER INTERFACE FOR AUGMENTED REALITY
EP3625774C0 (en) AUGMENTED REALITY
EP3593326A4 (en) VIRTUAL VISION SYSTEM
EP3564731A4 (en) Virtual reality head-mounted apparatus
EP3701460A4 (en) Virtual subaccounts
EP3452991A4 (en) GEOMETRY ADJUSTMENT IN VIRTUAL REALITY AND EXTENDED REALITY
AU201813269S (en) Virtual reality headset
GB201604203D0 (en) Virtual reality
GB2560004B (en) Virtual reality
EP3314424A4 (en) METHOD FOR MIGRATING A VIRTUAL MACHINE
EP3561572A4 (en) HEAD-MOUNTED DEVICE FOR VIRTUAL REALITY
PL3422145T3 (pl) Zapewnienie treści rzeczywistości wirtualnej
EP3756071C0 (en) HAPTIC FEEDBACK FOR VIRTUAL REALITY
EP3561573A4 (en) HEAD-MOUNTED DEVICE FOR VIRTUAL REALITY
EP3621709A4 (en) STAND FOR HEADPHONES OF VIRTUAL REALITY
GB2574795B (en) Generating virtual representations
EP3567413A4 (en) HEAD-MOUNTED DEVICE FOR VIRTUAL REALITY

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210114

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: VALVE CORPORATION

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06F0003010000

Ipc: A63F0013218000

A4 Supplementary search report drawn up and despatched

Effective date: 20220209

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/041 20060101ALI20220203BHEP

Ipc: A63F 13/00 20140101ALI20220203BHEP

Ipc: G06F 3/01 20060101ALI20220203BHEP

Ipc: A63F 13/213 20140101ALI20220203BHEP

Ipc: A63F 13/428 20140101ALI20220203BHEP

Ipc: A63F 13/214 20140101ALI20220203BHEP

Ipc: A63F 13/218 20140101AFI20220203BHEP

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230428

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240605