EP3807747A4 - Virtual reality hand gesture generation - Google Patents

Virtual reality hand gesture generation Download PDF

Info

Publication number
EP3807747A4
EP3807747A4 EP19822879.3A EP19822879A EP3807747A4 EP 3807747 A4 EP3807747 A4 EP 3807747A4 EP 19822879 A EP19822879 A EP 19822879A EP 3807747 A4 EP3807747 A4 EP 3807747A4
Authority
EP
European Patent Office
Prior art keywords
virtual reality
hand gesture
gesture generation
reality hand
generation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19822879.3A
Other languages
German (de)
French (fr)
Other versions
EP3807747A1 (en
Inventor
Scott Douglas Nietfeld
Joe van den Heuvel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valve Corp
Original Assignee
Valve Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/195,718 external-priority patent/US10987573B2/en
Application filed by Valve Corp filed Critical Valve Corp
Publication of EP3807747A1 publication Critical patent/EP3807747A1/en
Publication of EP3807747A4 publication Critical patent/EP3807747A4/en
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/218—Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
EP19822879.3A 2018-06-20 2019-05-17 Virtual reality hand gesture generation Pending EP3807747A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862687780P 2018-06-20 2018-06-20
US16/195,718 US10987573B2 (en) 2016-10-11 2018-11-19 Virtual reality hand gesture generation
PCT/US2019/032928 WO2019245681A1 (en) 2018-06-20 2019-05-17 Virtual reality hand gesture generation

Publications (2)

Publication Number Publication Date
EP3807747A1 EP3807747A1 (en) 2021-04-21
EP3807747A4 true EP3807747A4 (en) 2022-03-09

Family

ID=68982963

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19822879.3A Pending EP3807747A4 (en) 2018-06-20 2019-05-17 Virtual reality hand gesture generation

Country Status (5)

Country Link
EP (1) EP3807747A4 (en)
JP (1) JP7337857B2 (en)
KR (1) KR20210021533A (en)
CN (1) CN112437909A (en)
WO (1) WO2019245681A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024085829A1 (en) * 2022-10-17 2024-04-25 İstanbul Geli̇şi̇m Üni̇versi̇tesi̇ A system for learning to play old in a meta verse environment using virtual reality technology
US11991222B1 (en) 2023-05-02 2024-05-21 Meta Platforms Technologies, Llc Persistent call control user interface element in an artificial reality environment
CN116650950B (en) * 2023-06-08 2024-02-06 廊坊市珍圭谷科技有限公司 Control system and method for VR game

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031502A1 (en) * 2014-09-26 2017-02-02 Sensel Inc. Systems and methods for manipulating a virtual environment
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8717291B2 (en) * 2009-10-07 2014-05-06 AFA Micro Co. Motion sensitive gesture device
US9529523B2 (en) * 2010-04-23 2016-12-27 Handscape Inc. Method using a finger above a touchpad for controlling a computerized system
US8761437B2 (en) * 2011-02-18 2014-06-24 Microsoft Corporation Motion recognition
US20130154952A1 (en) * 2011-12-16 2013-06-20 Microsoft Corporation Gesture combining multi-touch and movement
WO2014100045A1 (en) * 2012-12-17 2014-06-26 Qi2 ELEMENTS II, LLC Foot-mounted sensor systems for tracking body movement
EP3262486A4 (en) * 2015-02-27 2018-10-24 Hewlett-Packard Development Company, L.P. Detecting finger movements
US9898091B2 (en) * 2015-06-03 2018-02-20 Oculus Vr, Llc Virtual reality system with head-mounted display, camera and hand-held controllers
US10514766B2 (en) * 2015-06-09 2019-12-24 Dell Products L.P. Systems and methods for determining emotions based on user gestures
US10307669B2 (en) * 2016-10-11 2019-06-04 Valve Corporation Electronic controller with finger sensing and an adjustable hand retainer
JP6854928B2 (en) * 2018-01-19 2021-04-07 株式会社ソニー・インタラクティブエンタテインメント Information processing equipment, information processing systems, information processing methods, and programs

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031502A1 (en) * 2014-09-26 2017-02-02 Sensel Inc. Systems and methods for manipulating a virtual environment
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Experimental Robotics", vol. 39, 1 January 2006, SPRINGER BERLIN HEIDELBERG, Berlin, Heidelberg, ISBN: 978-3-540-77457-0, article KRY PAUL G. ET AL: "Grasp Recognition and Manipulation with the Tango", pages: 551 - 559, XP055883837, DOI: 10.1007/978-3-540-77457-0_52 *
MAYER, SVEN ET AL: "Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks", PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE SURFACES AND SPACES, ACMPUB27, NEW YORK, NY, USA, 17 October 2017 (2017-10-17), pages 220 - 229, XP058458482, ISBN: 978-1-4503-4691-7, DOI: 10.1145/3132272.3134130 *
SEUNGJU HAN ET AL: "Grip-Ball: A spherical multi-touch interface for interacting with virtual worlds", CONSUMER ELECTRONICS (ICCE), 2013 IEEE INTERNATIONAL CONFERENCE ON, IEEE, 11 January 2013 (2013-01-11), pages 600 - 601, XP032348905, ISBN: 978-1-4673-1361-2, DOI: 10.1109/ICCE.2013.6487035 *

Also Published As

Publication number Publication date
JP7337857B2 (en) 2023-09-04
EP3807747A1 (en) 2021-04-21
JP2021527896A (en) 2021-10-14
KR20210021533A (en) 2021-02-26
WO2019245681A1 (en) 2019-12-26
CN112437909A (en) 2021-03-02

Similar Documents

Publication Publication Date Title
EP3533046A4 (en) Performing virtual reality input
EP3652744A4 (en) Virtual reality apparatus
EP3709908A4 (en) Virtual reality wrist assembly
EP3646309C0 (en) Virtual reality laparoscopic tools
EP3564731A4 (en) Virtual reality head-mounted apparatus
EP3740809A4 (en) Interactive augmented or virtual reality devices
EP3628125A4 (en) System for providing multiple virtual reality views
EP3533025A4 (en) Virtual reality experience sharing
EP3539087A4 (en) A system for importing user interface devices into virtual/augmented reality
EP3844723A4 (en) Virtual item simulation using detected surfaces
EP3318958A4 (en) Virtual reality experience device
EP3561572A4 (en) Virtual reality head-mounted apparatus
GB2573091B (en) Haptic feedback for virtual reality
GB2560004B (en) Virtual reality
EP3888047A4 (en) Interactive virtual interface
EP3573525A4 (en) Epidermal virtual reality devices
EP3579736A4 (en) Virtual reality surgical tools system
EP3533047A4 (en) User interface for informational input in virtual reality environment
EP3807815A4 (en) Augmented reality deep gesture network
EP3564729A4 (en) Virtual reality display device
EP3621055A4 (en) Universal virtual simulator
EP3549127A4 (en) A system for importing user interface devices into virtual/augmented reality
EP3561573A4 (en) Virtual reality head-mounted apparatus
EP3557308A4 (en) Virtual reality head-mounted apparatus
EP3567413A4 (en) Virtual reality head-mounted apparatus

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210114

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: VALVE CORPORATION

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06F0003010000

Ipc: A63F0013218000

A4 Supplementary search report drawn up and despatched

Effective date: 20220209

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/041 20060101ALI20220203BHEP

Ipc: A63F 13/00 20140101ALI20220203BHEP

Ipc: G06F 3/01 20060101ALI20220203BHEP

Ipc: A63F 13/213 20140101ALI20220203BHEP

Ipc: A63F 13/428 20140101ALI20220203BHEP

Ipc: A63F 13/214 20140101ALI20220203BHEP

Ipc: A63F 13/218 20140101AFI20220203BHEP

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230428