EP3807747A4 - GENERATION OF HAND GESTURES OF VIRTUAL REALITY - Google Patents

GENERATION OF HAND GESTURES OF VIRTUAL REALITY Download PDF

Info

Publication number
EP3807747A4
EP3807747A4 EP19822879.3A EP19822879A EP3807747A4 EP 3807747 A4 EP3807747 A4 EP 3807747A4 EP 19822879 A EP19822879 A EP 19822879A EP 3807747 A4 EP3807747 A4 EP 3807747A4
Authority
EP
European Patent Office
Prior art keywords
virtual reality
hand gesture
gesture generation
reality hand
generation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19822879.3A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3807747A1 (en
Inventor
Scott Douglas Nietfeld
Joe van den Heuvel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valve Corp
Original Assignee
Valve Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/195,718 external-priority patent/US10987573B2/en
Application filed by Valve Corp filed Critical Valve Corp
Publication of EP3807747A1 publication Critical patent/EP3807747A1/en
Publication of EP3807747A4 publication Critical patent/EP3807747A4/en
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/218—Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
EP19822879.3A 2018-06-20 2019-05-17 GENERATION OF HAND GESTURES OF VIRTUAL REALITY Pending EP3807747A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862687780P 2018-06-20 2018-06-20
US16/195,718 US10987573B2 (en) 2016-10-11 2018-11-19 Virtual reality hand gesture generation
PCT/US2019/032928 WO2019245681A1 (en) 2018-06-20 2019-05-17 Virtual reality hand gesture generation

Publications (2)

Publication Number Publication Date
EP3807747A1 EP3807747A1 (en) 2021-04-21
EP3807747A4 true EP3807747A4 (en) 2022-03-09

Family

ID=68982963

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19822879.3A Pending EP3807747A4 (en) 2018-06-20 2019-05-17 GENERATION OF HAND GESTURES OF VIRTUAL REALITY

Country Status (5)

Country Link
EP (1) EP3807747A4 (ko)
JP (1) JP7337857B2 (ko)
KR (1) KR20210021533A (ko)
CN (1) CN112437909A (ko)
WO (1) WO2019245681A1 (ko)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11334212B2 (en) 2019-06-07 2022-05-17 Facebook Technologies, Llc Detecting input in artificial reality systems based on a pinch and pull gesture
WO2024085829A1 (en) * 2022-10-17 2024-04-25 İstanbul Geli̇şi̇m Üni̇versi̇tesi̇ A system for learning to play old in a meta verse environment using virtual reality technology
US11991222B1 (en) 2023-05-02 2024-05-21 Meta Platforms Technologies, Llc Persistent call control user interface element in an artificial reality environment
CN116650950B (zh) * 2023-06-08 2024-02-06 廊坊市珍圭谷科技有限公司 一种用于vr游戏的控制系统及方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031502A1 (en) * 2014-09-26 2017-02-02 Sensel Inc. Systems and methods for manipulating a virtual environment
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8717291B2 (en) * 2009-10-07 2014-05-06 AFA Micro Co. Motion sensitive gesture device
US9529523B2 (en) * 2010-04-23 2016-12-27 Handscape Inc. Method using a finger above a touchpad for controlling a computerized system
US8761437B2 (en) * 2011-02-18 2014-06-24 Microsoft Corporation Motion recognition
US20130154952A1 (en) * 2011-12-16 2013-06-20 Microsoft Corporation Gesture combining multi-touch and movement
WO2014100045A1 (en) * 2012-12-17 2014-06-26 Qi2 ELEMENTS II, LLC Foot-mounted sensor systems for tracking body movement
US20140281964A1 (en) * 2013-03-14 2014-09-18 Maung Han Method and system for presenting guidance of gesture input on a touch pad
EP3262486A4 (en) * 2015-02-27 2018-10-24 Hewlett-Packard Development Company, L.P. Detecting finger movements
WO2016140924A1 (en) * 2015-03-01 2016-09-09 Tactical Haptics Embedded grasp sensing devices, systems, and methods
US20160342208A1 (en) * 2015-05-20 2016-11-24 Immersion Corporation Haptic effects based on predicted contact
US9898091B2 (en) * 2015-06-03 2018-02-20 Oculus Vr, Llc Virtual reality system with head-mounted display, camera and hand-held controllers
US10514766B2 (en) * 2015-06-09 2019-12-24 Dell Products L.P. Systems and methods for determining emotions based on user gestures
US10307669B2 (en) * 2016-10-11 2019-06-04 Valve Corporation Electronic controller with finger sensing and an adjustable hand retainer
US11302029B2 (en) 2018-01-19 2022-04-12 Sony Interactive Entertainment Inc. Information processing apparatus, information processing system, information processing method, and program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031502A1 (en) * 2014-09-26 2017-02-02 Sensel Inc. Systems and methods for manipulating a virtual environment
US20180104576A1 (en) * 2016-10-11 2018-04-19 Valve Corporation Electronic controller with a hand retainer, outer shell, and finger sensing

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
"Experimental Robotics", vol. 39, 1 January 2006, SPRINGER BERLIN HEIDELBERG, Berlin, Heidelberg, ISBN: 978-3-540-77457-0, article KRY PAUL G. ET AL: "Grasp Recognition and Manipulation with the Tango", pages: 551 - 559, XP055883837, DOI: 10.1007/978-3-540-77457-0_52 *
HINCKLEY KEN KENH@MICROSOFT COM ET AL: "Pre-Touch Sensing for Mobile Interaction", HUMAN FACTORS IN COMPUTING SYSTEMS, ACM, 2 PENN PLAZA, SUITE 701 NEW YORK NY 10121-0701 USA, 7 May 2016 (2016-05-07), pages 2869 - 2881, XP058628221, ISBN: 978-1-4503-3362-7, DOI: 10.1145/2858036.2858095 *
MAYER, SVEN ET AL: "Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks", PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE SURFACES AND SPACES, ACMPUB27, NEW YORK, NY, USA, 17 October 2017 (2017-10-17), pages 220 - 229, XP058458482, ISBN: 978-1-4503-4691-7, DOI: 10.1145/3132272.3134130 *
See also references of WO2019245681A1 *
SEUNGJU HAN ET AL: "Grip-Ball: A spherical multi-touch interface for interacting with virtual worlds", CONSUMER ELECTRONICS (ICCE), 2013 IEEE INTERNATIONAL CONFERENCE ON, IEEE, 11 January 2013 (2013-01-11), pages 600 - 601, XP032348905, ISBN: 978-1-4673-1361-2, DOI: 10.1109/ICCE.2013.6487035 *

Also Published As

Publication number Publication date
KR20210021533A (ko) 2021-02-26
WO2019245681A1 (en) 2019-12-26
JP7337857B2 (ja) 2023-09-04
JP2021527896A (ja) 2021-10-14
CN112437909A (zh) 2021-03-02
EP3807747A1 (en) 2021-04-21

Similar Documents

Publication Publication Date Title
EP3709908A4 (en) WRIST ARRANGEMENT FOR VIRTUAL REALITY
EP3652744A4 (en) DEVICE FOR VIRTUAL REALITY
EP3533046A4 (en) REALIZATION OF A SEIZURE OF VIRTUAL REALITY
EP3740809A4 (en) INTERACTIVE AUGMENTED OR VIRTUAL REALITY DEVICES
EP3555727A4 (en) ASSIGNMENT OF VIRTUAL OBJECTS BASED ON INCREASED REALITY
EP3539087A4 (en) USER INTERFACE DEVICE IMPORT SYSTEM IN VIRTUAL / AUGMENTED REALITY
EP3564731A4 (en) HEAD-MOUNTED DEVICE FOR VIRTUAL REALITY
EP3628125A4 (en) SYSTEM FOR PROVIDING SEVERAL VIEWS OF VIRTUAL REALITY
EP3533025A4 (en) COMMON EXPERIENCE IN VIRTUAL REALITY
EP3844723A4 (en) SIMULATION OF VIRTUAL ELEMENTS USING DETECTED SURFACES
EP3318958A4 (en) Virtual reality experience device
EP3579736A4 (en) VIRTUAL REALITY SURGICAL INSTRUMENT SYSTEM
EP3561572A4 (en) HEAD-MOUNTED DEVICE FOR VIRTUAL REALITY
EP3807747A4 (en) GENERATION OF HAND GESTURES OF VIRTUAL REALITY
GB2560004B (en) Virtual reality
EP3573525A4 (en) EPIDERMAL DEVICES OF VIRTUAL REALITY
GB2573091B (en) Haptic feedback for virtual reality
EP3621055A4 (en) UNIVERSAL VIRTUAL SIMULATOR
EP3888047A4 (en) INTERACTIVE VIRTUAL INTERFACE
EP3567413A4 (en) HEAD-CARRIED VIRTUAL REALITY APPARATUS
EP3549127A4 (en) SYSTEM FOR IMPORTING USER INTERFACE DEVICES INTO A VIRTUAL / EXTENDED REALITY
EP3533047A4 (en) USER INTERFACE FOR INFORMATION IN AN ENVIRONMENT OF VIRTUAL REALITY
EP3561573A4 (en) HEAD-MOUNTED DEVICE FOR VIRTUAL REALITY
EP3564729A4 (en) VIRTUAL REALITY DISPLAY DEVICE
EP3557308A4 (en) HEAD-CARRIED VIRTUAL REALITY APPARATUS

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210114

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: VALVE CORPORATION

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06F0003010000

Ipc: A63F0013218000

A4 Supplementary search report drawn up and despatched

Effective date: 20220209

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/041 20060101ALI20220203BHEP

Ipc: A63F 13/00 20140101ALI20220203BHEP

Ipc: G06F 3/01 20060101ALI20220203BHEP

Ipc: A63F 13/213 20140101ALI20220203BHEP

Ipc: A63F 13/428 20140101ALI20220203BHEP

Ipc: A63F 13/214 20140101ALI20220203BHEP

Ipc: A63F 13/218 20140101AFI20220203BHEP

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230428

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240605