EP3717991A4 - Methods and apparatus for simultaneous detection of discrete and continuous gestures - Google Patents

Methods and apparatus for simultaneous detection of discrete and continuous gestures Download PDF

Info

Publication number
EP3717991A4
EP3717991A4 EP18883547.4A EP18883547A EP3717991A4 EP 3717991 A4 EP3717991 A4 EP 3717991A4 EP 18883547 A EP18883547 A EP 18883547A EP 3717991 A4 EP3717991 A4 EP 3717991A4
Authority
EP
European Patent Office
Prior art keywords
discrete
methods
simultaneous detection
continuous gestures
gestures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP18883547.4A
Other languages
German (de)
French (fr)
Other versions
EP3717991A1 (en
Inventor
Patrick Kaifosh
Steven Demers
Adam Berenzweig
Michael ASTOLFI
Lana AWAD
Tudor GIURGICA-TIRON
Adam AL-NATSHEH
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meta Platforms Technologies LLC
Original Assignee
Facebook Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facebook Technologies LLC filed Critical Facebook Technologies LLC
Priority to EP21198618.7A priority Critical patent/EP3951564A1/en
Publication of EP3717991A1 publication Critical patent/EP3717991A1/en
Publication of EP3717991A4 publication Critical patent/EP3717991A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computational Mathematics (AREA)
  • Social Psychology (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Algebra (AREA)
  • Probability & Statistics with Applications (AREA)
  • Multimedia (AREA)
  • Dermatology (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • User Interface Of Digital Computer (AREA)
EP18883547.4A 2017-11-30 2018-11-30 Methods and apparatus for simultaneous detection of discrete and continuous gestures Withdrawn EP3717991A4 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21198618.7A EP3951564A1 (en) 2017-11-30 2018-11-30 Methods and apparatus for simultaneous detection of discrete and continuous gestures

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762592656P 2017-11-30 2017-11-30
US201862621728P 2018-01-25 2018-01-25
PCT/US2018/063215 WO2019108880A1 (en) 2017-11-30 2018-11-30 Methods and apparatus for simultaneous detection of discrete and continuous gestures

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP21198618.7A Division EP3951564A1 (en) 2017-11-30 2018-11-30 Methods and apparatus for simultaneous detection of discrete and continuous gestures

Publications (2)

Publication Number Publication Date
EP3717991A1 EP3717991A1 (en) 2020-10-07
EP3717991A4 true EP3717991A4 (en) 2021-04-28

Family

ID=66665810

Family Applications (2)

Application Number Title Priority Date Filing Date
EP18883547.4A Withdrawn EP3717991A4 (en) 2017-11-30 2018-11-30 Methods and apparatus for simultaneous detection of discrete and continuous gestures
EP21198618.7A Withdrawn EP3951564A1 (en) 2017-11-30 2018-11-30 Methods and apparatus for simultaneous detection of discrete and continuous gestures

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP21198618.7A Withdrawn EP3951564A1 (en) 2017-11-30 2018-11-30 Methods and apparatus for simultaneous detection of discrete and continuous gestures

Country Status (3)

Country Link
EP (2) EP3717991A4 (en)
CN (1) CN112041784A (en)
WO (1) WO2019108880A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111061368B (en) * 2019-12-09 2023-06-27 华中科技大学鄂州工业技术研究院 Gesture detection method and wearable device
FR3111224B1 (en) * 2020-06-04 2022-07-29 Safran Electronics & Defense Control system for controlling a device remote from the system.
US11804077B2 (en) * 2021-04-01 2023-10-31 KaiKuTek Inc. Generic gesture detecting method and generic gesture detecting device
CN114756137B (en) * 2022-06-15 2022-09-27 深圳市心流科技有限公司 Training mode adjusting method and device for electromyographic signals and electroencephalographic signals
CN116089798B (en) * 2023-02-07 2024-06-21 华东理工大学 Decoding method and device for finger movement
CN117752478B (en) * 2024-02-22 2024-06-18 浙江强脑科技有限公司 Double-gesture control method, device and equipment of bionic hand and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130317648A1 (en) * 2012-05-25 2013-11-28 California Institute Of Technology Biosleeve human-machine interface
CN104134060A (en) * 2014-08-03 2014-11-05 上海威璞电子科技有限公司 Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors
US20160091980A1 (en) * 2014-09-30 2016-03-31 Apple Inc. Motion and gesture input from a wearable device
US20160162022A1 (en) * 2014-12-08 2016-06-09 Rohit Seth Wearable wireless hmi device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7565295B1 (en) * 2003-08-28 2009-07-21 The George Washington University Method and apparatus for translating hand gestures
US20150366504A1 (en) * 2014-06-20 2015-12-24 Medibotics Llc Electromyographic Clothing
CN105190578A (en) * 2013-02-22 2015-12-23 赛尔米克实验室公司 Methods and devices that combine muscle activity sensor signals and inertial sensor signals for gesture-based control
WO2014197443A1 (en) * 2013-06-03 2014-12-11 Kacyvenski Isaiah Motion sensor and analysis
US9483123B2 (en) * 2013-09-23 2016-11-01 Thalmic Labs Inc. Systems, articles, and methods for gesture identification in wearable electromyography devices
US9367139B2 (en) * 2013-12-12 2016-06-14 Thalmic Labs Inc. Systems, articles, and methods for gesture identification in wearable electromyography devices
WO2016076376A1 (en) * 2014-11-12 2016-05-19 京セラ株式会社 Wearable device
US10449672B2 (en) * 2016-03-14 2019-10-22 California Institute Of Technology Wearable electromyography sensor array using conductive cloth electrodes for human-robot interactions

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130317648A1 (en) * 2012-05-25 2013-11-28 California Institute Of Technology Biosleeve human-machine interface
CN104134060A (en) * 2014-08-03 2014-11-05 上海威璞电子科技有限公司 Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors
US20160091980A1 (en) * 2014-09-30 2016-03-31 Apple Inc. Motion and gesture input from a wearable device
US20160162022A1 (en) * 2014-12-08 2016-06-09 Rohit Seth Wearable wireless hmi device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
See also references of WO2019108880A1 *
WANG WENHUI ET AL: "Dynamic gesture recognition based on multiple sensors fusion technology", PROCEEDINGS OF THE 31ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENGINEERING THE FUTURE OF BIOMEDICINE, EMBC 2009, IEEE, 3 September 2009 (2009-09-03), pages 7014 - 7017, XP031881574, ISBN: 978-1-4244-3296-7, DOI: 10.1109/IEMBS.2009.5333326 *

Also Published As

Publication number Publication date
EP3717991A1 (en) 2020-10-07
CN112041784A (en) 2020-12-04
WO2019108880A1 (en) 2019-06-06
EP3951564A1 (en) 2022-02-09

Similar Documents

Publication Publication Date Title
EP3731180A4 (en) Target detection method and apparatus
EP3619600A4 (en) Method and apparatus for object status detection
EP3629238A4 (en) Method and apparatus for recognizing object
EP3684463A4 (en) Method and apparatus for neuroenhancement
EP3637693A4 (en) Method and apparatus for path detection
EP3479257A4 (en) Apparatus and method for gaze tracking
EP3602259A4 (en) Touch sensing apparatus and method for assembly
EP3614924A4 (en) Touch measurement apparatus and method of use
EP3703054A4 (en) Target voice detection method and apparatus
EP3648006A4 (en) Method and apparatus for recognizing object
EP3717991A4 (en) Methods and apparatus for simultaneous detection of discrete and continuous gestures
EP3481059A4 (en) Object detection and display apparatus, moving body, and object detection and display method
EP3605301A4 (en) Touch control method and apparatus
EP3255917A4 (en) Channel detection method and apparatus
EP3308259A4 (en) Method and apparatus for using gestures across multiple devices
EP3273679A4 (en) Curved surface display apparatus and curved surface display method
EP3329085A4 (en) A method and apparatus of determining a state of a system
EP3206223A4 (en) Plasma processing method and plasma processing apparatus
EP3665779A4 (en) Method and apparatus
EP3649828A4 (en) Method and apparatus
EP3448980A4 (en) New apparatus and methods for disease detection
EP3823372A4 (en) Detection method and detection apparatus
EP3593705A4 (en) Gaze detection device and gaze detection method
EP3352066A4 (en) Method and apparatus for displaying function interface
EP3411323A4 (en) Anti-two-block sensing apparatus and method

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200604

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20210330

RIC1 Information provided on ipc code assigned before grant

Ipc: G06N 7/00 20060101ALI20210324BHEP

Ipc: G06N 3/08 20060101ALI20210324BHEP

Ipc: G06N 3/04 20060101ALI20210324BHEP

Ipc: G06K 9/00 20060101ALI20210324BHEP

Ipc: G06F 3/0484 20130101ALI20210324BHEP

Ipc: G06N 99/00 20190101ALI20210324BHEP

Ipc: G06F 3/0346 20130101ALI20210324BHEP

Ipc: G06F 1/16 20060101ALI20210324BHEP

Ipc: G06F 3/01 20060101AFI20210324BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20211027