WO2017092225A1 - Système d'entrée de texte à porter sur soi basé sur l'emg, et procédé - Google Patents

Système d'entrée de texte à porter sur soi basé sur l'emg, et procédé Download PDF

Info

Publication number
WO2017092225A1
WO2017092225A1 PCT/CN2016/080732 CN2016080732W WO2017092225A1 WO 2017092225 A1 WO2017092225 A1 WO 2017092225A1 CN 2016080732 W CN2016080732 W CN 2016080732W WO 2017092225 A1 WO2017092225 A1 WO 2017092225A1
Authority
WO
WIPO (PCT)
Prior art keywords
emg
sensor
text input
processor
based wearable
Prior art date
Application number
PCT/CN2016/080732
Other languages
English (en)
Chinese (zh)
Inventor
伍楷舜
邹永攀
叶树锋
Original Assignee
深圳大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳大学 filed Critical 深圳大学
Publication of WO2017092225A1 publication Critical patent/WO2017092225A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Definitions

  • the present invention relates to the field of intelligent identification, and in particular, to an EMG-based wearable text input system and method.
  • wearable technology has always been a concern in the international computer academia and industry, but because of the high cost of construction and technical complexity, many related equipment only stays in the conceptual field.
  • Some wearable devices have been conceptualized and commercialized. New wearable devices are constantly coming out, Google, Apple, Microsoft, Sony, and Olin. Bath, Motorola and many other technology companies have begun to explore this new field.
  • "Wearing smart device” is a general term for applying wearable technology to intelligently design and wear wearable devices for daily wear, such as glasses, wristbands, watches, clothing and shoes, which greatly improves the quality of life and work. The efficiency has gradually developed into miniaturization, multi-functionality and strong endurance. According to research, by 2016, the global market for wearable smart devices will reach $6 billion.
  • the present invention provides an EMG-based wearable text input system and method, which solves the problem that no wearable device realizes text recognition in the prior art.
  • an EMG-based wearable text input system is designed and manufactured, including a wristband main body and a sensor module, and the wristband main body is embedded with an inertial test unit IMU, a processor, and a memory.
  • a communication module and an expansion slot the sensor module is embedded in the expansion slot; the sensor transmits electromyographic bioelectrical change information to the processor; and the inertia test unit IMU records motion information of the analysis arm and transmits to The processor; the communication module transmits the analyzed character information.
  • the sensor module is a myoelectric sensor that senses the myoelectric bioelectrical changes produced by the tapping action, converts them into discrete digital signals and sends them to the processor.
  • the wristband body has a built-in power module, the power module is a battery or an external charger; and the interface on the wristband body is used for charging or data transmission.
  • the processor performs feature extraction, self-learning, key motion recognition and matching, and text combination on the signal transmitted by the sensor module and the inertial test unit IMU through the communication mode.
  • the block is sent out.
  • the myoelectric sensor comprises five electrodes, two of which are used to connect the expansion slots on the sides and the other three to be used to sense the myoelectric changes at the bottom.
  • the invention also provides an EMG-based wearable text input method, comprising the steps of: (S101) receiving data information of a sensor module; (S102) performing feature extraction; (S103) establishing a feature set; (S105) character recognition (S105) Generate text characters.
  • the signals sensed by the sensor module and the inertial test unit IMU in each time window are collected, and a data model is established and stored in the memory;
  • the sensor module captures the bioelectrical change signal generated by the electromyogram when the finger hits the paper keyboard;
  • the IMU captures the reading of the acceleration sensor and the gyroscope when the arm moves, and analyzes the movement trajectory of the arm.
  • the noise affecting the EMG signal is removed by a filtering algorithm, and then the useful feature signal is extracted; in the step (S103), the latest feature data is performed according to the training model. Processing, establishing a structured feature model; in the step (S105), analyzing the data model, identifying a corresponding button of each action according to the matching algorithm, and determining a character to be input by the user; the step (S106) In the grammar rules, the missing characters are contextually analyzed, then the blur is fixed, and the text information is output.
  • the EMG-based wearable text input method further includes a self-learning step, which is: according to the latest feature set, combined with the historical feature model, further correcting the data to provide an accurate identification model.
  • the data provides a flexible interface.
  • the sensor module is a myoelectric sensor that senses a myoelectric bioelectrical change generated by a tapping action, converts it into a discrete digital signal and transmits it to a processor;
  • the test unit IMU records the motion information of the analysis arm and transmits it to the processor;
  • the communication module transmits the analyzed character information.
  • the smart wristband is more portable and more fashionable; the detachable design increases the fun of the device, and the reasonable selection of the sensor can improve the accuracy and reduce the energy consumption.
  • FIG. 1 is a schematic diagram of a demonstration of an EMG-based wearable text input system of the present invention.
  • FIG. 2 is a side elevational view of the wristband body of the EMG-based wearable text input system of the present invention.
  • FIG. 3 is a developed view of a wristband body of an EMG-based wearable text input system of the present invention.
  • Figure 4 is a schematic view showing the connection of the myoelectric sensor of the present invention.
  • FIG. 5 is a schematic structural diagram of an EMG-based wearable text input system according to the present invention.
  • FIG. 6 is a schematic flow chart of an EMG-based wearable text input method according to the present invention.
  • An EMG-based wearable text input system includes a wristband body and a sensor module, the wristband body embedding an inertial test unit IMU, a processor, a memory, a communication module, and an expansion slot; the sensor module is embedded in the Expanding the slot; the sensor transmitting the electromyographic bioelectrical change information to the processor; the inertia test unit IMU records the motion information of the analysis arm and transmits to the processor; the communication module analyzes the character Information is transmitted.
  • the sensor module is a myoelectric sensor that senses the myoelectric bioelectrical changes produced by the tapping action, converts them into discrete digital signals, and sends them to the processor.
  • the wristband body has a built-in power module, and the power module is a battery or an external charger; the interface on the wristband body is used for charging or data transmission.
  • the processor performs feature extraction, self-learning, key motion recognition and matching, and text combination on the signals transmitted by the sensor module and the inertial test unit IMU, and then sends the matched characters through the communication module.
  • the myoelectric sensor contains five electrodes, two of which are used to connect the expansion slots on the sides and the other three to sense the myoelectric changes at the bottom.
  • the invention also provides an EMG-based wearable text input method, comprising the steps of: (S101) receiving data information of a sensor module; (S102) performing feature extraction; (S103) establishing a feature set; (S105) character recognition (S105) Generate text characters.
  • the signals sensed by the sensor module and the inertial test unit IMU in each time window are collected, and a data model is established and stored in the memory; wherein the sensor module captures a finger tap The bioelectrical change signal generated by myoelectricity on the paper keyboard; the IMU captures the readings of the acceleration sensor and the gyroscope when the arm moves, and analyzes the movement trajectory of the arm.
  • the noise affecting the EMG signal is removed by the filtering algorithm, and then the useful feature signal is extracted; in the step (S103), the latest feature data is processed according to the training model to establish a structured a feature model; in the step (S105), analyzing the data model, identifying a corresponding button of each action according to the matching algorithm, and determining a character to be input by the user; in the step (S106), according to the grammar rule, Context analysis of missing characters, then blur repair, output text information.
  • the EMG-based wearable text input method further includes a self-learning step, which is: according to the latest feature set, combined with the historical feature model, further correcting the data, providing accurate data for the recognition model, and providing flexible interface.
  • the sensor module is a myoelectric sensor that senses a myoelectric bioelectrical change generated by a tapping action, converts it into a discrete digital signal and sends it to a processor; the inertial testing unit IMU records an analysis arm The motion information is transmitted to the processor; the communication module transmits the analyzed character information.
  • the present invention can be combined with other sleep monitoring, stepping and other functions on the same device, providing multiple functions at the same time, and more fashionable, according to successful cases using the myoelectric sensor, such as the MYO control arm ring,
  • the EMG sensor provides accurate EMG electrode change monitoring, even for simple tapping actions.
  • the present invention can use the myoelectric sensor to perceive the tapping action, and combines each tapping action with the character input through comprehensive analysis, as shown in FIG.
  • FIG. 2 is a side view of the smart wristband, wherein P101 is a processing module, P102 is a myoelectric sensor; and FIG. 3 is an expanded view of the smart wristband.
  • P201 is the expansion slot of the main wristband (eight in total), P202 is the internal connection point of the expansion slot, P203 is the processing module, P204 is the data transmission bus and power cable;
  • Figure 4 is a detachable myoelectric sensor, P301 It is three necessary sensing electrodes, P302 is two electrodes for connecting to the expansion slot connection point;
  • Figure 5 is the processing module, P401 is the processor, P402 is the memory, P403 is the six-axis inertial test unit (IMU), P404 It is a communication module, and P405 is a USB interface.
  • An EMG-based wearable text input system is a wearable intelligent system, which mainly includes a wristband main body and a myoelectric sensor module.
  • the myoelectric sensor is detachable and can be selectively embedded in the expansion groove of the wristband main body, and embedded. The position and number will affect the recognition accuracy and equipment energy consumption; the myoelectric sensor senses the myoelectric bioelectricity change and transmits it to the processor for processing; the wristband main processing module embeds a six-axis inertial test unit (IMU), which can record the user's arm movement. Data, the arm movement trajectory can be analyzed; the wristband main processing module has embedded processor and memory, and contains various processing algorithms to process the information acquired by the sensor; the wristband main body analyzes the character information through the embedded communication module. Transfer to other electronic devices.
  • An EMG sensor with the same function is optionally embedded in the expansion slot, and the sensor senses the electromyographic bioelectrical changes produced by the tapping action, converts it into discrete digital signals, and sends them to the processor.
  • the position and number of embedding of the myoelectric sensor will affect the accuracy. The more accurate the position of the sensor covering the myoelectricity, the higher the accuracy of the data. The more the sensor is used, the higher the accuracy, but the more energy is consumed.
  • the main body of the wristband has a built-in power module.
  • the power supply is provided by the battery.
  • the battery can be charged by a USB interface.
  • the USB interface can be used for charging, and can also be connected to other electronic devices to transmit data.
  • the main body is designed with an expansion slot.
  • the sensor can be embedded and embedded. Data can be transmitted, can also be charged; EMG sensor, built-in battery, can be independently charged; processor, contains a variety of algorithms (such as including "filtering, correction, matching” algorithm), signals sent by myoelectric sensors and IMU sensors Perform "feature extraction - self-learning - key motion recognition and matching - text combination", and finally send the matched characters through the communication module.
  • the present invention also provides an EMG-based wearable text input method.
  • the following The step completes the text entry.
  • S101 During the data collection phase, according to the training model, the signals sensed by the EMG and IMU sensors in each time window are collected, and a data model is established and stored in the memory; wherein the EMG sensor captures the muscles when the finger hits the paper keyboard.
  • S102 Feature extraction.
  • the data model is acquired from S101, and combined with the data acquired by the IMU, the noise affecting the EMG signal is removed by a filtering algorithm, and then the useful characteristic signal is extracted.
  • S103 Feature set.
  • a useful feature signal is obtained, which is recorded in the feature set, and the feature feature stores the historical feature data and the latest feature data.
  • the latest feature data is processed to establish a structured feature model. Combined with historical feature data, the existing feature models are gradually improved.
  • S104 Self-learning interface. According to the latest feature set, combined with the historical feature model, the data is further modified to provide accurate data for the recognition model, providing a flexible interface.
  • S105 Identify the model and the key recognition.
  • the data model provided by the self-learning interface is analyzed, and according to the matching algorithm, the corresponding button of each action is identified, and the character that the user wants to input is determined.
  • S106 A grammar-based text input interface. According to the grammar rules, the missing characters are contextually analyzed, then blurred and finally combined into words or even sentences.

Abstract

La présente invention s'applique au domaine de l'identification intelligente, et concerne un système d'entrée de texte à porter sur soi, qui est basé sur l'EMG. Le système comprend un corps principal sous forme de bracelet et un module capteur. Le corps principal sous forme de bracelet contient une unité de mesure d'inertie (IMU), un processeur, une mémoire, un module de communication et une fente d'extension. Le module capteur est inclus dans la fente d'extension. Le capteur transmet des informations de changement de bioélectricité myoélectrique au processeur. L'IMU enregistre et analyse des informations de mouvement d'un bras et les transmet au processeur. Le module de communication transmet des informations de caractères analysées. La présente invention est avantageuse car un bracelet intelligent est plus pratique à porter et plus à la mode, la conception détachable rend le dispositif plus amusant, et le choix raisonnable d'un capteur peut accroître la précision et réduire la consommation d'énergie.
PCT/CN2016/080732 2015-12-04 2016-04-29 Système d'entrée de texte à porter sur soi basé sur l'emg, et procédé WO2017092225A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510884533.5 2015-12-04
CN201510884533.5A CN105511615B (zh) 2015-12-04 2015-12-04 基于emg的可穿戴式文本输入系统及方法

Publications (1)

Publication Number Publication Date
WO2017092225A1 true WO2017092225A1 (fr) 2017-06-08

Family

ID=55719665

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/080732 WO2017092225A1 (fr) 2015-12-04 2016-04-29 Système d'entrée de texte à porter sur soi basé sur l'emg, et procédé

Country Status (2)

Country Link
CN (1) CN105511615B (fr)
WO (1) WO2017092225A1 (fr)

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10409371B2 (en) 2016-07-25 2019-09-10 Ctrl-Labs Corporation Methods and apparatus for inferring user intent based on neuromuscular signals
US10460455B2 (en) 2018-01-25 2019-10-29 Ctrl-Labs Corporation Real-time processing of handstate representation model estimates
US10489986B2 (en) 2018-01-25 2019-11-26 Ctrl-Labs Corporation User-controlled tuning of handstate representation model parameters
US10496168B2 (en) 2018-01-25 2019-12-03 Ctrl-Labs Corporation Calibration techniques for handstate representation modeling using neuromuscular signals
US10592001B2 (en) 2018-05-08 2020-03-17 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US10684692B2 (en) 2014-06-19 2020-06-16 Facebook Technologies, Llc Systems, devices, and methods for gesture identification
US10687759B2 (en) 2018-05-29 2020-06-23 Facebook Technologies, Llc Shielding techniques for noise reduction in surface electromyography signal measurement and related systems and methods
US10772519B2 (en) 2018-05-25 2020-09-15 Facebook Technologies, Llc Methods and apparatus for providing sub-muscular control
CN111700718A (zh) * 2020-07-13 2020-09-25 北京海益同展信息科技有限公司 一种识别握姿的方法、装置、假肢及可读存储介质
US10817795B2 (en) 2018-01-25 2020-10-27 Facebook Technologies, Llc Handstate reconstruction based on multiple inputs
US10842407B2 (en) 2018-08-31 2020-11-24 Facebook Technologies, Llc Camera-guided interpretation of neuromuscular signals
US10905383B2 (en) 2019-02-28 2021-02-02 Facebook Technologies, Llc Methods and apparatus for unsupervised one-shot machine learning for classification of human gestures and estimation of applied forces
US10921764B2 (en) 2018-09-26 2021-02-16 Facebook Technologies, Llc Neuromuscular control of physical objects in an environment
US10937414B2 (en) 2018-05-08 2021-03-02 Facebook Technologies, Llc Systems and methods for text input using neuromuscular information
US10970936B2 (en) 2018-10-05 2021-04-06 Facebook Technologies, Llc Use of neuromuscular signals to provide enhanced interactions with physical objects in an augmented reality environment
US10970374B2 (en) 2018-06-14 2021-04-06 Facebook Technologies, Llc User identification and authentication with neuromuscular signatures
US10990174B2 (en) 2016-07-25 2021-04-27 Facebook Technologies, Llc Methods and apparatus for predicting musculo-skeletal position information using wearable autonomous sensors
US11000211B2 (en) 2016-07-25 2021-05-11 Facebook Technologies, Llc Adaptive system for deriving control signals from measurements of neuromuscular activity
US11045137B2 (en) 2018-07-19 2021-06-29 Facebook Technologies, Llc Methods and apparatus for improved signal robustness for a wearable neuromuscular recording device
US11069148B2 (en) 2018-01-25 2021-07-20 Facebook Technologies, Llc Visualization of reconstructed handstate information
US11079846B2 (en) 2013-11-12 2021-08-03 Facebook Technologies, Llc Systems, articles, and methods for capacitive electromyography sensors
US11179066B2 (en) 2018-08-13 2021-11-23 Facebook Technologies, Llc Real-time spike detection and identification
US11216069B2 (en) 2018-05-08 2022-01-04 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US11337652B2 (en) 2016-07-25 2022-05-24 Facebook Technologies, Llc System and method for measuring the movements of articulated rigid bodies
US11481031B1 (en) 2019-04-30 2022-10-25 Meta Platforms Technologies, Llc Devices, systems, and methods for controlling computing devices via neuromuscular signals of users
US11481030B2 (en) 2019-03-29 2022-10-25 Meta Platforms Technologies, Llc Methods and apparatus for gesture detection and classification
US11493993B2 (en) 2019-09-04 2022-11-08 Meta Platforms Technologies, Llc Systems, methods, and interfaces for performing inputs based on neuromuscular control
US11567573B2 (en) 2018-09-20 2023-01-31 Meta Platforms Technologies, Llc Neuromuscular text entry, writing and drawing in augmented reality systems
US11635736B2 (en) 2017-10-19 2023-04-25 Meta Platforms Technologies, Llc Systems and methods for identifying biological structures associated with neuromuscular source signals
US11666264B1 (en) 2013-11-27 2023-06-06 Meta Platforms Technologies, Llc Systems, articles, and methods for electromyography sensors
US11797087B2 (en) 2018-11-27 2023-10-24 Meta Platforms Technologies, Llc Methods and apparatus for autocalibration of a wearable electrode sensor system
US11868531B1 (en) 2021-04-08 2024-01-09 Meta Platforms Technologies, Llc Wearable device providing for thumb-to-finger-based input gestures detected based on neuromuscular signals, and systems and methods of use thereof
US11907423B2 (en) 2019-11-25 2024-02-20 Meta Platforms Technologies, Llc Systems and methods for contextualized interactions with an environment
US11921471B2 (en) 2013-08-16 2024-03-05 Meta Platforms Technologies, Llc Systems, articles, and methods for wearable devices having secondary power sources in links of a band for providing secondary power in addition to a primary power source
US11961494B1 (en) 2019-03-29 2024-04-16 Meta Platforms Technologies, Llc Electromagnetic interference reduction in extended reality environments

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105511615B (zh) * 2015-12-04 2019-03-05 深圳大学 基于emg的可穿戴式文本输入系统及方法
CN105975091A (zh) * 2016-07-05 2016-09-28 南京理工大学 一种基于惯性传感器的虚拟键盘人机交互技术
CN110362190B (zh) * 2018-04-09 2021-10-29 中国科学院沈阳自动化研究所 基于myo的文本输入系统及方法
CN109634439B (zh) * 2018-12-20 2021-04-23 中国科学技术大学 智能文本输入方法
CN110811598A (zh) * 2019-11-14 2020-02-21 深圳先进技术研究院 腕带式生物信号采集设备及其制作方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101477636A (zh) * 2009-01-15 2009-07-08 电子科技大学 一种臂式可穿戴计算机终端设备
CN105022471A (zh) * 2014-04-23 2015-11-04 王建勤 基于压力传感器阵列进行手势识别的装置与方法
US20150346833A1 (en) * 2014-06-03 2015-12-03 Beijing TransBorder Information Technology Co., Ltd. Gesture recognition system and gesture recognition method
CN105511615A (zh) * 2015-12-04 2016-04-20 深圳大学 基于emg的可穿戴式文本输入系统及方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101477636A (zh) * 2009-01-15 2009-07-08 电子科技大学 一种臂式可穿戴计算机终端设备
CN105022471A (zh) * 2014-04-23 2015-11-04 王建勤 基于压力传感器阵列进行手势识别的装置与方法
US20150346833A1 (en) * 2014-06-03 2015-12-03 Beijing TransBorder Information Technology Co., Ltd. Gesture recognition system and gesture recognition method
CN105511615A (zh) * 2015-12-04 2016-04-20 深圳大学 基于emg的可穿戴式文本输入系统及方法

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11921471B2 (en) 2013-08-16 2024-03-05 Meta Platforms Technologies, Llc Systems, articles, and methods for wearable devices having secondary power sources in links of a band for providing secondary power in addition to a primary power source
US11079846B2 (en) 2013-11-12 2021-08-03 Facebook Technologies, Llc Systems, articles, and methods for capacitive electromyography sensors
US11666264B1 (en) 2013-11-27 2023-06-06 Meta Platforms Technologies, Llc Systems, articles, and methods for electromyography sensors
US10684692B2 (en) 2014-06-19 2020-06-16 Facebook Technologies, Llc Systems, devices, and methods for gesture identification
US10409371B2 (en) 2016-07-25 2019-09-10 Ctrl-Labs Corporation Methods and apparatus for inferring user intent based on neuromuscular signals
US10656711B2 (en) 2016-07-25 2020-05-19 Facebook Technologies, Llc Methods and apparatus for inferring user intent based on neuromuscular signals
US11000211B2 (en) 2016-07-25 2021-05-11 Facebook Technologies, Llc Adaptive system for deriving control signals from measurements of neuromuscular activity
US11337652B2 (en) 2016-07-25 2022-05-24 Facebook Technologies, Llc System and method for measuring the movements of articulated rigid bodies
US10990174B2 (en) 2016-07-25 2021-04-27 Facebook Technologies, Llc Methods and apparatus for predicting musculo-skeletal position information using wearable autonomous sensors
US11635736B2 (en) 2017-10-19 2023-04-25 Meta Platforms Technologies, Llc Systems and methods for identifying biological structures associated with neuromuscular source signals
US10496168B2 (en) 2018-01-25 2019-12-03 Ctrl-Labs Corporation Calibration techniques for handstate representation modeling using neuromuscular signals
US11127143B2 (en) 2018-01-25 2021-09-21 Facebook Technologies, Llc Real-time processing of handstate representation model estimates
US10489986B2 (en) 2018-01-25 2019-11-26 Ctrl-Labs Corporation User-controlled tuning of handstate representation model parameters
US10460455B2 (en) 2018-01-25 2019-10-29 Ctrl-Labs Corporation Real-time processing of handstate representation model estimates
US11587242B1 (en) 2018-01-25 2023-02-21 Meta Platforms Technologies, Llc Real-time processing of handstate representation model estimates
US11069148B2 (en) 2018-01-25 2021-07-20 Facebook Technologies, Llc Visualization of reconstructed handstate information
US11361522B2 (en) 2018-01-25 2022-06-14 Facebook Technologies, Llc User-controlled tuning of handstate representation model parameters
US10817795B2 (en) 2018-01-25 2020-10-27 Facebook Technologies, Llc Handstate reconstruction based on multiple inputs
US11163361B2 (en) 2018-01-25 2021-11-02 Facebook Technologies, Llc Calibration techniques for handstate representation modeling using neuromuscular signals
US11216069B2 (en) 2018-05-08 2022-01-04 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US11036302B1 (en) 2018-05-08 2021-06-15 Facebook Technologies, Llc Wearable devices and methods for improved speech recognition
US10937414B2 (en) 2018-05-08 2021-03-02 Facebook Technologies, Llc Systems and methods for text input using neuromuscular information
US10592001B2 (en) 2018-05-08 2020-03-17 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US10772519B2 (en) 2018-05-25 2020-09-15 Facebook Technologies, Llc Methods and apparatus for providing sub-muscular control
US10687759B2 (en) 2018-05-29 2020-06-23 Facebook Technologies, Llc Shielding techniques for noise reduction in surface electromyography signal measurement and related systems and methods
US11129569B1 (en) 2018-05-29 2021-09-28 Facebook Technologies, Llc Shielding techniques for noise reduction in surface electromyography signal measurement and related systems and methods
US10970374B2 (en) 2018-06-14 2021-04-06 Facebook Technologies, Llc User identification and authentication with neuromuscular signatures
US11045137B2 (en) 2018-07-19 2021-06-29 Facebook Technologies, Llc Methods and apparatus for improved signal robustness for a wearable neuromuscular recording device
US11179066B2 (en) 2018-08-13 2021-11-23 Facebook Technologies, Llc Real-time spike detection and identification
US10842407B2 (en) 2018-08-31 2020-11-24 Facebook Technologies, Llc Camera-guided interpretation of neuromuscular signals
US10905350B2 (en) 2018-08-31 2021-02-02 Facebook Technologies, Llc Camera-guided interpretation of neuromuscular signals
US11567573B2 (en) 2018-09-20 2023-01-31 Meta Platforms Technologies, Llc Neuromuscular text entry, writing and drawing in augmented reality systems
US10921764B2 (en) 2018-09-26 2021-02-16 Facebook Technologies, Llc Neuromuscular control of physical objects in an environment
US10970936B2 (en) 2018-10-05 2021-04-06 Facebook Technologies, Llc Use of neuromuscular signals to provide enhanced interactions with physical objects in an augmented reality environment
US11941176B1 (en) 2018-11-27 2024-03-26 Meta Platforms Technologies, Llc Methods and apparatus for autocalibration of a wearable electrode sensor system
US11797087B2 (en) 2018-11-27 2023-10-24 Meta Platforms Technologies, Llc Methods and apparatus for autocalibration of a wearable electrode sensor system
US10905383B2 (en) 2019-02-28 2021-02-02 Facebook Technologies, Llc Methods and apparatus for unsupervised one-shot machine learning for classification of human gestures and estimation of applied forces
US11481030B2 (en) 2019-03-29 2022-10-25 Meta Platforms Technologies, Llc Methods and apparatus for gesture detection and classification
US11961494B1 (en) 2019-03-29 2024-04-16 Meta Platforms Technologies, Llc Electromagnetic interference reduction in extended reality environments
US11481031B1 (en) 2019-04-30 2022-10-25 Meta Platforms Technologies, Llc Devices, systems, and methods for controlling computing devices via neuromuscular signals of users
US11493993B2 (en) 2019-09-04 2022-11-08 Meta Platforms Technologies, Llc Systems, methods, and interfaces for performing inputs based on neuromuscular control
US11907423B2 (en) 2019-11-25 2024-02-20 Meta Platforms Technologies, Llc Systems and methods for contextualized interactions with an environment
CN111700718A (zh) * 2020-07-13 2020-09-25 北京海益同展信息科技有限公司 一种识别握姿的方法、装置、假肢及可读存储介质
US11868531B1 (en) 2021-04-08 2024-01-09 Meta Platforms Technologies, Llc Wearable device providing for thumb-to-finger-based input gestures detected based on neuromuscular signals, and systems and methods of use thereof

Also Published As

Publication number Publication date
CN105511615A (zh) 2016-04-20
CN105511615B (zh) 2019-03-05

Similar Documents

Publication Publication Date Title
WO2017092225A1 (fr) Système d'entrée de texte à porter sur soi basé sur l'emg, et procédé
US10649549B2 (en) Device, method, and system to recognize motion using gripped object
JP2021072136A (ja) ジェスチャに基づいて制御するための筋活動センサ信号と慣性センサ信号とを結合する方法および装置
CN104134060B (zh) 基于肌电信号和运动传感器的手语翻译和显示发声系统
Ganti et al. Satire: a software architecture for smart attire
CN104919396B (zh) 在头戴式显示器中利用身体握手
EP3315914B1 (fr) Procédé, dispositif et terminal de comptage de pas
US11222729B2 (en) Electronic device and method for providing stress index corresponding to activity of user
CN103513770A (zh) 基于三轴陀螺仪的人机接口设备及人机交互方法
CN210402266U (zh) 一种手语翻译系统和手语翻译手套
US20180188809A1 (en) Bioelectricity-based control method and apparatus, and bioelectricity-based controller
CN109634439B (zh) 智能文本输入方法
CN107798322A (zh) 一种智能笔
CN110442233A (zh) 一种基于手势交互的增强现实键鼠系统
CN105530581A (zh) 一种基于声音识别的智能穿戴设备和控制方法
CN110807471B (zh) 一种多模态传感器的行为识别系统及识别方法
CN105404390A (zh) 一种无线数据手套建模及手势动作识别方法
Roggen et al. An educational and research kit for activity and context recognition from on-body sensors
CN203552178U (zh) 腕带式手部运动识别装置
CN106843482A (zh) 一种基于无线自组网模式的手势姿态检测装置
CN107450672B (zh) 一种高识别率的腕式智能装置
CN105759970A (zh) 一种基于弯曲传感器的手势识别装置和手语翻译方法
KR20080053022A (ko) 유비쿼터스 컴퓨팅 환경에서의 다목적 최적화 기법을이용한 착용형 컴퓨터 및 그 방법
CN108089710A (zh) 一种电子设备控制方法、装置及电子设备
CN116909390A (zh) 基于手套的多模态数据采集系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16869539

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 25/09/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16869539

Country of ref document: EP

Kind code of ref document: A1