KR102220893B1 - 표면들 상에서의 제스처 인식을 위한 emg의 사용 - Google Patents

표면들 상에서의 제스처 인식을 위한 emg의 사용 Download PDF

Info

Publication number
KR102220893B1
KR102220893B1 KR1020157021340A KR20157021340A KR102220893B1 KR 102220893 B1 KR102220893 B1 KR 102220893B1 KR 1020157021340 A KR1020157021340 A KR 1020157021340A KR 20157021340 A KR20157021340 A KR 20157021340A KR 102220893 B1 KR102220893 B1 KR 102220893B1
Authority
KR
South Korea
Prior art keywords
body part
gesture
motion
determining whether
sensed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020157021340A
Other languages
English (en)
Korean (ko)
Other versions
KR20150107785A (ko
Inventor
배백 포르탄포어
시바쿠마르 바라수브라마니얌
비터 알. 카르발로
베네트 엠. 킹
질 에스. 이와사키
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20150107785A publication Critical patent/KR20150107785A/ko
Application granted granted Critical
Publication of KR102220893B1 publication Critical patent/KR102220893B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G06K9/00335—

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Dermatology (AREA)
  • Biomedical Technology (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
KR1020157021340A 2013-01-14 2014-01-10 표면들 상에서의 제스처 인식을 위한 emg의 사용 Active KR102220893B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/740,315 2013-01-14
US13/740,315 US9092664B2 (en) 2013-01-14 2013-01-14 Use of EMG for subtle gesture recognition on surfaces
PCT/US2014/011136 WO2014110439A1 (en) 2013-01-14 2014-01-10 Use of emg for gesture recognition on surfaces

Publications (2)

Publication Number Publication Date
KR20150107785A KR20150107785A (ko) 2015-09-23
KR102220893B1 true KR102220893B1 (ko) 2021-02-25

Family

ID=50071724

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020157021340A Active KR102220893B1 (ko) 2013-01-14 2014-01-10 표면들 상에서의 제스처 인식을 위한 emg의 사용

Country Status (6)

Country Link
US (1) US9092664B2 (enExample)
EP (1) EP2943855B1 (enExample)
JP (1) JP6227669B2 (enExample)
KR (1) KR102220893B1 (enExample)
CN (1) CN104919397B (enExample)
WO (1) WO2014110439A1 (enExample)

Families Citing this family (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10042422B2 (en) 2013-11-12 2018-08-07 Thalmic Labs Inc. Systems, articles, and methods for capacitive electromyography sensors
US20150124566A1 (en) * 2013-10-04 2015-05-07 Thalmic Labs Inc. Systems, articles and methods for wearable electronic devices employing contact sensors
US11921471B2 (en) 2013-08-16 2024-03-05 Meta Platforms Technologies, Llc Systems, articles, and methods for wearable devices having secondary power sources in links of a band for providing secondary power in addition to a primary power source
US12504816B2 (en) 2013-08-16 2025-12-23 Meta Platforms Technologies, Llc Wearable devices and associated band structures for sensing neuromuscular signals using sensor pairs in respective pods with communicative pathways to a common processor
WO2015081113A1 (en) 2013-11-27 2015-06-04 Cezar Morun Systems, articles, and methods for electromyography sensors
KR20150065336A (ko) * 2013-12-05 2015-06-15 삼성전자주식회사 전자 장치의 제스처 인식 방법, 장치 및 컴퓨터 판독 가능한 기록 매체
US10585484B2 (en) * 2013-12-30 2020-03-10 Samsung Electronics Co., Ltd. Apparatus, system, and method for transferring data from a terminal to an electromyography (EMG) device
US9880632B2 (en) 2014-06-19 2018-01-30 Thalmic Labs Inc. Systems, devices, and methods for gesture identification
US20170265780A1 (en) * 2014-12-09 2017-09-21 Lg Innotek Co., Ltd. Band type sensor and wearable device having the same
CN107168583A (zh) * 2015-01-19 2017-09-15 青岛海信移动通信技术股份有限公司 一种触摸屏检测方法及终端
CN106339076B (zh) * 2015-10-22 2019-11-15 北京智谷睿拓技术服务有限公司 基于动作识别的控制方法及控制装置
CN106371569A (zh) * 2015-10-22 2017-02-01 北京智谷睿拓技术服务有限公司 动作识别方法及动作识别装置
US20200073483A1 (en) 2018-08-31 2020-03-05 Ctrl-Labs Corporation Camera-guided interpretation of neuromuscular signals
US11216069B2 (en) 2018-05-08 2022-01-04 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US12554325B2 (en) 2016-07-25 2026-02-17 Meta Platforms Technologies, Llc Methods and apparatuses for low latency body state prediction based on neuromuscular data
WO2018022602A1 (en) 2016-07-25 2018-02-01 Ctrl-Labs Corporation Methods and apparatus for predicting musculo-skeletal position information using wearable autonomous sensors
EP3548994B1 (en) 2016-12-02 2021-08-11 Pison Technology, Inc. Detecting and using body tissue electrical signals
CN106821720B (zh) * 2017-01-13 2020-05-19 北京安云世纪科技有限公司 一种穴位按摩的推送方法、装置及ar设备
US10902743B2 (en) 2017-04-14 2021-01-26 Arizona Board Of Regents On Behalf Of Arizona State University Gesture recognition and communication
CN109213305A (zh) * 2017-06-29 2019-01-15 沈阳新松机器人自动化股份有限公司 一种基于表面肌电信号的手势识别方法
EP3697297A4 (en) 2017-10-19 2020-12-16 Facebook Technologies, Inc. SYSTEMS AND PROCEDURES FOR IDENTIFICATION OF BIOLOGICAL STRUCTURES IN CONNECTION WITH SIGNALS OF NEUROMUSCULAR ORIGIN
US10937414B2 (en) 2018-05-08 2021-03-02 Facebook Technologies, Llc Systems and methods for text input using neuromuscular information
US11493993B2 (en) 2019-09-04 2022-11-08 Meta Platforms Technologies, Llc Systems, methods, and interfaces for performing inputs based on neuromuscular control
US11150730B1 (en) 2019-04-30 2021-10-19 Facebook Technologies, Llc Devices, systems, and methods for controlling computing devices via neuromuscular signals of users
US11481030B2 (en) 2019-03-29 2022-10-25 Meta Platforms Technologies, Llc Methods and apparatus for gesture detection and classification
US12579768B2 (en) 2018-01-25 2026-03-17 Meta Platforms Technologies, Llc Wearable electronic devices, extended reality systems including neuromuscular sensors, and methods for generating text from speech input and modifying the generated text based on neuromuscular data
US11961494B1 (en) 2019-03-29 2024-04-16 Meta Platforms Technologies, Llc Electromagnetic interference reduction in extended reality environments
US11907423B2 (en) 2019-11-25 2024-02-20 Meta Platforms Technologies, Llc Systems and methods for contextualized interactions with an environment
US10592001B2 (en) 2018-05-08 2020-03-17 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US10802598B2 (en) * 2018-08-05 2020-10-13 Pison Technology, Inc. User interface control of responsive devices
US11099647B2 (en) * 2018-08-05 2021-08-24 Pison Technology, Inc. User interface control of responsive devices
CN112789577B (zh) 2018-09-20 2024-04-05 元平台技术有限公司 增强现实系统中的神经肌肉文本输入、书写和绘图
CN112739254A (zh) * 2018-09-20 2021-04-30 脸谱科技有限责任公司 增强现实系统的神经肌肉控制
CN113423341B (zh) 2018-11-27 2024-12-03 元平台技术有限公司 用于可穿戴电极传感器系统的自动校准的方法和装置
US11157086B2 (en) 2020-01-28 2021-10-26 Pison Technology, Inc. Determining a geographical location based on human gestures
US11199908B2 (en) 2020-01-28 2021-12-14 Pison Technology, Inc. Wrist-worn device-based inputs for an operating system
US11397466B2 (en) * 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
US11397468B2 (en) 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
CN112315488A (zh) * 2020-11-23 2021-02-05 宁波工业互联网研究院有限公司 一种基于肌电信号的人体运动状态识别方法
US11868531B1 (en) 2021-04-08 2024-01-09 Meta Platforms Technologies, Llc Wearable device providing for thumb-to-finger-based input gestures detected based on neuromuscular signals, and systems and methods of use thereof
US12340627B2 (en) 2022-09-26 2025-06-24 Pison Technology, Inc. System and methods for gesture inference using computer vision
US12366920B2 (en) 2022-09-26 2025-07-22 Pison Technology, Inc. Systems and methods for gesture inference using transformations
US12366923B2 (en) 2022-09-26 2025-07-22 Pison Technology, Inc. Systems and methods for gesture inference using ML model selection
US12502110B2 (en) 2023-10-24 2025-12-23 Pison Technology, Inc. Systems and methods for determining physiological state based on surface biopotentials

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100219989A1 (en) * 2009-02-27 2010-09-02 Denso Corporation Input system and wearable electrical apparatus

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7020508B2 (en) * 2002-08-22 2006-03-28 Bodymedia, Inc. Apparatus for detecting human physiological and contextual information
EP1408443B1 (en) * 2002-10-07 2006-10-18 Sony France S.A. Method and apparatus for analysing gestures produced by a human, e.g. for commanding apparatus by gesture recognition
JP2004348382A (ja) * 2003-05-21 2004-12-09 Ntt Docomo Inc 携帯型電子装置およびその制御方法
US7519223B2 (en) * 2004-06-28 2009-04-14 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
JP2006323690A (ja) * 2005-05-19 2006-11-30 Sony Corp 検索装置，プログラム及び検索方法
US20090278798A1 (en) 2006-07-26 2009-11-12 The Research Foundation Of The State University Of New York Active Fingertip-Mounted Object Digitizer
US8860683B2 (en) * 2007-04-05 2014-10-14 Cypress Semiconductor Corporation Integrated button activation sensing and proximity sensing
JP2008304632A (ja) * 2007-06-06 2008-12-18 Casio Comput Co Ltd カメラ及びカメラのレンズ鏡筒制御方法
US20110210931A1 (en) 2007-08-19 2011-09-01 Ringbow Ltd. Finger-worn device and interaction methods and communication methods
KR100934514B1 (ko) * 2008-05-07 2009-12-29 엘지전자 주식회사 근접한 공간에서의 제스쳐를 이용한 사용자 인터페이스제어방법
US8170656B2 (en) * 2008-06-26 2012-05-01 Microsoft Corporation Wearable electromyography-based controllers for human-computer interface
CN101482773A (zh) * 2009-01-16 2009-07-15 中国科学技术大学 一种多通道无线表面肌电信号采集装置及系统
US8378967B2 (en) * 2009-02-27 2013-02-19 Denso Corporation Wearable electrical apparatus
CN102498669B (zh) * 2009-04-07 2015-10-21 艾登特科技股份公司 用于抓握和靠近检测的传感器设备和方法
US8581856B2 (en) 2009-05-27 2013-11-12 Microsoft Corporation Touch sensitive display apparatus using sensor input
CN101930285B (zh) * 2009-11-23 2012-07-18 上海交通大学 基于表面肌电信号的手写识别方法
CN102906623A (zh) 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 交互式头戴目镜上的本地广告内容
WO2011151881A1 (ja) 2010-05-31 2011-12-08 株式会社モバイルビジネスプロモート 入力補助具
US8874129B2 (en) * 2010-06-10 2014-10-28 Qualcomm Incorporated Pre-fetching information based on gesture and/or location
CN102893236B (zh) * 2010-07-20 2015-11-25 英派尔科技开发有限公司 增强现实临近检测
US9089270B2 (en) * 2011-06-29 2015-07-28 Lg Electronics Inc. Terminal and control method thereof
CN102854973A (zh) * 2011-06-30 2013-01-02 德信互动科技（北京）有限公司 单机游戏实现装置和方法
CN102799270B (zh) * 2012-07-04 2015-03-11 北京理工大学 一种基于静电和肌电探测的人机交互方法

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100219989A1 (en) * 2009-02-27 2010-09-02 Denso Corporation Input system and wearable electrical apparatus

Also Published As

Publication number Publication date
EP2943855A1 (en) 2015-11-18
KR20150107785A (ko) 2015-09-23
CN104919397B (zh) 2019-03-15
EP2943855B1 (en) 2018-08-29
CN104919397A (zh) 2015-09-16
US20140198944A1 (en) 2014-07-17
WO2014110439A1 (en) 2014-07-17
US9092664B2 (en) 2015-07-28
JP6227669B2 (ja) 2017-11-08
JP2016507098A (ja) 2016-03-07

Similar Documents

Publication Publication Date Title
KR102220893B1 (ko) 표면들 상에서의 제스처 인식을 위한 emg의 사용
US10313587B2 (en) Power management in an eye-tracking system
KR102243977B1 (ko) 두부 장착형 디스플레이들에서의 물리적 악수의 레버리징
US10048761B2 (en) Classification of gesture detection systems through use of known and yet to be worn sensors
US10417901B2 (en) Electronic device and control method thereof
TWI510996B (zh) 控制觸控面板的方法以及使用該方法的可攜式電腦
CN104203095B (zh) 睡眠状态管理装置、睡眠状态管理方法
US20160070342A1 (en) Distracted browsing modes
WO2013060826A1 (en) Intelligent user mode selection in an eye-tracking system
KR102253100B1 (ko) 저비용 힘-감지 디바이스를 위한 초 저전력 모드
US10276036B2 (en) Electronic system and control method for the same
EP3488327B1 (en) Wearable device and method of operating the same
JP2020501309A (ja) 容量性ハンドルのための方法及びシステム
CN116390689A (zh) 使用生物传感器信号用于功率管理的头戴式设备
Sadat et al. Recognizing human affection: Smartphone perspective
EP4581451A1 (en) Passive proximity detection using an electrode

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20150806

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20181227

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20200429

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20201126

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20210222

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20210222

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20240102

Start annual number: 4

End annual number: 4

PR1001 Payment of annual fee

Payment date: 20241223

Start annual number: 5

End annual number: 5