JP6227669B2 - 表面上でのジェスチャ認識のためのｅｍｇの使用 - Google Patents

表面上でのジェスチャ認識のためのｅｍｇの使用 Download PDF

Info

Publication number
JP6227669B2
JP6227669B2 JP2015552831A JP2015552831A JP6227669B2 JP 6227669 B2 JP6227669 B2 JP 6227669B2 JP 2015552831 A JP2015552831 A JP 2015552831A JP 2015552831 A JP2015552831 A JP 2015552831A JP 6227669 B2 JP6227669 B2 JP 6227669B2
Authority
JP
Japan
Prior art keywords
body portion
gesture
motion
body part
determining whether
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015552831A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016507098A (ja
JP2016507098A5 (enExample
Inventor
フォルタンプーア、ババク
バラサブラマンヤム、シバクマー
カルバルホ、ビター・アール．
キング、ベネット・エム．
イワサキ、ジル・エス．
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2016507098A publication Critical patent/JP2016507098A/ja
Publication of JP2016507098A5 publication Critical patent/JP2016507098A5/ja
Application granted granted Critical
Publication of JP6227669B2 publication Critical patent/JP6227669B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Dermatology (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
JP2015552831A 2013-01-14 2014-01-10 表面上でのジェスチャ認識のためのｅｍｇの使用 Active JP6227669B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/740,315 US9092664B2 (en) 2013-01-14 2013-01-14 Use of EMG for subtle gesture recognition on surfaces
US13/740,315 2013-01-14
PCT/US2014/011136 WO2014110439A1 (en) 2013-01-14 2014-01-10 Use of emg for gesture recognition on surfaces

Publications (3)

Publication Number Publication Date
JP2016507098A JP2016507098A (ja) 2016-03-07
JP2016507098A5 JP2016507098A5 (enExample) 2017-02-02
JP6227669B2 true JP6227669B2 (ja) 2017-11-08

Family

ID=50071724

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015552831A Active JP6227669B2 (ja) 2013-01-14 2014-01-10 表面上でのジェスチャ認識のためのｅｍｇの使用

Country Status (6)

Country Link
US (1) US9092664B2 (enExample)
EP (1) EP2943855B1 (enExample)
JP (1) JP6227669B2 (enExample)
KR (1) KR102220893B1 (enExample)
CN (1) CN104919397B (enExample)
WO (1) WO2014110439A1 (enExample)

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11921471B2 (en) 2013-08-16 2024-03-05 Meta Platforms Technologies, Llc Systems, articles, and methods for wearable devices having secondary power sources in links of a band for providing secondary power in addition to a primary power source
US10042422B2 (en) 2013-11-12 2018-08-07 Thalmic Labs Inc. Systems, articles, and methods for capacitive electromyography sensors
US20150124566A1 (en) * 2013-10-04 2015-05-07 Thalmic Labs Inc. Systems, articles and methods for wearable electronic devices employing contact sensors
US10188309B2 (en) 2013-11-27 2019-01-29 North Inc. Systems, articles, and methods for electromyography sensors
US12504816B2 (en) 2013-08-16 2025-12-23 Meta Platforms Technologies, Llc Wearable devices and associated band structures for sensing neuromuscular signals using sensor pairs in respective pods with communicative pathways to a common processor
KR20150065336A (ko) * 2013-12-05 2015-06-15 삼성전자주식회사 전자 장치의 제스처 인식 방법, 장치 및 컴퓨터 판독 가능한 기록 매체
US10585484B2 (en) * 2013-12-30 2020-03-10 Samsung Electronics Co., Ltd. Apparatus, system, and method for transferring data from a terminal to an electromyography (EMG) device
US9880632B2 (en) 2014-06-19 2018-01-30 Thalmic Labs Inc. Systems, devices, and methods for gesture identification
WO2016093612A1 (en) * 2014-12-09 2016-06-16 Lg Innotek Co., Ltd. Band type sensor and wearable device having the same
CN107132951A (zh) * 2015-01-19 2017-09-05 青岛海信移动通信技术股份有限公司 一种触摸屏检测方法及终端
CN106339076B (zh) * 2015-10-22 2019-11-15 北京智谷睿拓技术服务有限公司 基于动作识别的控制方法及控制装置
CN106371569A (zh) * 2015-10-22 2017-02-01 北京智谷睿拓技术服务有限公司 动作识别方法及动作识别装置
WO2018022602A1 (en) 2016-07-25 2018-02-01 Ctrl-Labs Corporation Methods and apparatus for predicting musculo-skeletal position information using wearable autonomous sensors
US11216069B2 (en) 2018-05-08 2022-01-04 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US12554325B2 (en) 2016-07-25 2026-02-17 Meta Platforms Technologies, Llc Methods and apparatuses for low latency body state prediction based on neuromuscular data
KR102038120B1 (ko) 2016-12-02 2019-10-30 피손 테크놀로지, 인크. 신체 조직 전기 신호의 검출 및 사용
CN106821720B (zh) * 2017-01-13 2020-05-19 北京安云世纪科技有限公司 一种穴位按摩的推送方法、装置及ar设备
US10902743B2 (en) 2017-04-14 2021-01-26 Arizona Board Of Regents On Behalf Of Arizona State University Gesture recognition and communication
CN109213305A (zh) * 2017-06-29 2019-01-15 沈阳新松机器人自动化股份有限公司 一种基于表面肌电信号的手势识别方法
CN112040858B (zh) 2017-10-19 2024-06-07 元平台技术有限公司 用于识别与神经肌肉源信号相关的生物结构的系统和方法
US11150730B1 (en) 2019-04-30 2021-10-19 Facebook Technologies, Llc Devices, systems, and methods for controlling computing devices via neuromuscular signals of users
US11907423B2 (en) 2019-11-25 2024-02-20 Meta Platforms Technologies, Llc Systems and methods for contextualized interactions with an environment
US10937414B2 (en) 2018-05-08 2021-03-02 Facebook Technologies, Llc Systems and methods for text input using neuromuscular information
US12579768B2 (en) 2018-01-25 2026-03-17 Meta Platforms Technologies, Llc Wearable electronic devices, extended reality systems including neuromuscular sensors, and methods for generating text from speech input and modifying the generated text based on neuromuscular data
US11961494B1 (en) 2019-03-29 2024-04-16 Meta Platforms Technologies, Llc Electromagnetic interference reduction in extended reality environments
US11493993B2 (en) 2019-09-04 2022-11-08 Meta Platforms Technologies, Llc Systems, methods, and interfaces for performing inputs based on neuromuscular control
US11481030B2 (en) 2019-03-29 2022-10-25 Meta Platforms Technologies, Llc Methods and apparatus for gesture detection and classification
US10592001B2 (en) 2018-05-08 2020-03-17 Facebook Technologies, Llc Systems and methods for improved speech recognition using neuromuscular information
US10802598B2 (en) 2018-08-05 2020-10-13 Pison Technology, Inc. User interface control of responsive devices
US11099647B2 (en) * 2018-08-05 2021-08-24 Pison Technology, Inc. User interface control of responsive devices
WO2020047429A1 (en) 2018-08-31 2020-03-05 Ctrl-Labs Corporation Camera-guided interpretation of neuromuscular signals
EP3853698A4 (en) 2018-09-20 2021-11-17 Facebook Technologies, LLC NEUROMUSCULAR TEXT ENTRY, WRITING AND DRAWING IN SYSTEMS WITH EXTENDED REALITY
EP3852613A4 (en) * 2018-09-20 2021-11-24 Facebook Technologies, LLC. NEUROMUSCULAR CONTROL OF AN AUGMENTED REALITY SYSTEM
EP3886693A4 (en) 2018-11-27 2022-06-08 Facebook Technologies, LLC. METHOD AND DEVICE FOR AUTOCALIBRATION OF A PORTABLE ELECTRODE SENSING SYSTEM
US11199908B2 (en) 2020-01-28 2021-12-14 Pison Technology, Inc. Wrist-worn device-based inputs for an operating system
US11157086B2 (en) 2020-01-28 2021-10-26 Pison Technology, Inc. Determining a geographical location based on human gestures
US11397468B2 (en) 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
US11397466B2 (en) * 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
CN112315488A (zh) * 2020-11-23 2021-02-05 宁波工业互联网研究院有限公司 一种基于肌电信号的人体运动状态识别方法
US11868531B1 (en) 2021-04-08 2024-01-09 Meta Platforms Technologies, Llc Wearable device providing for thumb-to-finger-based input gestures detected based on neuromuscular signals, and systems and methods of use thereof
US12056285B2 (en) 2021-09-24 2024-08-06 Apple Inc. Electrodes for gesture recognition
US12366920B2 (en) 2022-09-26 2025-07-22 Pison Technology, Inc. Systems and methods for gesture inference using transformations
US12340627B2 (en) 2022-09-26 2025-06-24 Pison Technology, Inc. System and methods for gesture inference using computer vision
US12366923B2 (en) 2022-09-26 2025-07-22 Pison Technology, Inc. Systems and methods for gesture inference using ML model selection
US12502110B2 (en) 2023-10-24 2025-12-23 Pison Technology, Inc. Systems and methods for determining physiological state based on surface biopotentials

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7020508B2 (en) * 2002-08-22 2006-03-28 Bodymedia, Inc. Apparatus for detecting human physiological and contextual information
DE60215504T2 (de) * 2002-10-07 2007-09-06 Sony France S.A. Verfahren und Gerät zur Analyse von Gesten eines Menschen, z.B. zur Steuerung einer Maschine durch Gestik
JP2004348382A (ja) * 2003-05-21 2004-12-09 Ntt Docomo Inc 携帯型電子装置およびその制御方法
US7519223B2 (en) * 2004-06-28 2009-04-14 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
JP2006323690A (ja) * 2005-05-19 2006-11-30 Sony Corp 検索装置，プログラム及び検索方法
US20090278798A1 (en) 2006-07-26 2009-11-12 The Research Foundation Of The State University Of New York Active Fingertip-Mounted Object Digitizer
US8860683B2 (en) * 2007-04-05 2014-10-14 Cypress Semiconductor Corporation Integrated button activation sensing and proximity sensing
JP2008304632A (ja) * 2007-06-06 2008-12-18 Casio Comput Co Ltd カメラ及びカメラのレンズ鏡筒制御方法
US20110210931A1 (en) 2007-08-19 2011-09-01 Ringbow Ltd. Finger-worn device and interaction methods and communication methods
KR100934514B1 (ko) * 2008-05-07 2009-12-29 엘지전자 주식회사 근접한 공간에서의 제스쳐를 이용한 사용자 인터페이스제어방법
US8170656B2 (en) * 2008-06-26 2012-05-01 Microsoft Corporation Wearable electromyography-based controllers for human-computer interface
CN101482773A (zh) * 2009-01-16 2009-07-15 中国科学技术大学 一种多通道无线表面肌电信号采集装置及系统
JP4683148B2 (ja) 2009-02-27 2011-05-11 株式会社デンソー 電気機器
US8378967B2 (en) * 2009-02-27 2013-02-19 Denso Corporation Wearable electrical apparatus
ES2571133T3 (es) * 2009-04-07 2016-05-24 Microchip Tech Germany Gmbh Dispositivo sensor y procedimiento de detección de agarre y proximidad
US8581856B2 (en) 2009-05-27 2013-11-12 Microsoft Corporation Touch sensitive display apparatus using sensor input
CN101930285B (zh) * 2009-11-23 2012-07-18 上海交通大学 基于表面肌电信号的手写识别方法
AU2011220382A1 (en) 2010-02-28 2012-10-18 Microsoft Corporation Local advertising content on an interactive head-mounted eyepiece
WO2011151881A1 (ja) 2010-05-31 2011-12-08 株式会社モバイルビジネスプロモート 入力補助具
US8874129B2 (en) * 2010-06-10 2014-10-28 Qualcomm Incorporated Pre-fetching information based on gesture and/or location
US9606612B2 (en) * 2010-07-20 2017-03-28 Empire Technology Development Llc Augmented reality proximity sensing
US9089270B2 (en) * 2011-06-29 2015-07-28 Lg Electronics Inc. Terminal and control method thereof
CN102854973A (zh) * 2011-06-30 2013-01-02 德信互动科技（北京）有限公司 单机游戏实现装置和方法
CN102799270B (zh) * 2012-07-04 2015-03-11 北京理工大学 一种基于静电和肌电探测的人机交互方法

Also Published As

Publication number Publication date
KR102220893B1 (ko) 2021-02-25
KR20150107785A (ko) 2015-09-23
CN104919397A (zh) 2015-09-16
JP2016507098A (ja) 2016-03-07
US20140198944A1 (en) 2014-07-17
EP2943855A1 (en) 2015-11-18
US9092664B2 (en) 2015-07-28
EP2943855B1 (en) 2018-08-29
CN104919397B (zh) 2019-03-15
WO2014110439A1 (en) 2014-07-17

Similar Documents

Publication Publication Date Title
JP2016507098A (ja) 表面上でのジェスチャ認識のためのｅｍｇの使用
US10048761B2 (en) Classification of gesture detection systems through use of known and yet to be worn sensors
KR102714622B1 (ko) 졸음 시작 검출 기법
CN106055088B (zh) 交互式穿戴式设备的空气书写和手势系统
CN106687967B (zh) 用于对与触敏设备的接触进行分类的方法和装置
CN107924279B (zh) 具有多传感器流同步数据的触敏设备
US10942603B2 (en) Managing activity states of an application processor in relation to touch or hover interactions with a touch sensitive device
KR102243977B1 (ko) 두부 장착형 디스플레이들에서의 물리적 악수의 레버리징
US10282024B2 (en) Classifying contacts or associations with a touch sensitive device
TWI647625B (zh) 判斷使用者之姿勢之影像偵測方法以及影像偵測裝置
US20160061600A1 (en) Adaptive detection of user proximity
KR20190131087A (ko) 저비용 힘-감지 디바이스를 위한 초 저전력 모드
Abulkhair et al. Mobile platform detect and alerts system for driver fatigue
CN110109563A (zh) 一种确定对象物相对于触敏表面的接触状态的方法及系统
CN104850375A (zh) 阻止显示屏清除的方法和装置
CN104808777B (zh) 判断头戴式智能设备操作有效性的装置和方法
GB2632930A (en) Obtaining wellness insights using an input device
WO2017028198A1 (zh) 一种终端的休眠唤醒系统、方法及装置
CN103425227B (zh) 具省电功能的感测模块及其方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150928

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161212

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161212

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170912

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170913

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20171011

R150 Certificate of patent or registration of utility model

Ref document number: 6227669

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250