JP2019004915A - Myoelectric pattern identification method using time series information and myoelectric artificial hand - Google Patents

Myoelectric pattern identification method using time series information and myoelectric artificial hand Download PDF

Info

Publication number
JP2019004915A
JP2019004915A JP2015212840A JP2015212840A JP2019004915A JP 2019004915 A JP2019004915 A JP 2019004915A JP 2015212840 A JP2015212840 A JP 2015212840A JP 2015212840 A JP2015212840 A JP 2015212840A JP 2019004915 A JP2019004915 A JP 2019004915A
Authority
JP
Japan
Prior art keywords
myoelectric
pattern
patterns
identification
algorithm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2015212840A
Other languages
Japanese (ja)
Inventor
昌宏 粕谷
Masahiro Kasuya
昌宏 粕谷
龍 加藤
Ryu Kato
龍 加藤
浩史 横井
Hiroshi Yokoi
浩史 横井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meltin Mmi Co Ltd
University of Electro Communications NUC
Original Assignee
Meltin Mmi Co Ltd
University of Electro Communications NUC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Meltin Mmi Co Ltd, University of Electro Communications NUC filed Critical Meltin Mmi Co Ltd
Priority to JP2015212840A priority Critical patent/JP2019004915A/en
Priority to PCT/JP2016/082171 priority patent/WO2017073770A1/en
Publication of JP2019004915A publication Critical patent/JP2019004915A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/389Electromyography [EMG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50Prostheses not implantable in the body
    • A61F2/54Artificial arms or hands or parts thereof
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50Prostheses not implantable in the body
    • A61F2/68Operating or control means
    • A61F2/70Operating or control means electrical
    • A61F2/72Bioelectric control, e.g. myoelectric
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/08Controls for manipulators by means of sensing devices, e.g. viewing or touching devices

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Transplantation (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Vascular Medicine (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Cardiology (AREA)
  • Human Computer Interaction (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Prostheses (AREA)
  • Manipulator (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

To provide an algorithm for dramatically improving an identification rate of a myoelectric pattern while minimizing the number of myoelectric electrodes and a learning time for controlling a multiple-degree-of-freedom myoelectric artificial hand.SOLUTION: A myoelectric artificial hand includes a measurement part for measuring a myoelectric pattern at a constant time interval, a myoelectric identification part for identifying a myoelectric pattern from the measured myoelectricity, and a buffer for storing a predetermined number of the myoelectric patterns identified by the myoelectric identification part in time series. When the predetermined number of the myoelectric patterns stored in the buffer are referred to and an occupancy rate of a certain level or higher is found, control according to an operation command corresponding to the myoelectric pattern in which the occupancy rate of a certain level or higher is found is executed. The present invention can achieve a high-speed learning and a high identification rate in spite of a small number of electrode channels, and is effective for practical control of a multiple-degree-of-freedom myoelectric artificial hand.SELECTED DRAWING: Figure 1

Description

本発明は,多自由度筋電義手を制御する際に必要となる,多数の筋電パターン識別に関するものである.現在市販されている多自由度筋電義手は,キャリブレーションの必要がない反面,識別可能な筋電パターンは数種類程度に留まっている.研究段階においては多数の筋電パターン識別が実現されているが,キャリブレーションに必要な電極の多さ,時間の長さや識別精度が問題となり,実用化に至っていない.本出願ではこの課題に対し,少ない電極数,少ないキャリブレーション時間で高い識別精度を有する筋電識別アルゴリズムを提案する.   The present invention relates to the identification of a large number of myoelectric patterns, which are necessary when controlling a multi-degree-of-freedom myoelectric hand. The multi-degree-of-freedom myoelectric prostheses that are currently on the market do not require calibration, but there are only a few types of myoelectric patterns that can be identified. In the research stage, many EMG patterns have been identified, but the number of electrodes required for calibration, the length of time, and the accuracy of identification have become problems, and they have not been put to practical use. In this application, we propose a myoelectric identification algorithm that has a high identification accuracy with a small number of electrodes and a small calibration time.

[義手の背景]
義手は大きく分けて装飾義手,能動義手,電動義手がある.装飾義手は外見の再現,能動義手は機能性の再現を主目的としている(非特許文献1).そのため装飾義手は能動的に動かすことができず,能動義手は使用者の残存部位の動きをワイヤなどで動力として伝達し駆動されるため,把持力が弱いことが問題となっている(非特許文献2).一方電動義手はその名の通り,電力とモータを動力として駆動される.電動義手は能動義手に比べワイヤの取り回しの制約条件が少なく,運動の方向や量をある程度自由に設計可能であり(非特許文献1),多自由度のものなど様々な義手が制作されている.電動義手としては,皮膚表面で筋電を計測する表面筋電信号を用いて制御する筋電義手が一般的である.
[Background of prosthetic hand]
Prosthetic hands are roughly classified into decorative prostheses, active prostheses, and electric prostheses. The main purpose of the decorative prosthesis is to reproduce the appearance, and the active prosthesis is to reproduce the functionality (Non-patent Document 1). Therefore, the decorative prosthetic hand cannot be moved actively, and the active prosthetic hand is driven by transmitting the movement of the remaining part of the user as power with a wire or the like, so that the gripping force is weak (non-patent) Reference 2). On the other hand, as its name suggests, an electric prosthesis is driven by electric power and a motor. Electric prosthetic hands have fewer restrictions on wire handling than active prosthetic hands, and the direction and amount of movement can be designed to some degree of freedom (Non-Patent Document 1), and various prosthetic hands such as those with multiple degrees of freedom have been produced. . As an electric prosthesis, a myoelectric prosthesis is generally controlled by using a surface myoelectric signal that measures myoelectricity on the skin surface.

[筋電義手の要求仕様と本研究の対象要素]
筋電義手を使用するに当たり最も重要と言われている要素としては,重量,操作の確実性,装着の容易さ,把持力,自由度が挙げられる.特に自由度と操作の確実性と装着の容易さの両立が困難とされている.
筋電義手は手の代替として用いられ物体を把持する機能を持つため,操作の確実性は非常に重要視される.特に操作の確実性において,実用的に用いられるためには少なくとも80%以上の確実性を持って制御が行われることが望ましい.
[Required specifications of myoelectric prosthetic hand and target elements of this study]
The elements that are said to be the most important in using a myoelectric hand include weight, certainty of operation, ease of wearing, gripping force, and freedom. In particular, it is difficult to achieve both freedom, reliability of operation and ease of installation.
Since the myoelectric prosthetic hand is used as a substitute for the hand and has the function of grasping an object, the certainty of the operation is very important. In particular, in terms of operational certainty, it is desirable that the control be performed with a certainty of at least 80% for practical use.

装着の容易さについては,義手の生体への物理的接合に関するものとキャリブレーションに関するものが挙げられる.義手は日常的に用いるものであるため,装着は簡便で即座に行われることが求められる.物理的接合については,筋電義手の多くはソケット内側に筋電計を配置し,断端をソケットに挿入するだけで装着が完了する.またキャリブレーションについては,装着するごとに設定する必要が極小なことと,設定パラメータ数が極小なことから,筋電位の振幅の閾値を設定するのみで制御が可能なものが主流である.   As for the ease of wearing, there are ones related to physical attachment to the living body of the prosthetic hand and ones related to calibration. Since prosthetic hands are used on a daily basis, wearing them is required to be simple and immediate. For physical joints, many myoelectric prostheses can be installed simply by placing an electromyograph inside the socket and inserting the stump into the socket. As for calibration, it is the mainstream that can be controlled only by setting the threshold of myoelectric potential amplitude because it is necessary to set each time it is worn and the number of setting parameters is minimal.

[多自由度筋電義手における制御方式]
多自由度化に伴い,多自由度の手指を自由に動かすために制御自由度も向上させる必要があるが,現在普及する多自由度筋電義手の制御方式としてはコマンド方式が主流である(非特許文献4).コマンド方式では2つの筋電計を掌屈筋群と背屈筋群に配置し,筋電のパターンを脱力,掌屈,背屈,拮抗の4つに分け,それらの筋電パターンを特定の順序で入力し特定の動作を行わせる.例えば,伸筋と屈筋を瞬間的に2度拮抗させ,屈筋に力を入れると前腕が回内する,といった具合である.このような操作体系を取るのは,筋電が個人により様々な波形を示し,力の入れ方や力の加減をもとに制御すると,使用できる切断者が限定されるためである.そのため筋電計1チャンネルごとに,明確に区別可能で信頼して用いることのできる筋電のOn/Offを用いることが一般的である.しかしながら,表面筋電位は筋の電位を皮膚表面で計測するため,近傍の筋の信号が混ざり合うクロストークを生じる.そのため表面筋電位から筋1つ1つの電位を算出することは困難であることと,筋電計を多く皮膚表面に配置しても,近傍の筋電計には同様な信号が計測される.筋電は,筋の電位を筋電計のチャンネルの数を増加させても制御自由度は単純増加しない.このような背景から,多くの筋電義手は,別々に収縮させることのできる屈筋群と伸筋群に2箇所に筋電計を配置することが多い.そのため,屈筋群と伸筋群を別々に収縮させることで2ビット,つまり4状態の判別を行うことができるが,前述のクロストークの問題により,これ以上の筋電計の増加は効果的でなく,状態数としてはこれが限界である.それら4状態は安静,正回転,逆回転,モード変更に割り当てられることが多い.義手で行う動作を増やせば増やすほどモード変更の回数が増え,操作が煩雑になることから,自由に使用するには4週間ほどのトレーニングが必要となってしまう(非特許文献5).そのため,義手の多自由度化に適した新たな制御方法が必要とされている(非特許文献6).
[Control method for multi-degree-of-freedom myoelectric hand]
As the degree of freedom increases, it is necessary to improve the degree of freedom of control in order to move fingers with multiple degrees of freedom. Non-patent document 4). In the command method, two electromyographs are placed in the palm flexor muscle group and the dorsiflexor muscle group, and the myoelectric pattern is divided into four categories: weakness, palm flexion, dorsiflexion, and antagonism. Input to perform a specific action. For example, the extensor and flexor muscles are momentarily antagonized twice, and the forearm prolapses when force is applied to the flexor muscles. This type of operation system is used because myoelectric waves show various waveforms depending on the individual, and if they are controlled based on how force is applied or how much force is applied, the number of amputees that can be used is limited. Therefore, it is common to use myoelectric On / Off that can be clearly distinguished and used reliably for each channel of the electromyograph. However, surface myoelectric potentials measure muscle potentials on the skin surface, which causes crosstalk where signals from nearby muscles mix. Therefore, it is difficult to calculate the potential of each muscle from the surface electromyogram, and even if many electromyographs are placed on the skin surface, similar signals are measured in nearby electromyographs. Myoelectricity does not increase the degree of freedom of control simply by increasing the number of EMG channels. With this background, many myoelectric prostheses often place electromyographs at two locations in the flexor and extensor groups that can be contracted separately. Therefore, it is possible to distinguish 2 bits, that is, 4 states by contracting the flexor muscles and extensors separately. However, due to the above-mentioned crosstalk problem, the increase in electromyographs beyond this is effective. This is the limit for the number of states. These four states are often assigned to rest, forward rotation, reverse rotation, and mode change. As the number of operations performed with a prosthetic hand increases, the number of mode changes increases and the operation becomes complicated, so training for about 4 weeks is required to use it freely (Non-patent Document 5). Therefore, a new control method suitable for increasing the degree of freedom of the artificial hand is required (Non-patent Document 6).

[多自由度筋電義手の制御における先行研究]
そこで研究レベルでは,表面筋電から直接使用者の手指姿勢を推定するという試みが行われてきた.その多くは,筋電パターンを手指の運動種ごと複数のクラスに分類し学習し,計測された筋電パターンがいずれのクラスに属するかを識別することで義手の動作を実現するものである.
[Previous research on control of multi-degree-of-freedom myoelectric hand]
At the research level, attempts have been made to estimate the user's finger posture directly from surface EMG. In many cases, the movement of the prosthetic hand is realized by classifying the myoelectric pattern into multiple classes according to the type of finger movement and learning, and identifying the class to which the measured myoelectric pattern belongs.

Ajiboyeらはファジー理論を用い,筋電1パターンにつき8回筋電を計測し学習することで,健常者の手首の掌背屈,尺骨偏位,握り,安静の5パターンの筋電を約97%の精度で識別することに成功した(非特許文献7).切断者においても約96%の精度を出しており,識別精度は実用に耐えうるものである.しかしながら,義手を実用的に用いるためには装着の容易さが重要と認知されているため,5パターンの筋電それぞれを8回計測し学習させることが問題となる可能性がある.そのため,使用前の準備が簡便で,高い識別率を維持可能な手法が必要となる.Youngらは3自由度を約93%の精度で推定し,さらに複数の自由度を同時に動かす複合動作においても約89%の精度を出すことに成功した.Youngらの手法では1つの動作につき筋電パターンの学習が3秒間と高速で,筋電計測もAjiboyeらに比べ半分の4回で十分であった(非特許文献8).しかしながら用いている電極が6つであり,一般的な筋電義手の2電極に比べると多くなっていることから,装着の際に電極の位置合わせが困難となる可能性がある.そこで識別器を二段構成とし,一段目の識別器で,識別率は低い大まかな識別を行い,二段目で識別率を向上させるフィルタアルゴリズムを展開するという手法も用いられてきた(非特許文献9).この手法では5-15%の識別率向上が見られた.識別対象とする筋電パターン数は15と既存の筋電義手に比べ高く識別率も90%を超えている.しかしながら,依然電極数は12と既存の筋電義手に比べ多くなっている.   Ajiboye et al. Used fuzzy theory to measure and learn EMG 8 times for each EMG pattern, and measured about 97 EMGs of palm dorsal flexion, ulnar displacement, grip, and rest in healthy subjects. Successful identification with% accuracy (Non-Patent Document 7). Even the amputee has an accuracy of about 96%, and the identification accuracy can withstand practical use. However, since it is recognized that ease of wearing is important for practical use of the prosthetic hand, it may be problematic to measure and learn each of the five patterns of myoelectricity eight times. Therefore, it is necessary to prepare a method that can be easily prepared before use and maintain a high identification rate. Young et al. Estimated 3 degrees of freedom with an accuracy of about 93%, and succeeded in achieving an accuracy of about 89% even in complex motions that moved multiple degrees of freedom simultaneously. In Young's method, the EMG pattern was learned at a high speed of 3 seconds per action, and the electromyogram measurement was four times half that of Ajiboye et al. (Non-patent Document 8). However, the number of electrodes used is six, which is larger than that of two common myoelectric prosthetic hands, which may make it difficult to align the electrodes. Therefore, a method has been used in which the classifier is composed of two stages, the first stage classifier performs rough classification with a low classification rate, and a filter algorithm is developed that improves the classification rate in the second stage (non-patented). Reference 9). This method improved the recognition rate by 5-15%. The number of myoelectric patterns to be identified is 15, which is higher than that of existing myoelectric prostheses, and the classification rate exceeds 90%. However, the number of electrodes is still 12, which is larger than the existing myoelectric prosthesis.

特開2010−268404号公報JP 2010-268404 A 特開2011−03362号公報JP 2011-03362 A

Polhemus A, Doherty B, Mackiw K, Patel R, Paliwal M: uGrip II: A novel functional hybrid prosthetic hand design. 39th Annual Northeast Bioengineering Conference, pp. 303-304, 2013.Polhemus A, Doherty B, Mackiw K, Patel R, Paliwal M: uGrip II: A novel functional hybrid prosthetic hand design.39th Annual Northeast Bioengineering Conference, pp. 303-304, 2013. Smit G, Plettenburg DH, van der Helm FCT: Design and evaluation of two different finger concepts for body-powered prosthetic hand. Journal of Rehabilitation Research & Develop-ment. 50(9), pp. 1253-1266, 2013.Smit G, Plettenburg DH, van der Helm FCT: Design and evaluation of two different finger concepts for body-powered prosthetic hand.Journal of Rehabilitation Research & Develop-ment. 50 (9), pp. 1253-1266, 2013. Otto Bock HealthCare GmbH: The Michelange-lo® Hand in Practice - Therapy and Rehabilitation. 646D593=EN-01-1201.Otto Bock HealthCare GmbH: The Michelange-lo ® Hand in Practice-Therapy and Rehabilitation.646D593 = EN-01-1201. Connolly C: Prosthetic hands from Touch Bionics. Industrial Robot: An International Journal. 35(4), pp. 290-293, 2008.Connolly C: Prosthetic hands from Touch Bionics.Industrial Robot: An International Journal. 35 (4), pp. 290-293, 2008. Kannenberg A, Zacharias B: Difficulty of per-forming activities of daily living with the Mi-chelangelo Multigrip and traditional myoelectric hands. American Academy of Orthotists & Pros-thetists 40th Academy Annual Meeting & Scien-tific Symposium, FPTH14, 2014.Kannenberg A, Zacharias B: Difficulty of per-forming activities of daily living with the Mi-chelangelo Multigrip and traditional myoelectric hands.American Academy of Orthotists & Pros-thetists 40th Academy Annual Meeting & Scien-tific Symposium, FPTH14, 2014. Zecca M, Micera S, Carrozza MC, Dario P: Con-trol of multifunctional prosthetic hands by pro-cessing the electromyographic signal. Critical Reviews in Biomedical Engineering. 30(4-6), pp.459-485, 2002.Zecca M, Micera S, Carrozza MC, Dario P: Con-trol of multifunctional prosthetic hands by pro-cessing the electromyographic signal.Critical Reviews in Biomedical Engineering. 30 (4-6), pp.459-485, 2002. Ajiboye AB, Weir RF: A heuristic fuzzy logic approach to EMG pattern recognition for multi-functional prosthesis control. IEEE Transactions on Neural Systems and Rehabilitation Engineer-ing. 13(3), pp. 280-291, 2005.Ajiboye AB, Weir RF: A heuristic fuzzy logic approach to EMG pattern recognition for multi-functional prosthesis control.IEEE Transactions on Neural Systems and Rehabilitation Engineer-ing. 13 (3), pp. 280-291, 2005. Young AJ, Smith LH, Rouse EJ, Hargrove LJ: Classification of simultaneous movements using surface EMG pattern recognition. IEEE Transac-tions on Biomedical Engineering. 60(5), pp. 1250-1258, 2013.Young AJ, Smith LH, Rouse EJ, Hargrove LJ: Classification of simultaneous movements using surface EMG pattern recognition.IEEE Transac-tions on Biomedical Engineering. 60 (5), pp. 1250-1258, 2013. Huang H, Zhou P, Li G, Kuiken T: Spatial filtering improves EMG classification accuracy following targeted muscle reinnervation. Annals of Bio-medical Engineering. 37(9), pp. 1849-1857, 2009.Huang H, Zhou P, Li G, Kuiken T: Spatial filtering improves EMG classification accuracy following targeted muscle reinnervation. Annals of Bio-medical Engineering. 37 (9), pp. 1849-1857, 2009. Liu L, Liu P, Clancy EA, Scheme E, Englehart KB: Electromyogram whitening for improved classification accuracy in upper limb prosthesis control. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 21(5), pp. 767-774, 2013.Liu L, Liu P, Clancy EA, Scheme E, Englehart KB: Electromyogram whitening for improved classification accuracy in upper limb prosthesis control.IEEE Transactions on Neural Systems and Rehabilitation Engineering. 21 (5), pp. 767-774, 2013. Kato R, Yokoi H, Arai T: Real-time learning method for Adaptable motion-discrimination us-ing surface EMG signal. IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 2127-2132, 2006.Kato R, Yokoi H, Arai T: Real-time learning method for Adaptable motion-discrimination us-ing surface EMG signal.IEEE/RSJ International Conference on Intelligent Robots and Systems.pp. 2127-2132, 2006. Kita K, Kato R, Yokoi H: A self-organizing ap-proach to generate raining data for EMG signal classification. ROBIO 2008. IEEE International Conference on Robotics and Biomimetics. pp. 1230-1235, 2008.Kita K, Kato R, Yokoi H: A self-organizing ap-proach to generate raining data for EMG signal classification.ROBIO 2008. IEEE International Conference on Robotics and Biomimetics.pp. 1230-1235, 2008. P. R. Cavanagh, P. V. Komi: Electromechanical delay in human skeletal muscle under concentric and eccentric contractions. European Journal of Applied Physiology and Occupational Physiology. 42(3), pp.159-163, 1979.P. R. Cavanagh, P. V. Komi: Electromechanical delay in human skeletal muscle under concentric and eccentric contractions.European Journal of Applied Physiology and Occupational Physiology. 42 (3), pp.159-163, 1979.

筋電のパターン識別において,クラス数を増大させればより多くの動作が実現できるが,識別クラス数が増加すれば識別率は減少してしまう.識別率を向上させるためには筋電電極数や学習時間の増加が必要であるが,実用性が失われる恐れがある.
筋電電極数と学習時間を制限したときに識別器が十分に学習されず識別が安定しない問題(非特許文献10)を解決するべく,本発明では多自由度筋電義手制御のために,筋電電極数と学習時間を最小限にしながら,筋電パターンの識別率を飛躍的に向上させるアルゴリズムを提供することを目的とする.
In EMG pattern identification, more actions can be realized by increasing the number of classes, but the classification rate decreases as the number of classes increases. In order to improve the recognition rate, it is necessary to increase the number of electromyographic electrodes and the learning time, but there is a risk that practicality may be lost.
In order to solve the problem that the discriminator is not sufficiently learned and discrimination is not stable when the number of myoelectric electrodes and the learning time are limited (Non-Patent Document 10), in the present invention, for multi-degree-of-freedom myoelectric hand control, The purpose is to provide an algorithm that dramatically improves the recognition rate of myoelectric patterns while minimizing the number of EMG electrodes and learning time.

本出願に係る第1の発明は、
筋電を一定の時間間隔で計測するための計測部と、
あらかじめ学習された筋電パターンのうち、計測された筋電がいずれの筋電パターンに分類されるべきかを識別する筋電識別部と、
前記筋電識別部で識別された筋電パターンを、時系列順に所定数だけ保存するバッファと、を備え、
バッファに保存された前記所定数の筋電パターンを参照し、特定の筋電パターンにある割合以上の占有率が認められる場合には、その筋電パターンに関連付けられた動作指令にしたがった制御を行うことを特徴とする筋電義手である。
The first invention according to the present application is:
A measurement unit for measuring myoelectricity at regular time intervals;
A myoelectric identification unit for identifying which electromyographic pattern of the electromyogram pattern learned in advance should be classified,
A buffer for storing a predetermined number of myoelectric patterns identified by the myoelectric identification unit in time series,
With reference to the predetermined number of myoelectric patterns stored in the buffer and when an occupation ratio exceeding a certain ratio is recognized in a specific myoelectric pattern, control according to the operation command associated with the myoelectric pattern is performed. It is a myoelectric prosthesis characterized by performing.

また、本出願に係る第2の発明は、前記バッファがリングバッファであり、保存すべき筋電パターンが前記所定数に達した場合には、古い筋電パターンから破棄することを特徴とする第1の発明に記載の筋電義手である。   The second invention according to the present application is characterized in that when the buffer is a ring buffer and the number of myoelectric patterns to be stored reaches the predetermined number, the old myoelectric pattern is discarded. It is a myoelectric prosthesis as described in 1 invention.

更に、本出願に係る第3の発明は、前記占有率が50%以上のときに、前記特定の筋電パターンにしたがった制御を行うことを特徴とする第2の発明に記載の筋電義手である。   Furthermore, the third invention according to the present application is to perform control according to the specific myoelectric pattern when the occupation ratio is 50% or more. It is.

また、本出願に係る第4の発明は、前記筋電義手において同時に発現可能な動作をnパターンと設定した場合には、前記占有率が100/(n+1)%以上のときに、前記占有率を占める複数の筋電パターンのそれぞれに対応した動作指令にしたがった制御を同時に行うことを特徴とする第2の発明または第3の発明に記載の筋電義手である。   In addition, according to a fourth aspect of the present application, in the case where an action that can be expressed simultaneously in the myoelectric prosthesis is set as an n pattern, the occupation ratio is 100 / (n + 1)% or more when the occupation ratio is 100 / (n + 1)% or more. The myoelectric prosthetic hand according to the second or third aspect of the invention is characterized in that control is performed simultaneously in accordance with an operation command corresponding to each of a plurality of myoelectric patterns occupying the same.

本発明によれば,少ない電極チャンネルでありながら,高速な学習と高い識別率を達成することができるため,多自由度筋電義手の実用的な制御に有効である.   According to the present invention, it is possible to achieve high-speed learning and a high identification rate with few electrode channels, which is effective for practical control of a multi-degree-of-freedom myoelectric hand.

(a)は従来のアルゴリズム,(b)は本発明のアルゴリズムを示す概念図である。(A) is a conventional algorithm, (b) is a conceptual diagram showing the algorithm of the present invention. 本発明で用いるニューラルネットワークの構造を示す概念図である。It is a conceptual diagram which shows the structure of the neural network used by this invention. 本発明のアルゴリズムを示すフローチャートである。It is a flowchart which shows the algorithm of this invention. 筋電計の計測部位を示す模式図である。It is a schematic diagram which shows the measurement site | part of an electromyograph. (a)は筋電計,(b)は(a)の筋電計に湿式電極を取り付けた状態を示す写真である。(A) is an electromyograph, (b) is a photograph showing a state in which a wet electrode is attached to the electromyograph of (a). 実験中のPC画面を示す概念図である。It is a conceptual diagram which shows the PC screen in experiment. 筋電識別の安定化アルゴリズム搭載時および非搭載時の識別率の比較を示すグラフである。It is a graph which shows the comparison of the recognition rate at the time of mounting the stabilization algorithm of myoelectric identification, and non-mounting. (a)〜(d)は提案アルゴリズムを搭載した場合と搭載していない場合の識別の比較を示すグラフである。(A)-(d) is a graph which shows the comparison of the identification in the case where the proposal algorithm is not mounted and the case where it is not mounted.

以下、本発明を適用した具体的な実施の形態について詳細に説明する。   Hereinafter, specific embodiments to which the present invention is applied will be described in detail.

本発明は,加藤らが2007年に発表した筋電識別アルゴリズム(非特許文献11)を第1層の識別器とし,その識別結果を更に向上させる第2層の識別器として振る舞うフィルタアルゴリズムである.加藤らの筋電識別アルゴリズムではバックプロパゲーション(BP)ニューラルネットを用いて筋電パターンを識別している.この識別率を向上させるため,出力時系列の事象と相互背反性を有する特徴に着目することにより,BPニューラルネットのフィルタリングを行うアルゴリズムを提案する.BPニューラルネットでは,ニューラルネットワークを構成するノード間の結合強度をバックプロパゲーションにより学習する.本発明では,BPニューラルネットの構造を全く変化させることなく,識別率を飛躍的に向上させる階層化フィルタアルゴリズムを開発した.まず,従来の筋電パターン識別のアルゴリズムを模式図で表したのが図1(a)である.これに対し,本発明で提案するアルゴリズムを図1(b)に模式図で表示した.   The present invention is a filter algorithm that acts as a first-layer discriminator using the myoelectric discrimination algorithm (Non-patent Document 11) published by Kato et al. In 2007 and further improving the discrimination result. . Kato et al.'S EMG identification algorithm uses backpropagation (BP) neural network to identify EMG patterns. In order to improve this discrimination rate, we propose an algorithm for filtering BP neural networks by focusing on features that are mutually contradictory to events in the output time series. In the BP neural network, the connection strength between the nodes constituting the neural network is learned by backpropagation. In the present invention, a hierarchized filter algorithm has been developed that dramatically improves the identification rate without changing the structure of the BP neural network. First, Fig. 1 (a) shows a schematic diagram of a conventional myoelectric pattern identification algorithm. In contrast, the algorithm proposed in the present invention is shown schematically in FIG.

本発明では,識別された筋電パターンの時系列をバッファに保存しておき,その時系列データを元に2段階目の識別を行うことにより識別率を向上させる.1段階目の識別には,従来から用いられてきたBPニューラルネットワークによるアルゴリズムを用いる(非特許文献12).このアルゴリズムでは,まず筋電波形を計測しベクトルemgに保存する.ベクトルemgは3チャンネルの筋電計から計測された時系列データが格納されている.次に特徴抽出関数GFEによって,ベクトルemgからベクトルemgの周波数分布を示す特徴ベクトルXが抽出される.   In the present invention, the time series of the identified myoelectric pattern is stored in a buffer, and the discrimination rate is improved by performing the second stage identification based on the time series data. To identify the first stage, an algorithm based on a BP neural network that has been used conventionally is used (Non-patent Document 12). In this algorithm, the EMG waveform is first measured and stored in the vector emg. Vector emg contains time series data measured from 3 channel electromyographs. Next, a feature vector X indicating the frequency distribution of the vector emg is extracted from the vector emg by the feature extraction function GFE.

この特徴ベクトルXを特徴量としてBPニューラルネットワークの入力層に入力し,結果として異なる手の姿勢に対応した出力層のいずれかのノードが発火し,識別が行われる(図 2).この筋電パターンの識別処理を行う機構を,本願の図1(a)(b)では筋電識別器として模式的に示している.
ここで,BPニューラルネットの出力層における出力値をベクトルL,識別する筋電パターンの数をMとすると
と表される.最終的なBPニューラルネットの出力をy,筋電パターンのIDをmi,IDがmiの筋電パターンが出力yとして識別される際のベクトルLの集合をOiとすると
This feature vector X is input as a feature value to the input layer of the BP neural network. As a result, one of the nodes in the output layer corresponding to different hand postures fires and is identified (Fig. 2). The mechanism for performing this myoelectric pattern identification process is schematically shown as a myoelectric identifier in FIGS. 1 (a) and 1 (b).
If the output value at the output layer of the BP neural network is vector L and the number of EMG patterns to be identified is M
It is expressed as The output of the final BP neural net y, the ID of the myoelectric patterns m i, the ID is the set of vectors L when the myoelectric patterns of m i is identified as the output y and O i

と決定される.識別不能の場合,yには-1が代入される.筋電パターンmiが義手のどのような姿勢に割り当てられるかはあらかじめ実験者によりプログラミングされる.一般的に筋電波形には移動平均などの平滑化処理が行われるが(非特許文献10),ニューラルネットワークで識別された出力は離散的な姿勢となるため,単純な平滑処理は用いることができない.また,平滑化においては時間幅を多く取り過ぎると応答性が低下するため,平滑化の時間幅は最小限に留める必要がある.そこで着目したのが,対象とする筋電パターンのうち,同時に発現する可能性がある動作は限られることである.本実施例で取り扱う筋電パターンは,一例として,前腕の回内・回外,手首の掌屈・背屈,五指の握り・開き,母指の曲げ,4・5指の握り,安静状態の9パターンとする.例えば五指を握りながら手首の掌背屈を行うことはありうるが,手首を背屈させながら掌屈させることは手首を拮抗状態にしていることを意味し,現状の筋電義手は拮抗制御を行っていないため,識別する必要のない状態である.このことを踏まえ,複合動作としては前腕の回内または回外と,手首の掌屈または背屈と,指のパターンいずれか,という3つのパターンの同時識別が最大である.なお,本発明で取り扱い可能な筋電パターンは9パターンに限定されるものではなく,9パターン未満もしくは10パターン以上であっても良い. Is determined. If it cannot be identified, -1 is assigned to y. Or myoelectric patterns m i is assigned to any orientation of the prosthetic hand is programmed in advance by the experimenter. Generally, a smoothing process such as moving average is performed on the myoelectric waveform (Non-Patent Document 10). However, since the output identified by the neural network has a discrete posture, a simple smoothing process can be used. Can not. In addition, in smoothing, if the time width is too large, the responsiveness decreases, so the time width of smoothing needs to be kept to a minimum. Therefore, we focused on the fact that there is a limited number of movements that may occur simultaneously in the target myoelectric pattern. For example, the electromyographic pattern handled in this example is forearm pronation / extroversion, wrist palm flexion / dorsiflexion, five finger grip / open, thumb flexion, 4/5 finger grip, resting state There are 9 patterns. For example, palm dorsiflexion of the wrist may be performed while holding the five fingers, but palm flexing while dorsiflexing the wrist means that the wrist is in an antagonistic state, and the current myoelectric prosthetic hand performs antagonistic control. Since it is not done, it is not necessary to identify. Based on this, the combined action of the three patterns of forearm pronation or prolapse, wrist palm flexion or dorsiflexion, and finger pattern is the largest. The myoelectric patterns that can be handled in the present invention are not limited to nine patterns, and may be less than nine patterns or more than ten patterns.

筋電パターンが9パターンの場合には同時に発現する可能性のある動作は3パターンであることを踏まえ,図3 のようにアルゴリズムを構築した.このアルゴリズムでは,リングバッファに保存した一定時間の筋電パターンの時系列データを参照し,時系列に含まれる筋電パターンの割合を元に出力を決定するものである.一定時間にバッファされる筋電パターンの数をNとすると,ある時刻tにおけるリングバッファbufft
と表される.bufftの構成要素であるyiには筋電パターンのIDが記憶されている.この後,次の制御周期で再び筋電計測が行われ,新たな筋電パターンyの識別が行われたtl秒後,リングバッファbuffは
と更新される.リングバッファbufft+tl中に含まれる筋電パターンmiの数Si
と表される.これより,リングバッファbuff中に含まれる筋電パターンmiの占める割合Pi
となる.提案するアルゴリズムではまず,筋電パターンが単一であるか,複数の筋電パターンを含むかを判別する.リングバッファbuffの半数以上が任意の筋電パターンMpであれば,単一であると判断し,筋電パターンMpに対応付けられた動作を義手に出力する.
すなわち,まず提案するアルゴリズムが,リングバッファbuffに保存されたN個の筋電パターンを参照する.そして,半数以上が筋電パターンMpである場合には,制御部は筋電パターンMpに対応付けられた動作指令を出し,義手はその動作指令の通りの動作をする.
リングバッファbuffに複数の筋電パターンMp1,Mp2…を含む場合,先に述べたように同時に発現する動作数を3としたため,少なくともリングバッファbuffの1/4以上を占めた筋電パターンMp1,Mp2…をすべて出力する.ここで,一般化のために,最終的に出力される動作oを,同時に発現する動作数の最大値をnとして記述すると
となる.ここで,出力する筋電パターンoが複数の場合,実際には同時に出力されず,yiからykが順に出力されることとなる.
なお,同時に発現する動作数がnである場合には,同時発現の基準となるリングバッファbuffの閾占有率を1/(n+1)に設定し,リングバッファbuffに占める割合が1/(n+1)以上の筋電パターンの全てを同時に発現するのが望ましい.しかし,基準となる閾占有率は1/(n+1)に限られず,任意に設定することもできる.
本研究で提案するフィルタアルゴリズムを,識別結果の時系列buffを引数としてフィルタ結果としての義手への出力oを出力する関数GTSとして定義すると
のように記述できる.
Based on the fact that there are three movements that may occur simultaneously when there are nine EMG patterns, we constructed an algorithm as shown in Fig. 3. In this algorithm, the time series data of the myoelectric pattern for a certain time stored in the ring buffer is referenced, and the output is determined based on the ratio of the myoelectric pattern included in the time series. If the number of myoelectric patterns buffered at a certain time is N, the ring buffer buff t at a certain time t is
It is expressed as The myoelectric pattern ID is stored in y i which is a component of buff t . Thereafter, performed again electromyographic measurements in the next control cycle, after t l s identification is performed of the new myoelectric patterns y, the ring buffer buff is
And updated. The number S i myoelectric patterns m i contained in the ring buffer buff t + tl is
It is expressed as Than this, the ratio P i occupied by the myoelectric patterns m i contained in the ring buffer buff
It becomes. The proposed algorithm first determines whether the myoelectric pattern is single or contains multiple myoelectric patterns. If more than half of the ring buffer buff is an arbitrary myoelectric pattern M p , it is determined to be single, and the action associated with the myoelectric pattern M p is output to the prosthetic hand.
That is, the proposed algorithm first refers to the N myoelectric patterns stored in the ring buffer buff. If more than half are the myoelectric patterns M p , the control unit issues an operation command associated with the myoelectric pattern M p , and the prosthetic hand operates according to the operation command.
When the ring buffer buff contains multiple myoelectric patterns M p1 , M p2 ..., The number of operations that occur simultaneously is set to 3, so that the myoelectric pattern occupies at least 1/4 of the ring buffer buff. Output all M p1 , M p2 …. Here, for generalization, if the operation o that is finally output is described as n, the maximum value of the number of operations that occur simultaneously is described as
It becomes. Here, when there are multiple myoelectric patterns o to be output, they are not actually output at the same time, and y i to y k are output in order.
When the number of operations that are simultaneously expressed is n, the threshold occupancy rate of the ring buffer buff serving as a reference for the simultaneous expression is set to 1 / (n + 1), and the ratio of the ring buffer buff to 1 / (n + 1) It is desirable to develop all of the above myoelectric patterns simultaneously. However, the threshold threshold occupancy rate is not limited to 1 / (n + 1), and can be set arbitrarily.
The filter algorithm proposed in this study is defined as a function GTS that outputs the output o to the prosthetic hand as a filter result using the time series buff of the identification result as an argument.
Can be written as

[筋電パターン識別の平滑化]
本発明で提案したアルゴリズムGTSについて,バッファ長N = 6,同時に発現する動作数の最大値n = 3とする場合に,buffが式(11)のように与えられると仮定する.
[Smooth EMG pattern identification]
For the algorithm GTS proposed in the present invention, it is assumed that buff is given by Eq. (11) when the buffer length is N = 6 and the maximum number n of simultaneous operations is n = 3.

実施例のシステム上でbuff中のそれぞれの要素は20msほどで識別され更新されている.筋電義手の操作において,式(11)のように非連続的に1要素のみ異なる筋電パターンを20msの間に意識的に使用者が出力した可能性は低いと考えられ,この異なる1要素を誤識別として取り除く必要がある.この問題に対し,アルゴリズムGTSはまず式(7)によりSiおよびPi
On the system of the example, each element in buff is identified and updated in about 20ms. In EMG prosthetic hand operation, it is considered unlikely that the user has intentionally output a myoelectric pattern that differs only in one element discontinuously as shown in Equation (11) within 20 ms. Must be removed as a misclassification. To solve this problem, algorithm GTS first calculates S i and P i by Eq. (7).

と算出する.次に式(9)により
となり,非連続的にbuffに混入した筋電パターンを取り除くことができることがわかる.
To calculate. Next, using equation (9)
It can be seen that the myoelectric pattern mixed into the buff can be removed discontinuously.

[複数動作への対応]
手首を掌屈させながら4・5指を曲げるなど,複数の筋電パターンを同時に出力した場合,それらの筋電パターンが多く現れるため,このときのbuffは
となる.式(7)によりSiおよびPi
[Support for multiple operations]
When multiple myoelectric patterns are output simultaneously, such as bending 4 or 5 fingers while palm flexing the wrist, many of those myoelectric patterns appear.
It becomes. From Equation (7), S i and P i are

となる.次に式(9)により
となり,複数の筋電パターンを同時に出力した際にも有効であることがわかる.
It becomes. Next, using equation (9)
It can be seen that this is also effective when multiple myoelectric patterns are output simultaneously.

[適用範囲]
本発明で提案されるアルゴリズムは,定常的に筋電を発揮する場合に有効である.しかし,逆に瞬間的に筋電を発揮する場合においては適用することが困難である.例えば,タッピング動作など短時間にスパイク状の筋電が出力される場合,buffは脱力の筋電パターンをm0として
となる.このとき,式(7)によりSiおよびPi
[Scope of application]
The algorithm proposed in the present invention is effective when the myoelectricity is constantly exerted. However, it is difficult to apply in the case where myoelectricity is instantaneously exhibited. For example, when a spike-like myoelectric signal is output in a short time, such as a tapping operation, buff sets the weak myoelectric pattern to m 0
It becomes. At this time, S i and P i are

となり,義手への出力oは式(9)によりm0となってしまう. Thus, the output o to the prosthesis is m 0 according to Equation (9).

[実験目的]
実験により本発明である筋電パターン識別のアルゴリズムを評価した.提案アルゴリズムを搭載した筋電パターン識別が,従来の筋電パターン識別に比べてどれほど精度向上が図れるかを検証した.
[Purpose of experiment]
The myoelectric pattern identification algorithm was evaluated by experiments. We verified how much the EMG pattern identification with the proposed algorithm could improve the accuracy compared to the conventional EMG pattern identification.

[被験者と実験セットアップ]
本実験は,筋電義手の操作経験のある20代健常者2名を対象とし実施された.筋電計の貼り付け位置は前腕部の伸筋群,屈筋群,長母指屈筋の3箇所(図4)であり,基準電極は肘部とした.被験者はPCのモニタを無理のない体勢で見られるよう椅子に座る.筋電計測における各諸元は表1の通りであり,計測は湿式表面筋電計(図 5)を用いた.筋電パターンのリングバッファbuffのバッファ長Nは15とした.なお,筋電計測と筋電パターンの識別を経て,リングバッファが更新されるのにかかる時間は約10msである.
[Subject and experiment setup]
This experiment was conducted with 2 healthy people in their 20s who had experience with the operation of myoelectric prostheses. The electromyograph was attached to the forearm at three locations (extension group, flexor group, and long thumb flexor) (Fig. 4), and the reference electrode was the elbow. The subject sits in a chair so that the PC monitor can be seen in a comfortable posture. The specifications for electromyography are shown in Table 1. Wet surface electromyograph (Fig. 5) was used for measurement. The buffer length N of the myoelectric pattern ring buffer buff was set to 15. In addition, it takes about 10 ms for the ring buffer to be updated after EMG measurement and EMG pattern identification.

[BPニューラルネットの学習手順と条件]
BPニューラルネットワークの筋電パターンの学習プロセスは,被験者が筋電パターンを出力しながら対応させたい動作の番号のキーを押す.動作と番号の対応は,0:安静,1:前腕回外,2:前腕回内,3:手首掌屈,4:手首背屈,5:5指握り,6:5指開き,7:母指屈曲,8:4・5指屈曲となっている.この作業により特定の筋電パターンと特定の義手の動作がラベリングされ,BPによりニューラルネットが学習される.過去に教示した筋電パターンとその識別動作の組は全て記憶されており,最後に教示した筋電パターンの識別率が有意に高くならないよう配慮した.
[BP Neural Network Learning Procedures and Conditions]
The learning process of the myoelectric pattern of BP neural network presses the key of the number of the action that the subject wants to correspond while outputting the myoelectric pattern. Correspondence between movement and number is as follows: 0: Rest, 1: Forearm gyrus, 2: Forearm pronation, 3: Wrist palmar flexion, 4: Wrist dorsiflexion, 5: Five finger grip, 6: Five finger open, 7: Mother Finger flexion, 8: 4/5 finger flexion. Through this work, a specific myoelectric pattern and a specific prosthetic hand movement are labeled, and a neural network is learned by BP. All of the pairs of myoelectric patterns taught in the past and their recognition actions were memorized, and consideration was given so that the recognition rate of the last taught myoelectric pattern was not significantly increased.

教示の条件としては,各動作に割り当てる筋電パターンを1回ずつ教示した後,学習が不十分だとみなされた筋電パターンにつき追加1回までの追学習を許容した.筋電パターン1つの教示にかかる時間は,新たに教示された筋電パターンとすでに学習された筋電パターンとの類似度により変動し,他に学習データのない1度目の教示は100〜300ms,2度目以降の教示は,他の全ての学習データに対し一定の識別率が担保されるまでBP学習が継続するため100〜1000msほどとなる.   The teaching conditions were that the myoelectric pattern to be assigned to each action was taught once, and then additional learning was allowed once for the myoelectric pattern considered to be inadequate. The time taken to teach one myoelectric pattern varies depending on the similarity between the newly taught myoelectric pattern and the already learned myoelectric pattern, and the first teaching without any other learning data is 100 to 300 ms. The second and subsequent teachings are about 100 to 1000 ms because BP learning continues until a certain recognition rate is secured for all other learning data.

PCのモニタ上には図6のような画面が写し出されており,左側に目標姿勢,右側に筋電パターンから識別された姿勢が表示される.被験者には目標姿勢と識別された姿勢が一致するよう筋電パターンをコントロールするタスクが与えられる.   The screen shown in Fig. 6 is displayed on the PC monitor. The target posture is displayed on the left and the posture identified from the myoelectric pattern is displayed on the right. The subject is given a task to control the electromyographic pattern so that the target posture matches the identified posture.

[実験手順]
実験手順は,まず筋電計が被験者に装着され,被験者の筋電パターンをBPニューラルネットに学習させる.次に被験者に実験タスクが課せられ,データが収集される.筋電パターンの識別系はBPニューラルネットを用いた教師あり学習を用いているため,まず被験者の筋電パターンをシステムに教示する.次にPCモニタ上に目標となる手の筋電パターンと識別結果が表示(図6)され,目標筋電パターンに識別結果を一致させるタスクを行う.タスクは,4秒間PCモニタ上に表示された目標筋電パターンを出力し,次に6秒間脱力することを繰り返す.1タスク中に目標筋電パターンはそれぞれ5回表示される.この際,提案アルゴリズムを搭載したものと搭載していないものそれぞれで約7分間行い,目標となる筋電パターンに対する識別された筋電パターンの一致の程度を識別率として評価する.
[Experimental procedure]
In the experimental procedure, an electromyograph is first attached to the subject and the subject's myoelectric pattern is learned by the BP neural network. The subject is then assigned an experimental task and data is collected. Since the myoelectric pattern discrimination system uses supervised learning using BP neural network, the system first teaches the subject's myoelectric pattern. Next, the target electromyographic pattern of the hand and the identification result are displayed on the PC monitor (Fig. 6), and the task of matching the identification result to the target myoelectric pattern is performed. The task repeatedly outputs the target myoelectric pattern displayed on the PC monitor for 4 seconds and then weakens for 6 seconds. Each target EMG pattern is displayed 5 times during one task. At this time, each with and without the proposed algorithm is performed for about 7 minutes, and the degree of coincidence of the identified myoelectric pattern with respect to the target myoelectric pattern is evaluated as the discrimination rate.

[実験結果]
開発されたアルゴリズムを搭載した提案システムと,非搭載の従来システムを比較することで提案アルゴリズムの評価を行う.まず従来システムと提案システム両方の識別率を図7に示す.開発されたアルゴリズムの識別率は全9パターンを識別対象とした場合82.5%,前腕の回外・回内を識別対象から除いた7パターンの場合92.9%となった.開発されたアルゴリズム搭載と非搭載の試行でF検定を行ったところ,全パターン対象の試行は片側確率0.095,回外・回内を除く試行は0.37であり,ともに5%水準を上回っているため,等分散としてt検定を行った.その結果どちらの試行も提案手法の識別率が高いことに有意差(p < 0.001)が認められた.識別率の向上は全9パターン対象の場合17.7%,前腕の回外・回内を除く7パターンの場合11.5%となった.図8には識別の時系列,表2に各条件での識別率を示す.図8はアルゴリズムにより識別された筋電パターンをCSV形式でロギングしたものであり,サンプル間は10〜20msである.なお,図8においての筋電パターンと番号の対応は,0:安静,1:前腕回外,2:前腕回内,3:手首掌屈,4:手首背屈,5:5指握り,6:5指開き,7:母指屈曲,8:4・5指屈曲である.
[Experimental result]
The proposed algorithm is evaluated by comparing the proposed system with the developed algorithm with the conventional system without it. First, Fig. 7 shows the identification rates of both the conventional system and the proposed system. The classification rate of the developed algorithm was 82.5% when all 9 patterns were identified, and 92.9% when 7 patterns were excluded from the forearm pronation and pronation. When the F test was performed with the trial with and without the developed algorithm, the trial for all patterns had a one-sided probability of 0.095, and the trial excluding pronation and pronation was 0.37, both of which exceeded the 5% level. The t test was performed with equal variance. As a result, both trials showed a significant difference (p <0.001) in the high recognition rate of the proposed method. The improvement of the recognition rate was 17.7% for all nine patterns, and 11.5% for seven patterns excluding forearm pronation and pronation. Figure 8 shows the classification time series, and Table 2 shows the classification rate under each condition. Figure 8 shows the EMG pattern identified by the algorithm, logged in CSV format, with 10-20ms between samples. In addition, the correspondence of the myoelectric pattern and the number in Fig. 8 is as follows: 0: Rest, 1: Forearm gyrus, 2: Forearm pronation, 3: Wrist palm flexion, 4: Wrist dorsiflexion, 5: Five finger grip, 6 : 5 finger open, 7: thumb flexion, 8: 4/5 finger flexion.

図8(a)〜(d)は本発明のアルゴリズムを搭載した場合と搭載していない場合の識別の比較である.図8(a)(b)は被験者1のグラフ,図8(c)(d)は被験者2のグラフである。図8(a)(c)が本出願の提案手法,図8(b)(d)が従来手法である.横軸のサンプリング間隔は10〜20msである.上下は被験者ごとの違いであり,○が各識別結果を示している.目標姿勢の変化は実線で示している.目標姿勢がディスプレイに提示されているのは実線が水平の部分のみである.被験者が,PCモニタ上に表示される目標筋電パターンを出力する約7分間のうち代表的な区間における識別結果と目標筋電パターンを示した.図8から,従来手法に比べ,筋電パターンの連続性が保たれ,誤識別が少ないことが見て取れる.   Figures 8 (a) to 8 (d) show a comparison of identification when the algorithm of the present invention is installed and when it is not installed. 8A and 8B are graphs of the subject 1, and FIGS. 8C and 8D are graphs of the subject 2. 8 (a) and 8 (c) show the proposed method of this application, and FIGS. 8 (b) and 8 (d) show the conventional method. The sampling interval on the horizontal axis is 10 to 20 ms. The top and bottom are differences between subjects, and ○ indicates each identification result. The change in the target posture is shown by a solid line. The target posture is shown on the display only in the part where the solid line is horizontal. The subjects showed identification results and target myoelectric patterns in a representative section of about 7 minutes of outputting the target myoelectric pattern displayed on the PC monitor. From Fig. 8, it can be seen that the continuity of the myoelectric pattern is maintained and there are fewer misidentifications than the conventional method.

[識別率について]
実験の結果,回外・回内を含めるか否かで識別率が若干変わることがわかった.回外・回内を含めない場合の識別率は90%を超える結果となった.また,回外・回内を含めた場合であっても識別率は82.5%となった.識別の時系列を示した図8(a)の被験者1に注目すると,握り(筋電パターン5)時に回外(筋電パターン1)と誤識別しているのが見受けられる.握りの際に回外方向に力が入っており,握りと回外の識別がつきにくかった可能性がある.また図8(c)の被験者2に着目すると,回内(筋電パターン2)が回外(筋電パターン1)と開き(筋電パターン6)においても識別されており,識別されやすくバイアスがかかっていることが示唆される.
[About identification rate]
As a result of the experiment, it was found that the recognition rate changed slightly depending on whether or not pronation and pronation were included. The classification rate without the pronation and pronation exceeded 90%. The identification rate was 82.5% even when including pronation and pronation. Focusing on subject 1 in Fig. 8 (a), which shows the time series of discrimination, it can be seen that when grasping (myoelectric pattern 5), it was misidentified as prolapse (myoelectric pattern 1). There was a possibility that it was difficult to distinguish between gripping and pronation because there was force in the pronation direction when grasping. Focusing on the subject 2 in FIG. 8C, the pronation (myoelectric pattern 2) is also identified in the pronation (myoelectric pattern 1) and the opening (myoelectric pattern 6). It is suggested that it is hanging.

[制御周期について]
提案手法は制御周期10msの筋電識別器の出力を15個分バッファしているが,図3に示すようにバッファの1/4または1/2で判断がなされるため,提案手法の遅れ時間は40〜80msと見積もれる.筋電は,関節運動開始の数十〜百ミリ秒早く観測される(非特許文献13)ことを考えれば,義手として使うためには十分な応答性を持っていると考えられる.
[Control cycle]
The proposed method buffers 15 EMG discriminator outputs with a control period of 10 ms, but because the decision is made at 1/4 or 1/2 of the buffer as shown in Fig. 3, the delay time of the proposed method is Can be estimated as 40-80 ms. Considering that myoelectricity is observed several tens to hundreds of milliseconds before the start of joint movement (Non-patent Document 13), it is considered to have sufficient responsiveness to be used as a prosthetic hand.

筋電義手が実用的に用いられるためには,少なくとも80%以上の確実性を持って制御が行われることが望ましい.従来の多自由度筋電パターン識別は,その識別率を実現させるために,電極数の多さ(非特許文献8,9)や学習時間の長さ(非特許文献7)が問題となっていた.それに対し本発明では,3チャンネルの少ない電極数と,1秒以下の少ない学習時間で,回外・回内を除いた7パターンを識別対象とした際,90%以上の識別率が実現される.また,回外・回内を含めた場合であっても82.5%の識別率が実現されるため,義手として有効に用いることができる.また,被験者によっては全パターンの9パターン対象で90%を超える識別率を出しており,習熟により9パターンの全てにおいて90%を超える識別率の実現可能性も示唆された.   In order for a myoelectric prosthesis to be used practically, it is desirable to control it with a certainty of at least 80%. In conventional multi-degree-of-freedom myoelectric pattern identification, the number of electrodes (Non-Patent Documents 8 and 9) and the length of learning time (Non-Patent Document 7) are problems in order to realize the identification rate. It was. On the other hand, in the present invention, a discrimination rate of 90% or more is realized when 7 patterns excluding pronation and pronation are targeted for discrimination with a small number of electrodes of 3 channels and a short learning time of 1 second or less. . Moreover, even when including pronation and pronation, the recognition rate of 82.5% is realized, so it can be used effectively as a prosthetic hand. In addition, some subjects gave a recognition rate of over 90% for all 9 patterns, and it was suggested that proficiency could be over 90% for all 9 patterns.

本発明では,識別結果の時系列に注目し2段階の識別を行うことで,演算コストを大きく増大させることなく,3つの電極から7パターンを90%,9パターンを82.5%という実用的な識別率をもって識別することのできるシステムを構築した.また,識別器の学習時間も7パターン全ての教示で十数秒足らずであり,実用に耐えうる多自由度義手のための制御方式が実現に近づいた.   In the present invention, by focusing on the time series of the identification results and performing two-stage identification, practical identification of 7 patterns from 3 electrodes is 90% and 9 patterns is 82.5% without greatly increasing the calculation cost. We built a system that can be identified with a certain rate. Also, the learning time of the classifier is less than a dozen seconds for all 7 patterns, and a control method for a multi-degree-of-freedom prosthesis that can withstand practical use is approaching realization.

近年,筋電義手は多自由度化へのニーズが高まってきており,高機能な多自由度筋電義手の研究発表が相次いでいる.しかしながら筋電のノイズ対策や皮膚の電気的性質の変動など種々に存在する問題の難しさから,実質的な制御自由度の向上が妨げられてきた.そのため,多自由度のロボットハンドを筋電義手として機能させるためには,生体の特性変動を情報処理的に吸収し,安定して複数の筋電パターンを識別可能な方法論が必要とされる.本出願では筋電パターンの識別率を向上させるアルゴリズムを提案する.識別器の出力時系列に着目し,識別器自体の構造を全く変化させることなく,識別器の後方に位置することで識別率を飛躍的に向上させるフィルタアルゴリズムを開発した.評価実験では,開発されたアルゴリズムを搭載した識別系と非搭載の識別系で,筋電パターンの識別率を比較した.表面電極3チャンネル,1クラスあたりの学習時間は1秒以内で,識別クラス数を7,9個の2条件設定し,パターン識別の出力を10〜20msでサンプリングした.その結果クラス数7の場合は11.5%,9の場合は17.7%の精度向上が図られた.クラス数9では提案手法による識別率は82.5%,クラス数7では92.9%となった.少ない電極チャンネルでありながら,高速な学習と高い識別率が達成されており,多自由度筋電義手の実用的な制御に有効性の高い方法論の提案となっている.   In recent years, there is an increasing need for multi-degree-of-freedom myoelectric prostheses, and there have been a series of research presentations of highly functional multi-degree-of-freedom myoelectric prostheses. However, the difficulty of various problems such as countermeasures against EMG noise and changes in the electrical properties of the skin has hindered substantial improvement in control freedom. Therefore, in order to make a multi-degree-of-freedom robot hand function as a myoelectric prosthetic hand, a methodology capable of absorbing the characteristic changes of the living body in an information processing manner and identifying multiple myoelectric patterns stably is required. In this application, we propose an algorithm that improves the recognition rate of myoelectric patterns. Focusing on the output time series of the classifier, we developed a filter algorithm that dramatically improves the classification rate by being positioned behind the classifier without changing the structure of the classifier itself. In the evaluation experiment, the discrimination rate of the myoelectric pattern was compared between the discriminating system with the developed algorithm and the discriminating system without it. The surface electrode 3 channels, the learning time per class was within 1 second, the number of classification classes was set to 7 and 9 conditions, and the pattern identification output was sampled at 10-20 ms. As a result, the accuracy was improved by 11.5% for 7 classes and 17.7% for 9 classes. The classification rate by the proposed method was 82.5% for 9 classes and 92.9% for 7 classes. Although there are few electrode channels, high-speed learning and a high identification rate have been achieved, and it has been proposed a highly effective methodology for practical control of multi-degree-of-freedom myoelectric hand.

Claims (4)

筋電を一定の時間間隔で計測するための計測部と、
あらかじめ学習された筋電パターンのうち、計測された筋電がいずれの筋電パターンに分類されるべきかを識別する筋電識別部と、
前記筋電識別部で識別された筋電パターンを、時系列順に所定数だけ保存するバッファと、を備え、
バッファに保存された前記所定数の筋電パターンを参照し、特定の筋電パターンにある割合以上の占有率が認められる場合には、その筋電パターンに対応した動作指令にしたがった制御を行うことを特徴とする筋電義手。
A measurement unit for measuring myoelectricity at regular time intervals;
A myoelectric identification unit for identifying which electromyographic pattern of the electromyogram pattern learned in advance should be classified,
A buffer for storing a predetermined number of myoelectric patterns identified by the myoelectric identification unit in time series,
With reference to the predetermined number of myoelectric patterns stored in the buffer, if an occupation ratio exceeding a certain ratio is recognized in a specific myoelectric pattern, control is performed according to an operation command corresponding to the myoelectric pattern. A myoelectric prosthesis characterized by that.
前記バッファがリングバッファであり、保存すべき筋電パターンが前記所定数に達した場合には、古い筋電パターンから破棄することを特徴とする請求項1に記載の筋電義手。   The myoelectric prosthesis according to claim 1, wherein when the buffer is a ring buffer and the number of myoelectric patterns to be stored reaches the predetermined number, the old myoelectric pattern is discarded. 前記占有率が50%以上のときに、前記特定の筋電パターンに対応した動作指令にしたがった制御を行うことを特徴とする請求項2に記載の筋電義手。   The myoelectric prosthetic hand according to claim 2, wherein when the occupation ratio is 50% or more, control according to an operation command corresponding to the specific myoelectric pattern is performed. 前記筋電義手において同時に発現可能な筋電パターンをnパターンと設定した場合には、前記占有率が100/(n+1)%以上のときに、前記占有率を占める複数の筋電パターンのそれぞれに対応した動作指令にしたがった制御を同時に行うことを特徴とする請求項2または3に記載の筋電義手。
When the myoelectric pattern that can be expressed simultaneously in the myoelectric prosthetic hand is set as n pattern, each of the plurality of myoelectric patterns that occupy the occupation rate when the occupation rate is 100 / (n + 1)% or more. 4. The myoelectric prosthetic hand according to claim 2, wherein control according to a corresponding operation command is performed simultaneously.
JP2015212840A 2015-10-29 2015-10-29 Myoelectric pattern identification method using time series information and myoelectric artificial hand Pending JP2019004915A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2015212840A JP2019004915A (en) 2015-10-29 2015-10-29 Myoelectric pattern identification method using time series information and myoelectric artificial hand
PCT/JP2016/082171 WO2017073770A1 (en) 2015-10-29 2016-10-28 Method of identifying myoelectric pattern employing time series information, and myoelectric prosthetic hand

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2015212840A JP2019004915A (en) 2015-10-29 2015-10-29 Myoelectric pattern identification method using time series information and myoelectric artificial hand

Publications (1)

Publication Number Publication Date
JP2019004915A true JP2019004915A (en) 2019-01-17

Family

ID=58630397

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015212840A Pending JP2019004915A (en) 2015-10-29 2015-10-29 Myoelectric pattern identification method using time series information and myoelectric artificial hand

Country Status (2)

Country Link
JP (1) JP2019004915A (en)
WO (1) WO2017073770A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6991622B1 (en) * 2021-04-21 2022-01-14 株式会社メルティンMmi Methods, systems, and electrode structures for acquiring electrical signals from multiple nerves in a living body, and methods for manufacturing the electrode structures.
WO2023286216A1 (en) * 2021-07-14 2023-01-19 日本電信電話株式会社 Teaching device, teaching method, and program

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113907714A (en) * 2017-11-30 2022-01-11 梅尔廷Mmi株式会社 System for recognizing information represented by biological signal
CN109598219B (en) * 2018-11-20 2022-09-02 中国科学技术大学 Adaptive electrode registration method for robust electromyography control

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6991622B1 (en) * 2021-04-21 2022-01-14 株式会社メルティンMmi Methods, systems, and electrode structures for acquiring electrical signals from multiple nerves in a living body, and methods for manufacturing the electrode structures.
WO2022224808A1 (en) * 2021-04-21 2022-10-27 株式会社メルティンMmi Method, system, and electrode structure for acquiring electrical signals from plurality of lead wires, and method for manufacturing said electrode structure
WO2023286216A1 (en) * 2021-07-14 2023-01-19 日本電信電話株式会社 Teaching device, teaching method, and program

Also Published As

Publication number Publication date
WO2017073770A1 (en) 2017-05-04

Similar Documents

Publication Publication Date Title
Waris et al. Multiday evaluation of techniques for EMG-based classification of hand motions
US20200323658A1 (en) Systems And Methods For Postural Control Of A Multi-Function Prosthesis
Dalley et al. A method for the control of multigrasp myoelectric prosthetic hands
Young et al. Classification of simultaneous movements using surface EMG pattern recognition
Huang et al. An analysis of EMG electrode configuration for targeted muscle reinnervation based neural machine interface
Kanitz et al. Classification of transient myoelectric signals for the control of multi-grasp hand prostheses
Zhu et al. Cascaded adaptation framework for fast calibration of myoelectric control
Chen et al. Exploring the relation between EMG sampling frequency and hand motion recognition accuracy
WO2017073770A1 (en) Method of identifying myoelectric pattern employing time series information, and myoelectric prosthetic hand
Gauthaam et al. EMG controlled bionic arm
Lauretti et al. Fusion of M-IMU and EMG signals for the control of trans-humeral prostheses
Barnes et al. Comparison of hand and forearm muscle pairs in controlling of a novel myoelectric interface
Bimbraw et al. Towards sonomyography-based real-time control of powered prosthesis grasp synergies
Raurale Acquisition and processing real-time EMG signals for prosthesis active hand movements
Bhavani et al. A low cost bionic arm based on electromyography sensor
KR100994408B1 (en) Method and device for deducting pinch force, method and device for discriminating muscle to deduct pinch force
Wang et al. EMG signal classification for myoelectric teleoperating a dexterous robot hand
Sidek et al. Surface electromyography (sEMG)-based thumb-tip angle and force estimation using artificial neural network for prosthetic thumb
Pan et al. A reliable multi-user EMG interface based on a generic-musculoskeletal model against loading weight changes
Farrell et al. Pilot comparison of surface vs. implanted EMG for multifunctional prosthesis control
Castellini et al. EMG-based prediction of multi-DOF activations using single-DOF training: a preliminary result
Ibrahim et al. Electromyography signal based for intelligent prosthesis design
Putra et al. Pattern recognition of electromyography (EMG) signal for wrist movement using learning vector quantization (LVQ)
Dasanayake et al. Estimation of prosthetic arm motions using stump arm kinematics
Zhou et al. Real-time multiple-channel shoulder EMG processing for a rehabilitative upper-limb exoskeleton motion control using ANN machine learning