CN108829252A - Gesture input computer character device and method based on electromyography signal - Google Patents
Gesture input computer character device and method based on electromyography signal Download PDFInfo
- Publication number
- CN108829252A CN108829252A CN201810619841.9A CN201810619841A CN108829252A CN 108829252 A CN108829252 A CN 108829252A CN 201810619841 A CN201810619841 A CN 201810619841A CN 108829252 A CN108829252 A CN 108829252A
- Authority
- CN
- China
- Prior art keywords
- input
- pin
- gesture
- right hand
- left hand
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000002567 electromyography Methods 0.000 title claims abstract description 80
- 238000000034 method Methods 0.000 title claims abstract description 79
- 230000005540 biological transmission Effects 0.000 claims abstract description 48
- 230000033001 locomotion Effects 0.000 claims description 168
- 210000000707 wrist Anatomy 0.000 claims description 81
- 230000006870 function Effects 0.000 claims description 33
- 230000003183 myoelectrical effect Effects 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 18
- 230000009471 action Effects 0.000 claims description 16
- 229920003023 plastic Polymers 0.000 claims description 14
- 238000004891 communication Methods 0.000 claims description 12
- 210000004247 hand Anatomy 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 8
- 102100040862 Dual specificity protein kinase CLK1 Human genes 0.000 claims description 7
- 101000749294 Homo sapiens Dual specificity protein kinase CLK1 Proteins 0.000 claims description 7
- 239000011159 matrix material Substances 0.000 claims description 6
- 238000009987 spinning Methods 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 238000000605 extraction Methods 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 4
- 210000000245 forearm Anatomy 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 238000012706 support-vector machine Methods 0.000 claims description 4
- 101100136063 Mycobacterium tuberculosis (strain ATCC 25618 / H37Rv) PE11 gene Proteins 0.000 claims description 3
- 125000004122 cyclic group Chemical group 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 229910052730 francium Inorganic materials 0.000 claims description 3
- KLMCZVJOEAUDNE-UHFFFAOYSA-N francium atom Chemical compound [Fr] KLMCZVJOEAUDNE-UHFFFAOYSA-N 0.000 claims description 3
- 210000003205 muscle Anatomy 0.000 claims description 3
- 238000003909 pattern recognition Methods 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000004422 calculation algorithm Methods 0.000 claims description 2
- 238000013499 data model Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 25
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 9
- 229910052744 lithium Inorganic materials 0.000 description 9
- 230000005611 electricity Effects 0.000 description 5
- 239000003990 capacitor Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 239000013078 crystal Substances 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012913 prioritisation Methods 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 230000000392 somatic effect Effects 0.000 description 1
- 230000000087 stabilizing effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses the gesture input computer character device and methods based on electromyography signal, overcome current stringent to external condition requirement and do not have the problem of convenience, device includes arm ring element and execution unit；Arm ring element includes the left hand armlet and right hand armlet being worn on left arm and right arm respectively；Left hand armlet includes left surface electromyographic signal collection unit, left control unit and left transmission unit, and right hand armlet includes right surface electromyogram signal acquisition unit, right control unit and right transmission unit；Left surface electromyographic signal collection unit, left control unit and left transmission unit successively wired connection；Right surface electromyogram signal acquisition unit, right control unit and right transmission unit successively wired connection；Execution unit includes receiving unit, processor and display；Successively line connects for receiving unit, processor and display；Arm ring element and execution unit are using wireless connection.The present invention also provides the gesture input computer character methods based on electromyography signal.
Description
Technical field
The present invention relates to a kind of method and devices of surface electromyogram signal process field, it more particularly relates to
A kind of gesture input computer character device and method based on electromyography signal.
Background technique
Keyboard and mouse are the input units of current common electronics equipment, main to realize movement by operation keyboard or mouse
The order that cursor and input are clicked, double-clicked, completes the operation to electronic equipment.However, keyboard, touch tablet and mouse etc. are previous
Input equipment need entity apparatus in operation, do not have convenience.
In recent years, there is a kind of gesture input device, user can be by the intuitive input of hands movement, to select picture
The cursor of upper project is mobile or makes project from operation mobile etc. on picture.I.e. user makes picture by the movement of the hand of oneself
On cursor or project intuitively move.Most of common gesture input device is all by using video camera currently on the market
To capture the gesture motion signal of user.Thus, the previous input unit such as gesture input device and keyboard, touch tablet and mouse
It compares, has the advantages that not needing the physical operations device such as keyboard or mouse.And after the training being familiar with, anyone can
Enough achieve one's goal operation.And gesture input device also can apply to various game and include in somatic sensation television game be allowed to more convenience with
Interest.Shortcoming is that user must once leave video camera in carry out gesture operation, the hand within sweep of the eye of video camera
Field range just not can be carried out the input of information.It is in this way limited scope of activities when user's operation, is inconvenient.And ring
The light and shade of border light also will affect the running of video camera, to influence the recognition effect of gesture input.
Whether it completes to input by physical keyboard, mouse apparatus, or is video camera etc. to capture hand signal
Input mode, their common feature is all to require external condition stringent, do not have convenience, so now it is urgent to provide
One kind having mobility, and when user's operation possesses the input mode of more free scope of activities, and solution, which has environment, strictly to be wanted
The problem of asking limitation.More convenient, diversification mode is provided for people's lives.
Summary of the invention
The technical problem to be solved by the present invention is to overcome of the existing technology not require strictly and not external condition
There is the problem of convenience, provide a kind of gesture input computer character device and method based on electromyography signal.
In order to solve the above technical problems, the present invention adopts the following technical scheme that realization：It is described based on electromyography signal
Gesture input computer character device include arm ring element and execution unit；
The arm ring element is made of left hand armlet and right hand armlet, left hand armlet and right arm ring structure phase
Together, left hand armlet and right hand armlet are worn on respectively on left arm and right arm；
The left hand armlet includes left surface electromyographic signal collection unit, left control unit and left transmission unit, the right hand
Armlet includes right surface electromyogram signal acquisition unit, right control unit and right transmission unit；
Wired connection, left control unit and left transmission are used between left surface electromyographic signal collection unit and left control unit
Wired connection is used between unit；Wired connection, right control are used between right surface electromyogram signal acquisition unit and right control unit
Wired connection is used between unit processed and right transmission unit；
The execution unit includes receiving unit, processor and display；Using between receiving unit and processor has
Line connection, uses wired connection between processor and display；
The arm ring element passes through between the receiving unit in left transmission unit and right transmission unit and execution unit
Using wireless connection.
It is using wired connection between left surface electromyographic signal collection unit and left control unit described in technical solution
Refer to：The left surface electromyographic signal collection unit is the myoelectric sensor being made of the myoelectric sensor of 12 tunnel medical grades
Group, every road sensor are made of the myoelectric sensor of one piece of medical grade and a plastic shell, are all needed per myoelectric sensor all the way
It is fixed on the center position of plastic shell, the electromyographic electrode surface of myoelectric sensor is exposed on the inside of plastic shell, that is, connects
Touch that side of skin；12 electrical signal lines of the myoelectric sensor of 12 tunnel medical grades are drawn through the side of shell；
The left control unit includes arithmetic element；The arithmetic element includes model STM32F407VET6
Main control chip；
Operation in the electrical signal line of 12 myoelectric sensors of left surface electromyographic signal collection unit and left control unit
PE0 pin~PE11 pin of unit is connected.
Referred between left control unit and left transmission unit described in technical solution using wired connection：The left control
Unit processed includes arithmetic element；The arithmetic element includes the main control chip of model STM32F407VET6；
The left transmission unit uses the rf chip of model nRF2401, the operation list in left control unit
Member PB3 pin~PB8 pin successively with six pins of the rf chip of the model nRF2401 in left transmission unit
Be connected, i.e. PB3 pin~PB8 pin successively with DATA pin, CLK1 pin, DR1 pin, CE pin, CS pin and PWR_
The connection of UP pin.
Referred between receiving unit and processor using wired connection described in technical solution：The receiving unit is adopted
It is the rf chip for receiving the model nRF2401 of two different channel data simultaneously, model NRF2401's penetrates
Frequency transceiving chip is provided with P0.0 pin~P0.5 pin；The processor includes the main control chip of model STC89C52；
CE pin, CS pin, DATA pin, CLK1 pin, the DR1 of receiving unit, that is, model nRF2401 rf chip draw
Foot is successively connect with the P0.0 of processor pin~P0.5 lead-foot-line with PWR_UP pin.
Referred between processor and display using wired connection described in technical solution：The processor and display
It is connected between device by the RS232 communication interface of model DB9, the RS232 communication interface of the model DB9 includes type
Number for MAX232 chip and model DB9 interface；
The processor includes the main control chip of model STC89C52；The master of model STC89C52 in processor
R1out pin, T1in pin on the chip of P3.0/RXD pin, P3.1/TXD pin and model MAX232 on control chip
Be connected, No. 2 pins of T1out pin, R1in pin and RS232 communication interface on the chip of model MAX232, No. 3 draw
Foot is connected, the display connection of RS232 communication interface and computer.
A kind of gesture input computer character method based on electromyography signal, its step are as follows：
1) bimanual input action specification and function definition；
2) both hands arm surface electromyogram signal and the output of gesture identification result are acquired；
3) transmission of gesture motion information：
(1) after the success of bimanual input action recognition, gesture information data pass through the nRF2401 radio-frequency receiving-transmitting core of transmission unit
Piece 3 is exported with wireless transmission method, and is sent to receiving unit；
(2) the NRF2401 rf chip of receiving unit wirelessly receives after the identification of arm ring element
Gesture information data, the two groups of gesture motion data issued including left hand armlet and right hand armlet.Finally gesture is believed
Breath data are transmitted to the processor of execution unit by wired mode；
4) gesture information is converted to corresponding character content and carried out as the result is shown in display by processor.
(1) gesture information is converted to the principal function of corresponding character content by processor；
(2) gesture information is converted to the interrupt function of corresponding character content by processor.
Bimanual input action specification described in technical solution and function definition refer to：
1) bimanual input action specification：
The identifiable gesture motion pinches six kinds of gesture motions including clenching fist, stretching the palm, bent wrist, stretch wrist, shooting and sky,
In addition loosen, one shared loosen, clenches fist, stretching the palm, bent wrist, stretching wrist, shooting and sky and pinch seven kinds of states；It is convenient for statement, by left hand
Loosen, left hand is clenched fist, left hand stretches the palm, left hand song wrist, left hand stretch wrist, left hand shooting, left hand sky pinch be denoted as respectively L1, L2, L3,
L4, L5, L6, L7 loosen the right hand, the right hand is clenched fist, the right hand stretches the palm, right hand song wrist, the right hand stretch wrist, the right hand is shot, right hand sky is pinched
It is denoted as R1, R2, R3, R4, R5, R6, R7 respectively；
2) bimanual input holding function defines；
3) input in Chinese；
4) numeral input；
5) English input；
6) additional character inputs.
The definition of bimanual input holding function described in technical solution refers to：
(1) left hand clenches fist movement and the right hand clenches fist and acts L2R2 and be defined as " switching input pattern ", in input process
The middle additional character input pattern carried out in English input mode, Chinese input mode, 0-9 number entry mode and ascii table
Switching, be defaulted as English input.It clenches fist by the left hand right hand of clenching fist and acts L2R2 in above four kinds of input patterns in order
Cyclic switching is carried out, every movement once switches a kind of input pattern；
(2) left hand clenches fist movement and the right hand stretches palm movement L2R3 and is defined as " alternately shift key Alt ", and movement is once equivalent to
By next time replace shift key；
(3) left hand clenches fist movement and right hand song wrist movement L2R4 is defined as " backspace key Backspace ", and movement is primary suitable
In a character by backspace key next time, before cursor can be deleted；
(4) left hand clenches fist movement and the right hand is stretched wrist movement L2R5 and is defined as " capital and small letter locking key Caps lock ", movement one
It is secondary to be equivalent to by capital and small letter locking key next time, it can be used for switching capital and small letter；
(5) left hand clenches fist movement and right hand shooting movement L2R6 is defined as " perform shift key Shift ", and movement is primary suitable
In by the shift key that performs next time, it can be used for Chinese and English conversion.Also there is input method switching, be switched fast half-angle and full-shape, choosing
It selects contiguous file, directly delete the functions such as file；
(6) left hand clenches fist movement and the pinching of right hand sky is defined as " control key Ctrl " as L2R7, movement be once equivalent to by
Control key next time, it is possible to provide many shortcuts；
(7) left hand relaxation state and the right hand, which are clenched fist, acts L1R2 and is defined as " carriage return Enter ", and movement is once equivalent to input
One carriage-return character；
(8) left hand relaxation state and the right hand are stretched palm movement L1R3 and are defined as " space Space ", and movement is once equivalent to input
One space symbol；
(9) left hand relaxation state and right hand song wrist act L1R4 and are defined as " to the left ← ", for realizing in input process
Left Arrow acts a cursor and is moved to the left a lattice；
(10) left hand relaxation state and the right hand stretch wrist movement L1R5 be defined as " to the right → ", for being realized in input process
Right Arrow acts a cursor and moves right a lattice；
(11) left hand relaxation state and right hand shooting act L1R6 and are defined as " upwards ↑ ", for realizing in input process
Cursor is moved up, a cursor is acted and moves up a line；
(12) left hand relaxation state and the pinching of right hand sky are defined as " downwards → " as L1R7, for realizing in input process
Cursor is moved down, a cursor is acted and moves down a line；
(13) when left hand stretches palm movement, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
It is not defined as " Q ", " W ", " A ", " S ", " Z ", " X " letter, movement is once equivalent to by corresponding letter key next time；
(14) when left hand song wrist acts, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
It is not defined as " E ", " R ", " D ", " F ", " C ", " V " letter, movement is once equivalent to by corresponding letter key next time；
(15) when left hand stretches wrist movement, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
It is not defined as " T ", " Y ", " G ", " H ", " B ", " N " letter, movement is once equivalent to by corresponding letter key next time；
(16) when left hand shooting acts, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
" U ", " I ", " J ", " K ", " M ", ", " letter or symbol, movement is not defined as to be once equivalent to by corresponding letter next time
Or symbolic key；
(17) when left hand sky pinching is made, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
Be not defined as " O ", " P ", " L ", "；", " ", "/" letter or symbol, movement be once equivalent to by corresponding letter next time
Or symbolic key；
The function of the bimanual input movement of default definition can be used in user, can also be when using this method for the first time to both hands
Gesture motion carries out customized setting according to the habit of oneself.
Input in Chinese described in technical solution refers to：
(1) left hand, which is clenched fist, acts the right hand and clenches fist after movement " L2R2 " switches to Chinese input mode, and inputting display interface is aobvious
Show number entry mode mark " in "；In the display, after cursor being navigated to the position for needing to carry out text input, user
Putting in order for the letter that phonetic according to the Chinese to be inputted is included, successively carries out corresponding gesture motion, at this time respectively
The corresponding letters for successively showing and arranging according to the sequencing of gesture motion are seen over the display, and constitute pinyin combinations；
If the phonetic of " side " word is " fang ", then need to take turns doing following gesture motion："L4R5—L3R4—L5R7—L5R4"；
(2) input of Chinese character
A. alphabetic string combination is retrieved from " standard phonetic library " one by one, finds out effective phonetic that meet national standards
Combination；
B. then according to the pinyin combinations of input such as " fang ", retrieved from " phonetic identification Chinese character base ", find out spelling
All Chinese characters that sound " fang " is included；And the sequence according to the frequency of use record identification numerical value of each Chinese character from big to small,
Alternative Chinese character is shown on the downside of interface of input method over the display, in this input method alternative Chinese character press " every page of a line, often
The mode of row seven " shown, or according to circumstances from main regulation；
C. in input method display interface, the Chinese character that cursor selection needs is moved by " to the left " or " to the right ", by " to
On " or " downward " come move cursor to alternative Chinese character list carry out page turning switching；
A) when " to the left " is to the last one alternate item of upper page is switched to after this page first, this page is not first page at this time,
When this page is first page, cursor is no longer moved；When " to the right " to this page switches to first alternate item of nextpage after the last one；
B) it can not be paged up again after " upward " to first page, stop downward page turning after " downward " to the end one page；
If you need to select " side " word, " side " word position can be moved a cursor to by " to the right " twice,
D. it moves cursor to complete after selecting Chinese character, Chinese character where selecting cursor by " carriage return " completes the input of Chinese character；
When alternative Chinese character is more than seven, it is divided into multipage by the rule of frequency of use size, is turned over by " upward ", " downward "
Page switching.As phonetic " fang " includes 37 Chinese characters altogether in this example：It " puts the anti-mill in virtue side room and visits the imitative Fang Fang Fang that spins and walk back and forth a tree, used in making timber for boats Fang Fang Fang
Fang Fang Fang Fang Fang Fang Fang Fang Fang Fang spins Fang and visits Fang francium Fang Imitation Fang Fang Fang "；" spinning " word is such as inputted, only needs " downward " page turning primary,
Then mobile cursor is primary " to the right ", the Chinese character " spinning " where last " carriage return " selection cursor completes the input to the Chinese character；
The numeral input refers to：
It clenches fist to act the right hand and clench fist by multiple left hand and act after L2R2 switches to number entry mode, inputting display interface
It shows number entry mode mark " number ", and shows digital interface in display interface, number where default cursor is 5, by such as
" upwards, downwards, to the left, to the right " defined hereinabove acts mobile cursor position, selects the number needed, finally by
" Enter " of digital interface is selected to complete numeral input, also by left hand relaxation state and the right hand clenches fist and acts L1R2 " carriage return "
Selection is to complete numeral input；
The English input refers to：
(1) left hand is clenched fist to act the right hand and clench fist and be acted after L2R2 switches to English input mode, and inputting display interface is shown
English input mode identifies " English "；
(2) user carries out corresponding gesture motion according to the English alphabet of required input, and display interfaces directly display
English alphabet representated by corresponding gesture motion；When if you need to input capitalization English letter, movement is clenched fist by left hand and the right hand is stretched
Wrist acts L2R5 locking capitalization, and inputting display interface shows input pattern mark " English A ", and " A " indicates currently big for input English
Letter mode；Then user carries out corresponding gesture motion according to required input English capitalization, and display interfaces are straight
Connect English capitalization representated by the corresponding gesture motion of display.
The additional character input refers to：
(1) it clenches fist to act the right hand and clench fist by multiple left hand and acts input after L2R2 switches to additional character input pattern
Display interface shows additional character input pattern mark " symbol ", and interface of input method is such as divided four rows by matrix, eight symbols of every row, or
Other matrix arrangement modes show 32 displayable ASCII additional characters；
(2) mobile cursor is acted by " upwards, downwards, to the left, to the right ", selects the symbol needed, then passes through left hand
Relaxation state and the right hand, which are clenched fist, acts L1R2 " carriage return " selection completion additional character input.
Acquisition both hands arm surface electromyogram signal described in technical solution and the output of gesture identification result refer to：
1) user is correct and left hand armlet, right hand armlet are successfully worn on left arm, right arm forearm middle section i.e. wrist
Behind portion and ancon middle position, gesture motion is then carried out；When gesture motion, surface myoelectric in left hand armlet, right hand armlet
12 road myoelectric sensors of signal acquisition unit can acquire the surface at the corresponding arm position related muscles of each sensor
Electromyography signal；
2) due to generate in the signal that collects comprising other electro-physiological signals interference, electronic equipment is to electromyography signal
The Hz noise of generation and other distracters, so needing to pre-process the data of acquisition；
Bandpass filtering is carried out to the electromyography signal collected using Finite Impulse Response filter in the present invention, removes 50Hz work
Frequency and harmonic wave reduce low frequency signal energy, so that surface electromyogram signal is concentrated mainly between 5~200Hz, are completed pair with this
The pretreatment of data；
3) electromyography signal characteristic information is extracted；
Feature extraction is carried out to surface electromyogram signal using Sample Entropy in the present invention；
4) classifier carries out the classification of motion
Classifier uses support vector machine classifier in the present invention, and the electromyography signal characteristic information of extraction is inputted classification
Device realizes the Classification and Identification to gesture motion；Wherein 3) step and 4) algorithm combination of step have preferable robustness and reality
Shi Xing can satisfy demand of the user to multi-mode classification and recognition efficiency；
5) gesture motion recognition result exports
Final left hand armlet, right hand armlet control unit can complete to a series of point of the electromyography signal collected
Analysis and processing are finally completed the pattern-recognition to gesture motion, and carry out result output to gesture action recognition.
Compared with prior art the beneficial effects of the invention are as follows：
1. the gesture input computer character device and method of the present invention based on electromyography signal, which is got rid of, requires key
The limitation of the entity apparatus such as disk or mouse input, use are more convenient；
2. family operation can be used in the gesture input computer character device and method of the present invention based on electromyography signal
The more free scope of activities of Shi Yongyou has mobility to environment without limitation is strict with；
3. the gesture input computer character device and method low cost of the present invention based on electromyography signal, low function
Consumption, provides the mode of more diversification for people's lives, has very wide application prospect.
Detailed description of the invention
The present invention will be further described below with reference to the drawings：
Fig. 1 is the schematic block of the gesture input computer character apparatus structure composition of the present invention based on electromyography signal
Figure；
Fig. 2 is that the appearance of arm ring in the gesture input computer character device of the present invention based on electromyography signal is shown
It is intended to；
Fig. 3 is the correct pendant of arm ring in the gesture input computer character device of the present invention based on electromyography signal
Wear schematic diagram；
Fig. 4 is to analyze in the gesture input computer character method of the present invention based on electromyography signal electromyography signal
With the flow diagram of processing；
Fig. 5-1 is to know employed in the gesture input computer character method of the present invention based on electromyography signal
It is other to loosen gesture motion schematic diagram；
Fig. 5-2 is to know employed in the gesture input computer character method of the present invention based on electromyography signal
Other gesture motion schematic diagram of clenching fist；
Fig. 5-3 is to know employed in the gesture input computer character method of the present invention based on electromyography signal
It is other to stretch palm gesture motion schematic diagram；
Fig. 5-4 is to know employed in the gesture input computer character method of the present invention based on electromyography signal
Other song wrist gesture motion schematic diagram；
Fig. 5-5 is to know employed in the gesture input computer character method of the present invention based on electromyography signal
It is other to stretch wrist gesture motion schematic diagram；
Fig. 5-6 is to know employed in the gesture input computer character method of the present invention based on electromyography signal
Other shooting gesture motion schematic diagram；
Fig. 5-7 is to know employed in the gesture input computer character method of the present invention based on electromyography signal
Other sky knob gesture action schematic diagram；
Fig. 6 is that the input in Chinese of the gesture input computer character method of the present invention based on electromyography signal shows boundary
Face schematic diagram；
Fig. 7 is that the input in Chinese of the gesture input computer character method of the present invention based on electromyography signal shows boundary
Downward page turning schematic diagram upwardly；
Fig. 8 is that the input in Chinese of the gesture input computer character method of the present invention based on electromyography signal shows boundary
Face Chinese character selects overall process schematic diagram；
Fig. 9 is that numeral input shows boundary in the gesture input computer character method of the present invention based on electromyography signal
Face schematic diagram；
Figure 10 is additional character input in the gesture input computer character method of the present invention based on electromyography signal
Display interface schematic diagram；
Figure 11 is the flow diagram of the gesture input computer character method of the present invention based on electromyography signal；
Figure 12-1 is that the arithmetic element of the gesture input computer character device of the present invention based on electromyography signal connects
Connect circuit diagram；
Figure 12-2 is that the transmission unit of the gesture input computer character device of the present invention based on electromyography signal connects
Connect circuit diagram；
Figure 12-3 is that the vibrating motor of the gesture input computer character device of the present invention based on electromyography signal connects
Connect circuit diagram；
Figure 12-4 is that the indicator light of the gesture input computer character device of the present invention based on electromyography signal connects
Circuit diagram；
Figure 12-5 is the power supply pressure stabilizing electricity of the gesture input computer character device of the present invention based on electromyography signal
Road schematic diagram；
Figure 12-6 is that the charge port of the gesture input computer character device of the present invention based on electromyography signal connects
Circuit diagram；
Figure 12-7 is that the button of the gesture input computer character device of the present invention based on electromyography signal connects electricity
Road schematic diagram；
Figure 12-8 is that the processor of the gesture input computer character device of the present invention based on electromyography signal connects
Circuit diagram；
Figure 12-9 is that the receiving unit of the gesture input computer character device of the present invention based on electromyography signal connects
Connect circuit diagram；
Figure 12-10 is that the RS232 of the gesture input computer character device of the present invention based on electromyography signal is communicated
Interfacing circuitry schematic diagram；
Figure 13-1 is processor work in the gesture input computer character method of the present invention based on electromyography signal
Principal function flow chart；
Figure 13-2 is processor work in the gesture input computer character method of the present invention based on electromyography signal
Interrupt function flow chart；
In figure：1. myoelectric sensor group, 2. arithmetic elements, 3. rf chips, 4. vibrating motors, 5. indicator lights, 6.
Lithium battery, 7. charge ports, 8. buttons, 9. bandages.
Specific embodiment
The present invention is explained in detail with reference to the accompanying drawing：
Refering to fig. 1, the gesture input computer character device of the present invention based on electromyography signal includes arm ring list
Member and execution unit；
The arm ring element is made of left hand armlet and right hand armlet, left hand armlet and right arm ring structure phase
Together, left hand armlet and right hand armlet are worn on left arm, on right arm respectively.
The left hand armlet includes left surface electromyographic signal collection unit, left control unit and left transmission unit, described
Right hand armlet include right surface electromyogram signal acquisition unit, right control unit and right transmission unit, and left hand armlet and the right hand
The structural principle and connection type of armlet are all the same, and explanation is introduced around left hand armlet below.
Referring to Fig.2, the left surface electromyographic signal collection unit is to be made of the myoelectric sensor of 12 tunnel medical grades
The identical myoelectric sensor group 1 of 1,2 nested structure of myoelectric sensor group respectively constitute left surface electromyographic signal collection unit and right
Surface electromyogram signal acquisition unit completes the acquisition of left arm, right arm surface electromyogram signal when the movement of user's bimanual input；
Every road sensor is made of the myoelectric sensor of one piece of medical grade and a plastic shell, by 12 tunnel medical grades
Myoelectric sensor is embedded in 12 plastic shells, and 12 plastic shells for being equipped with myoelectric sensor are sequentially connected end to end
The arm ring circularized.Exactly, the center position for being fixed on plastic shell, myoelectricity are required per myoelectric sensor all the way
The electromyographic electrode surface of sensor is exposed on the inside of plastic shell, i.e., close to that side of skin.A length of 2.0 centimetres of plastic housing,
Width is 0.7 centimetre, with a thickness of 0.3 centimetre, with 150 ° of angle and using the side of three root skin bands between two neighboring plastic shell
Formula is connected, and belt is required to flexible and is evenly distributed between two neighboring plastic shell, to be suitable for different thicknesses
The use of arm.12 electrical signal lines of the myoelectric sensor of 12 tunnel medical grades are drawn through the side of shell, 12 electricity
The exit of signal wire is connected with the arithmetic element 2 in left control unit.
The left control unit includes arithmetic element 2, vibration motor 4, indicator light 5, lithium battery 6, charge port 7, button 8
With bandage 9.Left control unit completes analysis and place to the obtained surface electromyogram signal of left surface electromyographic signal collection unit
Reason, i.e., be converted to gesture information for the electromyography signal of input.
2-1 refering to fig. 1, the arithmetic element 2 include main control chip, the minimum system of model STM32F407VET6
Circuit and basic peripheral circuit；
The main control chip of the model STM32F407VET6 is with FPU (Float Point Unit, floating-point fortune
Calculate unit) ARM Cortex M4 kernel, the data processing to the electromyography signal collected can be completed；
The minimum system includes 8M crystal oscillating circuit, 32.768K crystal oscillating circuit and RST reset key circuit；
The basic peripheral circuit includes the power circuit of analog portion and the RTC (Real-Time of model CR1220
Clock, real-time clock) battery circuit, the reserve battery as real-time clock uses.
2-3 refering to fig. 1, the vibration motor 4 uses standard micro vibrating motor, can be used to provide vibrational feedback, complete
Pairs of user takes vibration reminding when corresponding function.The present invention uses the flat button-shaped vibration motor for mobile phone, specification
0830,0834,1020 equal-specifications also may be selected in selection 0827 certainly.Vibration motor type also can choose cylindrical type (drag cup
Auswan) vibrating motor or line style vibration motor etc., can specifically be selected according to self-demand；4 one end of vibrating motor and three
The connection of pole pipe Q collector, the other side are connect with 3V3, the base stage of triode and the PA9 pin (i.e. No. 68 pins) of arithmetic element 2
Between connect 510 Ω resistance, thus constitute vibrating motor control circuit.
2-4 refering to fig. 1, the indicator light 5 include red and two LED of green (Light Emitting Diode, hair
Optical diode) i.e. indicator light D1 and indicator light D2, indicator light D1 and indicator light D2 complete to power conditions and different indicate
Signal instruction.Other type indicator lights such as paster LED also may be selected in indicator light 5；Indicator light D1 is connect with the anode of indicator light D2
The cathode of 3V3, indicator light D1 and indicator light D2 after 510 Ω resistance with the PA6 pin of arithmetic element 2, PA7 pin (i.e. 31
Number pin, No. 32 pins) connection.
2-5 refering to fig. 1, the lithium battery 6 use the chargeable conventional type cylinder 5V lithium battery of standard, model
ICR18650, it can be used repeatedly, and the power supply for completing opponent's armlet unit provides.
Voltage regulator circuit of powering includes the positive low dropout voltage regulator of model AMS1117-3.3V, electrolytic capacitor C10, capacitor
C11, capacitor C12 and electrolytic capacitor C13；The positive low pressure drop of voltage 5V and model AMS1117-3.3V that lithium battery 6 exports
No. 3 lead-foot-line connections, are 3.3V by No. 2 pin output voltages, can be arithmetic element 2 and the other electricity of left hand armlet in voltage-stablizer
Road provides guarantee of power.
2-6 refering to fig. 1, the charge port 7 are provided and are charged to lithium battery 6 using unified standard Micro-USB charge port
When slot interface input.USB have two data output line USB_DM, USB_SP respectively with the PA11 pin of arithmetic element 2,
PA12 pin (i.e. No. 70 pins, No. 71 pins) connection.
2-7 refering to fig. 1, the button 8 are normally opened round button of seeking unity of standard, and provide the setting for completing multiple functions.
The cathode of button 8 is grounded, the PA8 pin (i.e. 67 pins) of the anode connection arithmetic element 2 of button 8.
Using the Pasting bandage for having velcro, when use, which ties up, wears arm ring position in user for the bandage 9
Rear side.
Referring to Fig.2, arithmetic element 2 is by PA9 pin and 4 circuit connection of vibrating motor, by PA6 pin, PA7 pin with
5 circuit connection of indicator light is connect with charge port 7 by PA11 pin, PA12 pin, is connect by PA8 pin with button 8.Lithium
Battery circuit exports 3.3V voltage by power supply voltage regulator circuit and connect with any 3V3 pin of arithmetic element 2 to provide guarantee of power.
2-2 refering to fig. 1, the left transmission unit use the rf chip 3 of model nRF2401.Left transmission is single
By treated, gesture information data carry out wireless communication transmission to member, i.e., gesture information is passed through to the radio frequency of model nRF2401
Transceiving chip 3 is wirelessly transmitted to receiving unit.The pin that the chip 3 of model nRF2401 is arranged includes No. 1 pin, that is, GND electricity
Source pin, No. 2 pins, that is, 3V3 power input pin, No. 3 pins, that is, CE pin, No. 4 pins, that is, CS pin, No. 5 pins be
DATA pin, No. 6 pins, that is, CLK1 pin, No. 7 pins, that is, DR1 pin；No. 8 pin, that is, PWR_UP power on pin；No. 3 pins are extremely
No. 8 pins respectively with the PB6 pin of arithmetic element 2, PB7 pin, PB3 pin~PB5 pin, PB8 pin (i.e. No. 92 pins,
No. 93 pins, No. 89 pin~No. 91 pins, No. 95 pins) it is connected.
The execution unit includes receiving unit, processor and display.
2-9 refering to fig. 1, the receiving unit use radio transceiver technology, and the present invention is using can be simultaneously
The nRF2401 rf chip of two different channel data is received, the transmission to gesture action information data is completed.Work as reception
After the left transmission unit of unit and arm ring element, right transmission unit successful connection, can simultaneously wireless receiving left hand armlet and
Two groups of gesture motion information datas that right hand armlet issues.Then gesture motion recognition result is sent to by place by wired mode
Device is managed, so that processor completes subsequent processing.Six pins of receiving unit, that is, nRF2401, that is, CE pin, CS pin, DATA
Pin, CLK1 pin, DR1 pin and PWR_UP pin (No. 3 pin~No. 8 pins) and P0.0 pin~P0.5 of processor draw
Foot (39 pins~34 pins) is connected.
2-8 refering to fig. 1, the processor include the main control chip and minimum system circuit of model STC89C52,
In：Minimum system circuit includes 11.0592MHz crystal oscillating circuit, RST reset key circuit；Processor is by reading receiving unit
The signal of the representative gesture motion of input completes a series of function of corresponding character content conversions.
2-10 refering to fig. 1, the display are the display of computer, complete the display to input character.Processing
It is connected between device and display by the RS232 communication interface of model DB9.That is R1out pin, the T1in pin of MAX232
(No. 12 pins, No. 11 pins) are connected with the P3.0/RXD pin of processor, P3.1/TXD pin (No. 10 pins, No. 11 pins)
It connects, No. 2 pins, 3 of the T1out pin of MAX232, R1in pin (i.e. No. 14 pins, No. 13 pins) and RS232 communication interface
Number pin is connected, and last RS232 communication interface is connect with computer display, completes word corresponding to current gesture input mode
Thus the display for according with content is finally reached the purpose that the input of computer character is completed using both hands electromyography signal.
Refering to fig. 1,12 myoelectric sensor electric signals of the left surface electromyographic signal collection unit in arm ring element
PE0 pin~PE11 pin (i.e. No. 97 pins and No. 98 pins, No. 1 pin~5 of arithmetic element 2 in line and left control unit
Number pin and No. 38 pin~No. 42 pins) totally ten two pins be connected, output surface electromyography signal.It is transported in left control unit
Totally six pins and left transmission are single for PB3 pin~PB8 pin (i.e. No. 89 pin~No. 93 pins, No. 95 pins) of calculation unit 2
Six pins of rf chip nRF2401 in member are connected, i.e., with No. 5 pins, that is, DATA pin, No. 6 pin, that is, CLK1
Pin, No. 7 pins, that is, DR1 pin, No. 3 pins, that is, CE pin, No. 4 pins, that is, CS pin, No. 8 pins, that is, PWR_UP pin are successively
Connection；Pass through left transmission unit wireless transmission treated Left-hand gesture information data to receiving unit.Likewise, right hand armlet
Pass through right transmission unit wireless transmission treated right-hand gesture information data to receiving unit.What receiving unit used
NRF2401 rf chip wirelessly receives the gesture information data from left hand armlet and right hand armlet simultaneously,
And be connected by wired mode with the P0.0 of processor pin~P0.5 pin (No. 39 pin~No. 34 pins), by both hands hand
The wire transmission of gesture information data is to processor.The P3.0/RXD pin of last processor, P3.1/TXD pin (No. 10 pins, 11
Number pin) it is connected with the R1out pin of MAX232, T1in pin (i.e. No. 12 pins, No. 11 pins), the T1out of MAX232
Pin, R1in pin (No. 14 pins, No. 13 pins) are connected with No. 2 pins of DB9, No. 3 pins, last DB9 and computer
Display connection.
Gesture input computer character device usual method and operation instruction of the present invention based on electromyography signal：
Refering to Fig. 3, left hand and right hand armlet is worn on user's left and right arm forearm middle section (wrist and ancon middle position).
It needs to be close to arm skin on the inside of left hand and right hand armlet, cannot cover outside clothes.If there is serious the case where shaking in wearing position,
Discrimination will be by extreme influence.
Under left hand and right hand armlet off-mode, by clicking round button 8 among left hand and right hand armlet control unit
To open equipment.After click button 8, shaken if there is 800 milliseconds of vibrating motors 4, and indicator light 5 lights and is shown as green light simultaneously
It is slowly flashed with 2 seconds frequencies, then represents equipment and open successfully, equipment enters waiting connection mode at this time.If nothing after click button 8
Reaction, then may be equipment not enough power supply, should charge in time.When 800 milliseconds of vibrations and the display of indicator light 5 occurs in vibration motor 4
When green and flicker frequency quickening, the transmission unit and receiving unit successful connection in left hand and right hand armlet are indicated.
Under open state, touch the button 8 time up to 5 seconds after unclamp, can pass hull closure, at this time occur 800 milliseconds
It shakes motor 4 to shake, and indicator light 5 knocks out.Arm ring control unit built-in lithium battery 6, should can power in open state
Or so 10 hours.When 6 not enough power supply of lithium battery, equipment meeting automatic shutdown, equipment passes through insertion Micro-USB charging
Mouth 7 charges, and indicator light 5 is displayed in red in charged state and president is bright, and about 2 hours can be full of, and refer to full of later red
Show that lamp 5 can extinguish.
Refering to fig. 11, the gesture input computer character method based on electromyography signal includes that bimanual input movement is said
Bright and function defines, acquires both hands arm surface electromyogram signal and the output of gesture identification result, the transmission of gesture motion information, processing
Gesture motion information is converted to corresponding character content by device, and is carried out as the result is shown in display.
1. bimanual input action specification and function definition
1) bimanual input action specification
Refering to Fig. 5-1 to Fig. 5-7, the identifiable gesture motion include clench fist, stretch the palm, bent wrist, stretch wrist, shooting and
Sky pinches six kinds of gesture motions, in addition loosen, one shared loosen, clenches fist, stretching the palm, bent wrist, stretching wrist, shooting and sky and pinch seven kinds of states；
It is convenient for statement, left hand is loosened, left hand is clenched fist, left hand stretches the palm, left hand song wrist, left hand stretch wrist, left hand shooting, left hand sky are pinched point
It is not denoted as L1, L2, L3, L4, L5, L6, L7, the right hand is loosened, the right hand is clenched fist, the right hand stretches the palm, right hand song wrist, the right hand stretch wrist, the right side
Hand shooting, right hand sky are pinched and are denoted as R1, R2, R3, R4, R5, R6, R7 respectively.
2) bimanual input holding function defines
Table 1 show the corresponding function of different gesture motions, utilizes the gesture input computer character based on electromyography signal
Device and method realizes the identification and input acted to bimanual input.
Table 1
The detailed description that bimanual input holding function defines：
(1) left hand clenches fist movement and right hand movement (L2R2) of clenching fist is defined as " switching input pattern ", for inputting
Carried out in journey English input (English) mode, input in Chinese (in) spy in mode, 0-9 numeral input (number) mode and ascii table
The switching of different symbol input (symbol) mode, is defaulted as English input.Movement (L2R2) is clenched fist above by the left hand right hand of clenching fist
Cyclic switching is carried out in four kinds of input patterns in order, every movement once switches a kind of input pattern；
(2) left hand clenches fist movement and the right hand stretches palm movement (L2R3) and is defined as " alternately shift key (Alt) ", acting primary phase
When in by next time replace shift key；
(3) left hand clenches fist movement and right hand song wrist movement (L2R4) is defined as " backspace key (Backspace) ", and movement is primary
It is equivalent to a character by backspace key next time, before cursor can be deleted；
(4) left hand clenches fist movement and the right hand stretches wrist movement (L2R5) and is defined as " capital and small letter locking key (Caps lock) ", moves
Work is once equivalent to by capital and small letter locking key next time, can be used for switching capital and small letter；
(5) left hand clenches fist movement and right hand shooting movement (L2R6) is defined as " shift key that performs (Shift) ", and movement is primary
It is equivalent to by the shift key that performs next time, can be used for Chinese and English conversion.Also there is input method switching, be switched fast half-angle and complete
The functions such as file, are directly deleted at selection contiguous file in angle；
(6) clench fist movement and right hand sky pinching of left hand is made (L2R7) and is defined as " control key (Ctrl) ", and movement is primary suitable
In by control key next time, it is possible to provide many shortcuts；
(7) left hand relaxation state and the right hand movement (L1R2) of clenching fist is defined as " carriage return (Enter) ", and movement is once equivalent to
Input a carriage-return character；
(8) left hand relaxation state and the right hand are stretched palm movement (L1R3) and are defined as " space (Space) ", and movement is once equivalent to
Input a space symbol；
(9) left hand relaxation state and right hand song wrist act (L1R4) and are defined as " (←) to the left ", in input process
It realizes Left Arrow, acts a cursor and be moved to the left a lattice；
(10) left hand relaxation state and the right hand stretch wrist movement (L1R5) and are defined as " (→) to the right ", in input process
It realizes Right Arrow, acts a cursor and move right a lattice；
(11) left hand relaxation state and right hand shooting movement (L1R6) are defined as " upward (↑) ", in input process
Realization moves up cursor, acts a cursor and moves up a line；
(12) left hand relaxation state and right hand sky pinching work (L1R7) are defined as " downward (→) ", in input process
Realization moves down cursor, acts a cursor and moves down a line；
(13) when left hand stretches palm movement, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
It is not defined as " Q ", " W ", " A ", " S ", " Z ", " X " letter, movement is once equivalent to by corresponding letter key next time；
(14) when left hand song wrist acts, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
It is not defined as " E ", " R ", " D ", " F ", " C ", " V " letter, movement is once equivalent to by corresponding letter key next time；
(15) when left hand stretches wrist movement, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
It is not defined as " T ", " Y ", " G ", " H ", " B ", " N " letter, movement is once equivalent to by corresponding letter key next time；
(16) when left hand shooting acts, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
" U ", " I ", " J ", " K ", " M ", ", " letter or symbol, movement is not defined as to be once equivalent to by corresponding letter next time
Or symbolic key；
(17) when left hand sky pinching is made, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, point
Be not defined as " O ", " P ", " L ", "；", " ", "/" letter or symbol, movement be once equivalent to by corresponding letter next time
Or symbolic key；
The function of the bimanual input movement of default definition can be used in user, can also be when using this method for the first time to both hands
Gesture motion carries out customized setting according to the habit of oneself.
3) input in Chinese
According to China《National standard information exchange encoding of chinese characters》It establishes " standard phonetic library " and " Chinese character is identified according to phonetic
Library ", each Chinese character have a frequency of use record mark in Chinese character base.This mark is for using input side of the invention
When method, alternative Chinese character is ranked up, frequency of use records the big Chinese character of flag values, the prioritization in alternative chinese disply
In front.Chinese character is often only used once, then the frequency of use record Blip Counting for corresponding to the Chinese character adds one.
(1) left hand, which is clenched fist, acts the right hand and clenches fist after movement (L2R2) switches to Chinese input mode, and inputting display interface is aobvious
Show number entry mode mark " in ".In the display, after cursor being navigated to the position for needing to carry out text input, user
Putting in order for the letter that phonetic according to the Chinese to be inputted is included, successively carries out corresponding gesture motion respectively.At this time
Over the display it can be seen that according to the corresponding letters that the sequencing of gesture motion successively shows and arranges, and constitute pinyin-group
It closes；If the phonetic of " side " word is " fang ", then need to take turns doing following gesture motion："L4R5—L3R4—L5R7—L5R4"；
(2) input of Chinese character
A. alphabetic string combination is retrieved from " standard phonetic library " one by one, finds out effective phonetic that meet national standards
Combination.
B. then according to the pinyin combinations of input such as " fang ", retrieved from " phonetic identification Chinese character base ", find out spelling
All Chinese characters that sound " fang " is included；And the sequence according to the frequency of use record identification numerical value of each Chinese character from big to small,
Alternative Chinese character is shown on the downside of interface of input method over the display, in this input method alternative Chinese character press " every page of a line, often
The mode of row seven " is shown (can also be according to circumstances from main regulation), as shown in Figure 6.
C. in input method display interface, the Chinese character that cursor selection needs is moved by " to the left " or " to the right ", by " to
On " or " downward " come move cursor to alternative Chinese character list carry out page turning switching；
A) when " to the left " to this page (this page is not first page at this time；When this page is first page, cursor is no longer moved) the
The last one alternate item of page is switched to after one, when " to the right " to this page switch to after the last one nextpage first it is alternative
?；
B) it can not be paged up again after " upward " to first page, stop downward page turning after " downward " to the end one page；
If you need to select " side " word, " side " word position can be moved a cursor to by " to the right " twice,
D. refering to Fig. 7, after mobile cursor completes selection to Chinese character, Chinese character where selecting cursor by " carriage return " completes the Chinese
The input of word.
When alternative Chinese character is more than seven, it is divided into multipage by the rule of frequency of use size, is turned over by " upward ", " downward "
Page switching.As phonetic " fang " includes 37 Chinese characters altogether in this example：It " puts the anti-mill in virtue side room and visits the imitative Fang Fang Fang that spins and walk back and forth a tree, used in making timber for boats Fang Fang Fang
Fang Fang Fang Fang Fang Fang Fang Fang Fang Fang spins Fang and visits Fang francium Fang Imitation Fang Fang Fang "." spinning " word is such as inputted, only needs " downward " page turning primary,
Then mobile cursor is primary " to the right ", as shown in figure 8, the Chinese character " spinning " where last " carriage return " selection cursor, can be completed pair
The input of the Chinese character.
4) numeral input
It clenches fist by multiple left hand and acts the right hand and clench fist after movement (L2R2) switches to number entry mode, input display circle
Face shows number entry mode mark " number ", and shows digital interface in display interface, as shown in Figure 9.Number where defaulting cursor
Word is 5, and mobile cursor position can be acted by " upwards, downwards, to the left, to the right " as defined hereinabove, and selection needs
The number wanted finally can also pass through left hand relaxation state by selecting " Enter " of digital interface to complete numeral input
And the right hand clenches fist movement (L1R2) " carriage return " selection to complete numeral input；
5) English input
(1) left hand, which is clenched fist, acts the right hand and clenches fist after movement (L2R2) switches to English input mode (English), input display circle
Face shows English input mode mark " English "；
(2) user carries out corresponding gesture motion according to the English alphabet of required input, and display interfaces directly display
English alphabet representated by corresponding gesture motion；When if you need to input capitalization English letter, movement is clenched fist by left hand and the right hand is stretched
Wrist acts (L2R5) locking capitalization, and inputting display interface shows input pattern mark " English A ", and " A " is indicated currently as input English
Capital letter mode；Then user carries out corresponding gesture motion, display interfaces according to required input English capitalization
Directly display English capitalization representated by corresponding gesture motion.
6) additional character inputs
(1) refering to fig. 10, clenching fist by multiple left hand acts right hand movement (L2R2) of clenching fist and switches to additional character input
After (symbol), inputting display interface shows additional character input pattern mark " symbol ", and interface of input method (such as divides four rows, often by matrix
Eight symbols of row, or other matrix arrangement modes) 32 displayable ASCII additional characters of display；
(2) refering to fig. 10, mobile cursor is acted by " upwards, downwards, to the left, to the right ", selects the symbol needed, then
By left hand relaxation state and the right hand clench fist movement (L1R2) " carriage return " selection complete additional character input.
Step 3) the input in Chinese of gesture input computer character method of the present invention based on electromyography signal extremely walks
Rapid 6) additional character input can need the step of selecting wherein according to user.
2. acquiring both hands arm surface electromyogram signal and the output of gesture identification result
Refering to Fig. 4, specific step is as follows：
1) user is correct and left hand and right hand armlet is successfully worn on left and right arm forearm middle section (among wrist and ancon
Position) after, gesture motion can be carried out；When gesture motion, the 12 of surface electromyogram signal acquisition unit in left hand and right hand armlet
Road myoelectric sensor can acquire the surface electromyogram signal at the corresponding arm position related muscles of each sensor；
2) due to generate in the signal that collects comprising other electro-physiological signals interference, electronic equipment is to electromyography signal
The Hz noise of generation and other distracters, so needing to pre-process the data of acquisition；
Bandpass filtering is carried out to the electromyography signal collected using Finite Impulse Response filter in the present invention, removes 50Hz work
Frequency and harmonic wave reduce low frequency signal energy, so that surface electromyogram signal is concentrated mainly between 5-200Hz, are completed pair with this
The pretreatment of data；
3) electromyography signal characteristic information is extracted；
Feature extraction is carried out to surface electromyogram signal using Sample Entropy in the present invention；
4) classifier carries out the classification of motion
Classifier uses SVM (Support Vector Machine, support vector machines) classifier in the present invention, will extract
Electromyography signal characteristic information input classifier, realize to the Classification and Identification of gesture motion.Wherein 3) step and 4) calculation of step
Method combination has preferable robustness and real-time, can satisfy demand of the user to multi-mode classification and recognition efficiency；
5) gesture motion recognition result exports
Final left hand armlet, right hand armlet control unit can complete to a series of point of the electromyography signal collected
Analysis and processing are finally completed the pattern-recognition to gesture motion, and carry out result output to gesture action recognition.
3. the transmission of gesture motion information
1) after the success of bimanual input action recognition, gesture information data pass through the nRF2401 radio-frequency receiving-transmitting core of transmission unit
Piece 3 is exported with wireless transmission method, and is sent to receiving unit；
2) the NRF2401 rf chip of receiving unit wirelessly receives after the identification of arm ring element
Gesture information data, the two groups of gesture motion data issued including left hand armlet and right hand armlet.Finally by gesture information
Data are transmitted to the processor of execution unit by wired mode.
4. gesture information is converted to corresponding character content and carried out as the result is shown in display by processor
The processor of execution unit receives the Information Number of the representative gesture motion of receiving unit output by wired mode
According to then handling gesture recognition result, be converted to a series of corresponding input character contents, it is dynamic to finally obtain gesture
Make corresponding computer character input order.
3-1 refering to fig. 1, the principal function stream as shown in the figure that gesture information is converted to corresponding character content for processor
Cheng Tu.After processor powers on, into main program, initialize simultaneously opens interrupters to system first, subsequently into endless loop etc.
Response to be interrupted.When receiving unit sends the data to processor, as there is event triggering to interrupt, subsequent program, which is jumped out, extremely to be followed
Ring, into interrupt function.
3-2 refering to fig. 1, the interrupt function as shown in the figure that gesture information is converted to corresponding character content for processor
Flow chart.After entering the interrupt, it first closes and interrupts, then read and store the gesture data from receiving unit, and judge the hand
Whether gesture data are one of defined gestures.If it is not, then directly jumping out interruption, waiting receives data again；If so,
The corresponding computer character content of the gesture is exported, and shows character input content on computer screen, is finally jumped out
It interrupts, reenters endless loop.
The final function of realizing the gesture input computer character based on electromyography signal, reaches complete using both hands electromyography signal
At the purpose of the input of computer character.
Claims (10)
1. a kind of gesture input computer character device based on electromyography signal, which is characterized in that described based on electromyography signal
Gesture input computer character device include arm ring element and execution unit；
The arm ring element is made of left hand armlet and right hand armlet, and left hand armlet is identical as right arm ring structure, left
Arm ring and right hand armlet are worn on respectively on left arm and right arm；
The left hand armlet includes left surface electromyographic signal collection unit, left control unit and left transmission unit, right hand armlet
Including right surface electromyogram signal acquisition unit, right control unit and right transmission unit；
Wired connection, left control unit and left transmission unit are used between left surface electromyographic signal collection unit and left control unit
Between use wired connection；Wired connection is used between right surface electromyogram signal acquisition unit and right control unit, right control is single
It is first that wired connection is used between right transmission unit；
The execution unit includes receiving unit, processor and display；Wired company is used between receiving unit and processor
It connects, wired connection is used between processor and display；
The arm ring element between the receiving unit in left transmission unit and right transmission unit and execution unit by using
It is wirelessly connected.
2. the gesture input computer character device described in accordance with the claim 1 based on electromyography signal, which is characterized in that described
Left surface electromyographic signal collection unit and left control unit between referred to using wired connection：
The left surface electromyographic signal collection unit is the myoelectric sensor being made of the myoelectric sensor of 12 tunnel medical grades
Group (1), every road sensor are made of the myoelectric sensor of one piece of medical grade and a plastic shell, all per myoelectric sensor all the way
Need to be fixed on the center position of plastic shell, the electromyographic electrode surface of myoelectric sensor is exposed on the inside of plastic shell, i.e.,
Contact that side of skin；12 electrical signal lines of the myoelectric sensor of 12 tunnel medical grades are drawn through the side of shell；
The left control unit includes arithmetic element (2)；The arithmetic element (2) includes model STM32F407VET6
Main control chip；
Arithmetic element in the electrical signal line of 12 myoelectric sensors of left surface electromyographic signal collection unit and left control unit
(2) PE0 pin~PE11 pin is connected.
3. the gesture input computer character device described in accordance with the claim 1 based on electromyography signal, which is characterized in that described
Left control unit and left transmission unit between referred to using wired connection：
The left control unit includes arithmetic element (2)；The arithmetic element (2) includes model STM32F407VET6
Main control chip；
The left transmission unit uses the rf chip (3) of model nRF2401, the arithmetic element in left control unit
(2) PB3 pin~PB8 pin successively draws with six of the rf chip of the model nRF2401 in left transmission unit
Foot is connected, i.e. PB3 pin~PB8 pin successively with DATA pin, CLK1 pin, DR1 pin, CE pin, CS pin with
The connection of PWR_UP pin.
4. the gesture input computer character device described in accordance with the claim 1 based on electromyography signal, which is characterized in that described
Receiving unit and processor between referred to using wired connection：
The receiving unit using simultaneously receive two different channel data model nRF2401 radio-frequency receiving-transmitting core
Piece, the rf chip of model NRF2401 are provided with P0.0 pin~P0.5 pin；
The processor includes the main control chip of model STC89C52；
The CE pin of receiving unit, that is, model nRF2401 rf chip, CS pin, DATA pin, CLK1 pin,
DR1 pin is successively connect with the P0.0 of processor pin~P0.5 lead-foot-line with PWR_UP pin.
5. the gesture input computer character device described in accordance with the claim 1 based on electromyography signal, which is characterized in that described
Processor and display between referred to using wired connection：
It is connected between the processor and display by the RS232 communication interface of model DB9, the model
The RS232 communication interface of DB9 includes the chip of model MAX232 and the interface of model DB9；
The processor includes the main control chip of model STC89C52；
P3.0/RXD pin, P3.1/TXD pin and model on the main control chip of model STC89C52 in processor
R1out pin, T1in pin on the chip of MAX232 are connected, T1out pin, R1in on the chip of model MAX232
Pin is connected with No. 2 pins of RS232 communication interface, No. 3 pins, the display connection of RS232 communication interface and computer.
6. a kind of gesture input computer character method based on electromyography signal, which is characterized in that described based on electromyography signal
Gesture input computer character method the step of it is as follows：
1) bimanual input action specification and function definition；
2) both hands arm surface electromyogram signal and the output of gesture identification result are acquired；
3) transmission of gesture motion information：
(1) after the success of bimanual input action recognition, gesture information data pass through the nRF2401 rf chip 3 of transmission unit
It is exported with wireless transmission method, and is sent to receiving unit；
(2) the NRF2401 rf chip of receiving unit wirelessly receives the hand after the identification of arm ring element
Gesture information data, the two groups of gesture motion data issued including left hand armlet and right hand armlet.Finally by gesture information number
According to the processor for being transmitted to execution unit by wired mode；
4) gesture information is converted to corresponding character content and carried out as the result is shown in display by processor:
(1) gesture information is converted to the principal function of corresponding character content by processor；
(2) gesture information is converted to the interrupt function of corresponding character content by processor.
7. the gesture input computer character method based on electromyography signal according to claim 6, which is characterized in that described
Bimanual input action specification and function definition refer to：
1) bimanual input action specification：
The identifiable gesture motion pinches six kinds of gesture motions including clenching fist, stretching the palm, bent wrist, stretch wrist, shooting and sky, in addition
Loosen, one shared loosen, clenches fist, stretching the palm, bent wrist, stretching wrist, shooting and sky and pinch seven kinds of states；It is convenient for statement, left hand is loosened,
Left hand is clenched fist, left hand stretches the palm, left hand song wrist, left hand stretch wrist, left hand shooting, left hand sky pinch be denoted as respectively L1, L2, L3, L4, L5,
L6, L7 loosen the right hand, the right hand is clenched fist, the right hand stretches the palm, right hand song wrist, the right hand stretch wrist, the right hand is shot, right hand sky is pinched and remembered respectively
For R1, R2, R3, R4, R5, R6, R7；
2) bimanual input holding function defines；
3) input in Chinese；
4) numeral input；
5) English input；
6) additional character inputs.
8. the gesture input computer character method based on electromyography signal according to claim 6, which is characterized in that described
Bimanual input holding function definition refer to：
(1) left hand clenches fist movement and the right hand clenches fist and acts L2R2 and be defined as " switching input pattern ", in input process into
Row English input mode, Chinese input mode, 0-9 number entry mode are cut with the additional character input pattern in ascii table
It changes, is defaulted as English input, clench fist by the left hand right hand of clenching fist and act L2R2 in above four kinds of input patterns and carry out in order
Cyclic switching, every movement once switch a kind of input pattern；
(2) left hand clenches fist movement and the right hand stretches palm movement L2R3 and is defined as " alternately shift key Alt ", and movement is once equivalent to and presses
Primary alternately shift key；
(3) left hand clench fist movement and the right hand song wrist movement L2R4 be defined as " backspace key Backspace ", movement once be equivalent to by
Backspace key next time, a character before cursor can be deleted；
(4) left hand clenches fist movement and the right hand stretches wrist movement L2R5 and is defined as " capital and small letter locking key Caps lock ", acts primary phase
When can be used for switching capital and small letter in by capital and small letter locking key next time；
(5) left hand clench fist movement and the right hand shooting movement L2R6 be defined as " perform shift key Shift ", movement once be equivalent to by
Perform shift key next time, can be used for Chinese and English conversion.Also there is input method switching, be switched fast half-angle and full-shape, selection company
Continuous file directly deletes the functions such as file；
(6) left hand clenches fist movement and the pinching of right hand sky is defined as " control key Ctrl " as L2R7, and movement is once equivalent to by next
Secondary control key, it is possible to provide many shortcuts；
(7) left hand relaxation state and the right hand, which are clenched fist, acts L1R2 and is defined as " carriage return Enter ", and movement is once equivalent to input one
Carriage-return character；
(8) left hand relaxation state and the right hand are stretched palm movement L1R3 and are defined as " space Space ", and movement is once equivalent to input one
Space symbol；
(9) left hand relaxation state and right hand song wrist act L1R4 and are defined as " to the left ← ", for realizing to the left in input process
Mobile cursor, acts a cursor and is moved to the left a lattice；
(10) left hand relaxation state and the right hand stretch wrist movement L1R5 be defined as " to the right → ", for being realized to the right in input process
Mobile cursor acts a cursor and moves right a lattice；
(11) left hand relaxation state and right hand shooting act L1R6 and are defined as " upwards ↑ ", upward for realizing in input process
Mobile cursor, acts a cursor and moves up a line；
(12) left hand relaxation state and the pinching of right hand sky are defined as " downwards → " as L1R7, downward for realizing in input process
Mobile cursor, acts a cursor and moves down a line；
(13) when left hand stretches palm movement, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, it is fixed respectively
Adopted alphabetical for " Q ", " W ", " A ", " S ", " Z ", " X ", movement is once equivalent to by corresponding letter key next time；
(14) when left hand song wrist acts, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, it is fixed respectively
Adopted alphabetical for " E ", " R ", " D ", " F ", " C ", " V ", movement is once equivalent to by corresponding letter key next time；
(15) when left hand stretches wrist movement, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, it is fixed respectively
Adopted alphabetical for " T ", " Y ", " G ", " H ", " B ", " N ", movement is once equivalent to by corresponding letter key next time；
(16) when left hand shooting acts, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, it is fixed respectively
Justice is " U ", " I ", " J ", " K ", " M ", ", " is alphabetical or symbol, movement are once equivalent to by corresponding letter or symbol next time
Number key；
(17) when left hand sky pinching is made, the right hand clenches fist respectively, stretch the palm, bent wrist, when stretching wrist, shooting and empty pinching and making, it is fixed respectively
Justice be " O ", " P ", " L ", "；", " ", "/" letter or symbol, movement once is equivalent to by next time it is corresponding letter or symbol
Number key；
The function of the bimanual input movement of default definition can be used in user, can also be when using this method for the first time to bimanual input
Movement carries out customized setting according to the habit of oneself.
9. the gesture input computer character method based on electromyography signal according to claim 6, which is characterized in that described
Input in Chinese refer to：
(1) left hand is clenched fist to act the right hand and clench fist and be acted after L2R2 switches to Chinese input mode, inputting display interface display number
Input pattern mark " in "；In the display, after cursor being navigated to the position for needing to carry out text input, user is according to wanting
Putting in order for the letter that the phonetic of the Chinese of input is included, successively carries out corresponding gesture motion respectively, is showing at this time
The corresponding letters for successively showing and arranging according to the sequencing of gesture motion are seen on device, and constitute pinyin combinations；Such as " side "
The phonetic of word is " fang ", then needs to take turns doing following gesture motion："L4R5—L3R4—L5R7—L5R4"；
(2) input of Chinese character
A. alphabetic string combination is retrieved from " standard phonetic library " one by one, finds out effective pinyin-group that meet national standards
It closes；
B. then according to the pinyin combinations of input such as " fang ", retrieved from " phonetic identification Chinese character base ", find out phonetic
All Chinese characters that " fang " is included；And the sequence according to the frequency of use record identification numerical value of each Chinese character from big to small,
Alternative Chinese character is shown on the downside of interface of input method on display, alternative Chinese character presses " every page of a line, every row in this input method
Seven " mode shown, or according to circumstances from main regulation；
C. in input method display interface, the Chinese character that cursor selection needs is moved by " to the left " or " to the right ", is passed through " upward "
Or " downward " carries out page turning switching to move cursor to alternative Chinese character list；
A) when " to the left " is to the last one alternate item of upper page is switched to after this page first, this page is not first page at this time, when this
When page is first page, cursor is no longer moved；When " to the right " to this page switches to first alternate item of nextpage after the last one；
B) it can not be paged up again after " upward " to first page, stop downward page turning after " downward " to the end one page；If you need to
" side " word is selected, " side " word position can be moved a cursor to by " to the right " twice,
D. it moves cursor to complete after selecting Chinese character, Chinese character where selecting cursor by " carriage return " completes the input of Chinese character；
When alternative Chinese character is more than seven, it is divided into multipage by the rule of frequency of use size, is cut by " upward ", " downward " page turning
It changes.As phonetic " fang " includes 37 Chinese characters altogether in this example：It " puts the anti-mill in virtue side room and visits the imitative Fang Fang Fang that spins and walk back and forth a tree, used in making timber for boats Fang Fang Fang Fang Fang
Fang Fang Fang Fang Fang Fang Fang Fang spins Fang and visits Fang francium Fang Imitation Fang Fang Fang "；" spinning " word is such as inputted, only needs " downward " page turning primary, then
" to the right " mobile cursor is primary, the Chinese character " spinning " where last " carriage return " selection cursor completes the input to the Chinese character；
The numeral input refers to：
It clenches fist to act the right hand and clench fist by multiple left hand and act after L2R2 switches to number entry mode, inputting display interface is shown
Number entry mode identifies " number ", and shows digital interface in display interface, and number where default cursor is 5, by such as above
Defined " upwards, downwards, to the left, to the right " acts mobile cursor position, the number needed is selected, finally by selection
" Enter " of digital interface completes numeral input, and also by left hand relaxation state and the right hand clenches fist and acts L1R2 " carriage return " selection
To complete numeral input；
The English input refers to：
(1) left hand is clenched fist to act the right hand and clench fist and be acted after L2R2 switches to English input mode, inputting display interface display English
Input pattern identifies " English "；
(2) user carries out corresponding gesture motion according to the English alphabet of required input, and display interfaces directly display correspondence
English alphabet representated by gesture motion；When if you need to input capitalization English letter, movement is clenched fist by left hand and the right hand to stretch wrist dynamic
Make L2R5 locking capitalization, inputting display interface shows input pattern mark " English A ", and " A " is indicated currently as input English capitalization word
Master mold formula；Then user carries out corresponding gesture motion according to required input English capitalization, and display interfaces are directly aobvious
Show English capitalization representated by corresponding gesture motion.
The additional character input refers to：
(1) it clenches fist to act the right hand and clench fist by multiple left hand and acts input display after L2R2 switches to additional character input pattern
Interface display additional character input pattern identifies " symbol ", and interface of input method is such as divided four rows, eight symbols or other of every row by matrix
Matrix arrangement mode show 32 displayable ASCII additional characters；
(2) mobile cursor is acted by " upwards, downwards, to the left, to the right ", selects the symbol needed, is then loosened by left hand
State and the right hand, which are clenched fist, acts L1R2 " carriage return " selection completion additional character input.
10. the gesture input computer character method based on electromyography signal according to claim 6, which is characterized in that institute
Acquisition both hands arm surface electromyogram signal and gesture identification the result output stated refer to：
1) user it is correct and successfully by left hand armlet, right hand armlet be worn on left arm, right arm forearm middle section i.e. wrist and
Behind ancon middle position, gesture motion is then carried out；When gesture motion, surface electromyogram signal in left hand armlet, right hand armlet
12 road myoelectric sensors of acquisition unit can acquire the surface myoelectric at the corresponding arm position related muscles of each sensor
Signal；
2) since the interference that generates in the signal that collects comprising other electro-physiological signals, electronic equipment generate electromyography signal
Hz noise and other distracters, so need the data of acquisition are pre-processed；
Bandpass filtering carried out to the electromyography signal that collects using Finite Impulse Response filter in the present invention, removal 50Hz power frequency and
Harmonic wave reduces low frequency signal energy so that surface electromyogram signal is concentrated mainly between 5~200Hz and has carried out paired data with this
Pretreatment；
3) electromyography signal characteristic information is extracted；
Feature extraction is carried out to surface electromyogram signal using Sample Entropy in the present invention；
4) classifier carries out the classification of motion
Classifier uses support vector machine classifier in the present invention, and the electromyography signal characteristic information of extraction is inputted classifier, real
Now to the Classification and Identification of gesture motion；Wherein 3) step and 4) algorithm combination of step have preferable robustness and real-time,
It can satisfy demand of the user to multi-mode classification and recognition efficiency；
5) gesture motion recognition result exports
Final left hand armlet, right hand armlet control unit can complete analysis a series of to the electromyography signal collected with
Processing is finally completed the pattern-recognition to gesture motion, and carries out result output to gesture action recognition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810619841.9A CN108829252A (en) | 2018-06-14 | 2018-06-14 | Gesture input computer character device and method based on electromyography signal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810619841.9A CN108829252A (en) | 2018-06-14 | 2018-06-14 | Gesture input computer character device and method based on electromyography signal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108829252A true CN108829252A (en) | 2018-11-16 |
Family
ID=64142072
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810619841.9A Pending CN108829252A (en) | 2018-06-14 | 2018-06-14 | Gesture input computer character device and method based on electromyography signal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829252A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634439A (en) * | 2018-12-20 | 2019-04-16 | 中国科学技术大学 | Intelligent text input method |
| CN109765823A (en) * | 2019-01-21 | 2019-05-17 | 吉林大学 | Ground crawler-type unmanned vehicle control method based on arm electromyography signal |
| CN110018744A (en) * | 2019-04-17 | 2019-07-16 | 华南理工大学 | The surface myoelectric man-machine interface system and its control method at a kind of view-based access control model stimulation interface |
| CN111427457A (en) * | 2020-06-11 | 2020-07-17 | 诺百爱（杭州）科技有限责任公司 | Method and device for inputting characters based on virtual keys and electronic equipment |
| CN111562842A (en) * | 2020-01-21 | 2020-08-21 | 北京航空航天大学 | Virtual keyboard design method based on electromyographic signals |
| WO2020192396A1 (en) * | 2019-03-22 | 2020-10-01 | 五邑大学 | Somatosensory device, game machine device and limb movement signal processing method |
| CN114442798A (en) * | 2020-11-06 | 2022-05-06 | 复旦大学附属妇产科医院 | Portable control system and control method |
| CN115857706A (en) * | 2023-03-03 | 2023-03-28 | 浙江强脑科技有限公司 | Character input method and device based on facial muscle state and terminal equipment |
| KR102584832B1 (en) * | 2023-01-20 | 2023-10-04 | 성균관대학교산학협력단 | Method of training deep learning model to realize motion of avatar in virtual world based on biosignal analysis and mental deep learning model training device performing method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853333A (en) * | 2014-03-21 | 2014-06-11 | 上海威璞电子科技有限公司 | Gesture control scheme for toy |
| CN104134060A (en) * | 2014-08-03 | 2014-11-05 | 上海威璞电子科技有限公司 | Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors |
| WO2015188268A1 (en) * | 2014-06-08 | 2015-12-17 | Hsien-Hsiang Chiu | Gestural interface with virtual control layers |
| CN106695794A (en) * | 2017-02-20 | 2017-05-24 | 苏州晨本智能科技有限公司 | Mobile machine arm system based on surface myoelectric signal and control method of mobile machine arm system |
| CN206406060U (en) * | 2017-01-24 | 2017-08-15 | 成都理工大学 | A kind of Hexapod Robot control system based on electromyographic signal |
| CN208207733U (en) * | 2018-06-14 | 2018-12-07 | 吉林大学 | Gesture input computer character device based on electromyography signal |
-
2018
- 2018-06-14 CN CN201810619841.9A patent/CN108829252A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853333A (en) * | 2014-03-21 | 2014-06-11 | 上海威璞电子科技有限公司 | Gesture control scheme for toy |
| WO2015188268A1 (en) * | 2014-06-08 | 2015-12-17 | Hsien-Hsiang Chiu | Gestural interface with virtual control layers |
| CN104134060A (en) * | 2014-08-03 | 2014-11-05 | 上海威璞电子科技有限公司 | Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors |
| CN206406060U (en) * | 2017-01-24 | 2017-08-15 | 成都理工大学 | A kind of Hexapod Robot control system based on electromyographic signal |
| CN106695794A (en) * | 2017-02-20 | 2017-05-24 | 苏州晨本智能科技有限公司 | Mobile machine arm system based on surface myoelectric signal and control method of mobile machine arm system |
| CN208207733U (en) * | 2018-06-14 | 2018-12-07 | 吉林大学 | Gesture input computer character device based on electromyography signal |
Non-Patent Citations (1)
| Title |
|---|
| 金梅;姬少英;张立国;杨妮;王松;: "基于惯性跟踪的手臂运动及脑波一致性分析", 高技术通讯, no. 07 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634439A (en) * | 2018-12-20 | 2019-04-16 | 中国科学技术大学 | Intelligent text input method |
| CN109765823A (en) * | 2019-01-21 | 2019-05-17 | 吉林大学 | Ground crawler-type unmanned vehicle control method based on arm electromyography signal |
| WO2020192396A1 (en) * | 2019-03-22 | 2020-10-01 | 五邑大学 | Somatosensory device, game machine device and limb movement signal processing method |
| CN110018744A (en) * | 2019-04-17 | 2019-07-16 | 华南理工大学 | The surface myoelectric man-machine interface system and its control method at a kind of view-based access control model stimulation interface |
| CN110018744B (en) * | 2019-04-17 | 2023-10-20 | 华南理工大学 | Surface myoelectricity man-machine interface system based on visual stimulus interface and control method thereof |
| CN111562842A (en) * | 2020-01-21 | 2020-08-21 | 北京航空航天大学 | Virtual keyboard design method based on electromyographic signals |
| CN111427457A (en) * | 2020-06-11 | 2020-07-17 | 诺百爱（杭州）科技有限责任公司 | Method and device for inputting characters based on virtual keys and electronic equipment |
| CN114442798A (en) * | 2020-11-06 | 2022-05-06 | 复旦大学附属妇产科医院 | Portable control system and control method |
| CN114442798B (en) * | 2020-11-06 | 2024-05-07 | 复旦大学附属妇产科医院 | Portable control system and control method |
| KR102584832B1 (en) * | 2023-01-20 | 2023-10-04 | 성균관대학교산학협력단 | Method of training deep learning model to realize motion of avatar in virtual world based on biosignal analysis and mental deep learning model training device performing method |
| CN115857706A (en) * | 2023-03-03 | 2023-03-28 | 浙江强脑科技有限公司 | Character input method and device based on facial muscle state and terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829252A (en) | Gesture input computer character device and method based on electromyography signal | |
| CN103676604B (en) | Watch and running method thereof | |
| CN105929940B (en) | Quick three-dimensional dynamic gesture identification method and system based on subdivision method of characteristic | |
| CN104808783B (en) | Mobile terminal and its control method | |
| CN103246349B (en) | Input method of wearable finer-sensing wireless communication, and input device using input method | |
| CN110045819A (en) | A kind of gesture processing method and equipment | |
| CN107145236A (en) | A kind of gesture identification method and system based on tendon of wrist pressure correlation characteristic | |
| WO2009044967A1 (en) | Bracelet keyboard and key-in method therby | |
| CN203801880U (en) | Intelligent hand ring | |
| CN205158728U (en) | Sign language translating system | |
| CN104714644B (en) | Electronic equipment and information processing method | |
| CN104038800A (en) | Finger ring for smart television input and input method of finger ring | |
| CN109634439B (en) | Intelligent text input method | |
| CN103543837A (en) | Keyboard-free input method and device achieving same | |
| Li et al. | Hand gesture recognition and real-time game control based on a wearable band with 6-axis sensors | |
| CN106648072A (en) | Motion recognition and control palm ring | |
| CN208207733U (en) | Gesture input computer character device based on electromyography signal | |
| CN108958620A (en) | A kind of dummy keyboard design method based on forearm surface myoelectric | |
| CN114167984A (en) | Device control method, device, storage medium and electronic device | |
| CN107450672B (en) | Wrist type intelligent device with high recognition rate | |
| CN109508088A (en) | One kind is based on electromyography signal Sign Language Recognition translation armlet and sign Language Recognition Method | |
| CN105582669A (en) | Motion sensing game bracelet system based on motion template feature matching | |
| CN205692125U (en) | Gesture discriminating device | |
| CN210605644U (en) | Wearable keyboard | |
| CN209514566U (en) | A kind of stylus and control system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20181116 |