CN102117119A - Method for realizing mouse control based on temporalis surface electromyogram signals - Google Patents

Method for realizing mouse control based on temporalis surface electromyogram signals Download PDF

Info

Publication number
CN102117119A
CN102117119A CN2011100313040A CN201110031304A CN102117119A CN 102117119 A CN102117119 A CN 102117119A CN 2011100313040 A CN2011100313040 A CN 2011100313040A CN 201110031304 A CN201110031304 A CN 201110031304A CN 102117119 A CN102117119 A CN 102117119A
Authority
CN
China
Prior art keywords
signal
temporalis
mouse
cursor
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011100313040A
Other languages
Chinese (zh)
Inventor
李立峰
张腾宇
赵域
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National Research Center for Rehabilitation Technical Aids
Original Assignee
National Research Center for Rehabilitation Technical Aids
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National Research Center for Rehabilitation Technical Aids filed Critical National Research Center for Rehabilitation Technical Aids
Priority to CN2011100313040A priority Critical patent/CN102117119A/en
Publication of CN102117119A publication Critical patent/CN102117119A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Position Input By Displaying (AREA)

Abstract

The invention provides a method for realizing control of mouse button clicking and mouse cursor moving functions by using head surface electromyogram signals. Biting actions at different positions, strengths and lasting times generate electromyogram signals with different characteristics; when the biting actions are carried out, the electromyogram signals at the head temporalis are acquired and processed and then converted to control signals which can realize mouse button clicking and mouse cursor moving functions and are connected with a computer via a wireless technology, so that patients with upper extremity motion function disorders such as high-level paraplegia and upper limb amputation can realize the control to a computer mouse through the simple biting actions.

Description

Realize the method for mouse control based on the temporalis surface electromyogram signal
Technical field
The present invention relates to utilize electromyographic signal to realize that mousebutton is clicked and the method for cursor of mouse locomotive function control, belong to rehabilitation project and field of computer technology.
Background technology
Mouse is the requisite input equipment of a kind of computing machine, and present product mainly is the control that realizes computing machine with click of moving by hand, can not satisfy high paraplegia and upper limb disability patient's demand.
In recent years, become one of the research forward position of teleoperation robot and human-computer interaction technology and focus based on the human-computer interaction technology of bioelectrical signals such as brain electricity, eye electricity, myoelectricity.Through a large amount of studies show that, the extraction of brain electricity and electro-ocular signal is convenient inadequately, be subject to the influence of individual misoperation and surrounding environment factor, and the cost of brain electric control is higher, is difficult for realizing industrialization.And surface myoelectric collection preconditioning technique is very ripe, and myoelectricity control is more and more paid close attention in fields such as clinical muscle disease diagnosis, sports medical science, rehabilitation projects as a new and developing branch in man machine interface field.It is fan-shaped that temporalis is, and arises from the dark face of temporal fossa and deep temporal fascia, and muscle bundle is descending, is gathered into flat tendon, passes tip, inboard and front and rear edge that the dark face of zygomatic arch terminates in coronoid process of mandible, and the leading edge that extends to ramus of mandible is until the third molar place.During the temporalis overall shrinkage, assistance is put jaw upwards, show as snap-action, through lot of experiments, the electromyographic signal feature that temporalis produces when gritting one's teeth action is obvious.Therefore the electromyographic signal that temporalis produces in the time of can utilizing snap-action is as mousebutton is clicked and cursor moves control signal.
The mouse with myoelectric signal control that patent application people 200610024781.3 relates to, can utilize the electromyographic signal of artificial hand controlled to come the right and left key switch of mouse beacon, and utilize existing myoelectrically controlled hand to catch mouse, motion by deformed limb realizes rolling mouse, thereby realizes the motion of cursor X, Y direction.But this patent control device is complicated and still need deformed limb to carry out the control of mouse, can not satisfy patients' such as high paraplegia demand for control.
Summary of the invention
The objective of the invention is provides a kind of method of utilizing self electromyographic signal to realize click and the control of cursor of mouse locomotive function for upper extremity exercise dysfunction patients such as high paraplegia, upper limb amputations.
To achieve these goals, the present invention adopts following scheme:
A kind of method based on temporalis surface electromyogram signal realization mouse control is characterized in that may further comprise the steps:
1) gathers the electromyographic signal that temporalis position, the head left and right sides produces;
2) analyze the temporalis surface electromyogram signal that identification is gathered, convert thereof into control signal;
3), realize that mousebutton clicks and the cursor of mouse locomotive function by the grit one's teeth combination of the both sides myoelectricity control signal that causes of action of difference.
Further:
Described mousebutton is clicked with the cursor of mouse locomotive function and is all only realized by the action of gritting one's teeth.
In described step 2) in, when reaching the threshold range of getting, the value of the electromyographic signal of gathering represents that then action effectively, is divided into assorted signal, push button signalling and movable signal according to duration with control signal, assorted signal is the invalid signals of misoperation introducing; The click function of corresponding cursor direction handoff functionality of push button signalling and mousebutton; The corresponding locomotive function of determining key function and cursor of mouse of movable signal.
In described step 3):
Then corresponding left mouse button click function when having only temporalis position, left side to produce push button signalling;
Then correspondence is clicked function by mouse right button when having only temporalis position, right side to produce push button signalling;
Then corresponding handoff functionality when temporalis position, the left and right sides produces push button signalling simultaneously, its control effect is to realize the switching of current cursor of mouse moving direction;
When having only temporalis position, left side to produce movable signal then corresponding cursor left/the right locomotive function;
When the movable signal that has only temporalis position, right side to produce on the then corresponding cursor/following direction locomotive function;
Then corresponding definite key function when temporalis position, the left and right sides produces movable signal simultaneously, its control effect is to choose and open the current indication file of cursor of mouse.
The present invention can utilize self electromyographic signal realization click and the control of cursor of mouse locomotive function.
Description of drawings
Fig. 1 is system and control block diagram thereof;
Fig. 2 is the control system structured flowchart;
Fig. 3 and Fig. 4 are the mouse control method process flow diagram.
Embodiment
The present invention relates to utilize electromyographic signal to realize that mousebutton is clicked and the method for cursor of mouse locomotive function control.
The action of gritting one's teeth of diverse location, intensity, duration can make temporalis produce the electromyographic signal of different characteristic, and the present invention converts thereof into the discernible mouse control signal of computing machine by collection, processing and calculating.
Choose the electromyographic signal that temporalis position, the head left and right sides produces and carry out acquisition process, realize that by the different combination of binary channels control signal mousebutton clicks and the cursor of mouse locomotive function with calculating converts thereof into control signal.
The electromyographic signal of head temporalis position was controlled when the mousebutton click was all only moved with gritting one's teeth with the cursor of mouse locomotive function.
Gather the different electromyographic signals that head left and right sides temporalis produces when moving of gritting one's teeth, this electromyographic signal is handled and calculated, convert thereof into control signal, its value reaches the threshold range of getting and represents that then action effectively, according to duration control signal is divided into assorted signal, push button signalling and movable signal, assorted signal is the invalid signals that misoperation is introduced; The click function of corresponding cursor direction handoff functionality of push button signalling and mousebutton; The corresponding locomotive function of determining key function and cursor of mouse of movable signal.
Have only temporalis position, left side to produce the corresponding left mouse button click function of push button signalling (being called for short the LS signal); Have only temporalis position, right side to produce push button signalling (being called for short the RS signal) correspondence and click function by mouse right button; Temporalis position, the left and right sides produces the corresponding handoff functionality of push button signalling (being called for short the BS signal) simultaneously, and its control effect is to realize the switching (switching of left and right directions and the switching of above-below direction) of current cursor of mouse moving direction.
Have only temporalis position, left side produce the corresponding cursor of movable signal (being called for short the LL signal) left/the right locomotive function; Have only on the corresponding cursor of movable signal (being called for short the RL signal) that temporalis position, right side produces/following direction locomotive function; Temporalis position, the left and right sides produces the corresponding definite key function of movable signal (being called for short the BL signal) simultaneously, and its control effect is to choose and open the current indication file of cursor of mouse.
Below the present invention is elaborated.
According to the method that this invention provides, design mainly is made up of four modules: the electromyographic signal collection module based on the mouse control system of temporalis electromyographic signal; Signal Processing and modular converter; Wireless transport module; Computer application software.Wherein:
Electromyographic signal collection module: choose head temporalis position as the electromyographic signal collection source, the electromyographic signal that collects is carried out filtering, is transferred to next module after amplifying and carries out signal Processing and conversion;
Signal Processing and modular converter: will handle and calculate it by single chip circuit through pretreated electromyographic signal, convert it into the discernible mouse control signal of computing machine, realize the control of click and cursor of mouse locomotive function by the grit one's teeth combination of action control signal of diverse location;
Signal transmission module: adopt wireless technology to realize the wireless transmission of control signal, receiving end adopts the radio receiver of USB mouth;
Application software: based on the realization that the mouse (cursor) of VB platform is controlled, according to the result of the action electromyographic signal pattern-recognition of gritting one's teeth, the api function that adopts windows to carry is realized the control to cursor.
Specific operation process is with reference to accompanying drawing:
As Fig. 1, choose the collection point of the muscle of temporalis position as electromyographic signal, the control signal that can realize functions such as click and cursor of mouse move is handled and calculated and convert to the signal process of gathering, utilize bluetooth radio module to finish the wireless transmission and the reception of control signal afterwards, computing machine is according to the result of the action electromyographic signal pattern-recognition of gritting one's teeth, and the api function that utilizes VB platform and windows to carry is realized the control to above-mentioned functions.
As shown in Figure 2, the feature of the electromyographic signal performance of temporalis position is obvious when gritting one's teeth action, import the electromyographic signal of gathering into single chip circuit after through pre-service such as amplification, filtering, the signal that single chip circuit will import into carry out A/D conversion and with the digital signal of conversion with reference to features such as sample frequency and electromyographic signal voltage magnitudes, and utilize the threshold value diagnostic method to convert thereof into the signal of may command mouse, utilize blue tooth wireless technology to finish the transmission and the reception of control signal afterwards.
As shown in Figure 3, the passing threshold diagnostic method has judged whether that action produces, and has action to produce then signal and puts high level, and action produces then signal and puts low level, according to high level lasting time signal is divided into assorted signal, push button signalling and movable signal.Assorted signal is an invalid signals, push button signalling and movable signal are control signals, when mixing signal, generation returns the signal condition before producing assorted signal, when producing useful signal, set certain high level lasting time threshold value, judge that when being no more than threshold value it is a push button signalling, when surpassing threshold value, judge that it is a movable signal, change signal over to next module D (Fig. 4) computing.
As shown in Figure 4, the right and left key click function and the current cursor of mouse direction handoff functionality of the corresponding mouse of the control signal of diverse location difference; The movable signal of diverse location is a left side/right side and last/following locomotive function and definite key function of corresponding mouse respectively.Particular content is as follows:
Have only temporalis position, left side to produce the corresponding left mouse button click function of push button signalling (being called for short the LS signal); Have only temporalis position, right side to produce push button signalling (being called for short the RS signal) correspondence and click function by mouse right button; Temporalis position, the left and right sides produces the corresponding handoff functionality of push button signalling (being called for short the BS signal) simultaneously, and its control effect is to realize the switching (switching of left and right directions and the switching of above-below direction) of current cursor of mouse moving direction.
Have only temporalis position, left side produce the corresponding cursor of movable signal (being called for short the LL signal) left/the right locomotive function; Have only on the corresponding cursor of movable signal (being called for short the RL signal) that temporalis position, right side produces/following direction locomotive function; Temporalis position, the left and right sides produces the corresponding definite key function of movable signal (being called for short the BL signal) simultaneously, and its control effect is to choose and open the current indication file of cursor of mouse.
Finished then end signal collection as operation, do not finished then to return as operation and continue the acquisition process electromyographic signal.

Claims (4)

1. realize it is characterized in that the method for mouse control may further comprise the steps based on the temporalis surface electromyogram signal for one kind:
1) gathers the electromyographic signal that temporalis position, the head left and right sides produces;
2) analyze the temporalis surface electromyogram signal that identification is gathered, convert thereof into control signal;
3), realize that mousebutton clicks and the cursor of mouse locomotive function by the grit one's teeth combination of the both sides myoelectricity control signal that causes of action of difference.
2. the method based on temporalis surface electromyogram signal realization mouse control according to claim 1 is characterized in that:
Described mousebutton is clicked with the cursor of mouse locomotive function and is all only realized by the action of gritting one's teeth.
3. the method based on temporalis surface electromyogram signal realization mouse control according to claim 1 and 2 is characterized in that:
In described step 2) in, when reaching the threshold range of getting, the value of the electromyographic signal of gathering represents that then action effectively, is divided into assorted signal, push button signalling and movable signal according to duration with control signal, assorted signal is the invalid signals of misoperation introducing; The click function of corresponding cursor direction handoff functionality of push button signalling and mousebutton; The corresponding locomotive function of determining key function and cursor of mouse of movable signal.
4. the method based on temporalis surface electromyogram signal realization mouse control according to claim 3 is characterized in that:
In described step 3):
Then corresponding left mouse button click function when having only temporalis position, left side to produce push button signalling;
Then correspondence is clicked function by mouse right button when having only temporalis position, right side to produce push button signalling;
Then corresponding handoff functionality when temporalis position, the left and right sides produces push button signalling simultaneously, its control effect is to realize the switching of current cursor of mouse moving direction;
When having only temporalis position, left side to produce movable signal then corresponding cursor left/the right locomotive function;
When having only temporalis position, right side to produce movable signal on the then corresponding cursor/following direction locomotive function;
Then corresponding definite key function when temporalis position, the left and right sides produces movable signal simultaneously, its control effect is to choose and open the current indication file of cursor of mouse.
CN2011100313040A 2011-01-28 2011-01-28 Method for realizing mouse control based on temporalis surface electromyogram signals Pending CN102117119A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011100313040A CN102117119A (en) 2011-01-28 2011-01-28 Method for realizing mouse control based on temporalis surface electromyogram signals

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011100313040A CN102117119A (en) 2011-01-28 2011-01-28 Method for realizing mouse control based on temporalis surface electromyogram signals

Publications (1)

Publication Number Publication Date
CN102117119A true CN102117119A (en) 2011-07-06

Family

ID=44215918

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011100313040A Pending CN102117119A (en) 2011-01-28 2011-01-28 Method for realizing mouse control based on temporalis surface electromyogram signals

Country Status (1)

Country Link
CN (1) CN102117119A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102289285A (en) * 2011-08-16 2011-12-21 海尔集团公司 Method for controlling electronic equipment based on consciousness
CN103809749A (en) * 2014-01-17 2014-05-21 浙江大学 System used for converting rehabilitation training movements into mouse instructions
CN106569607A (en) * 2016-11-08 2017-04-19 上海交通大学 Head action identifying system based on myoelectricity and motion sensor
CN108646726A (en) * 2018-04-03 2018-10-12 山东农业大学 The wheelchair control system of wheelchair control method and combination voice based on brain wave
WO2018227896A1 (en) * 2017-06-13 2018-12-20 北京纳米能源与系统研究所 Muscle micro-motion detection element, switch device, human-computer interaction system, and front-end device
CN110051351A (en) * 2019-03-28 2019-07-26 深圳市宏智力科技有限公司 It grits one's teeth the control method and device of signal acquiring method and electronic equipment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101776981A (en) * 2010-01-07 2010-07-14 天津大学 Method for controlling mouse by jointing brain electricity and myoelectricity

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101776981A (en) * 2010-01-07 2010-07-14 天津大学 Method for controlling mouse by jointing brain electricity and myoelectricity

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102289285A (en) * 2011-08-16 2011-12-21 海尔集团公司 Method for controlling electronic equipment based on consciousness
CN102289285B (en) * 2011-08-16 2016-06-08 海尔集团公司 A kind of method realizing electronic equipment is controlled based on consciousness
CN103809749A (en) * 2014-01-17 2014-05-21 浙江大学 System used for converting rehabilitation training movements into mouse instructions
CN106569607A (en) * 2016-11-08 2017-04-19 上海交通大学 Head action identifying system based on myoelectricity and motion sensor
WO2018227896A1 (en) * 2017-06-13 2018-12-20 北京纳米能源与系统研究所 Muscle micro-motion detection element, switch device, human-computer interaction system, and front-end device
CN108646726A (en) * 2018-04-03 2018-10-12 山东农业大学 The wheelchair control system of wheelchair control method and combination voice based on brain wave
CN110051351A (en) * 2019-03-28 2019-07-26 深圳市宏智力科技有限公司 It grits one's teeth the control method and device of signal acquiring method and electronic equipment

Similar Documents

Publication Publication Date Title
CN102117119A (en) Method for realizing mouse control based on temporalis surface electromyogram signals
CN103892945B (en) Myoelectric limb control system
CN102670218B (en) Wearable foot bottom pressure acquisition device for artificial limb control
Chen et al. Locomotion mode classification using a wearable capacitive sensing system
CN102323771A (en) Car model control device based on brain-computer interface
CN103543843A (en) Man-machine interface equipment based on acceleration sensor and man-machine interaction method
CN105012057B (en) Intelligent artificial limb based on double-arm electromyogram and attitude information acquisition and motion classifying method
CN107861628A (en) A kind of hand gestures identifying system based on human body surface myoelectric signal
CN203417440U (en) Composite sensing system for wearable pneumatic lower limb rehabilitation robot
CN102670207A (en) Gait analysis method based on plantar pressure
CN103815991B (en) Virtual training system and the method for doing evil through another person of dual pathways operation perception
CN105361880A (en) Muscle movement event recognition system and method
CN103513770A (en) Man-machine interface equipment and man-machine interaction method based on three-axis gyroscope
WO2014194609A1 (en) Control method based on electromyographic signal and sensor signal for implementing fine real-time motion
CN107066956B (en) Multisource emotion recognition robot based on body area network
CN104133470A (en) Multi-mode brain machine interface wheelchair control system
CN104571837A (en) Method and system for realizing human-computer interaction
Pancholi et al. Development of low cost EMG data acquisition system for arm activities recognition
CN111616848B (en) Five-degree-of-freedom upper arm prosthesis control system based on FSM
CN204909750U (en) Intelligence artificial limb based on both arms flesh electricity, Attitude information gather
CN202142007U (en) Head myoelectric control mouse device with adjustable signal collecting positions
CN206700691U (en) A kind of upper extremity exercise control is assessed and the mechanism of rehabilitation training
CN206710887U (en) A kind of idea dolly
CN107126302B (en) Upper and lower limb movement simulation processing method
CN210278193U (en) Comprehensive rehabilitation treatment system based on motion capture and biofeedback

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110706