CN1949139B - Brain-machine interface mouse controlling device - Google Patents
Brain-machine interface mouse controlling device Download PDFInfo
- Publication number
- CN1949139B CN1949139B CN2006101292549A CN200610129254A CN1949139B CN 1949139 B CN1949139 B CN 1949139B CN 2006101292549 A CN2006101292549 A CN 2006101292549A CN 200610129254 A CN200610129254 A CN 200610129254A CN 1949139 B CN1949139 B CN 1949139B
- Authority
- CN
- China
- Prior art keywords
- control
- mouse
- signal
- cursor
- brain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to two devices used EEG to control mouse. One of them includes screen cursor cycle control display panel, scalp lead electrode, pre-amplification low pass filter circuit, analog digital conversion circuit, and computer. The screen cursor cycle control display panel is respectively set indicator light on each azimuth which is controlled by cycle program, used to indicate current controlled mouse moving direction for user. The scalp lead electrode collects user EEG, and transmits it to the pre-amplification low pass filter circuit. The processed analog signal is converted into digital signal and output to computer by which the digital signal is processed to generate brain-computer interface control signal. The mouse control program is transferred by judging the brain-computer interface control signal and indicator light cycle lighted control signal to control the mouse cursor moving. Another one replaces the screen cursor cycle control display panel with screen display control. The invention supplies two simple and practicable computer mouse cursor control devices for paralysis patient, has distinct social and economic benefits.
Description
Technical field
The present invention relates to utilize EEG signals to realize the device of mouse control, belong to biomedical engineering and field of computer technology.
Background technology
Brain-computer interface (Brain-Computer Interface, BCI) being to set up a kind of direct information that does not rely on conventional brain output channel (peripheral nerve and musculature) to exchange and control channel between human brain and computing machine or other electronic equipments, is a kind of brand-new man-machine interaction system.
The principle of basic BCI system is as follows: the EEG signals that contains operation control intention obtains from scalp or encephalic by electrode, extract the EEG signals feature of reflection user intention through signal Processing, and it is converted into the operational order (as press remote control keys, knock typewriter keyboard, move screen and go up cursor etc.) of control external unit.The main application target of BCI research at present is to help the disabled person of the serious paralysis of limbs to handle and use peripheral daily life instrument, to realize information interchange and device control to external world.
Brain-computer interface is as a kind of brand-new message exchange and control technology, to be the paralytic, particularly those have lost basic extremity motor function but the patient that has a normal thinking, and a kind of and extraneous new way of carrying out information interchange and control is provided, and just are being subjected to increasing attention.
Summary of the invention
Purport of the present invention provides the control device of computer screen mouse cursor movement, to realize the no limb action remote control of computer mouse control.This invention can allow the general severe paralyse but the normally functioning disabled person of brains realizes the straighforward operation to the computer screen mouse cursor movement voluntarily.
Technical scheme of the present invention is as follows:
A kind of brain-machine interface mouse controlling device, comprise C3 and C4 scalp crosslinking electrode, the pre-amplification low pass circuit, analog to digital conversion circuit, computing machine, wherein: the EEG signals that C3 and C4 scalp crosslinking electrode are used to gather mouse action person is produced by the action of imagination cursor of mouse, and be sent to the pre-amplification low pass circuit and amplify, Filtering Processing, amplify, simulating signal after the Filtering Processing converts digital signal to through analog to digital conversion circuit and exports computing machine to, above-mentioned digital signal is carried out the calculation process of signal Processing and feature extraction by computing machine, calculate C3 and the C4 alpha wave band energy spectrum of EEG signals that leads, obtain its intermediate frequency 10Hz place energy value, calculate C3 and subtract the energy difference that C4 leads, and generate the brain-computer interface control signal in view of the above, and according to the brain-computer interface control signal, call the mouse control program, the moving of the cursor of mouse on the control computer screen.
In the above-mentioned brain-machine interface mouse controlling device, the calculation process that computing machine can adopt the Labview platform that the digital signal of input is carried out signal Processing and feature extraction.
The present invention utilizes the brain-computer interface control signal, be the paralytic, particularly those have lost basic extremity motor function but the patient that has a normal thinking, and a kind of control device that is simple and easy to the computer mouse cursor of usefulness is provided, and have remarkable social benefit and economic benefit.
Description of drawings
Fig. 1 system architecture synoptic diagram of the present invention;
Fig. 2 screen cursor cycle control display panel and indicator light cycle lighting synoptic diagram, (a): the cursor control that moves up; (b): cursor moves down control; (c): cursor is moved to the left control;
The process flow diagram that on the Labview platform, carries out signal Processing of Fig. 3 embodiment of the invention.
Embodiment
The present invention selects for use alpha in the brain electricity (α) ripple as the feature control signal.The α ripple is one of principal ingredient of spontaneous brain electricity, and corresponding with the unused rhythm and pace of moving things of visual cortex, frequency is 8～13Hz, is the composition of tool obvious characteristic in the rhythmicity brain wave.The normal person clear-headed when closing order the α ripple strengthen, open eyes, ponder a problem, or when being subjected to other and stimulating, the α ripple weakens or the electrophysiological phenomena that disappears is called the blocking-up of α ripple; After this if order is closed in experimenter's peace and quiet once again, then the α ripple occurs again.The α wave amplitude all can obviously strengthen this pervasive feature during the hindbrain electricity closed one's eyes according to 90% above cranial nerve function normal person in the short time, the present invention as control signal, realizes the control to the computer screen mouse cursor movement by the variation characteristic that extracts the experimenter and open eeg amplitude when closing one's eyes.Place Ag-AgCl scalp crosslinking electrode at operator's back of head 01-T5 place of leading and detect the variation of eeg amplitude, and set suitable control threshold value according to experimenter α wave amplitude size.When the α wave amplitude of closing one's eyes surpasses threshold value, then open the control corresponding switch.Because system operation is simple, generally need not training just can control computer screen mouse cursor movement.
Fig. 1 is a system architecture synoptic diagram of the present invention.This system is based on virtual instrument Labview platform, utilize the switch control action of the disconnected phenomenon of normal brain electricity α wave resistance to design corresponding screen cursor cycle control display panel, scalp crosslinking electrode, Labview data acquisition card, Labview signal processing platform, realize control the computer screen mouse cursor movement.The operator selects according to cursor on computer screen cycle control indication, produces the EEG signals that contains with the cursor of mouse control information; This signal carries out A/D conversion back input computing machine by the Lavview data acquisition card again by the induction of scalp crosslinking electrode, through the pre-amplification low pass circuit; In computing machine, finish on the Labview platform then denoising, root mean square (RMS) level and smooth-average, with threshold voltage relatively, produce a series of signal work of treatment such as gating pulse; At last by calling the mouse_event (MOUSEEVENTF_MOVE in the Windows api function storehouse, 10,0,0,0) function makes the computer screen mouse cursor move the proper number pixel to finish the control function to mouse to respective direction on the basis of current location.
The present invention has designed screen cursor cycle control display panel, to realize the selection (as shown in Figure 2) to four moving direction control function of cursor.Four control moving directions such as upper and lower, left and right are represented in four arrow indications shown in (a)～(c) respectively among Fig. 2, are shown by corresponding loop program Control Circulation.(a) and (b), (c) three width of cloth figure have demonstrated successively that cursor moves up, cursor moves down and cursor is moved to the left three function state of a controls (corresponding pilot lamp is lighted) among the figure.
The present invention can also adopt the screen display control, on the four direction up and down of control direction signs is set respectively, shows bright or variable color by the circulation of loop program control direction signs, and the function state of a control is to shown in Figure 2 similar.
The present invention utilizes brain electric control cursor of mouse flow process as follows:
(1) by the labview capture card by being placed in the scalp crosslinking electrode on the scalp, gather EEG signals.
(2) determine to wish cursor moving direction (upwards, downwards, left, to the right).
(3) supposition anticipation direction is upwards, when the pilot lamp that control lamp to be recycled makes progress is lighted, carries out the α ripple and recovers.
(4) EEG signals that collects is carried out filtering, near the variation of the power spectrum signal we the major concern 10Hz is so adopt the bandpass filter of 8～13Hz.
(5) it is level and smooth the later EEG signals of filtering to be carried out RMS, sets appropriate thresholds.The value of the RMS that records does not surpass threshold value output " 0 " if surpass threshold value output " 1 ".
(6) control signal of output " 0 " " 1 " signal and cycle control lamp is done and computing.If with operation result be 1, then call mouse_event (MOUSEEVENTF_MOVE, 0 ,-10,0,0) function in the Windows api function storehouse and make mouse ten pixels (number as number is adjustable) that on the basis of current location, move up
(7) in like manner, can finish downwards, left, task to the right.
Also can replace the cycle control lamp with imagination action potential, the selection idiographic flow of travel direction is as follows:
1) calculate C3 and the C4 alpha wave band energy spectrum of EEG signals that leads, and read its intermediate frequency 10Hz place energy value, calculating C3 leads and the C4 energy difference of EEG signals that leads.
2) according to the energy difference that subtracts each other come decision operation person to be intended that to want cursor left (or on) move still to the right (or down) and move: if the two result who subtracts each other moves threshold value V greater than cursor
RmCan conclude then that the operator has makes cursor (or down) intention of moving to the right, if the two result who subtracts each other is less than-V
Rm, can conclude then that the operator has to make cursor (or on) intention of moving left; If the two result who subtracts each other is at (V
Rm, V
Rm) between, thinking that then the energy difference that C3 and C4 lead is in normal range, the operator does not have the intention of moving cursor temporarily; Cursor action threshold value V
RmValue determine by following described method.
3) if lead and the lead energy difference of EEG signals of C4 can be concluded that the operator has and makes cursor (or down) intention of moving to the right according to C3, then call mouse_event (MOUSEEVENTF_MOVE in the Windows api function storehouse, 10,0,0,0) function make cursor by current location to the right (or down) move ten pixels; Otherwise, if subtracting energy difference that C4 leads according to C3 can conclude that the operator has and make cursor (or on) intention of moving left, then call mouse_event (MOUSEEVENTF_MOVE in the Windows api function storehouse,-10,0,0,0) function make cursor by current location left (or on) move ten pixels.
4) repeating step 1) 2) 3) can make cursor of mouse move to the screen position that the operator is concerned about.
Signal Processing of the present invention can be finished on the Labview platform.Signal processing flow is as shown in Figure 3: pick up original EEG signals after the Labview capture card is input to computing machine by scalp electrode, the bandpass filtering through 8～13Hz keeps wherein α wave component again; This signal is through being divided into two paths of signals behind root mean square (RMS) smoothing algorithm of 10ms: become the main control channel signal after one tunnel the average treatment through 400～500ms, be used for output control; Another road becomes the auxiliary control channel signal through after average treatment of 50ms, is used for judging that main channel signal is by the close one's eyes true α ripple amplification signal that produces or other disturbs caused noise signal of experimenter.Its determination methods is that main channel signal and threshold voltage are compared, if surmount threshold voltage, compares to judge whether true α ripple amplification signal with the auxiliary control channel signal again.Signal processing flow is exported to interface circuit with actual α ripple amplification signal as control signal at last and is produced prompt tone and gives the operator.
For total system of the present invention, need to determine four critical technical parameters: first cursor action threshold value, it two is a switching threshold voltage, it three is constants actuation time, continue the time of flicker before switching corresponding to pilot lamp on the control panel, it four is the caused maximum ground unrest voltages of various interference.Above-mentioned first parameter mirror operation person is in the difference of α wave amplitude between (or up and down) motion state of closing one's eyes about imagination cursor; Second parameter mirror operation person open, the difference of α wave amplitude between the closed-eye state; The 3rd parameter mirror operation person closes one's eyes back α wave amplitude above the threshold voltage required time; The 4th parameter is to judging that the main control channel signal is a true α wave control signal or interference noise has important value.Below these four parameters customized are really introduced.
Cursor action threshold value:
α wave amplitude mean value was designated as V when the operator was closed one's eyes (or the on) motion left of imagination cursor
Left, α wave amplitude mean value is designated as V during (or the down) motion to the right of the imagination of closing one's eyes cursor
Right, its difference is designated as V
m, operator's switching threshold voltage reference value V then
RmCan calculate by following experimental formula:
V
rm＝V
right+0.8V
m (1)
0.8 is the adjustment coefficient of α wave amplitude difference under two kinds of imaginations of operator operating state in the formula.
Switching threshold voltage:
α wave amplitude mean value was designated as V when the operator was opened eyes
Open, α wave amplitude mean value is designated as V when closing one's eyes
Close, its difference is designated as V
d, operator's switching threshold voltage reference value V then
RefCan calculate by following experimental formula:
V
ref＝V
open+0.8V
d (2)
0.8 be that the operator opens in the formula, the gain coefficient of α wave amplitude difference under the closed-eye state.The present invention adopts identical threshold voltage to the different operating person, can choose corresponding switching threshold voltage setting scheme according to different controlled target and task.
Actuation time constant:
As described above, the α wave amplitude surpassed the threshold voltage required time after actuation time, constant reflected the operator, the present invention adopts the identical gain coefficient value, determines each operator's switch control threshold voltage as stated above, and with being worth this system testing operator's actuation time.In order to obtain more reliable and more stable data, require each operator's repetitive operation test 25 times, consider system hardware collection, signal Processing required time and individual difference, the present invention chooses maximal value in data recording actuation time as constant actuation time of BCI system.
Maximum ground unrest voltage:
A lot of disturbing factors (comprising that eye electricity, electromyographic signal and ambient noise disturb) can appear in the operating process.The action mean values can be followed the variation of the generation of action or environment and corresponding change occur when above-mentioned interference occurs, and it is a lot of to exceed normal range.For the situation that occurs is disturbed in caution significantly, the present invention is setting an interference warning value in addition (above threshold voltage on subaisle outside the main channel, within the interference range significantly that may occur), if surpass this warning value just think the control signal of main channel may be by interference cause but not the control increase of α wave amplitude down consciously, thereby suppress the output of main channel control signal.
16 experimenters use computer screen mouse cursor movement control system of the present invention to carry out the basic controlling characteristic test.This experiment purpose is by experimenter's data analysis being investigated controlling schemes feasibility and the ease for operation and the control rate of system.The experimenter is young student (men and women half and half, and the mean age is 25.2 years old).Experiment comprises four-stage, and each stage requires the experimenter to carry out 20 Continuous Selection control.The experimenter all not through training in advance, selects the order of control task to provide at random in experiment.Pick up counting from sending the control task order,, pilot lamp selected to the controlled target direction lighted (control task is finished in expression), and then timing stops, and carries out successively 20 times; If the pilot lamp of being lighted is not the direction that the control task order will be chosen, then be designated as a mistake.The experimental period record is strict to be responsible for carrying out by same experimenter under same experimental conditions.
Each experimenter correct select time (containing maximal value, minimum value, intermediate value and mean value) and wrong choice number of times in continuous 20 target selection process of four-stage have been write down.From experimental data as can be seen each experimenter continuous experimentation, correct select time shortens, selects errors number obviously to gradually reduce gradually, and generally be near or below mean value from the correct select time of subordinate phase experiment beginning, after showing that the experimenter is through the phase one experiment, all can be familiar with the also control operation of adaptive system soon.It only is 10% that two experimenters error rate in experiment is first wherein arranged, three experimenters are from subordinate phase, error rate is dropped to 15%, 10% and 5% respectively, show that most experimenters have been familiar with system's control when subordinate phase is tested, thereby reduced error level rapidly.Above-mentioned basic controlling experimental result has shown that this BCI system has the characteristics of easy to understand and operation.
Table 1 is that two classes that are easier to occur in wherein 5 experimenters experiment are selected error statistics, and first what is called " loop error " refers to that the experimenter misses this circulation because of failing in time to make a choice, and can only wait until next circulation time select target direction again.It two is " it is wrong to face choosing ", refer to the experimenter because of control has too much of a good thing the wrong adjacent direction target of having selected.Summation is analyzed as can be seen from table, and loop error occurs fewer, and its main cause is an accidentalia.And in selecting wrong number, face and select mistake to occupy larger proportion, be easier to take place.In essence, face and select mistake mainly to result from psychological factor, but can overcome through training.Can see in the table and face the choosing mistake, reduce 64.7%, reduce 70.6%, further prove the ease for operation and the unfailing performance of this BCI system to the 4th part in the second portion error rate progressively obviously reducing in the experimentation.
16 experimenter's experimental results illustrate that this BCI system has does not need complicated study or biofeedback training process, the accuracy height, easy characteristics such as grasps may be for having a normal thinking but the patient of motor function incompleteness provides a kind of new information interchange control mode and help the disabled rehabilitation and life aid.
Table 15 a subject data statistics
Claims (2)
1. brain-machine interface mouse controlling device, comprise C3 and C4 scalp crosslinking electrode, the pre-amplification low pass circuit, analog to digital conversion circuit, computing machine, wherein: the EEG signals that C3 and C4 scalp crosslinking electrode are used to gather mouse action person is produced by the action of imagination cursor of mouse, and be sent to the pre-amplification low pass circuit and amplify, Filtering Processing, amplify, simulating signal after the Filtering Processing converts digital signal to through analog to digital conversion circuit and exports computing machine to, above-mentioned digital signal is carried out the calculation process of signal Processing and feature extraction by computing machine, calculate C3 and the C4 alpha wave band energy spectrum of EEG signals that leads, obtain its intermediate frequency 10Hz place energy value, calculate C3 and subtract the energy difference that C4 leads, and generate the brain-computer interface control signal in view of the above, and according to the brain-computer interface control signal, call the mouse control program, the moving of the cursor of mouse on the control computer screen.
2. brain-machine interface mouse controlling device according to claim 1 is characterized in that, the calculation process that computing machine adopts the Labview platform that the digital signal of input is carried out signal Processing and feature extraction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006101292549A CN1949139B (en) | 2006-11-08 | 2006-11-08 | Brain-machine interface mouse controlling device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006101292549A CN1949139B (en) | 2006-11-08 | 2006-11-08 | Brain-machine interface mouse controlling device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1949139A CN1949139A (en) | 2007-04-18 |
| CN1949139B true CN1949139B (en) | 2010-09-08 |
Family
ID=38018672
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006101292549A Expired - Fee Related CN1949139B (en) | 2006-11-08 | 2006-11-08 | Brain-machine interface mouse controlling device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1949139B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101433461B (en) * | 2008-12-04 | 2010-06-02 | 上海大学 | Detection circuit for high-performance brain electrical signal of brain-machine interface |
| CN102184017B (en) * | 2011-05-13 | 2012-11-28 | 天津大学 | Lead optimizing method for P300 brain-computer interface |
| US8516568B2 (en) | 2011-06-17 | 2013-08-20 | Elliot D. Cohen | Neural network data filtering and monitoring systems and methods |
| CN103699226B (en) * | 2013-12-18 | 2016-08-24 | 天津大学 | A kind of three mode serial brain-computer interface methods based on Multi-information acquisition |
| CN104615250A (en) * | 2015-02-11 | 2015-05-13 | 中国兵器科学研究院 | Method of quickly controlling two-dimensional cursor based on brain-computer interface |
| CN112379782A (en) * | 2020-12-11 | 2021-02-19 | 吉林大学 | Mouse control method based on electroencephalogram signals |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5029590A (en) * | 1985-08-09 | 1991-07-09 | Allain Joseph L | Portable, life detection monitor system |
| CN1141764A (en) * | 1995-07-28 | 1997-02-05 | 北京新兴生物医学工程研究发展中心 | Multi-channel electroencephalo signal measuring method and apparatus without hardware lead permutator |
| US5638826A (en) * | 1995-06-01 | 1997-06-17 | Health Research, Inc. | Communication method and system using brain waves for multidimensional control |
| CN1710621A (en) * | 2005-07-19 | 2005-12-21 | 天津大学 | Domestic electric-appliance telecontroller |
-
2006
- 2006-11-08 CN CN2006101292549A patent/CN1949139B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5029590A (en) * | 1985-08-09 | 1991-07-09 | Allain Joseph L | Portable, life detection monitor system |
| US5638826A (en) * | 1995-06-01 | 1997-06-17 | Health Research, Inc. | Communication method and system using brain waves for multidimensional control |
| CN1141764A (en) * | 1995-07-28 | 1997-02-05 | 北京新兴生物医学工程研究发展中心 | Multi-channel electroencephalo signal measuring method and apparatus without hardware lead permutator |
| CN1710621A (en) * | 2005-07-19 | 2005-12-21 | 天津大学 | Domestic electric-appliance telecontroller |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1949139A (en) | 2007-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103793058B (en) | A kind of active brain-computer interactive system Mental imagery classification of task method and device | |
| WO2020119245A1 (en) | Wearable bracelet-based emotion recognition system and method | |
| CN1949139B (en) | Brain-machine interface mouse controlling device | |
| CN100366215C (en) | Control method and system and sense organs test method and system based on electrical steady induced response | |
| Gao et al. | A BCI-based environmental controller for the motion-disabled | |
| CN101201696B (en) | Chinese input BCI system based on P300 brain electric potential | |
| CN101987048B (en) | Artificial limb control method and system thereof | |
| Fabiani et al. | Conversion of EEG activity into cursor movement by a brain-computer interface (BCI) | |
| CN101464729B (en) | Independent desire expression method based on auditory sense cognition neural signal | |
| CN102063180B (en) | HHT-based high-frequency combined coding steady state visual evoked potential brain-computer interface method | |
| CN103699216B (en) | A kind of based on Mental imagery and the E-mail communication system of vision attention mixing brain-computer interface and method | |
| CN101382837B (en) | Computer mouse control device of compound motion mode | |
| Scherer et al. | Self-initiation of EEG-based brain–computer communication using the heart rate response | |
| Hinterberger et al. | A device for the detection of cognitive brain functions in completely paralyzed or unresponsive patients | |
| CN109582131A (en) | The asynchronous mixing brain-machine interface method of one kind and system | |
| CN1949140B (en) | Brain-machine interface mouse controlling method | |
| CN108509040A (en) | Mixing brain machine interface system based on multidimensional processiug and adaptive learning | |
| CN100353390C (en) | Domestic electric-appliance telecontroller | |
| CN108523883A (en) | A kind of continuous Mental imagery identifying system of left and right index finger based on actual act modeling | |
| CN104571505A (en) | Brain-machine interface method based on sequence composite limb imaginary movement | |
| CN109009098A (en) | A kind of EEG signals characteristic recognition method under Mental imagery state | |
| CN106774851A (en) | Sense of touch finger motion rehabilitation system and method based on brain-computer interface | |
| CN103300850A (en) | Method for collecting and processing EEG (Electroencephalogram) signals of stroke patient | |
| CN114983419A (en) | Rehabilitation device for improving motor skills based on electroencephalogram signals | |
| CN110688013A (en) | English keyboard spelling system and method based on SSVEP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100908 Termination date: 20121108 |