CN106775023A - Electro-ocular signal acquisition method and the bluetooth mouse system based on electro-ocular signal control - Google Patents
Electro-ocular signal acquisition method and the bluetooth mouse system based on electro-ocular signal control Download PDFInfo
- Publication number
- CN106775023A CN106775023A CN201710012567.4A CN201710012567A CN106775023A CN 106775023 A CN106775023 A CN 106775023A CN 201710012567 A CN201710012567 A CN 201710012567A CN 106775023 A CN106775023 A CN 106775023A
- Authority
- CN
- China
- Prior art keywords
- electro
- signal
- ocular signal
- ocular
- mid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03543—Mice or pucks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/30—Assessment of water resources
Abstract
The present invention discloses electro-ocular signal acquisition method and the bluetooth mouse system based on electro-ocular signal control, by electro-ocular signal processing method of the invention, identify eye left, eye right, looking down, look up with it is double blink etc. eye motion, and define the different mouse action of different eye motion correspondences, bluetooth mouse system based on electro-ocular signal control of the invention, including：Electro-ocular signal acquisition electrode, electro-ocular signal acquisition module, analog-digital converter, digital signal processor, bluetooth module and power module；For realizing that user only can just control mouse to realize different operations by eye motion such that it is able to the patient for helping both arms to lack, the operation such as surf the Net is carried out using electronic equipment as normal person；Circuit structure of the present invention is simple, and small volume is convenient for carrying, strong antijamming capability, can be widely applied for the fields such as portable medical, patient in family monitoring.
Description
Technical field
The invention belongs to technical field of biological information, the more particularly to identification of electro-ocular signal and control technology.
Background technology
The obstacle of limb movement of patient has a strong impact on itself and extraneous communication capability, traditional human-computer interaction device,
Such as keyboard, mouse cannot meet the demand of patient.For the demand of above-mentioned special crowd, develop some and new be independent of
It is a feasible solution in the human-computer interaction device of limbs, and is realized using the bioelectrical signals of human body itself man-machine
Interaction is a kind of important technological means.
Such as Chinese invention patent application of Publication No. CN102662473, disclosed and " is based on the 12nd in September in 2012
Eye motion recognition realizes the device and method of man-machine information interaction ", the device includes camera, sensor and processor institute
The hardware device of composition.By timing acquiring view data, extract pupil center location module, then position is analyzed and
Action processes to realize man-machine interaction.But the device there is also some problems, such as system architecture is complicated, and processing procedure is cumbersome,
Cause operation it is constant, cost is also high.
Such as Chinese invention patent application of Publication No. CN102129307B, discloses " a kind of on May 21st, 2014
Computer input control method based on electro-ocular signal ", the general principle of the program is to carry out row and column by signal of blinking
Circulation selection, is communicated with computer.But the invention is limited only to typewriting, and to be connected with specific equipment, volume is huge
Big operation inconvenience, range of application is narrow, is typewrited by the way of repeating query is highlighted, can just be sent by after repeatedly blink output
Once complete control command, control function is single, and typing speed is slow.
The content of the invention
The present invention is in order to solve the above technical problems, propose a kind of electro-ocular signal processing method and based on electro-ocular signal control
Bluetooth mouse system, with five kinds of typical electro-ocular signals (look up, look down, eye left, eye right and blink) be base
Plinth, by related circuit and algorithm, control command is converted to by eye electric signal, realizes the control to mouse.
The technical solution adopted by the present invention is：Electro-ocular signal processing method, including：
M1, starting point detection is carried out to electro-ocular signal, obtain useful signal；
M2, extraction useful signal feature, mainly include：
A1, have electro-ocular signal where passage；
A2, useful signal above baseline or below；
A3, the difference of useful signal take absolute value the number of signal medium wave peak；
A4, the difference of useful signal take absolute value in signal the distance between first and second crest；
M3, by zero passage point analysis, identify the eye motion eyed left or eye right or look down；According to useful signal
Difference take absolute value the number of signal medium wave peak and the difference of useful signal takes absolute value first and second ripple in signal
The distance between peak, identify look up or double blink eye motion.
Further, the step M1 is specially：Eye electricity data to being originally inputted carry out first-order difference budget and take absolutely
To value, when threshold value of the absolute value more than or equal to setting, then it represents that find the corresponding electro-ocular signal start bit of eye motion
Put.
Further, the zero crossing analysis described in step S3 includes：Setting upper limit threshold CP and lower threshold CN.
Further, the step S3 specifically include it is following step by step：
M31, the energy summation of calculating first passage are EV, and the energy summation for calculating second channel is EH, and EV is taken with EH
Absolute value, is expressed as：absEV、absEH；
M32, when first passage and second channel have useful signal, perform step M35；Otherwise perform step M33；
M33, when second channel has the crest number N2 of useful signal and second channel to be set up more than or equal to 2 simultaneously,
Perform step M35；Otherwise perform step M34；
M34, when first passage has the crest number N1 of useful signal and first passage to be set up more than or equal to 2 simultaneously,
Step M38 is performed, no signal is otherwise identified as；
If M35, absEH≤absEV, step M36 is performed；Otherwise perform step M38；
If M36, EH<CN, is identified as eyeing left, and otherwise performs step M37；
If M37, EH>CP, is identified as eyeing right, and is otherwise identified as no signal；
If M38, N1≤4, double blink is identified as, otherwise perform step M39；
If M39, EV<CN, is identified as looking down, and otherwise performs step M310；
If M310, EV>CP, is identified as looking up, and is otherwise identified as no signal.
Further, the step M3 judges to obtain the number of crest according to dynamic threshold；Specifically include it is following step by step：
B1, initialization first position behind=current locations usefulp, second place mid=(initial point positions
Usefuls+1) %100, the 3rd position head=(initial point position usefuls+2) %100, and initialize the value of crest peak
It is the threshold value gate of setting, maximum max is the threshold value gate of setting, and the data amount check i of current channel is 0；
B2, work as i<When 50, i++ is performed, go to step B3, otherwise i performs step B8 more than or equal to 50；
B3, when the corresponding data buff [behind] of behind be less than the corresponding data buff [mid] of mid, with head pairs
The data buff [head] for answering is more than the corresponding data buff [mid] of mid, while performing step B4 when setting up；Otherwise perform step
Rapid B7；
B4, judge the corresponding data buff [mid] of mid more than crest peak value, if set up, if set up if continue to sentence
The corresponding data buff [mid] of disconnected mid are more than maximum, if set up, and step B5 is performed if setting up；Otherwise perform step
B6；
B5, the maximum max=buff [mid] for performing next iteration；The value peak=sheets of the crest of next iteration
The maximum max/5*2 of secondary iteration；
B6, execution crest number Jia 1 certainly, i.e. peak_num++；
B7, renewal behind, mid, head, specially：
The second place mid of the first position behind=current iterations of next iteration；
3rd position head of the second place mid=current iterations of next iteration；
The 3rd position head=(the 3rd position head+1 of current iteration) %100 of next iteration；
B8, return crest number.
Based on the bluetooth mouse system of electro-ocular signal control, including：Electro-ocular signal acquisition module, main control module, power supply mould
Block, bluetooth module and right leg drive；The electro-ocular signal acquisition module is connected with main control module, for special according to electro-ocular signal
Point is gathered and amplifies electro-ocular signal, low noise；The power module is connected with main control module, for gathering mould for electro-ocular signal
Block, main control module, bluetooth module are powered；The bluetooth module is connected with main control module, for being connected with outside bluetooth equipment, leads to
Bluetooth protocol control bluetooth mouse is crossed to be operated accordingly；The right leg drive is connected with electro-ocular signal acquisition module, right leg
Drive for suppression common mode noise.
The electro-ocular signal acquisition module includes：Silver chlorate acquisition electrode, pre-amplification circuit, integrator, second order Bart
Butterworth low pass filter, analog-digital converter；The silver chlorate acquisition electrode is connected with pre-amplification circuit, for gathering eye telecommunications
Number；The pre-amplification circuit is used to be amplified electro-ocular signal treatment；The pre-amplification circuit is connected with integrator, institute
Integrator is stated for being corrected to the flip-flop in the electro-ocular signal from pre-amplification circuit；The integrator and second order
Butterworth LPF is connected, and the second order Butterworth LPF is used to filter the electro-ocular signal from integrator
In high-frequency noise；The analog-digital converter is connected with second order Butterworth LPF, and the analog-digital converter is used for will
Electro-ocular signal from second order Butterworth LPF is converted into data signal；
The main control module is digital signal processor, for being carried out to the electro-ocular signal that electro-ocular signal acquisition module is exported
The classification of eye motion and recognize and be converted into control command.
Beneficial effects of the present invention：The present invention is identified and is eyed left, eyed right, downwards by electro-ocular signal processing method
See, to look up after eye motion, define the different mouse actions of different eye motions correspondences with double blink etc., pass through
Based on electro-ocular signal control bluetooth mouse system, realize user only by eye motion (look up, look down, eyeing left,
Eye right and blink) can just control mouse to realize different operations such that it is able to the patient for helping both arms to lack, as normal person
Equally the operation such as surf the Net is carried out using electronic equipment；Circuit structure of the present invention is simple, and small volume is convenient for carrying, antijamming capability
By force, the fields such as portable medical, patient in family monitoring be can be widely applied for.
Brief description of the drawings
The bluetooth mouse system schematic based on electro-ocular signal control that Fig. 1 is provided for the present invention.
The implementation process schematic diagram of the mouse control that Fig. 2 is provided for the present invention.
The silver chlorate acquisition electrode riding position schematic diagram that Fig. 3 is provided for the present invention.
Fig. 4 is starting point overhaul flow chart provided in an embodiment of the present invention.
Fig. 5 is the eye motion recognition flow chart eye left, eye right, looking down provided in an embodiment of the present invention.
Fig. 6 is the eye motion recognition flow chart looked up with double blink provided in an embodiment of the present invention.
Specific embodiment
For ease of skilled artisan understands that technology contents of the invention, enter one to present invention below in conjunction with the accompanying drawings
Step explaination.
The present invention will be with five kinds of typical electro-ocular signals (look up, look down, eye left, eye right and blink) for base
Plinth, by related circuit and algorithm, control command is converted to by eye electric signal, realizes the control to mouse.The invention is not
Simple structure is only realized, and wearable, low cost, fast response time, with market application value very high.
Bluetooth mouse control section of the present invention including eye electric data collecting analysis part and based on eye electricity data.
Described data collection and analysis part enters the electric data of interrupt acquisition eye by timer, during setting timer timing
Between determine sample rate as set timer time as 10ms sample rates be 100HZ；Looked for by carrying out Threshold detection to eye electricity data
To starting point；Eye electricity data are carried out with the corresponding feature of the different eye motions of adding window searching, the feature of extraction mainly includes：1st, have
Passage (being extracted when starting point is detected) where electro-ocular signal；2nd, useful signal above the baseline or below；
3rd, the difference of useful signal takes absolute value the number of signal medium wave peak；4th, the difference of useful signal takes absolute value first in signal
The distance between with second crest；Use the corresponding feature of zero passage point analysis eye motion different with dynamic threshold identification.Institute
The bluetooth mouse control section use state machine stated controls the concrete operations of mouse, is easy to user's more this hair of portable use
It is bright, it is to avoid long-time eye motion and cause eye strain.
In modelled signal Acquisition Circuit, the electro-ocular signal acquisition channel of two-way independent reference, electrode riding position are used
As shown in figure 3, wherein position is that the electro-ocular signal being vertically oriented that the electrode at E1 and E2 is gathered (looks up, looks down, blinking
Eye), position is the electro-ocular signal (eye left, eye right) being horizontally oriented of the electrode collection at E3 and E4, the electricity of position E5
Pole be export driven-right-leg circuit collection common mode noise feedback to human body, for suppression common mode noise.
After collecting eye electricity data, original eye electricity data are stored in buff [p], a jump is carried out to original electro-ocular signal
Partite transport is calculated and takes its absolute value and data are stored in diffbuff [p]；Buff [p] is in this application for a length is 100
Array, p represents position, and buff [p] represents the data at the p of position；Diffbuff [p] is in this application for a length is 100
Array be used to depositing original electro-ocular signal through first-order difference computing and the data after taking its absolute value, p represents position, buff [p]
Represent the data deposited at the p of position.Specific electro-ocular signal treatment is comprised the following steps：
M1, starting point detection is carried out to electro-ocular signal, obtain useful signal；
Starting point is detected
Starting point detection is carried out to electro-ocular signal first, the corresponding electro-ocular signal starting position of eye motion is found out.To eye
Electric data carry out first-order difference computing and just can be without the concern for the drifts of electro-ocular signal baseline after taking absolute value, it is possible to use
Threshold detection method judges that threshold value find starting point, threshold value here is certain value set in advance, when eye electricity data are entered
Row first-order difference computing and when taking absolute value more than or equal to threshold value, then it represents that have found starting point, threshold value value in the application
It is 4000.To improve starting point detection efficiency, define one and include 5 windows of data, threshold value is carried out again after data are full 5
Compare.
As shown in figure 4, judge the electro-ocular signal for collecting, if having found starting point (okfind=1) and gather full N number of
Data (N is set to full 100 data of collection in the application, is expressed as datafull=1), then by okfind=0, allow LED
It is bright；Then judge whether one group of data of passage 1 (find1) exceed threshold value, if so, then passage 1 has useful signal (to be expressed as
Find1=1), and current location (usefulp=p) is recorded, whether continuation judges one group of data of passage 2 (find2) more than threshold
Value；If one group of data of passage 1 (find1) are not less than threshold value, the no useful signal (being expressed as find1=0) of passage 1, so
Judge whether one group of data of passage 2 exceed threshold value afterwards；When one group of data of passage 2 exceed threshold value, then passage 2 has useful signal
(being expressed as find2=1), and record current location (usefulp=p)；When one group of data of passage 2 are not less than threshold value, then lead to
Then road 1 judges that when having a value in find1 and find2 be 1 without useful signal (being expressed as find2=0), then into etc.
Full 50 data to be collected；If find1 is 0 with find2 values, collection electro-ocular signal is returned to；As okfind=1 and
When datafull=1 is invalid, continue to gather electro-ocular signal.
M2, extraction useful signal feature, mainly include：
A1, have electro-ocular signal where passage；
A2, useful signal above the baseline or below；
A3, the difference of useful signal take absolute value the number of signal medium wave peak；
A4, the difference of useful signal take absolute value in signal the distance between first and second crest；
M3, by zero passage point analysis, identify the eye motion eyed left or eye right or look down；According to useful signal
Difference take absolute value the number of signal medium wave peak and the difference of useful signal takes absolute value first and second ripple in signal
The distance between peak, identify look up or double blink eye motion.By in a certain distance, seeing that difference takes
The number of absolute value signal crest, if only two is to look up, four is double blink.
Zero passage point analysis described in step M3, specially：
After finding starting point, it is analyzed as one group with 50 eye electricity data, classification treatment is carried out to electro-ocular signal,
Identify different eye motions.First using zero passage point analysis identify useful signal above the baseline or below.Zero passage
Point analysis is to recognize different eye motions by judging the positive negative pulse stuffing signal of original eye electricity data, but because eye exists
Certain interference can be produced to signal, so not selecting real zero point for cut-point, but set the upper limit threshold during action
Value CP and lower threshold CN are identified, to obtain accuracy rate higher.Can be identified by zero passage point analysis eye left, to
The eye motion such as is seen, looks down in the right side, looks up and is specially with the identification of double blink：In a certain distance, see that difference takes
The number of absolute value signal crest, if only two is to look up, four is double blink.
Identify and eye left, eye right, looking down, looking up and double blink, as shown in figure 5, calculating respectively logical
The energy summation in road 1 (find1) and passage 2 (find2), is expressed as：EV、EH；Then EV, EH are taken absolute value, is represented
It is absEH, absEV；Then judge whether find1 and find2 is all 1, if so, then judging whether absEH is more than or equal to
AbsEV, works as absEH>Whether absEV, continuation judges EH less than CN, if being then identified as eyeing left, if EH is more than or equal to CN,
Then judge that whether EH, more than CP, if being then identified as eyeing right, is otherwise identified as no signal；When absEH is less than absEV, continue
Whether the crest number N1 of passage 1 is judged more than or equal to 4, if being then identified as the eye twice that blinks；Otherwise judge whether EV is less than
Whether CN, if being then identified as looking down, if EV is more than or equal to CN, judge EV more than CP, if being then identified as looking up,
Otherwise it is identified as no signal；
When find1 and find2 are not all 1, judge whether find2=1 and the crest number N2 of passage 2 is more than or equal to
2, if whether then continuing to judge absEH more than or equal to absEV, if whether then judging EH less than CN, if being then identified as
Eye left, if EH is more than or equal to CN, judge that whether EH, more than CP, if being then identified as eyeing right, is otherwise identified as without letter
Number；If absEH is less than absEV, no signal is identified as；
If find2=1 and N2 are invalid more than or equal to 2, judge whether find1 and N1 sets up more than or equal to 2, if
Whether whether it is then to judge N1 more than or equal to 4, if being then identified as the eye twice that blinks, EV is otherwise judged less than CN, if then knowing
Wei not look down, if EV is more than or equal to CN, judge that whether EV, more than CP, if being then identified as looking up, is otherwise identified as
No signal；When find1 and N1 is invalid more than or equal to 2, then no signal is identified as.
The number of signal medium wave peak is taken absolute value by the difference for recognizing useful signal and the difference of useful signal takes definitely
The distance between first and second crest looks up and double blink to distinguish in value signal.But due to shake etc.
Interference can cause the influence of burr and small spike, and the present invention judges whether peak value is virtual value using dynamic threshold.To sum up institute
State, all of eye motion is all identified.Dynamic threshold judges specific as shown in Figure 6：
Three positions of initialization, first position behind=current locations usefulp, second place mid=(starting point position
Put usefuls+1) %100, the 3rd position head=(usefuls+2) %100, the threshold value of the value peak=settings of crest
Gate, the value peak of maximum max=crests when initial in three positions；Below every time can be corresponding according to three positions
The maximum of data updates the value of max；
Then judge whether current channel is first passage, if then initializing i=0, whether then judge i less than 50,
If then from Jia 1, continuation judges that behind corresponding data buff [behind] in position are less than the corresponding data of position mid to i
Buff [mid], and the corresponding data buff [head] of position head more than buff [mid] whether simultaneously set up, if then after
It is continuous to judge buff [mid]>Whether peak sets up, if buff [mid]>Peak sets up, then continue to judge buff [mid]>Whether max
Set up, perform max=buff [mid], peak=max/5*2 if setting up, and crest number peak_num from Jia 1；If buff
[mid]>Max is invalid, then perform crest number peak_num and Jia 1 certainly；
If buff [mid]>Peak is invalid, then perform behind=mid, mid=head, head=(head+1) %
100, then proceed to judge i whether less than 50；
As buff [behind]<Buff [mid] and buff [hesd]>Set up when buff [mid] is different, then perform behind
Whether=mid, mid=head, head=(head+1) %100, then proceed to judge i less than 50；If i is more than or equal to 50,
Then return to crest number peak_num；If current channel is not first passage, second channel is carried out as first passage is same
Operation.
After identifying eye motion, the different mouse action of different eye motion correspondences is defined.The mouse that looks up is upward
It is mobile, to look down mouse and move down, the mouse that eyes left is moved to the left, and the mouse that eyes right moves right, double blink mouse
Mark stops mobile or is determination operation.
Based on the bluetooth mouse control section circuit of eye electricity data, as shown in figure 1, including：Can be according to electro-ocular signal feature
The master control that gather and amplify electro-ocular signal, the electro-ocular signal acquisition module of low noise, electro-ocular signal can be classified and recognized
Molding block, power module and bluetooth module, as shown in Figure 1.Described electro-ocular signal acquisition module includes that silver chlorate gathers electricity
Pole, preamplifier, integrator, second order Butterworth LPF and analog-digital converter；Main control module is mainly number
Word signal processor, power module is powered for whole system, and bluetooth module is connected with the equipment for carrying bluetooth and is assisted by bluetooth
View control bluetooth mouse is operated accordingly.
As shown in figure 1, the electro-ocular signal that two passage silver chlorate acquisition electrodes 101 will get is input to signal acquisition circuit
100 input；Pre-amplification circuit 102 in signal acquisition circuit 100 is realized amplifying electro-ocular signal, in right leg drive
110 suppression common mode noises, integrator 103 realizes the dc component in correction electro-ocular signal, second order Butterworth LPF
104 filter the high-frequency noise in electro-ocular signal.Electro-ocular signal after amplifying after filtering is converted to numeral through analog-digital converter 105
Signal, and digital signal processor 106 is sent into, so as to realize the Classification and Identification to electro-ocular signal and be converted into control command, connect
Bluetooth module 107 control command is sent in reception system 108, the manipulation to mouse, power supply mould are realized by control command
Block 109 is powered for whole system.Only (look up, look down, eye left, to the right by eye motion the invention enables user
See and blink) can just control mouse to realize different operations such that it is able to the patient for helping both arms to lack, as normal person
The operation such as surf the Net is carried out using electronic equipment.Circuit structure of the present invention is simple, and small volume is convenient for carrying, strong antijamming capability, energy
Enough it is widely used in the fields such as portable medical, patient in family monitoring.
Described silver chloride electrode 101 uses common silver chloride electrode；Described preamplifier 102 is input resistance high
Anti-, high cmrr, low noise high precision instrument operational amplifier, it is desirable to which common-mode rejection ratio is in more than 100dB multiplication factors
500 times are set to, such as AD8221；Described driven-right-leg circuit extracts common-mode noise from the input of instrument operational amplifier,
Reversely amplify and then export to human body with being carried out after buffering through penetrating, so as to realize the suppression of common-mode noise；Integrator 103 and two
Rank Butterworth LPF 104 is using high accuracy, low noise, such as amplifier chip of Low Drift Temperature, AD8639；Described product
The cut-off frequency for dividing device 103 to use is 0.07HZ, and the cut-off frequency that described second order Butterworth filter 104 is used is 20HZ
And it is 2 times that multiplication factor is set in second-order；Described analog-digital converter 105 is using the 16 A/D conversions of two-way high-speed synchronous
Device, such as ADS8354；Described main control module 106 is the dsp controller of high primary frequency 150MHZ；Described bluetooth module 107 is used
Be that the agreement of bluetooth 2.0 is communicated；Described power module 109,3.7V lithium batteries used herein are powered, and lead to
Cross power supply chip to be boosted and be depressured as whole system is powered, than if the power supply core for boosting 3.7V and being depressured
3.7V can be depressurized to 3.3V by piece TPS61222, and 3.7V can be boosted to 5V by TPS61222, and positive voltage is converted into negative
3.3V can be switched to -3.3V by the power supply chip that voltage is powered for amplifier chip, such as MAX660, and be digital signal processor
The power supply chip of power supply such as TMSF320 series DSPs processor power source special power supply chip TPS70151 provides 1.8V and 3.3V electricity
Pressure.Signal acquisition circuit common-mode rejection ratio of the invention is higher than 100dB, and multiplication factor is 1000 times, with a width of 0.07HZ~
20HZ。
The implementation process of mouse control：
As shown in Fig. 2 bluetooth mouse original state is S4 stops 202；When mouse is in halted state 202, eye is recognized
Portion action for it is upward when, mouse enter state S0 all the way up move 201, now when the eye motion for identifying for upwards, to
Under, to the left, to the right when mouse keep up mobile 201, only when the eye motion for identifying to blink twice, mouse enters
Halted state 202.When bluetooth mouse be in halted state 202, recognize eye motion for it is downward when, mouse enter state S1 mono-
Directly move down 203, now when the eye motion for identifying for upwards, downwards, to the left, to the right when mouse keep down movement
203, only when the eye motion for identifying to blink twice, mouse enters halted state 202.When mouse is in halted state
202, it is that mouse is moved to the left 204 always into state S2 when to the left to recognize eye motion, now when the eye for identifying is dynamic
As it is upward, downward, to the left, to the right when mouse keep being moved to the left 204, only when the eye motion for identifying to blink twice
When mouse enter halted state 202；When mouse is in halted state 202, it is that mouse enters shape when to the right to recognize eye motion
State S3 moves right 206 always, now when the eye motion for identifying for upwards, downwards, to the left, to the right when mouse keep to the right
Mobile 206, only when the eye motion for identifying to blink twice, mouse enters halted state 202；Stop when mouse is in
State 202, when recognizing eye motion to blink twice, mouse determines that 205, i.e. mouse are clicked on screen and carried out really into state S5
Fixed selection, now when the eye motion for identifying is upward, mouse enters state 201 all the way up, when the eye for identifying
Act for it is downward when, mouse enters downward state 203 always, when the eye motion for identifying for the left when, mouse enters always
State 204 to the left, when the eye motion for identifying for the right when, mouse enters always state 203 to the right, when the eye for identifying
Act during to blink twice, mouse state is also determination 205.
One of ordinary skill in the art will be appreciated that embodiment described here is to aid in reader and understands this hair
Bright principle, it should be understood that protection scope of the present invention is not limited to such especially statement and embodiment.For ability
For the technical staff in domain, the present invention can have various modifications and variations.It is all within the spirit and principles in the present invention, made
Any modification, equivalent substitution and improvements etc., should be included within scope of the presently claimed invention.
Claims (8)
1. electro-ocular signal processing method, it is characterised in that including：
M1, starting point detection is carried out to electro-ocular signal, obtain useful signal；
M2, extraction useful signal feature, mainly include：
A1, have electro-ocular signal where passage；
A2, useful signal above baseline or below；
A3, the difference of useful signal take absolute value the number of signal medium wave peak；
A4, the difference of useful signal take absolute value in signal the distance between first and second crest；
M3, by zero passage point analysis, identify the eye motion eyed left or eye right or look down；According to the difference of useful signal
The number of signal medium wave peak that point takes absolute value and the difference of useful signal take absolute value in signal first and second crest it
Between distance, identify look up or double blink eye motion.
2. electro-ocular signal processing method according to claim 1, it is characterised in that the step M1 is specially：To original
The eye electricity data of input carry out first-order difference budget and take absolute value, when threshold value of the absolute value more than or equal to setting, then
The corresponding electro-ocular signal starting position of eye motion is found in expression.
3. electro-ocular signal processing method according to claim 1, it is characterised in that the zero crossing analysis bag described in step S3
Include：Setting upper limit threshold CP and lower threshold CN.
4. electro-ocular signal processing method according to claim 3, it is characterised in that the step M3 specifically includes following point
Step：
M31, the energy summation of calculating first passage are EV, and the energy summation for calculating second channel is EH, and EV and EH are taken definitely
Value, is expressed as：absEV、absEH；
M32, when first passage and second channel have useful signal, perform step M35；Otherwise perform step M33；
M33, when second channel has the crest number N2 of useful signal and second channel to be set up more than or equal to 2 simultaneously, perform
Step M35；Otherwise perform step M34；
M34, when first passage has the crest number N1 of useful signal and first passage to be set up more than or equal to 2 simultaneously, perform
Step M38, is otherwise identified as no signal；
If M35, absEH≤absEV, step M36 is performed；Otherwise perform step M38；
If M36, EH<CN, is identified as eyeing left, and otherwise performs step M37；
If M37, EH>CP, is identified as eyeing right, and is otherwise identified as no signal；
If M38, N1≤4, double blink is identified as, otherwise perform step M39；
If M39, EV<CN, is identified as looking down, and otherwise performs step M310；
If M310, EV>CP, is identified as looking up, and is otherwise identified as no signal.
5. electro-ocular signal processing method according to claim 3, it is characterised in that the step S3 sentences according to dynamic threshold
The disconnected number for obtaining crest；Specifically include it is following step by step：
B1, initialization first position behind=current locations usefulp, second place mid=(initial point position usefuls+
1) %100, the 3rd position head=(initial point position usefuls+2) %100, and it is setting to initialize the value of crest peak
Threshold value gate, maximum max are the threshold value gate of setting, and the data amount check i of current channel is 0；
B2, work as i<When 50, i++ is performed, go to step B3, otherwise i performs step B8 more than or equal to 50；
B3, when the corresponding data buff [behind] of behind be less than the corresponding data buff [mid] of mid, it is corresponding with head
Data buff [head] is more than the corresponding data buff [mid] of mid, while performing step B4 when setting up；Otherwise perform step B7；
B4, judge the corresponding data buff [mid] of mid more than crest peak value, if set up, if set up if continue judge
The corresponding data buff [mid] of mid are more than maximum, if set up, and step B5 is performed if setting up；Otherwise perform step B6；
B5, the maximum max=buff [mid] for performing next iteration；The value peak=of the crest of next iteration this changes
The maximum max/5*2 in generation；
B6, execution crest number Jia 1 certainly, i.e. peak_num++；
B7, renewal behind, mid, head, specially：
The second place mid of the first position behind=current iterations of next iteration；
3rd position head of the second place mid=current iterations of next iteration；
The 3rd position head=(the 3rd position head+1 of current iteration) %100 of next iteration；
B8, return crest number.
6. the bluetooth mouse system for being controlled based on electro-ocular signal, it is characterised in that including：Electro-ocular signal acquisition module, master control mould
Block, power module, bluetooth module and right leg drive；The electro-ocular signal acquisition module is connected with main control module, for basis
Electro-ocular signal feature is gathered and amplifies electro-ocular signal, low noise；The power module is connected with main control module, for being eye telecommunications
Number acquisition module, main control module, bluetooth module are powered；The bluetooth module is connected with main control module, for being set with outside bluetooth
Standby connection, controls bluetooth mouse to be operated accordingly by Bluetooth protocol；The right leg drive and electro-ocular signal acquisition module
It is connected, right leg drive is used for suppression common mode noise.
The electro-ocular signal acquisition module includes：Silver chlorate acquisition electrode, pre-amplification circuit, integrator, second order Butterworth
Low pass filter, analog-digital converter；The silver chlorate acquisition electrode is connected with pre-amplification circuit, for gathering electro-ocular signal；
The pre-amplification circuit is used to be amplified electro-ocular signal treatment；The pre-amplification circuit is connected with integrator, described
Integrator is used to be corrected the flip-flop in the electro-ocular signal from pre-amplification circuit；The integrator and second order bar
Special Butterworth low pass filter is connected, during the second order Butterworth LPF is used to filter the electro-ocular signal from integrator
High-frequency noise；The analog-digital converter is connected with second order Butterworth LPF, and the analog-digital converter is used in the future
Data signal is converted into from the electro-ocular signal of second order Butterworth LPF；
The main control module is digital signal processor, for carrying out eye to the electro-ocular signal that electro-ocular signal acquisition module is exported
The classification of action and recognize and be converted into control command.
7. it is according to claim 6 based on electro-ocular signal control bluetooth mouse system, it is characterised in that the power supply mould
Block includes：Battery and power supply chip.
8. it is according to claim 7 based on electro-ocular signal control bluetooth mouse system, it is characterised in that the power supply core
Piece is used to that battery to be boosted and is depressured.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710012567.4A CN106775023B (en) | 2017-01-09 | 2017-01-09 | Eye electric signal acquisition method and Bluetooth mouse system based on eye electric signal control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710012567.4A CN106775023B (en) | 2017-01-09 | 2017-01-09 | Eye electric signal acquisition method and Bluetooth mouse system based on eye electric signal control |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106775023A true CN106775023A (en) | 2017-05-31 |
| CN106775023B CN106775023B (en) | 2023-07-18 |
Family
ID=58950308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710012567.4A Active CN106775023B (en) | 2017-01-09 | 2017-01-09 | Eye electric signal acquisition method and Bluetooth mouse system based on eye electric signal control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106775023B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107392156A (en) * | 2017-07-25 | 2017-11-24 | 北京七鑫易维信息技术有限公司 | A kind of gaze estimation method and device |
| CN109032347A (en) * | 2018-07-06 | 2018-12-18 | 昆明理工大学 | One kind controlling mouse calibration method based on electro-ocular signal |
| CN110123318A (en) * | 2019-04-18 | 2019-08-16 | 华南理工大学 | One kind sitting calibration method based on electro-ocular signal monitoring eyeball position |
| CN110275621A (en) * | 2019-06-26 | 2019-09-24 | 陕西科技大学 | Barrier movable platform is helped based on electro-ocular signal control |
| CN110441912A (en) * | 2019-08-27 | 2019-11-12 | 高维度（深圳）生物信息智能应用有限公司 | A kind of Portable glasses intelligent wearable device and its control method |
| WO2020019169A1 (en) * | 2018-07-24 | 2020-01-30 | 高维度（深圳）生物信息智能应用有限公司 | Electrooculogram signal processing circuit and electrooculogram-based human-computer interaction system |
| CN112057250A (en) * | 2020-09-21 | 2020-12-11 | 山西白求恩医院(山西医学科学院) | Intelligent eye-socket wheelchair and control method thereof |
| CN112190405A (en) * | 2020-10-14 | 2021-01-08 | 合肥工业大学 | Wheelchair control system and control method thereof |
| CN114970608A (en) * | 2022-05-06 | 2022-08-30 | 中国科学院自动化研究所 | Human-computer interaction method and system based on electro-oculogram signals |
| CN110441912B (en) * | 2019-08-27 | 2024-04-19 | 高维度（深圳）生物信息智能应用有限公司 | Portable glasses intelligent wearing equipment and control method thereof |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004021157A1 (en) * | 2002-09-02 | 2004-03-11 | University Of Ulster | Method and apparatus for generating control signals using electro-oculographic potentials |
| CN101598973A (en) * | 2009-06-26 | 2009-12-09 | 安徽大学 | Man-machine interactive system based on electro-ocular signal |
| CN101644952A (en) * | 2009-06-04 | 2010-02-10 | 浙江大学 | Portable wireless man-machine interactive system based on electro-oculogram signal |
| TW201028895A (en) * | 2009-01-23 | 2010-08-01 | Rui-Keng Chou | Electro-oculogram control system |
| JP2010205099A (en) * | 2009-03-05 | 2010-09-16 | Univ Of Miyazaki | Mouse cursor control system using ocular potential |
| CN102129307A (en) * | 2011-03-10 | 2011-07-20 | 电子科技大学 | Electro-oculogram signal-based computer input control method |
| CN103211594A (en) * | 2013-05-20 | 2013-07-24 | 西安电子科技大学 | Wireless electro-oculogram acquisition system |
| CN206370034U (en) * | 2017-01-09 | 2017-08-01 | 成都信息工程大学 | The bluetooth mouse system controlled based on electro-ocular signal |
| CN108524121A (en) * | 2018-04-04 | 2018-09-14 | 西安电子科技大学 | The intelligent wheel chair of screen is controlled based on eyeball |
| WO2020019169A1 (en) * | 2018-07-24 | 2020-01-30 | 高维度（深圳）生物信息智能应用有限公司 | Electrooculogram signal processing circuit and electrooculogram-based human-computer interaction system |
| CN110840666A (en) * | 2019-11-19 | 2020-02-28 | 华南理工大学 | Wheelchair mechanical arm integrated system based on electro-oculogram and machine vision and control method thereof |
| CN112764532A (en) * | 2020-12-31 | 2021-05-07 | 北京信息科技大学 | Keyboard and mouse control system and control method based on brain electricity, eye electricity and electricity combination |
-
2017
- 2017-01-09 CN CN201710012567.4A patent/CN106775023B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004021157A1 (en) * | 2002-09-02 | 2004-03-11 | University Of Ulster | Method and apparatus for generating control signals using electro-oculographic potentials |
| TW201028895A (en) * | 2009-01-23 | 2010-08-01 | Rui-Keng Chou | Electro-oculogram control system |
| JP2010205099A (en) * | 2009-03-05 | 2010-09-16 | Univ Of Miyazaki | Mouse cursor control system using ocular potential |
| CN101644952A (en) * | 2009-06-04 | 2010-02-10 | 浙江大学 | Portable wireless man-machine interactive system based on electro-oculogram signal |
| CN101598973A (en) * | 2009-06-26 | 2009-12-09 | 安徽大学 | Man-machine interactive system based on electro-ocular signal |
| CN102129307A (en) * | 2011-03-10 | 2011-07-20 | 电子科技大学 | Electro-oculogram signal-based computer input control method |
| CN103211594A (en) * | 2013-05-20 | 2013-07-24 | 西安电子科技大学 | Wireless electro-oculogram acquisition system |
| CN206370034U (en) * | 2017-01-09 | 2017-08-01 | 成都信息工程大学 | The bluetooth mouse system controlled based on electro-ocular signal |
| CN108524121A (en) * | 2018-04-04 | 2018-09-14 | 西安电子科技大学 | The intelligent wheel chair of screen is controlled based on eyeball |
| WO2020019169A1 (en) * | 2018-07-24 | 2020-01-30 | 高维度（深圳）生物信息智能应用有限公司 | Electrooculogram signal processing circuit and electrooculogram-based human-computer interaction system |
| CN110840666A (en) * | 2019-11-19 | 2020-02-28 | 华南理工大学 | Wheelchair mechanical arm integrated system based on electro-oculogram and machine vision and control method thereof |
| CN112764532A (en) * | 2020-12-31 | 2021-05-07 | 北京信息科技大学 | Keyboard and mouse control system and control method based on brain electricity, eye electricity and electricity combination |
Non-Patent Citations (5)
| Title |
|---|
| 吴明权;李海峰;马琳;: "单通道脑电信号中眼电干扰的自动分离方法" * |
| 王兆云: ""基于眼电信号的人机交互系统的设计与实现"" * |
| 许青;杨凡;陈卫东;张韶岷;代建华;郑筱祥;: "基于眼电技术的人机交互系统" * |
| 赵杰;李斌;: "眼电信号采集放大电路的设计与实现" * |
| 郜东瑞;甘玉龙;李鹏霄;谢佳欣;尧德中;刘铁军;: "基于眼电的智能输入系统研究" * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107392156A (en) * | 2017-07-25 | 2017-11-24 | 北京七鑫易维信息技术有限公司 | A kind of gaze estimation method and device |
| CN107392156B (en) * | 2017-07-25 | 2020-08-25 | 北京七鑫易维信息技术有限公司 | Sight estimation method and device |
| CN109032347A (en) * | 2018-07-06 | 2018-12-18 | 昆明理工大学 | One kind controlling mouse calibration method based on electro-ocular signal |
| WO2020019169A1 (en) * | 2018-07-24 | 2020-01-30 | 高维度（深圳）生物信息智能应用有限公司 | Electrooculogram signal processing circuit and electrooculogram-based human-computer interaction system |
| CN110123318A (en) * | 2019-04-18 | 2019-08-16 | 华南理工大学 | One kind sitting calibration method based on electro-ocular signal monitoring eyeball position |
| CN110123318B (en) * | 2019-04-18 | 2021-03-30 | 华南理工大学 | Method for monitoring eyeball position coordinates based on electro-oculogram signals |
| CN110275621A (en) * | 2019-06-26 | 2019-09-24 | 陕西科技大学 | Barrier movable platform is helped based on electro-ocular signal control |
| CN110441912A (en) * | 2019-08-27 | 2019-11-12 | 高维度（深圳）生物信息智能应用有限公司 | A kind of Portable glasses intelligent wearable device and its control method |
| CN110441912B (en) * | 2019-08-27 | 2024-04-19 | 高维度（深圳）生物信息智能应用有限公司 | Portable glasses intelligent wearing equipment and control method thereof |
| CN112057250A (en) * | 2020-09-21 | 2020-12-11 | 山西白求恩医院(山西医学科学院) | Intelligent eye-socket wheelchair and control method thereof |
| CN112190405A (en) * | 2020-10-14 | 2021-01-08 | 合肥工业大学 | Wheelchair control system and control method thereof |
| CN114970608A (en) * | 2022-05-06 | 2022-08-30 | 中国科学院自动化研究所 | Human-computer interaction method and system based on electro-oculogram signals |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106775023B (en) | 2023-07-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106775023A (en) | Electro-ocular signal acquisition method and the bluetooth mouse system based on electro-ocular signal control | |
| CN206370034U (en) | The bluetooth mouse system controlled based on electro-ocular signal | |
| CN105654037B (en) | A kind of electromyography signal gesture identification method based on deep learning and characteristic image | |
| CN101598973B (en) | Human-computer interaction system based on electro-ocular signal | |
| CN104123007B (en) | Multidimensional weighted 3D recognition method for dynamic gestures | |
| Li et al. | Automatic recognition of sign language subwords based on portable accelerometer and EMG sensors | |
| CN103400123A (en) | Gait type identification method based on three-axis acceleration sensor and neural network | |
| CN105708587B (en) | A kind of the lower limb exoskeleton training method and system of the triggering of Mental imagery pattern brain-computer interface | |
| CN105938399B (en) | The text input recognition methods of smart machine based on acoustics | |
| CN105769173A (en) | Electrocardiogram monitoring system with electrocardiosignal denoising function | |
| CN102499797B (en) | Artificial limb control method and system | |
| CN202288542U (en) | Artificial limb control device | |
| CN105956624A (en) | Motor imagery electroencephalogram classification method based on space-time-frequency optimization feature sparse representation | |
| CN107981997B (en) | A kind of method for controlling intelligent wheelchair and system based on human brain motion intention | |
| CN113205074B (en) | Gesture recognition method fusing multi-mode signals of myoelectricity and micro-inertia measurement unit | |
| CN110123314A (en) | Judge that brain is absorbed in the method for relaxation state based on EEG signals | |
| CN102715915A (en) | Portable heart sound automatic sorting assistant diagnostic apparatus | |
| CN106569606A (en) | Smart home infrared control system and smart home infrared control method based on natural gesture identification | |
| CN109359619A (en) | A kind of high density surface EMG Signal Decomposition Based method based on convolution blind source separating | |
| CN202041916U (en) | Sound control mouse | |
| CN101785659A (en) | Portable general biological signal acquisition and analysis system and method thereof | |
| CN105892676B (en) | Human-computer interaction device, system and method of wire feeding mechanism for vascular intervention operation | |
| CN106484082A (en) | One kind is based on bioelectric control method, device and controller | |
| CN101644952A (en) | Portable wireless man-machine interactive system based on electro-oculogram signal | |
| CN202794939U (en) | Wheelchair controller based on brain wave |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |