Summary of the invention
(1) goal of the invention: it is an object of the invention to provide that one eye is dynamic, head dynamic and agomphiasis realizes institute
Depending on being the cursor control method controlled, i.e. dynamic for eye identification, the dynamic identification of head and agomphiasis percussion identification are carried out by one
The head-wearing device that hommization is integrated;Utilize man day raw natural head eye shallow consciousness synergy movement behavior, based on right
Target error the caused subconsciousness feedback head body pose compensation behavior act of visual psychology, by the behavior heart
Reason compensatory movement identification and the application of Kalman filtering, set up a pullover dynamic eye and move cursor control program step,
Realize head eye cursor control method the most easily.
(2) technical scheme:
The cursor control method of a kind of head-wearing device, comprises the following steps:
Step A, headwork process sensor and the head checked moves data are mapped as head and move two-dimensional coordinate displacement
And it is sent to microprocessor;Meanwhile, the eye movement data checked is mapped as eye dynamic two dimension seat by described eye tracker
Marker displacement is also sent to described microprocessor;
Step B, described microprocessor head is moved two-dimensional coordinate displacement and eye to move two-dimensional coordinate displacement superposed for cursor
The two-dimensional coordinate of movement;
Step C, described microprocessor perform, by sound recognition module, the click thing that bone-conduction microphone sends
Part, the two-dimensional coordinate that the event that will click on moves with cursor exports together.
The cursor control method of described head-wearing device, wherein: in described step A, headwork processes sensor
Head moves data be mapped as head and move the process of two-dimensional coordinate displacement, specifically includes following steps:
Motion tracker real-time data collection is optimized to obtain the most dynamic data by A-h1, headwork sensor,
And head is moved data pass to attitude computing module;
Head is moved the angular velocity in data by A-h2, described attitude computing module and acceleration carry out shaking thresholding and
Weighted fusion algorithm algorithm, obtains optimum attitude data, and optimum attitude data are passed to described head moves plane
Map checking module;
A-h3, described head move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Optimum attitude data are mapped as head and move two-dimensional coordinate parameter, and the head of mapping is moved the transmission of two-dimensional coordinate parameter
To the psychological behaviors compensating module of described microprocessor;
Head is moved the head of Planar Mapping checking module mapping and moves two-dimensional coordinate parameter by described psychological behaviors compensating module
It is modified, and correction value is fed back to described head moves Planar Mapping checking module;Described head moves Planar Mapping
The corrected value that checking module feeds back according to described psychological behaviors compensating module is corrected, and by the head after correction
Dynamic two-dimensional coordinate parameter is passed to an eye movement and is worked in coordination with superposition calculation module.
The cursor control method of described head-wearing device, wherein: described in described step A, eye tracker will check
Eye movement data be mapped as eye and move the process of two-dimensional coordinate displacement, specifically include following steps:
A-e1, eye move identification module and gather eye movement data, and the eye movement data of collection is transferred to filter tracking
Module;
A-e2, described filter tracking module obtain the pupil heart and corneal reflection by characteristics of image filtering, pass through
Noise reduction and temporal tracking filtering obtain the pupil heart and follow the tracks of data;And pupil heart tracking data are passed to assignment smooth adjustment
Module;
A-e3, described assignment smooth smothing filtering value and noise reduction function that adjustment module set by user and carry out
Adjustment, and the pupil heart after adjustment is followed the tracks of data pass to eye and move Planar Mapping checking module;
A-e4, described eye move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Described pupil heart tracking data are mapped, and the pupil heart tracking data of mapping are sent to described psychological behaviors
Compensating module;The pupil heart of mapping is followed the tracks of data and is modified by described psychological behaviors compensating module, and will revise
Value of feedback be sent to described eye and move Planar Mapping checking module;
Described eye moves Planar Mapping checking module to be carried out the pupil heart tracking data of mapping according to the correction value of feedback
Correction, and corrected value is sent to described head eye movement works in coordination with superposition calculation module.
The cursor control method of described head-wearing device, wherein, the side of described psychological behaviors compensating module correction
Method comprises the following steps:
Described psychological behaviors compensating module: by screen center's normal direction line, customer location, screen center's point, head
Dynamic horizontal plane central point, eye move central point as fixed reference, then head moves eye moving axes displacement move with head eye
Make feature database contrast and find out difference.
The cursor control method of described head-wearing device, wherein: described head moves eye moving axes displacement and moves with head eye
The contrast making feature database includes: the tracking psychic feedback that contrast sensation target deviates from causes a body pose compensation
Action obtains error amount, the error amount of each margin of error calculation by mean square error recurrence estimation during deviating from
Method corrects.
The cursor control method of described head-wearing device, wherein: described step B specifically includes following steps:
The head eye movement of microprocessor is worked in coordination with superposition calculation module and the head of optimization is moved data and eye movement data is carried out
Dynamic proportion superposition, makes light be marked in different quadrant different motion pattern and uses different superposition ratio, and accompany
For psychological compensation module dynamic corrections.
The cursor control method of described head-wearing device, wherein:
In described step C, the click eventing step sent of microprocessor execution bone-conduction microphone is:
The most described bone-conduction microphone is close to above forehead, and the data gathering teeth cavity signal are passed to micro-place
The sound recognition module of reason device;
The most described sound recognition module draws the intent instructions of user by the contrast of bone conduction waveform characterization libraries, concurrently
Go out cursor click event command and send gesture execution module to;
C3. gesture execution module will click on event and exports together with cursor coordinates.
The cursor control method of described head-wearing device, wherein: described gesture performs module and will click on thing
The output of part includes performing gesture, and is sent by the first wireless transport module by gesture.
The cursor control method of described head-wearing device, wherein: send cursor by the first wireless transmission unit
Control instruction controls other computer terminal, and when its computer terminal uses fixed terminal display, needs user
And eye dynamic carry out terminal display correct dynamic respectively in the position that two or more is different looks at characteristic point interaction school straight
Right, the geometric maps adjustment parameter obtained and screen distance information.
The cursor control method of described head-wearing device, wherein: described motion tracker include three-axis gyroscope,
Three axis accelerometer and three axle magnetic strength instrument.
(3) beneficial effect: the cursor control method of a kind of head-wearing device of the present invention, utilizes the man day to be conigenous so
The shallow consciousness synergy movement behavior of head eye, dynamic by eye, head dynamic and the sampling identification of agomphiasis percussion carries out mouse
Control, it is achieved body-worn smart machine has accomplished to realize the most directly and accurately expression while liberation both hands
Mode is depending on i.e. being controlled, and the operation light actuating quantity of nature is little, and reducing the consumption of muscle power energy in operation has
Encourage time operation and help people with disability to use.
Detailed description of the invention
Below in conjunction with preferred embodiment, the present invention is described in further details.
A kind of head-wearing device that the present invention provides, as it is shown in figure 1, include headwork sensor, bone conduction
Mike and eye tracker, described headwork sensor, bone-conduction microphone and eye tracker connect micro-place respectively
Reason device, described microprocessor connects the first wireless transport module.
Described headwork sensor comprises motion tracker, described motion tracker include three-axis gyroscope,
Three axis accelerometer and three axle magnetic strength instrument, for gathering the motion of user's head.
Described microprocessor includes that superposition calculation module, cursor are worked in coordination with in psychological behaviors compensating module, head eye movement
Instruction performs module, sound recognition module, head eye motion characteristic storehouse, bone conduction waveform characterization libraries and gesture
Perform module.
Described headwork sensor, moves Planar Mapping school including motion tracker, attitude computing module and head
To module.
Described eye tracker includes that eye moves identification module, filter tracking module, assignment smooths adjustment module and eye moves
Planar Mapping checking module.
Described head-wearing device utilizes headwork sensor, eye tracker, bone-conduction microphone and microprocessor fortune
The cursor control method that the pullover dynamic eye of row one is dynamic, can move data and eye by the head that described action sensor obtains
The eye movement data that dynamic instrument obtains obtains cursor displacement, bone-conduction microphone pickup tooth sound by superposition calculation
Judge to draw cursor acknowledgement key action, then cursor information is reflected in head-mounted display, or by the
One other terminal of wireless transport module controlled in wireless.Such as, wearing sensor described in can be wireless by first
Cursor control information is sent to the second wireless transport module of computer terminal, described computer terminal by transport module
Cursor control information is sent on terminal display display.
The method that described headwork sensor and eye tracker carry out cursor control, as in figure 2 it is shown, specifically include
Following steps:
Step A, described headwork process sensor and the head checked moves data are mapped as head and move two-dimensional coordinate
Displacement is also sent to described microprocessor;Meanwhile, the eye movement data checked is mapped as eye by described eye tracker
Dynamic two-dimensional coordinate displacement is also sent to described microprocessor.
Step B, described microprocessor head is moved two-dimensional coordinate displacement and eye to move two-dimensional coordinate displacement superposed for cursor
The two-dimensional coordinate of movement, and move two-dimensional coordinate displacement to head and eye moves two-dimensional coordinate Displacement Feedback correction value simultaneously.
Step C, described microprocessor monitors, and perform bone-conduction microphone by described sound recognition module
The click event sent, the two-dimensional coordinate that the event that will click on moves with cursor exports the most immediately, performs cursor
Instruct or gesture is sent to other-end by described first wireless transport module.
The cursor control method of head-wearing device of the present invention, in described step A, headwork processes sensor
Head moves data be mapped as head and move the process of two-dimensional coordinate displacement, specifically includes following steps:
Motion tracker real-time data collection is optimized the most dynamic by A-h1, described headwork sensor
Data, and head is moved data pass to described attitude computing module.
Head is moved the angular velocity in data by A-h2, described attitude computing module and acceleration carry out shaking thresholding and
Weighted fusion algorithm algorithm, obtains optimum attitude data, and optimum attitude data are passed to described head moves plane
Map checking module.
A-h3, described head move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Optimum attitude data are mapped as head and move two-dimensional coordinate parameter, and the head of mapping is moved the transmission of two-dimensional coordinate parameter
To the psychological behaviors compensating module of described microprocessor.
Head is moved the head of Planar Mapping checking module mapping and moves two-dimensional coordinate parameter by described psychological behaviors compensating module
It is modified, and correction value is fed back to described head moves Planar Mapping checking module;Described head moves Planar Mapping
The corrected value that checking module feeds back according to described psychological behaviors compensating module is corrected, and by the head after correction
Dynamic two-dimensional coordinate parameter is passed to an eye movement and is worked in coordination with superposition calculation module.
The eye movement data checked is mapped as eye and moves two-dimensional coordinate displacement by eye tracker described in described step A
Process, specifically includes following steps:
A-e1, described eye move identification module and gather eye movement data, and eye is moved identification module collection by described eye tracker
Eye movement data be transferred to described filter tracking module.
A-e2, described filter tracking module obtain the pupil heart and corneal reflection by characteristics of image filtering, pass through
Noise reduction and temporal tracking filtering obtain the pupil heart and follow the tracks of data;And pupil heart tracking data are passed to described assignment smooth
Adjustment module.
A-e3, described assignment smooth smothing filtering value and noise reduction function that adjustment module set by user and carry out
Adjustment, and the pupil heart after adjustment is followed the tracks of data pass to described eye and move Planar Mapping checking module.
A-e4, described eye move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Described pupil heart tracking data are mapped, and the pupil heart tracking data of mapping are sent to described psychological behaviors
Compensating module;The pupil heart of mapping is followed the tracks of data and is modified by described psychological behaviors compensating module, and will revise
Value of feedback be sent to described eye and move Planar Mapping checking module.
Described eye moves Planar Mapping checking module to be carried out the pupil heart tracking data of mapping according to the correction value of feedback
Correction, and corrected value is sent to described head eye movement works in coordination with superposition calculation module.
Described psychological behaviors compensating module: by screen center's normal direction line, customer location, screen center's point, head
Dynamic horizontal plane central point, eye move central point as fixed reference, then head moves eye moving axes displacement move with head eye
Make feature database contrast and find out difference.
Described head moves the contrast in eye moving axes displacement and head eye motion characteristic storehouse and includes: contrast sensation target deviates from
Follow the trail of psychic feedback cause an action for body pose compensation, such as head move short distance repeatedly come and go, head move eye move
The improper analysis deviating from action etc. identifies the error amount obtained, the error amount of each margin of error during deviating from
Corrected by the algorithm of a set of mean square error recurrence estimation, and particular weights error correction values feedback is moved to the end
Planar Mapping checking module and eye move correction cursor movement error in Planar Mapping checking module, give head simultaneously
Superposition calculation module dynamic proportion superposition value is worked in coordination with in eye movement.
The core of described psychological behaviors compensating module is based on the caused subconsciousness of target error to visual psychology
Feedback head body pose compensation behavior act, by answering psychological behaviors compensatory movement identification and Kalman filtering
With.
In step B of the present invention, head is moved described microprocessor two-dimensional coordinate displacement and eye moves two-dimensional coordinate
The step of the displacement superposed two-dimensional coordinate moved for cursor is specific as follows:
Described head eye movement work in coordination with superposition calculation module the head of optimization is moved data and eye movement data dynamically than
Example superposition, the dynamic superposition ratio i.e. using psychological behaviors compensating module to provide, make light be marked on different quadrant not
With motor pattern uses different superposition ratio, and with behavior psychological compensation module dynamic corrections;Also may be used simultaneously
To be selected single to use head to move data or eye movement data to drive cursor by user.
In described step C, the click eventing step sent of microprocessor execution bone-conduction microphone is:
The most described bone-conduction microphone is close to above forehead, and the data gathering teeth cavity signal are passed to micro-place
The sound recognition module of reason device.
The most described sound recognition module draws the intent instructions of user by the contrast of bone conduction waveform characterization libraries, concurrently
Go out cursor click event command and send gesture execution module to.
C3. gesture execution module will click on event and the most immediately exports with cursor coordinates, can perform light
Mark instruction, it is also possible to gesture is sent by the first wireless transport module of telling a story.
The present invention is unable to escape meter Da Si contact problems in order to avoid eye moves cursor from sending instructions, and adds bone conduction wheat
Gram wind identifies teeth cavity and the sound of tooth conduction, if the knock of dental articulation be " left button is clicked ", " is engaged
+ occlusion " it is " left double click ", the sound of " bullet tongue " is " right button ", " playing tongue+conjunction tooth ", " conjunction tooth+
Play tongue+conjunction tooth " ... it is equal to the instruction of corresponding mouse control and combines.Due to agomphiasis be the initial demand of the mankind really
Recognize action, meet the nature of people.
The head-wearing device that the present invention provides sends cursor control instruction by the first wireless transmission unit and controls other
Computer terminal, and when other computer terminal uses fixed terminal display, need user different in two or more
Position correct dynamic respectively and eye is dynamic carries out terminal display direct-view characteristic point interaction check and correction, as it is shown on figure 3,
The geometric maps adjustment parameter obtained and screen distance information, in order to after head moves, pass through motion tracker
Follow the tracks of displacement, and variable parameter when being calculated new position, to ensure the accuracy of cursor action.
The head-wearing device that the present invention provides can provide one eye to move, head is dynamic and agomphiasis realizes depending on i.e. being controlled
Cursor control method, i.e. a kind of by dynamic for eye identifying, head dynamic identify and agomphiasis percussion identification to carry out hommization whole
The head-wearing device closed;Utilize man day raw natural head eye shallow consciousness synergy movement behavior, based on to visual psychology
Target error caused subconsciousness feedback head body pose compensation behavior act, by psychological behaviors is compensated dynamic
Make to identify and the application of Kalman filtering, set up a pullover dynamic eye and move cursor control program step, it is achieved head eye
Cursor control method the most easily.
A kind of head-wearing device of the present invention and the cursor control method of head-wearing device, utilize man day raw natural head eye
Shallow consciousness synergy movement behavior, head dynamic by eye moves and the sampling identification of agomphiasis percussion carries out mouse control,
Realize body-worn smart machine and accomplish to realize the most directly and accurately expression way while liberation both hands
Depending on i.e. being controlled, the operation light actuating quantity of nature is little, when in minimizing operation, the consumption of muscle power energy has growth encourage
Between operate and help people with disability to use.
Above content is the explanation to a preferred embodiment of the present invention, can help those skilled in the art more
It is completely understood by technical scheme.But, these embodiments are merely illustrative, it is impossible to assert
The detailed description of the invention of the present invention is only limitted to the explanation of these embodiments.General to the technical field of the invention
For logical technical staff, without departing from the inventive concept of the premise, it is also possible to make some simple deductions and
Conversion, all should be considered as belonging to protection scope of the present invention.