CN104516489A - Eye control mouse based on matlab - Google Patents
Eye control mouse based on matlab Download PDFInfo
- Publication number
- CN104516489A CN104516489A CN201310452420.9A CN201310452420A CN104516489A CN 104516489 A CN104516489 A CN 104516489A CN 201310452420 A CN201310452420 A CN 201310452420A CN 104516489 A CN104516489 A CN 104516489A
- Authority
- CN
- China
- Prior art keywords
- matlab
- mouse
- eye
- characteristic vectors
- benchmark
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Position Input By Displaying (AREA)
- Image Processing (AREA)
Abstract
The invention provides an eye control mouse; in time sequence, a system is divided into three stages of background processing, benchmark position initialization, and real-time control. The background processing stage implements binarization to a background image for being used in a differential process of the subsequent stages; the benchmark position initialization process uses methods, including differential projection, region segmentation, inner eye corner point operator, and the like, to locate pupil centers and inner eye corner coordinates, so as to generate benchmark characteristic vectors; the real-time control stage uses the same methods to obtain face characteristic vectors while the system is running in real time; and comparing the face characteristic vectors with the benchmark characteristic vectors to drive the mouse. The eye control mouse based on matlab is beneficial to the use requirements of special people, and can further be applied to medical and military fields. By using the matlab software programming process, the efficiency of algorithm execution is increased, and various capturing and processing schemes are attempted. The expected effect is substantially ideal. Comparing with the prior art, the eye control mouse based on matlab is more reasonable, more efficient, higher in precision, and wider in use crowd.
Description
Technical field
The present invention relates to a kind of eye-controlled mouse, specifically relates to a kind of eye-controlled mouse based on matlab.
Background technology
Human-computer interaction technology (HCI), refers to the communication between user and computer system, is the bi-directional exchanges of information of various symbol and action between people and computing machine.Human-computer interaction technology is a pith of information processing research field always, and the development of human-computer interaction technology will directly affect the development process of field of information processing in some sense.From the age sixties in last century so far, human-computer interaction technology is mainly gone up and experienced by three developing stage; One, 60 ~ seventies of last century---in the punching interface epoch, this man-machine interaction in period is exactly that toggle switch or defeated people one fold punched card as defeated people, to read the display of LED or to obtain a hard copy as output.
In 70 ~ eighties of last century---the command interface epoch, this epoch man-machine interaction is exactly concentrate on to be similar to the technical of typewriter; Three, the eighties is so far---graphical interfaces (GUI) epoch, man-machine interaction is exactly undertaken mutual by the graphical interfaces (using window, icon, mouse and popup menu) based on W1MP at that time, and desktop application becomes the dominant force of man-machine interaction.
Eye-controlled mouse is in visual channel typical apply of nature man-machine interaction, its object is to help and there is upper limbs action impedient people equality as normal person, naturally exchange with computing machine.The ultimate principle of eye-controlled mouse is exactly replace real mouse to control the movement of mouse point on computer display screen by our eye gaze.Eye-controlled mouse is expressed the thought of oneself easily except helping physical disabilities and controls the basis that surrounding environment can also become other embody rule many, such as: in military affairs, helmet-type alignment clamp on Muscovite " Soviet Union 27 " fighter plane, the helmet-type armament systems of U. S. Marine Corps are all based on eye-controlled mouse technology; On civilian, the Visual Trace Technology that eye-controlled mouse uses can also as checking whether driver occurs the detection means of fatigue phenomenon in driving; In some severe manufacturing environments or be not suitable for the occasion that people carries out operating, eye-controlled mouse technology can also free laborer from production scene, long-range production control process, avoids unnecessary casualties.
Summary of the invention
The object of the invention is to overcome deficiency of the prior art, provide a kind of eye-controlled mouse based on matlab.
In order to solve the problems of the technologies described above, the present invention is achieved through the following technical solutions:
Provide a kind of method of relative efficiency; Original technology be the eye-controlled mouse system of first published use the central point of Liang Ge eyeball pupil center line to align the pupil center's line central point in face image mutually displacement difference as parameter to generate mouse control information, its advantage is the blank tentatively achieving an Ore-controlling Role, but because system only uses the basis for estimation of change in displacement as mouse movement of pupil center's line center point coordinate, when changes in coordinates, we can not judge that this change is due to face twisting or because caused by face translation, causes the inconvenience of user.Then, the eye-controlled mouse system of the second edition revises original algorithm on the basis of first published, binaryzation model and lip color model is utilized to find the region meeting eye feature and lip feature at area of skin color respectively, find out Liang Ge pupil center's point of eyes and the central point of lip, connect this three central points, obtain face characteristic triangle.When utilizing real-time characteristic triangle parameter and initialization, normal condition parameter is made comparisons, and estimates the motion of face, comprises torsion, pitching etc., and then utilize these information mouse beacons.The system of the second edition positions owing to employing feature triangle, overcomes the defect that original system can not distinguish face twisting gesture and face's translation gesture, but the also accurate not problem of existing characteristics point location.In order to solve the problems of the technologies described above, the present invention is achieved through the following technical solutions: at present, and the eye-controlled mouse system of the third edition is carried out the operation such as region segmentation and centroid algorithm to the ocular of coarse positioning and tried to achieve pupil center's point coordinate on the basis of second edition system.This method substantially increases the accuracy rate of location pupil center.In addition, system also utilizes inner eye corner operator accurately to locate the inner eye corner of user, utilizes the Coordinate generation mouse control information of inner eye corner and pupil center.First and second edition system feature before third edition system overcomes
The problem that positioning precision is not high, but it is comparatively large also to there is calculated amount, there is the comparatively shortcoming such as big error in concrete control mode (as the left click of torticollis mouse beacon).
Compared with prior art, the invention has the beneficial effects as follows:
The system resources consumption of PC is less.The computation process of complexity is transplanted in embedded system by native system, utilizes the streamline mechanism of multiple nucleus system to calculate, and PC end only carries out mouse control operation, and used resource greatly reduces.Existing algorithm improves operation efficiency for the optimization of hardware.Native system, when carrying out algorithm and transplanting, uses the method for the former table of multiplication and floating-point operation fixed point to be optimized, and greatly improves the arithmetic speed of algorithm at embedded platform.System have employed the multi-core parallel concurrent Treatment Design thinking of multiprocessor.Synchronization, multiple processor processes respective calculation task respectively.The changeable multiple bus of the design to system has carried out hardware design.The sharpest edges of this changeable multiple bus task to be calculated are fixed in a storer process, and avoids data transmission repeatedly between storer, greatly save system operation time.
Accompanying drawing explanation
Fig. 1 is eye-controlled mouse system flowchart.
Embodiment
Below in conjunction with accompanying drawing and embodiment, the present invention is described in further detail:
Four main modular that third edition system can be divided into by function, as shown in Figure 1: wherein, video acquisition module mainly uses camera to be responsible for carrying out image collection work; The major function of Computer Vision module carries out color space conversion and skin color segmentation to the cromogram collected, generate corresponding colour of skin binary map and gray-scale map, then difference operation is carried out to colour of skin binary map and background binary figure, obtain facial image, finally carrying out pre-service to facial image (comprises level and smooth, expand, the operations such as corrosion); Extract facial feature and tracking module mainly carry out a series of process to each width facial image acquired and (comprise Gray Projection, integration difference projection and centroid algorithm etc.), finally obtain pupil of both eyes center and the inner eye corner coordinate of every piece image; Direction of visual lines judgement and mouse control module in charge are real-time pupil of both eyes center and inner eye corner Coordinate generation mouse control vector, and compare with initial characteristics vector, obtain the change in location information of face, and this information is stored in mouse action message queue as mouse action instruction, thus play the effect of mouse beacon.
The undeclared part related in the present invention is same as the prior art or adopt prior art to be realized.
Claims (3)
1. based on an eye-controlled mouse of matlab, comprise the process to cursor of mouse and control, it is characterized in that: described human-computer interaction technology makes user and mobile terminal not contact the control that just can realize mouse; The specific implementation of the inside leans on the programmed algorithm of matlab to realize.
2. matlab algorithm routine according to claim 1, is characterized in that: described matlab can reduce workload, increases work efficiency, this program is made to have more ubiquity, describedly optimize data processing algorithm, reduce and postpone, improve and leave locating speed and precision.
3. human-computer interaction technology according to claim 1: described eye-controlled mouse is characterized in that being exactly the typical apply of natural human-machine interaction in visual channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310452420.9A CN104516489A (en) | 2013-09-28 | 2013-09-28 | Eye control mouse based on matlab |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310452420.9A CN104516489A (en) | 2013-09-28 | 2013-09-28 | Eye control mouse based on matlab |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104516489A true CN104516489A (en) | 2015-04-15 |
Family
ID=52791941
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310452420.9A Pending CN104516489A (en) | 2013-09-28 | 2013-09-28 | Eye control mouse based on matlab |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104516489A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105511618A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | 3D input device, head-mounted device and 3D input method |
| CN108717527A (en) * | 2018-05-15 | 2018-10-30 | 重庆邮电大学 | Face alignment method based on posture priori |
| US10666859B2 (en) | 2018-04-13 | 2020-05-26 | Boe Technology Group Co., Ltd. | Self-photographing control method and device, and electronic device |
-
2013
- 2013-09-28 CN CN201310452420.9A patent/CN104516489A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105511618A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | 3D input device, head-mounted device and 3D input method |
| US10666859B2 (en) | 2018-04-13 | 2020-05-26 | Boe Technology Group Co., Ltd. | Self-photographing control method and device, and electronic device |
| CN108717527A (en) * | 2018-05-15 | 2018-10-30 | 重庆邮电大学 | Face alignment method based on posture priori |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Argyros et al. | Vision-based interpretation of hand gestures for remote control of a computer mouse | |
| CN1304931C (en) | Head carried stereo vision hand gesture identifying device | |
| CN104808788A (en) | Method for controlling user interfaces through non-contact gestures | |
| Konda et al. | Real time interaction with mobile robots using hand gestures | |
| CN104407694A (en) | Man-machine interaction method and device combining human face and gesture control | |
| CN104317391A (en) | Stereoscopic vision-based three-dimensional palm posture recognition interactive method and system | |
| Fang et al. | Head-mounted display augmented reality in manufacturing: A systematic review | |
| CN107357428A (en) | Man-machine interaction method and device based on gesture identification, system | |
| CN104331158A (en) | Gesture-controlled human-computer interaction method and device | |
| CN102981742A (en) | Gesture interaction system based on computer visions | |
| CN111914629A (en) | Method, apparatus, device and storage medium for generating training data for face recognition | |
| WO2021232827A1 (en) | Method and apparatus for controlling video playing, and electronic device and storage medium | |
| CN113505694B (en) | Man-machine interaction method and device based on sight tracking and computer equipment | |
| CN104516489A (en) | Eye control mouse based on matlab | |
| JP2021114313A (en) | Face composite image detecting method, face composite image detector, electronic apparatus, storage medium and computer program | |
| CN111832648A (en) | Key point marking method and device, electronic equipment and storage medium | |
| CN108052901B (en) | Binocular-based gesture recognition intelligent unmanned aerial vehicle remote control method | |
| CN111862031A (en) | Face synthetic image detection method and device, electronic equipment and storage medium | |
| CN112200169B (en) | Method, apparatus, device and storage medium for training a model | |
| CN211293894U (en) | Hand-written interaction device in air | |
| CN106547339B (en) | Control method and device of computer equipment | |
| CN105320250A (en) | Eye-controlled mouse based on somatosensory | |
| Kim et al. | Visual multi-touch air interface for barehanded users by skeleton models of hand regions | |
| Thomas et al. | A comprehensive review on vision based hand gesture recognition technology | |
| Jiang et al. | A brief analysis of gesture recognition in VR |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150415 |