CN103677247A - Method for virtual mouse clicking - Google Patents
Method for virtual mouse clicking Download PDFInfo
- Publication number
- CN103677247A CN103677247A CN201210554369.8A CN201210554369A CN103677247A CN 103677247 A CN103677247 A CN 103677247A CN 201210554369 A CN201210554369 A CN 201210554369A CN 103677247 A CN103677247 A CN 103677247A
- Authority
- CN
- China
- Prior art keywords
- eyes
- user
- primary standard
- marker
- standard substance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a method for virtual mouse clicking. The method comprises the steps: (1) markers and a primary standard object are arranged on the eyelids of a user, wherein the markers move vertically along with opening and closing of the eyes, and the primary standard object is arranged below the eyes of the user, and a camera is arranged on an applying electrical device; (2) images of primary standard states such as the opening state of the two eyes, the closing state of the two eyes, the closing state of the left eye and the closing state of the right eye are shot, and the gap between each marker and the primary standard object is calculated; (3) the gap between the markers in the real-time images and the primary standard object is calculated, and the gap and data in the primary standard images are compared; (4) when the two eyes are identified to be opened or closed, it is judged that no instruction is input, when the closing state of the left eye is identified, it is judged that one time of mouse operation left key clicking instruction is input, and when the closing state of the right eye is identified, it is judged that one time of mouse operation left key clicking instruction is input. The method has the advantages of being simplified, accurate and fast.
Description
Technical field
The invention belongs to pseudo operation technical field, relate to a kind of method that virtual mouse is clicked.
Background technology
Development along with infotech, computer is more and more universal, mouse is as indispensable parts of computer, also along with computer has entered huge numbers of families, but the use of conventional mouse also brings many difficult problems, first conventional mouse is Activities Design based on hand, obviously like this makes the people that those cannot movable hand cannot valid function mouse, thereby cannot valid function computer.In addition, medical circle is also verified, uses for a long time conventional mouse, can cause physical property injury to people's wrist muscle, gently produces provisional ache, heavy cause the muscle disease that is difficult to for a long time healing.
Publication number is the Chinese patent of CN1889016A, a kind of eyes are disclosed to computer cursor automatic positioning method and system, its principle is: the eyes image when taking respectively user and watch four angles of computer monitor attentively with camera, image conversion is become to gray scale array, to array dynamic process, average value processing Xuan Qi center is carried out in maximum effective coverage in remaining value, calculate the eyeball center of every width image, according to the part attribute of these four some eyeball centers and system demonstration, set up model; Obtain after the full figure coordinate of four some correspondences, according to 4, calculate wherein heart position M; Set up quadrilateral with 4, then be rectangle by quadrangle modification, calculate the length of rectangle and wide, and be divided by with the length and width of display, calculate respectively ratio KW and KH, the ratio obtaining is for determining the relation of the cursor correspondence position of eyeball position and monitor.The method that this virtual mouse is controlled is comparatively numerous and diverse, and easily maloperation, and improvements are needed in upper existence badly.
Summary of the invention
The object of this invention is to provide a kind ofly comparatively simplify, virtual mouse is clicked accurately method.
The technical scheme that realizes the object of the invention is: a kind of method that virtual mouse is clicked, comprises the following steps:
1. on user's upper eyelid, arrange along with eyes open and close and the marker that moves up and down and be arranged on the primary standard substance below user's eyes; Answering setting on electrical appliance can photograph user's eyes, and the marker of each upper and lower both sides of eyes and the camera of primary standard substance;
2. utilize camera to take the following status image of user as normal condition image: eyes are opened state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker of each upper and lower both sides of eyes and primary standard substance, calculates the marker of each upper and lower both sides of eyes in each normal condition image and the spacing between primary standard substance, and deposits in storage unit;
3. when the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to the default speed of taking pictures, by calculating the marker of each upper and lower both sides of eyes in each realtime graphic and the spacing between primary standard substance, and with storage unit in data in each benchmark image of storing contrast, thereby identify user's eyes in which kind of state;
4. when identifying user, in eyes, open or when eyes are closed, be considered as inputting without instruction; When identifying user in the simple eye closure state of left eye, be considered as inputting primary mouse left button click commands, when identifying user in the simple eye closure state of right eye, be considered as inputting primary mouse and click instruction by right key.
The inventive method can be taken user's eyes area image frame by frame by camera, according to the spacing size between marker and a corresponding primary standard substance, identifying each eye is in opening or closed state, thereby which kind of instruction judgement user wants to send, realize and replace the manual operations that left mouse button is double-clicked and right button is double-clicked; Owing to monitoring and identifying, the switching of eyes is comparatively easy, thus with in conventional art, by monitoring eye movement, realize virtual mouse and control and compare, have comparatively simplify, advantage precisely and fast.
Embodiment
(embodiment 1)
The present embodiment is a kind of method that virtual mouse is clicked, and comprises the following steps:
1. on user's upper eyelid, arrange along with eyes open and close and the marker 1 that moves up and down and be arranged on the primary standard substance 2 below user's eyes; Answering setting on electrical appliance can photograph user's eyes, and the marker 1 of each upper and lower both sides of eyes and the camera of primary standard substance 2;
Described marker can be the regular shape coating being coated on upper eyelid, and for example colored horizontal line shape or mottled coating, can be also reflective sticker or the diffuse reflection paster of pasting on upper eyelid; Described primary standard substance can be also coating or reflective sticker or diffuse reflection paster; So long as and periphery yellowish pink and hair color to have the material of obvious difference all right.
Described primary standard substance is the static eyes below that is arranged on preferably.
2. utilize camera to take the following status image of user as normal condition image: eyes are opened state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker 1 and primary standard substance 2 of each upper and lower both sides of eyes, calculates the marker 1 of each upper and lower both sides of eyes in each normal condition image and the spacing between primary standard substance 2, and deposits in storage unit;
This is to be not quite similar due to position that each user pasted or applied marker and primary standard substance separately, so after being preferably in and having pasted marker and primary standard substance, take lower each normal condition image, so that as judgement more accurately;
A kind of concrete grammar of identifying spacing is: the image of four kinds of normal conditions that photograph is changed into gray scale array, also can directly change into 256 look formula arrays, marker and primary standard substance have obvious difference with periphery yellowish pink and hair color, so marker and primary standard substance all have significant array separately, and can judge corresponding marker and the primary standard substance spacing between upper and lower, and then judge that by identification spacing these place eyes are opened or closure;
3. when the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to the default speed of taking pictures, by calculating the marker 1 of each upper and lower both sides of eyes in each realtime graphic and the spacing between primary standard substance 2, and with storage unit in data in each benchmark image of storing contrast, thereby identify user's eyes in which kind of state;
4. when identifying user, in eyes, open or when eyes are closed, be considered as inputting without instruction; When identifying user in the simple eye closure state of left eye, be considered as inputting primary mouse left button click commands, when identifying user in the simple eye closure state of right eye, be considered as inputting primary mouse and click instruction by right key.
In addition, when in a certain Preset Time, for example, in 0.2 second, identify the more than twice simple eye closure state of left eye, be considered as inputting a mouse control left button and double-click instruction.When in a certain Preset Time, for example, in 0.2 second, identify the more than twice simple eye closure state of right eye, be considered as inputting a mouse control right button and double-click instruction.
Obviously, the above embodiment of the present invention is only for example of the present invention is clearly described, and is not the restriction to embodiments of the present invention.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here exhaustive without also giving all embodiments.And these belong to apparent variation or the change that connotation of the present invention extends out and still belong to protection scope of the present invention.
Claims (1)
1. the method that virtual mouse is clicked, comprises the following steps:
1. on user's upper eyelid, arrange along with eyes open and close and the marker that moves up and down and be arranged on the primary standard substance below user's eyes; Answering setting on electrical appliance can photograph user's eyes, and the marker of each upper and lower both sides of eyes and the camera of primary standard substance;
2. utilize camera to take the following status image of user as normal condition image: eyes are opened state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker of each upper and lower both sides of eyes and primary standard substance, calculates the marker of each upper and lower both sides of eyes in each normal condition image and the spacing between primary standard substance, and deposits in storage unit;
3. when the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to the default speed of taking pictures, by calculating the marker of each upper and lower both sides of eyes in each realtime graphic and the spacing between primary standard substance, and with storage unit in data in each benchmark image of storing contrast, thereby identify user's eyes in which kind of state;
4. when identifying user, in eyes, open or when eyes are closed, be considered as inputting without instruction; When identifying user in the simple eye closure state of left eye, be considered as inputting primary mouse left button click commands, when identifying user in the simple eye closure state of right eye, be considered as inputting primary mouse and click instruction by right key.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210554369.8A CN103677247A (en) | 2012-12-19 | 2012-12-19 | Method for virtual mouse clicking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210554369.8A CN103677247A (en) | 2012-12-19 | 2012-12-19 | Method for virtual mouse clicking |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103677247A true CN103677247A (en) | 2014-03-26 |
Family
ID=50315067
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210554369.8A Pending CN103677247A (en) | 2012-12-19 | 2012-12-19 | Method for virtual mouse clicking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103677247A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109240504A (en) * | 2018-09-25 | 2019-01-18 | 北京旷视科技有限公司 | Control method, model training method, device and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2281838A (en) * | 1993-08-04 | 1995-03-15 | Pioneer Electronic Corp | Input for a virtual reality system |
| CN1694045A (en) * | 2005-06-02 | 2005-11-09 | 北京中星微电子有限公司 | Non-contact type visual control operation system and method |
| CN102360247A (en) * | 2011-10-09 | 2012-02-22 | 长沙学院 | Finger mouse for identifying space actions |
-
2012
- 2012-12-19 CN CN201210554369.8A patent/CN103677247A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2281838A (en) * | 1993-08-04 | 1995-03-15 | Pioneer Electronic Corp | Input for a virtual reality system |
| CN1694045A (en) * | 2005-06-02 | 2005-11-09 | 北京中星微电子有限公司 | Non-contact type visual control operation system and method |
| CN102360247A (en) * | 2011-10-09 | 2012-02-22 | 长沙学院 | Finger mouse for identifying space actions |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109240504A (en) * | 2018-09-25 | 2019-01-18 | 北京旷视科技有限公司 | Control method, model training method, device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103443742B (en) | For staring the system and method with gesture interface | |
| EP3571673B1 (en) | Method for displaying virtual image, storage medium and electronic device therefor | |
| CN105593785B (en) | Stare auxiliary touch-screen input | |
| CN106843498B (en) | Dynamic interface interaction method and device based on virtual reality | |
| EP2919093A1 (en) | Method, system, and computer for identifying object in augmented reality | |
| CN105955461A (en) | Interactive interface management method and system | |
| JP2016071835A (en) | Display control method for three-dimensional holographic virtual object based on eye tracking | |
| CN106575160A (en) | Method and apparatus for providing interface recognizing movement in accordance with user's view | |
| WO2021244145A1 (en) | Head-mounted display device interaction method, terminal device, and storage medium | |
| CN102650906B (en) | A kind of control method of user interface and device | |
| CN105210116A (en) | Method and apparatus for rendering object for multiple 3D displays | |
| CN110989835B (en) | Working method of holographic projection device based on gesture recognition | |
| CN109145802A (en) | More manpower gesture man-machine interaction methods and device based on Kinect | |
| CN107179876A (en) | Human-computer interaction device based on virtual reality system | |
| Caggianese et al. | Situated visualization in augmented reality: Exploring information seeking strategies | |
| CN202995626U (en) | Visual mouse clicking system | |
| CN106325480A (en) | Line-of-sight tracing-based mouse control device and method | |
| CN103677247A (en) | Method for virtual mouse clicking | |
| CN202995625U (en) | Virtual mouse click system | |
| CN103049085A (en) | Method for double clicking virtual mouse | |
| CN107085489A (en) | A kind of control method and electronic equipment | |
| CN103699213A (en) | Control method for double click of virtual mouse | |
| CN109933194A (en) | To the exchange method of virtual target object in a kind of mixed reality environment | |
| CN103064517B (en) | A kind of virtual mouse clicks system | |
| CN109700422A (en) | Measure the device of vision system contrast sensitivity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140326 |
|
| RJ01 | Rejection of invention patent application after publication |