CN103064517B - A kind of virtual mouse clicks system - Google Patents
A kind of virtual mouse clicks system Download PDFInfo
- Publication number
- CN103064517B CN103064517B CN201210556213.3A CN201210556213A CN103064517B CN 103064517 B CN103064517 B CN 103064517B CN 201210556213 A CN201210556213 A CN 201210556213A CN 103064517 B CN103064517 B CN 103064517B
- Authority
- CN
- China
- Prior art keywords
- eyes
- user
- marker
- standard substance
- primary standard
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 210000001508 eye Anatomy 0.000 claims abstract description 65
- 239000000126 substance Substances 0.000 claims abstract description 32
- 239000003550 marker Substances 0.000 claims abstract description 30
- 210000000744 eyelid Anatomy 0.000 claims abstract description 13
- 238000000576 coating method Methods 0.000 claims abstract description 8
- 239000011248 coating agent Substances 0.000 claims abstract description 7
- 230000004399 eye closure Effects 0.000 claims description 11
- 210000000162 simple eye Anatomy 0.000 claims description 11
- 238000003491 array Methods 0.000 claims description 2
- 230000037308 hair color Effects 0.000 claims description 2
- 230000008901 benefit Effects 0.000 abstract description 2
- 238000000034 method Methods 0.000 description 4
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 208000029578 Muscle disease Diseases 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 230000000704 physical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Abstract
The invention discloses a kind of virtual mouse and click system, comprise the marker being arranged on and user's upper eyelid being arranged and moves up and down along with eyes opening and closing, be arranged on the primary standard substance below user's eyes, and be arranged on to answer electrical appliance can photograph the marker of user's eyes and the upper and lower both sides of each eyes and the camera of primary standard substance; Described marker is the coating be coated on upper eyelid; Described primary standard substance is the coating be coated on lower eyelid or below eyes.The present invention have comparatively simplify, precisely and fast advantage.
Description
Technical field
The invention belongs to pseudo operation technical field, relate to a kind of virtual mouse and click system.
Background technology
Along with the development of infotech, computer is more and more universal, mouse is as an essential element of computer, also along with computer enters huge numbers of families, but the use of conventional mouse also brings many difficult problems, first conventional mouse is the Activities Design based on hand, obvious like this make those cannot the people of movable hand cannot valid function mouse, thus cannot valid function computer.In addition, medical circle is also verified, uses conventional mouse for a long time, physical property can be caused to injure to the wrist muscle of people, gently then produce provisional ache, heavy then cause be difficult to for a long time cure muscle disease.
Publication number is the Chinese patent of CN1889016A, disclose a kind of eyes to computer cursor automatic positioning controlling method and system, its principle is: take eyes image when user watches computer monitor four angles attentively respectively with camera, image conversion is become gray scale array, to array dynamic process, average value processing Xuan Qi center is carried out to effective coverage maximum in remaining value, calculate the eyeball center of every width image, according to the part attribute Modling model that these four some eyeball centers and system show; After obtaining the full figure coordinate of four some correspondences, calculate wherein heart position M according to 4; Set up quadrilateral with 4, then be rectangle by quadrangle modification, calculate the length of rectangle and wide, and be divided by with the length and width of display, calculate ratio KW and KH respectively, the ratio obtained is for determining the relation of the cursor correspondence position of eyeball position and monitor.The method that this virtual mouse controls is comparatively numerous and diverse, and easily maloperation, improvements are needed in upper existence badly.
Summary of the invention
The object of this invention is to provide one comparatively simplify, precisely and fast virtual mouse click system.
The technical scheme realizing the object of the invention is: a kind of virtual mouse clicks system, comprise the marker being arranged on and user's upper eyelid being arranged and moves up and down along with eyes opening and closing, be arranged on the primary standard substance below user's eyes, and be arranged on to answer electrical appliance can photograph the marker of user's eyes and the upper and lower both sides of each eyes and the camera of primary standard substance; Described marker is the coating be coated on upper eyelid; Described primary standard substance is the coating be coated on lower eyelid or below eyes.
Described primary standard substance is preferably static to be arranged on below eyes.
The present invention takes user's eyes area image frame by frame by camera, according to the spacing size between marker and a corresponding primary standard substance, identify each eyes and be in the state opened or close, thus judge that user wants to send which kind of instruction, realize the manual operations replacing left mouse button double-click and right double click; Owing to monitor and the opening and closing identifying eyes is comparatively easy, therefore realize compared with virtual mouse controls with conventional art by monitoring eye movement, there is comparatively simplification, precisely and fast advantage.
reference numeral
Fig. 1 is a kind of structural representation of the present invention.
Embodiment
(embodiment 1)
Fig. 1 is a kind of structural representation of the present invention, shows a kind of embodiment of the present invention.
The present embodiment is that a kind of virtual mouse clicks system, as shown in Figure 1, comprise the marker 1 being arranged on and user's upper eyelid being arranged and moves up and down along with eyes opening and closing, be arranged on the primary standard substance 2 below user's eyes, and be arranged on the camera of answering the marker 1 that can photograph user's eyes and the upper and lower both sides of each eyes on electrical appliance and primary standard substance 2; Described marker 1 is the coating be coated on upper eyelid; Described primary standard substance 2 is the coatings be coated on lower eyelid or below eyes.In the present embodiment, described primary standard substance 2 is preferably static to be arranged on below eyes.
(application examples 1)
Should use-case be the control method of embodiment 1, comprise the following steps:
1. the marker 1 moved up and down along with eyes opening and closing and the primary standard substance 2 be arranged on below user's eyes are set on user's upper eyelid; User's eyes can be photographed answering electrical appliance arranges, and the marker 1 of the upper and lower both sides of each eyes and the camera of primary standard substance 2;
2. camera is utilized to take the following status image of user as normal condition image: eyes open state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker 1 of the upper and lower both sides of each eyes and primary standard substance 2, calculates the spacing between the marker 1 of the upper and lower both sides of each eyes in each normal condition image and primary standard substance 2, and stored in storage unit;
This is that the position applying marker and primary standard substance separately due to each user is not quite similar, so preferably after having applied marker and primary standard substance, the lower each normal condition image of shooting, so that as judging more accurately;
Should the concrete grammar of identification spacing that adopts of use-case be: the image of the four kinds of normal conditions photographed is changed into gray scale array, also 256 look formula arrays can directly be changed into, marker and primary standard substance have obvious difference with periphery yellowish pink and hair color, so marker and primary standard substance all have respective significant array, and the spacing between corresponding marker and primary standard substance are up and down can be judged, and then by identifying that spacing judges that these place's eyes are opened or closed.
3. when the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to presetting speed of taking pictures, by calculating the spacing between the marker 1 of the upper and lower both sides of each eyes in each realtime graphic and primary standard substance 2, and contrast with the data in each benchmark image of storing in storage unit, thus identify user's eyes and be in which kind of state;
4. when identify user be in eyes open or eyes close time, be considered as inputting without instruction; When identifying user and being in the simple eye closure state of left eye, be considered as input primary mouse left button click commands, when identifying user and being in the simple eye closure state of right eye, be considered as input primary mouse and click instruction by right key.
In addition, when in a certain Preset Time, such as, in 0.2 second, identify the simple eye closure state of left eye of more than twice, be considered as the instruction of an input mouse control left double click.When in a certain Preset Time, such as, in 0.2 second, identify the simple eye closure state of right eye of more than twice, be considered as the instruction of an input mouse control right double click.
Traditional reflective amount according to marker and primary standard substance can certainly be adopted to judge that each eyes are in open or closed state.
Obviously, the above embodiment of the present invention is only for example of the present invention is clearly described, and is not the restriction to embodiments of the present invention.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here exhaustive without the need to also giving all embodiments.And these belong to connotation of the present invention the apparent change of extending out or variation still belong to protection scope of the present invention.
Claims (1)
1. a virtual mouse clicks system, it is characterized in that: comprise the marker moved up and down along with eyes opening and closing be arranged on user's upper eyelid, be arranged on the primary standard substance below user's eyes, and be arranged on to answer electrical appliance can photograph the marker of user's eyes and the upper and lower both sides of each eyes and the camera of primary standard substance; Described marker is the coating be coated on upper eyelid; Described primary standard substance is the coating be coated on lower eyelid or below eyes;
Camera is utilized to take the following status image of user as normal condition image: eyes open state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker of the upper and lower both sides of each eyes and primary standard substance, calculates the spacing between the marker of the upper and lower both sides of each eyes in each normal condition image and primary standard substance, and stored in storage unit; Wherein identify that the concrete grammar of spacing is: the image of the four kinds of normal conditions photographed is changed into gray scale array, also 256 look formula arrays can directly be changed into, marker and primary standard substance have obvious difference with periphery yellowish pink and hair color, so marker and primary standard substance all have respective significant array, and the spacing between corresponding marker and primary standard substance are up and down can be judged, and then by identifying that spacing judges that these place's eyes are opened or closed;
When the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to presetting speed of taking pictures, by calculating the spacing between the marker of the upper and lower both sides of each eyes in each realtime graphic and primary standard substance, and contrast with the data in each benchmark image of storing in storage unit, thus identify user's eyes and be in which kind of state; When identify user be in eyes open or eyes close time, be considered as inputting without instruction; When identifying user and being in the simple eye closure state of left eye, be considered as input primary mouse left button click commands, when identifying user and being in the simple eye closure state of right eye, be considered as input primary mouse and click instruction by right key; When in 0.2 second, identify the simple eye closure state of left eye of more than twice, be considered as the instruction of an input mouse control left double click.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210556213.3A CN103064517B (en) | 2012-12-19 | 2012-12-19 | A kind of virtual mouse clicks system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210556213.3A CN103064517B (en) | 2012-12-19 | 2012-12-19 | A kind of virtual mouse clicks system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103064517A CN103064517A (en) | 2013-04-24 |
| CN103064517B true CN103064517B (en) | 2016-03-23 |
Family
ID=48107168
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210556213.3A Active CN103064517B (en) | 2012-12-19 | 2012-12-19 | A kind of virtual mouse clicks system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103064517B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004021157A1 (en) * | 2002-09-02 | 2004-03-11 | University Of Ulster | Method and apparatus for generating control signals using electro-oculographic potentials |
| CN101201695A (en) * | 2006-12-26 | 2008-06-18 | 谢振华 | Mouse system for extracting and tracing based on ocular movement characteristic |
| CN101697199A (en) * | 2009-08-11 | 2010-04-21 | 北京盈科成章科技有限公司 | Detection method of head-face gesture and disabled assisting system using same to manipulate computer |
| CN102360247A (en) * | 2011-10-09 | 2012-02-22 | 长沙学院 | Finger mouse for identifying space actions |
| CN202995625U (en) * | 2012-12-19 | 2013-06-12 | 苏州贝腾特电子科技有限公司 | Virtual mouse click system |
-
2012
- 2012-12-19 CN CN201210556213.3A patent/CN103064517B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004021157A1 (en) * | 2002-09-02 | 2004-03-11 | University Of Ulster | Method and apparatus for generating control signals using electro-oculographic potentials |
| CN101201695A (en) * | 2006-12-26 | 2008-06-18 | 谢振华 | Mouse system for extracting and tracing based on ocular movement characteristic |
| CN101697199A (en) * | 2009-08-11 | 2010-04-21 | 北京盈科成章科技有限公司 | Detection method of head-face gesture and disabled assisting system using same to manipulate computer |
| CN102360247A (en) * | 2011-10-09 | 2012-02-22 | 长沙学院 | Finger mouse for identifying space actions |
| CN202995625U (en) * | 2012-12-19 | 2013-06-12 | 苏州贝腾特电子科技有限公司 | Virtual mouse click system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103064517A (en) | 2013-04-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105593785B (en) | Stare auxiliary touch-screen input | |
| EP3293620B1 (en) | Multi-screen control method and system for display screen based on eyeball tracing technology | |
| CN105190477B (en) | Head-mounted display apparatus for user's interaction in augmented reality environment | |
| CN106843498B (en) | Dynamic interface interaction method and device based on virtual reality | |
| WO2017097143A1 (en) | Method and device for setting interface switch animation | |
| CN106575160A (en) | Method and apparatus for providing interface recognizing movement in accordance with user's view | |
| EP4026318A1 (en) | Intelligent stylus beam and assisted probabilistic input to element mapping in 2d and 3d graphical user interfaces | |
| CN102650906B (en) | A kind of control method of user interface and device | |
| JP2019036307A (en) | System and method for contactless user interface | |
| KR20170009979A (en) | Methods and systems for touch input | |
| CN109584153A (en) | Modify the methods, devices and systems of eye | |
| US20160048212A1 (en) | Display Device and Control Method Thereof, and Gesture Recognition Method | |
| Moeslund et al. | A natural interface to a virtual environment through computer vision-estimated pointing gestures | |
| CN104765454A (en) | Human muscle movement perception based menu selection method for human-computer interaction interface | |
| CN107450717A (en) | A kind of information processing method and Wearable | |
| CN103064517B (en) | A kind of virtual mouse clicks system | |
| CN202995626U (en) | Visual mouse clicking system | |
| CN202995625U (en) | Virtual mouse click system | |
| CN106155513B (en) | A kind of control method and device projecting touch screen | |
| CN110442242A (en) | A kind of smart mirror system and control method based on the interaction of binocular space gesture | |
| CN103049085A (en) | Method for double clicking virtual mouse | |
| CN103677247A (en) | Method for virtual mouse clicking | |
| Kao et al. | Eye gaze tracking based on pattern voting scheme for mobile device | |
| CN109700422A (en) | Measure the device of vision system contrast sensitivity | |
| CN105676656A (en) | Processing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| CB03 | Change of inventor or designer information |
Inventor after: Yu Jiabo Inventor after: Wang Jie Inventor before: Hu Xiaoqing |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160301 Address after: 325600 Yueqing salt industry zone, Zhejiang City, Wei Road, 20 Applicant after: Cao Xinmin Address before: 215026, Jiangsu, Suzhou Industrial Park, South Cross bumper harvest Plaza, 1, 809 Applicant before: Suzhou Beitengte Electronic Technology Co., Ltd. |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20180828 Address after: 226000 417, room 2, Chongchuan Road, Chongchuan Road, Chongchuan District, Nantong, Jiangsu, China, 58 Patentee after: Nantong Czech Automation Technology Co. Ltd. Address before: 325600 Wei 20 road, Yantian Industrial Zone, Yueqing, Zhejiang Patentee before: Cao Xinmin |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201015 Address after: 226300 No. 266 Century Avenue, hi tech Zone, Jiangsu, Nantong Patentee after: NANTONG FEIHAI ELECTRONIC TECHNOLOGY Co.,Ltd. Address before: 226000 Jiangsu Province, Nantong City Chongchuan District Chongchuan Road No. 58 Building 2 room 417 Patentee before: Nantong Czech Automation Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |