CN106325480A - Line-of-sight tracing-based mouse control device and method - Google Patents
Line-of-sight tracing-based mouse control device and method Download PDFInfo
- Publication number
- CN106325480A CN106325480A CN201510374422.XA CN201510374422A CN106325480A CN 106325480 A CN106325480 A CN 106325480A CN 201510374422 A CN201510374422 A CN 201510374422A CN 106325480 A CN106325480 A CN 106325480A
- Authority
- CN
- China
- Prior art keywords
- mouse
- control device
- sight line
- eye
- cursor control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a line-of-sight tracing-based mouse control device. The device comprises a region positioning unit for positioning a field of vision and a center point of the vision, a line-of-sight tracing unit for dynamically tracing motion of a line of sight relative to a reference position, a converting unit for converting the motion of the line of sight relative to the reference position into mouse motion in the field of vision, and a control unit for controlling a mouse to respond to an operation of a position where the mouse is. According to the device, the line of sight of a user can be traced by using an image pickup device like a low-cost common camera, a variable of the line of sight of the user relative to the reference position is obtained with reference to eye motion of the user according to a positioning identification result, a relative position of the mouse in the field of vision is dynamically adjusted, and a traditional mouse operation method is changed. The device has a simple structure, the operation method can be used by multiple crowds of people, a convenient human-computer interaction manner is provided for disabled users, and better user experience is achieved.
Description
Technical field
The present invention relates to electronic technology field, particularly relate to a kind of Mus based on Eye-controlling focus
Mark controls Apparatus for () and method therefor.
Background technology
Although electronic installation such as computer, portable set etc. extensively enter the day of people
Often life, but basic input equipment is still keyboard (Keyboard), but use
Keyboard has a little minor defect, that is, cursor position cannot the most quickly be moved
Dynamic, therefore, create mouse (Mouse) this pointing input device subsequently, use
Person can an icon on moving display screen or option rapidly by mobile mouse.
Currently used mouse is mainly based on wire mouse and wireless mouse, but along with people
The development of machine interaction technique, this tangible mouse can not meet all user
Requirement, significantly limit the development of man-machine interaction.Simultaneously for electronic installation
For the user of office or object for appreciation game, when operation, owing to keyboard and mouse have one
Fixed height, the necessary dorsiflex certain angle of wrist, cause wrist to be in compulsive position, no
Can naturally stretch, year in year out, easy " mouse hand ".And, limbs are transported
For the dynamic user that there is obstacle, also cannot normally use mouse and keyboard operation electronics
Device.
Control system based on Eye-controlling focus is a kind of application of Information barrier-free, and purpose exists
In need not by limb motion or helping limb motion to there is the user control of obstacle
Electronic installation processed.The device of eye tracer technique has compulsory type and non-compulsory, Wearable
With non-Wearable, contact with contactless etc., its precision from 0.1 ° to 2 °,
Manufacturing cost also has greatest differences.At present, Eye Tracking Technique also in the starting stage,
German researchers has been developed over eye control computer software system, and Tobii has asked
Generation, becomes the person advanced in the world of eye movement technique, and Eye Tracking Technique mainly solves eyes
The test problems of kinetic characteristic, detection method currently mainly has electro-oculogram method, contact lens
Method, corneal reflection method, infrared electro bounce technique, Infrared TV Method etc..
But, the method for above equipment cannot use the common camera of low cost to carry out
Eye-controlling focus, and sight line is with easily producing misoperation when of conation, it is impossible to precise and high efficiency
Realize mouse control, be the difficult problem needing solution badly.
Summary of the invention
It is an object of the invention to provide a kind of cursor control device based on Eye-controlling focus
And method, it is possible to the common camera by means of Image intake device such as low cost realizes
Tracking to user sight line, and the person's of being used in combination eye motion, according to its positioning identification
Result, obtain user sight line relative to the variable quantity of reference position, dynamically adjust Mus
It is marked on the relative position of field range, changes traditional mouse operation method, and structure
Simply, operational approach, be suitable for crowd wide, reach more preferable user experience effect.
According to an aspect of the present invention, it is provided that a kind of mouse control based on Eye-controlling focus sets
Standby, including:
Zone location unit, is used for positioning field range and central region point；
Eye-controlling focus unit, for dynamic tracing sight line relative to the motion of reference position；
Converting unit, for being converted to described sight line relative to the motion of reference position
Described mouse movement within the vision；
Control unit, for controlling the operation of mouse response present position.
Further, described zone location unit, fixed by the head of user is carried out
Position identification and position vertical coordinate and the horizontal coordinate of field range and central region point.
Further, described Eye-controlling focus unit, by catching eyeball relative to benchmark position
The change put carries out the dynamic tracing of sight line.
Further, described converting unit, become according to sight line is relative with between reference position
Change amount, dynamically adjusts mouse in relative position within the vision.
Further, described control unit, by the phonetic order of reception to control mouse
The operation of response present position.
Further, described phonetic order includes that left button single key command, right button are clicked
Instruction and double-click instruction.
Further, described zone location unit is one or more Image intake device.
Further, described Eye-controlling focus unit is one or more Image intake device.
Further, described Image intake device is the electric charge coupling being arranged on spectacle frame
Close element.
Further, the described visual field is determined according to the installation site of described Image intake device
The position of central point.
Further, described field range is centered by described central region point, encloses
Predetermined areas around described center.
Further, described converting unit, relative with between described reference position according to sight line
The variable quantity of position coordinates, moves as mapping to the position of mouse in described field range
Amount.Further, described cursor control device also includes: judging unit, is used for sentencing
Whether disconnected sight line is in focus state, if sight line is in focus state, then in the described visual field
In the range of call mouse, if sight line is in non-focusing state, then never call mouse.
Further, if described judging unit judges that sight line is in focus state, in institute
Stating and call mouse within sweep of the eye, described control unit is sentenced by receiving described judging unit
Disconnected sight line is in the duration of focus state to control the behaviour of mouse response present position
Make.
According to a further aspect in the invention, it is provided that a kind of mouse control based on Eye-controlling focus
Method, comprises the following steps:
S1. location field range and central region point；
S2. dynamic tracing sight line is relative to the motion of reference position；
S3. described sight line is converted in the described visual field relative to the motion of reference position
In the range of mouse movement；
S4. the operation of mouse response present position is controlled.
The cursor control device based on Eye-controlling focus of the offer according to the present invention and side thereof
Method, it is possible to the common camera by means of Image intake device such as low cost realizes use
The tracking of person's sight line, and the person's of being used in combination eye motion, according to the result of its positioning identification,
Obtain the user sight line variable quantity relative to reference position, dynamically adjust mouse in the visual field
The relative position of scope, changes traditional mouse operation method, and simple in construction, behaviour
Making method, be suitable for crowd wide, the user that there is obstacle for limb motion provides one
Man-machine interaction mode, reaches more preferable user experience effect easily.
Accompanying drawing explanation
By the description to embodiment carried out below in conjunction with the accompanying drawings, the present invention above-mentioned and
/ or other purpose and advantage will become apparent, wherein:
Fig. 1 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The structural representation of cursor control device；
Fig. 2 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
Cursor control device is the front view of headset equipment；
Fig. 3 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
Cursor control device is the side view of headset equipment；
Fig. 4 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
Cursor control device is the top view of headset equipment；
Fig. 5 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
Cursor control device location field range and the schematic diagram of central region point；
Fig. 6 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The schematic diagram of cursor control device Eye-controlling focus；
Fig. 7 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The transition diagram of cursor control device；
Fig. 8 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
Cursor control device focus vision and non-focusing schematic diagram；
Fig. 9 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The flow chart of mouse control method.
Detailed description of the invention
Reference will now be made in detail embodiments of the invention, the example of described embodiment is in the accompanying drawings
Illustrating, wherein, identical label refers to identical parts all the time.Below will be by ginseng
According to accompanying drawing, described embodiment is described, in order to explain the present invention.
Fig. 1 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The structural representation of cursor control device.As it is shown in figure 1, exemplary according to the present invention
A kind of based on Eye-controlling focus the cursor control device of embodiment, including: zone location list
Unit 1, is used for positioning field range and central region point；Eye-controlling focus unit 2, is used for
Dynamic tracing sight line is relative to the motion of reference position；Converting unit 3, for by described
Sight line is converted to transport at described mouse within the vision relative to the motion of reference position
Dynamic；Control unit 4, for controlling the operation of mouse response present position.
Preferably, zone location unit 1, distinguish by the head of user is carried out location
Know and position field range and the vertical coordinate of central region point and horizontal coordinate.
Preferably, Eye-controlling focus unit 2, by catching eyeball relative to reference position
Change carries out the dynamic tracing of sight line.
Wherein, zone location unit 1 and Eye-controlling focus unit 2 can be respectively one or
Multiple Image intake devices etc. have the equipment of image sensing function.Concrete, described shadow
As capturing apparatus can be the charge coupled cell being arranged on spectacle frame, conveniently allow use
Person directly wears, and the mode of its transmitting telecommunication number is more convenient to be wirelessly transferred.According to
The installation site of described Image intake device determines the position of described central region point.Described
Field range is centered by described central region point, around the presumptive area at described center
Scope.
Fig. 2-4 illustrate provide according to an exemplary embodiment of the present based on Eye-controlling focus
The structural representation that cursor control device is headset equipment.As in figure 2 it is shown, region
Positioning unit 1 can be 1 the photographic head A or imageing sensor being arranged on spectacle frame
A, Eye-controlling focus unit 2 can be 2 the photographic head B or figure being arranged on spectacle frame
As sensor B.Wherein, photographic head A or imageing sensor A and photographic head B or image
The quantity of sensor B is not limited to above quantity, and designer can be according to required Eye-controlling focus
The quantity of photographic head or imageing sensor is changed by precision.
Concrete, photographic head A is in order to the head position of general location user, fixed with this
Position field range and central region point, photographic head B, in order to catch eyeball action, determines and is
No execution mouse action and sight line is carried out dynamic tracing.
Fig. 5 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
Cursor control device location field range and the schematic diagram of central region point.Such as Fig. 5 institute
Showing, when certain panel region in user view screen, head can deflect accordingly, uses
Photographic head A can be equal with the central point in the simulator locating people visual field, vertical coordinate and horizontal coordinate
Positioned by photographic head A, so, it is determined that initial central region point A1, or A2, or
A3, centered by this puts, plans that certain areal extent, as field range, limits mouse
Action can not exceed this scope.When user moves eyeball again, define its corresponding Mus
Target range of activity, if the position of mouse anticipation movement is beyond field range, then uses
Person should redefine field range and central region point by moving-head again, makes mouse envision
The position of movement is positioned at and redefines within sweep of the eye.
Fig. 6 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The schematic diagram of cursor control device Eye-controlling focus.As shown in Figure 6, photographic head B is used to catch
Catch the eyeball relative change in location relative to reference position (such as eyeglass center), figure
Represent in 6 that eyeball will move to upper right side relative to eyeglass center, by catching
Eyeball carries out the dynamic tracing of sight line relative to the change of reference position, thus obtains mouse
The scope of movement and direction.
Preferably, converting unit 3, according to sight line and relative position between described reference position
The variable quantity of coordinate, as mapping to the position amount of movement of mouse in described field range,
I.e. according to the relative variation between sight line and reference position, dynamically adjust mouse at visual field model
Enclose interior relative position.Concrete, when ocular movement, between eyeball and reference position
Relative position coordinates will change, according to the vector change of successively movement, and as mapping
The position amount of movement of mouse to field range.
In implementing, vector can comprise " direction " and " size " two amounts, with
Relative position relation between eyeball and reference position is as the foundation in " direction ", and eyeball
Translational speed then as the foundation of " size ", say, that if the mobile speed of eyeball
Degree is fast, the most in the same direction, moves will result in bigger mouse within sweep of the eye
Amount, meanwhile, if the translational speed of eyeball is slow, although the distance that eyeball moves is with front
Person is identical, will be less but be transformed in mouse movement within the vision.
Fig. 7 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The transition diagram of cursor control device.As it is shown in fig. 7, confirming the initial visual field
After the A of region, eyeball virtual image RL on glasses of photographic head B capture is changed to R ' L ',
According to similar triangles theorem, the relative position conversion of sight line gazing at images A is made to be changed to
Image A '.
In transformation process, the data that photographic head B can be obtained, coordinate fuzzy drilling
Unravel silk method (Fuzzy Algorithm) and neutral net deductive method (Neural network
Algorithm) composition has the conversion method of fast and parallel process and learning capacity, makes
The most accurate with the zero offset capability of mouse position.
Preferably, control unit 4, responded to control mouse by the phonetic order received
The operation of present position.Concrete, described phonetic order includes that left button clicks finger
Make, right button single key command and double-click instruction.
In implementing, after mouse arrives the fixed point in field range, can add
Mouse left-right key typically enters the function of instruction, instruction can include eyes closed instruction,
Phonetic order or press the mode of button on lower keyboard.Wherein, phonetic order can set
It is set to: " to " represent and double-click instruction, "Yes" represents that left button is clicked, and " attribute " represents
Right button is clicked.
When sending phonetic order in view of user, language can be made by the interference of noise
The accurate implementation rate of sound instruction declines, and can increase the list that audio signal carries out noise suppression
Unit, to reduce the situation of garbled-reception phonetic order under noisy environment.
Preferably, described cursor control device also includes: judging unit 5, is used for sentencing
Whether disconnected sight line is in focus state, if sight line is in focus state, then in the described visual field
In the range of call mouse, if sight line is in non-focusing state, then never call mouse.
Preferably, described judging unit 5 judges that sight line is in focus state, regards described
Calling mouse in the range of open country, described control unit 4 judges by receiving described judging unit
Sight line is in the duration of focus state to control the operation of mouse response present position.
Fig. 8 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
Cursor control device focus vision and non-focusing schematic diagram.As shown in Figure 8, use is worked as
When person watches the operations such as whole desktop or film, sight line is in non-focusing state, only stares at
When certain icon or file, sight line just can focus on.When sight line is in non-focusing state, take the photograph
The virtual image L and R presented at eye positions as head B shooting eyeball center, LR is worked as in definition
When distance is more than preset value x, it is currently non-focusing state, then never calls mouse；When
When LR distance is less than preset value x, show that user stares at certain icon, be intended to it is carried out
Operation, then call mouse.
Fig. 9 illustrates provide according to an exemplary embodiment of the present based on Eye-controlling focus
The flow chart of mouse control method.As it is shown in figure 9, according to the exemplary enforcement of the present invention
Provide a kind of mouse control method based on Eye-controlling focus, comprise the following steps:
S1. location field range and central region point；
S2. dynamic tracing sight line is relative to the motion of reference position；
S3. described sight line is converted in the described visual field relative to the motion of reference position
In the range of mouse movement；
S4. the operation of mouse response present position is controlled.
Preferably, for step S1, when certain panel region in user view screen,
Head can deflect accordingly, and use photographic head A can be with the center in the simulator locating people visual field
Point, vertical coordinate and horizontal coordinate are positioned by photographic head A, so, it is determined that initial
Central region point, centered by this puts, plan certain areal extent as field range,
Limit mouse action and can not exceed this scope.When user moves eyeball again, define
The range of activity of its corresponding mouse, if the position of mouse anticipation movement is beyond visual field model
Enclose, then user should redefine field range and central region point by moving-head again,
The position making mouse anticipation movement is positioned at and redefines within sweep of the eye.
Preferably, for step S2, by catching the eyeball change relative to reference position
Change the dynamic tracing carrying out sight line, thus obtain scope and the direction that mouse moves.
Preferably, for step S3, when ocular movement, between eyeball and reference position
Relative position coordinates will change, according to the vector change of successively movement, and conduct is reflected
It is incident upon the position amount of movement of mouse in field range.
Preferably, for step S4, after mouse arrives the fixed point in field range,
Can add mouse left-right key and typically enter the function of instruction, instruction can include eyes
Close command, phonetic order or press the mode of button on lower keyboard.
Preferably, before step S1, it is also possible to include step S0, it is judged that sight line is
No it is in focus state, if sight line is in focus state, then adjusts within sweep of the eye described
With mouse, if sight line is in non-focusing state, then never call mouse.
The cursor control device based on Eye-controlling focus of the offer according to the present invention and side thereof
Method, it is possible to the common camera by means of Image intake device such as low cost realizes use
The tracking of person's sight line, and the person's of being used in combination eye motion, according to the result of its positioning identification,
Obtain the user sight line variable quantity relative to reference position, dynamically adjust mouse in the visual field
The relative position of scope, changes traditional mouse operation method, and simple in construction, behaviour
Making method, be suitable for crowd wide, the user that there is obstacle for limb motion provides one
Man-machine interaction mode, reaches more preferable user experience effect easily.
Each embodiment above of the present invention is merely exemplary, and the present invention is not subject to
It is limited to this.Those skilled in the art should understand that: without departing from the principle of the present invention and essence
In the case of god, can change these embodiments, wherein, the scope of the present invention exists
Claim and equivalent thereof limit.
Claims (15)
1. a cursor control device based on Eye-controlling focus, it is characterised in that including:
Zone location unit, is used for positioning field range and central region point；Eye-controlling focus unit,
For dynamic tracing sight line relative to the motion of reference position；Converting unit, for by institute
State sight line to be converted at described mouse within the vision relative to the motion of reference position
Motion；Control unit, for controlling the operation of mouse response present position.
Cursor control device the most according to claim 1, it is characterised in that institute
State zone location unit, position the visual field by the head of user is carried out positioning identification
The vertical coordinate of scope and central region point and horizontal coordinate.
Cursor control device the most according to claim 1, it is characterised in that institute
State Eye-controlling focus unit, carry out sight line by catching eyeball relative to the change of reference position
Dynamic tracing.
Cursor control device the most according to claim 1, it is characterised in that institute
State converting unit, according to the relative variation between sight line and reference position, dynamically adjust Mus
It is marked on relative position within the vision.
Cursor control device the most according to claim 1, it is characterised in that institute
State control unit, respond present position by the phonetic order received to control mouse
Operation.
Cursor control device the most according to claim 6, it is characterised in that institute
State phonetic order include left button single key command, right button single key command and double-click instruction.
Cursor control device the most according to claim 1, it is characterised in that institute
Stating zone location unit is one or more Image intake device.
Cursor control device the most according to claim 1, it is characterised in that institute
Stating Eye-controlling focus unit is one or more Image intake device.
9. according to the cursor control device described in claim 7 or 8, it is characterised in that
Described Image intake device is the charge coupled cell being arranged on spectacle frame.
Cursor control device the most according to claim 7, it is characterised in that root
The position of described central region point is determined according to the installation site of described Image intake device.
11. cursor control device according to claim 10, it is characterised in that
Described field range is making a reservation for centered by described central region point, around described center
Regional extent.
12. cursor control device according to claim 1, it is characterised in that institute
State converting unit, according to the change of relative position coordinates between sight line and described reference position
Amount, as the position amount of movement mapping to mouse in described field range.
13. cursor control device according to claim 1, it is characterised in that also
Including:
Judging unit, is used for judging whether sight line is in focus state, if sight line is in poly-
Coke-like state, then call mouse within sweep of the eye described, if sight line is in non-focusing state,
Then never call mouse.
14. cursor control device according to claim 13, it is characterised in that
If described judging unit judges that sight line is in focus state, call within sweep of the eye described
Mouse, by receiving described judging unit, described control unit judges that sight line is in focusing shape
The duration of state is to control the operation of mouse response present position.
15. 1 kinds of mouse control methods based on Eye-controlling focus, it is characterised in that include
Following steps:
S1. location field range and central region point；
S2. dynamic tracing sight line is relative to the motion of reference position；
S3. described sight line is converted in the described visual field relative to the motion of reference position
In the range of mouse movement；
S4. the operation of mouse response present position is controlled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510374422.XA CN106325480A (en) | 2015-06-30 | 2015-06-30 | Line-of-sight tracing-based mouse control device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510374422.XA CN106325480A (en) | 2015-06-30 | 2015-06-30 | Line-of-sight tracing-based mouse control device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106325480A true CN106325480A (en) | 2017-01-11 |
Family
ID=57722864
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510374422.XA Pending CN106325480A (en) | 2015-06-30 | 2015-06-30 | Line-of-sight tracing-based mouse control device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106325480A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107589849A (en) * | 2017-09-26 | 2018-01-16 | 杭州上手科技有限公司 | A kind of PowerPoint speed input method |
| CN108536285A (en) * | 2018-03-15 | 2018-09-14 | 中国地质大学（武汉） | A kind of mouse interaction method and system based on eye movement identification and control |
| CN109739351A (en) * | 2018-12-26 | 2019-05-10 | 秒针信息技术有限公司 | Data mask method and device, storage medium, electronic device |
| CN109753143A (en) * | 2018-04-16 | 2019-05-14 | 北京字节跳动网络技术有限公司 | A kind of method and apparatus optimizing cursor position |
| CN113220183A (en) * | 2021-05-24 | 2021-08-06 | 中国银行股份有限公司 | System operation method and device, computer equipment and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1694045A (en) * | 2005-06-02 | 2005-11-09 | 北京中星微电子有限公司 | Non-contact type visual control operation system and method |
| CN102609085A (en) * | 2010-12-27 | 2012-07-25 | 卡西欧计算机株式会社 | Information processing apparatus, method, and storage medium storing program |
| CN103294180A (en) * | 2012-03-01 | 2013-09-11 | 联想(北京)有限公司 | Man-machine interaction control method and electronic terminal |
| CN103984097A (en) * | 2013-02-12 | 2014-08-13 | 精工爱普生株式会社 | Head mounted display, control method for head mounted display, and image display system |
| US20150077329A1 (en) * | 2013-09-17 | 2015-03-19 | Electronics And Telecommunications Research Institute | Eye tracking-based user interface method and apparatus |
-
2015
- 2015-06-30 CN CN201510374422.XA patent/CN106325480A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1694045A (en) * | 2005-06-02 | 2005-11-09 | 北京中星微电子有限公司 | Non-contact type visual control operation system and method |
| CN102609085A (en) * | 2010-12-27 | 2012-07-25 | 卡西欧计算机株式会社 | Information processing apparatus, method, and storage medium storing program |
| CN103294180A (en) * | 2012-03-01 | 2013-09-11 | 联想(北京)有限公司 | Man-machine interaction control method and electronic terminal |
| CN103984097A (en) * | 2013-02-12 | 2014-08-13 | 精工爱普生株式会社 | Head mounted display, control method for head mounted display, and image display system |
| US20150077329A1 (en) * | 2013-09-17 | 2015-03-19 | Electronics And Telecommunications Research Institute | Eye tracking-based user interface method and apparatus |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107589849A (en) * | 2017-09-26 | 2018-01-16 | 杭州上手科技有限公司 | A kind of PowerPoint speed input method |
| CN108536285A (en) * | 2018-03-15 | 2018-09-14 | 中国地质大学（武汉） | A kind of mouse interaction method and system based on eye movement identification and control |
| CN108536285B (en) * | 2018-03-15 | 2021-05-14 | 中国地质大学（武汉） | Mouse interaction method and system based on eye movement recognition and control |
| CN109753143A (en) * | 2018-04-16 | 2019-05-14 | 北京字节跳动网络技术有限公司 | A kind of method and apparatus optimizing cursor position |
| CN109753143B (en) * | 2018-04-16 | 2019-12-13 | 北京字节跳动网络技术有限公司 | method and device for optimizing cursor position |
| CN109739351A (en) * | 2018-12-26 | 2019-05-10 | 秒针信息技术有限公司 | Data mask method and device, storage medium, electronic device |
| CN113220183A (en) * | 2021-05-24 | 2021-08-06 | 中国银行股份有限公司 | System operation method and device, computer equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11531402B1 (en) | Bimanual gestures for controlling virtual and graphical elements | |
| US20220326781A1 (en) | Bimanual interactions between mapped hand regions for controlling virtual and graphical elements | |
| CN102830797B (en) | A kind of man-machine interaction method based on sight line judgement and system | |
| KR20230170086A (en) | Hand gestures for animating and controlling virtual and graphical elements | |
| WO2022066578A1 (en) | Touchless photo capture in response to detected hand gestures | |
| CN103336575B (en) | The intelligent glasses system of a kind of man-machine interaction and exchange method | |
| CN106325480A (en) | Line-of-sight tracing-based mouse control device and method | |
| CN106168848A (en) | Display device and the control method of display device | |
| CN107390863A (en) | Control method and device, electronic equipment, the storage medium of equipment | |
| CN107357428A (en) | Man-machine interaction method and device based on gesture identification, system | |
| CN103713737A (en) | Virtual keyboard system used for Google glasses | |
| CN107656505A (en) | Use the methods, devices and systems of augmented reality equipment control man-machine collaboration | |
| CN103336581A (en) | Human eye movement characteristic design-based human-computer interaction method and system | |
| CN103336582A (en) | Motion information control human-computer interaction method | |
| US11889291B2 (en) | Head-related transfer function | |
| CN109839827B (en) | Gesture recognition intelligent household control system based on full-space position information | |
| WO2022006116A1 (en) | Augmented reality eyewear with speech bubbles and translation | |
| CN117337426A (en) | Audio augmented reality | |
| US20230256297A1 (en) | Virtual evaluation tools for augmented reality exercise experiences | |
| EP3991013A1 (en) | Method, computer program and head-mounted device for triggering an action, method and computer program for a computing device and computing device | |
| CN101071349B (en) | System for controlling cursor and window-operating by identifying dynamic trace | |
| Deb et al. | Designing an intelligent blink analyzer tool for effective human computer interaction through eye | |
| US11863963B2 (en) | Augmented reality spatial audio experience | |
| US11998798B2 (en) | Virtual guided fitness routines for augmented reality experiences | |
| US20220362631A1 (en) | Virtual tastings and guided tours for augmented reality experiences |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170111 |