CN108874139A - The target exchange method and system of visual focus and hand exercise tracking coordinated drive - Google Patents
The target exchange method and system of visual focus and hand exercise tracking coordinated drive Download PDFInfo
- Publication number
- CN108874139A CN108874139A CN201810636848.1A CN201810636848A CN108874139A CN 108874139 A CN108874139 A CN 108874139A CN 201810636848 A CN201810636848 A CN 201810636848A CN 108874139 A CN108874139 A CN 108874139A
- Authority
- CN
- China
- Prior art keywords
- visual focus
- target
- cursor
- user
- hand exercise
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The target exchange method of visual focus and hand exercise tracking coordinated drive, includes the following steps：Visual focus tracking, hand exercise tracking, the target interaction of fusion visual focus and hand exercise.The present invention also provides realize the method for the present invention system, including be sequentially connected and feed data with lower module：Visual focus tracking module, hand exercise tracking module, the target interactive module for merging visual focus and hand exercise.
Description
Technical field
The present invention relates to target exchange method and systems on large-scale display interface.
Background technique
It is aobvious towards large size as projection screen, large LED display etc. are gradually gained popularity in people's work, life
Show that the human-computer interaction at interface is also rapidly developed.Target selection is the important behaviour under large-scale display interface interaction scenarios
Make, is generally divided into two steps：1) it is positioned to the target of selection；2) then confirm the target currently positioned.And traditional mouse behaviour
Make mode, so that the cursor that user needs to carry out on large-scale display interface long range using mouse is mobile, increases user's
Operational load.In this background, the exchange method based on human eye vision Focus tracking is gradually applied to show towards large size
The target selection operation at interface because visual focus tracking have very strong directive property, can comparatively fast complete target positioning and
Selection.In addition, the interaction that visual focus characterizes user to a certain extent is intended to, the nature of implicit interactions is further improved
Property.Therefore it the invention proposes the target exchange method and system of visual focus and hand exercise tracking coordinated drive, realizes more
The target selection of channel fusion driving.Target is directed toward by visual focus, hand exercise confirms that the interaction mechanism of target is realized greatly
Target selection on type display interface passes through hand especially when the individual size of target is smaller, spacing is smaller between target
Movement changes the range of choice of visual focus tracking cursor, and visual focus tracking pointing accuracy not only can be improved, can also drop
Low operation difficulty；Meanwhile stable, second selecting and its Optimization Mechanism in conjunction with cursor, realize target choosing more accurately and quickly
It selects.
Summary of the invention
The present invention will overcome the disadvantages mentioned above of the prior art, provide visual focus and hand exercise tracks coordinated drive
Target exchange method.
The target exchange method and system of visual focus of the invention and hand exercise tracking coordinated drive, including walk as follows
Suddenly：
(1) visual focus tracks；
(2) hand exercise tracks；
(3) the target interaction of visual focus and hand exercise is merged；
The present invention also provides the target interactive systems of visual focus and hand exercise tracking coordinated drive, including successively connect
Connect and feed data with lower module：
(1) visual focus tracking module；
(2) hand exercise tracking module；
(3) the target interactive module of visual focus and hand exercise is merged；
The advantage of the invention is that：The target exchange method of visual focus and hand exercise tracking coordinated drive is proposed,
It is directed toward target by visual focus, hand exercise carries out selection confirmation, realizes efficient, natural target choosing on large-scale display interface
It selects.And target size is small, target spacing hour, pass through that visual focus cursor is stable, second selecting, and corresponding optimization
Mechanism improves interactive process comprehensively, the required precision to visual focus tracking is effectively reduced, in large-scale display interface
On interactive task complete efficiency and accuracy and be obviously improved.
Detailed description of the invention
Fig. 1 is the flow diagram of the method for the present invention.
Fig. 2 a~Fig. 2 b is the scalable visual focus tracking cursor schematic diagram of the method for the present invention, and wherein Fig. 2 a is initial
The visual focus tracking cursor of state；Fig. 2 b is by the amplified visual focus tracking cursor of " scaling " gesture.
Fig. 3 a~Fig. 3 b is the improved visual focus tracking cursor schematic diagram of the method for the present invention, and wherein Fig. 3 a is initial shape
The visual focus tracking cursor of state；Fig. 3 b is accordingly to be moved to the visual focus of new position after visual focus substantially moves
Tracking cursor.
Fig. 4 is the second selecting functional schematic of the method for the present invention.
Fig. 5 a~Fig. 5 b is the target selection schematic diagram based on preselected list of the method for the present invention, and wherein Fig. 5 a is that covering is more
The visual focus tracking cursor of a intensive target, it is currently selected in target in left end；Fig. 5 b is to introduce pre-selection Optimization Mechanism
Afterwards, cover the visual focus tracking cursor of multiple intensive targets, it is currently selected in target in right end.
Fig. 6 is the basic logical structure schematic diagram of present system.
Specific embodiment
Below in conjunction with attached drawing, to the target exchange method row of visual focus of the present invention and hand exercise tracking coordinated drive
It clearly and completely describes, it is clear that described embodiment is only a part of the embodiments of the present invention, rather than whole realities
Example is applied, is not considered as limiting the invention.Based on the embodiments of the present invention, those of ordinary skill in the art are not doing
Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
Refering to fig. 1, the target interaction side of visual focus and hand exercise tracking coordinated drive provided in an embodiment of the present invention
The flow diagram of method, to wherein the step of be specifically described：
(1) visual focus tracks；
Eye image is shot using the photographic device with infrared light supply, and binary conversion treatment is carried out to eye image, so
It is filtered afterwards with gaussian kernel function, removes the noise in eye image.Feature extraction further is carried out to eye image, is obtained
The center at pupil of human center and infrared light reflection hot spot (also referred to as Purkinje image), and the vector that the two is constituted is calculated, it is most laggard
Row calibration process establishes the mapping relations of the vector and user between large-scale display interface visual focus, further by quasi-
Close the plane coordinates that other visual focus are calculated.
(2) hand exercise tracks；
The hand exercise model that people is obtained using existing hand exercise tracking device, according to hand exercise feature to " lift
Rise ", " scaling ", the difference such as " waving " gestures are tracked and are identified." lifting " gesture is characterized in that hand exercise range is greater than
Certain distance H (for example, H=20 centimetres can be set), and the direction of motion is vertically to hoist movement from lower；" scaling " hand
Gesture is characterized in that hand (is put) from the state of clenching fist to palm open configuration, or from palm open configuration to the state of clenching fist (contracting),
And palm of the hand radius of a ball when clenching fist is set as Rw, palm of the hand radius of a ball when palm opens is Rz, it is desired to Rw/Rz>K is (for example, can be with
Set K=60%)；" waving " gesture is characterized in that hand exercise direction is that horizontal direction moves from left to right or from right to left,
And movement velocity is greater than S (for example, can set S=30 cm/s).
(3) the target interaction of visual focus and hand exercise is merged；
As shown in Figure 2 a, the cursor center of circle is point a, and cursor radius is r, and user can control button cursor with visual focus
Mobile, after cursor coverage goal, user carries out selection confirmation, final checked target by " lifting " gesture.In addition, working as target
Size is too small and when cursor is difficult to cover, user can expand cursor radius r by " scaling " gesture, as shown in Figure 2 b.
Cursor is stablized.As shown in Figure 3a, the currently practical visual focus of user is set as g, and practical visual focus and cursor are round
The distance between heart is d.When user visual focus in cursor radius (d<=r) when, the position of cursor will not occur
Change.Only when large range of transfer occurs for the visual focus of user, i.e. visual focus exceeds cursor scope (d>When r),
The position of cursor can accordingly be changed, as shown in Figure 3b.On the one hand this cursor eliminates visual focus tracking accuracy error causes
Unstability (i.e. user stability that cursor is then laid particular emphasis in selection target), on the other hand again can be biggish according to amplitude
Visual focus shifts and adjusts cursor position (flexibility that user lays particular emphasis on cursor in mobile cursor) in time, can effectively help
User's better choice small size target.
Second selecting.As shown in figure 4, having a large amount of small size target closely to arrange on large-scale display interface, user passes through
It after visual focus tracking carries out Primary Location, is tracked using hand exercise, the selection (figure of set objective is completed by second selecting
The rectangle of thick frame in 4).First user by " scaling " gesture expand cursor size, reduce select small size target when pair
The requirement of visual focus tracking accuracy.All targets covered by cursor can be all added in preselected list (by light in such as Fig. 4
Mark 4 targets of covering).There are a select finger in preselected list, the meeting when user is by the confirmation selection of " lifting " gesture
The target for choosing pointer to be directed toward, the target will become dark color.User passes through the movement of " waving " gesture control select finger, when it
When being directed toward the target of the desired selection of user, confirm again by " lifting " gesture and select, completes to complete set objective accurately choosing
It selects.
Optimization Mechanism.As shown in Figure 5 a, when target distribution is excessively intensive, it will lead to the target mistake of cursor while covering
It is more, so that carrying out the overlong time of object filtering (for example, it is desired to sieve one by one by " waving " from left to right using second selecting
Choosing), efficiency of selection is substantially reduced.For this purpose, the high low setting priority of a possibility that being selected according to target, the high target of priority
It will be easier selected.Specifically method is：When user is selected using visual focus cursor, when record user goes over one section
Between all visual focus in T (for example, can set T=2 seconds) coordinate, and the coordinate average value of these visual focus is made
For the most probable visual focus coordinate of active user (visual focus is known as predicting visual focus).Target position and prediction vision
Focus is closer, and priority is higher；Anyway.In addition, target priority will also be burnt according to prediction vision in preselected list
Put the variation of position and corresponding dynamic change.As shown in Figure 5 b, i is prediction visual focus, nearest with the target of the rightmost side, because
The target priority highest of this rightmost side, so first be set in preselected list, it is preselected automatically, this
When user do not need " waving " and repeatedly switched, and directly chosen with the confirmation of " lifting " gesture, hence it is evident that improve selection
Efficiency.
As shown in fig. 6, the target for visual focus and hand exercise the tracking coordinated drive that this paper inventive embodiments provide is handed over
The basic logical structure schematic diagram of mutual system.For ease of description, it illustrate only part related to the embodiment of the present invention.It should
Functional module/unit can be hardware module/unit, software module/unit in system, and main includes being sequentially connected and feeding number
According to lower module:
(1) visual focus tracking module extracts pupil and Purkinje image in eye image, calculates pupil and Purkinje image
Then centre coordinate establishes pupil-corneal reflection vector with pupil center and Purkinje image center, and then establishes visual focus and reflect
Penetrate model, coordinate of the computation vision focus on large-scale display interface；
(2) hand exercise tracking module obtains user's both hands model, according to its motion feature, the hand of real-time detection user
Portion's motion information, and identify and distinguish between different gestures；
(3) the target interactive module for merging visual focus and hand exercise receives the visual focus for calculating obtain in real time and sits
Data, and the hand exercise information and relevant gesture that detect are marked, corresponding interactive instruction is formed after fusion, control is big
Cursor on type display interface is mobile, specific to provide cursor stabilization, second selecting, and corresponding selection optimization function.
Modules can integrate in one in the embodiment of the present invention, can also be deployed separately, or be further split into more
A submodule.Modules can describe to be distributed in the system of embodiment according to embodiment, can also carry out corresponding change position
In the one or more systems for being different from the embodiment of the present invention.
Those skilled in the art should be understood that the embodiment of the present invention can provide as method, system or computer program
Product.
Each module or each step of the embodiment of the present invention can be realized with general computing device, and optionally, they can
To be realized with the program code that computing device can perform, so as to be stored in storage device by computing device Lai
It executes, perhaps they are fabricated to each integrated circuit modules or makes multiple modules or steps in them to
Single integrated circuit module is realized.Therefore, the embodiment of the present invention is not limited to any specific hardware and software combination.
Content described in this specification embodiment is only enumerating to the way of realization of inventive concept, protection of the invention
Range should not be construed as being limited to the specific forms stated in the embodiments, and protection scope of the present invention is also and in art technology
Personnel conceive according to the present invention it is conceivable that equivalent technologies mean.
Claims (2)
1. the target exchange method of visual focus and hand exercise tracking coordinated drive, includes the following steps：
(1) visual focus tracks；
Eye image is shot using the photographic device with infrared light supply, and binary conversion treatment is carried out to eye image, is then used
Gaussian kernel function is filtered, and removes the noise in eye image；Feature extraction is carried out to eye image, is obtained in pupil of human
The center of the heart and infrared light reflection hot spot, and the vector that the two is constituted is calculated, calibration process is finally carried out, the vector is established and uses
Mapping relations of the family between large-scale display interface visual focus further obtain the flat of other visual focus by the Fitting Calculation
Areal coordinate；
(2) hand exercise tracks；
The hand exercise model that people is obtained using existing hand exercise tracking device, according to hand exercise feature to " lifting ", " contracting
Put ", the gesture of " waving " tracked and identified；" lifting " gesture is characterized in that hand exercise range is greater than certain distance H, and
And the direction of motion is vertically to hoist movement from lower；" scaling " gesture is characterized in that hand opens shape from the state of clenching fist to palm
State (is put), or from palm open configuration to the state of clenching fist (contracting), and sets palm of the hand radius of a ball when clenching fist as Rw, and palm opens
When the palm of the hand radius of a ball be Rz, it is desired to Rw/Rz>K；" waving " gesture is characterized in that hand exercise direction is horizontal direction from left-hand
The right side moves from right to left, and movement velocity is greater than S；
(3) the target interaction of visual focus and hand exercise is merged；
The cursor center of circle is point a, and cursor radius is r, and user controls the movement of button cursor with visual focus, when cursor coverage goal
Afterwards, user carries out selection confirmation, final checked target by " lifting " gesture；When the size of target is too small and cursor is difficult to cover
When, user can expand cursor radius r by " scaling " gesture；
Cursor is stablized；The currently practical visual focus of user is set as g, the distance between practical visual focus and the cursor center of circle are d,
When user visual focus in cursor radius (d<=r) when, the position of cursor will not change, only when user's
Large range of transfer occurs for visual focus, i.e. visual focus exceeds cursor scope (d>When r), it just can accordingly change the position of cursor
It sets；On the one hand this cursor eliminates unstability caused by visual focus tracking accuracy error, i.e., user is in selection target
The stability of cursor is then laid particular emphasis on, on the other hand can be shifted again according to the biggish visual focus of amplitude and adjusts cursor position in time
It sets, user lays particular emphasis on the flexibility of cursor in mobile cursor, effectively helps user's better choice small size target；
Second selecting；There is a large amount of small size target closely to arrange on large-scale display interface, user by visual focus track into
It after row Primary Location, is tracked using hand exercise, the selection of set objective is completed by second selecting；User passes through " contracting first
Put " gesture expands the size of cursor, requirement to visual focus tracking accuracy when reducing selection small size target；It is all by cursor
The target of covering can be all added in preselected list；There are a select fingers in preselected list, when user passes through " lifting "
The target that pointer can be chosen to be directed toward when gesture confirmation selection, the target will become dark color；User is selected by " waving " gesture control
The movement for selecting pointer confirms again by " lifting " gesture and selects when it, which is directed toward user, wants the target of selection, completes to both
It sets the goal and completes accurately to select.
Optimization Mechanism；When target distribution is excessively intensive, the target that will lead to cursor while covering is excessive, so that utilizing secondary choosing
The overlong time for carrying out object filtering is selected, efficiency of selection is substantially reduced.For this purpose, the high low setting of a possibility that being selected according to target
Priority, the high target of priority will be easier selected.Specifically method is：User is selected using visual focus cursor
When, the coordinate of all visual focus in user's the past period T is recorded, and the coordinate average value of these visual focus is made
For the most probable visual focus coordinate of active user, which is known as predicting visual focus；Target position and prediction vision
Focus is closer, and priority is higher；Anyway.In addition, target priority will also be burnt according to prediction vision in preselected list
Put the variation of position and corresponding dynamic change；I is prediction visual focus, nearest with the target of the rightmost side, therefore the rightmost side
Target priority highest, so first be set in preselected list, it is preselected automatically, user is not required at this time
It " to wave " repeatedly to be switched, and directly be chosen with the confirmation of " lifting " gesture, improve efficiency of selection.
2. realize the target exchange method of visual focus and hand exercise tracking coordinated drive as described in claim 1 is
System, including be sequentially connected and feed data with lower module:
Visual focus tracking module extracts pupil and Purkinje image in eye image, calculates pupil and Purkinje image center is sat
Mark, then establishes pupil-corneal reflection vector with pupil center and Purkinje image center, and then establishes visual focus mapping mould
Type, coordinate of the computation vision focus on large-scale display interface；
Hand exercise tracking module obtains user's both hands model, and according to its motion feature, the hand exercise of real-time detection user is believed
Breath, and identify and distinguish between different gestures；
The target interactive module of visual focus and hand exercise is merged, the visual focus coordinate data for calculating obtain in real time is received,
And the hand exercise information and relevant gesture detected, corresponding interactive instruction is formed after fusion, controls large-scale display
Cursor on interface is mobile, specific to provide cursor stabilization, second selecting, and corresponding selection optimization function.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810636848.1A CN108874139B (en) | 2018-06-20 | 2018-06-20 | Target interaction method and system cooperatively driven by visual focus and hand motion tracking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810636848.1A CN108874139B (en) | 2018-06-20 | 2018-06-20 | Target interaction method and system cooperatively driven by visual focus and hand motion tracking |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108874139A true CN108874139A (en) | 2018-11-23 |
| CN108874139B CN108874139B (en) | 2021-02-02 |
Family
ID=64340756
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810636848.1A Active CN108874139B (en) | 2018-06-20 | 2018-06-20 | Target interaction method and system cooperatively driven by visual focus and hand motion tracking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108874139B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109917914A (en) * | 2019-03-05 | 2019-06-21 | 河海大学常州校区 | Interactive interface analysis and optimization method based on visual field position |
| CN110244844A (en) * | 2019-06-10 | 2019-09-17 | Oppo广东移动通信有限公司 | Control method and relevant apparatus |
| CN111290575A (en) * | 2020-01-21 | 2020-06-16 | 中国人民解放军空军工程大学 | Multichannel interactive control system of air defense anti-pilot weapon |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201638151U (en) * | 2010-01-29 | 2010-11-17 | 周幼宁 | Device for realizing virtual display and virtual interactive operation |
| WO2011106797A1 (en) * | 2010-02-28 | 2011-09-01 | Osterhout Group, Inc. | Projection triggering through an external marker in an augmented reality eyepiece |
| CN102447835A (en) * | 2011-10-29 | 2012-05-09 | 合肥博微安全电子科技有限公司 | Non-blind-area multi-target cooperative tracking method and system |
| CN103513771A (en) * | 2013-10-09 | 2014-01-15 | 深圳先进技术研究院 | System and method for using intelligent glasses in cooperation with interactive pen |
| CN103777754A (en) * | 2014-01-10 | 2014-05-07 | 上海大学 | Hand motion tracking device and method based on binocular infrared vision |
| CN105204629A (en) * | 2015-09-02 | 2015-12-30 | 成都上生活网络科技有限公司 | 3D (3-dimensional) gesture recognition method |
-
2018
- 2018-06-20 CN CN201810636848.1A patent/CN108874139B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201638151U (en) * | 2010-01-29 | 2010-11-17 | 周幼宁 | Device for realizing virtual display and virtual interactive operation |
| WO2011106797A1 (en) * | 2010-02-28 | 2011-09-01 | Osterhout Group, Inc. | Projection triggering through an external marker in an augmented reality eyepiece |
| CN102447835A (en) * | 2011-10-29 | 2012-05-09 | 合肥博微安全电子科技有限公司 | Non-blind-area multi-target cooperative tracking method and system |
| CN103513771A (en) * | 2013-10-09 | 2014-01-15 | 深圳先进技术研究院 | System and method for using intelligent glasses in cooperation with interactive pen |
| CN103777754A (en) * | 2014-01-10 | 2014-05-07 | 上海大学 | Hand motion tracking device and method based on binocular infrared vision |
| CN105204629A (en) * | 2015-09-02 | 2015-12-30 | 成都上生活网络科技有限公司 | 3D (3-dimensional) gesture recognition method |
Non-Patent Citations (2)
| Title |
|---|
| SHIWEI CHENG ET AL.: "designing eye gaze visualizations for online shopping social recommendations", 《IN PROCEEDING OF THE 2013 CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK COMPANION》 * |
| 程时伟 等: "面向阅读教学的眼动数据可视化批注方法", 《浙江工业大学学报》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109917914A (en) * | 2019-03-05 | 2019-06-21 | 河海大学常州校区 | Interactive interface analysis and optimization method based on visual field position |
| CN109917914B (en) * | 2019-03-05 | 2022-06-17 | 河海大学常州校区 | Interactive interface analysis and optimization method based on visual field position |
| CN110244844A (en) * | 2019-06-10 | 2019-09-17 | Oppo广东移动通信有限公司 | Control method and relevant apparatus |
| CN111290575A (en) * | 2020-01-21 | 2020-06-16 | 中国人民解放军空军工程大学 | Multichannel interactive control system of air defense anti-pilot weapon |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108874139B (en) | 2021-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11771988B2 (en) | System and method for controlling technical processes | |
| CN103518172B (en) | Stare auxiliary computer interface | |
| US20210263593A1 (en) | Hand gesture input for wearable system | |
| US20180307396A1 (en) | Operation control device and operation control method | |
| CN102662577B (en) | A kind of cursor operating method based on three dimensional display and mobile terminal | |
| US9310895B2 (en) | Touchless input | |
| KR101844390B1 (en) | Systems and techniques for user interface control | |
| US20110304650A1 (en) | Gesture-Based Human Machine Interface | |
| CN108874139A (en) | The target exchange method and system of visual focus and hand exercise tracking coordinated drive | |
| WO2015113503A1 (en) | Ring-type wireless finger controller, control method and control system | |
| CN105980965A (en) | Systems, devices, and methods for touch-free typing | |
| JP5264844B2 (en) | Gesture recognition apparatus and method | |
| CN102830797A (en) | Man-machine interaction method and system based on sight judgment | |
| CN105308536A (en) | Dynamic user interactions for display control and customized gesture interpretation | |
| CN101278251A (en) | Interactive large scale touch surface system | |
| CN109254662A (en) | Mobile device operation method, apparatus, computer equipment and storage medium | |
| KR102326489B1 (en) | Electronic device and method for controlling dispaying | |
| US20210081029A1 (en) | Gesture control systems | |
| CN109782920A (en) | One kind is for extending realistic individual machine exchange method and processing terminal | |
| Geer | Will gesture recognition technology point the way? | |
| TWI802456B (en) | Optical system with improved user experiemce and accurate eye-tracking and related method | |
| KR20210073429A (en) | Integration Interface Method and System based on Eye tracking and Gesture recognition for Wearable Augmented Reality Device | |
| CN106325480A (en) | Line-of-sight tracing-based mouse control device and method | |
| KR101335394B1 (en) | Screen touch apparatus at long range using 3D position of eyes and pointy object | |
| CN116107419A (en) | Method for interacting with electronic equipment and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |