CN106125931A - A kind of method and device of eyeball tracking operation - Google Patents
A kind of method and device of eyeball tracking operation Download PDFInfo
- Publication number
- CN106125931A CN106125931A CN201610499648.7A CN201610499648A CN106125931A CN 106125931 A CN106125931 A CN 106125931A CN 201610499648 A CN201610499648 A CN 201610499648A CN 106125931 A CN106125931 A CN 106125931A
- Authority
- CN
- China
- Prior art keywords
- pointer
- icon
- display screen
- eyeball tracking
- eyeball
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses the method and device of a kind of eyeball tracking operation, the method for this eyeball tracking operation includes: integrated described button in the apparatus starts described eyeball tracking function；Described movement locus and the described coordinate position of stop of display screen described in eyeball fixes is followed the tracks of, reflected to described eyeball tracking function；Described coordinate position is shown by described pointer in described display screen, the described pointer of described display and synchronizing moving described in described movement locus；Judge whether described pointer occurs described overlapping with icon described in described display screen, described button will make different operations according to described overlap, including: described pointer moves to, on the described icon in described display screen, described overlap occur, click on described button, run described iconic content；Described pointer does not occur described overlapping with icon described in described display screen, clicks on described button, exits described eyeball tracking function, and described pointer is closed in described display screen and disappears.When, after pointer with icon overlay, the order that button sends realizes the operation to icon by pointer.
Description
Technical field
The present invention relates to eyeball tracking field, particularly to eyeball tracking result is carried out button operation method and dress
Put.
Background technology
Eyeball tracking technology can be by the tracking to eyeball moving track, it is achieved position accurately.Eyeball tracking is applied
In one's hands mechanical, electrical in the equipment of grade, the particular location of eyeball fixes display screen can accurately be tracked.But want to pass through eyeball tracking
Realize the operation of function, there is certain difficulty, be particularly difficult to break through in terms of accuracy rate.In order to solve this problem,
Can reduce and identify and the scope of operation, so can improve efficiency.But so, range has limitation.
Using eyeball tracking function in mobile phone, the icon only needing eyes to face toward on display screen is watched attentively, eyeball tracking
Function just can accurately navigate to this icon.Manual screen sliding can be need not or clicking operation just can arrive the position watched attentively.
Along with the development of technology, the accuracy of eyeball tracking functional localization and locating speed will be become better and better.
Visible, have accurately and rapidly after positioning function, be more to need to operate accurately, meet user's
Demand.
Summary of the invention
For solving problem of the prior art, the present invention proposes the method and device of a kind of eyeball tracking operation, by aobvious
Pointer in display screen, the positioning result of display eyeball tracking function, button sends operation name to pointer, according to positioning result pair
Application program in display screen interface operates.
For achieving the above object, the method that the invention provides the operation of a kind of eyeball tracking, it is characterised in that be applied to end
End, the method includes:
Integrated described button in the apparatus starts described eyeball tracking function；
Described movement locus and the described coordinate of stop of display screen described in eyeball fixes is followed the tracks of, reflected to described eyeball tracking function
Position；
Described coordinate position is shown by described pointer in described display screen, the described pointer of described display and described fortune
Synchronizing moving described in dynamic track；
Judging whether described pointer occurs described overlapping with icon described in described display screen, described button will be according to described overlap
Make different operations, including:
Described pointer moves to, on the described icon in described display screen, described overlap occur, and clicks on described button, runs described
Iconic content；
Described pointer does not occur described overlapping with icon described in described display screen, clicks on described button, exits described eyeball and chases after
Track function, described pointer is closed in described display screen and disappears.
Described virtual key is an application icon in integrated described display screen in the apparatus.
Described application icon has multiple virtual functions key, is positioned by eyeball fixes and described eyeball tracking, automatically hold
The described virtual functions key function of row.
Described button is integrated on described remote controller, by wireless connections, and eyeball tracking function described in remote manipulation, described
Equipment has the radio receiver of correspondence；Described equipment has the radio receiver of correspondence.
Described eyeball tracking function is obtained by photographic head and follows the tracks of the described movement locus of display screen described in eyeball fixes
And the described coordinate position stopped.
Speed and residence time that described pointer moves keep consistent with the data of described eyeball tracking identification of function；Institute
State polygon frame or circle that pointer is a hollow.
Described pointer and icon occur described overlapping time, described pointer moves for grid type between icon, each figure
It is designated as a grid.
Described pointer realizes the movement of Grid Mobile when moving to the center of icon, and described grid is in icon
The heart band of position.
A kind of device of eyeball tracking operation, this device includes:
Operation module, integrated described button in the apparatus starts described eyeball tracking function.
Identification module, described eyeball tracking function follow the tracks of, reflection eyeball fixes described in display screen described movement locus and
The described coordinate position stopped.
Display module, described coordinate position is shown by described pointer in described display screen, the institute of described display
State pointer and synchronizing moving described in described movement locus.
Position module, it is judged that whether described pointer occurs described overlapping with icon described in described display screen, described button
Different operations will be made according to described overlap, including:
First judge module, described pointer moves on the described icon in described display screen, and described overlap occurs, and clicks on described
Button, performs described iconic content.
Second judge module, described pointer does not occur described overlapping with icon described in described display screen, presses described in click
Key, exits described eyeball tracking function, and described pointer is closed in described display screen and disappears.
Operator module, described virtual key is an application icon in integrated described display screen in the apparatus.
Virtual functions key module, has multiple virtual functions key in described application icon, by eyeball fixes and described eyeball
Tracing and positioning, performs described virtual functions key function automatically.
Radio operation module, described button is integrated on described remote controller, by wireless connections, eyeball described in remote manipulation
Tracking function, has the radio receiver of correspondence in described equipment.
Operator module, described eyeball tracking function is obtained by photographic head and follows the tracks of the institute of display screen described in eyeball fixes
State the described coordinate position of movement locus and stop.
The data of position submodule, speed that described pointer moves and residence time and described eyeball tracking identification of function
Keep consistent；Described pointer is polygon frame or the circle of a hollow.
First processing module, described pointer and icon occur described overlapping time, described pointer is grid type between icon
Mobile, each icon is a grid.
Second processing module, described pointer realizes the movement of Grid Mobile, institute when moving to the center of icon
State grid in icon center position area.
In embodiments of the present invention: by eyeball tracking function, eyeball moving track and described stop place are tracked
And location, and result is shown in display screen by pointer.Button sends operational order to pointer, when pointer and icon overlay
After, the order that button sends realizes the operation to icon by pointer.
Accompanying drawing explanation
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, in embodiment being described below required for make
Accompanying drawing be briefly described, it should be apparent that, below describe in accompanying drawing be only some embodiments of the present invention, for
From the point of view of those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to obtain other according to these accompanying drawings
Accompanying drawing.
Fig. 1 is the flow chart of the method for a kind of eyeball tracking operation that the embodiment of the present invention is introduced from terminal point.
Fig. 2 is the method for a kind of eyeball tracking operation that the embodiment of the present invention is introduced from terminal operation of virtual key angle
Flow chart.
Fig. 3 is the stream of the method for a kind of eyeball tracking operation that the embodiment of the present invention is introduced from terminal remote control work angle
Cheng Tu.
Fig. 4 is the flow chart of the method for a kind of eyeball tracking operation that the embodiment of the present invention is introduced from concrete operations angle.
Fig. 5 is the frame of the device of a kind of eyeball tracking operation that the embodiment of the present invention is introduced from terminal operation function aspects
Figure.
Fig. 6 is the frame of the device of a kind of eyeball tracking operation that the embodiment of the present invention is introduced from button operation function aspects
Figure.
Fig. 7 is the block diagram of the device of a kind of eyeball tracking operation that the embodiment of the present invention is introduced in terms of correlation function.
Detailed description of the invention
In order to make those skilled in the art be more fully understood that the present invention program, below in conjunction with in the embodiment of the present invention
Accompanying drawing, is clearly and completely described the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only
The embodiment of a present invention part rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people
The every other embodiment that member is obtained under not making creative work premise, all should belong to the model of present invention protection
Enclose.
The embodiment of the present application provides the method for a kind of eyeball tracking operation, and the method relates to shopping at network and logistics is joined
Send.Refer to Fig. 1, be the flow chart of the method for a kind of eyeball tracking operation that the embodiment of the present invention is introduced from terminal point.
As it is shown in figure 1, the method includes following step:
The integrated button in a device of step S101, a starts eyeball tracking function；
Starting eyeball tracking function by button, button is positioned in same equipment with the device of eyeball tracking function；Equipment is
Handhold mobile terminal equipment or device, button is generally arranged at the side of equipment, is the button of a physical arrangement, and button is eye
The function key that ball tracking function is opened, closed.
When being embodied as, in mobile phone, panel computer, click keys, eyeball tracking function on.
Movement locus and the coordinate bit of stop of eyeball fixes display screen is followed the tracks of, reflected to step S102, eyeball tracking function
Put；
In a device, eyeball tracking function the movement locus of eyeball and stop place of watching device display screen attentively are tracked and
Record.Movement locus and coordinate position range set are in eyeball fixes equipment in the range of display screen.Eyeball tracking device is to eye
The tracking of ball is moved for real-time synchronization and stops, and follows the trail of and also includes: the speed that eyeball moves.
When being embodied as, the eyeball tracking device being positioned in equipment, automatically after being unlocked, collects display screen model automatically
Enclose the position of interior eyeball fixes and the track of movement.During this, calculate by processor at device interior and process.
Step S103, coordinate position are shown by pointer in display screen, and the pointer of display is Tong Bu with movement locus
Mobile；
Pointer demonstrates positioning result and the movement locus of eyeball tracking function in display screen；Pointer is a compound display merit
The pointer of energy, pointer provides the effect of fixation and recognition simultaneously for eyeball tracking and button: pointer is for showing the fortune of eyeball tracking
Dynamic track and location information；Pointer also acts as the effect of a mouse pointer to button.
When being embodied as, after opening eyeball tracking function, only need the display screen of binocular fixation equipment, the pointer in display screen
Can along with the movement of eyeball synchronizing moving.Eyes see the somewhere of display screen, and pointer will move and show at eye gaze
Place.According to the place of eye gaze, user judges whether to need to perform operation by button voluntarily.
Step S104, judge whether pointer overlaps with icon in display screen, button by according to overlapping make different
Operation, including:
The operation of icon in display screen is built upon on the basis of pointer and icon set up overlapping relation by button, and button needs to exist
After pointer and icon overlap, icon could be carried out the operation of correspondence.Do not overlap between pointer and icon volume feelings
Under condition, click keys, it is defaulted as exiting eyeball tracking function.The executable order of button, including: open program application, close
Program, advance, retreat, maximize, the order such as minimize.
When being embodied as, it is, when user see one apply time, pointer moves to above the icon of this application, and
Sending overlap.By click keys, open icon, normally use software application.When needing to close application, eye gaze is to exiting
Button, pointer moves on exit button, click keys, performs to close the application of icon.
Step S105, pointer move to, on the icon in display screen, overlap, click keys, run iconic content；
The operation of button is between the icon in pointer and display screen, overlaps in moving process, click keys, and pointer connects
Receive and perform the operational order that icon corresponding to button sends.
When being embodied as, when eyeball fixes a to icon, pointer moves on this icon according to eyeball tracking function, and
Overlapping.Now, click keys, this icon is opened and runs.
Step S106, pointer do not overlap with icon in display screen, click keys, exit eyeball tracking function, pointer
Display screen is closed and disappears.
The operation of button is between the icon in pointer and display screen, in the case of not overlapping, and click keys, move back
Go out eyeball tracking function.
When being embodied as, when a white space in eyeball fixes to display screen, or sight line is directly off display screen,
Now, click keys, eyeball tracking function is closed, and pointer is closed the most simultaneously, and disappears in display screen.
In sum, in a device, the eyeball tracking function movement locus of eyeball and stop to watching device display screen attentively
Position is tracked and record.Pointer demonstrates positioning result and the movement locus of eyeball tracking function in display screen；Pointer
Being the pointer of a compound display function, pointer provides the effect of fixation and recognition simultaneously for eyeball tracking and button.Button needs
After pointer and icon overlap, icon could be carried out the operation of correspondence.Pointer performs the operational order of button.
Refer to Fig. 2, it illustrates the embodiment of the present invention and chase after from a kind of eyeball of terminal operation of virtual key angle introduction
The flow chart of the method for track operation.
As shown in Fig. 2, the method includes following step:
Step S201, button are an application icon in integrated display screen in a device；
Button is a virtual key in display screen, and eyeball tracking function is carried out operational order.Eyeball tracking merit will be started
Can make an addition in equipment by icon, open virtual key and eyeball tracking function by touch screen.When being embodied as, virtual key is used for
Eyeball tracking function is provided an operation providing the functions such as unlatching, closedown.Figure in eyeball tracking function with display screen
Mark overlapped after, click on virtual icon, can open by overlapping icon.
When being embodied as, manipulate virtual key by touching display screen, it is achieved the operation of corresponding function.Such as, eyeball
Tracking function navigates to eyeball and is just being look at wechat icon, clicks on the determination key in virtual key, opens wechat application program.
Step S202, application icon have multiple virtual functions key, is positioned by eyeball fixes and described eyeball tracking, from
The described virtual functions key function of dynamic execution；
Virtual key comprises multiple virtual functions key, it is provided that open, close, slide, advance, retreat, function is set etc., and with
Pointer is opened together, is closed.Virtual key icon provides slide in display screen.By eyeball fixes, any one is virtual
Function key, eyeball tracking function on is also to this virtual functions key enforcement location, and after confirming to watch attentively, system performs to be watched attentively automatically
Virtual functions key.
When being embodied as, by watching certain virtual key in display screen attentively, it is achieved the operation of corresponding function.Such as, micro-
In letter software, need to chat with someone, it is seen that after the information of this people.Watch the determination button of virtual functions key attentively, through the 1-2 second
Watch attentively, system opens the chat conversations frame with this people.
In sum, virtual key can realize manual clicking operation, in multiple virtual functions keys, watches some attentively empty
Intending function key certain time, system performs the order of this function key automatically.Performed order is overlapping to pointer and rests on
The operation that certain icon is implemented.
Refer to Fig. 3, it illustrates a kind of eyeball tracking that the embodiment of the present invention is introduced from terminal remote control work angle
The flow chart of the method for operation.
As shown in Fig. 3, step S301, button are integrated on a remote control, by wireless connections, remote manipulation eyeball tracking
Function, has the radio receiver of correspondence in equipment；
Button separates with equipment, and button becomes on wireless remote controller, by modes such as bluetooth, infrared ray, wireless, NFC to setting
The pointer on display screen in Bei is remotely controlled operation.In the display screen of display screen, received by embedded reception device and press
The information of key transmission.The information that the transmission such as eyeball tracking function receives bluetooth, communication of marching into the arena come, eyeball tracking merit is opened in remote control
Energy.Remote controller send information to the equipment with eyeball tracking function place, and equipment has the wireless receiver of reception information, receives
And perform relevant instruction.
When being embodied as, in the computer or television set of desktop computer, it is configured with eyeball tracking function, by eyeball tracking merit
The information that can identify, realizes operation by the method for remote controller, so, serves the convenience of a remote manipulation.Its ratio
For traditional remote controller, enhanced convenience in energy preferably function selecting, it is particularly well-suited in network intelligence TV.
In sum, in the equipment that button and equipment are separated from each other, realize the operation to pointer by wireless remote control, be
A kind of method of relative efficiency.The radio receiver added in a device and the remote controller dispensing device at button place, the two
Being integrated and be mutually matched, cooperate execution and reception order.Remote controller is that eyeball tracking function is implemented remote manipulation, still
Being based on eyeball tracking function to position eyeball, and show in display screen by pointer, pointer is sending weight with icon
Poststack, accepts the operational order of remote controller.
Refer to Fig. 4, it illustrates what the embodiment of the present invention operated from a kind of eyeball tracking that concrete operations angle is introduced
The flow chart of method.
As shown in Fig. 4, the method includes following step:
Step S401, eyeball tracking function obtain and follow the tracks of the movement locus of eyeball fixes display screen and stop by photographic head
Coordinate position；
Ocular movement and the track of stop and the identification of position is realized by photographic head, by processing means identification, judgement, will letter
Breath is shown on a display screen by pointer.Also include: obtain eyeball moving track by infrared ray.
When being embodied as, photographic head or infrared equipment carry out real-time tracking to the motion of eyeball, result are sent
Process in the device of eyeball tracking, result is shown in display screen by pointer.The device of eyeball tracking function is
One independent device, eyeball can be moved by this device provides trackings, the function of location, and had will tracking and determining
The result of position is shown in display screen by pointer.Further, eyeball tracking function receives the operation of button, and it is not the work of intelligence
Make, and be dependent on the judgement of user, perform operation by button.During this, user will play the most subjective
Motility.This is also beneficial to improve the accuracy identifying, operating.
Speed and residence time that step S402, pointer move keep consistent with the data of eyeball tracking identification of function；
Pointer is polygon frame or the circle of a hollow.
Pointer realizes synchronizing the relevant information that reflection eyeball tracking function captures.In the moving process of pointer, more can
Adapt to user, do not have nonsynchronous problem.The frame of hollow structure, indicates bigger contact area with figure, in contact
During also relative to easily determine.Its hollow structure ensure that pointer, being combined with icon when, will not block icon.Refer to
Pin profile size is suitable with icon, and pointer is the most just wrapped in the outside of icon, reduces the situation of misrecognition.Pointer is a frame
Structure, can increase visual recognition effect, and will not block icon, convenient observation and use.
When being embodied as, pointer can be with eyeball synchronizing moving, it is ensured that comfortableness during use and accuracy.Pointer and eye
The operation of ball real-time synchronization, the speed including movement is also the same.So, will be the most comfortable during use.Reach to synchronize
The effect used.User can be allowed the most not have lagging feeling or Excessive sensitivity produces unconformable sensation.
When pointer is a light tetragon frame, and four angles are rounded, and also include: a circle, are that icon overlaps
After, do not block observation icon.
When step S403, pointer and icon overlap, pointer moves for grid type between icon, and each icon is
One grid；
Pointer, near icon, moves according to the position of eyeball and realizes grid type on icon and move, it may be assumed that
Pointer moves between icon and icon, is not to fully rely on coordinate position and movement locus moves, when hand motion trend
It is to leave the region in icon sets, recovers and be other movement locus synchronizing moving according to eyeball tracking, and react is real
The coordinate position on border.
When being embodied as, pointer is when close to icon, and the position of pointer is moving one by one between icon of gridding.Not
Reflection eyeball tracking arrives completely actual movement position and track.After pointer keeps certain distance with icon, beg tracking
Effect and the state of real-time synchronization is replied between function and pointer.
Step S404, pointer realize the movement of Grid Mobile when moving to the center of icon, and grid is at icon
Center position area.
It is only the sub-fraction region in the middle of icon that icon can perform the region that gridding moves, and so, facilitates pointer more
Good close and icon of leaving away, for selecting and move to provide conveniently.
When being embodied as, when pointer close to the central area of icon is soon, pointer is guided to figure by figure rotating savings automatically
Target central area.So, just can be operated more accurately by button.Equally, in the process carrying out moving to next icon
In, after leaving central area, between icon and icon, have a buffer area, enter next icon central area time
Wait, have a little buffering excessive.
In sum, ocular movement and the track of stop and position are realized by photographic head or infrared lamp unit
Identification, synchronize the reflection relevant information that captures of eyeball tracking function.Entered in display screen by the pointer with border structure
Row display, after overlap, does not affect observation icon information.Further, pointer close to icon when, gridding can be converted to
Movement, it may be assumed that an icon is a grid, and grid can also be arranged in the portion central region of icon.
Refer to Fig. 5, this device includes:
Operation module 501, integrated button in a device starts eyeball tracking function；
Identification module 502, movement locus and the coordinate bit of stop of eyeball fixes display screen is followed the tracks of, reflected to eyeball tracking function
Put；
Display module 503, coordinate position is shown by pointer in display screen, and the pointer of display is Tong Bu with movement locus to be moved
Dynamic；
Position module 504, it is judged that whether pointer overlaps with icon in display screen, button will make different behaviour according to overlapping
Make, including:
First judge module 505, pointer moves to, on the icon in display screen, overlap, click keys, performs in icon
Hold；
Second judge module 506, pointer does not overlaps with icon in display screen, and click keys exits eyeball tracking function, refers to
Pin is closed in display screen and disappears.
In sum, opening eyeball tracking function by the way of physical button, button includes: physical button and display
Virtual key in screen.Eyeball tracking function effectively follows the tracks of the position of eye gaze display screen, and record also reflects eyeball in real time
The track of motion in display screen.Further, pointer is a translucent effect.
Eyeball fixes and the position of stop, shown by pointer in display screen, and oculomotor track also can pass through
The real-time reflection of pointer is on a display screen.It is almost ocular movement and stops the effect keeping synchronizing.
The pointer of display screen, if sending location overlap with the icon in equipment, pressing A Jian, performing the function of icon.
The overlapping range of pointer is after sending overlap, and has the operation of pressing keys, determines operation: when pointer and two icon overlay,
Perform the icon function more with icon overlay；When not overlapping with icon when, then perform the order exited.
Refer to Fig. 6, it illustrates a kind of eyeball tracking operation that inventive embodiments is introduced from button operation function aspects
The block diagram of device.
As shown in Figure 6, this device includes:
Operator module 601, virtual key is an application icon in integrated display screen in a device；
Virtual functions key module 602, has multiple virtual functions key in application icon, positioned by eyeball fixes and eyeball tracking,
Automatically virtual functions key function is performed.
Radio operation module 603, button is integrated on a remote control, by wireless connections, remote manipulation eyeball tracking function,
Equipment has the radio receiver of correspondence.
In sum, button further comprises the application icon of virtual key and correspondence, and this virtual key and application icon are all
It is integrated in the display screen of equipment and carries out showing and using, operate.Further comprises remote controller and eyeball tracking function is implemented wireless
Operation.Now, button is to be separately positioned in different devices from the eyeball tracking function in equipment.Also need in a device
There is radio receiver, the normal use of guarantee remote controller.
Refer to Fig. 7, it illustrates the dress of a kind of eyeball tracking operation that inventive embodiments is introduced in terms of correlation function
The block diagram put.
As it is shown in fig. 7, this device includes:
Operator module 701, eyeball tracking function obtained by photographic head and follow the tracks of eyeball fixes display screen movement locus and
The coordinate position stopped.
Position submodule 702, speed and the data of residence time and eyeball tracking identification of function that pointer moves keep
Unanimously；Pointer is polygon frame or the circle of a hollow.
First processing module 703, when pointer and icon overlap, pointer moves for grid type between icon, each
Individual icon is a grid；
Second processing module 704, pointer realizes the movement of Grid Mobile when moving to the center of icon, and grid is at figure
Mark center position area.
In sum, realizing eyeball tracking function by the equipment such as photographic head or infrared ray, pointer real-time synchronization reflects
Go out the movement locus of eyeball tracking function and the position of location, and receive the instruction of button, the icon in display screen is implemented one
Individual unlatching, the operation of closedown, concrete name realizes in the case of being based on pointer and icon sending overlap.According to virtual graph
The content of mark display, performs corresponding operation name.In display screen white space click keys, it is achieved that eyeball tracking function and
Exit while pointer.
Claims (10)
1. the method for an eyeball tracking operation, it is characterised in that described method includes:
Integrated described button in the apparatus starts described eyeball tracking function；
Described movement locus and the described coordinate of stop of display screen described in eyeball fixes is followed the tracks of, reflected to described eyeball tracking function
Position；
Described coordinate position is shown by described pointer in described display screen, the described pointer of described display and described fortune
Synchronizing moving described in dynamic track；
Judging whether described pointer occurs described overlapping with icon described in described display screen, described button will be according to described overlap
Make different operations, including:
Described pointer moves to, on the described icon in described display screen, described overlap occur, and clicks on described button, runs described
Iconic content；
Described pointer does not occur described overlapping with icon described in described display screen, clicks on described button, exits described eyeball and chases after
Track function, described pointer is closed in described display screen and disappears.
Method the most according to claim 1, it is characterised in that be applied to described virtual key, the method also includes:
Described virtual key is an application icon in integrated described display screen in the apparatus；
Described application icon has multiple virtual functions key, is positioned by eyeball fixes and described eyeball tracking, automatically perform institute
State virtual functions key function.
Method the most according to claim 1, it is characterised in that the described button being applied in described remote controller, the method
Also include:
Described button is integrated on described remote controller, by wireless connections, and eyeball tracking function described in remote manipulation, described equipment
In have correspondence radio receiver；Described equipment has the radio receiver of correspondence.
Method the most according to claim 1, it is characterised in that be applied to described eyeball tracking and in described display screen institute
Stating the display of pointer, the method also includes:
Described eyeball tracking function is obtained by photographic head and follows the tracks of the described movement locus of display screen described in eyeball fixes and stop
The described coordinate position stayed；
Speed and residence time that described pointer moves keep consistent with the data of described eyeball tracking identification of function；Described finger
Pin is polygon frame or the circle of a hollow.
Method the most according to claim 1, it is characterised in that be applied to position between described pointer and described icon and close
System, the method also includes:
Described pointer and icon occur described overlapping time, described pointer moves for grid type between icon, and each icon is
One grid；
Described pointer realizes the movement of Grid Mobile when moving to the center of icon, and described grid is at icon centre bit
Put region.
6. the device of an eyeball tracking operation, it is characterised in that this device includes:
Operation module, integrated described button in the apparatus starts described eyeball tracking function；
Identification module, described movement locus and the stop of display screen described in eyeball fixes is followed the tracks of, reflected to described eyeball tracking function
Described coordinate position；
Display module, described coordinate position is shown by described pointer in described display screen, the described finger of described display
Pin and synchronizing moving described in described movement locus；
Position module, it is judged that whether described pointer occurs described overlapping with icon described in described display screen, and described button will depend on
Different operations is made according to described overlap, including:
First judge module, described pointer moves on the described icon in described display screen, and described overlap occurs, and clicks on described
Button, performs described iconic content；
Second judge module, described pointer does not occur described overlapping with icon described in described display screen, clicks on described button, move back
Going out described eyeball tracking function, described pointer is closed in described display screen and disappears.
Device the most according to claim 6, it is characterised in that be applied to described virtual key, this device also includes:
Operator module, described virtual key is an application icon in integrated described display screen in the apparatus；
Virtual functions key module, has multiple virtual functions key in described application icon, by eyeball fixes and described eyeball tracking
Location, performs described virtual functions key function automatically.
Device the most according to claim 6, it is characterised in that the described button being applied in described remote controller, this device
Also include:
Radio operation module, described button is integrated on described remote controller, by wireless connections, eyeball tracking described in remote manipulation
Function, has the radio receiver of correspondence in described equipment.
Method the most according to claim 6, it is characterised in that be applied to described eyeball tracking and in described display screen institute
Stating the display of pointer, this device also includes:
Operator module, described eyeball tracking function is obtained by photographic head and follows the tracks of the described fortune of display screen described in eyeball fixes
Dynamic track and the described coordinate position of stop；
Position submodule, speed and the data of residence time and described eyeball tracking identification of function that described pointer moves keep
Unanimously；Described pointer is polygon frame or the circle of a hollow.
Device the most according to claim 6, it is characterised in that be applied to position between described pointer and described icon and close
System, this device also includes:
First processing module, described pointer and icon occur described overlapping time, described pointer moves for grid type between icon,
Each icon is a grid；
Second processing module, described pointer realizes the movement of Grid Mobile, described net when moving to the center of icon
Lattice are in icon center position area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610499648.7A CN106125931A (en) | 2016-06-30 | 2016-06-30 | A kind of method and device of eyeball tracking operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610499648.7A CN106125931A (en) | 2016-06-30 | 2016-06-30 | A kind of method and device of eyeball tracking operation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106125931A true CN106125931A (en) | 2016-11-16 |
Family
ID=57284809
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610499648.7A Pending CN106125931A (en) | 2016-06-30 | 2016-06-30 | A kind of method and device of eyeball tracking operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106125931A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107223276A (en) * | 2017-04-26 | 2017-09-29 | 深圳市汇顶科技股份有限公司 | Eyeball remote control system and electronic installation |
| CN107390874A (en) * | 2017-07-27 | 2017-11-24 | 深圳市泰衡诺科技有限公司 | A kind of intelligent terminal control method and control device based on human eye |
| CN107506030A (en) * | 2017-08-16 | 2017-12-22 | 陈乾 | Depending on controlling instrument |
| CN109597489A (en) * | 2018-12-27 | 2019-04-09 | 武汉市天蝎科技有限公司 | A kind of method and system of the eye movement tracking interaction of near-eye display device |
| CN111223251A (en) * | 2019-12-31 | 2020-06-02 | 航天信息股份有限公司 | Method and system for processing information based on eyeball tracking technology |
| CN112748798A (en) * | 2019-10-31 | 2021-05-04 | Oppo广东移动通信有限公司 | Eyeball tracking calibration method and related equipment |
| WO2022193989A1 (en) * | 2021-03-16 | 2022-09-22 | 展讯通信（上海）有限公司 | Operation method and apparatus for electronic device and electronic device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693022A (en) * | 2011-12-12 | 2012-09-26 | 苏州科雷芯电子科技有限公司 | Vision tracking and voice identification mouse system |
| CN104571528A (en) * | 2015-01-27 | 2015-04-29 | 王露 | Eyeball tracking-based IT (intelligent terminal) control device and method |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN105511620A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | Chinese three-dimensional input device, head-wearing device and Chinese three-dimensional input method |
-
2016
- 2016-06-30 CN CN201610499648.7A patent/CN106125931A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693022A (en) * | 2011-12-12 | 2012-09-26 | 苏州科雷芯电子科技有限公司 | Vision tracking and voice identification mouse system |
| CN104571528A (en) * | 2015-01-27 | 2015-04-29 | 王露 | Eyeball tracking-based IT (intelligent terminal) control device and method |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN105511620A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | Chinese three-dimensional input device, head-wearing device and Chinese three-dimensional input method |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107223276A (en) * | 2017-04-26 | 2017-09-29 | 深圳市汇顶科技股份有限公司 | Eyeball remote control system and electronic installation |
| CN107390874A (en) * | 2017-07-27 | 2017-11-24 | 深圳市泰衡诺科技有限公司 | A kind of intelligent terminal control method and control device based on human eye |
| CN107506030A (en) * | 2017-08-16 | 2017-12-22 | 陈乾 | Depending on controlling instrument |
| CN109597489A (en) * | 2018-12-27 | 2019-04-09 | 武汉市天蝎科技有限公司 | A kind of method and system of the eye movement tracking interaction of near-eye display device |
| CN112748798A (en) * | 2019-10-31 | 2021-05-04 | Oppo广东移动通信有限公司 | Eyeball tracking calibration method and related equipment |
| CN111223251A (en) * | 2019-12-31 | 2020-06-02 | 航天信息股份有限公司 | Method and system for processing information based on eyeball tracking technology |
| CN111223251B (en) * | 2019-12-31 | 2023-01-10 | 航天信息股份有限公司 | Method and system for processing information based on eyeball tracking technology |
| WO2022193989A1 (en) * | 2021-03-16 | 2022-09-22 | 展讯通信（上海）有限公司 | Operation method and apparatus for electronic device and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106125931A (en) | A kind of method and device of eyeball tracking operation | |
| KR101793566B1 (en) | Remote controller, information processing method and system | |
| CN104410883B (en) | The mobile wearable contactless interactive system of one kind and method | |
| CN103530061B (en) | Display device and control method | |
| CN102937832B (en) | A kind of gesture method for catching of mobile terminal and device | |
| WO2015113503A1 (en) | Ring-type wireless finger controller, control method and control system | |
| CN108646997A (en) | A method of virtual and augmented reality equipment is interacted with other wireless devices | |
| US20160098094A1 (en) | User interface enabled by 3d reversals | |
| EP2661091B1 (en) | Controlling a graphical user interface | |
| WO2013139181A1 (en) | User interaction system and method | |
| CN103019377A (en) | Head-mounted visual display equipment-based input method and device | |
| CN103442129A (en) | Interactive method and system between intelligent watch and mobile terminal | |
| KR102147430B1 (en) | virtual multi-touch interaction apparatus and method | |
| US20120229509A1 (en) | System and method for user interaction | |
| TW201447373A (en) | Display control apparatus, display apparatus, display control method, and program | |
| CN105094645A (en) | Information processing method and electronic equipment | |
| CN106468917B (en) | A kind of long-range presentation exchange method and system of tangible live real-time video image | |
| CN107452119A (en) | virtual reality real-time navigation method and system | |
| CN109189353A (en) | A kind of double screen switching method and mobile terminal | |
| CN109451141A (en) | A kind of method of controlling operation thereof and associated terminal | |
| JP2021192240A (en) | Portable communication terminal, directivity input unit and method relevant to the same | |
| CN110362231A (en) | The method and device that new line touch control device, image are shown | |
| CN107390874A (en) | A kind of intelligent terminal control method and control device based on human eye | |
| CN106896920A (en) | Virtual reality system, virtual reality device, virtual reality control device and method | |
| CN111367483A (en) | Interaction control method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161116 |