CN107390874A - A kind of intelligent terminal control method and control device based on human eye - Google Patents
A kind of intelligent terminal control method and control device based on human eye Download PDFInfo
- Publication number
- CN107390874A CN107390874A CN201710623311.7A CN201710623311A CN107390874A CN 107390874 A CN107390874 A CN 107390874A CN 201710623311 A CN201710623311 A CN 201710623311A CN 107390874 A CN107390874 A CN 107390874A
- Authority
- CN
- China
- Prior art keywords
- intelligent terminal
- eye
- pointer
- module
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 210000001508 eye Anatomy 0.000 claims abstract description 137
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 82
- 230000009471 action Effects 0.000 claims abstract description 49
- 230000008859 change Effects 0.000 claims abstract description 17
- 238000004891 communication Methods 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 10
- 230000004397 blinking Effects 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000000193 eyeblink Effects 0.000 claims description 5
- 238000000465 moulding Methods 0.000 claims 1
- 230000033001 locomotion Effects 0.000 abstract description 12
- 238000012544 monitoring process Methods 0.000 abstract 1
- 230000004438 eyesight Effects 0.000 description 18
- 230000000875 corresponding effect Effects 0.000 description 8
- 230000001276 controlling effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000012800 visualization Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000012512 characterization method Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000003756 stirring Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
One aspect of the present invention provides a kind of intelligent terminal control method based on human eye, and it comprises the following steps：A pointer image is shown on the display interface of intelligent terminal, the preposition photographing module of intelligent terminal catches eye image, the eyeball tracking module of intelligent terminal identifies the eyeball in human eye in eye image, follow the trail of the change of the eye position of human eye, an eye position information is sent to pointer control module, pointer control module controls pointer image to be moved to the eye position according to eye position information.A kind of another aspect of the present invention, there is provided intelligent terminal control device based on human eye.The present invention utilizes configuration eyeball control module and pointer control module in intelligent terminal, realize and utilize the movement for monitoring user eyeball, control the movement of pointer image on intelligent terminal display interface, with perform action, the control to each application program in intelligent terminal is realized, greatly improves the convenience and validity of intelligent terminal control operation.
Description
Technical field
The present invention relates to the control technology field of intelligent terminal, more particularly to a kind of intelligent terminal controlling party based on human eye
Method and control device.
Background technology
With the development of science and technology and progressive, intelligent terminal is constantly reformed.Currently, intelligent terminal is because its is multi-functional
Property and portability gradually penetrate into people life every aspect.Particularly, the development of intelligent terminal touch screen pattern, frees
Dependence of the intelligent terminal to keyboard, make the indication range of intelligent terminal bigger, while user relies on both hands and shown in intelligent terminal
The icon or other shortcuts for touching application program etc. are put on interface, you can realize and start or close corresponding application program,
Give the bigger freedom that user operates to intelligent terminal.
However, have phone invitation when the both hands of user are occupied, for example drive, or the disability for both hands inconvenience
Personage, either conventional key mobile phone and be existing full frame mobile phone, it is manually operated that it is required to user, so as to for portion
Divide and be used for, its convenience stills need to improve.At present, problems are also gradually recognized in this area, and constantly release not
Same intelligent terminal control method.
Such as, the A of patent CN 105487646 disclose a kind of gesture remote control intelligent terminal system, and it includes intelligent terminal and taken the photograph
As head, the gesture of identification gesture motion characterization image is understood with bi-coordinate system method, realizes effective gesture identification, and then complete hand
Gesture mode remote-controlled intelligent terminal, improves the operability of intelligent terminal, has expanded the application function of intelligent terminal.
The method and apparatus of acoustic control intelligent terminal when the A of patent CN 104580699 disclose a kind of standby, it includes, in intelligence
When energy terminal is in holding state, start default pronunciation receiver collection user speech information, the user's language that will be collected
Message breath is matched with the default voice messaging in intelligent terminal, according to matching result, performs the user speech information
Predetermined registration operation corresponding to the default voice messaging being fitted on.So as to which it is default that user can control intelligent terminal to perform by voice
Operation.
The A of patent CN 102750146 disclose a kind of method that analog mouse control is realized in intelligent terminal and intelligence eventually
End, it includes, and runs the user-defined press key respective service in the application framework layer of Android system, to receive from the external world
Remote command, while mouse images are shown in intelligent terminal display interface, so as to refer in the remote control for receiving the external world come
After order, the mouse control interface of Android system driving layer is called according to the telecommand, using mouse control interface in intelligence
Mouse function is realized in terminal display interface.
Therefore at present, in the market proposes numerous intelligent terminals from fields such as acoustic control, gesture control, analog mouses
Control method, to improve the convenience of intelligent terminal control, however, intelligent terminal control method of the prior art depends on more
The operation of user's both hands, although speech-control has been applied, the usage experience of user is also given in its dependence to language standard's property
Bring great inconvenience.
The content of the invention
To solve the above problems, the present invention provides a kind of intelligent terminal control method and control device based on human eye, its
Using eyeball control module and pointer control module is configured in intelligent terminal, by its mutual cooperation work, realize and utilize prison
The movement of user eyeball is controlled, obtains the change of human eye sight, so as to control the shifting of pointer image on intelligent terminal display interface
It is dynamic, and action is performed, the control to each application program in intelligent terminal is realized, greatly improves the convenient of intelligent terminal control operation
Property and validity.
Specifically, one aspect of the present invention provides a kind of intelligent terminal control method based on human eye, and it comprises the following steps：
A pointer image is shown on the display interface of the intelligent terminal；The preposition photographing module of the intelligent terminal catches the people
The eye image of eye；The eyeball tracking module of the intelligent terminal identifies the eyeball in the human eye in the eye image,
The change of the eye position of the human eye is followed the trail of, an eye position information is sent to the pointer control module of the intelligent terminal；
The pointer control module controls the pointer image to be moved to the eye position according to the eye position information.
Preferably, the control method is further comprising the steps of, described in the blink identification module identification of the intelligent terminal
The blink action of human eye and number of winks, action message and number of winks data, the pointer control module connect at a wink for transmission
The blink action message and the number of winks data are received, control the pointer image to perform action.
Preferably, when blink action is blinked for left eye, the pointer image performs left click action, the blink action
Blinked for right eye, the pointer image performs right click action, and the number of winks performs the number clicked on the pointer image
Correspond.
Preferably, the eyeball tracking module of the intelligent terminal identifies the eye in the human eye according to the eye image
The step of ball, following the trail of the change of the eye position of the human eye, an eye position information is sent to the pointer control module is wrapped
Include, the eyeball tracking module follows the trail of the eyeball change in the human eye, and sends the eyeball delta data, and the intelligence is eventually
The data processing module at end receives the delta data, the eye position of the human eye is calculated, and send an eye position
Information.
Another aspect of the present invention, it is to provide a kind of intelligent terminal control device based on human eye, it is included with lower module：
Image display, a pointer image is shown on the display interface of the intelligent terminal；Preposition photographing module, including preposition take the photograph
Picture head, catch the eye image of the human eye；Eyeball tracking module, connected with the preposition photographing module communication, in the people
Eyeball in the human eye is identified in eye pattern picture, follows the trail of the change of the eye position of the human eye, is sent out to the pointer control module
Send an eye position information；Pointer control module, it is connected with the eyeball tracking module communication, receives the eye position letter
Breath, and control the pointer image to be moved to the eye position according to the eye position information.
Preferably, above-mentioned control device also includes, identification module of blinking, and connects, knows with the preposition photographing module communication
Others' eye blink acts and number of winks, and action message and number of winks data, the pointer control module connect at a wink for transmission
The blink action message and the number of winks data are received, control the pointer image to be performed according to the number of winks data
Action.
Preferably, when blink action is blinked for left eye, the pointer image performs left click action, the blink action
Blinked for right eye, the pointer image performs right click action, and the number of winks performs the number clicked on the pointer image
Correspond.
Preferably, above-mentioned control device also includes, data processing module, is connected, connects with the eyeball tracking module communication
The delta data of the eyeball in the human eye that the eyeball tracking module is sent is received, the sight position of the human eye is calculated
Put, and send an eye position information.
Compared with prior art, the technical advantages of the present invention are that：
1) present invention realizes the mobile control intelligent terminal using human eye eyeball, performs desired operation, liberates existing intelligence
The dependence of energy terminal-pair user's both hands, greatly improve the convenience of intelligent terminal control；
2) present invention realizes that analog mouse operates in intelligent terminal, by visual pointer image, by user to intelligence
Can terminal operation visualization, be control operation of the control that becomes apparent from of user to intelligent terminal；
3) present invention passes through its mutual cooperation using eyeball control module and pointer control module is configured in intelligent terminal
Work, greatly improves accuracy of the user to application program controlling in intelligent terminal.
Brief description of the drawings
Fig. 1 is the schematic diagram of an intelligent terminal control method based on human eye for meeting one embodiment of the present invention；
Fig. 2 is the structure chart of an intelligent terminal control device based on human eye for meeting one embodiment of the present invention.
Embodiment
With reference to meeting and specific embodiment, the advantage of the present invention is elaborated.
Fig. 1 is participated in, it is showing for an intelligent terminal control method based on human eye for meeting one embodiment of the present invention
It is intended to.It can be seen that the control method of the intelligent terminal based on human eye provided in the present embodiment is mainly including following
Step：
- start human eye control program
First, user needs according to demand, and e.g., will carry out vehicle drive or other needs to account for bimanual activity
When, also or by way of voice, it can be carried by way of touching corresponding the instruction icon or shortcut in intelligent terminal
Human eye control program in preceding startup intelligent terminal.
- display pointer image；
After the display interface of intelligent terminal is activated, a pointer image, institute will be shown in the display interface of intelligent terminal
Mouse pointer of the pointer image similar to Computer display is stated, it can select or choose corresponding application according to the instruction of user
Program icon or shortcut, to start or to carry out other operations to the application program.Preferably, the pointer image
Can be arrow, hand etc..
- capture eye image
After the human eye control program is started, the preposition photographing module of the intelligent terminal will be opened on backstage, when with
When family places its face in the image pickup scope of the preposition photographing module, the preposition photographing module can catch face especially
The image of human eye.
- tracking human eye sight
When the eyeball tracking module of the intelligent terminal detects that catcher's face described in the preposition photographing module is special
When being eye image, it will further identify human eye eyeball, and monitor the change in location of human eye sight in real time, and by human eye sight
Positional information after change is timely sent.
It is further preferred that in the present embodiment, when the eyeball tracking module detect human eye eyeball it is mobile when, it will
The information such as displacement, direction to the data processing module transmission human eye eyeball of the intelligent terminal, and data processing module
After receiving above-mentioned eyeball mobile message, the shift position and direction of human eye sight according to eye tracking algorithm, will be calculated, will be obtained
The current location of human eye sight, and it is sent out a human eye sight positional information.
- control pointer image the movement
The pointer control module of the intelligent terminal is connected with the eyeball tracking module communication, and it can receive the human eye
Eye position information, and the pointer image is moved to according to the human eye sight positional information position of user's desired operation
On.So as to realize the change using human eye, pointer image is moved according to the wish of user.On the one hand user's both hands have been freed；Separately
On the one hand, operation of the user to intelligent terminal is made to be intended to visualization.
It is further preferred that the control method is further comprising the steps of,
The action of-identification blink and number
, can be by blinking eyes, further after pointer image is moved to desired position by user using the movement of eyeball
Realize startup or the operation to selected application program.Specifically, in the present embodiment, user keeps the existing position of eyeball, blinks
Eyes, the blink identification module of the intelligent terminal will identify the action of human eye blink and number of winks, and be sent out at a wink
Action message and number of winks data, the pointer control module shell receive the blink action message and the number of winks number
According to, and according to the concrete operations of above-mentioned blink, control the pointer image to perform corresponding action.
It is further preferred that in the present embodiment, when blink action is blinked for left eye, the pointer image performs left click and moved
To make, the blink action is blinked for right eye, and the pointer image performs right click action, and, the number of winks and the pointer
Image performs the number clicked on and corresponded.
Below, the operating method of the present invention will by concrete practice, be elaborated.
Embodiment one：Mobile eyeball is called
When user during driving vehicle in the case where wishing to call or other both hands being not convenient, Yong Huke
To start the human eye control program of its intelligent terminal by shortcut, then, intelligent terminal interface will occur a pointer figure accordingly
Picture；
Then, user places its face face in the image pickup scope of the preposition photographing module, so that preposition shooting
Its eyes image of module.Now, the eyeball tracking module of intelligent terminal will be in catcher's eye described in the preposition photographing module
Human eye eyeball is identified in image；
User eyeball keeps existing position, moves eyeball according to wish, watches address list attentively.Then, eyeball tracking module enters one
The movement of step tracking user eyeball, and position the position after eyeball movement, sends to pointer control module, pointer control module from
And control on the address list that the pointer image locks to user；
User keeps watching address list attentively, blinks left eye twice.Now, the blink identification module of the intelligent terminal will be known
Not, and it is sent out blinking left eye, blinks data message twice, the pointer control module of the intelligent terminal receives data letter
Breath, correspondingly, controls the pointer image left click twice in succession.So as to which the address list of intelligent terminal is opened.
Further, user moves eyeball, watches attentively and pre- dials contact person.Then, eyeball tracking module further tracks user's eye
The movement of ball, and position the position after eyeball movement, sends to pointer control module, and pointer control module is so as to controlling the finger
On the contact person that pin image locks to user.
User keeps watching selected contact person attentively, blinks left eye once.Now, the blink identification module of the intelligent terminal will
Identification, and be sent out blinking left eye, data message once is blinked, the pointer control module of the intelligent terminal receives data
Information, correspondingly, control the pointer image left click once.So as to which intelligent terminal selectes contact person's outgoing call to user.
In view of above-mentioned setting, user realizes the operation called in the case of without using both hands.
Embodiment two：Browsing pictures
First, likewise, user can start the human eye control program of its intelligent terminal by shortcut, then, intelligence is eventually
End interface will occur a pointer image accordingly；
Then, user places its face face in the image pickup scope of the preposition photographing module, so that preposition shooting
Its eyes image of module.Now, the eyeball tracking module of intelligent terminal will be in catcher's eye described in the preposition photographing module
Human eye eyeball is identified in image；
User eyeball keeps existing position, moves eyeball according to wish, watches picture library icon attentively.Then, eyeball tracking module is entered
One step tracks the movement of user eyeball, and positions the position after eyeball movement, sends to pointer control module, pointer control module
So as to control on the picture library icon that the pointer image locks to user；
User keeps watching picture library icon attentively, blinks left eye twice.Now, the blink identification module of the intelligent terminal will be known
Not, and it is sent out blinking left eye, blinks data message twice, the pointer control module of the intelligent terminal receives data letter
Breath, correspondingly, controls the pointer image left click twice in succession.So as to which the picture library of intelligent terminal is opened.
Further, user quickly moves eyeball from right to left.Then, eyeball tracking module further tracks the shifting of user eyeball
It is dynamic, and by eyeball moving track, send to pointer control module, pointer control module is so as to controlling the pointer image from dextrad
Left slip, so as to stir picture in picture library, browse and check for user.
In view of above-mentioned setting, user realizes the operation of browsing pictures in the case of without using both hands.
Another aspect of the present invention, referring to Fig. 2, it meets the intelligence based on human eye of one embodiment of the present invention eventually for one
Hold the structure chart of control device.As can be seen from the figure the present embodiment provides a kind of intelligent terminal control device based on human eye,
It is included with lower module：Image display；Preposition photographing module；Eyeball tracking module and pointer control module.Specifically such as
Under：
- image display
Described image display module, a pointer image is shown on the display interface of the intelligent terminal.Specifically, user
Need according to demand, e.g., will carry out vehicle drive or other when needing to account for bimanual movable, can pass through and touch intelligence eventually
The mode of corresponding instruction icon or shortcut in end, also or by way of voice, in pre-cooling intelligent terminal
Human eye control program.After the display interface of intelligent terminal is activated, a pointer figure will be shown in the display interface of intelligent terminal
Picture, similar to the mouse pointer of Computer display, it can be selected or choose and be corresponding according to the instruction of user the pointer image
Application icon or shortcut, to start or to carry out other operations to the application program.Preferably, the pointer
Image can be arrow, hand etc..
- preposition photographing module
The preposition photographing module, including front camera, catch eye image.Specifically, when the startup human eye control
After processing procedure sequence, the preposition photographing module of the intelligent terminal will be opened on backstage, when its face is placed described preposition take the photograph by user
As module image pickup scope in when, the preposition photographing module can catch the image of face especially human eye.
- eyeball tracking module,
The eyeball tracking module connects with the preposition photographing module communication, and it identifies human eye in the eye image
Eyeball, the change of tracking human eye sight position, eye position information is sent to the pointer control module；Specifically, when described
The eyeball tracking module of intelligent terminal detect catcher's face described in the preposition photographing module particularly eye image when, its
It will further identify human eye eyeball, and monitor the change in location of human eye sight in real time, and the position letter after human eye sight is changed
Breath is timely sent.
- pointer control module,
The pointer control module is connected with the eyeball tracking module communication, receives the eye position information, and control
Make the pointer image and be moved to human eye sight position.Specifically, the pointer control module of the intelligent terminal and the eyeball
Tracing module communication connection, it can receive the human eye sight positional information, and according to the human eye sight positional information by institute
Pointer image is stated to be moved on the position of user's desired operation.
In view of above-mentioned setting, using the device of the present embodiment, realizes the change using human eye, is moved according to the wish of user
Pointer image.On the one hand user's both hands have been freed；On the other hand, operation of the user to intelligent terminal is made to be intended to visualization.
Preferably, above-mentioned control device also includes,
- data processing module, it is connected with the eyeball tracking module communication, receives the people that the eyeball tracking module is sent
Eye eyeball delta data, is calculated human eye sight position, and send eye position information.So as to it is further preferred that this reality
Apply in example, when the eyeball tracking module detect human eye eyeball it is mobile when, it will the data processing to the intelligent terminal
Module sends the information such as the displacement of human eye eyeball, direction, and after data processing module receives above-mentioned eyeball mobile message,
The shift position and direction of human eye sight according to eye tracking algorithm, will be calculated, obtains the current location of human eye sight, and outwards
Send a human eye sight positional information.
Preferably, above-mentioned control device also includes,
- blink identification module
The blink identification module connects with the preposition photographing module communication, the action of identification human eye blink and blink time
Number, sends action message and number of winks data at a wink, and the pointer control module receives the blink action message and institute
Number of winks data are stated, control the pointer image to perform action according to the number of winks data.Specifically, the present embodiment
In, user keeps the existing position of eyeball, blinks eyes, and the blink identification module of the intelligent terminal will identify the action of human eye blink
And number of winks, and action message at a wink and number of winks data are sent out, described in the pointer control module shell reception
Action message of blinking and the number of winks data, and according to the concrete operations of above-mentioned blink, control the pointer image to perform
Corresponding action.
It is further preferred that in the present embodiment, when blink action is blinked for left eye, the pointer image performs left click and moved
To make, the blink action is blinked for right eye, and the pointer image performs right click action, and, the number of winks and the pointer
Image performs the number clicked on and corresponded.
In summary, the present invention realizes the mobile control intelligent terminal using human eye eyeball, performs desired operation, liberates
Dependence of the existing intelligent terminal to user's both hands, greatly improve the convenience of intelligent terminal control；The present invention was realized at intelligent end
Analog mouse operates in end, by visual pointer image, user is operated to intelligent terminal and visualized, is that user is more clear
Control operation of the clear control to intelligent terminal；The present invention utilizes the configuration eyeball control module in intelligent terminal and pointer control
Module, by its mutual cooperation work, greatly improve accuracy of the user to application program controlling in intelligent terminal.
It should be noted that embodiments of the invention have preferable implementation, and not the present invention is made any type of
Limitation, any one skilled in the art change or are modified to possibly also with the technology contents of the disclosure above equivalent effective
Embodiment, as long as without departing from the content of technical solution of the present invention, above example is made according to technical spirit of the invention
Any modification or equivalent variations and modification, in the range of still falling within technical solution of the present invention.
Claims (8)
- A kind of 1. intelligent terminal control method based on human eye, it is characterised in thatComprise the following steps：A pointer image is shown on the display interface of the intelligent terminal,The preposition photographing module of the intelligent terminal catches the eye image of the human eye,The eyeball tracking module of the intelligent terminal identifies the eyeball in the human eye in the eye image, follows the trail of the people The change of the eye position of eye, an eye position information is sent to the pointer control module,The pointer control module of the intelligent terminal is according to the eye position information controls the pointer image to be moved to Eye position.
- 2. intelligent terminal control method as claimed in claim 1, it is characterised in thatIt is further comprising the steps of,The blink identification module of the intelligent terminal identifies that the blink action of the human eye and number of winks, transmission act at a wink Information and number of winks data,The pointer control module receives the blink action message and the number of winks data, controls the pointer image to hold Action is made.
- 3. intelligent terminal control method as claimed in claim 2, it is characterised in thatWhen blink action is blinked for left eye, the pointer image performs left click action,The blink action is blinked for right eye, and the pointer image performs right click action,The number of winks performs the number clicked on the pointer image and corresponded.
- 4. intelligent terminal control method as claimed in claim 1, it is characterised in thatThe eyeball tracking module of the intelligent terminal identifies the eyeball in the human eye according to the eye image, follows the trail of the people The change of the eye position of eye, include to the step of pointer control module one eye position information of transmission,The eyeball tracking module follows the trail of the eyeball change in the human eye, and sends the delta data of the eyeball,The data processing module of the intelligent terminal receives the delta data, and the eye position of the human eye is calculated, and Send an eye position information.
- A kind of 5. intelligent terminal control device based on human eye, it is characterised in thatIncluding with lower module：Image display, a pointer image is shown on the display interface of the intelligent terminal,Preposition photographing module, including front camera, the eye image of the human eye is caught,Eyeball tracking module, connect, identified in the eye image in the human eye with the preposition photographing module communication Eyeball, the change of the eye position of the human eye is followed the trail of, an eye position information, pointer control are sent to the pointer control module Molding block, it is connected with the eyeball tracking module communication, receives the eye position information, and according to the eye position information The pointer image is controlled to be moved to the eye position.
- 6. intelligent terminal control device as claimed in claim 5, it is characterised in thatAlso include,Blink identification module, connected with the preposition photographing module communication, the action of identification human eye blink and number of winks, transmission one Action message of blinking and number of winks data,The pointer control module receives the blink action message and the number of winks data, controls the pointer image root Action is performed according to the number of winks data.
- 7. intelligent terminal control device as claimed in claim 6, it is characterised in thatWhen blink action is blinked for left eye, the pointer image performs left click action,The blink action is blinked for right eye, and the pointer image performs right click action,The number of winks performs the number clicked on the pointer image and corresponded.
- 8. intelligent terminal control device as claimed in claim 5, it is characterised in thatAlso include,Data processing module, it is connected with the eyeball tracking module communication, receives the people that the eyeball tracking module is sent The delta data of the eyeball of intraocular, the eye position of the human eye is calculated, and sends an eye position information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710623311.7A CN107390874A (en) | 2017-07-27 | 2017-07-27 | A kind of intelligent terminal control method and control device based on human eye |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710623311.7A CN107390874A (en) | 2017-07-27 | 2017-07-27 | A kind of intelligent terminal control method and control device based on human eye |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107390874A true CN107390874A (en) | 2017-11-24 |
Family
ID=60341364
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710623311.7A Pending CN107390874A (en) | 2017-07-27 | 2017-07-27 | A kind of intelligent terminal control method and control device based on human eye |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107390874A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825220A (en) * | 2019-09-29 | 2020-02-21 | 深圳市火乐科技发展有限公司 | Eyeball tracking control method and device, intelligent projector and storage medium |
| CN110962797A (en) * | 2019-12-27 | 2020-04-07 | 上海昶枫科技有限公司 | Automobile electronic steering column lock control system and method |
| CN111025999A (en) * | 2019-12-27 | 2020-04-17 | 上海昶枫科技有限公司 | Energy-saving control process for automobile electronic controller |
| CN112215198A (en) * | 2020-10-28 | 2021-01-12 | 郑小云 | Self-adaptive man-machine interaction system and method based on big data |
| CN112732355A (en) * | 2021-01-08 | 2021-04-30 | 蒋耕银 | Background application cleaning system and method based on big data |
| CN114327082A (en) * | 2022-03-04 | 2022-04-12 | 深圳市信润富联数字科技有限公司 | Method and system for controlling industrial application screen, terminal device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867603A (en) * | 2015-12-08 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Eye-controlled method and device |
| US20160313891A1 (en) * | 2013-12-18 | 2016-10-27 | Denso Corporation | Display control device, display control program and display-control-program product |
| CN106125931A (en) * | 2016-06-30 | 2016-11-16 | 刘兴丹 | A kind of method and device of eyeball tracking operation |
| CN106462242A (en) * | 2014-04-23 | 2017-02-22 | 谷歌公司 | User interface control using gaze tracking |
| US20170177079A1 (en) * | 2013-03-01 | 2017-06-22 | Tobii Ab | Determining gaze target based on facial features |
-
2017
- 2017-07-27 CN CN201710623311.7A patent/CN107390874A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170177079A1 (en) * | 2013-03-01 | 2017-06-22 | Tobii Ab | Determining gaze target based on facial features |
| US20160313891A1 (en) * | 2013-12-18 | 2016-10-27 | Denso Corporation | Display control device, display control program and display-control-program product |
| CN106462242A (en) * | 2014-04-23 | 2017-02-22 | 谷歌公司 | User interface control using gaze tracking |
| CN105867603A (en) * | 2015-12-08 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Eye-controlled method and device |
| CN106125931A (en) * | 2016-06-30 | 2016-11-16 | 刘兴丹 | A kind of method and device of eyeball tracking operation |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825220A (en) * | 2019-09-29 | 2020-02-21 | 深圳市火乐科技发展有限公司 | Eyeball tracking control method and device, intelligent projector and storage medium |
| CN110825220B (en) * | 2019-09-29 | 2023-12-08 | 深圳市火乐科技发展有限公司 | Eyeball tracking control method, device, intelligent projector and storage medium |
| CN110962797A (en) * | 2019-12-27 | 2020-04-07 | 上海昶枫科技有限公司 | Automobile electronic steering column lock control system and method |
| CN111025999A (en) * | 2019-12-27 | 2020-04-17 | 上海昶枫科技有限公司 | Energy-saving control process for automobile electronic controller |
| CN112215198A (en) * | 2020-10-28 | 2021-01-12 | 郑小云 | Self-adaptive man-machine interaction system and method based on big data |
| CN112732355A (en) * | 2021-01-08 | 2021-04-30 | 蒋耕银 | Background application cleaning system and method based on big data |
| CN112732355B (en) * | 2021-01-08 | 2022-03-01 | 湖南华埔信息产业有限公司 | Background application cleaning system and method based on big data |
| CN114327082A (en) * | 2022-03-04 | 2022-04-12 | 深圳市信润富联数字科技有限公司 | Method and system for controlling industrial application screen, terminal device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107390874A (en) | A kind of intelligent terminal control method and control device based on human eye | |
| CN108282677A (en) | Realize that content throws method, throwing screen device and the system of screen by client | |
| CN103873959B (en) | A kind of control method and electronic equipment | |
| EP3767939A1 (en) | Photographing method and mobile terminal | |
| CN108737720B (en) | Wearable device shooting method, wearable device and computer-readable storage medium | |
| CN109068161B (en) | Equipment connection establishing method and device | |
| CN111402367B (en) | Image processing method and electronic equipment | |
| CN109032734A (en) | A kind of background application display methods and mobile terminal | |
| KR20140089697A (en) | Operating Method of User Function based on a Face Recognition and Electronic Device supporting the same | |
| CN111666009B (en) | Interface display method and electronic equipment | |
| EP3299946B1 (en) | Method and device for switching environment picture | |
| EP3716030A1 (en) | Interactive interface display method, apparatus and storage medium | |
| CN109874038A (en) | A kind of display methods and terminal of terminal | |
| CN113938748B (en) | Video playing method, device, terminal, storage medium and program product | |
| CN111031253B (en) | Shooting method and electronic equipment | |
| CN112835445B (en) | Interaction method, device and system in virtual reality scene | |
| CN109857321A (en) | Operating method, mobile terminal based on screen prjection, readable storage medium storing program for executing | |
| CN110187769B (en) | Preview image viewing method, equipment and computer readable storage medium | |
| EP1756700B1 (en) | System and method for bodily controlled data input | |
| CN110058767B (en) | Interface operation method, wearable terminal and computer-readable storage medium | |
| CN111367483A (en) | Interaction control method and electronic equipment | |
| CN110830747A (en) | Video call method, wearable device and storage medium | |
| CN109739414A (en) | A kind of image processing method, mobile terminal, computer readable storage medium | |
| CN104598140B (en) | A kind of information processing method and the first electronic equipment | |
| CN112667074A (en) | Display method, display device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171124 |