CN104216508A - Method and device for operating function key through eye movement tracking technique - Google Patents
Method and device for operating function key through eye movement tracking technique Download PDFInfo
- Publication number
- CN104216508A CN104216508A CN201310211036.XA CN201310211036A CN104216508A CN 104216508 A CN104216508 A CN 104216508A CN 201310211036 A CN201310211036 A CN 201310211036A CN 104216508 A CN104216508 A CN 104216508A
- Authority
- CN
- China
- Prior art keywords
- eye
- function key
- image
- ocular
- discrepancy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Telephone Function (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a method and device for operating a function key through an eye movement tracking technique, and relates to the field of application of mobile terminals. By means of the eye movement tracking technique, eye portion areas can be recognized in a face image through an edge detection method, eye ball areas are positioned in the eye portion areas, eye movement tracks are built according to the eye ball areas positioned in frames of the image, initial positions of eyes correspond to positions preset in a mobile terminal screen, the function key which a user watches is determined according to the eye movement tracks, and a corresponding function operation such as a calling function is carried out according to the function key which the user watched. The method and device are different from a traditional dialing mode and provide novel user experience, the dialing effect can not be influenced by noisy environment, the method and device are suitable for particular people who cannot make a sound and people whose upper limbs cannot move conveniently, humanitarian convenience is provided, adhesion of the user is improved, and effective means for differential marketing and development and preservation of user resources are provided for operators.
Description
Technical field
The present invention relates to mobile terminal application, particularly a kind of method and apparatus being carried out function key operation by eye-tracking technology.
Background technology
Dialing function is one of basic function of often using of the mobile terminals such as mobile phone.Traditional phone dialing mode comprises the dialing of keyboard formula, touches the modes such as menu mode dialing, speech recognition dialing.
Traditional phone dialing mode for can not use in fact special scenes or specific crowd or effect poor.Such as, speech recognition dial mode is speech recognition rate variance under noisy environment, and the specific crowd that can not sound even cannot use speech recognition dial mode.Again such as, for the special population such as old man of upper limbs physical disabilities, self-care ability difference, keyboard formula cannot be used to dial or touch menu mode dialing.
In addition, traditional phone dialing mode is to the machine-made experience of user, and perceptibility is poor, and user's tackness is poor.
In view of above reason, be necessary to propose a kind of practicality, the distinctive communication technology, go for special scenes or specific crowd, increase the tackness at family, for operator provides the effective means of differentiated marketing, development and reservation user resources.
Summary of the invention
An embodiment of the present invention technical matters to be solved is: propose a kind of practicality, distinctive phone dialing mode.
According to an aspect of the embodiment of the present invention, propose a kind of method of being carried out function key operation by eye-tracking technology, comprising: utilize the front-facing camera of mobile terminal to gather facial image; In facial image, ocular is identified by edge detection method; Eyeball is oriented in ocular; According to the eyeball oriented in each two field picture, set up eye motion track; Eye initial position is corresponding with the predeterminated position in mobile terminal screen, and determine according to eye motion track the function key that user watches attentively, the function key of watching attentively according to user carries out corresponding feature operation.
According to the another aspect of the embodiment of the present invention, proposing a kind of device being carried out function key operation by eye-tracking technology, comprising: image capture module, gathering facial image for utilizing the front-facing camera of mobile terminal; Eye recognition module, for identifying ocular by edge detection method in facial image; Ins location module, for orienting eyeball in ocular; Eye track sets up module, for according to the eyeball oriented in each two field picture, sets up eye motion track; Communication module, for eye initial position is corresponding with the predeterminated position in mobile terminal screen, determine according to eye motion track the function key that user watches attentively, the function key of watching attentively according to user carries out corresponding feature operation.
The present invention utilizes eye-tracking technology, in facial image, ocular is identified by edge detection method, eyeball is oriented in ocular, according to the eyeball oriented in each two field picture, set up eye motion track, eye initial position is corresponding with the predeterminated position in mobile terminal screen, the function key that user watches attentively is determined according to eye motion track, the function key of watching attentively according to user carries out corresponding feature operation, such as phone call out function, the method that this use eye-tracking technology carries out function key operation is different from conventional dial mode, brand-new experience can be provided for user, and the effect that dials is not by the impact of noisy environment, go for the specific crowd that can not sound and the handicapped specific crowd of upper limbs, for these specific crowds provide humanistic convenient, thus the tackness of adding users, for operator provides differentiated marketing, the effective means of development and reservation user resources.
By referring to the detailed description of accompanying drawing to exemplary embodiment of the present invention, further feature of the present invention and advantage thereof will become clear.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the present invention carries out a method embodiment of function key operation schematic flow sheet by eye-tracking technology.
Fig. 2 is the present invention carries out another embodiment of method of function key operation schematic flow sheet by eye-tracking technology.
Fig. 3 is the present invention carries out a device embodiment of function key operation structural representation by eye-tracking technology.
Fig. 4 is the present invention carries out another embodiment of device of function key operation device schematic diagram by eye-tracking technology.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Illustrative to the description only actually of at least one exemplary embodiment below, never as any restriction to the present invention and application or use.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
In recent years, face recognition and eye-tracking technology development, along with popularizing of smart mobile phone, front-facing camera and giant-screen have become the mainstream configuration of mobile terminal, and therefore, the present invention proposes a kind of technology of being carried out function key operation by eye-tracking technology.
Fig. 1 is the present invention carries out a method embodiment of function key operation schematic flow sheet by eye-tracking technology.
As shown in Figure 1, the method for carrying out function key operation by eye-tracking technology of the present embodiment comprises the following steps:
Step S101, utilizes the front-facing camera of mobile terminal to gather facial image;
Particularly, the known algorithm such as human face characteristic point recognizer, neural network recognization algorithm, masterplate recognizer, view picture Arithmetic of Face Image Recognition via can be adopted to identify face.
Step S102, identifies ocular by edge detection method in facial image;
A kind of exemplary embodiment is: the brightness step calculating face image data; According to the certain proportion of the maximum brightness step of modulus value, determine threshold lower limit; With pixel corresponding to the brightness step that modulus value is maximum for starting point, pixel by pixel track rim path, records ocular marginal position in limited time, until brightness stops record in limited time under being less than threshold under brightness is more than or equal to threshold always.
Step S103, orients eyeball in ocular;
Exemplary embodiment is: using the highest gradient magnitude as a threshold value, finds the line segment of pupil region; Take pupil as the center of circle, the difference according to pupil neighboring pixel orients eyeball.
Further, in order to reduce interference, filtering can also be carried out to the ocular image identified; And/or by compute gradient amplitude, determine the changing value of each vertex neighborhood intensity of face image, the point that neighborhood Strength Changes value is greater than preset range is highlighted.
Step S104, according to the eyeball oriented in each two field picture, sets up eye motion track;
A kind of exemplary embodiment is: be pre-set dimension by ocular image down; Simplify the color of eye area image, be converted to the gray level image of default progression; From gray level image, determine discrepancy, and record the positional information of discrepancy, comprise angle in the horizontal direction and between the distance of vertical direction and two discrepancys of the coordinate of discrepancy, discrepancy and distance; According to the positional information of discrepancy, determine eye motion track.
Step S105, eye initial position is corresponding with the predeterminated position in mobile terminal screen, and determine according to eye motion track the function key that user watches attentively, the function key of watching attentively according to user carries out corresponding feature operation.
When the function key of watching attentively according to user carries out corresponding feature operation, judge whether the time that user watches function key attentively reaches Preset Time, if the time that user watches function key attentively reaches Preset Time, then carry out corresponding feature operation according to the function key that user watches attentively.
Fig. 2 is the present invention carries out another embodiment of method of function key operation schematic flow sheet by eye-tracking technology.
As shown in Figure 2, the method for carrying out function key operation by eye-tracking technology of the present embodiment comprises the following steps:
Step S201, utilizes the front-facing camera of mobile terminal to gather facial image, and identifies face.
Particularly, the known algorithm such as human face characteristic point recognizer, neural network recognization algorithm, masterplate recognizer, view picture Arithmetic of Face Image Recognition via can be adopted to identify face.
Because the construction profile of the face of the mankind, eye organ is all very similar, just eye approximate region can be found out by face.But the muscle groups such as orbicular muscle of eye move the nictation caused, the expression such as to stare and different shooting angle, different background illumination condition, and user wears mouth mask, glasses, hair, beard etc., all can affect the effect that eye movement catches.Therefore, the present invention proposes edge detection method and carries out topography's process, identifies brightness in digital picture and changes obvious point, to reflect the actual change of eye motion better.
Step S202, identifies ocular by edge detection method in face, thus irises out the boundary line between eye muscle group object and background.Following steps specifically can be adopted to realize:
(1) brightness step of face image data is calculated;
Particularly, the first order derivative differentiate that can be changed by brightness obtains brightness step, such as, can adopt following formulae discovery:
I′(x)=-1/2×I(x-1)+0×I(x)+12×I(x+1)
Wherein, I (x) represents the brightness of pixel x, and I ' (x) represents the first order derivative (or claiming brightness step) of the brightness of pixel x.
(2) according to the certain proportion of the maximum brightness step of modulus value, threshold lower limit is determined;
(3) with pixel corresponding to the brightness step that modulus value is maximum for starting point, pixel by pixel track rim path, records ocular marginal position in limited time, until brightness stops record in limited time under being less than threshold under brightness is more than or equal to threshold always.
Above-mentioned edge detection method thinks that edge is continuous print boundary line, can trace into eye motion change details, and the noise spot in image can not be labeled as edge, also useful signal can not be filtered out.
Step S203, very sensitive to noise owing to identifying the derivative calculations in ocular process, in order to improve the rim detection performance relevant to noise, filtering can be carried out to the ocular image identified, reduce the interference of the factors such as shake, light in actual photographed, highlight ocular feature, reach the compromise strengthening edge and reduce noise;
Concrete, the filter function that filtering adopts is as follows:
Wherein, I
lrepresent the left side brightness on border,
i
rrepresent the right side brightness on border,
σ represents edge fog degree.
Substitute into the Convolution Formula of filtering, be written as f=g
σ× u, g
σbe standard deviation, σ is gaussian kernel, and u is step function:
Step S204, in order to outstanding ocular pixel, the further interference getting rid of the factors such as shake, light, by compute gradient amplitude, determine the changing value of each vertex neighborhood intensity of face image, the point (namely neighborhood Strength Changes value is greater than the point of preset range) had significant change by neighborhood intensity level highlights.
Following formula specifically can be adopted to strengthen:
Wherein, h(x) represent the image strengthening each pixel in image, x represents any one pixel in present image, and y represents any one pixel in history image, the view data of each pixel in p function representation present image, the view data of each pixel in g function representation history image.
Step S205, using the highest gradient magnitude as threshold value, finds the line segment of pupil region.
Step S206, take pupil as the center of circle, according to the difference of pupil neighboring pixel (with pupil be the pupil in the center of circle, iris, annulus ciliaris tissue brightness low, outside the center of circle, bulbar conjunctiva, sclera, the sinuys venosus sclerae tissue i.e. brightness of " white of the eye " is high), orient eyeball.
Step S207, according to the eyeball oriented in each two field picture, sets up eye motion track.
A kind of exemplary method setting up eye motion track is as follows:
(1) eyes area reduction is such as the image of two 8 × 8 sizes by minification, 128 pixels altogether.Be fixed measure by ocular image down, that can accelerate eye motion track on the one hand sets up speed, can abandon different CCD(charge coupled cell on the other hand) the picture difference brought of imaging pixel, different proportion.Remove picture detail, the essential information such as structure, light and shade can be retained.
(2) simplify color, be converted to gray level image, such as, can transfer 64 grades of gray level images to.After converting 64 grades of gray level images to, all pixels in simple eye region are the highest only has 64 kinds of colors.
(3) discrepancy is determined;
One method is, compare the pixel grey scale of same position in the two field picture of front and back, if the pixel grey scale of a certain position is more than or equal to the pixel grey scale of same position in its previous frame image in current frame image, then be designated as a discrepancy, can represent with 1, if the pixel grey scale of a certain position is less than the pixel grey scale of same position in its previous frame image in current frame image, then not a discrepancy, can represent with 0;
Another kind method is, on the basis of pixel grey scale of comparing same position in the two field picture of front and back, also compare with the mean pixel gray scale of same position in historical frames image before, concrete, if the pixel grey scale of a certain position is more than or equal to the pixel grey scale of same position in its previous frame image in current frame image, and be more than or equal to the mean pixel gray scale of same position in historical frames image, then be designated as a discrepancy, otherwise, be not discrepancy, be designated as 0.It should be noted that, the number of frames of historical frames can according to the actual requirements or experience set flexibly.
(4) positional informations such as angle in the horizontal direction and between the distance of vertical direction and two discrepancys of the coordinate of discrepancy, discrepancy and distance are recorded;
(5) according to the positional information of discrepancy, just eye motion track can be obtained.
Step S208, eye initial position is corresponding with the center of mobile terminal screen, determine according to eye motion track the function key (function key that user watches attentively is also the function key of user for operation) that user watches attentively, the function key of watching attentively according to user carries out corresponding feature operation.
Further, in order to eliminate maloperation, such as sight streaks function key but not the maloperations such as this function key of wish operation, fixation time can be set, such as 1 second, if the time that user watches function key attentively meets or exceeds the time of 1 second, then carries out corresponding feature operation according to the function key that user watches attentively.
Wherein, the calling associative operations such as the corresponding feature operation of function key can be such as mobile phone menu switching, numerical key button, assignment key, on-hook key, backspace key, menu eject, sliding shoe moves.
Fig. 3 is the present invention carries out a device embodiment of function key operation structural representation by eye-tracking technology.
As shown in Figure 3, the device carrying out function key operation by eye-tracking technology of the present embodiment comprises:
Image capture module, gathers facial image for utilizing the front-facing camera of mobile terminal;
Eye recognition module, for identifying ocular by edge detection method in facial image;
Ins location module, for orienting eyeball in ocular;
Eye track sets up module, for according to the eyeball oriented in each two field picture, sets up eye motion track;
Communication module, for eye initial position is corresponding with the predeterminated position in mobile terminal screen, determine according to eye motion track the function key that user watches attentively, the function key of watching attentively according to user carries out corresponding feature operation.
Wherein, eye recognition module, specifically for:
Calculate the brightness step of face image data;
According to the certain proportion of the maximum brightness step of modulus value, determine threshold lower limit;
With pixel corresponding to the brightness step that modulus value is maximum for starting point, pixel by pixel track rim path, records ocular marginal position in limited time, until brightness stops record in limited time under being less than threshold under brightness is more than or equal to threshold always.
Wherein, Ins location module, specifically for:
Using the highest gradient magnitude as threshold value, find the line segment of pupil region; Take pupil as the center of circle, the difference according to pupil neighboring pixel orients eyeball.
Wherein, eye track sets up module, specifically for:
Be pre-set dimension by ocular image down;
Simplify the color of eye area image, be converted to the gray level image of default progression;
From gray level image, determine discrepancy, and record the positional information of discrepancy, comprise angle in the horizontal direction and between the distance of vertical direction and two discrepancys of the coordinate of discrepancy, discrepancy and distance;
According to the positional information of discrepancy, determine eye motion track.
As shown in Figure 4, this device can also comprise further:
Filtration module, for carrying out filtering to the ocular image identified, to reduce interference;
And/or
Strengthen module, for by compute gradient amplitude, determine the changing value of each vertex neighborhood intensity of face image, the point that neighborhood Strength Changes value is greater than preset range is highlighted.
Wherein, communication module when the function key of watching attentively according to user carries out corresponding feature operation specifically for: judge whether the time that user watches function key attentively reaches Preset Time, if the time that user watches function key attentively reaches Preset Time, then carry out corresponding feature operation according to the function key that user watches attentively.
The present invention utilizes eye-tracking technology, in facial image, ocular is identified by edge detection method, eyeball is oriented in ocular, according to the eyeball oriented in each two field picture, set up eye motion track, eye initial position is corresponding with the predeterminated position in mobile terminal screen, the function key that user watches attentively is determined according to eye motion track, the function key of watching attentively according to user carries out corresponding feature operation, such as phone call out function, the method that this use eye-tracking technology carries out function key operation is different from conventional dial mode, brand-new experience can be provided for user, and the effect that dials is not by the impact of noisy environment, go for the specific crowd that can not sound and the handicapped specific crowd of upper limbs, for these specific crowds provide humanistic convenient, thus the tackness of adding users, for operator provides differentiated marketing, the effective means of development and reservation user resources.
One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can have been come by hardware, the hardware that also can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be ROM (read-only memory), disk or CD etc.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (12)
1. carried out a method for function key operation by eye-tracking technology, comprising:
The front-facing camera of mobile terminal is utilized to gather facial image;
In facial image, ocular is identified by edge detection method;
Eyeball is oriented in ocular;
According to the eyeball oriented in each two field picture, set up eye motion track;
Eye initial position is corresponding with the predeterminated position in mobile terminal screen, and determine according to eye motion track the function key that user watches attentively, the function key of watching attentively according to user carries out corresponding feature operation.
2. method according to claim 1, is characterized in that, describedly in facial image, identifies that ocular comprises by edge detection method:
Calculate the brightness step of face image data;
According to the certain proportion of the maximum brightness step of modulus value, determine threshold lower limit;
With pixel corresponding to the brightness step that modulus value is maximum for starting point, pixel by pixel track rim path, records ocular marginal position in limited time, until brightness stops record in limited time under being less than threshold under brightness is more than or equal to threshold always.
3. method according to claim 1, is characterized in that, described eyeball of orienting in ocular comprises:
Using the highest gradient magnitude as threshold value, find the line segment of pupil region; Take pupil as the center of circle, the difference according to pupil neighboring pixel orients eyeball.
4. method according to claim 1, is characterized in that, the described eyeball according to orienting in each two field picture, sets up eye motion track and comprises:
Be pre-set dimension by ocular image down;
Simplify the color of eye area image, be converted to the gray level image of default progression;
From gray level image, determine discrepancy, and record the positional information of discrepancy, comprise angle in the horizontal direction and between the distance of vertical direction and two discrepancys of the coordinate of discrepancy, discrepancy and distance;
According to the positional information of discrepancy, determine eye motion track.
5. method according to claim 1, is characterized in that, described method also comprises:
Filtering is carried out, to reduce interference to the ocular image identified;
And/or
By compute gradient amplitude, determine the changing value of each vertex neighborhood intensity of face image, the point that neighborhood Strength Changes value is greater than preset range is highlighted.
6. method according to claim 1, is characterized in that, described function key of watching attentively according to user is carried out corresponding feature operation and comprised:
Judge whether the time that user watches function key attentively reaches Preset Time, if the time that user watches function key attentively reaches Preset Time, then carries out corresponding feature operation according to the function key that user watches attentively.
7. carried out a device for function key operation by eye-tracking technology, comprising:
Image capture module, gathers facial image for utilizing the front-facing camera of mobile terminal;
Eye recognition module, for identifying ocular by edge detection method in facial image;
Ins location module, for orienting eyeball in ocular;
Eye track sets up module, for according to the eyeball oriented in each two field picture, sets up eye motion track;
Communication module, for eye initial position is corresponding with the predeterminated position in mobile terminal screen, determine according to eye motion track the function key that user watches attentively, the function key of watching attentively according to user carries out corresponding feature operation.
8. device according to claim 7, is characterized in that, described eye recognition module, specifically for:
Calculate the brightness step of face image data;
According to the certain proportion of the maximum brightness step of modulus value, determine threshold lower limit;
With pixel corresponding to the brightness step that modulus value is maximum for starting point, pixel by pixel track rim path, records ocular marginal position in limited time, until brightness stops record in limited time under being less than threshold under brightness is more than or equal to threshold always.
9. device according to claim 7, is characterized in that, described Ins location module, specifically for:
Using the highest gradient magnitude as threshold value, find the line segment of pupil region; Take pupil as the center of circle, the difference according to pupil neighboring pixel orients eyeball.
10. device according to claim 7, is characterized in that, described eye track sets up module, specifically for:
Be pre-set dimension by ocular image down;
Simplify the color of eye area image, be converted to the gray level image of default progression;
From gray level image, determine discrepancy, and record the positional information of discrepancy, comprise angle in the horizontal direction and between the distance of vertical direction and two discrepancys of the coordinate of discrepancy, discrepancy and distance;
According to the positional information of discrepancy, determine eye motion track.
11. devices according to claim 7, is characterized in that, described device also comprises:
Filtration module, for carrying out filtering to the ocular image identified, to reduce interference;
And/or
Strengthen module, for by compute gradient amplitude, determine the changing value of each vertex neighborhood intensity of face image, the point that neighborhood Strength Changes value is greater than preset range is highlighted.
12. devices according to claim 7, is characterized in that, described communication module when the function key of watching attentively according to user carries out corresponding feature operation specifically for:
Judge whether the time that user watches function key attentively reaches Preset Time, if the time that user watches function key attentively reaches Preset Time, then carries out corresponding feature operation according to the function key that user watches attentively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310211036.XA CN104216508B (en) | 2013-05-31 | 2013-05-31 | Method and device for operating function key through eye movement tracking technique |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310211036.XA CN104216508B (en) | 2013-05-31 | 2013-05-31 | Method and device for operating function key through eye movement tracking technique |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104216508A true CN104216508A (en) | 2014-12-17 |
| CN104216508B CN104216508B (en) | 2017-05-10 |
Family
ID=52098093
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310211036.XA Active CN104216508B (en) | 2013-05-31 | 2013-05-31 | Method and device for operating function key through eye movement tracking technique |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104216508B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104850228A (en) * | 2015-05-14 | 2015-08-19 | 上海交通大学 | Mobile terminal-based method for locking watch area of eyeballs |
| CN105847540A (en) * | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses |
| CN105847538A (en) * | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking |
| CN106055230A (en) * | 2016-05-25 | 2016-10-26 | 努比亚技术有限公司 | Application evaluation device, mobile terminal and method |
| CN106527705A (en) * | 2016-10-28 | 2017-03-22 | 努比亚技术有限公司 | Operation realization method and apparatus |
| CN106940766A (en) * | 2016-01-04 | 2017-07-11 | 由田新技股份有限公司 | Sight line track authentication system and method |
| CN107526431A (en) * | 2016-06-21 | 2017-12-29 | 通用汽车环球科技运作有限责任公司 | For the device and method for the target for predicting visual attention |
| CN107613121A (en) * | 2017-09-19 | 2018-01-19 | 华南理工大学 | A kind of mobile communication Dialing Method based on EOG |
| CN108090463A (en) * | 2017-12-29 | 2018-05-29 | 腾讯科技（深圳）有限公司 | Object control method, apparatus, storage medium and computer equipment |
| CN109902606A (en) * | 2019-02-21 | 2019-06-18 | 维沃移动通信有限公司 | A kind of operating method and terminal device |
| CN111508142A (en) * | 2020-04-17 | 2020-08-07 | 深圳爱莫科技有限公司 | Sight voice interaction automatic cigarette vending machine |
| CN112022641A (en) * | 2020-09-10 | 2020-12-04 | 深圳职业技术学院 | Method and system for assisting eye rotation movement |
| CN113660477A (en) * | 2021-08-16 | 2021-11-16 | 吕良方 | VR glasses and image presentation method thereof |
| WO2022227264A1 (en) * | 2021-04-27 | 2022-11-03 | 广州市保伦电子有限公司 | Video interactive operation method based on eyeball tracking |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004021870A (en) * | 2002-06-20 | 2004-01-22 | Matsushita Electric Ind Co Ltd | Mobile telephone with line-of-sight input function |
| CN101297259A (en) * | 2005-10-28 | 2008-10-29 | 托比技术有限公司 | Eye tracker with visual feedback |
| CN102467230A (en) * | 2010-11-11 | 2012-05-23 | 由田新技股份有限公司 | Method and system for operating and controlling vernier by human body |
| CN102880292A (en) * | 2012-09-11 | 2013-01-16 | 上海摩软通讯技术有限公司 | Mobile terminal and control method thereof |
| CN102902967A (en) * | 2012-10-16 | 2013-01-30 | 第三眼（天津）生物识别科技有限公司 | Method for positioning iris and pupil based on eye structure classification |
| CN102981609A (en) * | 2011-08-02 | 2013-03-20 | 联发科技股份有限公司 | Method for performing display control and associated apparatus |
| CN103049084A (en) * | 2012-12-18 | 2013-04-17 | 深圳国微技术有限公司 | Electronic device and method for adjusting display direction according to face direction |
-
2013
- 2013-05-31 CN CN201310211036.XA patent/CN104216508B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004021870A (en) * | 2002-06-20 | 2004-01-22 | Matsushita Electric Ind Co Ltd | Mobile telephone with line-of-sight input function |
| CN101297259A (en) * | 2005-10-28 | 2008-10-29 | 托比技术有限公司 | Eye tracker with visual feedback |
| CN102467230A (en) * | 2010-11-11 | 2012-05-23 | 由田新技股份有限公司 | Method and system for operating and controlling vernier by human body |
| CN102981609A (en) * | 2011-08-02 | 2013-03-20 | 联发科技股份有限公司 | Method for performing display control and associated apparatus |
| CN102880292A (en) * | 2012-09-11 | 2013-01-16 | 上海摩软通讯技术有限公司 | Mobile terminal and control method thereof |
| CN102902967A (en) * | 2012-10-16 | 2013-01-30 | 第三眼（天津）生物识别科技有限公司 | Method for positioning iris and pupil based on eye structure classification |
| CN103049084A (en) * | 2012-12-18 | 2013-04-17 | 深圳国微技术有限公司 | Electronic device and method for adjusting display direction according to face direction |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104850228A (en) * | 2015-05-14 | 2015-08-19 | 上海交通大学 | Mobile terminal-based method for locking watch area of eyeballs |
| CN104850228B (en) * | 2015-05-14 | 2018-07-17 | 上海交通大学 | The method of the watching area of locking eyeball based on mobile terminal |
| CN106940766A (en) * | 2016-01-04 | 2017-07-11 | 由田新技股份有限公司 | Sight line track authentication system and method |
| CN105847540A (en) * | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses |
| CN105847538A (en) * | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking |
| CN105847538B (en) * | 2016-03-16 | 2021-06-01 | 惠州Tcl移动通信有限公司 | Mobile phone and method for controlling VR (virtual reality) glasses operation based on eyeball tracking |
| CN106055230A (en) * | 2016-05-25 | 2016-10-26 | 努比亚技术有限公司 | Application evaluation device, mobile terminal and method |
| CN106055230B (en) * | 2016-05-25 | 2019-08-27 | 努比亚技术有限公司 | Applicating evaluating device, mobile terminal and method |
| CN107526431B (en) * | 2016-06-21 | 2020-09-29 | 通用汽车环球科技运作有限责任公司 | Apparatus and method for predicting target of visual attention |
| CN107526431A (en) * | 2016-06-21 | 2017-12-29 | 通用汽车环球科技运作有限责任公司 | For the device and method for the target for predicting visual attention |
| CN106527705A (en) * | 2016-10-28 | 2017-03-22 | 努比亚技术有限公司 | Operation realization method and apparatus |
| CN107613121A (en) * | 2017-09-19 | 2018-01-19 | 华南理工大学 | A kind of mobile communication Dialing Method based on EOG |
| CN108090463A (en) * | 2017-12-29 | 2018-05-29 | 腾讯科技（深圳）有限公司 | Object control method, apparatus, storage medium and computer equipment |
| CN109902606B (en) * | 2019-02-21 | 2021-03-12 | 维沃移动通信有限公司 | Operation method and terminal equipment |
| CN109902606A (en) * | 2019-02-21 | 2019-06-18 | 维沃移动通信有限公司 | A kind of operating method and terminal device |
| CN111508142A (en) * | 2020-04-17 | 2020-08-07 | 深圳爱莫科技有限公司 | Sight voice interaction automatic cigarette vending machine |
| CN112022641A (en) * | 2020-09-10 | 2020-12-04 | 深圳职业技术学院 | Method and system for assisting eye rotation movement |
| WO2022227264A1 (en) * | 2021-04-27 | 2022-11-03 | 广州市保伦电子有限公司 | Video interactive operation method based on eyeball tracking |
| CN113660477A (en) * | 2021-08-16 | 2021-11-16 | 吕良方 | VR glasses and image presentation method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104216508B (en) | 2017-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104216508B (en) | Method and device for operating function key through eye movement tracking technique | |
| CN108720851B (en) | Driving state detection method, mobile terminal and storage medium | |
| CN103885589B (en) | Eye movement tracking method and device | |
| KR101005719B1 (en) | Rolled fingerprint acquisiton apparatus and method for automatic detecting start and end of registration and synthesis | |
| CN105469356B (en) | Face image processing process and device | |
| US10955689B2 (en) | Contact lens and storage medium | |
| CN110520824A (en) | The tracking of multi-mode eyes | |
| CN109993115B (en) | Image processing method and device and wearable device | |
| CN108076290B (en) | Image processing method and mobile terminal | |
| US20190102905A1 (en) | Head pose estimation from local eye region | |
| CN107292242A (en) | A kind of iris identification method and terminal | |
| CN103413120A (en) | Tracking method based on integral and partial recognition of object | |
| CN109793498A (en) | A kind of skin detecting method and electronic equipment | |
| CN103051795A (en) | Method for switching front camera and rear camera of mobile terminal and mobile terminal | |
| EP2616993A1 (en) | Smile detection systems and methods | |
| CN105550631A (en) | Iris image acquisition method and apparatus | |
| CN105373767A (en) | Eye fatigue detection method for smart phones | |
| CN108154465A (en) | Image processing method and device | |
| CN102034247A (en) | Motion capture method for binocular vision image based on background modeling | |
| CN110705454A (en) | Face recognition method with living body detection function | |
| CN111353404A (en) | Face recognition method, device and equipment | |
| CN105989329A (en) | Method and device for detecting use of handheld device by person | |
| CN108174093A (en) | Method, equipment and the computer of moment image can storage mediums | |
| CN110427108A (en) | Photographic method and Related product based on eyeball tracking | |
| CN111259757B (en) | Living body identification method, device and equipment based on image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |