CN109919065A - A method of focus is obtained on the screen using eyeball tracking technology - Google Patents
A method of focus is obtained on the screen using eyeball tracking technology Download PDFInfo
- Publication number
- CN109919065A CN109919065A CN201910145780.1A CN201910145780A CN109919065A CN 109919065 A CN109919065 A CN 109919065A CN 201910145780 A CN201910145780 A CN 201910145780A CN 109919065 A CN109919065 A CN 109919065A
- Authority
- CN
- China
- Prior art keywords
- region
- focus
- client
- twitching
- eyelid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 238000005516 engineering process Methods 0.000 title claims abstract description 15
- 210000005252 bulbus oculi Anatomy 0.000 title claims abstract description 14
- 206010028347 Muscle twitching Diseases 0.000 claims abstract description 17
- 210000000744 eyelid Anatomy 0.000 claims abstract description 17
- 210000001508 eye Anatomy 0.000 claims abstract description 11
- 230000008859 change Effects 0.000 claims abstract description 4
- 230000008569 process Effects 0.000 claims abstract description 4
- 238000013316 zoning Methods 0.000 claims description 6
- 238000009434 installation Methods 0.000 abstract description 4
- 230000003993 interaction Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of methods for obtaining focus on the screen using eyeball tracking technology, the first step, and it is N number of region that screen display content, which is used grid division,；Second step, using image capture device, capture eyes see to it is different when eye slight change and extract feature, be aided with blink identification, watch identification, twitching of the eyelid identification technology attentively, get parms；Third step is calculated by the parameter of acquisition, completes the identification of region-of-interest；4th step analyzes the interest preference of client, switching display content according to the content of focus region, and reacquires the new focus of user, into control process next time.By the above-mentioned means, the present invention can obtain client's focus, it is possible to reduce the limitation to equipment installation position, the usage scenario of expansion equipment improve the acquisition speed of user interest and focus, the effective utilization of lifting means.
Description
Technical field
The present invention relates to marketing to experience apparatus field, is obtained on the screen more particularly to a kind of using eyeball tracking technology
The method of focus.
Background technique
Human-computer interaction is realized on the screen, needs to lead to using interactive devices such as touch screen, infrared touch frame, interaction radars
Software capture touch event is crossed, the focus of client is obtained.
Human-computer interaction based on touch-control, equipment need to be equipped with touch device, and relative cost is higher, to the installation site of equipment
It must be limited in the range of human body can touch and reach with software touch point position, while the limb action of client being needed to cooperate to obtain and close
Focus is infused, the usage scenario of equipment is limited.
Summary of the invention
Focus is obtained on the screen using eyeball tracking technology the invention mainly solves the technical problem of providing a kind of
Method, be able to use eyeball tracking technology, tracked according to the changing features of eyeball and eyeball periphery, obtain user watch attentively
Region on the screen, in conjunction with the analysis to twitching of the eyelid path, to analyze the interest preference of client according to focus.
In order to solve the above technical problems, one technical scheme adopted by the invention is that: a kind of use eyeball tracking skill is provided
The method that art obtains focus on the screen, comprising the following steps:
The first step, it is N number of region that screen display content, which is used grid division,；
Second step, using image capture device, capture eyes see to it is different when eye slight change and extract feature, it is auxiliary
With blink identification, watch identification, twitching of the eyelid identification technology attentively, obtain following parameter:
Twitching of the eyelid path P=(B1,B2,...,Bn), wherein Bi(i=1...n) region that eye gaze is crossed is indicated；
Picture gaze duration TaAll fixation time summations of=picture；
Region gaze duration Tn(n=1...N) all fixation time summations in=interest region；
Rate R is stared in subregion zoningn(n=1...N)=Tn/Ta；
Calculate average gaze rate M=(R1+R2+...+RN)/N；
Rate variance S=((R is stared in zoning1-M)2+(R2-M)2+...+(RN-M)2)/N；
The identification of third step, region-of-interest uses under type such as to calculate:
When rate variance S > S is stared in regionaIt when (parameter), indicates that client has the region paid close attention to, takes out region and stare rate
Focus of the high region as client；
When rate variance S≤S is stared in regionaWhen (parameter), twitching of the eyelid indicates search of the client to attentinal contents, uses such as lower section
Method obtains client's focus:
Twitching of the eyelid path length, which is greater than N1 (1≤N1≤N), indicates the content that display content does not have client to pay close attention to；
The flyback number in certain region is greater than N2 (1≤N2≤N1) in twitching of the eyelid path, obtains the high region conduct of flyback number
The focus of client；
4th step analyzes the interest preference of client according to the content of focus region, switching display content, and
The new focus of user is reacquired, into control process next time.
The beneficial effects of the present invention are: the present invention obtains client's focus using eyeball tracking technology, it is possible to reduce right
The limitation of equipment installation position, the usage scenario of expansion equipment improve the acquisition speed of user interest and focus, lifting means
Effective utilization.
Detailed description of the invention
Fig. 1 is a kind of one preferred embodiment of method for obtaining focus on the screen using eyeball tracking technology of the present invention
Schematic diagram.
Specific embodiment
The preferred embodiments of the present invention will be described in detail with reference to the accompanying drawing, so that advantages and features of the invention energy
It is easier to be readily appreciated by one skilled in the art, so as to make a clearer definition of the protection scope of the present invention.
Referring to Fig. 1, the embodiment of the present invention includes:
A method of focus is obtained on the screen using eyeball tracking technology, comprising the following steps:
The first step, it is N number of region that screen display content, which is used grid division,；
Second step, using image capture device, capture eyes see to it is different when eye slight change and extract feature, it is auxiliary
With blink identification, watch the technologies such as identification, twitching of the eyelid identification attentively, obtain following parameter:
Twitching of the eyelid path P=(B1,B2,...,Bn), wherein Bi(i=1...n) region that eye gaze is crossed is indicated；
Picture gaze duration TaAll fixation time summations of=picture；
Region gaze duration Tn(n=1...N) all fixation time summations in=interest region；
Rate R is stared in subregion zoningn(n=1...N)=Tn/Ta；
Calculate average gaze rate M=(R1+R2+...+RN)/N；
Rate variance S=((R is stared in zoning1-M)2+(R2-M)2+...+(RN-M)2)/N；
The identification of third step, region-of-interest uses under type such as to calculate:
When rate variance S > S is stared in regionaIt when (parameter), indicates that client has the region paid close attention to, takes out region and stare rate
Focus of the high region as client；
When rate variance S≤S is stared in regionaWhen (parameter), twitching of the eyelid indicates search of the client to attentinal contents, uses such as lower section
Method obtains client's focus:
Twitching of the eyelid path length, which is greater than N1 (1≤N1≤N), indicates the content that display content does not have client to pay close attention to；
The flyback number in certain region is greater than N2 (1≤N2≤N1) in twitching of the eyelid path, obtains the high region conduct of flyback number
The focus of client；
4th step analyzes the interest preference of client according to the content of focus region, switching display content, and
The new focus of user is reacquired, into control process next time.
The present invention obtains client's focus using eyeball tracking technology, it is possible to reduce the limitation to equipment installation position,
The usage scenario of expansion equipment improves the acquisition speed of user interest and focus, the effective utilization of lifting means.
The above description is only an embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (1)
1. a kind of method for obtaining focus on the screen using eyeball tracking technology, which comprises the following steps:
The first step, it is N number of region that screen display content, which is used grid division,；
Second step, using image capture device, capture eyes see to it is different when eye slight change and extract feature, be aided with and blink
Outlook is other, watches identification, twitching of the eyelid identification technology attentively, obtains following parameter:
Twitching of the eyelid path P=(B1,B2,...,Bn), wherein Bi(i=1...n) region that eye gaze is crossed is indicated；
Picture gaze duration TaAll fixation time summations of=picture；
Region gaze duration Tn(n=1...N) all fixation time summations in=interest region；
Rate R is stared in subregion zoningn(n=1...N)=Tn/Ta；
Calculate average gaze rate M=(R1+R2+...+RN)/N；
Rate variance S=((R is stared in zoning1-M)2+(R2-M)2+...+(RN-M)2)/N；
The identification of third step, region-of-interest uses under type such as to calculate:
When rate variance S > S is stared in regionaWhen (parameter), indicate that client has the region paid close attention to, it is high that rate is stared in taking-up region
Focus of the region as client；
When rate variance S≤S is stared in regionaWhen (parameter), twitching of the eyelid indicates search of the client to attentinal contents, obtains with the following method
Take client's focus:
Twitching of the eyelid path length, which is greater than N1 (1≤N1≤N), indicates the content that display content does not have client to pay close attention to；
The flyback number in certain region is greater than N2 (1≤N2≤N1) in twitching of the eyelid path, obtains the high region of flyback number as client
Focus；
4th step analyzes the interest preference of client according to the content of focus region, switching display content, and again
The new focus of user is obtained, into control process next time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910145780.1A CN109919065A (en) | 2019-02-26 | 2019-02-26 | A method of focus is obtained on the screen using eyeball tracking technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910145780.1A CN109919065A (en) | 2019-02-26 | 2019-02-26 | A method of focus is obtained on the screen using eyeball tracking technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109919065A true CN109919065A (en) | 2019-06-21 |
Family
ID=66962508
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910145780.1A Pending CN109919065A (en) | 2019-02-26 | 2019-02-26 | A method of focus is obtained on the screen using eyeball tracking technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109919065A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111798457A (en) * | 2020-06-10 | 2020-10-20 | 上海众言网络科技有限公司 | Image visual weight determining method and device and image evaluation method |
| CN112966872A (en) * | 2021-03-17 | 2021-06-15 | 京诚数字科技(江苏)有限公司 | Camera-based attention prediction analysis method and device and terminal |
| CN114052653A (en) * | 2021-11-19 | 2022-02-18 | 中国工商银行股份有限公司 | Desktop device, interest information acquisition method and acquisition system |
| WO2022042766A1 (en) * | 2020-08-25 | 2022-03-03 | 荣耀终端有限公司 | Information display method, terminal device, and computer readable storage medium |
| CN115019570A (en) * | 2021-03-03 | 2022-09-06 | 北京七鑫易维信息技术有限公司 | Intelligent teaching system |
| CN115935002A (en) * | 2022-11-18 | 2023-04-07 | 北京新唐思创教育科技有限公司 | Search method, device and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102221881A (en) * | 2011-05-20 | 2011-10-19 | 北京航空航天大学 | Man-machine interaction method based on analysis of interest regions by bionic agent and vision tracking |
| CN104395857A (en) * | 2012-05-09 | 2015-03-04 | 英特尔公司 | Eye tracking based selective accentuation of portions of a display |
| CN104834446A (en) * | 2015-05-04 | 2015-08-12 | 惠州Tcl移动通信有限公司 | Display screen multi-screen control method and system based on eyeball tracking technology |
| CN105138118A (en) * | 2015-07-31 | 2015-12-09 | 努比亚技术有限公司 | Intelligent glasses, method and mobile terminal for implementing human-computer interaction |
| CN106537290A (en) * | 2014-05-09 | 2017-03-22 | 谷歌公司 | Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects |
| CN108829242A (en) * | 2018-05-22 | 2018-11-16 | 深圳奥比中光科技有限公司 | Intelligent terminal and its non-touch operating method |
| CN108932096A (en) * | 2018-07-18 | 2018-12-04 | 三星电子（中国）研发中心 | A kind of method and apparatus of quick screenshotss |
-
2019
- 2019-02-26 CN CN201910145780.1A patent/CN109919065A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102221881A (en) * | 2011-05-20 | 2011-10-19 | 北京航空航天大学 | Man-machine interaction method based on analysis of interest regions by bionic agent and vision tracking |
| CN104395857A (en) * | 2012-05-09 | 2015-03-04 | 英特尔公司 | Eye tracking based selective accentuation of portions of a display |
| CN106537290A (en) * | 2014-05-09 | 2017-03-22 | 谷歌公司 | Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects |
| CN104834446A (en) * | 2015-05-04 | 2015-08-12 | 惠州Tcl移动通信有限公司 | Display screen multi-screen control method and system based on eyeball tracking technology |
| CN104834446B (en) * | 2015-05-04 | 2018-10-26 | 惠州Tcl移动通信有限公司 | A kind of display screen multi-screen control method and system based on eyeball tracking technology |
| CN105138118A (en) * | 2015-07-31 | 2015-12-09 | 努比亚技术有限公司 | Intelligent glasses, method and mobile terminal for implementing human-computer interaction |
| CN108829242A (en) * | 2018-05-22 | 2018-11-16 | 深圳奥比中光科技有限公司 | Intelligent terminal and its non-touch operating method |
| CN108932096A (en) * | 2018-07-18 | 2018-12-04 | 三星电子（中国）研发中心 | A kind of method and apparatus of quick screenshotss |
Non-Patent Citations (1)
| Title |
|---|
| 元明顺等: "《基于大数据驱动的市场研究实验教程》", 30 September 2016 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111798457A (en) * | 2020-06-10 | 2020-10-20 | 上海众言网络科技有限公司 | Image visual weight determining method and device and image evaluation method |
| CN111798457B (en) * | 2020-06-10 | 2021-04-06 | 上海众言网络科技有限公司 | Image visual weight determining method and device and image evaluation method |
| WO2022042766A1 (en) * | 2020-08-25 | 2022-03-03 | 荣耀终端有限公司 | Information display method, terminal device, and computer readable storage medium |
| CN115019570A (en) * | 2021-03-03 | 2022-09-06 | 北京七鑫易维信息技术有限公司 | Intelligent teaching system |
| CN112966872A (en) * | 2021-03-17 | 2021-06-15 | 京诚数字科技(江苏)有限公司 | Camera-based attention prediction analysis method and device and terminal |
| CN114052653A (en) * | 2021-11-19 | 2022-02-18 | 中国工商银行股份有限公司 | Desktop device, interest information acquisition method and acquisition system |
| CN115935002A (en) * | 2022-11-18 | 2023-04-07 | 北京新唐思创教育科技有限公司 | Search method, device and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109919065A (en) | A method of focus is obtained on the screen using eyeball tracking technology | |
| US10488925B2 (en) | Display control device, control method thereof, and display control system | |
| CN103869946B (en) | A kind of display control method and electronic equipment | |
| EP3293620A1 (en) | Multi-screen control method and system for display screen based on eyeball tracing technology | |
| CN104317396B (en) | A kind of method, apparatus and terminal device of the automatic deformation of screen | |
| CN109995942A (en) | A kind of eye care method and system of intelligent terminal | |
| JP2017526078A5 (en) | ||
| EP3403130A1 (en) | Language element vision augmentation methods and devices | |
| CN103425443A (en) | Control method, control system and electronic equipment | |
| CN104391574A (en) | Sight processing method, sight processing system, terminal equipment and wearable equipment | |
| CN104793741A (en) | Imaging system and method for guiding eyeballs to trace virtual reality | |
| CN106126786B (en) | Method for quantitatively evaluating man-machine work efficiency of man-machine interface design of cockpit display | |
| Ramirez Gomez et al. | Gaze+ hold: eyes-only direct manipulation with continuous gaze modulated by closure of one eye | |
| CN109597489A (en) | A kind of method and system of the eye movement tracking interaction of near-eye display device | |
| CN107260506B (en) | 3D vision training system, intelligent terminal and head-mounted device based on eye movement | |
| CN106502378A (en) | The control method at a kind of electronic equipment interface and electronic equipment | |
| CN107307981B (en) | Control method of head-mounted display device | |
| CN106886290A (en) | A kind of eye flowing control method and device | |
| US20190324270A1 (en) | Systems and methods for visually guided gaze-based targeting | |
| CN110162185A (en) | A kind of intelligent display method and device | |
| CN114138109A (en) | AR equipment based on brain-computer interaction | |
| US7446762B2 (en) | System and method for avoiding eye and bodily injury from using a display device | |
| US20130131535A1 (en) | Brainwave control system and method operable through time differential event-related potential | |
| CN111722708B (en) | Eye movement-based multi-dimensional geographic information self-adaptive intelligent interaction method and device | |
| CN104793732A (en) | Intelligent glasses operation method and intelligent glasses |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190621 |
|
| RJ01 | Rejection of invention patent application after publication |