CN206863514U - A kind of Eye-controlling focus device for exempting from calibration - Google Patents
A kind of Eye-controlling focus device for exempting from calibration Download PDFInfo
- Publication number
- CN206863514U CN206863514U CN201720550689.4U CN201720550689U CN206863514U CN 206863514 U CN206863514 U CN 206863514U CN 201720550689 U CN201720550689 U CN 201720550689U CN 206863514 U CN206863514 U CN 206863514U
- Authority
- CN
- China
- Prior art keywords
- eye
- controlling focus
- user
- image
- corneal reflection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The utility model discloses a kind of Eye-controlling focus device for exempting from calibration, the position of watching attentively of device user is tracked for realizing, the Eye-controlling focus device includes some Eye-controlling focus modules, each Eye-controlling focus module has different space coordinates in target area, Eye-controlling focus module includes at least one light source, for forming corneal reflection (the first Purkinje image) on the cornea of user, at least one image acquisition unit is also included, for capturing the corneal reflection image and pupil image of user.The Eye-controlling focus device for exempting from calibration also includes data processing module, for determining position or the band of position that user's eyes watch attentively according to corneal reflection image and pupil image, and stores the data that user watches the space coordinates attentively.The utility model is capable of the sight of convenient follow-up mechanism user, determines that user's watches position and watching area attentively without calibration or calibration.
Description
Technical field
The utility model belongs to eye and moves control field, more particularly to a kind of Eye-controlling focus device for exempting from calibration.
Background technology
The application of Eye Tracking Technique is very extensive, such as computer realm, psychology and physiological detection field, city
The multiple fields such as field marketing and advertisement.Eye Tracking Technique can also be used to collect user to the emerging of the article that is illustrated on shelf
Interesting degree.
Eye Tracking Technique of the prior art mainly adopts the following technical scheme that：(one is generally comprised using eye tracker
Individual or two video cameras and several infrared light supplies) in video camera shooting user's eye image, according to infrared in eye image
The corneal reflection of light source and the relative position relation of pupil center determine the position that eyes of user is seen.
Subject matter is existing for prior art, carries out Eye-controlling focus to device user using an eye tracker, often
Need to calibrate before secondary use or calibrate and (typically take eyes to watch the method for the calibration point of some ad-hoc locations attentively successively), otherwise eye
Dynamic instrument can not accurately judge that eyes of user watches position attentively, in-convenience in use and losing time.
Utility model content
In order to solve the above technical problems, inventors herein propose following technical scheme：
A kind of Eye-controlling focus device for exempting from calibration, comprising some Eye-controlling focus modules, each Eye-controlling focus module is in target
There is different space coordinates in region；Each Eye-controlling focus module includes at least one light source, at the canthus of user
Corneal reflection (the first Purkinje image) is formed on film；Each Eye-controlling focus module includes at least one image acquisition unit, uses
In the corneal reflection image and pupil image of capture user；The Eye-controlling focus device for exempting from calibration also includes data processing mould
Block, for carrying out Digital Image Processing, pupil center and corneal reflection are obtained, is determined according to corneal reflection and pupil center
The position or the band of position that user's eyes are watched attentively, and store the data that user watches the position or the band of position attentively.Using this
Eye-controlling focus device, without calibrating or calibrating, it becomes possible to the sight of convenient follow-up mechanism user, determine watching attentively for user
Position and watching area.
Preferably, a bandpass filter, the wavelength of bandpass filter and regarding where it are also included in Eye-controlling focus module
The light that light source in line tracing module is sent it is Wavelength matched, the reflected light path of corneal reflection is incident to by bandpass filter
Image acquisition unit, so that described image acquisition unit captures described corneal reflection image.Add bandpass filter
After piece, the image acquisition unit in Eye-controlling focus module can only receive the light of specific wavelength, filter the light of non-specific wavelength
Interference of the veiling glare to image acquisition unit can be effectively reduced, improves the recognition efficiency of Eye-controlling focus module.
Preferably, a bandpass filter, the wavelength of bandpass filter and regarding where it are also included in Eye-controlling focus module
The light that light source in line tracing module is sent it is Wavelength matched, the reflected light path of corneal reflection is incident to by bandpass filter
Image acquisition unit, so that described image acquisition unit captures described corneal reflection image.Due to two neighboring
The wavelength for the light that light source in Eye-controlling focus module is sent is different, so the wavelength and phase of the bandpass filter of Eye-controlling focus module
The optical source wavelength of adjacent Eye-controlling focus module can not be mutually matched.Now, the image acquisition unit in Eye-controlling focus module can not obtain
The light that light source is sent in adjacent Eye-controlling focus module is taken, eliminates adjacent Eye-controlling focus module light source to image acquisition unit
Interference.
Preferably, a bandpass filter, the wavelength of bandpass filter and regarding where it are also included in Eye-controlling focus module
The light that light source in line tracing module is sent it is Wavelength matched, the reflected light path of corneal reflection is incident to by bandpass filter
Image acquisition unit, so that described image acquisition unit captures described corneal reflection image.Due to all sights
The wavelength for the light that light source in tracing module is sent is different, so the bandpass filter of each Eye-controlling focus module can only lead to
The light that the light source crossed in the Eye-controlling focus module where it is sent, eliminate in addition to Eye-controlling focus module itself light source where it
Other interference of Eye-controlling focus module light source to image acquisition unit, improve the efficiency of Eye-controlling focus device.
Preferably, some Eye-controlling focus modules are turned on and off successively according to the time cycle of setting.In setting time week
In phase, all Eye-controlling focus sequence of modules are turned on and off, it is possible to achieve within this time cycle, each image acquisition unit is only
A corneal reflection image is obtained, greatly improves the efficiency of Eye-controlling focus device.
Preferably, Eye-controlling focus device also includes control unit and some controlled plants.Control unit receives Eye-controlling focus
The data that data processing unit transmits in device, and send instruction control controlled plant according to data.Device user can be
Controlled plant is controlled in the case of without calibration, can feel more square when user is using Eye-controlling focus device control controlled plant
Just, more preferably experienced.
Preferably, the light source in Eye-controlling focus module is infrared light supply, can avoid visible ray to image acquisition unit
Interference.
The Eye-controlling focus device that the utility model discloses, without calibrating or calibrating, it becomes possible to which convenient follow-up mechanism uses
The sight of person, determine that user's watches position and watching area attentively.
Brief description of the drawings
Fig. 1 is a kind of structured flowchart for the Eye-controlling focus device for exempting from calibration of the utility model；
Fig. 2 is the utility model technical principle schematic diagram；
Fig. 3 is the schematic diagram of the utility model embodiment one；
Fig. 4 is the schematic diagram of the utility model embodiment two；
Fig. 5 is the schematic diagram of the corneal reflection obtained in embodiment two；
Fig. 6 is the schematic diagram of the utility model embodiment three.
Embodiment
To describe the technical solution of the utility model in detail, in conjunction with brief description of the drawings the utility model preferred embodiment.
As shown in figure 1, the utility model discloses a kind of Eye-controlling focus device 10 for exempting from calibration, the Eye-controlling focus device 10
It is middle that some Eye-controlling focus modules 100 are set；Described Eye-controlling focus module 100 includes：At least one light source 101, for making
Corneal reflection is formed on the cornea of user；At least one image acquisition unit 102 (camera), for capturing user's
Corneal reflection image and pupil image；Eye-controlling focus device 10 also includes data processing module 200, for reflective according to cornea
Dot image and pupil image determine the position or the band of position that user's eyes are watched attentively.
The technical principle that the utility model uses is when user's eyes watch certain point attentively, from the camera positioned at the point
And pupil center in the eyes of user image taken by light source and corneal reflection center essentially coincide.The utility model base
In such hypothesis：When a certain image acquisition unit collects the corneal reflection image and pupil image of user's eyes 40,
When its corneal reflection 50 is located at center or the near center location of pupil 401, then it is assumed that user is observing this and regarded
Position (as shown in Figure 2) where line tracing module.
Embodiment one：According to above-mentioned technical principle, the Eye-controlling focus device 10 in the utility model can be used for businessman
Assess customer's commodity interested and display location interested or the band of position.In embodiment one, by Eye-controlling focus
When device 10 carries out advertising or displaying for commodity in shopper window, interest journey of the collection user to display product
Degree.As shown in figure 3,9 commodity are illustrated in show window (replaces each commodity, business respectively in figure with A, B, C, D, E, F, G, H, I
The species of product is can be in article shown in show window, such as toy, electrical equipment etc.), the corresponding Eye-controlling focus of each commodity
Module 100, Eye-controlling focus module are arranged on the underface of commodity, and between the two in small distance, in the present embodiment, both it
Between distance can be ignored.In order to obtain the eye position of user's eyes or the band of position, user's eyes watch certain attentively
During position, image acquisition unit captures the corneal reflection image and pupil image of user, by operating in image procossing list
The algorithm of member, calculates the pupil cornea vector between each corneal reflection and pupil center, more all pupil cornea vectors
Length, the space coordinates where Eye-controlling focus module corresponding to the most short image of vector length are the space that user watches attentively
Coordinate, which part commodity that user is look in 9 commodity thus can be judged.
So, the user of certain sample size is acquired respectively, user position interested or position area
Domain forms hotspot graph or eye movement data statistical report form, it can be determined that goes out interested degree of the user to commodity, statistical result
Evaluation studies can be carried out to Window Display position for businessman.
In the present embodiment, in order to improve efficiency, the two dimensional image of pupil is assumed to be one using pupil center as the center of circle
Circle, as shown in Fig. 2 can only to a certain threshold range 60 (threshold range be radius be less than pupil radium circle) in cornea
Reflective spot is analyzed, and the corneal reflection image beyond the threshold range 60 is not involved in calculating, and reduces the quantity of contrast.
Embodiment two：In the present embodiment, some Eye-controlling focus modules were opened or closed successively according to the time cycle of setting
Close.Within the setting time cycle, all Eye-controlling focus sequence of modules are turned on and off, it is possible to achieve within this time cycle, often
Individual image acquisition unit only obtains a corneal reflection image, greatly improves the efficiency of Eye-controlling focus device.As shown in figure 4,
Three switch panels (1,2,3) are arranged side by side on metope, wherein, switch panel 1 represents light switch, and switch panel 2 represents
Central air-conditioning is switched, and switch panel 3 represents ground heating system switch, and 3 Eye-controlling focus modules 100 are integrated into the central position of panel
Put, and switching device is embedded into wall.The cycle of unlatching successively of 3 Eye-controlling focus modules is arranged to 0.1 second, works as human eye
When watching the switch installation region of metope attentively, 3 Eye-controlling focus modules are opened successively in 0.1 second, and image acquisition unit obtains angle
The reflective dot image of film, as shown in Fig. 5 A~5C, respectively switch panel 1, switch panel 2, the image corresponding to switch panel 3 obtain
The image and pupil image of the corneal reflection of the shooting of unit 102 are taken, corresponding corneal reflection vector is respectively 11,21,31,
Length by comparing three corneal reflection vectors judges that user is just being look at switch panel 2, i.e. user wants control
Switching device corresponding to switch panel 2.
Embodiment three：In the present embodiment, Eye-controlling focus device includes control unit and some controlled plant (201-
205), control unit receives the data that data processing unit transmits in Eye-controlling focus device, and sends instruction control according to data
Controlled plant.Eye-controlling focus device 10 is used to control the miscellaneous switching device being arranged in family on wall, such as Fig. 6
It is shown, include light switch 201, central air-conditioning switch 202, ground heating system switch 203, the VMC switch being arranged in order
204 and intelligent Home Center Control Unit switch 205, and each switching device is correspondingly arranged an Eye-controlling focus module 100,
Each Eye-controlling focus module includes a light source 101 and an image acquisition unit 102.
In the present embodiment, for the ease of implementing, Eye-controlling focus module 100 is provided in the lower section of switching device, can be with
For transforming existing switching device, to realize eye control function, as shown in Figure 6.Similarly, by Eye-controlling focus module 100
The top, left side and right side of switching device are may also be arranged on, would be obvious to one skilled in the art.
In the present embodiment, switching device communicates with the data processing module 200 in Eye-controlling focus device 10, receives data
The control instruction that processing module 200 is sent, and receive switching device state in which information；For example, control light switch, when
When light switch is in normally open, data processing module determines user's eyes according to corneal reflection image and pupil image
Light switch is just look at, now data processing module 200 sends the instruction closed to light switch；If light switch is in normal
During closed state, data processing module determines that user's eyes are just being look at electric light and opened according to corneal reflection image and pupil image
Close, now data processing module 200 sends the instruction opened to light switch.
Similarly, the Eye-controlling focus device 10 in the utility model can be also used for function on driver and vehicle by
Button is interacted, and determines the function button that driver watches attentively, and corresponding function button is responded.For example, to the sound on automobile
Acoustic system, air-conditioning system etc. are controlled, and set an Eye-controlling focus module corresponding to each system at switch device position,
When the sight for collecting user falls in the position of the switch, corresponding function is turned on and off.
In another embodiment of the present utility model, a bandpass filter, band logical filter are also included in Eye-controlling focus module
Wavelength matched, the reflected light of corneal reflection for the light that the wavelength of mating plate is sent with the light source in the Eye-controlling focus module where it
Road is incident to image acquisition unit by bandpass filter, so as to capture described cornea anti-for described image acquisition unit
Dot pattern picture.Due to the wavelength difference for the light that the light source in two neighboring Eye-controlling focus module is sent, so Eye-controlling focus module
The wavelength of bandpass filter and the optical source wavelength of adjacent Eye-controlling focus module can not be mutually matched.Now, Eye-controlling focus module
In image acquisition unit can not obtain the light that light source is sent in adjacent Eye-controlling focus module, eliminate adjacent Eye-controlling focus
Interference of the module light source to image acquisition unit.
In another embodiment of the present utility model, a bandpass filter, band logical filter are also included in Eye-controlling focus module
Wavelength matched, the reflected light of corneal reflection for the light that the wavelength of mating plate is sent with the light source in the Eye-controlling focus module where it
Road is incident to image acquisition unit by bandpass filter, so as to capture described cornea anti-for described image acquisition unit
Dot pattern picture.The wavelength of the light sent due to the light source in all Eye-controlling focus modules is different, so each Eye-controlling focus
The light that the bandpass filter of module can only be sent by the light source in the Eye-controlling focus module where it, is eliminated except where it
Other the outer interference of Eye-controlling focus module light source to image acquisition unit of itself light source of Eye-controlling focus module, improve Eye-controlling focus
The efficiency of device.
Although content of the present utility model is discussed in detail by above preferred embodiment, but it should be appreciated that on
The description stated is not considered as to limitation of the present utility model.After those skilled in the art have read the above, for
A variety of modifications and substitutions of the present utility model all will be apparent.Therefore, the scope of protection of the utility model should be by appended
Claim limit.
Claims (7)
1. a kind of Eye-controlling focus device for exempting from calibration, it is characterised in that include：
Some Eye-controlling focus modules, each Eye-controlling focus module have different space coordinates in target area；
Described Eye-controlling focus module includes：
At least one light source, for forming corneal reflection on the cornea of user；
At least one image acquisition unit, for capturing the corneal reflection image and pupil image of user；
The described Eye-controlling focus device for exempting from calibration also includes data processing module, for according to corneal reflection and pupil center
Position or the band of position that user's eyes are watched attentively are determined, and stores the data that user watches the position or the band of position attentively.
2. according to the Eye-controlling focus device described in claim 1, it is characterised in that also included in described Eye-controlling focus module
One bandpass filter, the wavelength for the light that the wavelength of the bandpass filter is sent with the light source in the Eye-controlling focus module where it
Matching, the reflected light path of described corneal reflection passes through described bandpass filter and is incident to image acquisition unit, so as to
Described image acquisition unit is set to capture described corneal reflection image.
3. according to the Eye-controlling focus device described in claim 2, it is characterised in that the light in two neighboring Eye-controlling focus module
The wavelength for the light that source is sent is different.
4. according to the Eye-controlling focus device described in claim 2, it is characterised in that the light source hair in all Eye-controlling focus modules
The wavelength of the light gone out is different.
5. according to the Eye-controlling focus device described in claim 1, it is characterised in that described some Eye-controlling focus modules according to
The time cycle of setting is turned on and off successively.
6. according to the Eye-controlling focus device described in claim 1, it is characterised in that the Eye-controlling focus device also includes control
Unit and some controlled plants.
7. according to the Eye-controlling focus device described in claim 1, it is characterised in that the light source is infrared light supply.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201720550689.4U CN206863514U (en) | 2017-05-17 | 2017-05-17 | A kind of Eye-controlling focus device for exempting from calibration |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201720550689.4U CN206863514U (en) | 2017-05-17 | 2017-05-17 | A kind of Eye-controlling focus device for exempting from calibration |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN206863514U true CN206863514U (en) | 2018-01-09 |
Family
ID=60824326
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201720550689.4U Active CN206863514U (en) | 2017-05-17 | 2017-05-17 | A kind of Eye-controlling focus device for exempting from calibration |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN206863514U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ES2741377A1 (en) * | 2019-02-01 | 2020-02-10 | Mendez Carlos Pons | ANALYTICAL PROCEDURE FOR ATTRACTION OF PRODUCTS IN SHIELDS BASED ON AN ARTIFICIAL INTELLIGENCE SYSTEM AND EQUIPMENT TO CARRY OUT THE SAID PROCEDURE (Machine-translation by Google Translate, not legally binding) |
-
2017
- 2017-05-17 CN CN201720550689.4U patent/CN206863514U/en active Active
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ES2741377A1 (en) * | 2019-02-01 | 2020-02-10 | Mendez Carlos Pons | ANALYTICAL PROCEDURE FOR ATTRACTION OF PRODUCTS IN SHIELDS BASED ON AN ARTIFICIAL INTELLIGENCE SYSTEM AND EQUIPMENT TO CARRY OUT THE SAID PROCEDURE (Machine-translation by Google Translate, not legally binding) |
| WO2020157366A1 (en) * | 2019-02-01 | 2020-08-06 | Pons Méndez Carlos | Method for analysing product attraction in shop windows based on an artificial intelligence system and equipment for carrying out said method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107145086A (en) | A kind of Eye-controlling focus device and method for exempting from calibration | |
| US10635900B2 (en) | Method for displaying gaze point data based on an eye-tracking unit | |
| US10182720B2 (en) | System and method for interacting with and analyzing media on a display using eye gaze tracking | |
| Berman et al. | Sensors for gesture recognition systems | |
| EP2549914B1 (en) | System and method for tracking the point of gaze of an observer | |
| US7809160B2 (en) | Method and apparatus for calibration-free eye tracking using multiple glints or surface reflections | |
| US9710058B2 (en) | Portable eye tracking device | |
| US20160210503A1 (en) | Real time eye tracking for human computer interaction | |
| US7657062B2 (en) | Self-calibration for an eye tracker | |
| US20140022371A1 (en) | Pupil detection device | |
| CN107004275A (en) | For determining that at least one of 3D in absolute space ratio of material object reconstructs the method and system of the space coordinate of part | |
| CN102830793A (en) | Sight tracking method and sight tracking device | |
| Tripathi et al. | A statistical approach to continuous self-calibrating eye gaze tracking for head-mounted virtual reality systems | |
| Toivanen et al. | Probabilistic approach to robust wearable gaze tracking | |
| Arar et al. | A regression-based user calibration framework for real-time gaze estimation | |
| CN112666705A (en) | Eye movement tracking device and eye movement tracking method | |
| CN109670456A (en) | A kind of content delivery method, device, terminal and storage medium | |
| CN108369744A (en) | It is detected by the 3D blinkpunkts of binocular homography | |
| CN108537103B (en) | Living body face detection method and device based on pupil axis measurement | |
| JP2013125985A (en) | Display system | |
| CN206863514U (en) | A kind of Eye-controlling focus device for exempting from calibration | |
| WO2008132741A2 (en) | Apparatus and method for tracking human objects and determining attention metrics | |
| CN103565399A (en) | Pupil detector | |
| Li et al. | Distributed rgbd camera network for 3d human pose estimation and action recognition | |
| Ferhat et al. | Eye-tracking with webcam-based setups: Implementation of a real-time system and an analysis of factors affecting performance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |