CN103793045B - Pupil tracing device - Google Patents
Pupil tracing device Download PDFInfo
- Publication number
- CN103793045B CN103793045B CN201210428613.6A CN201210428613A CN103793045B CN 103793045 B CN103793045 B CN 103793045B CN 201210428613 A CN201210428613 A CN 201210428613A CN 103793045 B CN103793045 B CN 103793045B
- Authority
- CN
- China
- Prior art keywords
- pupil
- light source
- brightness
- image
- active light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
A kind of pupil tracing device, comprises active light source, imageing sensor and control processing unit.Described active light source is luminous towards eyeball with the first brightness and the second brightness in turn.Described imageing sensor obtains the first luminance picture of the most described first brightness and the second luminance picture of relative described second brightness.Described control processing unit is in order to be identified as active light source image relative to the brightest area of position by described first luminance picture in described second luminance picture.
Description
Technical field
The present invention is about a kind of interaction systems, uses at least one active light source as positioning datum especially with regard to one
The pupil tracing device of point.
Background technology
Interactive control mechanism can provide the control mode that user is more humane, each because being widely used in
Formula multimedia system, is particularly applicable to comprise the image display system of display screen.
It is a kind of conventional means as interactive man-computer interface that use can obtain the remote controller of image, and described distant
Control device can be made into various stage property, such as bat, racket, club etc..Another kind of interactive man-computer interface is then to be not required to use
Any hand-held device is carried out, and such as pupil tracing device can carry out interactive according to the change of user direction of visual lines
Operation.
Known pupil tracing device has a problem in that the impact being easily subject to environment light source, such as Fig. 1 show eye image 9
Schematic diagram, it comprises pupil image Ip and environment light source image Io, when described pupil image Ip and described environment light source image
When Io is overlapped, then it is likely to occur the situation that cannot be properly positioned described pupil image Ip, thus cannot correctly carry out pupil
Follow the trail of.
In view of this, the present invention also proposes a kind of pupil tracing device, and it can be got rid of the impact of environment light source, improve whereby
The correctness of pupil tracing.
Summary of the invention
The purpose of the present invention is providing a kind of pupil tracing device, and it utilizes at least one active light source to be formed towards eyeball luminescence
Positioning datum point.
Another object of the present invention is providing a kind of pupil tracing device being applicable to wear-type accessory.
The present invention provides a kind of pupil tracing device, comprises active light source, imageing sensor and control processing unit.Described
Active light source is luminous towards eyeball with the first brightness and the second brightness in turn.Described imageing sensor obtains the most described first brightness
The second luminance picture of the first luminance picture and relative described second brightness.Described control processing unit is in order to by described first
Luminance picture is identified as active light source image relative to the brightest area of position in described second luminance picture.
The present invention also provides for a kind of pupil tracing device, comprises active light source, imageing sensor and control processing unit.Institute
State active light source luminous towards eyeball with the first brightness and the second brightness in turn.Described imageing sensor obtains the most described first bright
First luminance picture of degree and the second luminance picture of relative described second brightness.Described control processing unit is described in order to calculate
Dark areas in described difference image is also identified as actively by the first luminance picture and the difference image of described second luminance picture
Light source image.
In one embodiment, described control processing unit is according to described first luminance picture or described second luminance picture identification
Pupil position；Wherein, when described first brightness is higher than described second brightness, described control processing unit is by described first brightness
In image, minimum gray scale is on weekly duty encloses grey decision-making and is identified as pupil region between multiple pixels of grey decision-making scope, and calculates described pupil
The center of gravity of bore region or center are using as described pupil position.
In one embodiment, pupil tracing device additionally comprises memory element in order to store described active light source image and described pupil
The pupil coordinate information that hole site is relevant.Described control processing unit can calculate current pupil according to described pupil coordinate information and sit
Mark.
In one embodiment, described first luminance picture and described second luminance picture can be by changing described imageing sensor
Time of exposure and/or circuit gain realize, be not necessarily to change the brightness of described active light source.
The present invention also provides for a kind of pupil tracing device, and this device comprises at least two active light source, an imageing sensor
Processing unit is controlled with one.Described at least two active light sources are luminous to illuminate eyeball in turn.Described imageing sensor obtains relatively
The first picture frame that different described active light sources is lighted and the second picture frame.Described control processing unit is in order to calculate described
Dark areas and brightest area in described difference image is also identified as by one picture frame and the difference image of described second picture frame
Active light source image.
In one embodiment, described control processing unit is always according to described first picture frame identification the first pupil region basis
Described second picture frame identification the second pupil region；And by described first pupil region and the Lian Ji district of described second pupil region
Territory is defined as exporting pupil region.
In one embodiment, described pupil tracing device comprises four active light sources, described in described control processing unit identification
Four active light source images calculate the elements of a fix of the most described four active light source images respectively in difference image.Described control
Processing unit processed then can calculate the eyeball center of described eyeball according to described four elements of a fix.
In one embodiment, described control processing unit is defeated always according to described first picture frame and described second picture frame identification
Go out pupil region, and the line direction at described eyeball center Yu described output pupil region is defined as direction of visual lines.
In the pupil tracing device of the embodiment of the present invention, described active light source image refers to that described active light source is at cornea
(Cornea) reflected image on.
In the pupil tracing device of the embodiment of the present invention, described active light source image is used as the location base into pupil tracing
On schedule, therefore pupil tracing device is advantageously provided on wear-type accessory, with active light source image described in fixing described eyeball
Position.
In the pupil tracing device of the embodiment of the present invention, by the correct position identifying active light source image using as fixed
Position datum mark and by calculate difference image with eliminate environment light source impact, the degree of accuracy of pupil tracing can be effectively improved.
Accompanying drawing explanation
Fig. 1 shows the schematic diagram of eye image；
The block schematic diagram of the pupil tracing device of Fig. 2 A display embodiment of the present invention.
In the pupil tracing device of Fig. 2 B display embodiment of the present invention, the schematic diagram of pupil coordinate information；
Fig. 3 A shows the running schematic diagram of the pupil tracing device of one embodiment of the invention；
Fig. 3 B shows Image Acquisition and the schematic diagram of light source igniting of the pupil tracing device of one embodiment of the invention；
Fig. 3 C shows in the pupil tracing device of one embodiment of the invention, identifies the schematic diagram of active light source image；
Fig. 3 D shows Image Acquisition and the schematic diagram of light source igniting of the pupil tracing device of another embodiment of the present invention；
Fig. 4 shows in the pupil tracing device of the embodiment of the present invention, identifies the schematic diagram of pupil position；
Fig. 5 A shows the running schematic diagram of the pupil tracing device of another embodiment of the present invention；
Fig. 5 B shows Image Acquisition and the schematic diagram of light source igniting of the pupil tracing device of another embodiment of the present invention；
Fig. 5 C shows in the pupil tracing device of another embodiment of the present invention, identifies the schematic diagram of active light source image.
Description of reference numerals
1 pupil tracing device 111-114 active light source
12 imageing sensors 13 control processing unit
14 memory element 2 wear-type accessories
3 image display device 9 eye images
90 eyeballs 91,91' pupil image
92,92' iris image 93,93' corneal moieties
91-94Eye image LS111-LS114Reflection light point
fb1、fb2Luminance picture f1, f2 picture frame
fb1-fb2Difference image f1-f2 difference image
I111-I114Active light source image I111'-I114' active light source image
P1Minimum gray scale value P2Pupil position
Rg grey decision-making scope PA pupil region
A111、A111' brightest area IPPupil image
Io environment light source image C1-C4Preset reference point
IC1-IC4Pupil imageDistance.
Detailed description of the invention
In order to above and other purpose, feature and the advantage of the present invention can be become apparent from, appended diagram hereafter will be coordinated,
It is described in detail below.In the explanation of the present invention, identical component is to represent with identical symbol, should illustrate in advance at this.
Refer to shown in Fig. 2 A, the block schematic diagram of the pupil tracing device 1 of its display embodiment of the present invention, comprise at least
One active light source (being the most now shown as four active light source 111-114), imageing sensor 12, control processing unit 13 and storage
Unit 14.The pupil tracing device 1 of the present embodiment mainly utilizes described active light source to be projected to a few active light on eyeball 90
Source images is using as positioning datum point, and closes according to pupil position is relative with described positioning datum point (i.e. active light source image)
System determines pupil coordinate；Wherein, described active light source image refers to described active light source reflected image on cornea.Described pupil
Wired or wireless for described pupil coordinate such as can be sent to image display device 3(Fig. 2 B by hole follow-up mechanism 1) with control relatively
Make described image display device 3 and perform corresponding function.Should be noted that, the purpose using four active light sources is to count
Calculate eyeball center, if but only carry out pupil tracing, any number of active light source can be used.
It is said that in general, when described eyeball 90 is looked down, upper eyelid meeting shaded portions eyeball 90, if the most described pupil chases after
Track device 1 is arranged on wear-type accessory 2, and the position that arranges of described imageing sensor 12 is preferably less than described eyeball 90, to keep away
Exempt to cause detecting when eyeball 90 looks down (pupil is down) situation of pupil.
Described active light source 111-114 can be such as infrared light light source, such as infrared light light-emittingdiode, to avoid lighting
Time affect sight line.Described active light source 111-114 is in order to towards the luminescence of described eyeball 90 with the described eyeball 90 of illumination and in described
On eyeball, 90 form reflection light point (being i.e. presented in the active light source image on described eyeball 90).Should be noted that, each
Active light source can only comprise single light source element or be formed by the arrangement of multiple light sources.
Described imageing sensor 12 can be such as that ccd image sensor, cmos image sensor etc. are in order to sense light energy
Optical sensor, it obtains described eyeball 90 with lighting of frame per second (frame rate) the most described active light source 111-114
Picture frame.Described imageing sensor 12 can be fixed or variable time of exposure and circuit gain obtain picture frame.Mandatory declaration
, the frame per second of described imageing sensor 12 can be not equal to the glow frequency of described active light source 111-114.
Described control processing unit 13 is in order to control lighting and described imageing sensor of described active light source 111-114
The Image Acquisition of 12, and according to the picture frame identification pupil position acquired in described imageing sensor 12, pupil coordinate, active light
Source images, eyeball center and direction of visual lines etc. (after being specified in).In other embodiments, described control processing unit 13 also can be by many
Individual unit is formed, such as, control described active light source 111-114 and independent process list with independent light source control unit
Unit (DSP) carries out post processing of image, there is no specific restriction.
The pupil coordinate letter that described memory element 14 is relevant to described pupil position in order to store described active light source image
Breath.Whereby, when described control processing unit 13 tries to achieve the current relativeness of current pupil position and active light source image, then may be used
Described pupil coordinate information according to prestoring tries to achieve current pupil coordinate.Referring for example to shown in Fig. 2 B, the embodiment of the present invention
Pupil tracing device 1 such as can comprise setting program (setup procedure), its can before every time operation automatically into or
Accept just to enter during instruction.In described setting program, user can watch preset reference point successively attentively, such as, but not limited to, successively
Four corner C of gazing at images display device 31-C4, the most described imageing sensor 12 obtains four eye images 9 the most successively1-
94, each eye image 91-94Comprise pupil image I respectivelyC1-IC4With active light source image I111；Wherein, described active light
Source images I111In four eye images 91-94In be respectively positioned on identical (relatively) position.Such as, reference Point C is watched attentively when user1
Time, described imageing sensor 12 obtains described eye image 91；Wherein, described pupil image IC1To described active light source image
I111Vector be assumed to be；In like manner, described control processing unit 13 can obtain described eye image 9 respectively2-94In vectorPupil tracing device 1 then can be according to described vectorDefining operation space is also pre-stored within described storage list
In unit 14.Whereby, when practical operation, described control processing unit 13 then can calculate current pupil seat according to described working place
Mark.Should be noted that, vector described in Fig. 2 BDirection be likely on the contrary.
Refer to shown in Fig. 3 A, the running schematic diagram of the pupil tracing device 1 of its display one embodiment of the invention.Described pupil
Hole follow-up mechanism 1 comprises active light source 111, imageing sensor 12, controls processing unit 13 and memory element 14.Deposit as previously mentioned
Storage unit 14 uses to store the pupil coordinate information that active light source image is relevant to pupil position, therefore repeats no more in this.
Referring to shown in Fig. 3 A to 3D, Fig. 3 B shows in the pupil tracing device of Fig. 3 A, described imageing sensor 12
Image Acquisition and the schematic diagram of light source igniting of described active light source 111；Fig. 3 C shows in the pupil tracing device of Fig. 3 A, institute
Stating control processing unit 13 and identify the schematic diagram of active light source image I111, Fig. 3 D shows in the pupil tracing device of Fig. 3 A, institute
State the Image Acquisition of imageing sensor 12 and another schematic diagram of the light source igniting of described active light source 111.
Described active light source 111 is luminous towards eyeball 90 with the first brightness and the second brightness in turn.Described imageing sensor 12
Obtain the first luminance picture f of the most described first brightnessb1Second luminance picture f of the most described second brightnessb2.Such as
In Fig. 3 C, described first luminance picture fb1Comprise brightest area A111(i.e. active light source image), pupil (Pupil) image 91, rainbow
Film (Iris) image 92 and cornea (Cornea) part 93；Described second luminance picture fb2Comprise brightest area A111' (i.e. actively
Light source image), pupil image 91', iris image 92' and corneal moieties 93'.Pupil tracing device due to the embodiment of the present invention
1 is advantageously provided on wear-type accessory 2, so that described active light source 111 is fixed with the relative position of described eyeball 90, and therefore institute
State brightest area A111、A111Although ' be positioned in different luminance picture, but it is positioned at (identical) position relatively, and described active light source
Image is the described active light source 111 direct pip on cornea, for brightest area in image.Therefore, described control processes
Unit 13 can be by described first luminance picture fb1With described second luminance picture fb2In relative to brightest area (the i.e. A of position111、
A111') it is identified as active light source image I111；Wherein, described brightest area refers to that grey decision-making is the highest.Whereby, though described image
Luminance picture acquired in sensor 12 includes other environment light source images, yet with described eyeball 90 and environment light source
Between spatial relationship do not fix, environment light source image described in different luminance pictures will not be positioned at same position, therefore finds relatively
The brightest area of position can get rid of the impact of environment light source whereby.In other embodiments, described imageing sensor 12 can additionally obtain
Take described active light source 111 not luminescent image (a 3rd luminance picture) fb3, as shown in Figure 3 D, and by described first luminance graph
As fb1With described second luminance picture fb2It is individually subtracted described 3rd luminance picture and obtains fb13With fb23Filtering environmental light is done whereby
Disturb and the active light source image of stable detection brightest area.
Additionally, in addition to the brightness (such as changing the size of driving electric current) changing described active light source 111, it is possible to fixing
The brightness of described active light source 111 and change the sampling parameter of described imageing sensor 12 and (such as comprise time of exposure and circuit
Gain etc.) reach identical purpose.That is, in another embodiment, described first brightness can be equal to described second brightness, described figure
As sensor 12 obtains described first luminance picture f with the first time of exposure and the first circuit gainb1And with the second time of exposure
Described second luminance picture f is obtained with second circuit gainb2；Wherein, described first time of exposure is not equal to described second exposure
Time and/or described first circuit gain are not equal to described second circuit gain.
Separately can be according to described first luminance picture f additionally, control processing unit 13 described in the present embodimentb1Or described second
Luminance picture fb2Identify pupil position；Wherein, described control processing unit 13 is preferably according to the luminance picture with higher brightness
Identifying described pupil position, what so energy was more visible identifies pupil image 91.Referring for example to shown in Fig. 4, described control processes
Unit 13 is in order to calculate described first luminance picture fb1In (it is assumed that described first brightness higher than described second brightness) minimum
Grey decision-making P1, and by described minimum gray scale value P1Around grey decision-making is identified as lesser ring of Merkel between multiple pixels of grey decision-making scope Rg
Territory PA.When described active light source 11 is lighted, the brightness of described pupil image 91 is minimum, and the brightness of described pupil region 93 is the highest
And the brightness of described iris image 92 is generally between described pupil image 91 and described pupil region 93, therefore described minimum gray scale
Value P1There will be in described pupil image 91.Therefore, described minimum gray scale value P1Neighbouring pixel region then can be considered described
Pupil region PA, and described minimum gray scale value P1Neighbouring pixel region such as may utilize image and hives off (image grouping)
Mode inter-related pixel region is regarded as same object, such as can refer to convey to U.S. of common assignee of the present invention
State's patent discloses No. 20110176733, disclosed in entitled " image-recognizing method ".Additionally, described grey decision-making scope
The setting of Rg can adjust according to the operating environment of described pupil tracing device 1, and such as open air can separately design different from indoor
Grey decision-making scope Rg.Furthermore, for avoiding noise jamming, described control processing unit 13 separately can be according to described pupil region PA
The characteristics such as size and dimension judge whether to belong to environment light source image, and such as the least when size or non-genus circle person may be i.e. ring
Environmental light source, can be got rid of.
Then, described control processing unit 13 can calculate the center of gravity of described pupil region PA or center using as pupil position
P2, and according to described pupil position P2With described reference light source image I111Relative position reference described in memory element 14 is deposited
The pupil coordinate information of storage exports described pupil position P2Relevant pupil coordinate (x, y).Described control processing unit 13 is such as
Can be according to described pupil coordinate (x, y) action of the vernier of relation control image display device 3.It will be appreciated that described pupil
Hole site P2 can be not equal to described minimum gray scale value P1Position.
Sum it up, in the present embodiment, described control processing unit 13 is according to active light source described in two picture frame identifications
Image I111, but only identify described pupil position with one (such as brightness the higher person), get rid of environment light source impact and institute whereby
State active light source image and can be used as the positioning datum point of pupil tracing.
In another embodiment, in order to eliminate the impact of environment light source further, described control processing unit 13 can be further
Calculate described first luminance picture fb1With described second luminance picture fb2Difference image (fb1-fb2), and by described difference image
(fb1-fb2In) dark areas by with described first luminance picture fb1Or described second luminance picture fb2Relatively, to identify master
Dynamic light source image I111" (such as Fig. 3 C)；Wherein, described dark areas refers to that grey decision-making is minimum, and it can be such as about 0 GTG, but
It can also be relative value.
Specifically, due to described first luminance picture fb1With the second luminance picture fb2Described in active light source image I111
(i.e. brightest area A111And A111') it is respectively provided with maximum brightness (high-order of used grey decision-making scope), the most described difference
Partial image (fb1-fb2The I of active light source image described in)111Can have minimum brightness.In one embodiment, it is assumed that described first image
fb1In, active light source image I111Being 255 GTGs, pupil image 91 is 0 GTG, and iris image 92 is 128 GTGs and corneal moieties
93 is 228 GTGs；Described second image fb2In, active light source image I111' it is 255 GTGs, pupil image 91' is 0 GTG, rainbow
Film image 92' is 64 GTGs and corneal moieties 93' is 100 GTGs；So can try to achieve described difference image (fb1-fb2In), actively
Light source image I111" being 0 GTG, pupil image 91 " is 0 GTG, and iris image 92 " being 64 GTGs and corneal moieties 93 " is 128
GTG.Owing to described pupil image 91, the grey decision-making of 91' are 0 GTG, the most described difference image (fb1-fb2Pupil described in)
Hole pattern " can have minimum brightness equally as 91.Now, can be by relatively described difference image (fb1-fb2) and described first brightness
Image fb1Or described second luminance picture fb2, just may recognize that described active light source image I111" the position of (such as Fig. 3 C)；Its
In, the mode compared such as, due to described first luminance picture fb1Or described second luminance picture fb2In described pupil image
91,91' all has minimum brightness, the most just can be directly by relatively described first luminance picture fb1With described difference image
(fb1-fb2) which image object is to be changed to the most very dark by relative incandescent in two images, just can determine described active accordingly
Light source image I111" the position of (such as Fig. 3 C)；Or, by relatively described second luminance picture fb2With described difference image
(fb1-fb2) which image object is to be changed to the most very dark by relative incandescent in two images, just can determine described active accordingly
Light source image I111" the position of (such as Fig. 3 C).In another embodiment, can be by described difference image (fb1-fb2Have minimum bright in)
Degree and image object area smaller are identified as described active light source image and will have minimum brightness and image object area relatively
Big person is identified as pupil image.
Additionally, except described active light source image I in the present embodiment111Calculating be to utilize difference image (fb1-fb2) enter
Outside row, other include identifying pupil position, setting up pupil coordinate information and realize described first luminance picture fb1With described
Two luminance picture fb2All identical with previous embodiment etc. mode, therefore repeat no more in this.
Refer to shown in Fig. 5 A, the running schematic diagram of the pupil tracing device 1 of its display another embodiment of the present invention.Described
Pupil tracing device 1 comprises four active light source 111-114, an imageing sensor 12, controls processing unit 13 and a storage is single
Unit 14.The most described memory element 14 is to store the pupil coordinate letter that active light source image is relevant to pupil position
Breath, therefore repeat no more in this.
Referring to shown in Fig. 5 A to 5C, Fig. 5 B shows in the pupil tracing device of Fig. 5 A, described imageing sensor 12
Image Acquisition and the schematic diagram of light source igniting of described active light source 111-114；Fig. 5 C shows the pupil tracing device of Fig. 5 A
In, described control processing unit 13 identifies the schematic diagram of active light source image.As it was previously stated, use four active light sources be in order to
Calculating eyeball center, if only carrying out pupil tracing, at least two active light source can be used can to reach the purpose of the present embodiment.
Described active light source 111-114 is luminous to illuminate eyeball 90 in turn, for forming reflection light on described eyeball 90
Point LS111-LS114.Described imageing sensor 112 obtains the first image that the most different described active light source 111-114 lights
Frame f1 and the second picture frame f2.Described control processing unit 13 is in order to calculate described first picture frame f1 and described second picture frame
The difference image (f1-f2) of f2 by dark areas (such as I in described difference image (f1-f2)113' and I114') and highlights
Territory (such as I111' and I112') it is identified as active light source image.
Such as in Fig. 5 C, described active light source 111 and 112 lights (extinguishing of the most described active light source 113 and 114) time institute
Stating imageing sensor 12 and obtain the first picture frame f1, it comprises pupil image 91, iris image 92, corneal moieties 93 and reference light
Source images I111And I112；Described figure when described active light source 113 and 114 lights (extinguishing of the most described active light source 111 and 112)
As sensor 12 obtains the second picture frame f2, it comprises pupil image 91', iris image 92', corneal moieties 93' and reference light
Source images I113And I114；Wherein, the light of the light-source brightness of the most described first picture frame f1 and relative described second picture frame f2
Source brightness may be the same or different, and there is no specific restriction.Additionally, in other embodiments, the most described first picture frame f1 can light
One (such as one or three) the most described second picture frame f2 then point at least within described active light source 111-114
Other active light sources bright (such as three or one), are not limited to light two active light sources.As described first picture frame f1
When deducting described second picture frame f2, reference light source image I described in described difference image (f1-f2)111And I112Become the brightest
Region and there is high gray value and described reference light source image I113And I114Become dark areas and there is minimum gray scale value；Borrow
This, described control processing unit 13 can identify four active light source image I in described difference image (f1-f2)111'-
I114'.In one embodiment, it is assumed that in described first picture frame f1, active light source image I111And I112It is about+255 GTGs, pupil
Hole pattern is about 0 GTG as 91, and iris image 92 is about 64 GTGs and corneal moieties 93 is about 128 GTGs；Described second
In picture frame f2, active light source image I113And I114Being about+255 GTGs, pupil image 91' is about 0 GTG, iris image
92' is about 64 GTGs and corneal moieties 93' is about 128 GTGs；So can try to achieve active in described difference image (f1-f2)
Light source image I111' and I112' it is about+127 GTGs, active light source image I113' and I114' it is about-127 GTGs, other portions
Divide and be about 0 GTG；In another embodiment, overall grey decision-making can be adjusted and make whole grey decision-making be all higher than being equal to
Zero, such as active light source image I111' and I112' about can be adjusted to+254 GTGs, active light source image I113' and I114' about
Can be adjusted to 0 GTG, other parts about can be adjusted to+127 GTGs.Should be noted that, above-mentioned grey decision-making value is only
Exemplary, it is not limited to the present invention.
Owing to the present embodiment uses four active light source 111-114, described control processing unit 13 identifies described difference
Four active light source image I in image (f1-f2)111'-I114After ', the most described four active light source images can be calculated respectively
I111'-I114' the elements of a fix, and each elements of a fix can be all three-dimensional coordinate.Described control processing unit 13 then can basis
Described four elements of a fix calculate the eyeball center of described eyeball 90, such as, utilize spheroid equation (x-x0)2+ (y-y0)2+
(z-z0)2=r2Calculate.Whereby, described control processing unit 13 can so that by described eyeball center with output pupil region line
Direction is defined as direction of visual lines.
In the present embodiment, the deciding means of described output pupil region is as follows: first, described control processing unit 13 basis
Described first picture frame f1 identifies the first pupil region and identifies the second pupil region according to described second picture frame f2.Identify pupil
The mode of bore region is similar to Figure 4, namely described control processing unit 13 is by minimum gray scale value in described first picture frame f1
(such as P1Around), grey decision-making is identified as described first pupil region (such as PA) between multiple pixels of grey decision-making scope Rg；Institute
State control and process single 13 by minimum gray scale value (such as P in described second picture frame f21Around), grey decision-making is between described grey decision-making
Multiple pixels of scope Rg are identified as described second pupil region (such as PA).When described first pupil region and described second pupil
After bore region identifies, described control processing unit 13 then calculates the center of gravity of described first pupil region or center using as described
First pupil position (such as P2) and calculate the center of gravity of described second pupil region or center using as described second pupil position
(such as P2).
Owing to two picture frames of the present embodiment all can obtain pupil image, the most described control processing unit 13 is by described
The connection collection region of the first pupil region and described second pupil region is as output pupil region.In like manner, described control processes single
Unit 13 can determine output according to described output pupil region with the pupil coordinate information being pre-stored within described memory element 14
Pupil coordinate, simply comprises four active light source images as positioning datum point herein.In other embodiments, described control processes
Unit 13 also can be by one therein in described first pupil region and described second pupil region as described output lesser ring of Merkel
Territory.
Additionally, the pupil tracing device 1 of various embodiments of the present invention can be arranged in pairs or groups, display unit is to show image, and described display
Unit may also set up on described wear-type accessory 2, such as glasses or protective eye lens.
The pupil tracing device 1 of various embodiments of the present invention can also have detection function nictation.The most described control processes single
Unit 13 can record the period detecting and can't detect pupil respectively, identifies action nictation whereby.
The pupil tracing device 1 of various embodiments of the present invention can also have sleepy detection and detection function of diverting one's attention.Such as work as institute
State pupil tracing device 1 when being applied to Vehicular device, may be used to detection and drive and whether have sleepiness or be absorbed in front, and in suitably
Time proposes warning.Detection sleepiness such as can be opened the ratio of entire time by detection eyes and realize；Detection diverts one's attention such as can lead to
The direction of visual lines crossing detection driving realizes.
The pupil tracing device 1 of various embodiments of the present invention can also have frequency of wink and xerophthalmia detection function.Specifically,
Described control processing unit 13 can push away the dry and astringent probability of current eyes and degree, Jin Erti according to the frequency of wink detected is counter
User of waking up is blinked.
The pupil tracing device 1 of various embodiments of the present invention can also have gesture recognition (gesture recognition) merit
Energy.The most described gesture recognition can be such as identify pupil towards predetermined direction with pre-determined number to change position, and by it with pre-
If posture is compared, can reach the running performing specific function whereby, it is similar to known other objects utilized beyond pupil,
The gesture identification that such as hands or finger are carried out.
The pupil tracing device 1 of various embodiments of the present invention can also have electricity-saving function, such as, detect not in Preset Time
Too small to the image change amount of pupil or picture frame, then can enter battery saving mode.
It will be appreciated that active light source image is the most exemplary with the ratio of pupil image in above-mentioned each diagram.
Should be noted that, the pupil tracing device 1 of various embodiments of the present invention can be fabricated directly into wear-type pupil tracing
Device, or it is fixed on wear-type accessory, such as various wearing, the set such as glasses, protective eye lens or medicated cap by binding member combination
If or be set up in the accessory of head, preferably make active light source and human eye will not relative movement, described active light source image then can use
As the positioning datum point following the trail of pupil.
In sum, it is known that pupil tracing device is because getting rid of the impact of environment light source, thus is likely to occur detection mistake
Situation by mistake.The present invention separately proposes a kind of pupil tracing device (Fig. 2 A, 3A and 5B), and it utilizes the master that relative eyeball position is fixing
Dynamic light source, as positioning datum point, can eliminate the impact of environment light source to improve detection degree of accuracy.
Although the present invention is by disclosing with previous embodiment, but it is not limited to the present invention, any institute of the present invention
Belong to the technical staff in technical field with usual knowledge, without departing from the spirit and scope of the present invention, various when making
Change and amendment.Therefore protection scope of the present invention is when being defined in the range of standard depending on appended claims scope.
Claims (20)
1. a pupil tracing device, this pupil tracing device comprises:
Active light source, this active light source same is luminous, in turn with described first towards eyeball with the first brightness and the second brightness in turn
Brightness and the same described active light source of described second Intensity LEDs have fixing relative position with described eyeball；
Imageing sensor, obtains the first luminance picture of the most described first brightness and the second brightness of relative described second brightness
Image；And
Control processing unit, in order to by brightest area relative to position in described first luminance picture and described second luminance picture
It is identified as active light source image.
Pupil tracing device the most according to claim 1, wherein said control processing unit is always according to described first brightness
Image or described second luminance picture identification pupil position.
Pupil tracing device the most according to claim 2, wherein said first brightness is higher than described second brightness, described control
Processing unit processed by the minimum gray scale grey decision-making enclosed on weekly duty in described first luminance picture between multiple pixels of grey decision-making scope
It is identified as pupil region, and calculates the center of gravity of described pupil region or center using as described pupil position.
Pupil tracing device the most according to claim 2, this pupil tracing device also comprises memory element, in order to store
State the pupil coordinate information that active light source image is relevant to described pupil position.
Pupil tracing device the most according to claim 1, wherein said first brightness is equal to described second brightness, described figure
As sensor obtains described first luminance picture and with the second time of exposure and the with the first time of exposure and the first circuit gain
Two circuit gains obtain described second luminance picture.
6., according to the pupil tracing device described in claim any one of claim 1-5, this pupil tracing device is arranged at
On wear-type accessory.
7. a pupil tracing device, this pupil tracing device comprises:
Active light source, this active light source same is luminous, in turn with described first towards eyeball with the first brightness and the second brightness in turn
Brightness and the same described active light source of described second Intensity LEDs have fixing relative position with described eyeball；
Imageing sensor, obtains the first luminance picture of the most described first brightness and the second brightness of relative described second brightness
Image；And
Control processing unit, in order to calculate described first luminance picture and the difference image of described second luminance picture, and by institute
The dark areas stated in difference image is identified as active light source image.
Pupil tracing device the most according to claim 7, wherein said control processing unit is always according to described first brightness
Image or described second luminance picture identification pupil position.
Pupil tracing device the most according to claim 8, wherein said first brightness is higher than described second brightness, described control
Processing unit processed by the minimum gray scale grey decision-making enclosed on weekly duty in described first luminance picture between multiple pixels of grey decision-making scope
It is identified as pupil region, and calculates the center of gravity of described pupil region or center using as described pupil position.
Pupil tracing device the most according to claim 8, this pupil tracing device also comprises memory element, this storage list
The pupil coordinate information that unit is relevant to described pupil position in order to store described active light source image.
11. pupil tracing devices according to claim 7, wherein said first brightness is equal to described second brightness, described
Imageing sensor obtain described first luminance picture with the first time of exposure and the first circuit gain and with the second time of exposure and
Second circuit gain obtains described second luminance picture.
12. according to the pupil tracing device described in claim any one of claim 7-11, and this pupil tracing device is arranged
On wear-type accessory.
13. 1 kinds of pupil tracing devices, this pupil tracing device comprises:
At least two active light source, luminous to illuminate eyeball in turn；
Imageing sensor, obtains the first picture frame and the second picture frame that the most different described active light sources is lighted；And
Control processing unit, in order to calculate described first picture frame and the difference image of described second picture frame, and by described difference
Dark areas and brightest area in partial image is identified as active light source image using the positioning datum point as pupil tracing.
14. pupil tracing devices according to claim 13, wherein said control processing unit is always according to described first figure
As frame identification the first pupil region and according to described second picture frame identification the second pupil region.
15. pupil tracing devices according to claim 14, wherein said control processing unit is by described first picture frame
The middle minimum gray scale grey decision-making enclosed on weekly duty is identified as described first pupil region and by institute between multiple pixels of grey decision-making scope
State the grey decision-making enclosed on weekly duty of minimum gray scale in the second picture frame and be identified as described between multiple pixels of described grey decision-making scope
Two pupil region；The center of gravity of described control processing unit described first pupil region of calculating or center are using as the first pupil position
And calculate the center of gravity of described second pupil region or center using as the second pupil position.
16. pupil tracing devices according to claim 14, described control processing unit is also by described first pupil region
It is defined as exporting pupil region with the connection collection region of described second pupil region.
17. pupil tracing devices according to claim 13, this pupil tracing device comprises four active light sources, described control
Four active light source images in difference image described in processing unit identification processed also calculate the most described four active light sources respectively
The elements of a fix of image.
18. pupil tracing devices according to claim 17, wherein said control processing unit is described fixed always according to four
Position coordinate calculates the eyeball center of described eyeball.
19. pupil tracing devices according to claim 18, wherein said control processing unit is always according to described first figure
As frame and described second picture frame identification output pupil region, and by the line at described eyeball center Yu described output pupil region
Direction is defined as direction of visual lines.
20. according to the pupil tracing device described in claim any one of claim 13-19, and this pupil tracing device is arranged
On wear-type accessory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210428613.6A CN103793045B (en) | 2012-10-31 | 2012-10-31 | Pupil tracing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210428613.6A CN103793045B (en) | 2012-10-31 | 2012-10-31 | Pupil tracing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103793045A CN103793045A (en) | 2014-05-14 |
| CN103793045B true CN103793045B (en) | 2016-12-28 |
Family
ID=50668808
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210428613.6A Active CN103793045B (en) | 2012-10-31 | 2012-10-31 | Pupil tracing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103793045B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110051319A (en) * | 2019-04-23 | 2019-07-26 | 七鑫易维(深圳)科技有限公司 | Adjusting method, device, equipment and the storage medium of eyeball tracking sensor |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102463169B1 (en) * | 2015-09-07 | 2022-11-04 | 삼성전자주식회사 | Method and apparatus for eye tracking |
| CN105607252A (en) * | 2015-09-23 | 2016-05-25 | 宇龙计算机通信科技(深圳)有限公司 | Control method of intelligent glasses and control device thereof |
| CN107991775B (en) * | 2016-10-26 | 2020-06-05 | 中国科学院深圳先进技术研究院 | Head-mounted visual equipment capable of tracking human eyes and human eye tracking method |
| CN110446965B (en) * | 2017-03-21 | 2022-05-03 | 奇跃公司 | Method and system for tracking eye movement in conjunction with a light scanning projector |
| CN110633685B (en) * | 2019-09-20 | 2022-10-25 | Oppo广东移动通信有限公司 | Human eye detection method and related product |
| CN111616800B (en) * | 2020-06-09 | 2023-06-09 | 电子科技大学 | Ophthalmic surgery navigation system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344919A (en) * | 2008-08-05 | 2009-01-14 | 华南理工大学 | Sight tracing method and disabled assisting system using the same |
| CN101788848A (en) * | 2009-09-29 | 2010-07-28 | 北京科技大学 | Eye characteristic parameter detecting method for sight line tracking system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8890946B2 (en) * | 2010-03-01 | 2014-11-18 | Eyefluence, Inc. | Systems and methods for spatially controlled scene illumination |
-
2012
- 2012-10-31 CN CN201210428613.6A patent/CN103793045B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344919A (en) * | 2008-08-05 | 2009-01-14 | 华南理工大学 | Sight tracing method and disabled assisting system using the same |
| CN101788848A (en) * | 2009-09-29 | 2010-07-28 | 北京科技大学 | Eye characteristic parameter detecting method for sight line tracking system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110051319A (en) * | 2019-04-23 | 2019-07-26 | 七鑫易维(深圳)科技有限公司 | Adjusting method, device, equipment and the storage medium of eyeball tracking sensor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103793045A (en) | 2014-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103793045B (en) | Pupil tracing device | |
| US10747995B2 (en) | Pupil tracking device | |
| TWI471808B (en) | Pupil detection device | |
| JP6308940B2 (en) | System and method for identifying eye tracking scene reference position | |
| JP6847124B2 (en) | Adaptive lighting systems for mirror components and how to control adaptive lighting systems | |
| WO2018177311A1 (en) | Line-of-sight tracking device and head-mounted display device | |
| JP4783018B2 (en) | Method and apparatus for detecting and tracking the eye and its gaze direction | |
| KR101829850B1 (en) | Systems and methods for spatially controlled scene illumination | |
| US10503248B1 (en) | Selective color sensing for motion tracking | |
| KR20140064080A (en) | Method and apparatus to detect live eye | |
| WO2017203815A1 (en) | Information processing device, information processing method, and recording medium | |
| CN106295536A (en) | A kind of self-adapting type iris identification device and utilize the method that this device carries out iris identification | |
| WO2022095605A1 (en) | Handle control tracker | |
| EP3198992B1 (en) | Control of lighting | |
| EP2995241A1 (en) | Pupil detection light source device, pupil detection device and pupil detection method | |
| US11675429B2 (en) | Calibration, customization, and improved user experience for bionic lenses | |
| WO2018164104A1 (en) | Eye image processing device | |
| CN103565399B (en) | Pupil detector | |
| CN112188689B (en) | Method and system for controlling light source based on learning duration | |
| JP6687195B2 (en) | Eye image processing device | |
| JP6370168B2 (en) | Illumination imaging apparatus and line-of-sight detection apparatus including the same | |
| JP2021197214A (en) | Lighting system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |