CN104657702A - Eyeball detection device, pupil detection method and iris identification method - Google Patents

Eyeball detection device, pupil detection method and iris identification method Download PDF

Info

Publication number
CN104657702A
CN104657702A CN201310607136.4A CN201310607136A CN104657702A CN 104657702 A CN104657702 A CN 104657702A CN 201310607136 A CN201310607136 A CN 201310607136A CN 104657702 A CN104657702 A CN 104657702A
Authority
CN
China
Prior art keywords
eyeball
bright spot
image
pupil
reference point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310607136.4A
Other languages
Chinese (zh)
Other versions
CN104657702B (en
Inventor
黄昱豪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pixart Imaging Inc
Original Assignee
Pixart Imaging Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixart Imaging Inc filed Critical Pixart Imaging Inc
Priority to CN201910196821.XA priority Critical patent/CN109919117B/en
Priority to CN201310607136.4A priority patent/CN104657702B/en
Publication of CN104657702A publication Critical patent/CN104657702A/en
Application granted granted Critical
Publication of CN104657702B publication Critical patent/CN104657702B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Molecular Biology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The invention provides an eyeball detection device, a pupil detection method and an iris identification method. The eyeball detection device comprises an optical component, an image sensor and a calculation unit, wherein the optical component is used for providing a plurality paths of incident light to an eyeball and used for forming a plurality of bright points on the eyeball; at least a part of the bright points are positioned near the pupil of the eyeball; the image sensor is used for taking eyeball images; the eyeball images comprise images of the bright points; the calculation unit is used for analyzing the gray level values of the images of the eyeball, used for obtaining the distribution positions of the bright points according to the gray level values of the images of the eyeball, and used for judging the position of the pupil according to the distribution positions of the bright points.

Description

Eyeball arrangement for detecting, pupil method for detecting and iris discrimination method
Technical field
The present invention has about a kind of eyeball arrangement for detecting, and the method for detecting carrying out eyeball tracking related to especially by eyeball arrangement for detecting and iris discrimination method.
Background technology
Current eyeball arrangement for detecting in order to detect eye movement direction, or can carry out iris boundary identification.Most eyeball arrangement for detecting utilizes the characteristic of pupil shift position with the change of sight line, detects the direction of eyeball fixes.
Generally speaking, known eyeball arrangement for detecting major part is the direction that the bright spot (glint) utilizing incident light to be projeced into eyeball is formed detects eyeball fixes, and known eyeball arrangement for detecting is normally using the reference point of bright spot as the location of eyeball.
Specifically, after the image of acquisition eyeball, known eyeball arrangement for detecting can go out pupil and bright spot from the image identification of the cornea of eyeball (Cornea).In the process of identification pupil, whole ball image of opening one's eyes can be scanned, distribute and identification pupil and bright spot by the gray-scale value (gray scale value) analyzing whole ball image of opening one's eyes.Afterwards, eyeball arrangement for detecting can obtain the relative position between pupil and bright spot further, and relative position differentiates the direction that eyeball is watched attentively accordingly.
Summary of the invention
The object of the present invention is to provide a kind of eyeball arrangement for detecting that can pick out pupil quickly.
Another object of the present invention be to provide a kind of need through judging that the grey value profile of whole the first eyeball image or the second eyeball image is to obtain detecting pupil method and the identification iris method of the position of pupil.
Another object of the present invention is to provide a kind of iris discrimination method accelerating the border search speed of iris image.
The embodiment of the present invention provides a kind of eyeball arrangement for detecting, and its distributing position through at least one bright spot epibulbar judges the position of pupil according to this.
The embodiment of the present invention provides a kind of eyeball arrangement for detecting, and described eyeball arrangement for detecting comprises optical module, image sensor and arithmetic element.Optical module provides multiple incident light to eyeball and forms multiple bright spot at eyeball, and bright spot is positioned near the pupil of this eyeball at least partly.Image sensor, for capturing the image of this eyeball, and the image of eyeball comprises these bright spots.Arithmetic element analyzes the gray-scale value of image of eyeball, and obtains the distributing position of these bright spots through the gray-scale value of the image of eyeball, is judged the position of pupil by the distributing position of these bright spots according to this.
The embodiment of the present invention provides a kind of method detecting pupil, its through form one or more bright spot distributing position judge the position of pupil according to this.
The embodiment of the present invention provides a kind of method detecting pupil, and described method for detecting comprises to be provided one or more incident light beam strikes to eyeball and form one or more the first bright spot at eyeball, and at least part of first bright spot is positioned near pupil.Capture the first eyeball image from eyeball, and the first eyeball image comprises the image of multiple first bright spot and pupil.Analyze the gray-scale value of the first eyeball image to obtain the distributing position of these the first bright spots.Distributing position through these the first bright spots judges the position of pupil according to this.
The embodiment of the present invention provides a kind of method of identification iris, the deformation quantity of iris image when it can judge eyeball displacement.
The embodiment of the present invention provides a kind of method of identification iris, the method of described identification iris comprises when eyeball is positioned at a reference position, send the multiple incident light beam strikes of multiple tracks to eyeball, to form the first reference point, the second reference point and the 3rd reference point to be positioned at the mark of reference position as eyeball near the pupil of this eyeball, wherein the position of the first reference point, the second reference point and the 3rd reference point is corresponding with the position of these incident light transmittings place.When eyeball is from reference position activity to a measuring position, these incident lights form the first measurement bright spot, second in eyeball and measure bright spot and the 3rd measurement bright spot, and the first measurement bright spot, second measures bright spot and the 3rd measurement bright spot is positioned near the pupil of eyeball.The eyeball image of acquisition eyeball, eyeball image comprises these bright spots and iris image.Analyze the gray-scale value of eyeball image to obtain the position that the first measurement bright spot, second measures bright spot and the 3rd bright measurement point.Calculate first to measure bright spot, second and measure bright spot and the 3rd and measure the displacement that the position of bright spot produces relative to the position of the first reference point, the second reference point and the 3rd reference point, obtain the deformation quantity of iris image when iris image when eyeball is positioned at measuring position is positioned at reference position relative to eyeball according to this.
The embodiment of the present invention provides a kind of method of identification iris, and it can judge the change resolution amount of iris image.
The embodiment of the present invention provides a kind of method of identification iris, and the method for described identification iris comprises provides multiple incident light beam strikes to eyeball.Set the first reference point, the second reference point and the 3rd reference point to be positioned at the mark of reference position as eyeball, wherein the position of the first reference point, the second reference point and the 3rd reference point is corresponding with the position of these incident light transmittings place.These incident lights form first in eyeball and measure bright spot, the second measurement bright spot and the 3rd measurement bright spot, and the first measurement bright spot, second measures bright spot and the 3rd measurement bright spot is positioned near the pupil of eyeball, wherein the position of the first measurement bright spot, the second measurement bright spot and the 3rd measurement bright spot is corresponding with the position of the first reference point, the second reference point and the 3rd reference point.The eyeball image of acquisition eyeball, eyeball image comprises these bright spots and iris image.Analyze the gray-scale value of eyeball image to obtain the position that the first measurement bright spot, second measures bright spot and the 3rd bright measurement point.Calculate first and measure the change of spacing relative to the spacing of the first reference point and the second reference point that bright spot and second measures bright spot, and calculate this and second measure the change of spacing relative to the spacing of the second reference point and the 3rd reference point that bright spot and the 3rd measures bright spot, obtain the change resolution amount that iris image when eyeball is positioned at reference position produces according to this.
In sum, the embodiment of the present invention provides detecting and the discrimination method of eyeball arrangement for detecting and eyeball (as pupil and iris).Described eyeball arrangement for detecting comprises optical module, image sensor and arithmetic element.The method for detecting of described eyeball tracking can judge the grey value profile of the neighboring area near the bright spot in the first eyeball image by arithmetic element, thus obtains the position of pupil.Therefore, arithmetic element need not through judging that the grey value profile of whole the first eyeball image is to obtain the position of pupil.Compare known technology, the eyeball arrangement for detecting of the embodiment of the present invention can pick out pupil quickly.
The embodiment of the present invention provides the method for detecting of eyeball arrangement for detecting and eyeball tracking, and described eyeball arrangement for detecting comprises optical module, image sensor, arithmetic element and control module.Control the position of different incident light beam strikes in different time points by control module, thus the bright spot position that can adjust in the eyeball image of different time points, and then can more confirm bright spot position through gray-scale value and special pattern via after image subtraction step, help the probability reducing location of mistakes bright spot position.Arithmetic element only can judge the grey value profile of the neighboring area near the distributing position of the bright spot in Difference image, thus can accelerate the position obtaining pupil P1.Compare known technology, arithmetic element need through judging that the grey value profile of whole the first eyeball image or the second eyeball image is to obtain the position of pupil.
The embodiment of the present invention provides the method for identification iris, the method of described identification iris calculates the first measurement bright spot, second by arithmetic element and measures the displacement that bright spot and the 3rd position measuring bright spot produce relative to the position of the first reference point, the second reference point and the 3rd reference point, the ellipse long and short shaft of iris image can be calculated according to this, thus estimate out the oval border of iris image, and then accelerate the border search speed of iris image.
The embodiment of the present invention provides the method for identification iris, after the method for described identification iris calculates the first variable quantity, the second variable quantity and the 3rd variable quantity by arithmetic element, estimates out the border of iris image, and then accelerates the border search speed of iris image.
In order to technology, method and effect that the present invention takes further can be understood, refer to following detailed description for the present invention, graphic, believe feature of the present invention and feature, when being goed deep into thus and concrete understanding, but institute's accompanying drawings and annex only provide reference and explanation use, are not used for being limited the present invention.
Accompanying drawing explanation
Figure 1A is the schematic side view of the eyeball arrangement for detecting of first embodiment of the invention.
Figure 1B is the front-view schematic diagram of the eyeball arrangement for detecting of first embodiment of the invention.
Fig. 1 C is the functional block diagram of the eyeball arrangement for detecting of first embodiment of the invention.
Fig. 1 D is the schematic flow sheet of the pupil method for detecting that first embodiment of the invention provides.
Fig. 2 A is the front-view schematic diagram of the eyeball arrangement for detecting of second embodiment of the invention.
Fig. 2 B is the schematic flow sheet of the pupil method for detecting that second embodiment of the invention provides.
Fig. 2 C is the schematic flow sheet of the pupil method for detecting of second embodiment of the invention.
Fig. 3 A is the functional block diagram of the eyeball arrangement for detecting of third embodiment of the invention.
Fig. 3 B is the schematic flow sheet of the pupil method for detecting that third embodiment of the invention provides.
Fig. 4 is the schematic flow sheet of the iris discrimination method that the embodiment of the present invention provides.
Fig. 5 is the schematic flow sheet of the iris discrimination method that the embodiment of the present invention provides.
Reference numeral
100,200,300 eyeball arrangement for detecting
110,210 optical modules
112,212 light sources
114,214 spectrum groupware
120 image sensors
130,230 arithmetic elements
150 bearing frames
152 picture frames
154 mirror pin
340 control modules
L1 incident light
M1 inspects region
E1 eyeball
G1 bright spot
G1a first bright spot
G1b second bright spot
P1 pupil
I1 iris
S101 ~ S104 step
S201 ~ S204 step
S301 ~ S307 step
S401 ~ S405 step
S501 ~ S506 step
Embodiment
Figure 1A is the schematic side view of the eyeball arrangement for detecting of first embodiment of the invention, and Figure 1B is the front-view schematic diagram of the eyeball arrangement for detecting of first embodiment of the invention, and Fig. 1 C is the functional block diagram of the eyeball arrangement for detecting of first embodiment of the invention.Refer to Figure 1A to Fig. 1 C, eyeball arrangement for detecting 100 comprises optical module 110, image sensor 120 and arithmetic element 130.Optical module 110 provides at least one incident light L1 to form at least one bright spot G1 near pupil P1.Image sensor 120 is for capturing eyeball image, and eyeball image comprises the image of bright spot G1.Arithmetic element 130 analyzes the gray-scale value of eyeball image, and obtains the distributing position of bright spot G1 according to this.In addition, arithmetic element 130 can judge pupil P1 position according to this by the distributing position of bright spot G1.
Eyeball arrangement for detecting 100 can be installed on frame, also can be installed on the panel of running gear mobile computer or intelligent mobile phone.In the present embodiment, eyeball arrangement for detecting 100 is the eyeball arrangement for detecting 100 of a spectacle, and optical module 110 and image sensor 120 are all installed in bearing frame 150.Bearing frame 150 is available for users to wear, and makes optical module 110 and image sensor 120 all be positioned at eyeball E1 front.But, in other embodiments, eyeball arrangement for detecting 100 can also be installed on running gear, such as, be on the preposition camera lens of mobile computer or intelligent mobile phone or panel.But, the present invention is not limited this.
In practice, bearing frame 150 can be a mirror holder, and comprises two picture frames 152 and two mirror pin 154 be connected with picture frame 152 respectively.Mirror pin 154 is placed on ear by user, and before picture frame 152 is positioned at eyeball E1.But, the design of bearing frame 150 is only for illustrating, the present invention is not limited bearing frame 150.
Optical module 110 can launch at least one incident light L1 to eyeball E1.These incident lights L1 drops on eyeball E1, and can reflect to form at least one bright spot G1 on iris I1, and wherein bright spot G1 is positioned near pupil P1.In the present embodiment, incident one incident light L1 is to eyeball E1, thus the quantity of bright spot G1 is one.It should be noted that, incident light L1 is invisible light (invisible light), such as infrared light (infrared light, or near infrared light (near infrared light IR), NIR), and iris I1 structural outside layers is covered with cornea (Cornea) is a smooth surface, therefore each party all to incident light can form one and reflects bright spot on cornea with on the light path of image sensor, and therefore L1 incident light then can form more than one bright spot G1.
Specifically, optical module 110 can comprise at least one light source 112 and at least one spectrum groupware 114, and optical module 110 provides at least one incident light L1 by light source 112 and spectrum groupware 114.In practice, light source 112 can be light emitting diode (Light Emitting Diode, LED), and spectrum groupware 114 can have guide-lighting function, and there is multiple optical microstructures, wherein optical microstructures can be printed patterns, groove or fin, and groove is such as V-type ditch (V-cut).When the light that light source 112 provides is to spectrum groupware 114, and light can be reflected by these optical microstructures, reflect or scattering, thus can from the bright dipping outgoing of spectrum groupware 114.
Image sensor 120 is for capturing eyeball image.What deserves to be explained is, the wavelength coverage that image sensor 120 senses contains the wavelength coverage of incident light L1.The eyeball image energy captured demonstrates the eye of user, such as, be the white of the eye (sign), iris I1 and pupil P1 etc.In addition, described bright spot G1 is also comprised in the eyeball image captured.Specifically, image sensor 120 is through photosensory assembly induction incident light L1, and photosensory assembly can be CMOS (Complementary Metal Oxide Semiconductor) sensing component (Complementary Metal-Oxide-Semiconductor Sensor, CMOS sensor) or Charged Coupled Device (Charge-Coupled Device, CCD).
Arithmetic element 130 can be digital signal processor (Digital Signal Processor, DSP) or central processing unit (Central Processing Unit, CPU).Arithmetic element 130 analyzes the grey value profile of the eyeball image that image sensor 120 captures, and obtains the distributing position of bright spot G1 through the grey value profile of eyeball image, thus the distributing position be able to according to bright spot G1 and judge the position of pupil P1.
Fig. 1 D is the schematic flow sheet of the pupil method for detecting that first embodiment of the invention provides.Refer to Figure 1B, Fig. 1 C and Fig. 1 D.
Perform step S101, when user uses eyeball arrangement for detecting 100, such as, be user when wearing the bearing frame 150 being configured with eyeball arrangement for detecting 100, make optical module 110 provide one incident light L1 to eyeball E1.Incident light L1 drops on eyeball E1, and can be positioned near pupil P1, and such as, iris I1 region near, reflects to form a bright spot G1.
It should be noted that the ornaments position of light source 112 or the configuration of light source 112 and spectrum groupware 114 can adjust incident light L1 and be incident in iris I1 region near pupil P1.That is, the position of bright spot G1 can change along with the change of the position of incident light L1 transmitting place, that is the position of bright spot G1 corresponds to the position of incident light L1 transmitting place.
Then, perform step S102, take eyeball E1 to capture the first eyeball image through image sensor 120.The first eyeball image captured by image sensor 120 can demonstrate the image of the eye of user and the image of described bright spot G1.Then, the data of the first captured eyeball image are transferred to arithmetic element 130 by image sensor 120.
Then, perform step S103, arithmetic element 130 analyzes the gray-scale value of the first eyeball image, to obtain the distributing position of bright spot G1.For 8 256 color shade values, gray-scale value is finally quantified as 256 colors to pure white change by black to ash, and the scope of gray-scale value is 0 to 255.What deserves to be explained is, the gray-scale value of bright spot G1 mostly close to or equal 255, the gray-scale value of pupil P1 relative to the gray-scale value of bright spot G1 then comparatively close to 0.Arithmetic element 130 is through the grey value profile of the first eyeball image, after can learning position that in all pixels gray-scale value distributes close to the pixel of maximal value, shape and range size, and infer the position that the pixel of the bright spot G1 position in corresponding first eyeball image distributes further.
Then, perform step S104, arithmetic element 130 judges the position of pupil P1 according to this through the distributing position of bright spot G1.Specifically, arithmetic element 130 first chooses suitable threshold grey scale value (thresholdgray scale value), and the gray-scale value of pupil P1 in the first eyeball image is less than described threshold grey scale value, and the gray-scale value of multiple bright spot G1 in the first eyeball image is greater than described threshold grey scale value.
After the distributing position confirming bright spot G1, arithmetic element 130 scans the grey value profile of inspecting in region M1 (as shown in Figure 1B) of the vicinity of bright spot G1 distributing position, and to judge at the gray-scale value inspecting the first eyeball image in the M1 of region be less than the part of threshold grey scale value.Wherein, inspecting region M1 can define such as by the position of bright spot G1, inspect region M1 can set be less times greater than and contain the region of the distributing position of bright spot G1 and pupil.What deserves to be explained is, bright spot G1 can be positioned at the border of inspecting region M1 or inspect inside the M1 of region.User can according to inspect the scope of region M1 for searching pupil P1 position range size through arithmetic element 130 setting.The present invention is not limited the range size of inspecting region M1.
When arithmetic element 130 judges have after the gray-scale value of a specific region is less than threshold grey scale value inspecting region M1, judge whether the shape of described specific region meets the shape of pupil P1 to reduce the probability judging pupil P1 position by accident further.For example, arithmetic element 130 judge to meet the specific region being less than threshold grey scale value and have rectangle and circle, then can judge that circular specific region more meets the shape of pupil P1 compared with the specific region of rectangle, namely level off to circle.In addition, in order to more reduce the probability of erroneous judgement pupil P1 position, first can set up the area value scope of the pupil P1 image in the first eyeball image, and arithmetic element 130 can judge whether the scale of specific region falls within the area value scope of described pupil P1 image, further to reduce the probability of erroneous judgement pupil P1 position.
What deserves to be explained is, through above-mentioned pupil method for detecting, arithmetic element 130 only can analyze the grey value profile of inspecting region M1 near the bright spot G1 in the first eyeball image, to reduce the scope finding pupil P1, thus can accelerate the position obtaining pupil P1.Compare known techniques, arithmetic element 130 does not need the grey value profile analyzing whole the first eyeball image to find the position of pupil P1.
Fig. 2 A is the schematic side view of the eyeball arrangement for detecting of second embodiment of the invention, and Fig. 2 B is the functional block diagram of the eyeball arrangement for detecting of second embodiment of the invention.Refer to Fig. 2 A and Fig. 2 B, the eyeball arrangement for detecting 200 of the second embodiment is similar to both eyeball arrangement for detecting 100 structure of the first embodiment, and such as eyeball arrangement for detecting 100 is same with 200 all comprises optical module 110 and image sensor 120.But, still difference is had between eyeball arrangement for detecting 100 and 200.Just be described in detail for the difference between eyeball arrangement for detecting 200 and eyeball arrangement for detecting 100 below, same characteristic features then repeats no more.
The eyeball arrangement for detecting 200 of the second embodiment comprises optical module 210, image sensor 120 and arithmetic element 130.Optical module 110 provides multiple incident light L1 to form multiple bright spot G1 near pupil P1.Image sensor 120 is for capturing eyeball image, and eyeball image comprises the image of these bright spot G1.Arithmetic element 130 analyzes the gray-scale value of eyeball image, and obtains the distributing position of these bright spot G1 according to this.In addition, arithmetic element 130 can judge pupil I1 position according to this by the distributing position of these bright spot G1.
Optical module 210 can launch multiple tracks incident light L1 to eyeball E1.These incident lights L1 drops on eyeball E1, and can reflect to form multiple bright spot G1 on iris I1, and wherein at least part of bright spot G1 is positioned near pupil P1.
The present embodiment can only use one or the light source of negligible amounts 212 and spectrum groupware 214 light to be divided into many incident light L1.Or optical module 210 can also comprise multiple light source 212 and not comprise any spectrum groupware 214, and optical module 210 by these light sources 212 to provide multiple tracks incident light L1.Therefore, the structure that the present invention does not limit light source 212 quantity and spectrum groupware 214 is limited.
Fig. 2 C is the schematic flow sheet of the pupil method for detecting that first embodiment of the invention provides.Refer to Fig. 2 A, Fig. 2 B and Fig. 2 C.
Perform step S201, when user uses eyeball arrangement for detecting 200, make optical module 210 provide multiple tracks incident light L1 to eyeball E1, and can the iris I1 regional reflex near pupil P1 be positioned to form multiple bright spot G1.
It should be noted that the position of bright spot G1 can change along with the change of the position of incident light L1 transmitting place.For example, suppose to provide four incident light L1 position of transmitting place, and the position of this four incident light L1 transmitting place is about rectangular arranged and length breadth ratio is about 2 to 1, iris I1 region then near pupil P1 is by appearance four bright spot G1, and the arrangement of bright spot G1 is in principle also for rectangular arranged and length breadth ratio are 2 to 1.
Then, perform step S202, capture the first eyeball image through image sensor 120 from eyeball E1.The first eyeball image captured by image sensor 120 can demonstrate the image of the eye of user and the image of described bright spot G1.Then, the data of the first captured eyeball image are transferred to arithmetic element 130 by image sensor 120.
Then, perform step S203, arithmetic element 130 is through the grey value profile of the first eyeball image, after can learning position that in all pixels gray-scale value distributes close to the pixel of maximal value, shape and range size, and infer the position that the pixel of the bright spot G1 position in corresponding first eyeball image distributes further.
Then, perform step S204, arithmetic element 130 judges the position of pupil P1 according to this through the distributing position of these bright spot G1.Specifically, arithmetic element 130 first chooses suitable threshold grey scale value, and the gray-scale value of multiple bright spot G1 in the first eyeball image is greater than described threshold grey scale value.After the distributing position confirming bright spot G1, arithmetic element 130 scans the grey value profile of inspecting in region M1 (as shown in Figure 2 A) of the vicinity of these bright spot G1 distributing positions, and to judge at the gray-scale value inspecting the first eyeball image in the M1 of region be less than the part of threshold grey scale value.
What deserves to be explained is, inspecting region M1 can be defined by the position of these bright spot G1.Such as, inspect region M1 can be less times greater than and contain the region of the distributing position of these bright spot G1 and pupil, also can be around forming by these bright spot G1 institutes.
Similarly, in order to reduce the probability of erroneous judgement pupil P1 position, judge, inspecting after region M1 has interior one to be less than the specific region of threshold grey scale value, to judge whether the shape of described specific region meets the shape of pupil P1 and judge whether the scale of specific region falls within the area value scope of described pupil P1 image in arithmetic element 130.
What deserves to be explained is, through above-mentioned pupil method for detecting, arithmetic element 130 can only transmit multiple bright spot G1 and define the scope or shape of inspecting region M1, to reduce the scope finding pupil P1, thus can accelerate the position obtaining pupil P1.
Fig. 3 A is the functional block diagram of the eyeball arrangement for detecting of third embodiment of the invention.Refer to Fig. 3 A, the eyeball arrangement for detecting 300 of the 3rd embodiment is similar to both eyeball arrangement for detecting 200 structure of the second embodiment, and such as eyeball arrangement for detecting 300 is same with 200 all comprises optical module 210 and image sensor 120.But, still difference is had between eyeball arrangement for detecting 300 and 200.Just be described in detail for the difference between eyeball arrangement for detecting 300 and eyeball arrangement for detecting 200 below, same characteristic features then repeats no more.
The eyeball arrangement for detecting 300 of the 3rd embodiment comprises optical module 210, image sensor 120, arithmetic element 230 and control module 340.Optical module 210 provides multiple incident light L1 to form multiple bright spot G1 near pupil P1.Control module 340 can control the time point of incident light beam strikes to eyeball E1, and namely control module 340 can provide incident light L1 to eyeball E1 in different time points by control both optical assembly 110 respectively.Image sensor 120 is for capturing the eyeball image of different time points, and eyeball image comprises these bright spot G1a or G1b respectively, all demonstrates bright spot G1a or G1b among the eyeball image namely captured respectively at different time points.Arithmetic element 230 analyzes the gray-scale value of the eyeball image in different time points, and obtains the distributing position of these bright spot G1 according to this, and judges pupil I1 position according to this by the distributing position of bright spot G1a and G1b.
Specifically, control module 340 provides incident light L1 to be incident to the time point of eyeball E1 for control both optical assembly 210, and that is, control module 340 control both optical assembly 210 provides incident light L1 respectively in different time points.Image sensor 120 is for capturing the eyeball image in different time points, and these eyeball images captured in different time points all demonstrate bright spot G1a or G1b.Arithmetic element 230 is except the gray-scale value judged and analyze these eyeball images under different time points, arithmetic element 230 more can transmit instruction to control module 340, thus makes control module 340 control both optical assembly 210 provide the time point of incident light L1.
Fig. 3 B is the schematic flow sheet of the pupil method for detecting that second embodiment of the invention provides.Refer to Fig. 3 A and Fig. 3 B.
Perform step S301, control module 340 control both optical assembly 210 provides multiple tracks incident light L1 in very first time point.These incident lights L is incident to iris I1 regional reflex near pupil P1 to form multiple first bright spot G1a, and the position of the first bright spot G1a corresponds to the position of incident light L1 transmitting place.What deserves to be explained is, the present embodiment can adopt and comprise multiple light source 112 and the optical module 210 not comprising any spectrum groupware 114.
Then, perform step S302, capture the first eyeball image in very first time point through image sensor 120.The first eyeball image captured by image sensor 120 is captured when very first time point, and demonstrates the image of the eye of user and the image of the first bright spot G1a.And the data of the first captured eyeball image are transferred to arithmetic element 230 by image sensor 120.
Then, perform step S303, control module 340 control both optical assembly 210 provides multiple tracks incident light L1 to be incident to iris I1 region near pupil P1 in the second time point.Incident light L1 reflects to form multiple second bright spot G1b once again, and the position of the second bright spot G1b corresponds to the position of incident light L1 transmitting place.It should be noted that described second time point is different from very first time point, and the position of the second bright spot G1b formed in the second time point is different from the position of putting the first bright spot G1a formed in the very first time.Specifically, when very first time point, only the light source 112 of part sends incident light L1, and when the second time point, only the light source 112 of another part sends incident light L1.
For example, the quantity of light source 212 can be four, and the position of these four light sources 212 can present rectangular arranged, and wherein the length breadth ratio of rectangle is 2 to 1.Control module 340 can control four light sources 212 and first only provide two light sources 212 being wherein positioned at diagonal angle when very first time point, and control module 340 is controlling when the second time point two light sources 212 being positioned at other diagonal angle.But, what deserves to be explained is, the present invention does not provide the position of the light source 212 of incident light L1 and quantity to be limited for lower of different time points, does not also limit the sequence of light of these light sources 212 with different time points.
Then, perform step S304, capture the second eyeball image in the second time point through image sensor 120.The image of the eye of user and the image of the second bright spot G1b is demonstrated in the second eyeball image captured by image sensor 120.And the data of the second captured eyeball image are transferred to arithmetic element 230 by image sensor 120.
What deserves to be explained is, described very first time point is the point sometime that user brings into use eyeball arrangement for detecting 300, and namely the second time point is different from another time point of very first time point.The first eyeball image eyeball image that to be then image sensor 120 captured when very first time point, the second eyeball image is then the image sensor 120 eyeball image captured when the second time point.
Then, perform step S305, analyze the gray-scale value of the first eyeball image and the second eyeball image to obtain the distributing position of the first bright spot G1a and the second bright spot G1b.Specifically, arithmetic element 230 analyzes the grey value profile of the first eyeball image and the second eyeball image respectively, can learn position that among the first eyeball image and the second eyeball image all gray-scale values distribute close to the pixel of maximal value, shape and scope.According to this, the position distributed close to the pixel of maximal value through all gray-scale values of analysing and comparing, shape and scope, and infer further and all first bright spot G1a in the first eyeball image and the second eyeball image and the second bright spot G1b position.
Then, perform step S306, image is performed to the first eyeball image and the second eyeball image and subtracts each other (Image Subtraction).It should be noted that in the present embodiment, the quantity of light source 212 is four, and in the first eyeball image, the first bright spot G1a only provided by two light sources 212 being wherein positioned at diagonal angle.And in the second eyeball image, the second bright spot G1b provided by two light sources 212 at other diagonal angle.Subtracted each other by the gray-scale value of the first eyeball image and the corresponding pixel of the second eyeball image, the Difference image of this two width image that will obtain, the difference gray-scale value of such as Difference image will between-255 to 255.
What deserves to be explained is, because the first bright spot G1a image position in the first eyeball image and the second bright spot G1b image position in the second eyeball image do not overlap, according to this, perform among the Difference image that produces after image subtracts each other at the first eyeball image and the second eyeball image, the gray-scale value of corresponding first bright spot G1a image position and the second bright spot G1b image position is extreme value.For example, according to this, among described Difference image, the gray-scale value of the first bright spot G1a position in corresponding first eyeball image is the highest, and the gray-scale value (being such as negative gray-scale value) of the second bright spot G1b position in corresponding second eyeball image is minimum.
According to this, among described Difference image, the gray-scale value corresponding to two the first bright spot G1a and two the second bright spot G1b positions presents a special pattern.And this special pattern defined by two most bright spots and two most dim spots.But, in other embodiments, can be deduct the first eyeball image with the second eyeball image, thus among its Difference image, the gray-scale value of the bright spot G1 position in corresponding second eyeball image is the highest, and the gray-scale value of bright spot G1 position in corresponding first eyeball image is minimum.The present invention is not limited this.
Furthermore, when arithmetic element 230 is when the position of judgement first bright spot G1a and the second bright spot G1b, analyze position that all gray-scale values distribute close to the pixel of maximal value (255) and minimum value (-255), shape and scope according to Difference image and infer the position the first bright spot G1a and the second bright spot G1b in Difference image.Then, arithmetic element 230 judge infer that whether the positional alignment of the first bright spot G1a or the second bright spot G1b corresponds to above-mentioned special pattern, and then further confirm the position of the first bright spot G1a in Difference image and the second bright spot G1b.
Accordingly, control the position of different incident light L1 incidence in different time points by control module 340, thus the first bright spot G1a that can change in the eyeball image of different time points and the second bright spot G1b position, and can more confirm the first bright spot G1a and the second bright spot G1b position through gray-scale value and described special pattern via after image subtraction step, help the probability reducing location of mistakes bright spot G1 position.
Then, perform step S207, arithmetic element 230 judges the position of pupil P1 according to this through the distributing position of the first bright spot G1a and the second bright spot G1b.Specifically, arithmetic element 230 first chooses suitable threshold grey scale value, and the gray-scale value of pupil P1 in original first image is less than described threshold grey scale value, and the absolute value of the gray-scale value of multiple first bright spot G1a in Difference image or the second bright spot G1b is greater than described threshold grey scale value.Utilize threshold grey scale value, arithmetic element 230 can confirm the distributing position of these first bright spot G1a or the second bright spot G1b.After the distributing position of confirmation first bright spot G1a or the second bright spot G1b, inspect the grey value profile in the M1 of region near the distributing position that arithmetic element 230 scans the first bright spot G1a or the second bright spot G1b1, and to judge at the gray-scale value inspecting original first image in the M1 of region be less than the part of threshold grey scale value.
For example, among described Difference image, the gray-scale value of corresponding first bright spot G1a image position and the second bright spot G1b image position is extreme value, the gray-scale value of the first bright spot G1a position in corresponding first eyeball image is the highest, and the gray-scale value of the second bright spot G1b position in corresponding second eyeball image is minimum.According to this, arithmetic element 230 confirms the position of the first bright spot G1a through described threshold grey scale value, thus arithmetic element 230 scans the grey value profile of inspecting in the M1 of region near the first bright spot G1a judges the position of pupil P1 according to this.
What deserves to be explained is, inspecting region M1 can be defined by these first bright spot G1a and/or the second bright spot G1b.Inspect region M1 can be less times greater than and contain the distributing position of the first bright spot G1a or the second bright spot G1b around region.Or inspecting region M1 also can be around forming by the first bright spot G1a or the second bright spot G1b institute.User can inspect the scope of region M1 through arithmetic element 230 setting according to searching pupil P1 position range size.The present invention is not limited the range size of inspecting region M1.
When arithmetic element 230 judges have after the gray-scale value of a specific region is less than threshold grey scale value inspecting region M1, namely judge the shape of described specific region and scale whether close to the pupil P1 image in difference image to reduce the probability of erroneous judgement pupil P1 position.
Based on above-mentioned, through pupil method for detecting of the present invention, arithmetic element 230 only can judge the grey value profile of inspecting region M1 near the distributing position of the first bright spot G1a in Difference image or the second bright spot G1b, thus can accelerate the position obtaining pupil P1.Compare known technology, arithmetic element 230 need through judging that the grey value profile of whole the first eyeball image or the second eyeball image is to obtain the position of pupil P1.
Fig. 4 is the schematic flow sheet of the method for the iris identification that the embodiment of the present invention provides, and the method for the iris identification of the present embodiment can adopt the eyeball arrangement for detecting of Fig. 2 A.Refer to Fig. 4 and Fig. 2 A is consulted in cooperation.
Carry out step S401, when eyeball E1 is positioned at a reference position, send multiple tracks incident light L1 on eyeball E1, to form multiple bright spot G1 near the pupil P1 of eyeball E1, wherein the distributing position of these bright spot G1 is respectively as the first reference point, the second reference point and the 3rd reference point.
Specifically, multiple tracks incident light L1 can provide by light source 212 and spectrum groupware 214, thus multiple tracks incident light L1 transmitting place is multiple bright dippings place of spectrum groupware 214.Or multiple tracks incident light L1 can also not comprise any spectrum groupware 214 by least three light sources 212 to be provided, thus multiple tracks incident light L1 transmitting place is the lay down location of these light sources 212.The ornaments position of light source 212 or the configuration of light source 212 and spectrum groupware 214 can adjust incident light L1 and be incident in iris I1 region near pupil P1.
First reference point, the second reference point and the 3rd reference point are in order to be positioned at the mark of reference position as eyeball E1, and this reference position is in order to provide the position of one group of reference data in follow-up iris identification step.In the present embodiment, under the state that eyeball E1 faces front, user presets multiple bright spot G1 positions corresponding to these incident lights L1 transmitting place as the position of the first reference point, the second reference point and the 3rd reference point.Specifically, between the first reference point and the second reference point, form the first axis of reference, between the second reference point and the 3rd reference point, form the second axis of reference, and have between the first axis of reference and the second axis of reference with reference to angle.In addition, mark reference position in order to definitely clear, the present invention more can comprise setting the 4th reference point or other reference point more.That is, the present invention is not limited the quantity of reference point.
In the present embodiment, provide three incident light L1 position of transmitting place, and the position of this three incident light L1 transmitting place presents a right angle rounded projections arranged, and two section chief's degree ratios of this right-angle triangle are 2 to 1.Iris I1 region near pupil P1 is by appearance three bright spot G1, and the arrangement of these bright spot G1 is identical with the positional alignment of incident light L1 transmitting place in principle.That is, in principle, the ratio between the length of the first axis of reference and the length of the second axis of reference is about 2 to 1, is 90 degree with reference to angle.
Then, carry out step S402, when eyeball E1 is from the activity of described reference position to a measuring position, these incident lights L1 forms the first measurement bright spot, second in eyeball E1 and measures bright spot and the 3rd measurement bright spot, and the first measurement bright spot, second measures bright spot and the 3rd measurement bright spot is positioned near the pupil P1 of eyeball E1.First measurement bright spot and second is measured between bright spot and is formed the first axle, and the second measurement bright spot and the 3rd is measured between bright spot and formed the second axle, and has angle between the first axle and the second axle.
Specifically, when eyeball E1 rotates relative to reference position, because eyeball E1 shape is three-dimensional spherical haply, and iris I1 can protrude sphere, will change so incident light L1 is incident in multiple bright spot G1 positions that iris I1 formed, and change position bright spot G1 be described first and measure bright spot, second and measure bright spot and the 3rd and measure bright spot.That is, when eyeball E1 sight line departs from the state facing front, bright spot G1 position will deviate to the first measurement bright spot, second by the position of the first reference point, the second reference point and the 3rd reference point and measure the position that bright spot and the 3rd measures bright spot.
Then, carry out step S403, capture eyeball image through image sensor 120.Demonstrate the image of the eye of user, described first in eyeball image captured by image sensor 120 and measure the image that bright spot, second measures bright spot, the 3rd measurement bright spot and iris I1.Then, the data of captured eyeball image are transferred to arithmetic element 130 or 230 by image sensor 120.
Afterwards, carry out step S404, the gray-scale value analyzing eyeball image measures to obtain the first measurement bright spot, second position that bright spot and the 3rd measures bright spot.Specifically, arithmetic element 130 or 230 analyzes the grey value profile of eyeball image, can learn position that among eyeball image all gray-scale values distribute close to the pixel of maximal value (gray-scale values of such as 255), shape and scope.According to this, the position that arithmetic element 130 or 230 distributes through the pixel of all gray-scale values close to maximal value of analysing and comparing, shape and scope, infer that all first in eyeball image measures the position that bright spot, second measures bright spot and the 3rd measurement bright spot further.
Then, carry out step S405, calculate first to measure bright spot, second and measure bright spot and the 3rd and measure the displacement that the position of bright spot produces relative to the position of the first reference point, the second reference point and the 3rd reference point, obtain the deformation quantity of iris I1 image when iris I1 image when eyeball E1 is positioned at measuring position is positioned at reference position relative to eyeball E1 according to this.Specifically, the first axle is calculated relative to the variable quantity of the length of the first axis of reference and the variable quantity of angle to obtain the first variable quantity, the second axle relative to the variable quantity of the length of the second axis of reference and the variable quantity of angle to obtain the second variable quantity, angle relative to the variable quantity with reference to angle to obtain the 3rd variable quantity through arithmetic element 130 or 230.Accordingly, arithmetic element 130 or 230 calculates the deformation quantity of iris image according to the first variable quantity, the second variable quantity and the 3rd variable quantity, advanced, described deformation quantity ratio can change according to the relative scale of first and second axle and the ratio of original reference the or two axle merely to be estimated, sensor can be estimated to eyeball distance in addition according to the first axle or the second shaft length, and then estimation iris image size, accelerate to search.
What deserves to be explained is, when eyeball E1 faces front and is positioned at reference position, the iris image captured by image sensor 120 comparatively will be similar to round shape.When measuring position is identical with reference position, that is when eyeball E1 sight line keeps facing the state in front, the iris image captured by image sensor 120 will remain unchanged and be similar to round shape.When measuring position is different from reference position, that is when eyeball E1 sight line departs from the state facing front, the iris image captured by image sensor 120 comparatively will be similar to ellipticity.
Arithmetic element 130 or 230 can calculate the ellipse long and short shaft of iris image after calculating the first variable quantity, the second variable quantity and the 3rd variable quantity according to this, thus estimates out the oval border of iris image, and then accelerates the border search speed of iris image.
Fig. 5 is the schematic flow sheet of the method for the identification iris that the embodiment of the present invention provides.Refer to Fig. 5 and Fig. 2 A is consulted in cooperation, wherein the identification iris method of Fig. 5 embodiment and both identification iris methods of Fig. 4 embodiment similar, and to be described in detail for the difference between the method for these two kinds of identification irises below.
In the method for the identification iris of the present embodiment, first, carry out step S501, provide multiple incident light L1 to be incident to eyeball E1, to form multiple bright spot G1 on eyeball E1.Multiple tracks incident light L1 can provide by light source 112 and spectrum groupware 114, and multiple tracks incident light L1 transmitting place is the position of light by multiple bright dippings of spectrum groupware 114.Or multiple tracks incident light L1 can also not comprise any spectrum groupware 214 by least three light sources 212 to be provided, thus multiple tracks incident light L1 transmitting place is the lay down location of these light sources 212.In addition, the ornaments position of light source 212 or the configuration of light source 212 and spectrum groupware 214 can adjust incident light L1 and be incident in iris I1 region near pupil P1.
Carry out step S502, set the first reference point, the second reference point and the 3rd reference point to be positioned at the mark of reference position as eyeball E1.In the present embodiment, reference position is the position that eyeball E1 faces front.Under the state that eyeball E1 faces front, user presets multiple bright spot G1 positions corresponding to these incident lights L1 transmitting place as the position of the first reference point, the second reference point and the 3rd reference point.But, what deserves to be explained is that reference position does not need only to be defined as the position that eyeball E1 faces front, reference position can also be positioned at the position that eyeball E1 sight line departs from dead ahead.
Specifically, between the first reference point and the second reference point, form the first axis of reference, between the second reference point and the 3rd reference point, form the second axis of reference, and have between the first axis of reference and the second axis of reference with reference to angle.In addition, mark reference position in order to definitely clear, the present invention more can comprise setting the 4th reference point or other reference point more.That is, the present invention is not limited the quantity of reference point.
In the present embodiment, provide three incident light L1 position of transmitting place, and the position of this three incident light L1 transmitting place presents a right angle rounded projections arranged, and two section chief's degree ratios of this right-angle triangle are 2 to 1.Iris I1 region near pupil P1 is by appearance three bright spot G1, and the arrangement of these bright spot G1 is identical with the positional alignment of incident light L1 transmitting place in principle.That is, in principle, the ratio between the length of the first axis of reference and the length of the second axis of reference is 2 to 1, is 90 degree with reference to angle.It should be noted that user presets multiple bright spot G1 positions corresponding to these incident lights L1 transmitting place as the position of the first reference point, the second reference point and the 3rd reference point.
Carry out step S503, when eyeball E1 is positioned at measuring position, these incident lights L1 forms first in eyeball E1 and measures bright spot, the second measurement bright spot and the 3rd measurement bright spot.First measures bright spot, the second measurement bright spot and the 3rd position measuring bright spot is positioned near the pupil P1 of eyeball E1, and corresponding with the position of the first reference point, the second reference point and the 3rd reference point.First measurement bright spot and second is measured between bright spot and is formed the first axle, and the second measurement bright spot and the 3rd is measured between bright spot and formed the second axle, and has angle between the first axle and the second axle.
Specifically, when different users wears eyeball tracking device 200 or 300, optical module 210 is easily because the shape of face of user is different or bridge of the nose height is different and from eyeball E1 apart from different, so multiple bright spot G1 positions that the incident eyeball E1 of incident light L1 is formed will change, and the bright spot G1 position changed is, and described first measures bright spot, the second measurement bright spot and the 3rd measures bright spot.That is, when the state that eyeball E1 sight line remains unchanged, bright spot G1 position will zoom to the first measurement bright spot, second by the position equal proportion of the first reference point, the second reference point and the 3rd reference point and measure the position that bright spot and the 3rd measures bright spot, and angle is identical with the angle with reference to angle.
In the present embodiment, the ratio between the length of the first axle and the length of the second axle is 2 to 1, and accordingly, the ratio between the length of the first axis of reference and the length of the second axis of reference is also 2 to 1.Reference angle is 90 degree, and accordingly, angle is also 90 degree.
Carry out step S504, capture eyeball E1 image through image sensor 120.Demonstrate the image of eye, described first in eyeball image captured by image sensor 120 and measure the image that bright spot, second measures bright spot, the 3rd measurement bright spot and iris I1.Then, the data of captured eyeball image are transferred to arithmetic element 130 or 230 by image sensor 120.
Carry out step S505, analyze the gray-scale value of eyeball image to obtain the position that the first measurement bright spot, second measures bright spot and the 3rd bright measurement point.Specifically, arithmetic element 130 or 230 analyzes the grey value profile of eyeball image, can learn position that among eyeball image all gray-scale values distribute close to the pixel of maximal value, shape and scope.According to this, the position distributed close to the pixel of maximal value through all gray-scale values of analysing and comparing, shape and scope, and infer that all first in eyeball image measures the position that bright spots, second measure bright spot and the 3rd bright measurement point.What deserves to be explained is, because the position of bright spot G1 corresponds to the position of incident light L1 transmitting place, the position that therefore can be distributed close to the pixel of maximal value by all gray-scale values, shape and scope and infer the bright spot G1 position in the first eyeball image.
Carry out step S506, calculate first to measure bright spot, second and measure bright spot and the 3rd and measure the displacement that the position of bright spot produces relative to the position of the first reference point, the second reference point and the 3rd reference point, obtain the change resolution amount that iris I1 image when eyeball E1 is positioned at reference position produces according to this.Specifically, arithmetic element 130 or 230 is captured in eyeball image by image sensor 120, calculates the variable quantity of the first axle relative to the first axis of reference to obtain the first variable quantity, the second axle relative to the variable quantity of the second axis of reference to obtain the second variable quantity.Accordingly, arithmetic element 130 or 230 calculates the change resolution amount of iris image according to the first variable quantity and the second variable quantity.
For example, if the first axis of reference has 20 pixel values (pixels), the second axis of reference has 10 pixel values, and the ratio between the pixel value of the pixel value of the first axis of reference and the second axis of reference is 2 to 1.And arithmetic element 130 or 230 calculates the first axis of reference and has 10 pixel values, the second axis of reference has 5 pixel values.Then, arithmetic element 130 or 230 can calculate the pixel value scaled down 2 times that the first variable quantity and the second variable quantity are respectively the first axis of reference and the second axis of reference.Accordingly, estimated out the border of iris image, and then accelerated the border search speed of iris image.
In sum, the embodiment of the present invention provides the method for detecting of eyeball arrangement for detecting and eyeball tracking.Described eyeball arrangement for detecting comprises optical module, image sensor and arithmetic element.The method for detecting of described eyeball tracking only can judge the grey value profile of inspecting region near the bright spot in the first eyeball image by arithmetic element, thus can accelerate the position obtaining pupil.Compare known technology, arithmetic element need through judging that the grey value profile of whole the first eyeball image is to obtain the position of pupil.
The embodiment of the present invention provides the method for detecting of eyeball arrangement for detecting and eyeball tracking, and described eyeball arrangement for detecting comprises optical module, image sensor, arithmetic element and control module.Control the position of different incident light beam strikes in different time points by control module, thus the bright spot position that can adjust in the eyeball image of different time points, and then can more confirm bright spot position through gray-scale value and special pattern via after image subtraction step, help the probability reducing location of mistakes bright spot position.Arithmetic element only can judge the grey value profile of inspecting region near the distributing position of the bright spot in Difference image, thus can accelerate the position obtaining pupil.Compare known technology, arithmetic element need through judging that the grey value profile of whole the first eyeball image or the second eyeball image is to obtain the position of pupil.
The embodiment of the present invention provides the method for identification iris, the method of described identification iris calculates the first measurement bright spot, second by arithmetic element and measures the displacement that bright spot and the 3rd position measuring bright spot produce relative to the position of the first reference point, the second reference point and the 3rd reference point, the ellipse long and short shaft of iris image can be calculated according to this, thus estimate out the oval border of iris image, and then accelerate the border search speed of iris image.
The embodiment of the present invention provides the method for identification iris, after the method for described identification iris calculates the first variable quantity, the second variable quantity and the 3rd variable quantity by arithmetic element, estimates out the border of iris image, and then accelerates the border search speed of iris image.
The foregoing is only embodiments of the invention, it is also not used to limit scope of patent protection of the present invention.Anyly have the knack of alike those skilled in the art, not departing from spirit of the present invention and scope, the equivalence of the change done and retouching is replaced, and is still in scope of patent protection of the present invention.

Claims (30)

1. an eyeball arrangement for detecting, is characterized in that this eyeball arrangement for detecting comprises:
One optical module, for providing at least one incident light to eyeball, to form at least one bright spot on this eyeball, and this at least one bright spot is positioned near a pupil of this eyeball;
One image sensor, for capturing an eyeball image from this eyeball, this eyeball image comprises the image of this at least one bright spot and the image of this pupil;
One arithmetic element, for analyzing the gray-scale value of this eyeball image, and obtains the distributing position of described at least one bright spot through the gray-scale value of this eyeball image, and judges the position of this pupil according to the distributing position of this at least one bright spot.
2. eyeball arrangement for detecting as claimed in claim 1, is characterized in that: this incident light is infrared light.
3. eyeball arrangement for detecting as claimed in claim 1, is characterized in that: the gray-scale value of this pupil in this eyeball image is less than a threshold grey scale value, and the gray-scale value of this bright spot in this eyeball image is greater than a threshold grey scale value.
4. eyeball arrangement for detecting as claimed in claim 1, is characterized in that: this optical module provides multiple tracks incident light.
5. eyeball arrangement for detecting as claimed in claim 4, is characterized in that: this optical module comprises at least one light source and at least one spectrum groupware, and this light source provides a light, and this spectrum groupware of this light therethrough and form described multiple tracks incident light.
6. eyeball arrangement for detecting as claimed in claim 4, it is characterized in that: this optical module comprises multiple light source, described multiple light source is in order to provide described multiple tracks incident light.
7. eyeball arrangement for detecting as claimed in claim 4, it is characterized in that: more comprise a control module, this control module controls the time point of incident described multiple tracks incident light to this eyeball, and this image sensor captures this eyeball image of the different time points of this user according to this, and this arithmetic element analyzes the gray-scale value in this eyeball image of different time points.
8. eyeball arrangement for detecting as claimed in claim 7, is characterized in that: this arithmetic element controls control module and performs the time point of incident described multiple tracks incident light to this eyeball.
9. detect a method for side pupil, it is characterized in that the method that this detects side pupil comprises:
There is provided at least one incident light beam strikes to eyeball, to form at least one first bright spot on this eyeball, and this at least one first bright spot is positioned near a pupil;
From this eyeball acquisition one first eyeball image, and this first eyeball image comprises this at least one image of the first bright spot and image of this pupil;
Analyze the gray-scale value of this first eyeball image to obtain the distributing position of this at least one first bright spot; And
Distributing position through this at least one first bright spot judges the position of this pupil according to this.
10. detect the method for side pupil as claimed in claim 9, it is characterized in that: this optical module provides multiple tracks incident light, to form multiple first bright spot on this eyeball.
11. methods of detecing side pupil as claimed in claim 10, is characterized in that: described multiple tracks incident light sends from an optical module.
12. methods of detecing side pupil as claimed in claim 9, is characterized in that: this first eyeball image captures through an image sensor.
13. methods of detecing side pupil as claimed in claim 9, is characterized in that: judge through an arithmetic element and analyze the gray-scale value of this first eyeball image.
14. methods of detecing side pupil as claimed in claim 9, is characterized in that: the distributing position through described at least one first bright spot judges that the step of this pupil position comprises according to this:
Choose a threshold grey scale value;
Analyze defined by described at least one first bright spot one inspect grey value profile in region;
Inspect in region at this that to choose the region that gray-scale value is less than this threshold grey scale value be a specific region; And
Judge whether the shape of this specific region meets the shape of this pupil.
15. methods of detecing side pupil as claimed in claim 14, is characterized in that: this inspects region by described at least one first bright spot institute around forming.
16. methods of detecing side pupil as claimed in claim 14, is characterized in that: the gray-scale value of described at least one first bright spot in this first eyeball image is greater than this threshold grey scale value.
17. methods of detecing side pupil as claimed in claim 10, it is characterized in that: this first eyeball image is the acquisition when a very first time point, included by this first eyeball image, the image of described at least one bright spot is the image of multiple first bright spot, and this method of detecing side pupil more comprises:
There is provided described multiple tracks incident light beam strikes to this eyeball in one second time point and form multiple second bright spot at this eyeball, and at least part of described multiple second bright spot is positioned near this pupil;
Capture the one second eyeball image in this second time point, wherein this second eyeball image comprises described multiple image of the second bright spot and the image of this pupil;
Analyze the gray-scale value of this second eyeball image to obtain the distributing position of described multiple second bright spot, wherein the distributing position of described multiple first bright spots of this first eyeball image is different from the distributing position of described multiple second bright spots of this second eyeball image; And
Perform image to this first eyeball image and this second eyeball image to subtract each other, to produce a Difference image.
18. methods of detecing side pupil as claimed in claim 17, is characterized in that: perform incident described multiple tracks incident light to this eyeball through a control module in this very first time point and this second time point.
The method of 19. 1 kinds of identification irises, is characterized in that the method for this identification iris comprises:
When an eyeball is positioned at a reference position, send multiple tracks incident light on this eyeball, to form one first reference point, one second reference point and one the 3rd reference point to be positioned at the mark of reference position as this eyeball near the pupil of this eyeball, wherein the position of this first reference point, this second reference point and the 3rd reference point is corresponding with the position of described multiple tracks incident light transmitting place;
When this eyeball is from this reference position activity to a measuring position, described multiple tracks incident light forms one first and measures bright spot, one second measurement bright spot and one the 3rd measurement bright spot near this pupil;
Capture an eyeball image of this eyeball, this eyeball image comprises this first measures bright spot, this second measurement bright spot and the 3rd measures bright spot image and iris image;
Analyze the gray-scale value of this eyeball image to obtain the position of this first measurement bright spot, this second measurement bright spot and the 3rd bright measurement point;
First measures bright spot, this second is measured bright spot and the 3rd and measure the displacement that position of bright spot produces relative to the position of one first reference point, one second reference point and one the 3rd reference point to calculate this, obtains a deformation quantity of this iris image when this iris image when this eyeball is positioned at this measuring position is positioned at this reference position relative to this eyeball according to this.
The method of 20. identification irises as claimed in claim 19, it is characterized in that: described multiple tracks incident light provided by least one light source and at least one spectrum groupware, this light source provides a light, and this spectrum groupware of this light therethrough is to form described multiple tracks incident light.
The method of 21. identification irises as claimed in claim 20, is characterized in that: transmitting place of described multiple tracks incident light is the position of this light by multiple bright dippings of this spectrum groupware.
The method of 22. identification irises as claimed in claim 19, is characterized in that: described multiple tracks incident light provided by least three light sources, and transmitting place of described multiple tracks incident light is the lay down location of described multiple light source.
The method of 23. identification irises as claimed in claim 19, it is characterized in that: between this first reference point and this second reference point, form one first axis of reference, form one second axis of reference between this second reference point and the 3rd reference point, and have one between this first axis of reference and this second axis of reference with reference to angle.
The method of 24. identification irises as claimed in claim 23, it is characterized in that: this first measures bright spot and this second is measured between bright spot and form one first axle, this the second measurement bright spot and the 3rd is measured between bright spot and is formed one second axle, and has an angle between this first axle and this second axle.
The method of 25. identification irises as claimed in claim 24, is characterized in that: in this eyeball image of this acquisition, the step of the deformation quantity of an iris image comprises:
Calculate one first variable quantity, wherein this first variable quantity is the length of this first axle relative to this first axis of reference and the variable quantity of angle;
Calculate one second variable quantity, wherein this second variable quantity is the length of this second axle relative to this first axis of reference and the variable quantity of angle;
Calculate one the 3rd variable quantity, wherein the 3rd variable quantity is the variable quantity of this angle relative to this reference angle.
This deformation quantity is calculated according to this first variable quantity, this second variable quantity and the 3rd variable quantity.
The method of 26. identification irises as claimed in claim 19, is characterized in that: this reference position corresponds to the eye position that this eyeball faces front.
The method of 27. 1 kinds of identification irises, when wherein an eyeball is positioned at a reference position, is characterized in that the method for this identification iris comprises:
There is provided multiple incident light beam strikes to this eyeball;
Set one first reference point, one second reference point and one the 3rd reference point to be positioned at the mark of reference position as eyeball, wherein the position of this first reference point, this second reference point and the 3rd reference point is corresponding with the position of described multiple incident light transmitting place;
Described multiple incident light forms one first in this eyeball and measures bright spot, one second measurement bright spot and one the 3rd measurement bright spot, and this first measures bright spot, this second is measured bright spot and the 3rd and measure region near a pupil that bright spot is positioned at this eyeball, wherein this first measures bright spot, this second is measured bright spot and the 3rd to measure position of bright spot corresponding with the position of this first reference point, this second reference point and the 3rd reference point;
Capture an eyeball image of this eyeball, this eyeball image comprises described bright spot and this iris image;
Analyze the gray-scale value of this eyeball image to obtain the position of this first measurement bright spot, this second measurement bright spot and the 3rd bright measurement point;
Calculate this and first measure bright spot and this second change of spacing relative to the spacing of this first reference point and this second reference point of measuring bright spot, and calculate this and second measure the change of spacing relative to the spacing of this second reference point and the 3rd reference point that bright spot and the 3rd measures bright spot, obtain the change resolution amount that this iris image when this eyeball is positioned at this reference position produces according to this.
The method of 28. identification irises as claimed in claim 27, is characterized in that: form one first axis of reference between this first reference point and this second reference point, forms one second axis of reference between this second reference point and the 3rd reference point.
The method of 29. identification irises as claimed in claim 28, is characterized in that: form one first axle between this first bright spot and this second bright spot, forms one second axle between this second bright spot and the 3rd bright spot.
The method of 30. identification irises as claimed in claim 29, is characterized in that: the step obtaining this change resolution amount of this iris image comprises:
Calculate one first variable quantity, wherein this first variable quantity is the length variations amount of this first axle relative to this first axis of reference;
Calculate one second variable quantity, wherein this second variable quantity is the length variations amount of this second axle relative to this first axis of reference;
This change resolution amount is calculated according to this first variable quantity and this second variable quantity.
CN201310607136.4A 2013-11-25 2013-11-25 Eyeball arrangement for detecting, pupil method for detecting and iris discrimination method Active CN104657702B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910196821.XA CN109919117B (en) 2013-11-25 2013-11-25 Eyeball detection device and pupil detection method
CN201310607136.4A CN104657702B (en) 2013-11-25 2013-11-25 Eyeball arrangement for detecting, pupil method for detecting and iris discrimination method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310607136.4A CN104657702B (en) 2013-11-25 2013-11-25 Eyeball arrangement for detecting, pupil method for detecting and iris discrimination method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201910196821.XA Division CN109919117B (en) 2013-11-25 2013-11-25 Eyeball detection device and pupil detection method

Publications (2)

Publication Number Publication Date
CN104657702A true CN104657702A (en) 2015-05-27
CN104657702B CN104657702B (en) 2019-04-12

Family

ID=53248804

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201310607136.4A Active CN104657702B (en) 2013-11-25 2013-11-25 Eyeball arrangement for detecting, pupil method for detecting and iris discrimination method
CN201910196821.XA Active CN109919117B (en) 2013-11-25 2013-11-25 Eyeball detection device and pupil detection method

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910196821.XA Active CN109919117B (en) 2013-11-25 2013-11-25 Eyeball detection device and pupil detection method

Country Status (1)

Country Link
CN (2) CN104657702B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108567405A (en) * 2017-04-28 2018-09-25 分界线（天津）网络技术有限公司 A kind of measuring system and method for myopic refractive degree
CN108567411A (en) * 2017-09-15 2018-09-25 分界线（天津）网络技术有限公司 A kind of judgement system and method for human eye health state
CN108567406A (en) * 2017-04-28 2018-09-25 分界线（天津）网络技术有限公司 A kind of analytical measurement system and method for human eye diopter
CN110929570A (en) * 2019-10-17 2020-03-27 珠海虹迈智能科技有限公司 Iris rapid positioning device and positioning method thereof

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111781722A (en) * 2020-07-01 2020-10-16 业成科技（成都）有限公司 Eyeball tracking structure, electronic device and intelligent glasses

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006013669A1 (en) * 2004-08-02 2006-02-09 Matsushita Electric Industrial Co., Ltd. Pupil detector and iris identification device
CN101336089A (en) * 2006-01-26 2008-12-31 诺基亚公司 Eye tracker equipment
CN101344919A (en) * 2008-08-05 2009-01-14 华南理工大学 Sight tracing method and disabled assisting system using the same
WO2009066475A1 (en) * 2007-11-21 2009-05-28 Panasonic Corporation Display
CN101539991A (en) * 2008-03-20 2009-09-23 中国科学院自动化研究所 Effective image-region detection and segmentation method for iris recognition

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI432172B (en) * 2008-10-27 2014-04-01 Utechzone Co Ltd Pupil location method, pupil positioning system and storage media
US8723798B2 (en) * 2011-10-21 2014-05-13 Matthew T. Vernacchia Systems and methods for obtaining user command from gaze direction

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006013669A1 (en) * 2004-08-02 2006-02-09 Matsushita Electric Industrial Co., Ltd. Pupil detector and iris identification device
CN101336089A (en) * 2006-01-26 2008-12-31 诺基亚公司 Eye tracker equipment
WO2009066475A1 (en) * 2007-11-21 2009-05-28 Panasonic Corporation Display
CN101539991A (en) * 2008-03-20 2009-09-23 中国科学院自动化研究所 Effective image-region detection and segmentation method for iris recognition
CN101344919A (en) * 2008-08-05 2009-01-14 华南理工大学 Sight tracing method and disabled assisting system using the same

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108567405A (en) * 2017-04-28 2018-09-25 分界线（天津）网络技术有限公司 A kind of measuring system and method for myopic refractive degree
CN108567406A (en) * 2017-04-28 2018-09-25 分界线（天津）网络技术有限公司 A kind of analytical measurement system and method for human eye diopter
CN108567411A (en) * 2017-09-15 2018-09-25 分界线（天津）网络技术有限公司 A kind of judgement system and method for human eye health state
CN110929570A (en) * 2019-10-17 2020-03-27 珠海虹迈智能科技有限公司 Iris rapid positioning device and positioning method thereof
CN110929570B (en) * 2019-10-17 2024-03-29 珠海虹迈智能科技有限公司 Iris rapid positioning device and positioning method thereof

Also Published As

Publication number Publication date
CN109919117A (en) 2019-06-21
CN104657702B (en) 2019-04-12
CN109919117B (en) 2024-05-03

Similar Documents

Publication Publication Date Title
TWI533224B (en) Eye detecting device and methodes of detecting pupil and identifying iris
CN104657702A (en) Eyeball detection device, pupil detection method and iris identification method
EP1008831B1 (en) Outdoor range finder
CN103780957B (en) A kind of television terminal intelligence control system and control method thereof
EP3371779B1 (en) Systems and methods for forming models of three dimensional objects
US20200210733A1 (en) Enhanced video-based driver monitoring using phase detect sensors
CN101013028A (en) Image processing method and image processor
JP4452836B2 (en) Method and apparatus for detecting pupils
US20090225278A1 (en) Eyeball locating method and system
CN207439968U (en) It is a kind of to detect and distinguish the device of transparent glass cover board upper and lower surface defect
WO2018164104A1 (en) Eye image processing device
EP3401899B1 (en) Method for controlling a display parameter of a mobile device and computer program product
US10485420B2 (en) Eye gaze tracking
TW201911233A (en) Image depth sensing method and image depth sensing apparatus
CN105391998A (en) Automatic detection method and apparatus for resolution of low-light night vision device
US11418707B2 (en) Electronic device and notification method
JP4452835B2 (en) Method and apparatus for detecting pupils
US11272086B2 (en) Camera system, vehicle and method for configuring light source of camera system
CN107024487B (en) ITO conductive glass detection system and detection method thereof
US20230009071A1 (en) Control method for light sources of vision machine, and vision machine
JP7028814B2 (en) External shape recognition device, external shape recognition system and external shape recognition method
KR100593606B1 (en) Object Recognition Apparatus by Pattern Image Projection and Applied Image Processing Method
CN106153011B (en) Range-measurement system and the method for measuring distance
JPS62194413A (en) Three-dimensional coordinate measuring instrument
JP2021004762A (en) Measurement device, imaging device, measurement system, control method, program and recording medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant