Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/18—Eye characteristics, e.g. of the iris
  • G06V40/19—Sensors therefor
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/20—Image preprocessing
  • G06V10/24—Aligning, centring, orientation detection or correction of the image
  • G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning

Definitions

• the present invention relates generally to systems and methods for processing images to obtain biometric information, and more particularly, to systems and methods for rapidly detecting specular reflection patterns in eye images, which can then be analyzed to determine the quality of the image for biometric analysis.
• Biometric iris image capture systems typically consist of a video camera which produces a stream of video frames and a set of illuminators in fixed locations relative to the camera which provide the light necessary to produce high quality images. In order to capture high quality images, the quality of the images in the video stream must be assessed. These quality results can be used to provide feedback to users, drive autofocus or camera pan/tilt mechanisms, or determine which frames from the video stream are likely to be useful for matching.
• image focus specifically the sharpness of the iris texture and pupil boundary.
• Cameras for capturing images of the iris tend to have a shallow depth of field, and irises are surrounded by confounding image features such as eyelashes and eyebrows.
• General image sharpness algorithms often respond to these confounding features while leaving the iris texture itself out of focus.
• the iris is typically a moving target due to motion of the capture subject, the camera operator, or both. This means that focusing on a fixed location within the image is unlikely to produce reliable focus results.
• a reliable focus assessment algorithm should be able to locate the region of interest, i.e., iris texture, within an image and assesses the focus in that region within the time of a single video frame.
• Focus assessment algorithms that apply to fixed image regions can be readily implemented. However, algorithms for locating irises tend to require significant processing time, making them ill-suited for embedded processor or high rate applications.
• Embodiments according to aspects of the present invention provide rapid detection of specular reflection patterns in eye images, which can then be specifically analyzed to determine the quality of the image for biometric analysis.
• systems and methods according to aspects of the present invention receive at least one image of an eye from an image capture system.
• the image capture system includes a camera and one or more illuminators that direct light at the eye while the camera captures the at least one image of the eye.
• the eye reflects the light from the one or more illuminators to create a pattern of one or more specular reflections in the at least one image.
• the specular reflection pattern in the at least one image of the eye is identified and a quality of the at least one image of the eye is determined based on the specular reflection pattern.
• the specular reflection pattern in the at least one image is located.
• a location of iris texture in the at least one image may be identified according to the location of the specular reflection pattern.
• the quality of the at least one image may be determined by analyzing a focus measure based on the located iris texture.
• the quality of the at least one image is determined by analyzing a focus measure for the at least one image according to other techniques.
• the focus measure for the at least one image may be determined by analyzing a sharpness of one or more of the specular reflections, which is determined by measuring a size of the one or more specular reflections.
• the quality of the at least one image is determined by analyzing an intensity of areas surrounding the one or more specular reflections in the at least one image to determine a location of the one or more specular reflections relative to features of the eye.
• the quality of the at least one image is determined by analyzing an occlusion of the one or more specular reflections in the at least one image.
• a type of image capture system is determined according to the specular reflection pattern and the at least one image is analyzed according to the type of image capture system.
• information relating to the quality of the at least one image is sent to the image capture system, and the image capture system is adjusted according to the quality information.
• FIG. 1 illustrates an image capture system that may be implemented according to aspects of the present invention.
• FIG. 2 illustrates an example embodiment implementing steps according to aspects of the present invention.
• FIG. 3 illustrates an example embodiment implementing further steps according to aspects of the present invention.
• FIG. 4A illustrates an example eye image where the eye is looking generally straight toward the camera and there are no occlusions.
• FIG. 4B illustrates example areas where iris texture is expected to be in an eye image according to aspects of the present invention.
• FIG. 5 illustrates an example eye image that is out of focus.
• FIG. 6 illustrates an example eye image where the iris has rolled upward relative to specular reflections.
• FIG. 1 an image capture system 100 is illustrated.
• the image capture system 100 includes a camera 102 and a set of illuminators 104 that are employed to capture a stream of video frames of an eye including iris texture.
• FIG. 1 also illustrates a controller 110 coupled to the image capture system 100.
• the controller 110 processes the video frames from the image capture system 100 and may also control aspects of the operation of the image capture system 100.
• the controller 110 assesses whether the quality of a video frame is sufficient for further biometric analysis.
• the controller 110 uses the quality assessment to provide feedback to the image capture system 100 so that higher quality images can be captured, e.g., by adjusting auto focus, camera pan/tilt mechanisms, or the like.
• a stream of video frames of the eye, including iris texture are captured in step 202 with the image capture system 100.
• the illuminators 104 produce a fixed pattern of specular reflection on the surface of the eye.
• a procedure for object detection is applied to the video frames to identify and locate the specular reflection pattern.
• the set of illuminators 104 in some embodiments may be arranged to make the specular reflection pattern easier to distinguish. For example, a single illuminator 104 generally produces a single bright spot, whereas four illuminators produce four spots in a fixed pattern which may be more easily distinguishable, for example, from background glare.
• the location of the eye can be determined from the location of the specular reflection pattern as the specular reflection pattern always appears in the eye, which acts as a reflective sphere. From the location of the eye and the geometry of the image capture system 100, the location of the iris texture in the eye image can then be estimated in step 206.
• An example of a typical eye image 10 is shown in FIG. 4A.
• the eye image 10 is produced when the eye is looking generally straight toward the camera 102.
• the two specular reflections 15 appear within the pupil 12 and do not obscure the iris 14.
• the iris texture can be assumed to be in a generally fixed location relative to the specular reflection pattern.
• FIG. 4B illustrates the estimated location of the iris texture in the areas 16.
• a quality assessment procedure e.g. , focus measurement
• Step 208 can be specifically applied in step 208 to the iris region of interest.
• Step 208, as well as steps 204 and 206, are executed by the controller 110.
• An example procedure for measuring focus is described in U.S. Patent No. 6,753,919 to Daugman, the contents of which are incorporated entirely herein by reference. Unlike other implementations of this focus measurement procedure, however, the focus here is assessed for a region of interest as determined by the location of the specular reflection pattern.
• rectangle features are particularly successful in the embodiments described herein, because specular reflections on a pupil may strongly resemble black and white rectangular structures. Rapid computation of the rectangular features is achieved by using an intermediate image representation, referred to as "an integral image.”
• AdaBoost Adaptive Boosting
• AdaBoost Adaptive Boosting
• Boost adaptive Boosting
• the object detector finds the specular reflection pattern rapidly by focusing on areas of the image where the pattern is likely to be located.
• the specular reflection pattern of a particular image capture system can be described very efficiently in this object detection procedure and can be used to track the eye with a high degree of accuracy with minimal computation.
• FIG. 5 illustrates an example of how specular reflections 15 appear in an out of focus eye image 20.
• the area of each specular reflection is larger and the edges of each specular reflection are more diffused.
• focus can be successfully determined by ignoring the iris texture for focus measurement and merely assuming that the sharpest image among the captured video frames is the image with smallest specular reflections. Because the specular reflections provide information on image focus, the object detector can be calibrated to respond most strongly to the specular reflection pattern when the iris texture is at peak focus.
• the eye is looking generally straight toward the camera. If, however, the subject rolls his or her eye upward, the eye capture system 100 may capture an eye image 30 as shown in FIG. 6.
• the specular reflections 15 remain in the same place relative to the eye in general as shown in FIG. 4A, but the iris 14 has moved upward so that the reflections 15 are now positioned over the iris 14. Because the object detector attempts to identify specular reflections 15 relative to a dark background, such as the pupil 12, the eye image 30 in FIG. 5 does not receive a high quality score, thereby eliminating the eye image 30 as a candidate for further analysis.
• the intensity of the pixels surrounding the specular reflection can be used to determine whether the iris is centered or rolled to one side.
• the specular reflections are often occluded as well, also resulting in a low quality score that eliminates the image as a candidate, whereas the quality score of a more general focus metric might not be affected by the occlusion.
• the overall quality of an image is a combination of how well the specular reflections match up with an expected (or acceptable) image as well as how sharp the iris texture appears to be.
• the illuminators 104 of the image capture system 110 produce a fixed pattern of specular reflection on the surface of the eye.
• the specular reflection pattern indicates what type of image capture system 100, including the model of the camera 102, is being used to obtain the images. Because embodiments according to the present invention can identify different specular reflection patterns, information on the detected specular reflection pattern can also be employed to identify the type of image capture system 100 used to obtain the images.
• the specular reflection is identified in step 204 using the object detection procedure above.
• the specular reflection pattern is used to determine the corresponding image capture system 100, e.g., by referring to a database of known specular reflection patterns. Subsequent processing or analysis particular to the image capture system 100 is then performed in step 212.
• FIG. 1 illustrates the controller 110 for processing the video frames from the image capture system 100 using algorithms and optionally providing feedback to the image capture system 100.
• the controller 110 may be implemented as a combination of hardware and software elements.
• the hardware aspects may include combinations of operatively coupled hardware components including microprocessors, logical circuitry, communication/networking ports, digital filters, memory, or logical circuitry.
• the controller may be adapted to perform operations specified by a computer-executable code, which may be stored on a computer readable medium.
• the controller 110 may be a programmable processing device, such as an external conventional computer or an on-board field programmable gate array (FPGA) or digital signal processor (DSP), that executes software, or stored instructions.
• FPGA field programmable gate array
• DSP digital signal processor
• physical processors and/or machines employed by embodiments of the present disclosure for any processing or evaluation may include one or more networked or non-networked general purpose computer systems, microprocessors, field programmable gate arrays (FPGA's), digital signal processors (DSP's), micro-controllers, and the like, programmed according to the teachings of the exemplary embodiments, as is appreciated by those skilled in the computer and software arts.
• the physical processors and/or machines may be externally networked with the image capture system 100, or may be integrated to reside within the image capture system 100.
• Appropriate software can be readily prepared by programmers of ordinary skill based on the teachings of the exemplary embodiments, as is appreciated by those skilled in the software art.
• the devices and subsystems of the exemplary embodiments can be implemented by the preparation of application-specific integrated circuits or by interconnecting an appropriate network of conventional component circuits, as is appreciated by those skilled in the electrical art(s).
• the exemplary embodiments are not limited to any specific combination of hardware circuitry and/or software.
• the exemplary embodiments may include software for controlling the devices and subsystems of the exemplary embodiments, for driving the devices and subsystems of the exemplary embodiments, for enabling the devices and subsystems of the exemplary embodiments to interact with a human user, and the like.
• Such software can include, but is not limited to, device drivers, firmware, operating systems, development tools, applications software, and the like.
• Such computer readable media further can include the computer program product of an embodiment for performing all or a portion (if processing is distributed) of the processing performed in implementations.
• Computer code devices of the exemplary embodiments can include any suitable interpretable or executable code mechanism, including but not limited to scripts, interpretable programs, dynamic link libraries (DLLs), Java classes and applets, complete executable programs, and the like.
• parts of the processing of the exemplary embodiments of the present disclosure can be distributed for better performance, reliability, cost, and the like.
• Computer-readable media may include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other suitable magnetic medium, a CD-ROM, CDRW, DVD, any other suitable optical medium, punch cards, paper tape, optical mark sheets, any other suitable physical medium with patterns of holes or other optically recognizable indicia, a RAM, a PROM, an EPROM, a FLASH-EPROM, any other suitable memory chip or cartridge, a carrier wave or any other suitable medium from which a computer can read.
• a floppy disk a flexible disk, hard disk, magnetic tape, any other suitable magnetic medium, a CD-ROM, CDRW, DVD, any other suitable optical medium, punch cards, paper tape, optical mark sheets, any other suitable physical medium with patterns of holes or other optically recognizable indicia, a RAM, a PROM, an EPROM, a FLASH-EPROM, any other suitable memory chip or cartridge, a carrier wave or any other suitable medium from which a computer can read.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Ophthalmology & Optometry (AREA)
• Human Computer Interaction (AREA)
• Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Applications Claiming Priority (2)

Publications (2)

Family

ID=47422893

Family Applications (1)

Country Status (2)

Cited By (1)

Families Citing this family (4)

Family Cites Families (4)

• 2012
  • 2012-06-18 WO PCT/US2012/042904 patent/WO2012177542A1/en unknown
  • 2012-06-18 EP EP20120802809 patent/EP2724292A4/de not_active Withdrawn

Also Published As

Similar Documents

Legal Events