Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/12—Fingerprints or palmprints
  • G06V40/13—Sensors therefor
  • G06V40/1324—Sensors therefor by using geometrical optics, e.g. using prisms

Definitions

• the present invention relates to fingerprint detection, and in particular to methods and apparatus for imaging fingerprints in conjunction with detection of a biological property of the finger that confirms the integrity of the finger being imaged.
• the expression 'confirmation of integrity' in this context is intended to encompass confirmation that the finger is not a fake finger (i.e. a plastic or latex replica) and/or that the finger belongs to an animate object (i.e. not a dead body or severed finger).
• the expression 'finger' is used throughout the present specification for convenience, but it is intended to encompass any body part that provides a highly characteristic 'print' based on a non-planar surface pattern and which is capable of delivering a measurable biological property that confirms its integrity as defined above. Examples may include palm prints, hand prints, footprints and the like.
• Authenticating the identity of a person is becoming an increasingly frequent requirement in many contexts, e.g. when travelling, accessing buildings and other secure areas, and when accessing or using electronic systems such as computers and data storage devices.
• this document proposes using a bundle 10 of optical fibres 14 having a first end 38 that provides a combined interface to a light source 40 for transmitting light down the fibres 14 and an imaging device 42 for receiving light returned along the fibres.
• the fibres 14 At the opposite (second) end 36 of the fibre bundle, the fibres 14 each terminate with an end face 16 that is at an oblique angle to the longitudinal axis of the fibre.
• the end faces 16 of the fibres in the bundle are disposed so that the angled faces together provide a detector surface 36 upon which a finger 12 may be placed.
• the optical fibres 14 have a refractive index of n1 ; the medium present at the detector surface has a refractive index of n2.
• the medium present at the detector surface 36 may be air (n2 ⁇ n1) or skin of the finger (n2 > n1).
• the oblique angle is selected such that when the medium beyond the end of the fibre 14 is air, total internal reflection 32 occurs and light is internally scattered and returned down the optical fibre to the first end. If the medium beyond the end of the fibre 14 is skin, the light from the fibre is transmitted into the finger 12 where it is scattered and not generally returned down the fibre 14 from which it emerged.
• the finger 12 provides a non-planar surface having ridges and valleys corresponding to the fingerprint pattern.
• the individual fibres 14 are sufficiently small in diameter that some fibres will provide a detector surface 16 that falls between ridges and will therefore have air at the interface (n2 ⁇ n1) while others will provide a detector surface 16 on which a ridge falls (n2 > n1).
• light transmitted back down the fibre bundle will be a function of the fingerprint pattern placed on the detector surface.
• the device in US '171 cannot make use of the light that is transmitted into, and scattered within, the finger because there is no specific optical detector for this light.
• US 2003/0090650 describes, with particular reference to figure 8 therein, a system in which there is provided a first optical detector 120 for collecting light transmitted into and scattered from the finger F as well as a second detector 2Of for collecting light returned by internal reflection from a planar surface of a microprism element.
• the first optical detector 120 collects all light scattered from the finger and returned via the microprism element 50 to facilitate plethysmography measurements, while the second detector is a two dimensional detector that preserves spatial information for imaging the fingerprint pattern.
• fingerprint imaging systems have been variously described in US 6175641 , US 2003/0118219, US 2003/0044051 and WO 03/063065. It is an object of the present invention to provide a method and apparatus for imaging fingerprints and for detecting at least one biological property of the finger that confirms the integrity of the finger being imaged. It is a further object of the invention to provide a method and apparatus for fingerprint imaging that can readily incorporate detection of a number of possible animate biological properties of the finger. It is a further object of the invention to facilitate verification of the finger as belonging to an animate object using Doppler blood perfusion measurements. It is a further object of the invention to provide a highly compact apparatus for fingerprint imaging that can conveniently be incorporated within other electronic devices.
• the present invention provides a fingerprint imaging device comprising: an array of optical waveguides each having an optical axis extending between a source end and a reflection end, the reflection end comprising a detection surface that is oblique to the optical axis such that light propagating along the optical axis is reflected internally to the optical waveguide when a target medium having a refractive index less than that of the waveguide is present at the reflection end and such that light is transmitted through the reflection surface when the target medium has a refractive index greater than that of the waveguide; an array of illumination sources, each illumination source optically coupled to a respective one of the optical waveguides; and at least one detector, proximal to the detection surfaces of the reflection ends of the optical waveguides, for receiving said transmitted light after scattering from the medium.
• the present invention provides a fingerprint imaging device comprising: an array of optical waveguides each having an optical axis extending between a source end and a reflection end, the reflection end comprising a detection surface that is oblique to the optical axis such that light propagating along the optical axis is reflected internally to the optical waveguide when no skin is in contact with the detection surface and such that light is transmitted through the reflection surface when skin is in contact with the detection surface; an array of illumination sources, each illumination source optically coupled to a respective one of the optical waveguides; and at least one detector, proximal to the detection surfaces of the reflection ends of the optical waveguides, for receiving said transmitted light after scattering from the skin.
• Figure 1 shows schematic views of a prior art fingerprint acquisition system in which figure 1(a) is side view of the optical components including an optical fibre bundle; figure 1 (b) is a cross-sectional side view of an optical fibre within the bundle of figure 1(a); and figure 1(c) is a perspective view of the optical fibre bundle;
• Figure 2 is a schematic diagram of detection principles according to the present invention in which figure 2(a) shows an optical path for light scattered from a target medium; and figure 2(b) shows an optical path for light reflected within an optical waveguide;
• Figure 3 is a perspective view of optical elements of a fingerprint and biological property acquisition system according to a presently preferred configuration.
• Figure 4 is a schematic diagram of a fingerprint and biological property acquisition system according to a presently preferred configuration.
• Figure 5 is a schematic diagram of an alternative optical scanning system that can replace a switched array of optical sources.
• the present invention generally provides a plurality of optical waveguides 113 which may be optical fibres or waveguides within an integrated optical element 110 such as can be formed using known optical semiconductor device fabrication processes.
• the optical waveguide array 110 comprises a plurality of waveguides 113 each of which has a first (source) end 130 that acts an input facet for a light source 122, for transmitting light down the waveguide 113.
• each waveguide 113 terminates with a reflection end face 135 that is at an oblique angle to the longitudinal axis of the waveguide 113.
• the reflection end faces 135 of the waveguides 113 are disposed so that the angled faces together provide a detection surface 136 upon which a finger 111 may be placed.
• the non-planar surface 105 of the finger 111 is evident in figure 2.
• the waveguides 113 have a refractive index of n1 ; the target medium present at the detection surface 136 has a refractive index of n2.
• the target medium present at the detection surface 136 is skin of the finger 111 (n2 > n1) while in the example of figure 2(b) the target medium present at the detection surface 136 is air 106 (n2 ⁇ n1).
• the oblique angle of the detection surface 136 relative to the optical axes of the waveguides 113 is selected such that when the target medium at the detection surface 136 is air 106 (figure 2(b)), input light 100 undergoes total internal reflection resulting in a reflected beam as illustrated, internally scattered and returned down the optical waveguide to the first end or dissipated in the walls of the waveguide. Conversely, if the target medium at the detection surface is skin (figure 2(a)), input light 101 is transmitted into the finger 111 where it is scattered as shown by paths 112 to detector elements 123 and not generally returned down the waveguides.
• the detector elements 123 are provided in an array 140 that corresponds in dimensionality to the array of waveguides 113 so that each waveguide has at least one detector element 123.
• the detector elements 123 are each positioned proximal to respective reflection end faces 135 of the waveguides 113, on an adjacent part of the detection surface 136.
• the detector elements 123 can receive light scattered by the finger 111 directly without requiring return passage of the scattered light through the waveguide array.
• the proximity of the detector elements 123 to the respective reflection end faces is of similar order of spacing to the separation of the waveguides 113 in the array 110, but could generally be from 100 microns up to the order of a few millimetres.
• Each waveguide 113 is provided with an illumination source such as semiconductor laser 122.
• the illumination sources are provided in an array of such semiconductor lasers as shown.
• the individual illumination sources in the array are separately switchable.
• a biological property of the target medium e.g. finger
• the target medium e.g. finger
• Photoplethysmography is based on the changing optical properties of a selected area of skin, e.g. the finger.
• the finger When light is transmitted into the body, more or less light is absorbed depending on the blood volume present within the body in the illuminated area. Consequently, monitoring backscattered light from the illuminated skin area corresponds with any variation of the blood volume. Blood volume changes can thus be determined by measuring variations in the amount of reflected light and using the optical properties of tissue and blood.
• the detector elements 123 are coupled to a suitable processing device 150 that is adapted to determine whether the target medium corresponds to an animate object based on plethysmographic analysis of the signals received by the detector elements 123.
• Pulse oximetry is a technique for monitoring the level of oxygenation of the blood. Pulse oximetry makes use of the phenomenon that blood changes colour depending on whether haemoglobin in red blood cells is oxygenated or deoxygenated. Deoxygenated blood is darker red in colour than oxygenated blood. It is therefore possible to deduce the degree of oxygen saturation of blood from its colour. Consequently, measuring the absorption of certain parts of the colour spectrum in transmitted or scattered light from an illuminated area of skin enables a determination of the oxygenation of the blood. Typically, relative absorption of different frequencies of light is monitored in order to compensate for other light absorptive characteristics of the body.
• the pulse oximetry technique distinguishes between arterial blood which is oxygenated and venous blood which is deoxygenated by measuring the differences in light absorption characteristics between the high and low points of pulse fluctuations (systolic and diastolic) so as to cancel out effects of steady venous flow and measure only the colour of the pulsating arterial blood.
• the detector elements 123 are coupled to a suitable processing device 150 that is adapted to determine whether the target medium corresponds to an animate object based on pulse oximetry analysis of the signals received by the detector elements 123.
• the illumination sources 122 are adapted to provide optical output at at least two different wavelengths of light such that absorption coefficients at different wavelengths can be determined.
• the illumination sources 122 are broad spectrum sources encompassing the at least two different wavelengths so that absorption can be measured for each.
• a pair of detector elements 123, each responsive to one of the different wavelengths, is provided for each waveguide.
• the illumination sources 122 are each substantially monochromatic but comprise at least two groups, each group covering the at least two different wavelengths.
• detector elements 123 are preferably optimised for sensitivity to their respective illumination source and waveguide.
• Doppler blood perfusion measurement is a technique for measuring the circulation of blood within the body.
• some of the light is scattered by moving red blood cells and some is scattered by static tissue.
• the light scattered by moving red blood cells will have minute changes in frequency due to the Doppler effect.
• a sensitive optical detector By detecting these small changes in frequency in the scattered light using a sensitive optical detector, an indication of blood perfusion can be derived.
• highly monochromatic light sources such as semiconductor laser sources are required.
• the detector elements 123 are coupled to a suitable processing device 150 that is adapted to determine whether the target medium corresponds to an animate object based on Doppler blood perfusion analysis of the signals received by the detector elements 123.
• the illumination sources 122 are all adapted to provide substantially monochromatic optical output at a wavelength of light such that Doppler shifts in light scattered by moving red blood cells is readily identifiable.
• the invention as so far described can be implemented with a two dimensional array of illumination sources 122, waveguides 113 and detector elements 123 in order to obtain the required two dimensional image of the fingerprint as well as the biological property indication.
• a particular advantage of providing an array of detector elements 123 corresponding in dimension to the array of waveguides 123 and illumination sources 122 is that the biological property indication and fingerprint image information can be collected by the same detector elements 123. This avoids the need for two sets of detectors and also avoids the need for scattered light to be passed back into the waveguides. Still further, it avoids the need for the reflected light within the waveguides to be captured and detected.
• the detector elements 123 preferably also comprise a corresponding one-dimensional array of corresponding dimensions. Although two detector elements 123 are depicted per waveguide 113 in figure 3, it will be understood that this configuration represents two linear arrays of detector elements in which each linear array comprises detectors sensitive to a specific wavelength, useful for example when performing pulse oximetry measurements or Doppler perfusion measurements.
• the array dimension extends in the 'x' direction and a user's finger is drawn across the detection surface in the direction of arrow 125 which represents the 'y' direction.
• the finger could equally be drawn in the opposite (-y) direction.
• the detected light is sampled over short periods each corresponding to a location in y-space.
• Each waveguide 113 corresponds to a location in x-space.
• the illumination sources 122 are preferably each fired in turn, for a short period of time that does not overlap with the firing period of any other illumination source.
• the firing period, or 'on-time' of each illumination source is of the order of 0.025 ms.
• one or more detector elements 123 check to see whether light has entered the finger 111 and been scattered. If so, the location of medium in contact with the detection surface 136 is established (e.g. a ridge of a fingerprint). If no light is detected by the detector elements 123, it is determined that air is present at the detection surface for that location (e.g. a fingerprint valley overlies the detection surface) and all light from the illumination source has been internally reflected within the waveguide.
• the process is repeated for each successive illumination source 122 and waveguide 113 in the array until an entire x-scan is completed. Subsequent x-scans are performed at predetermined time intervals as the finger is drawn across the detection surface 136 in order that a two- dimensional image of the fingerprint can be established.
• Measurement of the animate biological property typically requires a longer period of illumination than an image scan as described above.
• Doppler blood perfusion analysis typically requires data acquisition times of the order of 1 ms. Therefore, between one or more selected x-scans, it is possible to switch on at least one illumination source for an extended period, e.g. 2.5 ms, in order to capture data adequate for perfusion analysis. For better signal to noise ratio, and because spatial information is not necessarily required for perfusion analysis, it may be desirable to switch all illumination sources 122 on together for the perfusion analysis reading.
• one illumination source 122 in the array 120 and its respective detectors may be selected to have a wavelength different than the other illumination sources selected for fingerprint imaging or mapping.
• the respective sources and detectors operating at different wavelengths do not interfere with each other, it is possible for the selected source and detector to be dedicated full time to biological property measurement.
• an exemplary control system for the fingerprint imaging device includes a control module 160 for providing signal timing for the array 120 of illumination sources 122 and for the array 140 of detectors 123.
• the control module addresses each relevant illumination source 122 via a multiplexer 161 to ensure that each illumination source fires for the appropriate on-time.
• Signals from each of the detectors 123 are sampled and passed to a signal processor 150 by way of demultiplexer 162.
• the signal processor 150 receives the detected signals. With knowledge of the firing timing of the illumination sources from the control module 160, the signal processor 150 is operative to determine the spatial fingerprint image 151 which may be output as a real time displayed image, hardcopy and or data file for further processing. The signal processor is also operative to perform suitable signal processing, e.g. by plethysmographic analysis, pulse oximetry analysis or Doppler blood perfusion analysis to determine whether the received data has been obtained from an animate object. For processing the detected signals using Doppler perfusion analysis, as described above, it is desirable that light enters a single specific optical fibre for a much longer time than the scan frequency of the other optical fibres.
• the Doppler perfusion sampling signal is of duration of approximately 2.5 ms, whereas the other sampled signals for fingerprint imaging have duration of approximately 0.025 ms each as scanned along the one dimensional array. This ensures that the total measurement time for the fingerprint is kept within reasonable limits to enables line scans as the finger moves across the array. For 100 line scans, the total measurement time can be limited to less than half a second, sufficient to capture the moving finger with sufficient spatial resolution.
• the preferred technique of figures 3 and 4 above uses electronically controlled scanning by way of separately switchable laser diodes in an array.
• Figure 5 illustrates an alternative scanning arrangement that requires only a single illumination source 231 to provide an effective 'virtual array' of illumination sources for each waveguide.
• a specially configured mirror 234, 235 rotates continuously at a frequency of, for example, 200 Hz and is illuminated by an input beam 232 from the illumination source 231.
• the mirror has a first surface 234 that is planar and a second surface 235 that is convex.
• Half of the time e.g. 5 ms
• light from the illumination source 231 is reflected from the planar side 234 as shown in figure 5(b).
• the reflected beam 236 is scanned in the direction indicated by arrow 233, thereby creating a scanning beam for scanning across the array of waveguides 110.
• the input beam 232 is reflected from the convex side 235 as shown in figure 5(c).
• the reflected beam 236 remains stationary and can be directed at the waveguide used for biological property measurement. In this way, sufficient time is provided for Doppler measurements, for example.
• this scanning illumination source provides a mechanical alternative to the separately switchable array of illumination sources.
• the waveguides 113 have a refractive index of n1 ; the target medium present at the detection surface 136 has a refractive index of n2.
• the target medium present at the detection surface 136 is skin of the finger 111 (n2 > n1) while in the example of figure 2(b) the target medium present at the detection surface 136 is air 106 (n2 ⁇ n1).
• this relies on a selection of waveguide material such that the refractive index of the waveguide material lies between that of skin (approximately 1.3 to 1.4), and that of air (1.0).
• a glass material is used for the waveguides, having a refractive index in the range 1.5 to 1.7.
• the oblique angle of the detection surface 136 relative to the optical axes of the ' waveguides 113 is selected such that when the target medium at the detection surface 136 is air 106 (figure 2(b)) with a refractive index of approximately 1.0, input light 100 undergoes total internal reflection resulting in a reflected beam as illustrated, internally scattered and returned down the optical waveguide to the first end or dissipated in the walls of the waveguide.
• the oblique angle is also selected such that if the target medium at the detection surface is skin (figure 2(a)), with a refractive index in the range 1.3 to 1.4, input light 101 is transmitted into the finger 111 where it is scattered as shown by paths 112 to detector elements 123 and not generally returned down the waveguides.
• the oblique angle is selected according to the relative refractive indices of the waveguide material, the skin, and air.
• the oblique angle of the detection surface relative to the optical axis is selected such that light propagating along the optical axis is reflected internally to the optical waveguide when no skin is in contact with the detection surface and such that light is transmitted through the reflection surface when skin is in contact with the detection surface.
• ⁇ crit sin-1(n1 / n2).
• n2 1.0
• nw the refractive index of the waveguide
• the angle of the detection surface relative to the optical axis is selected such that it lies in the range 1 ⁇ nw sin(a) ⁇ nf where a is the angle of the optical axis relative to the normal to the detection surface.
• nf the upper limit for a would be approximately 70°.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Optics & Photonics (AREA)
• Human Computer Interaction (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
• Length Measuring Devices By Optical Means (AREA)
• Image Input (AREA)

Priority Applications (2)

Applications Claiming Priority (2)

Publications (1)

Family

ID=33523537

Family Applications (1)

Country Status (4)

Cited By (2)

Families Citing this family (3)

Citations (3)

• 2004
  • 2004-11-11 GB GB0424889A patent/GB0424889D0/en not_active Ceased
• 2005
  • 2005-10-31 JP JP2007540760A patent/JP2008519633A/ja active Pending
  • 2005-10-31 EP EP05818860A patent/EP1815394A1/en not_active Withdrawn
  • 2005-10-31 WO PCT/IB2005/053551 patent/WO2006051440A1/en not_active Application Discontinuation

Patent Citations (3)

Also Published As

Similar Documents

Legal Events