JP2008109952A - Biological authentication apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a biological authentication apparatus which prevents forgery for realizing precise identification by easily focusing on fingerprint and a blood vessel pattern of veins by a simple constitution for imaging clearly. <P>SOLUTION: The biological authentication apparatus 100 has a transparent plate 110 formed of a glass or a plastic for placing an object OBJ being a finger of a person to be identified facing down in the figure (with a surface having the finger print facing down), an illuminator 120 for photographing the finger print, an illuminator 130 for photographing the veins, and an imaging device 140. The imaging device 140 is provided with an imaging lens apparatus 200 for imaging an object disperse image having passed through an optical system and a phase plate, an image processor 300 for generating a dispersion-free image signal from a dispersed image signal from the imaging element 220, and an irradiation wavelength detector 400 for generating irradiating wavelength information. The image processor 300 generates the dispersion-free image signal from the dispersed image signal based on the information generated by the irradiation wavelength detector 400. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a biometric authentication device, and more particularly to a biometric authentication device capable of fingerprint authentication, vein authentication, iris authentication, and the like.

  Conventionally, a method using a physical key or a password is known as a method for authenticating an individual. Recently, however, safety is regarded as a problem by methods such as picking and skimming. For this reason, in recent years, the use of methods for identifying individuals by biometric authentication has been rapidly increasing.

  The reason for the increase in biometric authentication is that fingerprints and veins remain unchanged throughout the life, and are suitable for authenticating individuals, and unlike keys and passwords, there is no worry of being lost, stolen or forgotten. It is.

  As an authentication method using a fingerprint, many methods such as the method disclosed in Patent Document 1 have been proposed.

  As a method corresponding to a copy or replica of a fingerprint, a method for determining whether or not the specimen is a living body when performing fingerprint authentication is disclosed in Patent Document 2 and the like.

  In addition, as an apparatus that employs a method of performing authentication using a blood vessel pattern such as a vein, image data of a plurality of fingers can be acquired with good reproducibility by, for example, gripping a handle-like data acquisition unit having a curvature. Personal authentication device or personal authentication device comprising a case for inserting a finger, a light source, an interference filter unit, an imaging unit for imaging transmitted light that has passed through the interference filter unit, and an image processing device for imaging data Has been proposed.

  Furthermore, an image that can be requested using a vein pattern and a fingerprint as an ID, including a personal authentication device that authenticates using two or more information of a fingerprint and a vein pattern, a vein pattern and fingerprint recognition unit, an operator recognition unit, etc. Forming devices, personal identification systems that improve the accuracy of identity verification by collating fingertip blood vessel patterns in addition to fingerprint collation, or personal identification devices that realize rapid and highly accurate personal identification with a smaller amount of data Proposed.

  Digital image data of an imaging device such as a digital camera is used for authentication and identification in these various devices.

In response to the digitization of information, which has been rapidly developing in recent years, the response in the video field is also remarkable.
In particular, as symbolized by a digital camera, a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensor, which is a solid-state image sensor, is used in most cases instead of a conventional film.

  As described above, an imaging lens device using a CCD or CMOS sensor as an imaging element is for taking an image of a subject optically by an optical system and extracting it as an electrical signal by the imaging element. In addition to a digital still camera, It is used for a video camera, a digital video unit, a personal computer, a mobile phone, a personal digital assistant (PDA) and the like.

FIG. 23 is a diagram schematically illustrating a configuration and a light flux state of a general imaging lens device.
The imaging lens device 1 includes an optical system 2 and an imaging element 3 such as a CCD or CMOS sensor. In the optical system, the object side lenses 21 and 22, the diaphragm 23, and the imaging lens 24 are sequentially arranged from the object side (OBJS) toward the image sensor 3 side. In the imaging lens device 1, as shown in FIG. 23, the best focus surface is matched with the imaging element surface. 24A to 24C show spot images on the light receiving surface of the imaging element 3 of the imaging lens device 1.

Further, an imaging apparatus has been proposed in which a light beam is regularly dispersed by a phase plate (Wavefront Coding optical element) and restored by digital processing to enable imaging with a deep depth of field (for example, non-patent literature). 1, 2, and patent documents 3 to 7).
JP-A-54-85600 JP 7-308308 A "Wavefront Coding; jointly optimized optical and digital imaging systems", Edward R. Dowski, Jr., Robert H. Cormack, Scott D. Sarama. "Wavefront Coding; A modern method of achieving high performance and / or low cost imaging systems", Edward R. Dowski, Jr., Gregory E. Johnson. USP 6,021,005 USP 6,642,504 USP 6,525,302 USP 6,069,738 JP 2003-235794 A

  By the way, in the fingerprint authentication described in Patent Document 1, there is a disadvantage that it is easily authenticated by a third party by using a fingerprint copy (duplication) or a finger replica that generates a copied fingerprint. On the other hand, there is also a disadvantage that it is difficult to authenticate if there are dirt or scratches on the fingerprint.

In addition, when authentication is performed using a blood vessel pattern such as a vein, unlike a fingerprint, it is difficult to forge, but there is a disadvantage that authentication is not performed when the temperature of the specimen changes or a serious injury occurs.
As an example of this correspondence, as described above, an authentication method using two or more pieces of information of a fingerprint and a vein pattern has been proposed. However, since a blood vessel pattern such as a fingerprint and a vein is not on the same plane, When one imaging system is used, focus movement is required, but no details have been proposed.
Therefore, in the conventional apparatus, one of the images is not in focus, and it is difficult to realize highly accurate authentication.
Further, it is possible to adjust the focus by moving the focus, but this leads to an increase in the size and cost of the apparatus, and also from the viewpoint of durability.

Further, in the imaging devices proposed in the above-mentioned documents, all of them are based on the premise that the PSF (Point-Spread-Function) when the above-described phase plate is inserted into a normal optical system is constant. Yes, when the PSF changes, it is extremely difficult to realize an image having a deep depth of field by convolution using a subsequent kernel.
Therefore, even with a single focal point lens, a regular (non-changing) PSF cannot be realized with a normal optical system in which the spot image changes depending on the object distance. Due to the high accuracy of the design and the associated cost increase, there are significant challenges to adopt.

  An object of the present invention is to provide a biometric authentication apparatus that can easily focus on a blood vessel pattern such as a fingerprint and a vein with a simple configuration, can capture a clear image, prevent forgery, and realize high-accuracy authentication. It is to provide.

In order to achieve the above object, a first aspect of the present invention is a biometric authentication device including an imaging device that reads a predetermined pattern of a fingerprint and a predetermined part of a subject, the imaging device including an optical system and a light wavefront A modulation element; an imaging element that captures a subject dispersion image that has passed through the optical system and the light wavefront modulation element; and a conversion unit that generates a non-dispersion image signal from a dispersion image signal from the imaging element; and at least two or more Irradiating means for irradiating the fingerprint or a predetermined part of the subject with a wavelength, and the converting means outputs an image signal that is less dispersed than the dispersed image signal based on wavelength information irradiated by the irradiating means. Generate.

  Preferably, the imaging apparatus includes conversion coefficient storage means that stores in advance at least two conversion coefficients corresponding to dispersion caused by the light wavefront modulation element in accordance with the irradiating wavelength, and the conversion means. Selects the conversion coefficient according to the irradiated wavelength, converts the image signal, and generates an image signal without dispersion.

  Preferably, the imaging apparatus includes conversion coefficient calculation means for calculating a conversion coefficient according to the irradiated wavelength, and the conversion means uses the conversion coefficient obtained from the conversion coefficient calculation means to generate an image signal. To generate an image signal without dispersion.

  Preferably, the conversion coefficient calculation means includes a kernel size of the subject dispersion image as a variable.

  More preferably, the conversion means performs a convolution operation based on the conversion coefficient.

  According to a second aspect of the present invention, there is provided a biometric authentication device including an imaging device that reads a fingerprint and a predetermined pattern of a predetermined portion of a subject, the imaging device including an optical system, a light wavefront modulation element, An image pickup device that picks up a subject dispersion image that has passed through an optical system and a light wavefront modulation device; a conversion unit that generates an image signal having no dispersion from a dispersion image signal from the image pickup device; and the fingerprint or Irradiating means for irradiating a predetermined part of a subject, and having a plurality of the light wavefront modulation elements, and each of the light wavefront modulation elements based on the wavelength information irradiated by the irradiation means. Selection switching means for inserting into and retracting from the optical path.

According to the present invention, it is possible to easily focus a blood vessel pattern such as a fingerprint and a vein with a simple configuration, to capture a clear image, to prevent forgery, and to realize high-accuracy authentication.
In addition, there is an advantage that the lens can be designed without worrying about the object distance and the defocus range, and the image can be restored by calculation such as convolution with high accuracy.
Further, according to the present invention, the optical system can be simplified and the cost can be reduced.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
FIG. 1 is a diagram schematically illustrating a configuration example of a biometric authentication apparatus according to an embodiment of the present invention. 2 is a diagram schematically showing a fingerprint authentication operation in the biometric authentication device of FIG. 1, and FIG. 3 is a diagram schematically showing a vein authentication operation in the biometric authentication device of FIG.

  As shown in FIG. 1, the biometric authentication device 100 is made of, for example, glass or plastic for placing the subject OBJ, which is the finger of the person to be authenticated, facing down in the figure (the surface on the fingerprint is facing down). A plate 110, a fingerprint photographing illumination device 120, a vein photographing illumination device 130, and an imaging device 140 are included as main components.

  In the biometric authentication device 100, as shown in FIGS. 1 and 2, an imaging device 140 is disposed on the surface (surface with a hand fingerprint) of the subject OBJ, and illumination is performed for the purpose of assisting fingerprint imaging on the same side. A device 120 is arranged.

  As shown in FIGS. 1 and 3, an illuminating device 130 is disposed on the back surface (the surface with the fingernail) of the subject OBJ for the purpose of assisting vein imaging.

  Although not described in detail here as the illumination device, the illumination device for fingerprint imaging 120 is a light source (for example, an ultraviolet wavelength light source) having a wavelength suitable for making visible light or a fingerprint more prominent. It is desirable to use a light source (for example, an infrared wavelength light source) suitable for raising a blood vessel while passing through the skin. In this embodiment, a description will be given of a configuration in which irradiation is possible with two wavelengths by selecting one of two lighting devices having different wavelengths. However, irradiation is performed with one lighting device that can irradiate two wavelengths. You may do it. Further, the wavelength is not limited to two, and three or more wavelengths may be used.

  As will be described in detail later, the imaging device 140 includes a depth-of-field expansion optical system having an optical wavefront modulation element and an image processing unit, and is configured to output a restored image.

  The imaging device 140 includes a storage unit that temporarily stores image data, a data conversion unit that compares and collates image data, a storage unit that stores other registered data, a processing unit that performs comparison and collation, and a comparison An instruction unit that issues an instruction according to the result of the collation is included.

  Here, the case where the device is shown alone is described as an example, but a network-compatible configuration using a dedicated line, the Internet, or the like is also possible. In this case, the system configuration includes a server or the like whose registration data is a network host.

By adopting the imaging device 140 including the depth-of-field extending optical system having the light wavefront modulation element and the image processing unit as in the present embodiment, the following features can be obtained.
In a normal optical system, it is necessary to reduce the aperture, that is, to darken the depth of field. On the other hand, in the “depth-expanding optical system” of this embodiment, which will be described in detail later, it is not necessary to reduce the aperture, so that the required amount of light is less than that of a normal optical system. Therefore, the light quantity of the lighting device can be reduced.
In other words, the cost of the lighting device can be reduced and the power consumption can be reduced. As a result, the durability of the lighting device can be improved.

  On the other hand, since the focused image can be obtained even if the subject is not located at a fixed point, it is necessary to determine a certain range, but authentication can be performed without touching the apparatus.

  Further, in the biometric authentication device 100 of the present embodiment, the priority order of a plurality of authentication results can be switched according to the situation.

As a method for switching the priority of authentication verification, it is possible to employ, for example, a method in which captured data and registered data are verified and the priority is switched based on the verification result. As another method, a method of selecting when the user (subject) performs authentication can be employed.
In this embodiment, for example, vein authentication is given priority in the case where the accuracy of authentication is lowered due to, for example, an injured or dirty fingerprint.
Conversely, when the temperature of the subject is changing greatly, for example, when the blood flow is worse when it is cold, or when the authentication accuracy drops due to a major injury, etc., priority is given to fingerprint authentication. It is possible to adopt a method.
Here, switching the priority order means adjusting the weight in advance for each authentication, and is different from adopting only one authentication result.
As a result, the authentication rate can be improved from one authentication, and high-accuracy authentication can be performed without lowering the authentication rate due to a plurality of authentications.

Hereinafter, the imaging device 140 including the depth-of-field extending optical system having the light wavefront modulation element and the image processing unit will be described in detail.
FIG. 4 is a block configuration diagram illustrating the imaging apparatus according to the present embodiment.
The imaging device 140 according to the present embodiment includes an imaging lens device 200 having a zoom optical system, an image processing device 300, and an irradiation wavelength detection device 400 as main components.

  The imaging lens device 200 optically captures an image of an imaging target object (subject) OBJ, and an image captured by the zoom optical system 210 is formed. The image sensor 220 includes a CCD or a CMOS sensor that is output to the image processing apparatus 300 as the next image signal FIM. In FIG. 4, the imaging element 220 is described as a CCD as an example.

FIG. 5 is a diagram schematically illustrating a configuration example of the optical system of the zoom optical system 210 according to the present embodiment.
The zoom optical system 210 in FIG. 5 is disposed between an object side lens 211 disposed on the object side OBJS, an image forming lens 212 for forming an image on the image sensor 220, and between the object side lens 211 and the image forming lens 212. An optical wavefront modulation element (wavefront forming optical element: Wavefront) made of, for example, a phase plate (Cubic Phase Plate) having a three-dimensional curved surface, which deforms the wavefront of the image formation on the light receiving surface of the imaging element 220 by the imaging lens 212. A Coding Optical Element) group 213; A stop (not shown) is disposed between the object side lens 211 and the imaging lens 212.

  In the present embodiment, the case where the phase plate is used has been described. However, the optical wavefront modulation element of the present invention may be any element that deforms the wavefront, and an optical element whose thickness changes. (For example, the above-described third-order phase plate), an optical element whose refractive index changes (for example, a gradient index wavefront modulation lens), an optical element whose thickness and refractive index change by coding on the lens surface (for example, wavefront modulation) A light wavefront modulation element such as a hybrid lens) or a liquid crystal element capable of modulating the phase distribution of light (for example, a liquid crystal spatial phase modulation element) may be used.

  The zoom optical system 210 in FIG. 5 is an example in which an optical phase plate 213a is inserted into a 3 × zoom used in a digital camera.

The phase plate 213a shown in the figure is an optical lens that regularly splits the light beam converged by the optical system. By inserting this phase plate, an image that does not fit anywhere on the image sensor 220 is realized.
In other words, the phase plate 213a forms a deep light beam (which plays a central role in image formation) and a flare (blurred portion).
Means for restoring the regularly dispersed image to a focused image by digital processing is called a wavefront aberration control optical system, and this processing is performed in the image processing apparatus 300.

FIG. 6 is a diagram illustrating a spot image on the infinite side of the zoom optical system 210 that does not include a phase plate.
FIG. 7 is a diagram showing a spot image on the near side of the zoom optical system 210 that does not include a phase plate. FIG. 8 is a diagram showing a spot image on the infinite side of the zoom optical system 210 including the phase plate. FIG. 9 is a diagram showing a spot image on the near side of the zoom optical system 210 including the phase plate.

Basically, as shown in FIGS. 6 and 7, the spot image of the light passing through the optical lens system not including the phase plate is different depending on whether the object distance is on the close side or on the infinite side. A spot image is shown.
As described above, in an optical system having spot images different in object distance, the H function described later is different.
Naturally, as shown in FIGS. 8 and 9, the spot image passing through the phase plate affected by the spot image also becomes a different spot image on the near side and the infinite side.

In such an optical system having different spot images at the object position, the conventional apparatus cannot perform an appropriate convolution operation, and astigmatism, coma aberration, spherical aberration, etc. that cause this spot image shift. An optical design that eliminates each aberration is required. However, the optical design that eliminates these aberrations increases the difficulty of optical design, causing problems such as an increase in design man-hours, an increase in cost, and an increase in the size of the lens.
Therefore, in the present embodiment, as shown in FIG. 4, when the imaging device (camera) 140 enters a photographing state, the type of the illumination device currently irradiated is read from the irradiation wavelength detection device 400 and image processing is performed. Supply to device 300. The “irradiating wavelength information” of the present invention includes the type of the illumination device, and the irradiation wavelength detecting device 400 irradiates either the fingerprint irradiation device 120 or the finger vein irradiation device 130. What is necessary is just to detect whether it is doing.

  The image processing device 300 generates an image signal having no dispersion from the dispersion image signal from the image sensor 220 based on the irradiated wavelength information read from the irradiation wavelength detection device 400.

  In the present embodiment, as described above, dispersion means that, by inserting the phase plate 213a, an image that does not fit anywhere on the image sensor 220 is formed, and the phase plate 213a has a deep light flux ( It plays a central role in image formation) and a phenomenon of forming flare (blurred portion), and includes the same meaning as aberration because of the behavior of the image being dispersed to form a blurred portion. Therefore, in this embodiment, it may be described as aberration.

FIG. 10 is a block diagram illustrating a configuration example of the image processing apparatus 300 that generates an image signal having no dispersion from the dispersion image signal from the image sensor 220.
As illustrated in FIG. 10, the image processing apparatus 300 includes a convolution apparatus 301, a kernel / numerical arithmetic coefficient storage register 302, and an image processing arithmetic processor 303.

In this image processing apparatus 300, the image processing arithmetic processor 303 that has obtained the irradiated wavelength information read from the irradiation wavelength detecting apparatus 400 uses the kernel size or the like used in an appropriate calculation for the irradiated wavelength. The calculation coefficient is stored in the kernel and numerical calculation coefficient storage register 302, and an appropriate calculation is performed by the convolution device 301 that calculates using the value to restore the image.

  In the biometric authentication device, the accuracy of authentication can be improved by changing the wavelength of light depending on the authentication object. For example, as described above, it is conceivable that authentication is advantageous by using infrared rays, that is, long-wavelength light for vein authentication, and using ultraviolet rays, that is, light having a short wavelength, for fingerprint authentication.

  Usually, the focal length shifts depending on the wavelength of light. This focal shift can be relaxed or corrected by a combination of optical elements. However, it is conceivable that the possibility of occurrence of material problems and configurations (arrangement and number of sheets) of optical elements, manufacturing problems, and the like increases, which affects productivity and cost. Therefore, the present invention is characterized in that the conversion coefficient corresponding to the dispersion caused by the light wavefront modulation element can be varied, or the light wavefront modulation element itself can be varied to perform conversion in consideration of the focal shift. . Thereby, authentication accuracy can be improved.

Here, the basic principle of the wavefront aberration control optical system will be described.
As shown in FIG. 11, the image f of the subject enters the wavefront aberration control optical system optical system H, thereby generating a g image.
This can be expressed by the following equation. Note that * represents convolution.

In order to obtain a subject from the generated image, the following processing is required.

Here, the kernel size and calculation coefficient regarding the function H will be described.
The H function of each wavelength information is defined as Hn, Hn−1,.
Since each spot is different, each H function is as follows.

  The difference in the number of rows and / or the number of columns of this matrix is the Carney size, and each number is the calculation coefficient.

As described above, in the case of an imaging device including a phase plate (Wavefront Coding optical element) as an optical wavefront modulation element, an image signal without proper aberrations by image processing within the predetermined focal length range However, if it is outside the predetermined focal length range, there is a limit to the correction of the image processing, so that only an object outside the above range has an image signal with aberration.
On the other hand, by performing image processing in which no aberration occurs within a predetermined narrow range, it is possible to bring out a blur to an image outside the predetermined narrow range.

  The image processing is performed by convolution calculation. To realize this, for example, one type of convolution calculation coefficient is stored in common, and a correction coefficient is stored in advance according to the irradiation wavelength, The correction coefficient is used to correct the calculation coefficient, and an appropriate convolution calculation can be performed using the corrected calculation coefficient.

In addition to this configuration, the following configuration can be employed.
The kernel size and the convolution calculation coefficient itself are stored in advance according to the irradiation wavelength, the convolution calculation is performed using the stored kernel size and the calculation coefficient, and the calculation coefficient according to the irradiation wavelength is stored in advance as a function. In addition, it is possible to employ a configuration in which a calculation coefficient is obtained from this function according to the irradiation wavelength and a convolution calculation is performed using the calculated calculation coefficient.

Corresponding to the configuration of FIG. 10, the following configuration can be taken.
At least two or more conversion coefficients corresponding to the aberration caused by the phase plate 213a are stored in advance according to the wavelength applied to the register 302 as the conversion coefficient storage means. The image processing arithmetic processor 303 functions as a coefficient selection unit that selects a conversion coefficient corresponding to the irradiated wavelength based on the irradiated wavelength information generated by the irradiated wavelength detection device 400.
Then, a convolution device 301 as a conversion unit converts an image signal using the conversion coefficient selected by the image processing arithmetic processor 303 as a coefficient selection unit.

Alternatively, as described above, the image processing arithmetic processor 303 serving as a conversion coefficient calculator calculates a conversion coefficient based on the irradiated wavelength information generated by the irradiation wavelength detector 400 and stores the conversion coefficient in the register 302. Then, a convolution device 301 as a conversion unit converts an image signal using a conversion coefficient obtained by an image processing calculation processor 303 as a conversion coefficient calculation unit and stored in the register 302.

Next, specific processing when the image processing arithmetic processor 303 functions as a conversion coefficient arithmetic means will be described.
In the irradiation wavelength detection device 400, the irradiation wavelength is detected, and detection information is supplied to the image processing arithmetic processor 303. In the image processing arithmetic processor 303, it is determined whether or not the irradiation wavelength is n. If it is determined that the irradiation wavelength is n, the kernel size and calculation coefficient of n are obtained and stored in the register. If it is determined that the irradiating wavelength is not n, it is determined whether or not the irradiating wavelength is n-1. If it is determined that the irradiating wavelength is n-1, the kernel size and operation coefficient of n-1 are obtained and stored in the register. In the image processing arithmetic processor 303, the set value is transferred to the kernel and numerical arithmetic coefficient storage register 302. Then, a convolution operation is performed on the image data captured by the imaging lens device 200 and input to the convolution device 301 based on the data stored in the register 302, and the calculated and converted data S302 is an image. Transferred to the processing arithmetic processor 303.

  In the present embodiment, a wavefront aberration control optical system can be adopted to obtain a high-definition image quality, and the optical system can be simplified and the cost can be reduced.

Hereinafter, this feature will be described.
12A to 12C show spot images on the light receiving surface of the imaging element 220 of the imaging lens device 200. FIG. 12A shows a case where the focal point is shifted by 0.2 mm (Defocus = 0.2 mm), FIG. 12B shows a case where the focal point is a focal point (Best focus), and FIG. 12C shows a case where the focal point is shifted by −0.2 mm. Each spot image in the case of the case (Defocus = −0.2 mm) is shown.
As can be seen from FIGS. 12A to 12C, in the imaging lens device 200 according to the present embodiment, a light beam having a deep depth (a central role in image formation) is obtained by the wavefront forming optical element 213 including the phase plate 213a. And flare (blurred part) are formed.
As described above, the primary image FIM formed in the imaging lens device 200 of the present embodiment has a light beam condition with a very deep depth.

FIGS. 13A and 13B are diagrams for explaining a modulation transfer function (MTF) of a primary image formed by the imaging lens device according to the present embodiment. FIG. 13A is a diagram showing a spot image on the light receiving surface of the imaging element of the imaging lens device, and FIG. 13B shows the MTF characteristics with respect to the spatial frequency.
In the present embodiment, the high-definition final image is left to the correction processing of the image processing apparatus 300 including a digital signal processor (Digital Signal Processor), for example, as shown in FIGS. 13A and 13B. The MTF of the primary image is essentially a low value.

  The image processing apparatus 300 is configured by a DSP, for example, and receives a primary image FIM from the imaging lens apparatus 200 as described above, and performs a predetermined correction process or the like for raising the MTF at the spatial frequency of the primary image. A fine final image FNLIM is formed.

The MTF correction processing of the image processing apparatus 300 is performed after edge enhancement, chroma enhancement, etc., using the MTF of the primary image, which is essentially a low value, as shown by a curve A in FIG. In the process, correction is performed so as to approach (reach) the characteristics indicated by the curve B in FIG.
A characteristic indicated by a curve B in FIG. 14 is a characteristic obtained when the wavefront is not deformed without using the wavefront forming optical element as in the present embodiment.
It should be noted that all corrections in the present embodiment are based on spatial frequency parameters.

In the present embodiment, as shown in FIG. 14, in order to achieve the MTF characteristic curve B to be finally realized with respect to the MTF characteristic curve A with respect to the optically obtained spatial frequency, each spatial frequency is changed to each spatial frequency. On the other hand, the original image (primary image) is corrected by applying strength such as edge enhancement.
For example, in the case of the MTF characteristic of FIG. 14, the curve of edge enhancement with respect to the spatial frequency is as shown in FIG.
That is, a desired MTF characteristic curve B is virtually realized by performing correction by weakening edge enhancement on the low frequency side and high frequency side within a predetermined spatial frequency band and strengthening edge enhancement in the intermediate frequency region. To do.

As described above, the imaging apparatus 140 according to the embodiment includes the imaging lens apparatus 200 including the optical system 210 that forms the primary image, and the image processing apparatus 300 that forms the primary image into a high-definition final image. In the system system, the wavefront of the imaging is deformed by providing a new optical element for wavefront shaping, or by providing an optical element such as glass or plastic that has been molded for wavefront shaping. In this image forming system, such a wavefront is imaged on an imaging surface (light receiving surface) of an imaging element 220 including a CCD or a CMOS sensor, and the primary image is obtained through the image processing apparatus 300 to obtain a high-definition image. .
In the present embodiment, the primary image obtained by the imaging lens device 200 has a light beam condition with a very deep depth. Therefore, the MTF of the primary image is essentially a low value, and the image processing apparatus 300 corrects the MTF.

Here, the imaging process in the imaging lens apparatus 200 in the present embodiment will be considered in terms of wave optics.
A spherical wave diverging from one of the object points becomes a convergent wave after passing through the imaging optical system. At that time, aberration occurs if the imaging optical system is not an ideal optical system. The wavefront is not a spherical surface but a complicated shape. Wavefront optics lies between geometric optics and wave optics, which is convenient when dealing with wavefront phenomena.
When dealing with the wave optical MTF on the imaging plane, the wavefront information at the exit pupil position of the imaging optical system is important.
The MTF is calculated by Fourier transform of the wave optical intensity distribution at the imaging point. The wave optical intensity distribution is obtained by squaring the wave optical amplitude distribution, and the wave optical amplitude distribution is obtained from the Fourier transform of the pupil function in the exit pupil.
Further, since the pupil function is exactly from the wavefront information (wavefront aberration) at the exit pupil position, if the wavefront aberration can be strictly calculated numerically through the optical system 210, the MTF can be calculated.

  Accordingly, if the wavefront information at the exit pupil position is modified by a predetermined method, the MTF value on the imaging plane can be arbitrarily changed.

In this embodiment, the wavefront shape is mainly changed by the wavefront forming optical element, but the target wavefront is formed by increasing or decreasing the phase (phase, optical path length along the light beam). .
Then, if the desired wavefront is formed, the exiting light flux from the exit pupil is made up of dense and sparse portions of the light, as can be seen from the geometric optical spot images shown in FIGS. It is formed.
The MTF in the luminous flux state shows a low value at a low spatial frequency and a characteristic that the resolving power is managed up to a high spatial frequency.
That is, if this MTF value is low (or such a spot image state in terms of geometrical optics), the phenomenon of aliasing will not occur.
That is, a low-pass filter is not necessary.
Then, the flare-like image that causes the MTF value to be lowered may be removed by the image processing apparatus 300 including a DSP or the like at the subsequent stage. Thereby, the MTF value is significantly improved.

Next, the response of the MTF of this embodiment and the conventional optical system will be considered.
FIG. 16 is a diagram showing the MTF response when the object is at the focal position and when the object is out of the focal position in the case of the conventional optical system.
FIG. 17 is a diagram showing the response of the MTF when the object is at the focal position and when the object is out of the focal position in the optical system of the present embodiment having the light wavefront modulation element.
FIG. 18 is a diagram illustrating a response of the MTF after data restoration of the imaging apparatus according to the present embodiment.

As can be seen from the figure, in the case of an optical system having a light wavefront modulation element, even when the object deviates from the focal position, the change in the MTF response is smaller than the optical diameter in which the light wavefront modulation element is not inserted.
The response of the MTF is improved by processing the image formed by this optical system using a convolution filter.

As described above, according to the present embodiment, the imaging lens device 200 that captures a subject dispersion image that has passed through the optical system and the phase plate (light wavefront modulation element), and the dispersion image signal from the dispersion image signal from the imaging element 200. An image processing device 300 that generates no image signal, and an irradiation wavelength detection device 400 that generates irradiation wavelength information. The image processing device 300 performs irradiation generated by the irradiation wavelength detection device 400. Since an image signal that is less dispersed than a dispersed image signal is generated based on wavelength information, the kernel size used in the convolution calculation and the coefficient used in the numerical calculation are made variable to detect the irradiation wavelength, and the wavelength By adapting the kernel size and the above-mentioned coefficients corresponding to the lens, the lens can be designed without worrying about the wavelength to be used. One accurate convolutional - there is an advantage that the image restoration becomes possible by Deployment.
The imaging apparatus 100 according to the present embodiment can be used for a zoom lens wavefront aberration control optical system in consideration of the small size, light weight, and cost of consumer devices such as digital cameras and camcorders.

In the present embodiment, the imaging lens device 200 having a wavefront forming optical element that deforms the wavefront of the imaging on the light receiving surface of the imaging device 220 by the imaging lens 212, and the primary image FIM by the imaging lens device 200. Therefore, the image processing apparatus 300 that performs a predetermined correction process for raising the MTF at the spatial frequency of the primary image to form a high-definition final image FNLIM is provided, so that high-definition image quality can be obtained. There is an advantage that it becomes possible.
In addition, the configuration of the optical system 210 of the imaging lens device 200 can be simplified, manufacturing becomes easy, and cost can be reduced.

By the way, when a CCD or CMOS sensor is used as an image sensor, there is a resolution limit determined by the pixel pitch, and if the resolution of the optical system exceeds the limit resolution, a phenomenon such as aliasing occurs, which adversely affects the final image. It is a well-known fact that
In order to improve image quality, it is desirable to increase the contrast as much as possible, but this requires a high-performance lens system.
However, as described above, aliasing occurs when a CCD or CMOS sensor is used as an image sensor.
Currently, in order to avoid the occurrence of aliasing, the imaging lens apparatus uses a low-pass filter made of a uniaxial crystal system to avoid the occurrence of aliasing.
The use of a low-pass filter in this way is correct in principle, but the low-pass filter itself is made of crystal, so it is expensive and difficult to manage. Moreover, there is a disadvantage that the use of the optical system makes the optical system more complicated.

As described above, in order to form a high-definition image, the optical system must be complicated in the conventional imaging lens apparatus in spite of the demand for higher-definition image due to the trend of the times. . If it is complicated, manufacturing becomes difficult, and if an expensive low-pass filter is used, the cost increases.
However, according to the present embodiment, the occurrence of aliasing can be avoided without using a low-pass filter, and high-definition image quality can be obtained.

In the present embodiment, the example in which the wavefront forming optical element of the optical system 210 is disposed closer to the object side lens than the stop has been described. The effect of this can be obtained.
In addition, the lenses constituting the optical system 210 are not limited to the example of FIG. 5, and various aspects of the present invention are possible.

Next, the operation of the biometric authentication apparatus of this embodiment will be described in association with the flowchart of FIG.
When the control system inputs an authentication start signal (ST101), the illumination device 120 for fingerprint photographing is turned on (ST102).
Then, as a first time, the imaging device 140 captures a fingerprint (ST103).

The imaging device 140 performs image processing in the image processing device 300 including the wavefront aberration control optical system (ST104), and stores shooting data (ST105).
Next, the illumination device for fingerprint imaging 120 is turned off, and the illumination device for vein imaging 130 is turned on (ST106).
Then, as a second time, the imaging device 140 captures a vein (ST107).
The imaging device 140 performs image processing in the image processing device 300 or the like including the wavefront aberration control optical system (ST108), and stores shooting data (ST109).
Then, collation based on the stored fingerprint data and vein data is performed (ST110).

  As described above, the biometric authentication device 100 of the present embodiment is formed of, for example, glass or plastic for placing the subject OBJ, which is the finger of the person to be authenticated, facing downward in the figure (the surface on the fingerprint is facing downward). A transparent plate 110, a fingerprint photographing illumination device 120, a vein photographing illumination device 130, and an imaging device 140 are included as main components. The imaging device 140 includes a depth-of-field expansion optical system having a light wavefront modulation element and Since the image processing unit is provided, the following effects can be obtained.

  That is, it is possible to realize a biometric authentication apparatus that can easily focus on a blood vessel pattern such as a fingerprint and a vein with a simple configuration, can capture a clear image, prevent forgery, and realize high-accuracy authentication. it can.

More specifically, as in a normal optical system, in order to obtain the depth of field, it is not necessary to reduce the aperture, that is, to darken, and it is not necessary to reduce the aperture. Compared to this, the required amount of light is reduced. Thereby, the light quantity of an illuminating device can be reduced.
Therefore, the cost of the lighting device can be reduced and the power consumption can be reduced. As a result, the durability of the lighting device can be improved.

  On the other hand, since the focused image can be obtained even if the subject is not located at a fixed point, it is necessary to determine a certain range, but authentication can be performed without touching the apparatus.

  Further, in the biometric authentication device 100 of the present embodiment, the priority order of a plurality of authentication results can be switched according to the situation, and the authentication rate can be improved more than one authentication. High-accuracy authentication is possible without lowering.

  In the present embodiment, authentication using a fingerprint and a vein pattern has been described. However, the present invention can also be applied to combinations such as other irises and fundus.

  Next, an embodiment of the second invention of the present invention will be described. The first invention is characterized in that the conversion by the conversion means is varied according to the wavelength of irradiation, whereas the second invention is provided with a plurality of light wavefront modulation elements for irradiation. The light wavefront modulation element is varied according to the wavelength. By adopting such a configuration, the same effect as described above can be obtained.

  FIG. 20 is a block diagram showing an image pickup apparatus according to the second embodiment of the present invention. In the following embodiments, only the change of the light wavefront modulation element will be described, but it is natural that both may be changed in combination with the first invention.

The imaging device 140 includes any one of an imaging lens device 200, an irradiation wavelength detection device 400 that supplies irradiating wavelength information, and a plurality of light wavefront modulation elements provided in the optical system 210 according to the irradiating wavelength information. A selection switching unit 410 to be selected and an image processing device (signal processing unit) 500 are included as main components.
The imaging lens device 200 optically captures an image of an imaging target object (subject) OBJ, and an image captured by the optical system 210 is formed. The image sensor 220 includes a CCD or a CMOS sensor which is output to the image processing apparatus 300 as the signal FIM. In FIG. 20, the image sensor 220 is described as a CCD as an example.

  The selection switching unit 410 is formed integrally with, for example, a plurality of phase plates as light wavefront modulation elements, and each of the plurality of phase plates according to the irradiated wavelength information generated by the irradiation wavelength detection device 400. Are selectively inserted into or retracted from the optical path of the optical system 210.

  21 and 22 are diagrams illustrating a configuration example of the selection switching unit 410 of the present embodiment. The selection switching unit 410A in FIG. 21 has a plurality of (3 or 4 in this example) phase plates 213a-1 to 213a-4 having different modulation characteristics in a locus concentrically with a rotationally movable component 401 having a rotation center. The desired phase plate 213a is arranged in accordance with the wavelength information generated by the irradiation wavelength detection device 400 by engaging with the gear 402 attached to the edge of the component 401 and the rotating shaft of the motor 402. −1 (˜−4) is inserted (positioned) in the optical path including the optical axis center AX or retracted. This realizes optical wavefront modulation according to the wavelength information being irradiated.

  The selection switching unit 410B in FIG. 22 has a plurality of (1 or 2 in this example) phase plates 213a-1 and 213a-2 with different modulation characteristics arranged in parallel in a direction perpendicular to the optical axis center on the plate-like component 404. The wavelength information generated by the irradiation wavelength detecting device 400 is arranged along a concentric circle and meshed with one edge of the component 404 and a gear 406 attached to the rotation shaft of the motor 405. Accordingly, the desired phase plate 213a-1 (, -2) is inserted (positioned) in the optical path including the optical axis center AX or retracted. Thereby, the optical wavefront modulation is realized according to the wavelength information being irradiated.

In the examples of FIGS. 21 and 22, the phase plate is arranged at all the arrangement positions of the phase plates of the components 401 and 404. For example, a portion where no phase plate is arranged is provided, and the light wavefront modulation is performed according to the information. It is also possible to make it enter into the image pick-up element 220, without giving.
When such a configuration is adopted, for example, when the shooting information is information related to the shooting mode, and the macro (proximity) mode, for example, the phase plate is inserted (positioned) in the optical path, and the image is slightly blurred. In this case, a mode in which a portion where the phase plate is not arranged is inserted (positioned) in the optical path is possible.
That is, it is possible to obtain a blurred image like a conventional optical system while using a depth expanding optical system for the purpose of obtaining a focused image by an optical wavefront modulation element and image processing.

It is also possible to simply insert or retract an optical wavefront modulation element such as a phase plate in the optical path so that the optical wavefront modulation element is not disposed in the optical path or the optical wavefront modulation processing is not performed.
Further, the light wavefront modulation element of one phase plate can be fixed on the optical path, and the light wavefront modulation element such as another phase plate can be inserted into or retracted from the optical path.

It is a figure which shows typically the structural example of the biometrics apparatus which concerns on embodiment of this invention. It is a figure which shows typically the fingerprint authentication operation | movement in the biometrics apparatus of FIG. It is a figure which shows typically the vein authentication operation | movement in the biometrics apparatus of FIG. It is a block block diagram which shows the imaging device which concerns on this embodiment. It is a figure which shows typically the structural example of the zoom optical system of the imaging lens apparatus which concerns on this embodiment. It is a figure which shows the spot image of the infinite side of the zoom optical system which does not include a phase plate. It is a figure which shows the near spot image of the zoom optical system which does not include a phase plate. It is a figure which shows the spot image of the infinite side of the zoom optical system containing a phase plate. It is a figure which shows the spot image of the near side of the zoom optical system containing a phase plate. It is a block diagram which shows the specific structural example of the image processing apparatus of this embodiment. It is a figure for demonstrating the principle of a wavefront aberration control optical system system. It is a figure which shows the spot image in the light-receiving surface of the image pick-up element of the image pick-up lens apparatus which concerns on this embodiment, Comprising: (A) is a case where a focus shifts by 0.2 mm (Defocus = 0.2 mm), (B) is a result. It is a figure which shows each spot image in the case of a focus (Best focus), and the case where (C) shifts | focuses a focus by -0.2mm (Defocus = -0.2mm). It is a figure for demonstrating MTF of the primary image formed with the imaging lens apparatus which concerns on this embodiment, Comprising: (A) is a figure which shows the spot image in the light-receiving surface of the image pick-up element of an imaging lens apparatus, ( B) shows the MTF characteristic with respect to the spatial frequency. It is a figure for demonstrating the MTF correction process in the image processing apparatus which concerns on this embodiment. It is a figure for demonstrating concretely the MTF correction process in the image processing apparatus which concerns on this embodiment. It is a figure which shows the response (response) of MTF when an object exists in a focus position in the case of the conventional optical system, and when it remove | deviated from the focus position. It is a figure which shows the response of MTF when an object exists in a focus position in the case of the optical system of this embodiment which has a light wavefront modulation element, and remove | deviates from a focus position. It is a figure which shows the response of MTF after the data restoration of the imaging device which concerns on this embodiment. It is a flowchart for demonstrating operation | movement of the biometrics apparatus of this embodiment. It is a block block diagram which shows the imaging device which concerns on the 2nd Embodiment of this invention. It is a figure which shows the 1st structural example of the selection switching part of this embodiment. It is a figure which shows the 2nd structural example of the selection switching part of this embodiment. It is a figure which shows typically the structure and light beam state of a general imaging lens apparatus. FIG. 24A is a diagram showing a spot image on the light receiving surface of the imaging element of the imaging lens device of FIG. 23, where FIG. 23A shows a case where the focal point is shifted by 0.2 mm (Defocus = 0.2 mm), and FIG. It is a figure which shows each spot image in case (Best focus) and (C) when a focus shift | offset | differs -0.2 mm (Defocus = -0.2 mm).

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Biometric authentication apparatus 110 ... Transparent board | substrate 120 ... Illumination apparatus 130 for fingerprint imaging | photography ... Illumination apparatus 140 for vein imaging | photography ... Imaging apparatus 200 ... Imaging lens apparatus 211 ... Object side lens 212 ... Imaging lens 213 ... Optical element 213a for wavefront formation ... Phase plate 300 ... Image processing device 301 ... Convolution device 302 ... Kernel, numerical operation coefficient storage register 303 ... Image processing operation processor 400 ... Irradiation wavelength detection device

Claims (6)

A biometric authentication device including an imaging device that reads a predetermined pattern of a fingerprint and a predetermined portion of a subject,
The imaging apparatus includes an optical system and an optical wavefront modulation element, an imaging element that captures a subject dispersion image that has passed through the optical system and the optical wavefront modulation element, and an image signal that is less dispersed than a dispersed image signal from the imaging element. Conversion means for generating, and irradiation means for irradiating the fingerprint or a predetermined part of the subject with at least two wavelengths,
The biometric authentication device, wherein the conversion unit generates an image signal having no dispersion from the dispersion image signal based on the wavelength information irradiated by the irradiation unit. The imaging apparatus includes conversion coefficient storage means for storing in advance at least two conversion coefficients corresponding to dispersion caused by the light wavefront modulation element according to the irradiating wavelength,
The biometric authentication device according to claim 1, wherein the conversion unit selects the conversion coefficient according to the irradiating wavelength, converts the dispersed image signal, and generates an image signal without dispersion. . The imaging apparatus includes a conversion coefficient calculation unit that calculates a conversion coefficient in accordance with the irradiated wavelength.
The biometric authentication apparatus according to claim 1, wherein the conversion unit converts the distributed image signal using the conversion coefficient obtained from the conversion coefficient calculation unit to generate an image signal without dispersion.   The biometric authentication apparatus according to claim 3, wherein the conversion coefficient calculation unit includes a kernel size of the subject dispersion image as a variable.   The biometric authentication device according to any one of claims 2 to 4, wherein the conversion unit performs a convolution operation based on the conversion coefficient. A biometric authentication device including an imaging device that reads a predetermined pattern of a fingerprint and a predetermined portion of a subject,
The imaging apparatus includes an optical system and an optical wavefront modulation element, an imaging element that captures a subject dispersion image that has passed through the optical system and the optical wavefront modulation element, and an image signal that is less dispersed than a dispersed image signal from the imaging element. Conversion means for generating, and irradiation means for irradiating the fingerprint or a predetermined part of the subject with at least two wavelengths,
A plurality of the optical wavefront modulation elements, and selection switching means for inserting and retracting each of the optical wavefront modulation elements on the optical path of the optical system based on wavelength information irradiated by the irradiation means. A biometric authentication device.

Images