JP2008181220A - Personal authentication apparatus and personal authentication method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a personal authentication apparatus that can surely prevent authentication errors when an artifact imitating a human finger or palm is used, providing high authentication accuracy, and that can readily be made thinner. <P>SOLUTION: An image-pickup optical system 100a using a compound-eye optical system continuously picks up images of vein patterns at predetermined time intervals and stores time-series compound-eye images in an image storage part 201. A pulse information detecting part 204 obtains pulse information from the time-series compound-eye images and an image reconfiguring part 205 reconfigures a high-resolution single image from one of the compound-eye images. An authentication part 208 performs personal authentication based on collation with either the vein patterns in the reconfigured image, or its features and the vein patterns of a registrant stored in a vein pattern information storage part 202, or its features; an authentication part 207 performs personal authentication based on collation between the pulse information stored in a pulse information part 203 about the particular registrant authenticated and the pulse information detected by the pulse information detecting part 204. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a personal authentication device that performs personal authentication using a human finger or palm as a subject.

  The personal authentication device described in Patent Document 1 detects a secretion product that detects the presence of a secretion secreted from the exocrine line of the finger skin from an image of the surface of the in vivo skin read by moving a finger on the image collection surface. Means for identifying artificial gums made of gummy and the like.

  The personal authentication device described in Patent Document 2 measures a pulse from a finger using a pressure sensor in order to prevent unauthorized access using a forged fingerprint, and when the pulse matches a condition, It determines that it is a living body and performs an authentication operation.

  The personal identification device described in Patent Literature 3 includes an image receiving unit including a light source, a visible light cut filter, a coupling lens group, and an image receiving element, and a computer that processes an output from the image receiving unit. Image processing means for obtaining a blood vessel fluoroscopic image by imaging a blood vessel pattern under the hand, feature amount extracting means for extracting a personal characteristic amount from the blood vessel fluoroscopic image, and storing the characteristic amount as personal identification information at the time of registration And determining means for determining whether or not the feature quantity stored in the storage means matches the feature quantity extracted based on the blood vessel fluoroscopic image output from the image receiving means at the time of collation. Function.

  Non-Patent Document 1 describes a thin image input device that photographs a close subject by a compound eye optical system using a lens array. An experimental example for inputting a fingerprint image copied on a transparent film is shown.

  Non-Patent Document 2 describes a downsized laser blood flow meter.

WO2004 / 023999 JP-A-6-187430 JP 7-21373 A Ikenji et al., "Development of thin image input device using compound eye optical system", Journal of the Institute of Image Information and Television Engineers, Vol. 57, No. 9, pp. 1135-1141 (2003) Seikura et al., “Ultra-compact laser blood flow meter that can be always carried”, NTT Technical Journal, November 2005, pp. 24-27

  In a personal authentication device that reads fingerprint patterns and vein patterns of fingers or palms and uses them for personal authentication, even when reading artificial fingers, palms, films with fingerprints or vein patterns, etc. If it matches the registered pattern, it will be erroneously authenticated.

  In patent document 1, when the secretion from the exocrine gland of the living body skin is not detected, it is determined that the finger is an artificial finger or the like, and the authentication operation is not performed. However, in the case where a droplet imitating a secretion is attached to an artificial finger in advance, an authentication operation is performed without being judged as an artificial finger, and a pattern such as a fingerprint read from the artificial finger is registered If it matches, false authentication may occur.

  Further, in the personal authentication device of Patent Document 2, a finger pulse is detected using a pressure sensor, and when the detected pulse does not match the condition, it is determined to be an artificial finger or the like, and the authentication operation is not performed. However, a person's pulse varies considerably among individuals (for example, 50 to 100 times / minute). Therefore, the pulse must be judged under fairly gentle conditions. For example, when the artificial finger is vibrated with a vibrator or the like, authentication is performed without being judged as an artificial finger, and erroneous authentication may occur. There is sex.

  The present invention has been made in view of the above problems, and its main purpose is to reliably prevent erroneous authentication when an artificial object imitating a person's finger or palm is used, and authentication accuracy. It is to provide a personal authentication device and a personal authentication method that are high in cost.

  Personal authentication devices are beginning to be installed in mobile devices such as mobile phones and notebook PCs. In such applications, it is important to reduce the size of the personal authentication device, particularly to reduce the thickness.

  Therefore, another main object of the present invention is to realize downsizing, in particular, thinning of the personal authentication device.

  In order to achieve the above object, in the present invention, a vein pattern of a finger or palm (subject) is read, and a predetermined one type or a plurality of types of subjects other than the vein pattern, which are unique to a living body and have individual differences from the subject. Biological information (specifically, information on one or more of pulse, epidermis color, body temperature, blood flow) is detected. And the biometric information memorize | stored about the registrant who authenticated by this by performing the personal authentication by collating with the vein pattern or its characteristic which was detected and the vein pattern or its characteristic memorized about one or more registrants And personal authentication by collating with the detected biometric information. A compound eye optical system using a lens array that has a short imaging distance and can be easily thinned is employed as an optical system for reading vein patterns. The features of the invention according to each claim are as follows.

The personal authentication device of the invention according to claim 1 is:
A personal authentication device that performs personal authentication using a human finger or palm as a subject,
Vein pattern reading means for reading the vein pattern of the subject;
Biological information detection means for detecting a predetermined type of biological information that is unique to a living body and has individual differences, other than a vein pattern, from the subject;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Biometric information storage means for storing the predetermined type of biometric information about one or more registrants;
The first personal authentication for the subject is performed by collating the vein pattern read by the vein pattern reading means or the feature thereof with the vein pattern or the feature stored in the vein pattern information storage means. A first authentication means;
And comparing the biological information stored in the biological information storage means for the registrant authenticated by the first personal authentication with the biological information detected by the biological information detection means, Second authentication means for performing second personal authentication for
It is characterized by having.
As biological information detected by the biological information detection means, specifically, for example, information relating to pulse, skin color, body temperature, blood flow, etc. can be used.
When an artificial object is used as the subject, the probability of success of both the first personal authentication based on the vein pattern and the second personal authentication based on biometric information that is unique to the living body and has individual differences is low. For example, a registrant who uses a transparent film or the like on which a registrant's vein pattern is recorded as a subject and succeeds in the second personal authentication even if the first personal authentication is successful. It is difficult to detect biological information related to the pulse, skin color, body temperature, blood flow rate, and the like inherent to each other. Therefore, according to the personal authentication apparatus of the first aspect of the invention, it is possible to reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of succeeding even in the second personal authentication using biometric information with individual differences is low. Thus, in order to perform two-stage personal authentication based on biometric information having a vein pattern and individual differences, according to the personal authentication device of the first aspect of the present invention, authentication accuracy when the subject is a human finger or palm is used. Will also improve.

According to a second aspect of the present invention, there is provided a personal authentication device according to the first aspect of the present invention.
The biological information detection means detects a predetermined plurality of types of biological information,
The biological information storage means stores the predetermined plural types of biological information;
The second authentication means includes a plurality of types of biometric information stored in the biometric information storage means for the registrant authenticated by the first personal authentication, and a plurality of types detected by the biometric information detection means. The second personal authentication for the subject is performed by collating the biometric information between the same types of biometric information.
When an artificial object is used as the subject, the probability that both the first personal authentication based on the vein pattern and the second personal authentication based on a plurality of types of biological information that are unique to the living body and have individual differences is low. For example, a registrant who uses a transparent film or the like on which a registrant's vein pattern is recorded as a subject and succeeds in the second personal authentication even if the first personal authentication is successful. It is extremely difficult to detect a plurality of types of biological information related to the pulse, skin color, body temperature, blood flow rate, and the like inherent to each other. Therefore, according to the personal authentication device of the second aspect of the present invention, it is possible to more reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of succeeding even in the second personal authentication using a plurality of types of biometric information with individual differences is low. As described above, in order to perform two-step personal authentication using a plurality of types of biometric information having individual differences from the vein pattern, according to the personal authentication device of the second aspect, the subject is a person's finger or palm. The accuracy of authentication is also improved.
In addition, since the second personal authentication uses a plurality of types of biometric information, the second personal authentication succeeds for all of the plurality of types of biometric information and the second personal authentication succeeds for any one type of biometric information. It is also possible to control which of these cases will ultimately result in successful personal authentication.

According to a third aspect of the present invention, there is provided the personal authentication device according to the first or second aspect, wherein the vein pattern reading means includes:
A light source for irradiating the subject with light;
A lens array facing the subject;
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
It comprises image reconstruction means for reconstructing a single image of the vein pattern from a compound eye image picked up by the image pickup means.
According to such a configuration, the optical system for reading the vein pattern can be easily reduced in thickness. Therefore, according to the third aspect of the invention, the personal authentication device can be thinned.

The personal authentication device of the invention according to claim 4 is:
A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with light,
A lens array facing the subject,
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
Image reconstruction means for reconstructing a single image of the vein pattern of the subject from a compound eye image captured by the imaging means;
Pulse information detecting means for detecting pulse information of the subject based on a plurality of compound eye images continuously taken at predetermined time intervals by the imaging means or a single eye image of a part thereof;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Pulse information storage means for storing pulse information about one or more registrants;
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by comparing the pulse information stored in the pulse information storage means for the registrant authenticated by the first personal authentication with the pulse information detected by the pulse information detection means, Second authentication means for performing second personal authentication for
It is characterized by having.
When an artificial object is used as the subject, the probability of success of both the first personal authentication based on the vein pattern and the second personal authentication based on pulse information that is unique to the living body and has individual differences is low. For example, a registrant who uses a transparent film or the like on which a registrant's vein pattern is recorded as a subject and succeeds in the second personal authentication even if the first personal authentication is successful. It is difficult to detect unique pulse information. Therefore, according to the personal authentication apparatus of the invention described in claim 4, it is possible to reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of succeeding even in the second personal authentication based on pulse information with individual differences is low. Thus, in order to perform two-stage personal authentication based on pulse information having a vein pattern and individual differences, according to the personal authentication device of the invention of claim 4, authentication accuracy when the subject is a person's finger or palm Will also improve.
The compound eye optical system using a lens array for reading a vein pattern can be easily made thin, and there is no need to provide a pressure sensor as in Patent Document 2 for detecting pulse information. According to the invention, the personal authentication device can be easily reduced in thickness and size.

The personal authentication device of the invention according to claim 5 is:
A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with near infrared light and visible light;
A lens array facing the subject,
A visible light cut filter for preventing visible light from entering a lens other than the predetermined lens in the lens group of the lens array;
A compound eye of a vein pattern of the subject that is positioned on the image plane side of the lens array and is imaged by a lens other than the predetermined lens of the lens array in a state where the subject is irradiated with light from the light source. A first imaging means for capturing an image;
Second imaging that images an image formed by the predetermined lens of the lens array as a color image in a state where the object is irradiated with light from the light source and located on the image plane side of the lens array means,
Image reconstruction means for reconstructing a single image of the vein pattern from a compound eye image captured by the first imaging means;
Skin color information detecting means for detecting skin color information of the subject from a color image captured by the second imaging means;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Skin color information storage means for storing skin color information for one or more registrants;
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by comparing the skin color information stored in the skin color information storage means for the registrant authenticated by the first personal authentication with the skin color information detected by the skin color information detection means. , Second authentication means for performing second personal authentication on the subject,
It is characterized by having.
When an artificial object is used as the subject, the probability that both the first personal authentication based on the vein pattern and the second personal authentication based on the skin color information that is unique to the living body and has individual differences is low. For example, a registrant who uses a transparent film or the like on which a registrant's vein pattern is recorded as a subject and succeeds in the second personal authentication even if the first personal authentication is successful. It is difficult to detect unique skin color information. Therefore, according to the personal authentication device of the fifth aspect of the present invention, erroneous authentication when an artifact is used as a subject can be reliably prevented.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of success even through the second personal authentication based on skin color information having individual differences is low. Thus, in order to perform two-step personal authentication based on skin color information having individual differences from the vein pattern, according to the personal authentication device of the invention according to claim 5, authentication is performed when the subject is a human finger or palm. Accuracy is also improved.
The compound eye optical system using the lens array for reading the vein pattern can be easily thinned, and it is not necessary to separately provide a color sensor or the like for detecting the skin color information. For example, the personal authentication device can be easily reduced in size and thickness.

The personal authentication device of the invention according to claim 6 is:
A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with light,
A lens array facing the subject,
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
Image reconstruction means for reconstructing a single image of the vein pattern from a compound eye image captured by the imaging means;
Body temperature information detecting means for detecting body temperature information from the subject using a temperature sensor;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Body temperature information storage means for storing body temperature information about one or more registrants,
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by comparing the body temperature information stored in the body temperature information storage unit for the registrant authenticated by the first personal authentication with the body temperature information detected by the body temperature information detection unit, Second authentication means for performing second personal authentication for
It is characterized by having.
When an artificial object is used as the subject, the probability of success of both the first personal authentication based on the vein pattern and the second personal authentication based on body temperature information that is unique to the living body and has individual differences is low. For example, a registrant who uses a transparent film or the like on which a registrant's vein pattern is recorded as a subject and succeeds in the second personal authentication even if the first personal authentication is successful. It is difficult to detect specific body temperature information. Therefore, according to the personal authentication device of the sixth aspect of the present invention, erroneous authentication when an artifact is used as a subject can be reliably prevented.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of success even through the second personal authentication based on body temperature information with individual differences is low. Thus, in order to perform two-step personal authentication based on body temperature information having a vein pattern and individual differences, according to the personal authentication device of the sixth aspect of the invention, authentication accuracy when the subject is a human finger or palm Will also improve.
In addition, since the compound eye optical system using the lens array for reading the vein pattern can be easily reduced in thickness, the personal authentication device can be easily reduced in thickness according to the invention described in claim 6.

The personal authentication device of the invention according to claim 7 is:
A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with light,
A lens array facing the subject,
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
Image reconstruction means for reconstructing a single image of the vein pattern from a compound eye image captured by the imaging means;
Blood flow information detecting means for detecting blood flow information from the subject using a blood flow sensor;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Blood flow information storage means for storing blood flow information on one or more registrants;
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by collating the blood flow information stored in the blood flow information storage means for the registrant authenticated by the first personal authentication with the blood flow information detected by the blood flow information detection means. , Second authentication means for performing second personal authentication on the subject,
It is characterized by having.
When an artificial object is used as the subject, the probability that both the first personal authentication based on the vein pattern and the second personal authentication based on blood flow information that is unique to the living body and has individual differences is low. For example, a registrant who uses a transparent film or the like on which a registrant's vein pattern is recorded as a subject and succeeds in the second personal authentication even if the first personal authentication is successful. It is extremely difficult to detect blood flow information unique to the patient. Therefore, according to the personal authentication device of the seventh aspect of the invention, it is possible to reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of success even by the second personal authentication based on blood flow information having individual differences is extremely low. Thus, in order to perform two-stage personal authentication based on blood flow information having a vein pattern and individual differences, according to the personal authentication device of the invention according to claim 7, authentication is performed when the subject is a human finger or palm. Accuracy is also improved.
In addition, since a compound eye optical system using a lens array for reading vein patterns can be easily reduced in thickness, the personal authentication device can be easily reduced in thickness according to the invention described in claim 7.

In addition to the configuration of the personal authentication device of the invention described in claim 4, the personal authentication device of the invention of claim 8 includes:
Blood flow information detecting means for detecting blood flow information from the subject using a blood flow sensor;
Blood flow information storage means for storing blood flow information on one or more registrants;
By collating the blood flow information stored in the blood flow information storage means for the registrant authenticated by the first personal authentication with the blood flow information detected by the blood flow information detection means, It has 3rd authentication means which performs the 3rd personal authentication with respect to the said subject.
Probability that all of the first and second personal authentications based on the vein information and the pulse information and the blood flow information that are unique to the individual and the blood flow information are successful when an artificial object is used as the subject. Is extremely low. For example, using a transparent film or the like that records the registrant's vein pattern as the subject, even if the first personal authentication can be successful, the second and third personal authentication can be successful, It is extremely difficult to detect pulse information and blood flow information. Therefore, according to the personal authentication device of the eighth aspect of the invention, it is possible to reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of success in the second and third personal authentication based on pulse information and blood flow information having individual differences is extremely low. Thus, in order to perform two-step personal authentication based on pulse information and blood flow information having individual differences from the vein pattern, according to the personal authentication device of the invention of claim 8, the subject is a human finger or palm. The authentication accuracy in the case is also improved.
In addition, it is possible to control which of the cases where the second personal authentication and the third personal authentication are both successful and the case where one of the two is successful ultimately determines that the personal authentication has succeeded.

In addition to the configuration of the personal authentication device of the invention described in claim 4, the personal authentication device of the invention of claim 9 includes:
Body temperature information detecting means for detecting body temperature information from the subject using a temperature sensor;
Body temperature information storage means for storing body temperature information about one or more registrants,
By comparing the body temperature information stored in the body temperature information storage means for the registrant authenticated by the first personal authentication with the body temperature information detected by the body temperature information detection means, It has 3rd authentication means to perform 3rd personal authentication, It is characterized by the above-mentioned.
When an artificial object is used as a subject, the first personal authentication based on the vein pattern, and the probability that all of the second and third personal authentications based on the pulse information and body temperature information that are unique to the living body and have individual differences will succeed. Low. For example, using a transparent film or the like that records the registrant's vein pattern as the subject, even if the first personal authentication can be successful, the second and third personal authentication can be successful, It is extremely difficult to detect pulse information and body temperature information. Therefore, according to the personal authentication device of the ninth aspect of the invention, it is possible to reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of succeeding even in the second and third personal authentication based on pulse information and body temperature information having individual differences is extremely low. In this way, in order to perform two-step personal authentication based on pulse information and body temperature information that have individual differences from the vein pattern, according to the personal authentication device of the invention according to claim 9, when the subject is a human finger or palm The accuracy of authentication is also improved.
In addition, it is possible to control which of the cases where the second personal authentication and the third personal authentication are both successful and the case where one of the two is successful ultimately determines that the personal authentication has succeeded.

The personal authentication method of the invention according to claim 10 is:
A personal authentication method for performing personal authentication using a human finger or palm as a subject,
A vein pattern reading step for reading the vein pattern of the subject;
A biological information detection step of detecting information related to any one of pulse, skin color, body temperature, and blood flow (hereinafter referred to as biological information) from the subject;
By comparing the vein pattern read by the vein pattern reading step or the feature thereof with the vein pattern or the feature of one or more individual registrants stored in the vein pattern information storage means, A first authentication step for performing a first personal authentication;
And by comparing the biological information detected by the biological information detection means with the biological information stored in the biological information storage means for the registrant authenticated by the first personal authentication. A second authentication step for performing a second personal authentication;
It is characterized by having.
When an artificial object is used as the subject, the probability of success of both the first personal authentication based on the vein pattern and the second personal authentication based on biological information that is unique to the living body and has individual differences is low. For example, a registrant who uses a transparent film or the like on which a registrant's vein pattern is recorded as a subject and succeeds in the second personal authentication even if the first personal authentication is successful. It is extremely difficult to detect biological information related to the pulse, skin color, body temperature, or blood flow volume inherent to the body. Therefore, according to the personal authentication method of the invention described in claim 10, it is possible to reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of succeeding even in the second personal authentication using biometric information with individual differences is low. In this way, in order to perform two-step personal authentication based on biometric information having a vein pattern and individual differences, according to the personal authentication method of the invention of claim 10, authentication accuracy when the subject is a human finger or palm Will also improve.

The personal authentication method of the invention according to claim 11 is:
A personal authentication method for performing personal authentication using a human finger or palm as a subject,
A vein pattern reading step for reading the vein pattern of the subject;
A biological information detection step of detecting information on any two or more of pulse, epidermis color, body temperature, and blood flow (hereinafter referred to as biological information) from the subject;
By comparing the vein pattern read by the vein pattern reading step or the feature thereof with the vein pattern or the feature of one or more registrants stored in the vein pattern information storage means, A first authentication step for performing one personal authentication;
And the biometric information stored in the biometric information storage means for the registrant who has been authenticated by the first personal authentication and the biometric information detected by the biometric information detection step between the same types of biometric information. A second authentication step for performing second personal authentication on the subject by collating;
It is characterized by having.
When an artificial object is used as the subject, the probability that both the first personal authentication based on the vein pattern and the second personal authentication based on a plurality of types of biological information that are unique to the living body and have individual differences is low. For example, if a transparent film or the like on which a registrant's vein pattern is recorded is used as a subject, even if the first personal authentication can be successful, the second personal authentication can be successful. It is extremely difficult to detect a plurality of types of biological information related to color, body temperature or blood flow. Therefore, according to the personal authentication device of the eleventh aspect of the invention, it is possible to reliably prevent erroneous authentication when an artifact is used as a subject.
Even if the subject is a finger or palm of a person other than the registrant, and the vein pattern is coincidentally very similar to the vein pattern of the registrant, the first personal authentication is successful. The probability of succeeding even in the second personal authentication using a plurality of types of biometric information with individual differences is extremely low. As described above, in order to perform two-step personal authentication based on a plurality of types of biometric information having individual differences from the vein pattern, according to the personal authentication device of the invention according to claim 11, when the subject is a human finger or palm The accuracy of authentication is also improved.
In addition, since the second personal authentication uses a plurality of types of biometric information, the second personal authentication succeeds for all of the plurality of types of biometric information and the second personal authentication succeeds for any one type of biometric information. It is also possible to control which of these cases will ultimately result in successful personal authentication.

  As described above, according to the present invention, it is possible to reliably prevent erroneous authentication when an artificial object imitating a human finger or palm is used as a subject, and the subject is a human finger or palm. In this case, a personal authentication device and a personal authentication method with high authentication accuracy can be realized. In addition, since the personal authentication device can be reduced in size, particularly reduced in thickness, it is possible to achieve an effect that a personal authentication device suitable for mounting on a mobile device or the like can be realized.

  Hereinafter, embodiments of the present invention will be described in detail with respect to a personal authentication device. However, the following description also serves as a description of the embodiment of the personal authentication method of the present invention. In the drawings referred to in the following description, the same or similar reference numerals are used for the same or similar elements in order to reduce duplication of description.

[First Embodiment]

  FIG. 1 is an explanatory diagram of a configuration of a personal authentication apparatus according to the first embodiment of the present invention. FIG. 1 schematically shows a subject (a person's finger or palm) 13. In this personal authentication device, as information for personal authentication, an image of a vein 14 (vein pattern) inside the subject 13 and other pulse information that is a kind of biometric information with individual differences are detected from the subject 13. .

  Reference numeral 100a denotes an imaging optical system for reading a vein pattern. In the present embodiment, the image captured by the imaging optical system 100a is also used for pulse information detection. In the imaging optical system 100a, reference numeral 1 denotes a light source that irradiates the subject 13 with light. 2 is a visible light cut filter, 3 is a lens array composed of two or more lenses 3 a arranged in a substantially planar shape, and 4 is a light shielding member for preventing crosstalk of light rays between the lenses 3 a of the lens array 3. It is. Reference numeral 5 denotes an image sensor for capturing an image formed by the lens array 3. As this image sensor 5, a CCD image sensor, a CMOS image sensor, or the like in which light receiving elements are arranged in a two-dimensional array can be used. Such an imaging optical system 100a is composed of a compound eye optical system using a flat lens array, so that the whole can be easily reduced in thickness.

  The light source 1 irradiates the subject 13 with light, and the emitted light is preferably near infrared light in order to image a vein pattern inside the subject. Near-infrared light is absorbed by deoxyhemoglobin contained in venous blood, but it is difficult to absorb in other tissue parts, so a clearer vein pattern is imaged compared to when using light of other wavelengths. it can. In FIG. 1, the light source 1 is disposed at a position facing the lens array 3 and the image sensor 5, but this is an example, and light is emitted from the side of the subject 13 or from the lens array 3 side. A light source 1 may be arranged. Even in such an arrangement, since the living body is a strong scatterer, a vein pattern can be imaged. The vein pattern is imaged by the lens array 3 and imaged by the image sensor 5. The light shielding member 4 suppresses crosstalk at the imaging position of the light beam passing through each lens 3a. The visible light cut filter 2 is provided in order to prevent the visible light component from entering the lens array 3 and to capture a clearer vein pattern. If the light emitted from the light source 1 contains no visible light component and no visible light is incident from the outside, the visible light cut filter 2 may be omitted. The image picked up by the image pickup device 5 is a compound eye image in which single-eye images of vein patterns formed by the lenses 3 a of the lens array 3 are arranged.

  FIG. 2 shows a simulation example of a compound eye image captured. 2A is a subject image, and FIG. 2B is a compound eye image to be captured. In a compound eye image, a grid-like black portion existing between single-eye images is a shadow of the light shielding member 4. The single-eye image formed by each lens 3a includes a portion having a different vein pattern depending on the lens position. Note that A in FIG. 1 represents a field of view by one lens 3a, and corresponds to a region observed as a single-eye image. Further, B in FIG. 1 is a portion where the fields of view of the adjacent lenses 3a overlap, and this represents an overlapping region common to adjacent single-eye images in the compound-eye image.

  Returning to FIG. An image storage unit 201 temporarily stores an image captured by the image sensor 5. An image reconstruction unit 205 reconstructs a single image of a vein pattern from a compound eye image of a vein pattern stored in the image storage unit 201. This single image reconstruction will be described in detail later. The image reconstruction unit 205 constitutes a vein pattern reading unit of the subject 13 together with the imaging optical system 100a. Reference numeral 204 denotes a pulse information detection unit that detects pulse information of the subject 13 based on an image stored in the image storage unit 201, and details thereof will be described later. Reference numeral 202 denotes a vein pattern information storage unit that stores vein patterns or characteristics of one or more registrants. A pulse information storage unit 203 stores pulse information about one or more registrants. Reference numeral 206 denotes an authentication unit that performs personal authentication using a vein pattern, and 207 denotes an authentication unit that performs personal authentication using pulse information. The authentication unit 206 collates the vein pattern or its feature in the single image reconstructed by the image reconstruction unit 205 with the vein pattern or its feature for the registrant stored in the vein pattern information storage unit 202. By doing so, personal authentication is performed. The authentication unit 207 compares the pulse information stored in the pulse information storage unit 203 for the specific registrant authenticated by the authentication unit 207 with the pulse information detected by the detection unit 204, thereby authenticating the individual. I do. A control unit 208 controls the operation of each unit of the apparatus and the processing flow of the entire apparatus.

  Next, the overall operation of this personal authentication device will be described. FIG. 3 is a flowchart for the explanation.

  The imaging optical system 100a continuously captures the vein pattern of the subject 13 at predetermined time intervals, and the captured time-series images (the compound eye images of the vein pattern) are stored in the image storage unit 201 ( Step S1). The imaging time interval and the number of imaging frames are determined in consideration of pulse information detection described later.

  Next, in the pulse information detection unit 204, a time-series image is read from the image storage unit 201, and pulse information is detected (step S2). The pulse information detection unit 204 also determines whether the detected pulse information is clearly abnormal as human pulse information, and notifies the control unit 208 of the determination result (step S3). When this determination result is Yes, that is, when it is determined that the subject 13 is clearly a non-living body (artifact), the control unit 208 performs control to stop the processing. When the determination result is No, since the subject 13 may be a living body, the control unit 208 performs control to advance the process to the next step S4. Details of pulse information detection and abnormality determination will be described later.

  When the determination result in step S3 is No, the image reconstruction unit 205 reads one frame of the time-series image stored in the image storage unit 201, and this image (vein pattern compound eye image) is high-resolution. A process of reconstructing into a single image is performed (step S4). Details of this image reconstruction processing will be described later.

  Next, in the authentication unit 206, the vein pattern in the high-resolution single image reconstructed from the compound eye image in the image reconstruction unit 205 or its features and the registrant's information stored in the vein information storage unit 202. Personal authentication is performed by collating the vein pattern or its characteristics (step S5). When the registrant's vein pattern is stored in the vein information storage unit 202, the authentication unit 206 obtains the similarity (or difference) by pattern matching, and the similarity for a registrant exceeds a predetermined threshold (or It is determined that the personal authentication has succeeded when the degree of difference is equal to or less than a predetermined threshold. However, instead of pattern matching between vein patterns, feature points are extracted from the vein patterns in the reconstructed image and the vein patterns stored in the vein pattern information storage unit 202, and the correspondence between the feature points of both vein patterns is determined. The desired feature-based matching may be used. When feature information such as a feature point of a vein pattern is stored in the vein pattern information storage unit 202, the latter feature-based matching is used. Whether the personal authentication is correct or not is notified to the control unit 208.

  If the personal authentication is successful (step S6, Yes), the authentication unit 206 notifies the authenticated specific registrant to the authentication unit 207. When personal authentication fails (step S6, No), the control part 208 performs control which stops a process.

  When the personal authentication in the authentication unit 206 is successful, the authentication unit 207 performs personal authentication based on the pulse information (step S7). That is, the authentication unit 206 reads the pulse information about the registrant notified from the authentication unit 206 from the pulse information storage unit 203, collates this pulse information with the pulse information received from the pulse information detection unit 204, and keeps constant. If the above similarity (or a certain degree of difference) is obtained, it is determined that the authentication has succeeded, and otherwise, it is determined to have failed. For example, when a pulse period or a pulse rate is used as the pulse information, a difference between the pulse period or the pulse rate is calculated, and if the absolute value of the difference is equal to or less than a predetermined threshold, it is determined to be successful. . When a pulse pattern is used as the pulse information, pattern matching between pulse patterns can be used. When this personal authentication fails, the subject 13 is likely to be an artificial object or a finger or palm other than the registrant who has been authenticated by the personal authentication using the vein pattern.

  When the personal authentication of the authentication unit 207 fails (step S8, No), the control unit 208 performs control to stop the process. When the personal authentication of the authentication unit 207 is successful (step S8, Yes), the control unit 208 is notified of the success, and the control unit 208 finally determines that the personal authentication is successful and outputs a signal to that effect to the outside. (Step S9). For example, when this personal authentication device is used for login management or entry management of an electronic device, the control unit 208 outputs a login permission signal to the electronic device, a door unlocking permission signal, or the like.

  As described above, the registrant who has been authenticated by the personal authentication based on the vein pattern is further subjected to personal authentication based on pulse information, which is a kind of biometric information having individual differences. Even when a simulated artifact is used and a vibration simulating a pulse is applied to the artifact, erroneous authentication can be reliably prevented. In addition, since double personal authentication based on vein patterns and pulse information is performed, the risk of authenticating registrants who have very similar vein patterns as registrants is reduced, and authentication accuracy is improved compared to personal authentication using only vein patterns. To do. It should be noted that a threshold for determining success or failure of personal authentication based on pulse information may be changeable, and this aspect is also included in the present embodiment.

  In the present embodiment, pulse information is detected based on an image captured by the imaging optical system 100a for reading a vein pattern, and a pressure sensor for pulse detection is not provided separately as in Patent Document 2. This is advantageous in reducing the cost and size of the personal authentication device.

  The vein pattern is read using the registrant's finger or palm as the subject 13, and the vein pattern of the reconstructed image by the image reconstruction unit 205 or its characteristics is stored in the vein pattern information storage unit 202, and the pulse information detection unit 204 is read. Registration processing means for storing the pulse information detected in step S1 in the pulse information storage unit 203 may be added, and this aspect is also included in the present embodiment. However, it goes without saying that the registrant's vein pattern (or its characteristics) and pulse information may be acquired and stored in the respective storage units 202 and 203 by a device different from the personal authentication device. .

  As is apparent from the above description, this embodiment corresponds to an embodiment of the invention described in claims 1, 3, 4, and 10.

  Next, detection of pulse information by the pulse information detection unit 204 will be described.

  The pulse information detection unit 204 obtains the number of pixels in the vein portion at each time from the time-series image stored in the image storage unit 201. As described above, the vein part absorbs near-infrared light as compared with other biological tissue parts. Therefore, the vein part appears darker than the surrounding biological tissues in the captured image. Therefore, by binarizing the image with an appropriate threshold, it is possible to detect the vein portion as a black pixel and the biological tissue portion other than the vein as a white pixel. When the number of black pixels, that is, vein pixels detected in this way are arranged in time series, a pulse pattern 15 schematically shown in FIG. 4 can be obtained. The pulse information detection unit 204 obtains and outputs the pulse pattern 15 or the interval 16 between the peaks or valleys of the pulse pattern, that is, the pulse period, or the reciprocal of the pulse period, that is, the pulse rate, as pulse information. Although it is possible to perform the pulse portion pixel detection processing for obtaining the pulse pattern described above on the entire compound eye image, in order to shorten the calculation time, only a specific eye image in the compound eye image is used. It is desirable to perform processing on the target.

  FIG. 5 is a flowchart illustrating an example of a processing flow of the pulse information detection unit 204. In this example, a compound eye image is read frame by frame from the image storage unit 201 (step S11), and a single eye image at a specific position is extracted (step S12). The single-eye image is binarized with a predetermined threshold (step S13), the black pixel image of the binarized image is counted, and the count value is stored in time series (step S14). However, it is preferable to exclude black pixels in shadow portions of the light shielding member 4 from the count. Similar processing is repeated for each frame of the time-series image stored in the image storage unit 201. When the process is completed up to the last frame (step S15, Yes), a pulse pattern is obtained. In this example, the pulse period or pulse rate is detected as pulse information from this pulse pattern (step S16). However, as described above, the pulse pattern itself can also be detected as pulse information.

  Next, the image reconstruction process of the image reconstruction unit 205 will be described.

  A compound eye optical system using a lens array can reduce the back focus and reduce the thickness of the optical system. However, since the number of pixels forming an image formed by each lens of the lens array is reduced, a single lens is used. There is a demerit that the resolution of the image is lower than when the image is formed by. However, by reconstructing a compound eye image into a single image using the parallax included in the compound eye image, it is possible to compensate for this disadvantage and obtain a high resolution image. FIG. 6 shows a processing flow of image reconstruction using this parallax, and details of the processing will be described below.

  In the first step S21, a single-frame compound eye image captured at a certain time is read from the image storage unit 201. A high-resolution single image is reconstructed from the compound eye image.

Although the compound eye images seem to have the same single-eye images arranged at a glance, each single-eye image is obtained by capturing the subject from different positions, so there is a parallax due to the positional relationship between each lens 3a and the subject. The image becomes an image that is gradually shifted with the parallax. In step S22, a shift between single-eye images due to such parallax is calculated. For example, pattern matching can be used to calculate the shift. A single-eye image (reference single-eye image) serving as a shift reference is arbitrarily selected from the compound-eye image, and a part of this single-eye image is used as a template. The shift of the reference single-eye image is (0, 0). A single-eye image (shift-detected single-eye image) to be subjected to shift detection is selected, and a shift is calculated from the similarity or difference between the reference single-eye image and the shift-detected single-eye image. As is well known, a cross-correlation function can be used as the similarity, and SSD (the sum of squares of pixel value differences) or SAD (the sum of absolute values of pixel values) can be used as the difference. An example of the degree of difference calculated by pattern matching is shown in FIG. The index of difference was SSD.
The dissimilarity using SSD is expressed by the following equation.

ここで、RはＳＳＤで算出される相違度、Ｉは被シフト検出個眼画像の一部、Ｔはテンプレートとした基準個眼画像の一部である。ｉ，jはそれぞれテンプレートの横方向と縦方向の画素数、ｘ，ｙはシフトの探索範囲内で変化する値である。すなわち、Rが最小となる（ｘ，ｙ）が、二つの個眼画像間のシフトである。図７に画像シフトとパターンマッチングの相違度を例示する。図７において、ｘ軸およびy軸はｘ，ｙ方向の画像のシフト、ｚ軸は相違度である。

Here, R is the dissimilarity calculated by SSD, I is a part of the shift-detected single-eye image, and T is a part of the reference single-eye image as a template. i and j are the numbers of pixels in the horizontal and vertical directions of the template, respectively, and x and y are values that change within the search range of shift. That is, (x, y) at which R is minimized is a shift between two single-eye images. FIG. 7 illustrates the difference between image shift and pattern matching. In FIG. 7, the x axis and the y axis are image shifts in the x and y directions, and the z axis is the degree of difference.

  In order to reconstruct a compound eye image to obtain a high-resolution single image, it is necessary to calculate shifts in units smaller than one pixel, that is, in sub-pixel order, but the degree of difference and similarity calculated in pixel order The shift detection in the sub-pixel order is possible by the function fitting method and the pattern matching method by interpolating either the template or the shift-detected single-eye image.

  Further, since the arrangement of the lenses 3a constituting the lens array 3 is known, it is not necessary to perform shift calculation for all single-eye images in the compound-eye image, and the reference single-eye image and a certain shift-detected single-eye image. A shift can be calculated for one set of and a shift of the remaining single-eye image can be estimated from the shift. For example, in a square lattice-shaped compound-eye image in which the number of single-eye images is M and N in the horizontal and vertical directions, respectively, the single-eye image at the upper left corner is used as the reference single-eye image, and the single-eye image at the lower right corner is covered Shift detection single image As a result of pattern matching, if the shift of the shift-detected single-eye image is calculated as (x, y), x / (M−1) in the horizontal and vertical directions between adjacent single-eye image images, It can be estimated that there is a shift of y / (N−1). In this way, it is possible to shorten the calculation time by limiting the shift calculation operation to a single eye image and estimating the shift of the remaining eye images.

  In the next step S23, the compound eye image is reconstructed to generate a high-resolution single image. This reconstruction is performed by rearranging the pixels based on the shift of the single-eye image calculated in the previous step. FIG. 8 is a schematic diagram for explaining image reconstruction. As shown in the figure, a virtual digital image area 17 is secured in advance for a single image to be reconstructed, and each pixel brightness of each single-eye image 18a of the compound-eye image 18 is digitally determined based on each image shift. A single image can be reconstructed by repeating the process of rearranging in the image area 17. When this process ends, the reconstructed single image is output (step S24).

[Second Embodiment]

  FIG. 9 is a configuration explanatory diagram of a personal authentication device according to the second embodiment of the present invention. In the personal authentication device according to the present embodiment, as information for personal authentication, an image of the vein 14 inside the subject (vein pattern) from the subject 13 and other types of biological information with individual differences are the epidermis. Detect color information.

  Reference numeral 100b denotes an imaging optical system for reading a vein pattern. In the present embodiment, the image captured by the imaging optical system 100b is also used for skin color information detection. The configuration of the imaging optical system 100b is basically the same as that of the imaging optical system 100a according to the first embodiment, but the configuration is different in the following points. That is, in the imaging optical system 100b, the visible light component is not cut for a part of a specific single-eye image to be picked up (here, a single-eye image formed by the rightmost lens 3a in FIG. 8). In addition, the visible light cut filter 2 is disposed, and an RGB color filter 20 for color separation is provided on the light receiving element of the image pickup element 5 where the specific single-eye image is formed. Moreover, although what emits near-infrared light and visible light is used as the light source 1, even if this is a single light source that emits near-infrared light and visible light, the light source that emits near-infrared light and visible light are used. A light source combined with a light source that emits light may be used.

  In addition, the personal authentication device according to the present embodiment uses the specific color image (color image composed of RGB components) in the compound eye image captured by the imaging optical system 100b and stored in the image storage unit 201, and the skin color information. Skin color information detection unit 210, skin color information storage unit 211 that stores skin color information about one or more registrants, and authentication unit 212 that performs personal authentication using the skin color information.

  Next, the overall operation of this personal authentication device will be described. FIG. 10 is a flowchart for the explanation.

  A compound eye image is captured by the imaging optical system 100 b and the image is stored in the image storage unit 201. Here, a single-eye compound image is captured and stored (step S31). The specific single-eye image in the compound eye image is an RGB color image. As can be understood from the above description, the imaging device 5 serves as an imaging unit for imaging a vein pattern and an imaging unit for imaging a color image of a part of a subject irradiated with visible light. Thus, the light receiving element provided with the color filter 20 functions as a light receiving element for the latter imaging means.

  In the skin color information detection unit 210, a compound eye image is read from the image storage unit 201, and skin color information is detected from the specific RGB color single-eye image (step S32). Specifically, for example, pixels constituting an RGB color single-eye image are mapped to the RGB color space, and information representing the color area is detected as skin color information. In this case, the skin color information storage unit 211 also stores information on color regions in the same RGB color space obtained in advance for the registrant as skin color information.

  In the skin color information detection unit 210, it is also determined whether or not the detected color area is clearly abnormal as a human skin color area (step S33). When this determination result is Yes, that is, when it is determined that the subject 13 is clearly a non-living body (artifact), the control unit 208 performs control to stop the processing. When the determination result is No, since the subject 13 may be a living body, the control unit 208 performs control to advance the process to the next step S34.

  When the determination result in step S33 is No, the image reconstruction unit 205 reads a compound eye image from the image storage unit 201 and performs reconstruction processing into a single image (step S34). This image reconstruction process is as described in the first embodiment. However, since a specific color single-eye image in a compound eye image forms visible light, noise and noise are extracted when a vein pattern is extracted. Therefore, it is desirable not to use it for image reconstruction.

  Next, in the authentication unit 206, the vein pattern or its feature in the reconstructed image by the image reconstruction unit 205 and the vein pattern or its feature of one or more registrants stored in the vein pattern information storage unit 202 Personal authentication by collation is performed (step S35). When the personal authentication by the authentication unit 206 fails (No at Step S36), the control unit 208 performs control to stop the process.

  When the personal authentication by the authentication unit 206 is successful (step S36, Yes), in the authentication unit 212, the color area information received from the skin color information detection unit 210 (skin color information detected from the subject 13), and the authentication unit The color area information stored in the skin color information storage unit 211 for the specific registrant authenticated by 206 is collated, and personal authentication is performed based on the similarity or difference between the color areas (step S37). If the similarity between the color areas is equal to or higher than a predetermined threshold value, or the difference between the color areas is equal to or lower than the predetermined threshold value, the personal authentication is determined to be successful (step S38, Yes), otherwise the personal authentication fails. (Step S38, No). In the case of failure, the control unit 208 performs control to stop the process.

  When the personal authentication of the authentication unit 212 is successful (step S38, Yes), the control unit 208 finally determines that the personal authentication is successful, and outputs a signal to that effect to the outside (step S39). For example, when this personal authentication device is used for login management or entry management of an electronic device, the control unit 208 outputs a login permission signal to the electronic device, a door unlocking permission signal, or the like.

  As described above, the registrant who has been authenticated by the personal authentication based on the vein pattern is further subjected to personal authentication based on the skin color information, which is a kind of biometric information having individual differences. Even when an artifact that mimics the above is used, erroneous authentication can be reliably prevented. In addition, since double personal authentication based on vein pattern and skin color information is performed, the risk of authenticating a registrant who is very similar to the vein pattern as a registrant is reduced, and authentication accuracy is higher than personal authentication based only on vein patterns. improves. It should be noted that the threshold for determining success or failure of personal authentication based on the skin color information may be changeable, and this aspect is also included in this embodiment.

  Further, in the present embodiment, since it is configured to detect the skin color information based on the image captured by the imaging optical system 100b for reading the vein pattern, it is not necessary to separately provide a color sensor for detecting the skin color. This is advantageous in reducing the cost and size of the personal authentication device.

  The vein pattern reading is performed with the finger or palm of the registrant as the subject 13, and the vein pattern of the reconstructed image by the image reconstruction unit 205 or its characteristics is stored in the vein pattern information storage unit 202, and the skin color information detection unit Registration processing means for storing the skin color information detected in 210 in the skin color information storage unit 211 may be added, and such an embodiment is also included in this embodiment. However, it goes without saying that the registrant's vein pattern (or its characteristics) and skin color information may be acquired by an apparatus different from the personal authentication apparatus and stored in the storage units 202 and 211. Absent.

  As is apparent from the above description, the present embodiment corresponds to an embodiment of the invention described in claims 1, 3, 5, and 10.

[Third Embodiment]

  FIG. 11 is an explanatory diagram of a configuration of a personal authentication device according to the third embodiment of the present invention. In the personal authentication device according to the present embodiment, as information for personal authentication, an image of the vein 14 inside the subject (vein pattern) from the subject 13 and body temperature that is a kind of other biometric information with individual differences. Detect information. The body temperature information detection unit 220 is means for detecting body temperature from the subject 13 using the temperature sensor 30. In the present embodiment, an infrared sensor that detects infrared rays emitted from the subject 13 is used as the temperature sensor 30. Since the infrared sensor can measure the temperature in a non-contact manner, the psychological burden on the person to be authenticated is small and is preferable to the contact-type temperature sensor. The personal authentication device according to the present embodiment includes a body temperature information storage unit 221 that stores body temperature information about one or more registrants, a body temperature information detected by the body temperature information detection unit 220, and a body temperature stored in the body temperature information storage unit 221. An authentication unit 222 that performs personal authentication by collating with information is provided.

  The overall operation of this personal authentication apparatus will be described. FIG. 11 is a flowchart for the explanation.

  First, body temperature is detected from the subject 13 using the temperature sensor 30 in the body temperature information detection unit 220, and information on the detected body temperature is output (step S41). Here, since an infrared sensor is used as the temperature sensor 30, the body temperature is detected without causing the light source 1 of the imaging optical system 100a to emit light.

  In the body temperature information detection unit 220, it is also determined whether or not the detected body temperature is clearly abnormal as a human body temperature (step S42). When this determination result is Yes, that is, when it is determined that the subject 13 is clearly a non-living body (artifact), the control unit 208 performs control to stop the processing. If the determination result is No, since the subject 13 may be a living body, the control unit 208 performs control to advance the process to the next step S43.

  When the determination result in step S42 is No, the imaging optical system 100 captures a vein pattern, and the captured compound eye image is stored in the image storage unit 201 (step S43). Then, the image reconstruction unit 205 reads a compound eye image from the image storage unit 201 and performs reconstruction processing into a single image (step S44).

  Next, in the authentication unit 206, the vein pattern or its feature in the reconstructed image by the image reconstruction unit 205 and the vein pattern or its feature of one or more registrants stored in the vein pattern information storage unit 202 Personal authentication by collation is performed (step S45). If the personal authentication by the authentication unit 206 has failed (No in step S46), the control unit 208 performs control to stop the process.

  When the personal authentication by the authentication unit 206 is successful (step S46, Yes), the authentication unit 222 stores the body temperature information received from the body temperature information detection unit 220 and the body temperature information about the specific registrant authenticated by the authentication unit 206. Personal authentication is performed by collating with the body temperature information stored in the unit 221 (step S47). If the absolute value of the difference in body temperature is less than or equal to the predetermined threshold, the personal authentication is determined to be successful (step S48, Yes), and otherwise, the personal authentication is determined to be failed (step S48, No). In the case of failure, the control unit 208 performs control to stop the process.

  When the personal authentication of the authentication unit 222 is successful (step S48, Yes), the control unit 208 finally determines that the personal authentication is successful, and outputs a signal to that effect to the outside (step S49). For example, when this personal authentication device is used for login management or entry management of an electronic device, the control unit 208 outputs a login permission signal to the electronic device, a door unlocking permission signal, or the like.

  As described above, the registrant who is authenticated by the personal authentication using the vein pattern is further subjected to personal authentication using body temperature information which is a kind of biometric information with individual differences, so that, for example, the finger or palm of the registrant can be used as the subject 13. Even when a simulated artifact is used, erroneous authentication can be reliably prevented. In addition, since double personal authentication is performed using vein patterns and body temperature information, the risk of authenticating registrants who are very similar to vein patterns as a registrant is reduced, and authentication accuracy is improved compared to personal authentication using only vein patterns. To do. Note that the threshold for determining success or failure of personal authentication based on body temperature information may be changeable, and this aspect is also included in this embodiment.

  The vein pattern is read using the registrant's finger or palm as the subject 13, and the vein pattern of the reconstructed image by the image reconstruction unit 205 or its characteristics is stored in the vein pattern information storage unit 202, and the body temperature information detection unit 220 is read. Registration processing means for storing the body temperature information detected in step 1 in the body temperature information storage unit 211 may be added, and such an embodiment is also included in this embodiment. However, it goes without saying that the registrant's vein pattern (or its characteristics) and body temperature information may be acquired and stored in the storage units 202 and 221 by a device other than the personal authentication device. .

  As is apparent from the above description, this embodiment corresponds to an embodiment of the invention described in claims 1, 3, 6, and 10.

[Fourth Embodiment]

  FIG. 13 is a configuration explanatory diagram of a personal authentication device according to the fourth embodiment of the present invention. In the personal authentication device according to the present embodiment, as information for personal authentication, an image of a vein 14 inside the subject (vein pattern) from the subject 13 and blood that is a type of other biological information having individual differences. Detect flow information.

  The personal authentication device according to the present embodiment includes a blood flow sensor 40 and a blood flow information detector 230 for detecting blood flow information. The blood flow sensor 40 irradiates the subject 13 with laser light, converts scattered light from the inside of the subject 13 into an electrical signal, and outputs the electrical signal. Scattered light from inside the subject includes scattered light that has undergone Doppler shift due to the movement of blood cells inside the capillaries inside the living body and scattered light that has been scattered by a stationary tissue and has not undergone Doppler shift. A beat signal component due to interference of scattered light is included in the output signal of the blood flow sensor 40. The blood flow rate detection unit 230 obtains the power spectrum of the beat signal and obtains the blood flow rate by multiplying and integrating the frequency. Since the principle of blood flow measurement using such laser light is well known, further details are omitted.

  In addition, the personal authentication device according to the present embodiment stores blood flow information and blood flow information detected by the blood flow information storage unit 231 and the blood flow information detection unit 230 that store blood flow information for one or more registrants. The authentication part 232 which performs personal authentication by collation with the blood flow rate information memorize | stored in the part 231 is provided.

  Next, the overall operation of this personal authentication apparatus will be described. FIG. 14 is a flowchart for the explanation.

  The imaging optical system 100a images the vein pattern of the subject 13, stores the captured compound eye image in the image storage unit 201 (step S51), and uses the blood flow sensor 40 in the blood flow rate information detection unit 230 in parallel with this. The blood flow is detected (step S52).

  The blood flow information detector 230 determines whether or not the detected blood flow is clearly abnormal as a human blood flow (step 53). When it is determined that the blood flow volume is clearly abnormal as the human blood flow volume, that is, the subject 13 is clearly non-living (Yes in step S53), the control unit 208 performs control to stop the processing. When that is not right (step S53, No), the control part 208 performs control which advances a process to the following step S54. Note that the determination in step S53 can also be made based on the waveform of the output signal of the blood flow sensor 40. That is, when the subject 13 is a living body, the output signal of the blood flow sensor 40 is a mixture of a large-cycle wave indicating the degree of blood flow and a fine-cycle wave corresponding to the pulse, but the subject 13 is non-existing. In the case of a living body, since the output signal of the blood flow sensor 40 has a flat waveform, it can be easily determined that the body is non-living.

  When the determination result in step S53 is No, the image reconstruction unit 205 reads a compound eye image from the image storage unit 201 and performs reconstruction processing into a high-resolution single image (step S54). Next, in the authentication unit 206, by comparing the vein pattern or the feature of the registrant stored in the vein pattern information storage unit 202 with the vein pattern or the feature in the reconstructed image by the image reconstruction unit 205 Personal authentication is performed (step S55). When the personal authentication is unsuccessful (No at Step S56), the control unit 208 performs control to stop the process.

  When personal authentication by the authentication unit 206 is successful (step S56, Yes), in the authentication unit 232, blood flow information stored in the blood flow information storage unit 231 for the specific registrant authenticated by the authentication unit 206 and Then, personal authentication is performed by collating with blood flow information passed from the blood flow information detecting unit 230 (step S57). If the absolute value of the collated blood flow difference is equal to or greater than a predetermined threshold, the personal authentication is determined to be unsuccessful (No in step S58), and the control unit 208 performs control to stop the process. If the absolute value of the difference in blood flow is less than the predetermined threshold, the personal authentication is determined to be successful (step S58, Yes), and the control unit 208 finally determines that the personal authentication is successful, and sends a signal to that effect to the outside. (Step S59). For example, when this personal authentication device is used for login management or entry management of an electronic device, the control unit 208 outputs a login permission signal to the electronic device, a door unlocking permission signal, or the like.

  As described above, the registrant who is authenticated by the personal authentication based on the vein pattern is further subjected to personal authentication based on blood flow information that is a kind of biometric information having individual differences. Even when an artifact that mimics the above is used, erroneous authentication can be reliably prevented. In addition, since double personal authentication based on vein patterns and blood flow information is performed, the risk of authenticating a registrant who is very similar to the vein pattern as a registrant is reduced, and authentication accuracy is higher than personal authentication based only on vein patterns. improves. Note that the threshold for determining success or failure of personal authentication based on blood flow information may be changeable, and this aspect is also included in the present embodiment.

  Further, the vein pattern reading is performed with the finger or palm of the registrant as the subject 13, and the vein pattern of the reconstructed image by the image reconstruction unit 205 or its characteristics is stored in the vein pattern information storage unit 202, and the blood flow information detection unit Registration processing means for storing the blood flow information detected at 230 in the blood flow information storage unit 231 may be added, and this aspect is also included in the present embodiment. However, it goes without saying that the registrant's vein pattern (or its characteristics) and blood flow information may be acquired by a device different from the personal authentication device and stored in the storage units 202 and 231. Absent.

  As is apparent from the above description, this embodiment corresponds to an embodiment of the invention described in claims 1, 3, 7, and 10.

  In addition, since it is considered that it is not easy to create an artificial object in which an appropriate blood flow is detected as a human being, even if it is determined that there is no abnormality in step S53, only personal authentication using a vein pattern is performed. The objective of preventing mis-authentication when artifacts are used will be achieved. In this case, the blood flow information detection unit 230 does not calculate the blood flow, and the determination in step S53 may be performed based on the output signal of the blood flow sensor 40. The personal authentication device having such a configuration is also included in the present invention.

[Fifth Embodiment]

  FIG. 15 is an explanatory diagram of a configuration of a personal authentication apparatus according to the fifth embodiment of the present invention. In the present embodiment, as information for personal authentication, an image of a vein 14 (vein pattern) inside the subject 13 and pulse information and blood flow information, which are other biometric information with individual differences, are detected from the subject 13. To do.

  This personal authentication device is different from the personal authentication device according to the first embodiment in that the blood flow sensor 40, the blood flow information detection unit 230, the blood flow information storage unit 231 and the blood flow information in the fourth embodiment are used. In this configuration, an authentication unit 232 that performs authentication is added. Since each part of the apparatus has been described, the overall operation of this personal authentication apparatus will be described below. FIG. 16 is a flowchart for the explanation.

  The imaging optical system 100a continuously captures the vein pattern of the subject 13 at predetermined time intervals, the captured time-series compound eye images are stored in the image storage unit 201 (step S61), and the pulse information detection unit 204 Thus, pulse information is detected based on the time-series image in the image storage unit 201 (step S62). In parallel with this operation, blood flow information is detected in the blood flow information detection unit 230 using the blood flow sensor 40 (step S63).

  It is determined whether or not the pulse information detected by the pulse information detection unit 204 is clearly abnormal as human pulse information, and the blood flow detected by the blood flow information detection unit 230 is obvious as human blood flow. It is determined whether or not there is an abnormality. If it is determined that either the pulse information detection unit 204 or the blood flow information detection unit 230 is abnormal (Yes in step S64), the control unit 208 determines that the subject 13 is clearly non-living and performs the processing. Control to stop. On the other hand, when it is determined that both the pulse information detection unit 204 and the blood flow information detection unit 230 are not abnormal (step S64, No), the control unit 208 determines that the subject 13 is likely to be a living body. Control to proceed to the next step S65 is performed. In addition, as described in relation to the fourth embodiment, the determination may be performed based on the output signal of the blood flow sensor 40 in the blood flow information detecting unit 230.

  When the determination result in step S64 is No, the image reconstructing unit 205 performs processing to reconstruct a high-resolution single image from a single-frame compound eye image stored in the image storage unit 201 (step S65). . The authentication unit 206 performs personal authentication by collating the vein pattern or its feature in the reconstructed image with the registrant's vein pattern or feature stored in the vein pattern information storage unit 202 (step S66). When this personal authentication fails, the control unit 208 performs control to stop the process.

  When the personal authentication by the authentication unit 206 is successful (step S67, Yes), the pulse information stored in the pulse information storage unit 203 and the blood flow information storage unit 231 for the specific registrant authenticated by the personal authentication and The authentication unit 207 and the authentication unit 232 perform personal authentication by collating the blood flow information with the pulse information detected by the pulse information detection unit 204 and the blood flow information detected by the blood flow information detection unit 230 ( Step S68).

  The control unit 208 can select two modes. When the first mode is selected, when the personal authentication of both the authentication unit 207 and the authentication unit 232 is successful (step S69, Yes), the control unit 208 finally determines that the personal authentication is successful, A signal to that effect is output (step S70). In other cases, the control unit 208 finally determines that personal authentication has failed and performs control to stop the process. As described above, when the personal authentication by the vein pattern is successful and the personal authentication by two types of biometric information is further successful, it is determined that the personal authentication is finally successful. Authentication can be prevented more reliably, and the accuracy of authentication when a living body is used can be further improved, and extremely strong security can be achieved.

  When the second mode is selected, as indicated in parentheses in step S69 of FIG. 16, the control unit 208 finally succeeds in personal authentication when at least one of the authentication units 207 and 232 succeeds. When both the personal authentications by the authentication units 207 and 232 fail, it is determined that the personal authentication has finally failed. Therefore, the second mode has a reduced security strength compared to the first mode. Thus, the security strength can be adjusted by switching between the two modes.

  Even when it is determined that only one of the pulse information and the blood flow information is not abnormal, the process proceeds with the determination result of Step S64 as No, and the pulse information or the blood flow determined not abnormal in Step S68. It is also possible to take an aspect in which only personal authentication based on information is performed and it is finally determined that the personal authentication is successful when the personal authentication is successful. Such an embodiment is also encompassed by the present invention.

  As is clear from the above description, this embodiment corresponds to an embodiment of the invention described in claims 2, 3, 8, and 11.

[Sixth Embodiment]

  FIG. 17 is an explanatory diagram of a configuration of a personal authentication apparatus according to the sixth embodiment of the present invention. In the present embodiment, as information for personal authentication, an image of a vein 14 (vein pattern) inside the subject 13 and other pulse information and body temperature information, which are biometric information with individual differences, are detected from the subject 13. .

  This personal authentication device is an authentication that performs personal authentication using the temperature sensor 30, the body temperature information detection unit 220, the body temperature information storage unit 221 and the body temperature information in the third embodiment to the personal authentication device according to the first embodiment. This is a configuration in which a unit 222 is added. Since each part of the apparatus has been described, the overall operation of this personal authentication apparatus will be described below. FIG. 18 is a flowchart for the explanation.

  The body temperature information detection unit 220 detects the body temperature information using the temperature sensor 30, and determines whether or not the detected body temperature information is clearly abnormal as human body temperature information (step S81). If the body temperature information is clearly abnormal (step S82, Yes), since the subject 13 is determined to be non-living, the control unit 208 performs control to stop the process. When the body temperature information is not abnormal (step S82, No), since the subject 13 is highly likely to be a living body, the control unit 208 advances the processing to the next step S83.

  When the determination result in step S82 is No, the imaging optical system 100a continuously captures the vein pattern of the subject 13 at predetermined time intervals, and the captured time-series compound eye images are stored in the image storage unit 201. (Step S83).

  The pulse information detection unit 204 detects pulse information based on the time-series image in the image storage unit 201, and determines whether the detected pulse information is clearly abnormal as human pulse information (step) S84). When the pulse information detection unit 204 determines that there is an abnormality (step S85, Yes), the control unit 208 performs control to determine that the subject 13 is clearly non-living and stop processing. On the other hand, when the pulse information detection unit 204 determines that there is no abnormality (No at Step S85), the control unit 208 determines that the subject 13 is highly likely to be a living body and proceeds to the next Step S86. Do.

  When the determination result in step S85 is No, the image reconstruction unit 205 performs processing for reconstructing a single high-resolution image from a single-frame compound image stored in the image storage unit 201 (step S86). . The authentication unit 206 performs personal authentication by collating the vein pattern or its feature in the reconstructed image with the registrant's vein pattern or feature stored in the vein pattern information storage unit 202 (step S87). If the personal authentication fails (No at Step S88), the control unit 208 performs control to stop the process.

  When the personal authentication by the authentication unit 206 is successful (step S88, Yes), the pulse information and the body temperature stored in the pulse information storage unit 203 and the body temperature information storage unit 221 for the specific registrant authenticated by the personal authentication. Individual authentication is performed by the authentication unit 207 and the authentication unit 222 by collating the information with the pulse information detected by the pulse information detection unit 204 and the body temperature information detected by the body temperature information detection unit 220 (step S89).

  The control unit 208 can select two modes. When the first mode is selected, when the personal authentication of both the authentication unit 207 and the authentication unit 222 is successful (step S90, Yes), the control unit 208 finally determines that the personal authentication is successful, A signal to that effect is output (step S91). In other cases, the control unit 208 finally determines that personal authentication has failed and performs control to stop the process. As described above, when the personal authentication by the vein pattern is successful and the personal authentication by two types of biometric information is further successful, it is determined that the personal authentication is finally successful. Authentication can be prevented more reliably, and the accuracy of authentication when a living body is used can be further improved, and extremely strong security can be achieved.

  When the second mode is selected, as indicated in parentheses in step S90 of FIG. 18, the control unit 208 finally succeeds in personal authentication when at least one of the authentication units 207 and 222 succeeds. When both the personal authentications by the authentication units 207 and 222 fail, it is finally determined that the personal authentication has failed. Therefore, the second mode has a reduced security strength compared to the first mode. Thus, the security strength can be adjusted by switching between the two modes.

Even if it is determined in step S82 that it is not a living body and only one of the determination pulse information and body temperature information is determined not to be abnormal, the determination result in step S85 is set to No, and the process proceeds. In S89, it is possible to take an aspect in which only personal authentication based on pulse information or body temperature information determined not to be abnormal is performed, and when the personal authentication is successful, it is finally determined that the personal authentication is successful. . Such an embodiment is also encompassed by the present invention.

  As is apparent from the above description, this embodiment corresponds to an embodiment of the invention described in claims 2, 3, 9, and 11.

[Other Embodiments]

  The present invention includes an embodiment in which vein information and other pulse information and skin color information, which are biometric information having individual differences, are detected as information for personal authentication. The personal authentication device according to such an embodiment performs, for example, the personal authentication using the pulse information detection unit 204, the pulse information storage unit 203, and the pulse information according to the first embodiment in the configuration according to the second embodiment. The authentication unit 207 to be performed can be added.

  The present invention includes an embodiment for detecting vein pattern and other skin information such as skin color information and body temperature information as information for personal authentication. The personal authentication device according to such an embodiment includes, for example, the configuration according to the second embodiment, the temperature sensor 30 according to the third embodiment, the body temperature information detection unit 220, the body temperature information storage unit 221, and the body temperature information. It is possible to adopt a configuration in which an authentication unit 222 for performing personal authentication according to is added.

  The present invention also includes an embodiment for detecting vein pattern and other skin information such as skin color information and blood flow information as information for personal authentication. The personal authentication device according to such an embodiment includes, for example, the configuration according to the second embodiment, the blood flow sensor 40 according to the fourth embodiment, the blood flow information detection unit 230, and the blood flow information storage unit 231. The authentication unit 232 that performs personal authentication based on blood flow information can be added.

  The present invention also includes an embodiment for detecting body temperature information and blood flow information, which are biometric information having individual differences, as vein information, as information for personal authentication. The personal authentication device according to such an embodiment includes, for example, the configuration according to the third embodiment, the blood flow sensor 40 according to the fourth embodiment, the blood flow information detection unit 230, and the blood flow information storage unit 231. The authentication unit 232 that performs personal authentication based on blood flow information can be added.

  Naturally, embodiments in which three or more types of biometric information are detected and used for personal authentication are also included in the present invention.

1 is a configuration explanatory diagram of a personal authentication device according to a first embodiment of the present invention. FIG. It is a figure which shows the example of a simulation of the compound eye image imaged. It is a flowchart for demonstrating the whole operation | movement of the personal authentication apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows the pulse pattern which plotted the pixel number of the vein part in a time series image. It is a flowchart of a pulse information detection process. It is a flowchart of the process which reconfigure | reconstructs from a compound eye image to a single image. It is a figure explaining the difference degree of the block matching for detecting the shift of an image. It is the figure which showed typically the method of reconstructing a single image from a compound eye image based on an image shift. It is composition explanatory drawing of the personal authentication apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart for demonstrating the whole operation | movement of the personal authentication apparatus which concerns on the 2nd Embodiment of this invention. It is composition explanatory drawing of the personal authentication apparatus which concerns on the 3rd Embodiment of this invention. It is a flowchart for demonstrating the whole operation | movement of the personal authentication apparatus which concerns on the 3rd Embodiment of this invention. It is composition explanatory drawing of the personal authentication apparatus which concerns on the 4th Embodiment of this invention. It is a flowchart for demonstrating the whole operation | movement of the personal authentication apparatus which concerns on the 4th Embodiment of this invention. It is composition explanatory drawing of the personal authentication apparatus which concerns on the 5th Embodiment of this invention. It is a flowchart for demonstrating the whole operation | movement of the personal authentication apparatus which concerns on the 5th Embodiment of this invention. It is structure explanatory drawing of the personal authentication apparatus which concerns on the 6th Embodiment of this invention. It is a flowchart for demonstrating the whole operation | movement of the personal authentication apparatus which concerns on the 6th Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Light source 2 Visible light cut filter 3 Lens array 4 Light-shielding member 5 Imaging element 13 Subject (finger or palm)
14 vein 20 RGB filter 30 temperature sensor 40 blood flow sensor 100a, 100b imaging optical system 201 image storage unit 202 vein pattern information storage unit 203 pulse information storage unit 204 pulse information detection unit 205 image reconstruction unit 206, 207, 212, 222 , 232 Authentication unit 208 Control unit 210 Skin color information detection unit 211 Skin color information storage unit 220 Body temperature information detection unit 221 Body temperature information storage unit 230 Blood flow rate information detection unit 231 Blood flow rate information storage unit

Claims (11)

A personal authentication device that performs personal authentication using a human finger or palm as a subject,
Vein pattern reading means for reading the vein pattern of the subject;
Biological information detection means for detecting a predetermined type of biological information that is unique to a living body and has individual differences, other than a vein pattern, from the subject;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Biometric information storage means for storing the predetermined type of biometric information about one or more registrants;
The first personal authentication for the subject is performed by collating the vein pattern read by the vein pattern reading means or the feature thereof with the vein pattern or the feature stored in the vein pattern information storage means. A first authentication means;
And comparing the biological information stored in the biological information storage means for the registrant authenticated by the first personal authentication with the biological information detected by the biological information detection means, Second authentication means for performing second personal authentication for
A personal authentication device characterized by comprising: The biological information detecting means detects a predetermined plurality of types of biological information,
The biological information storage means stores the predetermined plural types of biological information,
The second authentication means includes a plurality of types of biometric information stored in the biometric information storage means for the registrant authenticated by the first personal authentication, and a plurality of types detected by the biometric information detection means. The personal authentication apparatus according to claim 1, wherein the second personal authentication is performed on the subject by collating the biometric information with the same type of biometric information. The vein pattern reading means includes
A light source for irradiating the subject with light;
A lens array facing the subject;
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
Image reconstruction means for reconstructing a single image of the vein pattern from the compound eye image captured by the imaging means;
The personal authentication device according to claim 1 or 2, characterized by comprising: A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with light,
A lens array facing the subject,
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
Image reconstruction means for reconstructing a single image of the vein pattern of the subject from a compound eye image captured by the imaging means;
Pulse information detecting means for detecting pulse information of the subject based on a plurality of compound eye images continuously taken at predetermined time intervals by the imaging means or a single eye image of a part thereof;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Pulse information storage means for storing pulse information about one or more registrants;
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by comparing the pulse information stored in the pulse information storage means for the registrant authenticated by the first personal authentication with the pulse information detected by the pulse information detection means, Second authentication means for performing second personal authentication for
A personal authentication device characterized by comprising: A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with near infrared light and visible light;
A lens array facing the subject,
A visible light cut filter for preventing visible light from entering a lens other than the predetermined lens in the lens group of the lens array;
A compound eye of a vein pattern of the subject that is positioned on the image plane side of the lens array and is imaged by a lens other than the predetermined lens of the lens array in a state where the subject is irradiated with light from the light source. A first imaging means for capturing an image;
Second imaging that images an image formed by the predetermined lens of the lens array as a color image in a state where the object is irradiated with light from the light source and located on the image plane side of the lens array means,
Image reconstruction means for reconstructing a single image of the vein pattern from a compound eye image captured by the first imaging means;
Skin color information detecting means for detecting skin color information of the subject from a color image captured by the second imaging means;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Skin color information storage means for storing skin color information for one or more registrants;
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by comparing the skin color information stored in the skin color information storage means for the registrant authenticated by the first personal authentication with the skin color information detected by the skin color information detection means. , Second authentication means for performing second personal authentication on the subject,
A personal authentication device characterized by comprising: A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with light,
A lens array facing the subject,
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
Image reconstruction means for reconstructing a single image of the vein pattern from a compound eye image captured by the imaging means;
Body temperature information detecting means for detecting body temperature information from the subject using a temperature sensor;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Body temperature information storage means for storing body temperature information about one or more registrants,
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by comparing the body temperature information stored in the body temperature information storage unit for the registrant authenticated by the first personal authentication with the body temperature information detected by the body temperature information detection unit, Second authentication means for performing second personal authentication for
A personal authentication device characterized by comprising: A personal authentication device that performs personal authentication using a human finger or palm as a subject,
A light source for irradiating the subject with light,
A lens array facing the subject,
An imaging unit that is located on the image plane side of the lens array and that captures a compound eye image of the vein pattern of the subject that is imaged by the lens array in a state in which the subject is irradiated with light from the light source;
Image reconstruction means for reconstructing a single image of the vein pattern from a compound eye image captured by the imaging means;
Blood flow information detecting means for detecting blood flow information from the subject using a blood flow sensor;
Vein pattern information storage means for storing vein patterns or characteristics thereof for one or more registrants;
Blood flow information storage means for storing blood flow information on one or more registrants;
By comparing the vein pattern or its feature in the single image reconstructed by the image reconstruction means with the vein pattern or its feature stored in the vein pattern information storage means, A first authentication means for performing one personal authentication;
And by collating the blood flow information stored in the blood flow information storage means for the registrant authenticated by the first personal authentication with the blood flow information detected by the blood flow information detection means. , Second authentication means for performing second personal authentication on the subject,
A personal authentication device characterized by comprising: Blood flow information detecting means for detecting blood flow information from the subject using a blood flow sensor;
Blood flow information storage means for storing blood flow information on one or more registrants;
By collating the blood flow information stored in the blood flow information storage means for the registrant authenticated by the first personal authentication with the blood flow information detected by the blood flow information detection means, The personal authentication apparatus according to claim 4, further comprising third authentication means for performing third personal authentication on the subject. Body temperature information detecting means for detecting body temperature information from the subject using a temperature sensor;
Body temperature information storage means for storing body temperature information about one or more registrants,
By comparing the body temperature information stored in the body temperature information storage means for the registrant authenticated by the first personal authentication with the body temperature information detected by the body temperature information detection means, 5. The personal authentication apparatus according to claim 4, further comprising third authentication means for performing third personal authentication. A personal authentication method for performing personal authentication using a human finger or palm as a subject,
A vein pattern reading step for reading the vein pattern of the subject;
A biological information detection step of detecting information related to any one of pulse, skin color, body temperature, and blood flow (hereinafter referred to as biological information) from the subject;
By comparing the vein pattern read by the vein pattern reading step or the feature thereof with the vein pattern or the feature of one or more registrants stored in the vein pattern information storage means, A first authentication step for performing one personal authentication;
And by comparing the biological information detected by the biological information detection means with the biological information stored in the biological information storage means for the registrant authenticated by the first personal authentication. A second authentication step for performing a second personal authentication;
A personal authentication method characterized by comprising: A personal authentication method for performing personal authentication using a human finger or palm as a subject,
A vein pattern reading step for reading the vein pattern of the subject;
A biological information detection step of detecting information on any two or more of pulse, epidermis color, body temperature, and blood flow (hereinafter referred to as biological information) from the subject;
By comparing the vein pattern read by the vein pattern reading step or the feature thereof with the vein pattern or the feature of one or more registrants stored in the vein pattern information storage means, A first authentication step for performing one personal authentication;
And the biometric information stored in the biometric information storage means for the registrant who has been authenticated by the first personal authentication and the biometric information detected by the biometric information detection step between the same types of biometric information. A second authentication step for performing second personal authentication on the subject by collating;
A personal authentication method characterized by comprising:

Images