KR101021838B1 - Imaging apparatus and method for authentication of user - Google Patents

Abstract

The user authentication imaging apparatus can quickly perform the matching step of the input biometric data. The user authentication imaging device includes an imaging unit for imaging the guided finger and the guided palm, a matching data storage unit for storing the predetermined finger image and the predetermined palm image, and a finger image and a stored finger image and a stored palm image And a matching unit to match the palm image. The matching unit selects a finger image having a similar feature amount based on the picked up finger image and authenticates the user based on a result of matching the palm image corresponding to the selected finger image with the picked up palm image.

User authentication imaging device, biometric data, matching unit

Description

Imaging Apparatus and Method for User Authentication {IMAGING APPARATUS AND METHOD FOR AUTHENTICATION OF USER}

The present invention relates to an imaging device that authenticates a user based on biometric data obtained by imaging.

Background Art [0002] In the biometric data authentication technique for authenticating an individual using image data of a finger, a system for matching a skin pattern or a blood vessel pattern such as a fingerprint with previously stored data has already been proposed. In addition, in the biometric data authentication technology for authenticating a user using a palm, a system for matching a skin pattern such as a palm pattern or a blood vessel pattern of a palm with previously stored data is also known. For example, for ATMs installed in banks, a user is authenticated by using biometric data of a finger or palm as described above.

On the other hand, in today's market of ATMs, each bank installs a user authentication imaging device which loads only one or both of finger and palm biometric data authentication technologies. ATMs need to be prepared for use in many banks and must provide biometric data imaging (input) devices for both fingerprint and palm patterns. As a result, this makes ATM more expensive and hinders its widespread use.

In the background as described above, Japanese Patent Laid-Open No. 2003-85538, which is already filed as a prior art of the present invention, discloses a method of using a fingerprint as biometric data as a prior art of a contactless biometric data imaging device.

In addition, Japanese Patent Laid-Open No. 7 (1995) -21373 discloses a method of using blood vessels of a finger as biometric data.

In addition, Japanese Patent Laid-Open No. 2006-107401 discloses a method of using a blood vessel of a palm as biometric data.

However, the user authentication imaging device disclosed in the patent document uses different optical systems and imaging units, respectively. Therefore, the user authentication imaging device must use a plurality of input units and imaging units for implementing a plurality of biometric data authentication techniques for fingerprint and palm pattern, for example. Therefore, the user authentication imaging device has a problem that it is difficult to achieve miniaturization and cost reduction.

In addition, when the user authentication device uses single biometric data, the authentication result depends on the user's body state, skin condition, and blood pressure at the time of imaging, thereby causing a problem that the user authentication device cannot obtain stable authentication accuracy.

In addition, selecting at least one image data matched with the imaging data from a large amount of data requires a matching step for each image of the pre-stored image data. Thus, in this case, the problem that a long time is also required for the matching step remains unsolved.

It is an object of the present invention to provide a user authentication imaging device capable of quickly performing a matching step of biometric data.

According to an aspect of the present invention, a finger guide unit for guiding an imaging area of a finger, a palm guide unit for guiding an imaging area of a palm, an imaging unit for imaging biometric data of the guided finger and an imaging area of a palm, at least one And an image storage unit for storing the finger image and the at least one palm image, and a matching unit for matching the captured finger data and the captured palm data with the stored finger image and the stored palm image. And the matching unit comprises: a selection unit for selecting a stored finger image having a similar feature amount (value) based on the captured finger data and the stored palm image corresponding to the selected finger image; Matched to the data Based on the referred result further includes an authentication unit to authenticate a user.

According to one aspect of the present invention, a finger imaging step of imaging an imaging area of a finger guided by a finger guide unit, a finger image matching step of matching the imaging data of a finger obtained by the imaging step with stored finger image data, and palm guidance A palm imaging step of imaging the imaging area of the palm guided by the unit, a palm image matching step of matching the imaging data of the palm obtained by the imaging step with the stored palm image data, and the finger image data and the palm image data A user authentication imaging method is provided which includes a matching step of matching a user based on a matching result of.

According to one aspect of the present invention, a finger imaging function for scratching a scratch area of a finger guided by a finger guide unit, a finger image matching function for matching the captured finger data obtained by the imaging function with stored finger data, a palm Palm imaging function for imaging the imaging area of the palm guided by the guide unit, palm image matching function for matching the captured palm data obtained by the imaging function with the stored palm image data, and the finger image data and the palm A computer readable medium is provided which records a program capable of causing a computer to execute an authentication function for authenticating a user based on a matching result of matching image data.

According to one aspect of the invention, an imaging unit for imaging the biometric data of the imaging area of the user's palm and finger, an image storage unit for storing at least one finger image and at least one palm image from the same user, and the captured image A user authentication imaging device is provided that includes a matching unit for matching finger data and the imaged palm data with the stored finger image data and the stored palm image data, wherein the matching unit includes a numerical value associated with the imaged finger data. A selection unit for selecting a finger image from the storage unit based on a comparison of numerical values associated with the stored finger image, and a result of matching the captured palm data with the stored palm image data corresponding to the selected finger image And an authentication unit that authenticates the user based on that.

According to the present invention, the total process for matching and authenticating a user can be executed quickly, ensuring high security for the authentication process, and achieving higher authentication accuracy than the authentication system in the prior art using a single biometric data. It is possible to provide an inexpensive and compact imaging device that can be obtained.

Other features and advantages of the present invention will become more apparent from the following detailed description and the accompanying drawings.

In the drawings, like reference numerals refer to like structural elements.

Hereinafter, the first embodiment of the present invention will be described in detail.

First, the basic structural elements of the first embodiment of the present invention will be described. As shown in FIG. 1, an imaging device (hereinafter referred to as an "imaging device") 100 for imaging the biometric data of an exemplary embodiment, for example, an imaging such as a camera provided inside the imaging device 100. Unit 104 is installed. In addition, the imaging device 100 includes a fingertip guide unit 102 and a finger root guide unit 103. These fingertip guide units 102 and finger root guide units 103 guide the imaging unit 104 to the imaging region of the fingerprint and finger blood vessel pattern of the finger to a position suitable for the imaging step. The imaging device 100 also includes a palm guidance unit 101. The palm guide unit 101 guides the palm pattern and the blood vessel pattern of the palm to a position suitable for the imaging step. The fingertip guide unit 102, the finger root guide unit 103, and the palm guide unit 101 are installed on the upper portion of the imaging device 100.

When imaging a finger with the imaging device 100, the tip of the user's finger is located on the fingertip guide unit 102, and at the same time the root of the associated finger (finger root) is located on the finger root guide unit 103. do. Thus, the user's finger is guided to a position suitable for the imaging step by the imaging unit 104.

In addition, the finger roots of the user's hands are located on the palm guidance unit 101. As a result, the palm of the user is guided to a position suitable for the imaging step by the imaging unit 104.

Here, the position of the imaging area of the palm guided by the palm guide unit 101 is smaller than the position of the imaging area of the finger guided by the fingertip guide unit 102 and the finger root guide unit 103. Is set on the side farther from). For example, the palm guide unit 101 is located at a position farther than the positions of the fingertip guide unit 102 and the finger root guide unit 103 in the imaging direction of the imaging unit 104. As a result, the guided finger is positioned between the position of the guided palm and the imaging unit 104.

Thus, since the distance to the imaging unit 104 of the imaging area of the guided palm becomes longer than in the imaging area of the guided finger, the palm can be imaged to a wider area than the imaging area of the finger. Thus, the accuracy of biometric authentication based on palm image data can be improved.

In addition, the fingertip guide unit 102, the finger root guide unit 103, and the palm guide unit 101 are set and arranged so that the positions of the image capturing regions of the guided finger and palm overlap in the vertical direction. Therefore, the occupation area of the imaging device 100 can be set small. As a result, the cost and space required for installation of the imaging device can be reduced.

Palm guide unit 101 includes recessed areas 201, 202, 203. When the imaging unit 104 picks up the palm pattern and blood vessel of the palm, the root portions of the three center fingers (forefinger, middle finger, and weak finger) of the user's palm are on these concave regions as shown in FIG. 4. Each is located. As a result, the imaging area of the palm is guided, whereby the imaging unit 104 can image the imaging area of the palm.

The fingertip guide unit 102 and the finger root guide unit 103 guide a finger. When the imaging unit 104 picks up the fingerprint and blood vessel pattern of the user's finger, the fingertip is positioned on the fingertip guide unit 102 and the root of the finger is the finger root guide unit 103 as shown in FIG. 5. Is located on. As a result, the imaging area of the finger is guided and the imaging unit 104 can obtain data of the imaging area of the finger.

Here, the vertical cross section which includes the imaging unit 104 of the imaging device 100 is shown to FIG. 2 (a), and sectional drawing along the line AA of FIG. 2 (a) is shown to FIG. 2 (b). .

Here, the light source 208 for the fingerprint and palm pattern is formed in a planar shape, and as shown in (a) and (b) of FIG. 2, on a single surface of the side (front side) of the fingertip of the device. Is placed. The light source 208 for the fingerprint and palm pattern emits light to image the fingerprint or palm pattern by radiating onto the fingerprint portion of the finger or the palm pattern of the palm. In view of imaging the fingerprint and palm pattern formed through the concave and convex areas on the surface of the skin, it is preferable that the shadow and the convex area are formed to be shaded on the surface of the skin. 208 preferably emits light in only one direction.

The fingerprint and palm pattern light source 208 is preferably formed as a short wavelength light source that is difficult for imaging of blood vessels. In addition, when considering the elimination of the effect of disturbing the light, the light source 208 for the fingerprint and palm pattern may provide a long wavelength of near infrared rays that may be provided by the light source 209 for blood vessels. If both the light source 208 for the fingerprint and palm pattern and the light source for the blood vessel 209 provide similar long wavelength light, a sufficient contrast can be achieved through the arrangement in which a single light source for the fingerprint and palm pattern emits light in only one direction ( contrast can be obtained. In addition, the influence of external light that interferes with the identification of the fingerprint and palm pattern can be sufficiently suppressed by processing the imaging data.

The vessel light source 209 is formed as a linear light source and is disposed on the inner side surfaces of the left and right sides of the imaging device, respectively. The light source 209 for blood vessels radiates near-infrared rays to the guided finger and palm, thereby imaging blood vessels of the finger and palm.

Further, for imaging the blood vessel pattern of the finger and the palm, the blood vessel light source 209 emits light from both directions to both the finger and the palm as the image pickup object, so that the concave on the surface of the skin for the data obtained by the imaging step and Possible prevention of the appearance of shadows of the fingerprint and palm pattern formed by the convex areas.

The imaging unit 104 has a function of generating respective image data by imaging a fingerprint and a blood vessel pattern of a finger or a palm pattern and a blood vessel pattern of a palm.

Here, the imaging unit 104 is composed of an image sensor such as a CCD and a CMOS, a control system, and a lens optical system that focuses an image of a finger and a palm on the image sensor. The imaging unit 104 also includes an AD converter or the like for converting an image focused on the image sensor by the imaging step into image data.

In addition, the imaging unit 104 is provided with a plurality of imaging modes. For example, the imaging unit 104 has a finger imaging mode in which an appropriate focal length and shutter speed for imaging a finger are preset, and a palm imaging mode in which an appropriate focal length and shutter speed, etc. for imaging a palm are preset. Have

In addition, the imaging device 100 is connected to the imaging unit 104 as shown in FIG. 3. The imaging device 100 includes an image processing unit 204 for selecting image data generated by the associated imaging unit 104, a matching unit 205 for storing image feature quantities (data) such as blood vessel patterns, and an imaging unit. A control unit 210 or the like connected to 104 to control the imaging mode of the associated imaging unit 104.

The image processing unit 204 selects a fingerprint, a palm pattern, and image feature amounts of fingers and palms from the image data obtained by the imaging unit 104. The image processing unit 204 has an image feature variable selection function for transmitting the selected feature variable data to the matching unit 205.

Here, the image processing unit 204 is configured of a microcomputer or the like. The image processing unit 204 processes image data of a fingerprint of a finger and a palm pattern of a palm and a blood vessel image.

The matching unit 205 has an image data matching function that matches the image feature variable data transmitted from the image processing unit 204 based on the prestored image feature variable data.

The control unit 210 is connected to the imaging unit 104 as shown in FIG. 3 and provides an imaging mode control function for controlling the imaging mode of the imaging unit 104.

Here, the control unit 210 may be provided with a gradation mode setting function for setting the imaging mode of the imaging unit 104 based on the image data transmitted from the image processing unit 204. In this case, the control unit 210 obtains the image data obtained by the imaging step and checks the gradation of one or a plurality of different pixels preset in this image data. Thus, the focused image can be determined as a finger image or a palm image.

For example, the control unit 210 obtains the gradation of the plurality of pixels in the portion picked up to either the right side or the left side of the imaging data based on the imaging data. The control unit 210 may determine that the acquired image represents an image of a finger focused only at the center of the image when the gradation is completely “black”.

In addition, the control unit 210 may determine that when the preset pixel exhibits a completely "white" gradation, the entire portion of the screen of image data represents the focused image. Thus, this image can be determined as an image of a palm with a broadly focused image.

The imaging object may be determined as an image of a finger or a palm as described above, and the imaging mode of the imaging unit 104 may be set to an imaging mode suitable for the imaging object.

Further, the control unit 210 is connected to the palm guidance unit 101 and the fingertip guidance unit 102 so that when the finger roots are located, for example, on the palm guidance unit 101, that is, the palm guidance unit When 101 guides the palm, it provides a guide detection function that detects the palm on the palm guidance unit 101 via, for example, a sensor. Therefore, when detecting that the hand is located on the palm guidance unit, the imaging object can be determined as the palm and the imaging mode of the imaging unit 104 can be set to an imaging mode suitable for the imaging object (palm).

For example, when the fingertip is positioned on the finger guide unit 102, that is, when the finger guide unit 102 guides the finger, the control unit 210 is positioned on the finger guide unit with the guide detection function. Detect the finger and determine that the imaging object is a finger. Here, the imaging mode of the imaging unit 104 can be set (changed) to an imaging mode suitable for an imaging object (palm).

Therefore, the imaging apparatus 100 can effectively secure the security of personal authentication by imaging the fingerprint, palm pattern, finger blood vessel pattern, and palm blood vessel pattern.

Further, by imaging and authenticating a fingerprint of a finger, a blood vessel, and a palm pattern and a blood vessel of a palm with only one imaging unit, it is possible to provide a compact and inexpensive biometric data imaging apparatus.

On the other hand, the influence on the authentication caused by the appearance of specific characteristics or features of different image data in all the imaging units used in the imaging step can be controlled by imaging a plurality of different biometric data with the same imaging unit 104. have.

The control unit 210 also has a fingerprint position estimation and detection function that detects (expects) the position of the fingerprint as a relative position of the image of the finger blood vessel pattern image picked up by controlling the imaging unit 104. Therefore, based on the image of the finger blood vessel pattern image and the palm vein pattern image, the imaging region of the fingerprint and the palm pattern can be predicted and identified as a relative position.

The matching unit 205 has an image matching function for matching stored images such as stored fingerprints, palm patterns, and blood vessel patterns with the captured data.

The matching unit 205 selects the stored finger blood vessel image (vascular image of the authentication candidate of the finger) that matches the stored feature amount by matching the stored finger blood vessel image in the matching data storage unit 211 with the transmitted finger blood vessel feature image. It also has a function to select.

The matching unit 205 selects a feature amount in the transmitted feature image data. In addition, the matching unit 205 further has a function of performing 1: N matching with the stored images N based on this feature amount. Also, the matching unit 205 selects a candidate image similar to the feature amount as the feature amount by selecting the stored image matched from the plurality of feature quantities. In other words, the matching unit 205 has a candidate image selection function for performing coarse feature quantity matching according to a preset matching level. Thus, matching unit 205 can quickly select an authentication candidate image from many stored images.

When the image sent to the matching unit 205 is a palm image (palm vein pattern, palm pattern image) obtained by imaging a pattern, the image data of the palm is larger in image size than the image data of the finger, so that the image data of the palm Is in the matching phase for a longer time. Accordingly, the matching unit 205 may specifically determine the palm image stored as the object of the matching step by matching the fingerprint of the finger or the blood vessel or both the fingerprint and the blood vessel of the finger with the stored data. Therefore, the time required for the palm matching step can be reduced.

In addition, here, the level of matching of the matching unit 205 can be variably set. For example, the feature amount is set using fine set points (many set points). Thus, the number of stored images specified (selected) by the matching step can be limited.

Next, the operation of the user authentication biometric data imaging apparatus 100 will be described later.

First, the imaging unit 104 picks up the guided finger and the palm. The matching unit 205 matches the captured finger image data with the stored finger image data to select a stored finger image having a similar feature amount (finger image matching and selection step). The matching unit 205 then matches the stored palm image corresponding to the selected stored finger image with the captured palm data (palm matching step).

In the meantime, the processing step may be performed as described below. That is, the imaging unit 104 picks up the imaging area of the guided finger (imaging step) and roughly matches the imaging data of the finger obtained in this imaging step with the stored finger image data (coarse matching step of the finger image). ). Here, the imaging mode set by the imaging unit 104 is changed to the palm imaging mode for imaging the palm (imaging mode changing step). Next, the imaging unit 104 picks up the imaging area of the palm guided by the palm guide unit 101 (palm imaging step). Thereafter, the matching unit 205 authenticates the user by matching the stored palm image corresponding to each selected and stored finger image with the imaged palm data (palm image matching step) (palm authentication step).

The finger image matching and selection step, palm matching step, finger imaging step, wide-area finger image matching step, imaging mode changing step, palm imaging step, and palm authentication step, respectively, are carried out by the computer through the introduction of the program of such execution contents. It may be suitably configured. In this exemplary embodiment, in this order, the finger vein pattern image, the fingerprint image, the palm vein pattern image, and the palm pattern image photographed to authenticate the user are matched and determined. However, matching and authentication of the user may be allowed through the combination of the finger vein pattern image, the palm vein pattern image and the palm pattern image, and the combination of the fingerprint image, the palm vein pattern image and the palm pattern image. Meanwhile, the matching and authentication step may also be performed by using a combination of the finger vein pattern image, the palm vein pattern image and the palm pattern image, and the combination of the fingerprint image, the palm vein pattern image and the palm pattern image. In addition, the matching and authentication step may be performed by using a combination of the finger vein pattern image, the fingerprint image and the palm vein pattern image, and a combination of the finger vein pattern image, the fingerprint image and the palm pattern image.

Therefore, wide-area matching with the stored image can be performed quickly based on the finger image (fingerprint blood vessel pattern image, fingerprint image) of the small imaging area. In addition, the matching step may be performed based on the palm image (palm veins, palm pattern image). As a result, a reduction in the total time required to authenticate the user can be realized.

As an exemplary embodiment described above, the operation of the imaging device 100 will be described in detail based on the flowchart of FIG. 6. First, the imaging unit 104 picks up the finger blood vessel pattern of the guided finger (step S101: finger blood vessel imaging step). In this case, the user's finger is located on the fingertip guide unit 102 and the finger root guide unit 103 as shown in FIG. 5. In this way, the fingers located on the fingertip guide unit 102 and the finger root guide unit 103 are guided to a position suitable for the imaging step.

It is also possible for the control unit 210 to detect the finger being placed on the fingertip guide unit 102 and the finger root guide unit 103. When the control unit 210 detects a finger located on both guide units, the imaging mode of the imaging unit 104 is set to the finger imaging mode and the imaging unit 104 can image the finger blood vessel pattern of the guided finger. Can be. In addition, the control unit 210 can control the imaging mode of the imaging unit 104 to the finger imaging mode or the palm imaging mode based on the gradation of a specific pixel in the image obtained by the imaging step of the imaging unit 104 here. Can be.

In this case, the control unit 210 determines whether the finger or the palm is correctly positioned on the guide unit for the imaging step, based on the gradation of the specific pixel in the imaged data. For example, if a pixel set in areas close to both ends of the right and left sides of the captured data has a higher gradation than the preset gradation, i.e. when such pixels are colored black (darker black) than other pixels, the finger is It is determined that it is correctly positioned on the guide unit. On the other hand, when such a pixel has a gradation lower than the preset gradation, that is, when such a pixel is colored less black (light black), it is determined that the palm is located.

Next, the imaging unit 104 picks up the fingerprint of the guided finger (step S102: fingerprint imaging step). Here, by the control unit 210 controlling the imaging unit 104 before the fingerprint imaging step, it is permissible to detect (expect) the position of the fingerprint as a relative position of the imaged finger blood vessel pattern data. Since the range of retrieval of the fingerprint as the image pickup object is limited by the above-described steps, the retrieval time of the fingerprint position and the time required for image pickup of the fingerprint can be effectively reduced. Further, the central area of the fingerprint can be effectively retrieved and set based on the relative position of the image of the finger blood vessel pattern data captured. As a result, the quality of the captured fingerprint data can be further improved.

Next, the imaging unit 104 transmits the imaged finger blood vessel pattern data to the image processing unit 204 (step S103). Thereafter, the image processing unit 204 selects the feature amount of the image based on this finger blood vessel pattern image to generate finger blood vessel feature variable data. The image processing unit 204 also transmits this finger blood vessel feature variable image data to the matching unit 205 (step S104: finger blood vessel feature variable image generation step).

The matching unit 205 then matches the stored finger blood vessel storage image in the matching data storage unit 211 with the transmitted finger blood vessel feature quantity image. The matching unit 205 also selects (selects) a stored finger blood vessel image (authentication candidate finger blood vessel image) matching the stored feature amount (step S105: authentication candidate finger blood vessel image selection step). Here, the matching unit 205 also selects the feature amount of the transmitted finger vein feature amount image 1 and performs 1: N matching with the stored finger vein image N based on the selected feature amount. For example, the matching unit 205 selects the finger blood vessel storage image matched with the fine feature amount as the feature amount. As described above, the matching unit 205 selects candidate images having similar feature amounts from the stored image data. In other words, the matching unit 205 executes the wide area feature variable matching step. Thus, matching unit 205 can quickly select an authentication candidate image from many stored images.

Here, it may also be allowed that the matching level of the matching unit 205 can be set variably. For example, the number of stored (selected) images to be identified by the matching step may be limited through the fine setting of the (many) feature quantities.

The imaging unit 104 then transfers the captured fingerprint data to the image processing unit 204 (step S106). The image processing unit 204 selects a feature amount based on this fingerprint image, generates a fingerprint feature variable image, and transfers this fingerprint feature variable image to the matching unit 205 (step S107: fingerprint feature variable image generation) step). The above-described processing steps 106 to 107 can be set to be executed after step S103. Thus, the image processing unit 204 may transfer the feature amount of the captured fingerprint to the matching unit 205 during the finger vessel candidate image selection step of step S105. As a result, the total matching time can be shortened.

The matching unit 205 then matches the transmitted fingerprint feature variable image with each stored fingerprint image corresponding to the selected finger blood vessel storage image (step S108: authentication candidate fingerprint image selection step).

When the user who previously stored his biometric data is identified as a result of the authentication candidate finger blood vessel image selection step of step S105, the matching unit 205 mutually matches the identified stored fingerprint image with the fingerprint feature variable data. Due to such 1: 1 matching (1: 1 blood vessel matching), user authentication can be performed.

Here, the matching unit 205 matches each fingerprint image corresponding to each selected stored finger blood vessel image with fingerprint data based on the feature amount points (eg, five points) included in the captured fingerprint image. (Fingerprint matching step). In addition, the matching unit 205 selects an authentication candidate fingerprint image having the feature amount point data that matches or is close to the aforementioned feature amount point data. Accordingly, the matching unit 205 further selects a limited area of the authentication candidate image from the selected authentication candidate fingerprint image based on the position of the feature amount point data.

Here, the matching level of the matching step performed by the matching unit 205 may be set variably. For example, a plurality of feature variable point data of fingerprint data is set. As a result, the number of authentication candidate images selected by the relevant matching step is then limited to a small number.

Subsequently, the imaging unit 104 picks up the palm vein pattern (step S109: palm vein imaging step). By way of example, the palm of the user is located on the palm guidance unit as shown in FIG. 6.

Here, the control unit 210 detects that the finger roots are located on the palm guidance unit 101. The control unit 210 can set the imaging mode of the imaging unit 104 to the finger imaging mode. The imaging unit 104 may image the blood vessel pattern of the guided palm.

On the other hand, the control unit 210 can set the imaging mode of the imaging unit 104 to the palm imaging mode based on the gradation of specific pixels in the image data obtained by the imaging unit 104.

In this case, the control unit 210 determines whether the finger or the palm is positioned on the guide unit, based on the gradation of the specific pixel in the image data. For example, if the pixel set in the area near the left and right ends at the center of the image obtained by the imaging step has a gradation higher than that of the current same pixel, that is, the pixel is colored more black (dark black), the finger It is determined that it is located on this guide unit. It is also determined that the palm is positioned on the guide unit when the relevant pixel has a lower gradation than the gradation of the current same pixel, ie when the pixel is colored less black (light black). Thereafter, the imaging unit 104 picks up the palm pattern of the guided hand (step S110: fingerprint imaging step).

The imaging unit 104 then transfers the captured palm vein pattern image to the image processing unit 24 (step S111).

Here, the image processing unit 204 selects a feature amount of the image based on this palm vein pattern image and generates a palm vein feature amount image. In addition, the image processing unit 204 transfers this palm vein feature amount image to the matching unit 205 (step S111: Palm vein feature amount image generation step). Subsequently, the matching unit 205 matches the stored palm vein image corresponding to the authentication candidate fingerprint image selected from the palm vein image stored in the matching data storage unit 211 with the transmitted fingerprint feature variable image (step S112: Palm vein). Matching step).

Here, the matching unit 205 is based on the feature amount included in the imaged palm vein pattern image in the palm vein image corresponding to the selected authentication candidate fingerprint image, in view of selecting an authentication candidate palm vein image matched in the feature amount. By performing matching of the palm vein pattern. Accordingly, the matching unit 205 may additionally perform the limited selection of the authentication candidate image based on the feature amount of the palm vein pattern from the selected authentication candidate image.

Here, the matching unit 205 can variably set its matching level. For example, many feature quantities of palm vein pattern data may be set (matching level is raised). As a result, the number of authentication candidate images selected by narrow matching may be limited to a small number.

When the user who stored the biometric data is identified as a result of the authentication candidate finger blood vessel image selection step of step S105 or the authentication candidate fingerprint image selection step of step S108, the matching unit 205 associates the identified stored fingerprint image with a fingerprint feature variable image. Match each other. In addition, the matching unit 205 may authenticate and determine the user through 1: 1 matching (1: 1 palm vascular matching).

The imaging unit 104 then transfers the captured palm pattern image to the image processing unit 204 (step S113).

Here, the image processing unit 204 generates a palm pattern feature amount image by selecting the feature amount of the image based on this palm pattern image. The image processing unit 204 also transmits this palm pattern feature variable image to the matching unit 205 (step S114: palm pattern feature variable image generation step).

Then, the matching unit 205 executes matching between the input palm pattern feature variable image and each stored palm pattern image corresponding to the selected authentication candidate palm vein image (step S115: palm pattern matching step).

Here, the matching unit 205 further performs matching based on the feature amount data included in the palm pattern feature variable image in the stored palm pattern image corresponding to the selected authentication candidate blood vessel pattern image described above. The matching unit 205 also identifies only one stored palm pattern image that is matched in its feature data.

Here, in the case where the matching unit 205 has identified only one palm pattern data, authentication of the user can be completed successfully. Further, when the biometric data image of only one user is identified as a result of the palm vein matching step of step S112, the matching unit 205 narrows down to only one user and stores the stored palm pattern image corresponding to the vein image of the selected authentication candidate. May be matched in a 1: 1 matching step based on the palm pattern feature amount image and the feature value point data included in both images (palm pattern matching step).

Here, the palm pattern data is matched as a result of the 1: 1 matching step, and the authentication of the user is completed successfully. On the other hand, if the palm pattern data does not match, it means failure of authentication.

As described above, in the exemplary embodiment of the present invention, the biometric data imaging device captures biometric data of the finger and the palm and performs wide-area matching with the stored finger image based on the captured finger image, thereby matching the palm image. Authenticate the user via As a result, the total process for matching and authenticating the user can be executed quickly. In addition, the user can be authenticated using only data of an image of a finger and a palm image photographed without input of an ID by the user. As a result, high security can be ensured in the authentication process.

Further, in an exemplary embodiment of the present invention, the biometric data imaging device performs authentication of a user by combining biometric data of fingers and palms. Therefore, higher authentication accuracy can be obtained than in the prior art authentication system using single biometric data.

In the exemplary embodiment described above, the photographed finger blood vessel pattern image, fingerprint image, palm vein pattern image, and palm pattern image are set in this order to be used in the matching step for authentication of the user. However, it is also possible to make a setting for authentication of a user by combining a finger vein pattern image or fingerprint image with a palm vein pattern image or palm pattern image, respectively.

As described above, the user can be authenticated using the imaging data of the finger and the palm without inputting the ID by the user. As a result, higher security is ensured for authentication. In addition, it is possible to realize a user authentication process with higher authentication accuracy than prior art authentication systems using single biometric data.

In addition, in an exemplary embodiment of the present invention, a single imaging unit 104 may image biometric data of fingers and palms. Therefore, the present invention can provide an image capturing apparatus that is cheaper and smaller than an apparatus combining a plurality of image capturing units.

The common and single imaging unit 104 picks up the fingerprint and blood vessel pattern of the finger and the palm pattern and blood vessel pattern of the palm. Thus, an image can be obtained based on image quality under common optical conditions.

The present invention can be applied to an authentication device for authenticating a user based on biometric data of a finger and a palm prior to use of an ATM and a personal computer, and a personal authentication system used when an individual enters or exits a room or a building.

While the invention has been described in conjunction with the preferred embodiments described above, those skilled in the art will now be able to practice the invention in a variety of other ways.

1 is a perspective view of a schematic structure showing a user authentication imaging device as an exemplary embodiment of the present invention.

2 (a) and 2 (b) are views of the internal structure of FIG. 1, FIG. 2 (a) is a vertical sectional view including an imaging means, and FIG. 2 (b) is a Section according to line AA.

Fig. 3 is a schematic block diagram showing the internal structure of a user authentication imaging device as an exemplary embodiment of the present invention.

4 is a side view of a finger imaging step in the user authentication imaging device as an embodiment of the present invention.

Fig. 5 is a side view of the palm image pickup step in the user authentication image pickup device as an exemplary embodiment of the present invention.

Fig. 6 is a flowchart showing overall operation processing steps in a user authentication imaging device as an exemplary embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

101: palm guide unit 102: fingertip guide unit

103: finger root guide unit 104: imaging unit

201, 202, 203: recessed area 208: light source for fingerprint and palm pattern

209: light source for blood vessel

Claims (16)

A palm guide unit for guiding the imaging area of the palm; A finger guide unit for guiding an imaging area of a finger; An imaging unit which picks up biometric data of the imaging area of the user's palm and finger; An image storage unit for storing at least one finger image and at least one palm image; And A matching unit for matching the photographed finger and the photographed palm data with the stored finger image and the stored palm image, The matching unit, A selection unit that selects a finger image from the storage unit based on the feature amount of the captured finger data and the feature amount of the stored finger image; And And an authentication unit for authenticating a user based on a result of matching the stored palm image corresponding to the selected finger image with the photographed palm data. The method of claim 1, The imaging unit, A finger imaging function for imaging a fingerprint and finger blood vessel pattern; And Has more palm imaging function to image palm pattern and palm vessel pattern, The authentication unit further comprises a switching unit for switching the imaging mode back and forth between the finger imaging mode and the palm imaging mode. The method of claim 2, The matching unit, A biometric data storage unit for storing at least one finger blood vessel pattern image and at least one palm blood vessel pattern image linked to each other; A matching unit matching the captured finger blood vessel pattern with the stored blood vessel pattern image; And Selecting a finger blood vessel pattern from the biometric data storage unit, wherein the feature amount of the selected finger blood vessel pattern corresponds to the feature amount of the photographed finger blood vessel pattern; The matching unit matches the palm vein pattern corresponding to each of the selected finger vein pattern image with the photographed palm vein pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage configured to store at least one finger blood vessel pattern image and at least one palm pattern image linked to each other; A matching unit matching the captured finger blood vessel pattern with an image of the stored blood vessel pattern; And Selecting a finger blood vessel pattern from the biometric data storage unit, wherein the feature amount of the selected finger blood vessel pattern corresponds to the feature amount of the photographed finger blood vessel pattern; The matching unit matches the palm pattern corresponding to each of the selected finger blood vessel pattern images with the photographed palm pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage configured to store at least one fingerprint image and at least one palm vein pattern image linked to each other; A matching unit matching the captured fingerprint with the stored fingerprint image; And And selecting a fingerprint image from the biometric data storage, wherein the feature amount of the selected image corresponds to the feature amount of the imaged fingerprint. The matching unit matches the palm vein pattern corresponding to each of the selected fingerprint images with the photographed palm vein pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage unit for storing at least one fingerprint image and at least one palm pattern image linked to each other; A matching unit matching the captured fingerprint with the stored fingerprint image; And And selecting a fingerprint image from the biometric data storage, wherein the feature amount of the selected image corresponds to the feature amount of the photographed fingerprint. The matching unit matches the palm vein pattern corresponding to each of the selected fingerprint images with the photographed palm vein pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage configured to store at least one fingerprint image, at least one finger blood vessel pattern image, and at least one palm blood vessel pattern image linked to each other; A matching unit matching the captured fingerprint with the stored fingerprint image based on the finger blood vessel pattern image and the fingerprint image; And Selecting a fingerprint image and a finger blood vessel pattern image from the biometric data storage unit, wherein the feature amount of the selected image corresponds to a feature amount of the captured fingerprint and the image of the finger blood vessel pattern; The matching unit matches the palm vein pattern corresponding to each of the selected fingerprint image and the finger vein pattern image with the photographed palm vein pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage configured to store at least one fingerprint image, at least one finger blood vessel pattern image, and at least one palm pattern image linked to each other; A matching unit matching the captured fingerprint with the stored fingerprint image based on the finger blood vessel pattern image and the fingerprint image; And Selecting a fingerprint image and a finger blood vessel pattern image from the biometric data storage unit, wherein the feature amount of the selected image corresponds to a feature amount of the captured fingerprint and the image of the finger blood vessel pattern; The matching unit matches the palm pattern corresponding to each of the selected fingerprint images and finger blood vessel pattern images with the photographed palm pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage configured to store at least one finger blood vessel pattern image, at least one palm blood vessel pattern image, and at least one palm pattern image linked to each other; A matching unit to match the captured finger blood vessel pattern with the stored finger blood vessel pattern image; And Selecting a finger blood vessel pattern image from the biometric data storage unit, wherein the feature amount of the selected image corresponds to the feature amount of the photographed blood vessel pattern; The matching unit matches the palm vein pattern and the palm pattern corresponding to each of the selected finger vein pattern images with the photographed palm vein pattern and the photographed palm pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage configured to store at least one fingerprint image, at least one palm vein pattern image, and at least one palm pattern image linked to each other; A matching unit matching the captured fingerprint with the stored fingerprint image; And And selecting a fingerprint image from the biometric data storage, wherein the feature amount of the selected image corresponds to the feature amount of the photographed fingerprint. The matching unit matches the palm vein pattern and the palm pattern corresponding to each of the selected fingerprint images with the photographed palm vein pattern and the photographed palm pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 2, The matching unit, A biometric data storage configured to store at least one fingerprint image, at least one finger blood vessel pattern image, at least one palm blood vessel pattern image, and at least one palm pattern image linked to each other; A matching unit for matching the photographed fingerprint and the photographed finger blood vessel pattern with the stored fingerprint image and the stored finger blood vessel pattern image; And Selecting a fingerprint image and a finger blood vessel pattern image from the biometric data storage unit, wherein the feature amount of the selected image corresponds to the feature amount of the captured fingerprint and the image of the finger blood vessel pattern; The matching unit matches a palm vein pattern and a palm pattern corresponding to each of the selected fingerprint image and the finger vein pattern image with the photographed palm vein pattern and the photographed palm pattern, The matching unit further comprises a palm authentication function for authenticating a user based on the matching result. The method of claim 7, wherein And a setting unit for setting the position of the imaging area with respect to the fingerprint based on the finger blood vessel pattern image. The method of claim 9, And a setting unit for setting a position of an imaging area with respect to the palm pattern based on the palm vein pattern image. (a) imaging the biometric data of the user's finger and the palm guided by the palm guide unit and the finger guide unit; (b) matching the captured finger data with stored finger data stored in a storage unit; (c) selecting a finger image from the storage unit based on the feature amount of the captured finger data and the feature amount of the stored finger data; (d) matching a palm image corresponding to the selected finger image from the storage unit with the captured palm data; And (e) authenticating a user based on the matching result. A computer readable medium embodying a program for executing a user authentication method on a device, The user authentication method, (a) imaging the biometric data of the user's finger and the palm guided by the palm guide unit and the finger guide unit; (b) matching the captured finger data with stored finger data stored in a storage unit; (c) selecting a finger image from the storage unit based on the feature amount of the captured finger data and the feature amount of the stored finger data; (d) matching a palm image corresponding to the selected finger image from the storage unit with the captured palm data; And (e) authenticating a user based on the matching result. An imaging unit which picks up biometric data of an imaging area of a user's palm and finger; An image storage unit for storing at least one finger image and at least one palm image from the same user; And A matching unit for matching the photographed finger data and the photographed palm data with the stored finger image data and the stored palm image data; The matching unit, A selection unit for selecting a finger image from the storage unit based on a comparison of the numerical value associated with the captured finger data with the numerical value associated with the stored finger image; And And an authentication unit for authenticating a user based on a result of matching the photographed palm data with the stored palm image data corresponding to the selected finger image.

Images