JP4409541B2 - Image processing apparatus, personal authentication method, and image processing method - Google Patents

Description

  The present invention relates to an authentication apparatus for authenticating an individual, and more particularly, to a technique for authenticating using vein information of a living body.

  In recent years, security for personal information has been regarded as important. Biometric authentication is attracting attention as a personal authentication technology that protects security. Biometric authentication is a technology for authenticating using human biometric information, and is excellent in convenience and confidentiality.

  As a conventional biometrics authentication technique, authentication using a fingerprint, an iris, a voice, a face, a vein on the back of a hand, or a finger vein is known. In particular, in biometric authentication using veins, authentication can be performed simply by a user presenting a part of a living body such as a hand or a finger to an authentication device. Therefore, biometric authentication using a vein (vein authentication device) has a low psychological resistance to the user. Furthermore, since the vein authentication apparatus uses internal information of the living body, it is excellent in forgery resistance.

  Hereinafter, a finger vein authentication device will be described in particular.

  First, the finger vein authentication device irradiates a finger with infrared light. Then, infrared light is scattered inside the finger and then transmitted to the outside. Then, the finger vein authentication device images infrared light transmitted from the palm side of the finger.

  At this time, hemoglobin in the blood absorbs infrared light more than the surrounding tissue. Therefore, the image captured by the finger vein authentication device visualizes blood vessels (finger veins) distributed under the skin on the palm side of the finger as dark shadow patterns (finger vein patterns).

  The finger vein authentication device registers the characteristics of this finger vein pattern in advance.

  The finger vein authentication device captures an image of a finger presented by a user during authentication. Then, the finger vein authentication device performs personal authentication by obtaining a correlation between the finger vein pattern of the captured image and a pre-registered feature.

  However, the conventional finger vein authentication device images a finger inserted into the device. Therefore, the user feels resistance because the user has to insert a finger into the closed internal space of the finger vein authentication device.

  Therefore, a finger vein authentication device that solves this problem is described in Japanese Patent Application Laid-Open No. 2004-265269. In this finger vein authentication device, infrared light sources for irradiating a finger are installed on both sides of the finger. As a result, the user can authenticate only by placing his finger on the apparatus.

  However, this finger vein authentication device has a problem in that it cannot be miniaturized because a space for installing a light source is required on the side of the finger.

  On the other hand, a vein authentication apparatus having a planar structure is described in International Publication No. 2002/099393 pamphlet.

In this vein authentication apparatus, a light source is installed on the same plane as the image sensor with respect to a vein to be photographed.
JP 2004-265269 A International Publication No. 2002/099393 Pamphlet

  However, a vein authentication device that installs a light source on the same plane as the imaging element also captures light reflected by the surface of the finger skin. For this reason, the vein authentication apparatus has a problem that it cannot capture a vein pattern clearly.

  Accordingly, the present invention has been made in view of the above-described problems, and an object thereof is to provide a vein authentication device that can capture a clear vein pattern and can be miniaturized.

  The present invention is an image processing apparatus, wherein a first light source, a second light source, and an imaging unit that are located on the opposite side of the finger with respect to the surface of the image processing apparatus facing the imaged finger, An opening provided on the surface; and a processing unit that extracts a blood vessel pattern of the finger from an image of light transmitted through the finger that has been imaged by the imaging unit, and the first and The second light source is arranged side by side in the longitudinal direction of the imaged finger across the opening, and each of the first and second light sources is arranged in the width direction of the imaged finger. It is characterized by comprising a plurality of light source elements.

  The vein authentication apparatus of the present invention can capture a vein pattern clearly. Furthermore, the size can be reduced.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the embodiment of the present application, a finger vein authentication device will be described in particular. However, the present invention can be applied to other living bodies such as palms.
(First embodiment)
FIG. 1 is a configuration diagram of an authentication system according to the first embodiment of this invention.

  The authentication system includes an input device 2, an authentication processing unit 10, a storage device 14, a display unit 15, an input unit 16, a speaker 17, and an image input unit 18.

  The input device 2 will be described later with reference to FIGS. 3A, 3B, and 3C. The input device 2 includes a light source 23 and an imaging device 29.

  The light source 23 is, for example, an infrared LED, and irradiates the finger 1 presented on the input device 2 with infrared light. The imaging device 29 images the finger 1 presented on the input device 2.

  The image input unit 18 inputs an image captured by the imaging device 29 of the input device 2 to the authentication processing unit 10.

  The authentication processing unit 10 includes a CPU 11, a memory 12, and an interface (IF) 13.

  The CPU 11 performs various processes by executing a program stored in the memory 12. As will be described later with reference to FIG. 2, the memory 12 stores a program executed by the CPU. The memory 12 temporarily stores the image input from the image input unit 18.

  The interface 13 is connected to a device external to the authentication processing unit 10. Specifically, the interface 13 is connected to the input device 2, the storage device 14, the display unit 15, the input unit 16, the speaker 17, the image input unit 18, or the like.

  The storage device 14 stores user verification data in advance. The collation data is information for collating users, and is, for example, an image of a finger vein pattern. The finger vein pattern image is an image of blood vessels (finger veins) distributed under the skin on the palm side of the finger as dark shadow patterns.

  The display unit 15 is, for example, a liquid crystal display, and displays information received from the authentication processing unit 10.

  The input unit 16 is a keyboard or the like, for example, and transmits information input from the user to the authentication processing unit 10. The speaker 17 transmits the information received from the authentication processing unit 10 by voice.

  Hereinafter, an authentication process of the authentication system according to the present embodiment will be described.

  First, a user who requests authentication presents the finger 1 to the input device 2. Then, the light source 23 installed in the input device 2 irradiates the finger 1 with infrared light. This infrared light is scattered in all directions inside the finger 1.

  The imaging device 29 installed in the input device 2 captures infrared light emitted from the palm side of the finger. Then, the imaging device 29 inputs the captured image to the authentication processing unit 10 via the image input unit 18.

  Then, the authentication processing unit 10 stores the input image in the memory 12. Then, feature data is extracted from the image stored in the memory 12.

  Next, the authentication processing unit 10 acquires authentication data stored in advance in the storage device 14 from the storage device 14. Note that the authentication processing unit 10 may acquire only authentication data corresponding to information (for example, a user ID) input from the input unit 16 from the storage device 14. Next, the acquired authentication information is stored in the memory 12.

  Next, the authentication processing unit 10 collates the extracted feature data with the authentication data acquired from the storage device 14. Specifically, the person who presented the finger 1 to the input device 2 is specified by calculating the correlation value between the feature data and the authentication data.

  And the authentication process part 10 performs the process corresponding to the specified person.

  As described above, the authentication system according to the present embodiment authenticates the user.

  FIG. 2 is a block diagram of the memory 12 of the authentication processing unit 10 according to the first embodiment of this invention.

  The memory 12 stores a finger detection program 121, a light amount control program 122, a feature extraction program 123, a feature data pasting program 124, a feature matching program 125, and the like.

  The finger detection program 121 determines whether or not the finger 1 is placed on the input device 2.

  The light quantity control program 122 controls the light quantity of the light source 23.

  The feature extraction program 123 extracts feature data from the image captured by the imaging device 29.

  The feature data combining program 124 combines the feature data extracted by the feature extraction program 123 and the feature data extracted in the past.

  The feature collation program 125 collates the feature data pasted by the feature data pasting program 124 with the authentication data stored in the storage device 14.

  FIG. 3A is a side view of the input device 2 according to the first embodiment of this invention. FIG. 3B is a front view of the input device 2 according to the first embodiment of this invention. FIG. 3C is a plan view of the input device 2 according to the first embodiment of this invention.

  The input device 2 of the present embodiment will be described by taking a sweep type finger vein authentication device as an example. The sweep type finger vein authentication device captures an image of the entire finger 1 when the user moves the finger 1.

  Two finger rests 25 are installed in the upper part of the input device 2 as an interface for installing a living body to be imaged. The two finger rests 25 are installed so as to provide the opening 30.

  In addition, the opening part 30 should just be transparent with respect to infrared light, may be a mere space, and may be a member transparent with respect to infrared light. Further, the opening 30 makes the width of the finger 1 in the longitudinal direction narrower than the length of the finger 1. Thereby, the input device 2 can be reduced in size.

  The finger rest 25 may be configured integrally with the input device 2 or may be configured separately from the input device 2. The finger rest 25 is made of a material that is opaque to infrared light.

  In addition, the finger rest 25 has a curved shape that matches the shape of the finger 1 (see, for example, FIG. 3B). The finger rest 25 has a shape with a recessed center.

  As a result, the user can place a finger at a predetermined position. Furthermore, the user can move the finger 1 stably. As a result, the authentication accuracy of the authentication system according to the present embodiment can be improved.

  Further, the finger rest 25 may have a planar shape instead of a curved recess. In this case, the finger rest 25 has no unevenness. Thereby, the upper part of the input device 2 can be made into a planar structure. The finger rest 25 is an example of an interface on which a finger is presented at the time of authentication. The interface may have any shape as long as the finger 1 is presented at the time of authentication.

  A light source 23 is installed below the finger rest 25. The light source 23 irradiates the finger 1 with infrared light. The light source 23 emits light with an optical axis 231 in a direction substantially parallel to the imaging direction 320 of the imaging device 29. Note that the imaging direction 320 is the direction of the optical axis taken by the imaging device 29.

  In this explanatory diagram, four light sources 23 are arranged below each finger rest 25 in a direction substantially perpendicular to the longitudinal direction of the finger 1. The number of the light sources 23 is not limited as long as the finger 1 can be irradiated with sufficient intensity.

  However, a plurality of light sources 23 are arranged side by side in a direction substantially perpendicular to the longitudinal direction of the finger 1 so that the entire finger 1 can be irradiated with uniform brightness. Furthermore, the longitudinal width of the finger 1 of the input device 2 can be reduced. In addition, it is the same even if it installs the light source 23 of one elongate shape in the substantially perpendicular | vertical direction with respect to the longitudinal direction of a finger | toe instead of installing the several light source 23 side by side.

  Further, the CPU 11 of the authentication processing unit 10 controls the amount of infrared light emitted from the light source 23 by executing a light amount control program 122. For example, when the joint part is placed on the finger rest 25, the authentication processing unit 10 weakens the light amount. Further, when the thick part of the finger 1 is placed on the finger rest 25, the amount of light is increased.

  The authentication processing unit 10 may control all the light sources 23 to the same light amount. In this case, the authentication processing unit 10 may control the light source 23 with one current. Therefore, an authentication system can be created at low cost.

  Further, the authentication processing unit 10 may control each light source 23 to a different light amount. In this case, the authentication processing unit 10 controls the light source 23 with a plurality of different currents. Therefore, the cost of the authentication system increases. However, since each light source 23 emits light with an appropriate amount of light, the imaging device 29 can capture a clear image with little unevenness in brightness.

  Further, the authentication processing unit 10 may control the light amount different between the light source 23 installed on the finger rest 25 on the base side of the finger 1 and the light source 23 installed on the finger rest 25 on the fingertip side. Good. In this case, the authentication processing unit 10 may control the light source 23 with two currents. Therefore, an authentication system can be created at low cost. Furthermore, the imaging device 29 can capture a clear image with little unevenness in brightness.

  A plurality of light sources 23 may be installed side by side in the longitudinal direction of the finger 1.

  A plurality of light sources 23 may be arranged in a planar shape. In this case, the authentication processing unit 10 increases the light amount of the light source 23 far from the opening 30 and weakens the light amount of the light source 23 near the opening 30. Thereby, the imaging device 29 can capture a clear image with little unevenness of brightness.

  An acrylic plate 34 is installed in the opening 30. The acrylic plate 34 is a material transparent to infrared light. The acrylic plate 34 prevents foreign matter including fingers and dust from entering the input device 2.

  Light shielding members 32 are installed on both sides of the upper portion of the opening 30. The light shielding member 32 prevents external light from entering the opening 30. For example, the light shielding member 32 is installed so as to cover both sides of the finger 1.

  When the influence of external light is small, the light shielding member 32 is not necessary. Further, when the upper portion of the input device 2 needs to have a planar structure, the light shielding member 32 is not necessary.

  An imaging device 29 and an infrared transmission filter 27 are installed inside the input device 2.

  The infrared transmission filter 27 is installed between the acrylic plate 34 and the imaging device 29. The infrared transmission filter 27 transmits only infrared light.

  The imaging device 29 images infrared light that has passed through the opening 30, the acrylic plate 34, and the infrared transmission filter 27 from the outside of the input device 2. The imaging device 29 is installed directly below the opening 30 and upward.

  A mirror or the like may be installed inside the input device 2. In this case, the imaging device 29 can be installed in an arbitrary position and an arbitrary direction. Thereby, the input device 2 can reduce the height. This is because the distance between the opening 30 and the imaging device 29 can be adjusted by changing the path of infrared light entering from the opening 30 with a mirror or the like.

  A planar light receiving element may be installed in the opening 30. The light receiving element detects infrared light. In this case, the input device 2 can be planarized because the acrylic plate 34, the infrared transmission filter 27, and the imaging device 29 can be omitted.

  Hereinafter, processing of the input device 2 will be described.

  First, the user who requests authentication presents the finger 1 on the finger rest 25. Then, the light source 23 irradiates the finger 1 with infrared light. This infrared light is scattered in all directions inside the finger. Therefore, part of the infrared light scattered inside the finger reaches near the upper portion of the opening 30. Further, a part of the infrared light that reaches near the upper part of the opening travels outside the finger 1.

  The infrared light that has traveled to the outside of the finger 1 passes through the opening 30, the acrylic plate 34, and the infrared transmission filter 27 and reaches the imaging device 29. The imaging device 29 images the reached infrared light.

  The infrared light imaged by the imaging device 29 is transmitted from the inside of the finger 1 to the palm-side surface of the finger 1. For this reason, the infrared light imaged by the imaging device 29 includes a weak part attenuated by transmitting through the finger vein and a strong part not attenuated by transmitting through the part without the finger vein. Yes. That is, the infrared light imaged by the imaging device 29 includes a contrast difference due to finger veins.

  Therefore, the imaging device 29 can acquire an image of the finger vein pattern of the partial region (imaged portion) of the finger 1 located directly above the opening 30 by imaging the infrared light.

  The opening 30 of the input device 2 of the present embodiment has a narrow width in the longitudinal direction of the finger. Therefore, the user moves the finger 1 in the longitudinal direction of the finger 1 with the finger 1 placed on the finger rest 25. At this time, the imaging device 29 of the input device 2 continuously captures an imaged portion. And the authentication process part 10 acquires the whole image of the finger vein pattern of the finger | toe 1 by synthesize | combining the several image imaged with the imaging device 29. FIG.

  In order for the imaging device 29 of the input device 2 to clearly capture an image of the finger vein pattern of the imaged portion, it is desirable that the following optical conditions be satisfied.

  One is that the imaging device 29 does not image infrared light reflected by the skin surface of the finger 1. The other is that the imaging device 29 does not image infrared light scattered without reaching the depth at which the finger vein exists.

  If the optical condition is not satisfied, infrared light that does not include information on the finger vein pattern reduces the contrast of the finger vein pattern. Furthermore, the image of the finger vein pattern includes unnecessary information such as wrinkles on the skin surface of the finger 1 and becomes unclear.

  In order to satisfy the optical condition, the finger rest 25 is installed between the light source 23 and the opening 30. The finger rest 25 is made of a material that is opaque to infrared light.

  The light source 23 emits infrared light with a spread (directivity). Therefore, if the finger rest 25 is made of a material that is transparent to infrared light, the infrared light from the light source 23 directly reaches the imaged portion above the opening 30. And since the infrared light which reached | attained the to-be-imaged part directly reflects on the skin surface of the to-be-imaged part and reaches | attains the imaging device 29, it does not satisfy | fill optical conditions. Therefore, the finger rest 25 must be made of a material that is opaque to infrared light.

  The inner wall of the input device 2, the filter 27, the imaging device 29, and the acrylic plate 34 are preferably made of a material that does not reflect infrared light. This is because infrared light traveling from the inside of the finger 1 to the outside is reflected inside the input device 2 so as not to reach the surface of the finger 1 again.

  Furthermore, in order to satisfy the optical conditions, the finger rest 25 covers more than half of the upper part of the light source 23 on the opening 30 side. Thereby, the imaging device 29 is hardly affected by infrared light scattered without reaching the depth at which the finger vein exists (for example, infrared light scattered near the surface of the finger 1), and the finger vein pattern is not affected. Images can be taken.

  Hereinafter, the reason will be described.

  FIG. 4A is an explanatory diagram of an effect of the shape of the finger rest 25 according to the first embodiment of this invention.

  In this explanatory diagram, the finger rest 25 covers more than half of the upper part of the light source 23 on the opening 30 side. Thereby, the infrared light from the light source 23 faces the opposite side of the opening 30.

  The finger rest 25 may be installed so that the spread of infrared light from the light source 23 does not include the imaging direction 320. That is, the finger rest 25 is installed so that all components of the infrared light from the light source 23 face the opposite side of the opening 30. Note that the spread of infrared light from the light source 23 is a range between the boundary lines 322. The imaging direction 320 is the direction of the optical axis taken by the imaging device 29.

  In the present embodiment, the light source 23 emits light with the direction substantially parallel to the imaging direction 320 as the optical axis.

  Next, the infrared light path in this case will be described.

  First, infrared light from the light source 23 reaches the finger 1. Then, a part of the infrared light reaching the finger 1 is reflected on the surface of the finger 1 skin. Further, part of the infrared light travels inside the finger 1.

  The infrared light reflected from the surface of the skin of the finger 1 is blocked by the finger rest 25 and does not reach the upper part of the opening 30.

  A portion 326 of the infrared light traveling inside the finger 1 is scattered without reaching the depth at which the finger vein 62 exists. Further, the part 324 of the infrared light is scattered after reaching the depth where the finger vein 62 exists.

  The infrared light 326 scattered without reaching the depth at which the finger vein 62 exists changes the traveling direction. However, very little infrared light reaches the upper portion of the opening 30 in the infrared light 326. This is because most components of the infrared light that has traveled to the finger 1 face the opposite side of the opening 30.

  A part of the infrared light 324 scattered after reaching the depth where the finger vein 62 exists is absorbed by the finger vein 62. Further, part of the infrared light 324 reaches the upper portion of the opening 30. As a result, the infrared light 324 reaches the upper portion of the opening 30 while retaining information on the finger vein pattern.

  Therefore, the imaging device 29 can capture an image of the finger vein pattern by capturing the infrared light 324. At this time, the imaging device 29 greatly reduces the influence of the infrared light 326 scattered without reaching the depth at which the finger vein 62 exists and the infrared light reflected on the skin surface of the finger 1, thereby reducing the finger vein. A pattern image can be taken.

  FIG. 4B is an explanatory diagram of an effect of the shape of the finger rest 25 according to the first embodiment of this invention.

  In this explanatory diagram, the finger rest 251 is different from the finger rest 25 of this embodiment in that no light shielding member is present above the light source 23. The infrared light path in the case of this finger rest 251 will be described to compare with the finger rest 25 of the present embodiment.

  In this case, the spread of infrared light from the light source 23 is a range between the boundary lines 327 and includes the imaging direction 320. That is, the infrared light from the light source 23 includes a component that faces the opening 30 side.

  Next, the infrared light path in this case will be described.

  The infrared light path is the same as the infrared light path (FIG. 4A) in the case of the finger rest 25 except for the infrared light 326 scattered without reaching the depth at which the finger vein 62 exists. . Description of the same path of infrared light is omitted.

  In the case of this explanatory diagram, the infrared light from the light source 23 includes a component that faces the opening 30 side. Therefore, a part of the infrared light 326 scattered without reaching the depth at which the finger vein 62 exists reaches the upper portion of the opening 30.

  That is, if the finger rest 251 does not cover the upper part of the light source 23, the imaging device 29 is affected by the scattered infrared light 326 without reaching the depth at which the finger veins 62 are present when the finger vein pattern image is captured. Will receive. Therefore, the imaging device 29 cannot capture a finger vein pattern image clearly.

  On the other hand, when the finger rest 25 covers more than half of the upper part of the light source 23 on the opening 30 side, the imaging device 29 affects the influence of the scattered infrared light 326 without reaching the depth at which the finger vein 62 exists. Since it is hardly received, a finger vein pattern image can be taken clearly.

  The input device 2 of the present embodiment is a sweep type authentication device. Therefore, the user moves the finger 1 in the longitudinal direction of the finger 1 with the finger 1 placed on the finger rest 25. However, when the user moves the finger 1, it is assumed that the finger 1 is lifted from the finger rest 25. Also in this case, when the finger rest 25 covers more than half of the light source 23 on the opening 30 side, the imaging device 29 can capture a finger vein pattern image clearly.

  Hereinafter, the reason will be described.

  FIG. 5A is an explanatory diagram of an effect of the shape of the finger rest 25 according to the first embodiment of this invention.

  In this explanatory diagram, the finger rest 25 covers more than half of the upper part of the light source 23 on the opening 30 side. Thereby, the infrared light from the light source 23 faces the opposite side of the opening 30.

  The finger rest 25 may be installed so that the spread of infrared light from the light source 23 does not include the imaging direction 320. That is, the finger rest 25 is installed so that all components of the infrared light from the light source 23 face the opposite side of the opening 30. Note that the spread of infrared light from the light source 23 is a range between the boundary lines 322. The imaging direction 320 is the direction of the optical axis taken by the imaging device 29.

  Next, the infrared light path in this case will be described.

  First, infrared light from the light source 23 reaches the finger 1. Then, a part of infrared light 342 reaching the finger 1 is reflected by the surface of the finger 1. Further, a part 324 of the infrared light travels inside the finger 1.

  Note that the path of the infrared light 324 that has traveled into the finger 1 is the same as the path of the infrared light described in FIG. 4A. Therefore, the description is omitted.

  On the other hand, the infrared light 342 reflected from the surface of the finger 1 changes the traveling direction. However, very little infrared light reaches the upper part of the opening 30 in the infrared light 342. This is because the infrared light that has reached the finger 1 faces the opposite side of the opening 30. That is, most components of the infrared light 342 reflected from the surface of the finger 1 travel in the direction opposite to the opening 30.

  FIG. 5B is an explanatory diagram of an effect of the shape of the finger rest 25 according to the first embodiment of this invention.

  In this explanatory diagram, the finger rest 251 is different from the finger rest 25 of this embodiment in that no light shielding member is present above the light source 23. The infrared light path in the case of this finger rest 251 will be described to compare with the finger rest 25 of the present embodiment.

  In this case, the spread of infrared light from the light source 23 is a range between the boundary lines 327 and includes the imaging direction 320. That is, the infrared light from the light source 23 includes a component that faces the opening 30 side.

  Next, the infrared light path in this case will be described.

  The infrared light path is the same as the infrared light path (FIG. 5A) in the case of the finger rest 25 except for the infrared light 342 reflected from the surface of the finger 1. Therefore, description of the same path of infrared light is omitted.

  In the case of this explanatory diagram, the infrared light from the light source 23 includes a component that faces the opening 30 side. Therefore, a part of the infrared light 342 reflected on the surface of the finger 1 reaches the upper part of the opening 30.

  That is, if the finger rest 251 does not cover the upper part of the light source 23, the imaging device 29 is affected by the infrared light 342 reflected on the surface of the finger 1 when the finger vein pattern image is captured. Therefore, the imaging device 29 cannot capture a finger vein pattern image clearly.

  On the other hand, when the finger rest 25 covers more than half of the light source 23 on the opening 30 side, the imaging device 29 is hardly affected by the infrared light 342 reflected on the surface of the finger 1. A pattern image can be clearly captured.

  That is, the finger rest 25 needs to cover the upper part of the light source 23 in order to keep the spread of infrared light from the light source 23 away from the opening 30.

  Note that the width of the finger rest 25 may be sufficiently wide without covering the upper portion of the light source 23. In this case, although the input device 2 is large, the imaging device 29 is affected by the infrared light 326 scattered without reaching the depth at which the finger vein 62 exists and the infrared light reflected by the skin surface of the finger 1. It is possible to take an image of a finger vein pattern with a very small amount.

  Next, an image of the finger vein pattern imaged by the imaging device 29 will be described.

  FIG. 6 is an explanatory diagram of the relationship between the distance from the light source 23 and the luminance value of the finger vein pattern image according to the first embodiment of this invention.

  The graph shown in this explanatory diagram shows the relationship between the distance from the light source 23 and the luminance value of the finger vein pattern image.

  First, a case where the amount of infrared light emitted from the light source 23 is not changed will be described.

  When the distance from the light source 23 is short, the luminance value of the image is high. Then, as the distance from the light source 23 increases, the luminance value of the image decreases. Note that if the distance from the light source 23 is increased at a position where the distance from the light source 23 is short, the luminance value of the image rapidly decreases. On the other hand, even when the distance from the light source 23 is far away from the light source 23, the luminance value of the image gradually decreases.

  The luminance value is divided into one of a high luminance region 184, a visible region 186, and a low luminance region 188.

  If the luminance value is within the range of the high luminance region 184, the authentication processing unit 10 cannot acquire finger vein pattern information from the image. This is because light is saturated in the image.

  If the luminance value is within the visible region 186, the authentication processing unit 10 can acquire finger vein pattern information from the image.

  If the luminance value is within the low luminance region 188, the authentication processing unit 10 cannot acquire finger vein pattern information from the image. This is because the light is too weak in the image.

  That is, the visible region 186 is a range in which the imaging device 29 can detect the intensity of light. Further, the high luminance region 184 and the low luminance region 188 are ranges in which the imaging device 29 cannot detect the intensity of light.

  Next, when the amount of infrared light emitted from the light source 23 is increased, the curve indicating the luminance value of the image moves to the upper right method. That is, when the light amount of the light source 23 is increased, the position that becomes the visible region 186 moves away from the light source 23.

  On the other hand, when the light amount of the infrared light emitted from the light source 23 is weakened, the curve indicating the luminance value of the image moves to the lower left method. That is, when the light amount of the light source 23 is weakened, the position that becomes the visible region 186 approaches the light source 23.

  This explanatory diagram is a luminance value of an image by the light source 23 on the base side of the finger 1. Note that the luminance value of the image by the light source 23 on the fingertip side is a curve obtained by horizontally inverting the curve in this explanatory diagram.

  The luminance value of the image by the light source 23 on the root side of the finger 1 and the light source 23 on the fingertip side is a curve obtained by superimposing these two curves.

  In the present embodiment, the width of the opening 30 is sufficiently narrower than the visible region 186. Therefore, the entire region of the opening 30 can be included in the visible region 186 by adjusting the amount of infrared light emitted from the light source 23.

  Further, the light source 23 may be installed only on either the root side or the fingertip side of the finger 1. Even in this case, since the width of the opening 30 is sufficiently narrower than the visible region 186, the entire region of the opening 30 can be included in the visible region 186. Note that the finger rest 25 may or may not be installed on the side not having the light source 23.

  However, the shift of the finger 1 can be suppressed by installing the finger rest 25 on the side not having the light source. On the other hand, the input device 2 can be further reduced in size by omitting the finger rest 25 and the light source 23 on either the root side or the fingertip side of the finger 1.

  When the width of the opening 30 cannot be included in the visible region 186, the amount of infrared light emitted from the light source 23 is continuously changed. And the imaging device 29 images an image for each light quantity. And the authentication process part 10 acquires the whole image of the width | variety of the opening part 30 by synthesize | combining these images imaged by the imaging device 29. FIG.

  FIG. 7 is a flowchart of the authentication process of the authentication processing unit 10 according to the first embodiment of this invention.

  First, the authentication processing unit 10 determines whether or not the finger 1 is placed on the finger rest 25 by performing finger detection processing (S100) (S110).

  For example, it is determined whether the finger 1 is placed on the finger rest 25 using information from a contact sensor, a temperature sensor, an electrical resistance sensor, a dielectric constant sensor, or the like. Further, it may be determined whether or not the finger 1 is placed on the finger rest 25 using the image captured by the imaging device 29.

  Specifically, a case where an image captured by the imaging device 29 is used will be described. In this case, since the sensor is unnecessary, the authentication system can be constructed at a low cost.

  In this case, the light source 23 is lit at a constant cycle. In addition, the imaging device 29 captures an image at a cycle shorter than the lighting cycle of the light source 23. Then, the imaging device 29 transmits the captured image to the authentication processing unit 10.

  First, the authentication processing unit 10 receives an image from the imaging device 29. Next, the luminance value of the received image is obtained. Next, the amount of change in the luminance value of the image is obtained by comparing the luminance values of the successively received images. Then, based on the obtained change amount of the luminance value of the image, it is determined whether or not the finger 1 is placed on the finger rest 25.

  Specifically, when the change amount of the luminance value of the image is smaller than the threshold value, it is determined that the finger 1 is not placed on the finger rest 25. This is because the infrared light emitted from the light source 23 does not reach the imaging device 29 unless the finger 1 is placed on the finger rest 25.

  On the other hand, when the amount of change in the luminance value of the image is equal to or greater than the threshold, it is determined that the finger 1 is placed on the finger rest 25. This is because when the finger 1 is placed on the finger rest 25, infrared light emitted from the light source 23 is scattered inside the finger 1 and reaches the imaging device 29.

  If it is determined that the finger 1 is not placed on the finger rest 25, there is no need to perform authentication processing, and the process returns to step S100.

  On the other hand, if it is determined that the finger 1 is placed on the finger rest 25, a light amount control process is performed (S120).

  Specifically, the light amount of the light source 23 is controlled so that the luminance value of the image captured by the imaging device 29 approaches the target value. The target value is a luminance value at which the contrast difference between the vein portion and the other tissue portion is maximized. The target value is a constant value regardless of the finger shape and thickness.

  Here, the case where the authentication processing unit 10 separately controls the light source 23 on the fingertip side and the light source 23 on the root side of the finger 1 will be described.

  The authentication processing unit 10 receives an image from the imaging device 29. Next, the average luminance value of the half surface on the fingertip side of the received image and the average luminance value of the half surface on the base side of the finger 1 of the image are obtained.

  Next, the light amount of the light source 23 is controlled according to the obtained average luminance value. Specifically, the light amount of the light source 23 on the fingertip side is controlled so that the average luminance value on the other hand on the fingertip side approaches the target value. Further, the light amount of the light source 23 on the root side of the finger 1 is controlled so that the average luminance value on the other side of the finger 1 approaches the target value.

  The authentication processing unit 10 brings the luminance value closer to the target value by increasing or decreasing the light amount of the light source 23 while feeding back the luminance value of the image. In this case, the value for increasing or decreasing the amount of light from the light source 23 may be a fixed value or may be changed according to the convergence state. Further, the authentication processing unit 10 may estimate the amount of light that brings the luminance value of the image close to the target value based on the characteristics of the imaging device 29 and cause the light source 23 to emit the estimated amount of light.

  Next, feature extraction processing (S130) is performed. The feature extraction processing extracts feature data from an image captured by the imaging device 29, as will be described later with reference to FIGS. 8A, 8B, and 8C.

  Next, feature data pasting processing (S140) is performed. Note that the feature data pasting process is described later with reference to FIG. 9, but the extracted feature data and past feature data are pasted together.

  Next, it is determined whether or not the size of the pasted feature data is greater than or equal to a threshold value (S150). Note that the threshold value is the size of feature data required for collation.

  Specifically, the movement amount of the finger 1 can be obtained in the feature data combining process (S140). Then, based on the obtained movement amount of the finger 1, it is determined whether or not the size of the feature data is greater than or equal to a threshold value.

  If the size of the feature data is smaller than the threshold value, the feature matching process cannot be performed, and the process returns to step S120.

  On the other hand, if the size of the feature data is greater than or equal to the threshold value, a feature matching process (S160) is performed.

  In step S150, it may be determined whether or not the moving speed of the finger 1 has become slower than the threshold value. In this case, if the size of the feature data is equal to or greater than the threshold and the moving speed of the finger 1 is slower than the threshold, the feature matching process (S160) is performed.

  Note that since the amount of movement of the finger 1 differs depending on the length of the finger, the finger 1 may be able to move even when the size of the feature data exceeds the threshold value. In this case, the feature data is continuously taken until the finger 1 stops or immediately before the stop. Then, the feature matching process (S160) is started when the feature data is acquired up to the maximum size. As a result, the recognition rate can be further increased.

  Specifically, the feature data pasted in step S140 and the authentication data stored in the storage device 14 are collated.

  For example, the similarity between the feature data and the authentication data is calculated. If the calculated similarity is equal to or greater than the threshold, the person is authenticated as a person corresponding to the authentication data.

  Then, the authentication process ends.

  Note that the feature data pasted in the feature data pasting process (S140) may be distorted. In this case, the authentication processing unit 10 performs feature matching processing (S160) using a matching method that takes distortion into consideration.

  The collation method considering distortion includes a method of collating while enlarging or reducing an image, a method of comprehensively determining a result of dividing an image into a plurality of pieces and independently collating each area. In the method of collating while enlarging or reducing the image, the distortion in the moving direction of the finger 1 is appropriately corrected by increasing the expansion / contraction rate in the longitudinal direction of the finger 1.

  Hereinafter, the feature extraction process (S130) of the authentication processing unit 10 will be described.

  FIG. 8A is an explanatory diagram of the finger vein 62 imaged by the imaging device 29 according to the first embodiment of this invention.

  The finger veins 62 are distributed throughout the finger 1. The imaging device 29 images the finger 1 on which the opening 30 is presented. That is, the imaging device 29 images the finger vein 62 included in the range of the opening 30.

  FIG. 8B is an explanatory diagram of an image 64 captured by the imaging device 29 according to the first embodiment of this invention.

  The image 64 is an image captured by the imaging device 29. The image 64 shows the finger 1 and the finger vein 62 included in the range of the opening 30.

  The authentication processing unit 10 extracts the range of the opening 30 from the image 64 captured by the imaging device 29.

  The range of the opening 30 may be set in advance or may be automatically determined by the authentication processing unit 10.

  Here, a method in which the authentication processing unit 10 automatically measures the range of the opening 30 will be described.

  The authentication processing unit 10 determines the range of the opening 30 based on the difference in luminance on the image captured by the imaging device 29. However, the image is an image captured in a state where the light source 23 emits light and the finger 1 is placed on the finger rest 25.

  Next, the authentication processing unit 10 extracts a finger vein pattern image from the extracted image of the range of the opening 30.

  Specifically, a finger vein pattern image is extracted using a general image processing method. Common image processing methods include a dark line tracking method, a line pattern enhancement method using filter processing, or a line pattern extraction method based on the curvature of the luminance profile curve of an image.

  The authentication processing unit 10 may extract a finger vein pattern image after performing finger contour detection processing on the extracted image in the range of the opening 30. In the finger contour detection process, the contour of the finger 1 is detected by distinguishing the finger region from other regions. The authentication processing unit 10 can extract the finger vein pattern image with high accuracy by performing the finger contour detection process in advance.

  Specifically, the outline of the finger 1 is detected using a general image processing technique. A general image processing method is edge enhancement processing or contour tracking processing.

  For example, the authentication processing unit 10 controls the light source 23 to blink. At this time, the imaging device 29 captures an image when the light source 23 is turned on and an image when the light source 23 is turned off and inputs the image to the authentication processing unit 10.

  The authentication processing unit 10 obtains each luminance value from the input image when the light source 23 is turned on and the image when the light source is turned off. Then, an area having a large difference between the luminance value of the image when the light source 23 is turned on and the luminance value when the light source 23 is turned off is detected as a finger area. As described above, the authentication processing unit 10 can stably detect the outline of the finger 1 by comparing the image when the light source 23 is turned on and the image when the light source 23 is turned off.

  In addition, the contour of the finger 1 may be detected by the following method. The imaging device 29 captures an image in a state where the light amount of the light source 23 on one side of the finger 1 is strong and the light amount on the opposite side is weak. Next, the imaging device 29 captures an image in a state in which the intensity of the light source 23 is switched. The imaging device 29 inputs these captured images to the authentication processing unit 10.

  The authentication processing unit 10 detects an area having a large difference in luminance value between these input images as a finger area.

  Next, the authentication processing unit 10 converts the extracted finger vein pattern image into feature data.

  FIG. 8C is an explanatory diagram of the feature data 66 converted by the authentication processing unit 10 according to the first embodiment of this invention.

  The feature data 66 is information used for collation with the collation data stored in the storage device 14.

  The feature data 66 indicates the correspondence between the position (x coordinate) on the image and the luminance value. The x axis is a direction substantially perpendicular to the longitudinal direction of the finger 1. The feature data 66 in this explanatory diagram relates to the area 65 on the image 64 (FIG. 8B).

  The feature data 66 has a plurality of minimum points 68. The minimum point 68 is the position of the finger vein. This is because the blood in the finger vein absorbs infrared light from the light source 23.

  The feature data may be an image of a finger vein pattern used in template matching, or may be line segment structure information. The line segment structure information includes information related to the branch points and end points of the finger veins, and is information obtained by abstracting information related to the finger veins.

  Hereinafter, the feature data combining process (S140) of the authentication processing unit 10 will be described.

  FIG. 9 is an explanatory diagram of the feature data pasting process (S140) of the authentication processing unit 10 according to the first embodiment of this invention.

  In this explanatory diagram, a case where the feature data is an image of a finger vein pattern used in template matching will be described as an example. The same applies to the case where the feature data is other information including line segment structure information and the like.

  The authentication processing unit 10 pastes the feature data extracted by the feature extraction process (S130). Here, a case where the authentication processing unit 10 pastes the feature data 80 extracted from the image 64 of the frame N onto the feature data 82 extracted from the images from the frame 1 to the frame N−1 will be described. Here, the frame N indicates the order of images captured by the imaging device 29. Note that an image in which the imaging device 29 first images the finger 1 is referred to as a frame 1.

  First, the authentication processing unit 10 superimposes on the feature data 82 extracted from the images up to the frame N−1 while moving the position of the feature data 80 extracted from the image 64 of the frame N.

  Next, the authentication processing unit 10 obtains a matching degree between the feature data 80 of the frame N and the feature data 82 up to the frame N-1 at each position where the feature data 80 is moved. Next, a deviation amount of the finger 1 is obtained based on the degree of matching of the obtained feature data. Then, the position moved from the position of the frame N-1 by the amount of the shift is determined as the position of the feature data 80 extracted from the image 64 of the frame N.

  Note that the amount of deviation of the finger 1 may be obtained using a method of observing the surface of the finger 1 or a method of observing the contour of the finger 1. By using such methods together, the amount of deviation of the finger 1 can be obtained with high accuracy.

  Here, the authentication processing unit 10 stores the coordinates 92 of the upper left corner of the position 88 where the feature data up to the frame N-1 are pasted. The authentication processing unit 10 moves the position of the feature data 80 of the frame N so that the upper left coordinate 90 of the position of the feature data 80 of the frame N falls within a predetermined range centered on the coordinate 92.

  In this case, since the authentication processing unit 10 limits the position where the feature data 80 is moved, the burden of calculating the amount of deviation of the finger 1 can be reduced.

  Note that the image of the frame N and the image of the frame N-1 are images that are continuously captured, and there is no significant change in position. Therefore, even if the position where the authentication processing unit 10 moves the feature data 80 is limited, no problem occurs.

  When determining the position of the feature data 80 of the frame N, the authentication processing unit 10 pastes the feature data 80 of the frame N and the feature data 82 up to the frame N-1.

  Specifically, the feature data 80 of the frame N and the feature data 82 up to the frame N-1 are pasted together using a general image pasting method. Common image pasting methods include a method of overwriting a feature pattern, a method of taking an average value of feature patterns, or a method of taking a majority of feature patterns.

  As described above, the authentication processing unit 10 can acquire the entire vein pattern of the finger 1 by performing the pasting process (S140).

(Second Embodiment)
In the second embodiment of the present invention, the input device 2 includes a reflection light source.

  The configuration of the authentication system according to the second embodiment of the present invention is the same as that of the authentication system according to the first embodiment (FIG. 1) except for the input device 2. The processing of the authentication system according to the second embodiment of the present invention is the same as that of the authentication system according to the first embodiment (such as FIG. 7). The description of the same configuration and processing is omitted.

  FIG. 10 is a side view of the input device 2 according to the second embodiment of this invention.

  The input device 2 according to the second embodiment includes a reflected light source 102. Other configurations are the same as those of the input device (FIGS. 3A, 3B, and 3C) of the first embodiment. The same configuration is given the same number and the description is omitted.

  In this explanatory diagram, the reflected light source 102 is installed near the imaging device 29 inside the input device 2. Further, the reflected light source 102 is installed facing the direction of the opening 30. Therefore, the reflected light source 102 irradiates the imaged part of the finger 1 with infrared light.

  Note that the reflected light source 102 may be installed at any location inside the input device 2 as long as it can irradiate the imaged portion of the finger 1 with infrared light. A plurality of the reflection light sources 102 may be installed inside the input device 2.

  When the reflected light source 102 irradiates the imaged part of the finger 1, the imaging device 29 images the infrared light reflected by the skin on the surface of the finger 1. That is, the imaging device 29 can capture an image of the surface of the finger 1.

  The authentication processing unit 10 can acquire various information using the image of the surface of the finger 1 imaged by the imaging device 29.

  For example, the authentication processing unit 10 obtains the reflectance of the object presented on the finger rest 25 from the image captured by the imaging device 29. Then, based on the obtained reflectance, it can be determined whether or not the presented object is the finger 1.

  In addition, the authentication processing unit 10 can extract wrinkle information on the surface of the finger 1 from the image captured by the imaging device 29. Based on the extracted wrinkle information, the movement amount of the finger 1 can be obtained.

  Note that when the light source 23 is turned off and the reflected light source 102 is turned on, the imaging device 29 captures an image of the surface of the finger 1. On the other hand, when the light source 23 is turned on and the reflected light source 102 is turned off, the imaging device 29 captures an image of a finger vein pattern.

  The input device 2 of the present embodiment is a sweep type finger vein authentication device. Therefore, the finger 1 moves on the finger rest 25.

  Therefore, the authentication processing unit 10 turns on the reflected light source 102 and the light source 23 alternately. And the imaging device 29 images the finger | toe 1 according to the lighting timing of the reflective light source 102 and the light source 23. FIG. Then, the imaging device 29 can alternately capture the image of the surface of the finger 1 and the image of the finger vein pattern.

  The reflected light source 102 may be used in the finger detection process (step S100 in FIG. 7). In this case, the reflected light source 102 is lit at a constant cycle. In addition, the imaging device 29 captures an image with a cycle shorter than the lighting cycle of the reflected light source 102. Then, the imaging device 29 inputs the captured image to the authentication processing unit 10.

  The authentication processing unit 10 obtains the luminance value of the input image. Next, the amount of change in the luminance value of the image is obtained by comparing the luminance values of the successively received images. Then, based on the obtained change amount of the luminance value of the image, it is determined whether or not the finger 1 is placed on the finger rest 25.

  Specifically, when the change amount of the luminance value of the image is smaller than the threshold value, it is determined that the finger 1 is not placed on the finger rest 25.

  On the other hand, when the amount of change in the luminance value of the image is equal to or greater than the threshold, it is determined that the finger 1 is placed on the finger rest 25.

  As described above, the authentication processing unit 10 can perform the finger detection process (step S100 in FIG. 7) using the reflected light source 102.

  The authentication system according to the present embodiment can reduce power consumption by performing finger detection processing using the reflected light source 102 instead of the light source 23. This is because the authentication processing unit 10 can detect the finger when the reflected light source 102 irradiates the finger 1 with infrared light weaker than the light source 23.

(Third embodiment)
In the third embodiment of the present invention, the light source 23 is installed at an angle.

  The configuration of the authentication system according to the third embodiment of the present invention is the same as that of the authentication system according to the first embodiment (FIG. 1) except for the input device 2. The processing of the authentication system according to the third embodiment of the present invention is the same as that of the authentication system according to the first embodiment (such as FIG. 7). The description of the same configuration and processing is omitted.

  FIG. 11A is a plan view of the input device 2 according to the third embodiment of this invention. FIG. 11B is an explanatory diagram of the light source 23 of the input device 2 according to the third embodiment of this invention. FIG. 11C is a front view of the input device 2 according to the third embodiment of this invention.

  The configuration of the input device 2 of the third embodiment is the same as that of the input device of the first embodiment (FIGS. 3A, 3B, and 3C) except for the light source 23 and the finger rest 25. The same configuration is given the same number and the description is omitted.

  The light source 23 emits infrared light with a spread (directivity). Further, the light source 23 is installed to be inclined to the opposite side of the opening 30.

  For example, the light source 23 is installed with an inclination of 60 degrees from the imaging direction 320 of the imaging device 29. That is, the light source 23 emits light with the direction inclined by 60 degrees from the imaging direction 320 of the imaging device 29 as the optical axis 231. Note that the imaging direction 320 is the direction of the optical axis taken by the imaging device 29. Thereby, the infrared light from the light source 23 faces the opposite side of the opening 30.

  The finger rest 25 is installed so that the spread of infrared light from the light source 23 does not include the imaging direction. That is, the finger rest 25 is installed so that all components of the infrared light from the light source 23 face the opposite side of the opening 30. Note that the spread of infrared light from the light source 23 is a range between the boundary lines 322.

  In addition, the finger rest 25 of this embodiment does not need to cover the upper part of the light source 23 to half. This is because the light source 23 is inclined with respect to the imaging direction. Further, depending on the spread of infrared light from the light source 23, the finger rest 25 may not cover the upper part of the light source 23.

  In the present embodiment, the infrared light emitted from the light source 23 enters the finger 1 at a position farther from the opening 30 than in the first embodiment. Thereby, the image picked up by the image pickup device 29 also has an advantage that the luminance value becomes uniform.

(Fourth embodiment)
In the fourth embodiment of the present invention, the finger rest 25 has a recess.

  The configuration of the authentication system according to the fourth embodiment of the present invention is the same as that of the authentication system according to the first embodiment (FIG. 1) except for the input device 2. The processing of the authentication system according to the fourth embodiment of the present invention is the same as that of the authentication system according to the first embodiment (such as FIG. 7). The description of the same configuration and processing is omitted.

  FIG. 12 is a front view of the input device 2 according to the fourth embodiment of this invention.

  The configuration of the input device 2 of the fourth embodiment is the same as that of the input device (FIGS. 3A, 3B, and 3C) of the first embodiment except for the finger rest 25. The same configuration is given the same number and the description is omitted.

  The finger rest 25 has a depression 142 on the surface in contact with the finger 1. The depression 142 extends in the longitudinal direction of the finger 1. Since the depression 142 does not press the finger 1, the blood flow inside the finger 1 is released.

  Assume that the user moves the finger 1 while pressing the finger 1 against the finger rest 25 with a pressure more than necessary. In this case, if the finger rest 25 does not have the depression 142, the blood is pushed away by the pressure with the finger rest 25, and the blood on the imaging surface of the finger 1 is depleted. For this reason, the finger vein pattern is unclear in the image picked up by the image pickup device 29.

  On the other hand, when the finger rest 25 has the depression 142, blood flows through the depression 142. Therefore, even if the user presses the finger 1 against the finger rest 25 with a pressure more than necessary, the imaging device 29 can clearly capture the finger vein pattern image.

(Fifth embodiment)
In the fifth embodiment of the present invention, a finger rest and a light shielding member are provided separately.

  The configuration of the authentication system according to the fifth embodiment of the present invention is the same as that of the authentication system according to the first embodiment (FIG. 1) except for the input device 2. The processing of the authentication system according to the fifth embodiment of the present invention is the same as that of the authentication system according to the first embodiment (such as FIG. 7). The description of the same configuration and processing is omitted.

  FIG. 13 is a side view of the input device 2 according to the fifth embodiment of this invention.

  The configuration of the input device 2 according to the fifth embodiment is the same as that of the input device according to the first embodiment (FIGS. 3A, 3B, and 3C) except for the light shielding member 22 and the finger rest 28. The same configuration is given the same number and the description is omitted.

  The input device 2 is provided with a light shielding member 22 and a finger rest 28 instead of the finger rest 25 according to the first embodiment.

  The finger rest 25 of the first embodiment also has the function of a light shielding member by being made of a material that is opaque to infrared light.

  In the present embodiment, the light shielding member 22 is installed between the light source 23 and the opening 30. The light shielding member 22 is made of a material that is opaque to infrared light.

  The finger rest 28 is installed on the opposite side of the opening 30 with respect to the light source 23. The finger placing table 28 is a table on which the finger 1 is placed at the time of authentication. In this case, the finger rest 28 may be made of a material that is transparent to infrared light or may be made of an opaque material.

(Sixth embodiment)
In the sixth embodiment of the present invention, authentication is performed without moving the finger 1.

  The configuration of the authentication system according to the sixth embodiment of the present invention is the same as that of the authentication system according to the first embodiment (FIG. 1) except for the configuration of the input device 2. The description of the same configuration is omitted.

  FIG. 14 is a side view of the input device 2 according to the sixth embodiment of this invention.

  The configuration of the input device 2 according to the sixth embodiment is the same as that of the input device according to the first embodiment (FIGS. 3A, 3B, and 3C) except for the size of the opening 30. The same configuration is given the same number and the description is omitted.

  The two finger rests 25 are installed so that the opening 30 is provided therebetween. The opening 30 is wider in the longitudinal direction of the finger 1 than the opening (FIG. 3A) of the first embodiment. The opening 30 has a width that allows the imaging device 29 to capture an image of a finger vein pattern necessary for authentication.

  In the authentication system of the sixth embodiment, since the opening 30 is wide, the user does not need to move the finger 1. Therefore, the user can authenticate only by placing the finger 1 on the finger rest 25.

  A light amount control process according to the present embodiment will be described.

  FIG. 15 is an explanatory diagram of the relationship between the distance from the light source 23 and the luminance value of the finger vein pattern image according to the sixth embodiment of this invention.

  The graph shown in this explanatory diagram shows the relationship between the distance from the light source 23 and the luminance value of the finger vein pattern image. The graph is a case where the light source 23 exists on the fingertip side and the base side of the finger 1. Therefore, the graph is a composite of the graph (FIG. 6) in which the light source 23 exists only on one side reversed.

  The luminance value is divided into one of a high luminance region 184, a visible region 186, and a low luminance region 188.

  If the luminance value is within the range of the high luminance region 184, the authentication processing unit 10 cannot acquire finger vein pattern information from the image. This is because light is saturated in the image. If the luminance value is within the visible region 186, the authentication processing unit 10 can acquire finger vein pattern information from the image. If the luminance value is within the low luminance region 188, the authentication processing unit 10 cannot acquire finger vein pattern information from the image. This is because the light is too weak in the image.

  In the input device 2 of the present embodiment, the opening 30 is wide. Therefore, even if the authentication processing unit 10 adjusts the light amount of the light sources 23 on both sides, the entire area of the opening 30 may not be included in the visible region 186.

  In this case, the authentication processing unit 10 changes the light amount of the light source 23 on the base side of the finger 1 and the light amount of the light source 23 on the fingertip side in time series. At this time, the imaging device 29 captures an image at each light quantity. The captured image has a partially optimal brightness. And the authentication process part 10 acquires the image of the brightness optimal on the whole by synthesize | combining the image imaged with the imaging device 29. FIG.

  Specific processing will be described below.

  First, the authentication processing unit 10 increases the light amount of the light source 23 on the base side of the finger 1 and decreases the light amount of the light source 23 on the fingertip side.

  In this state, the imaging device 29 captures an image. The image has a luminance value like the graph shown in FIG. Therefore, the image is as shown in FIG. 16A.

  FIG. 16A is an explanatory diagram of an image captured when the light source 23 on the base side of the finger 1 is strong according to the sixth embodiment of this invention.

  When the light source 23 on the base side of the finger 1 is strong, the image picked up by the image pickup device 29 has an optimal brightness in an area that is equal to or larger than the half surface on the fingertip side. However, in the image, light is saturated at a part of the base side of the finger 1.

  Therefore, the authentication processing unit 10 weakens the light amount of the light source 23 on the base side of the finger 1 and increases the light amount of the light source 23 on the fingertip side.

  In this state, the imaging device 29 captures an image. The image has a luminance value like the graph shown in FIG. Therefore, the image is as shown in FIG. 16B.

  FIG. 16B is an explanatory diagram of an image captured when the light source 23 on the fingertip side is strong according to the sixth embodiment of this invention.

  When the light source 23 on the fingertip side is strong, the image picked up by the image pickup device 29 has an optimal brightness in an area of the half surface or more on the base side of the finger 1. However, in the image, light is saturated at a part of the fingertip side.

  The authentication processing unit 10 combines these two images (FIGS. 16A and 16B) captured by the imaging device 29.

  FIG. 16C is an explanatory diagram of an image synthesized by the authentication processing unit 10 according to the sixth embodiment of this invention.

  The authentication processing unit 10 synthesizes an image with optimal brightness (FIG. 16A) in the area of the half or more of the fingertip side and an image of optimal brightness (FIG. 16B) in the area of the half or more on the base side of the finger 1. . As a result, the authentication processing unit 10 acquires an image with optimal brightness in the entire area of the explanatory diagram.

  In addition, the authentication processing unit 10 may acquire an image having optimum brightness in the entire region by combining two or more images.

  In this case, the authentication processing unit 10 gradually increases the light amount of the light source 23 on one side and gradually decreases the light amount of the other light source 23. The imaging device 29 captures an image at each light quantity. In the image, the region having the optimum brightness gradually moves. And the authentication process part 10 acquires the image of the brightness optimal on the whole by synthesize | combining the image imaged with the imaging device 29. FIG.

  Note that the imaging device 29 of the authentication system of the sixth embodiment images the finger 1 as a whole. Therefore, since the authentication processing unit 10 corrects the inclination of the finger 1 and removes the background, it is necessary to detect the contour of the finger 1.

  The authentication processing unit 10 detects the contour of the finger 1 using a general image processing technique. A general image processing method is edge enhancement or contour tracking.

  In addition, the authentication processing unit 10 may detect the contour of the finger 1 by comparing a plurality of images.

  Specifically, the authentication processing unit 10 compares an image in which the light amount of the light source 23 is increased with an image in which the light source 23 is turned off. Then, an area having a large change in luminance value is detected as a finger area. Thereby, the authentication processing unit 10 can stably detect the contour of the finger 1.

  Note that the authentication system according to the sixth embodiment can stably acquire a clear finger vein pattern even when the finger 1 is placed on the finger rest 25 in a bent state. This is because even in this case, the principle that the infrared light from the light source 23 scatters inside the finger 1 and travels outside does not change.

  However, when the finger 1 is placed on the finger rest 25 in a bent state, the authentication processing unit 10 obtains the distance between the finger and the device based on the detected contour of the finger 1. Then, the authentication processing unit 10 corrects the enlargement ratio using the obtained distance between the finger and the device. As a result, the authentication processing unit 10 can perform the matching process while reducing the influence of the bending of the finger 1. That is, since the finger 1 is allowed to bend to some extent, user convenience can be improved.

  Further, the authentication system of the sixth embodiment can acquire the finger vein pattern even when the finger 1 is not in contact with the finger rest 25. The reason is the same as the reason why a clear finger vein pattern can be acquired when the finger 1 is lifted in the first embodiment (FIGS. 5A and 5B).

  That is, the authentication system of the sixth embodiment can perform authentication without the user touching the finger rest 25 with the finger 1. This can alleviate the user's psychological resistance to contact.

  The sixth embodiment can also be applied to the second to fifth embodiments by widening the width of the opening 30.

(Seventh embodiment)
In the seventh embodiment of the present invention, an authentication system is mounted on an information portable terminal.

  FIG. 17A is an explanatory diagram of the portable information terminal 242 according to the seventh embodiment of this invention.

  The information portable terminal 242 is equipped with an authentication system. The information portable terminal 242 may be mounted with any of the authentication systems of the first to sixth embodiments.

  Further, the input device 2 of the authentication system is installed such that the finger rest 25 appears on the surface of the information portable terminal 242. The input device 2 may be installed on the side surface of the information portable terminal 242.

  The configuration of the authentication system mounted on the portable information terminal 242 is the same as that of the authentication system according to the first embodiment (FIG. 1) except for the input device 2. The processing of the authentication system mounted on the portable information terminal 242 is the same as that of the authentication system (FIG. 7 etc.) of the first embodiment. The description of the same configuration and processing is omitted.

  FIG. 17B is a side view of the input device 2 mounted on the portable information terminal 242 according to the seventh embodiment of this invention.

  The input device 2 is the same as the input device (FIGS. 3A, 3B, and 3C) of the first embodiment except that a light source light window 43 is provided. The same configuration is given the same number and the description is omitted.

  The light source light window 43 is installed on the same plane as the surface of the portable information terminal 242. The light source light window 43 covers the upper part of the light source 23 and the upper part of the opening 30. The light source light window 43 is made of a material transparent to infrared light.

  In addition, the shape which has a curved hollow may be sufficient as the finger rest 25, and a planar shape may be sufficient as it. In addition, when the finger rest 25 has a planar shape, the presentation position of the finger 1 may be printed on the surface, or the surface may be made of a material having a different touch. Thereby, the user can grasp the presenting position and moving direction of the finger 1.

(Eighth embodiment)
In the eighth embodiment of the present invention, an authentication system is mounted on an information portable terminal.

  FIG. 18A is an explanatory diagram of the portable information terminal 242 according to the eighth embodiment of this invention.

  The information portable terminal 242 is equipped with an authentication system. The information portable terminal 242 may be mounted with any of the authentication systems of the first to sixth embodiments.

  In addition, the input device 2 of the authentication system is installed on the side surface of the portable information terminal 242 so that it can be pulled out. This explanatory diagram shows the portable information terminal 242 in a state where the input device 2 is pulled out. Then, the input device 2 is moved leftward by software control or physical control. Then, the input device 2 can be stored in the information portable terminal 242.

  As a result, the portable information terminal 242 can be equipped with an authentication system even when the input device 2 of the authentication system cannot be installed on the surface.

  The configuration of the authentication system mounted on the portable information terminal 242 is the same as that of the authentication system according to the first embodiment (FIG. 1) except for the input device 2. The processing of the authentication system mounted on the portable information terminal 242 is the same as that of the authentication system (FIG. 7 etc.) of the first embodiment. The description of the same configuration and processing is omitted.

  FIG. 18B is a front view of the input device 2 mounted on the portable information terminal 242 according to the eighth embodiment of this invention.

  The input device 2 is the same as the input device (FIGS. 3A, 3B, and 3C) of the first embodiment except that the input device 2 includes the reflection unit 302, the position of the infrared transmission filter 27, and the position of the imaging device 29. is there. The same configuration is given the same number and the description is omitted.

  A reflection unit 302 is installed inside the input device 2. The reflection unit 302 is, for example, a prism or an optical fiber, and changes the path of infrared light.

  In addition, the imaging device 29 is installed inside the portable information terminal 242 so as to face the reflecting unit 302. The infrared transmission filter 27 is disposed between the imaging device 29 and the reflection unit 302.

  The imaging device 29 images infrared light from the outside of the input device 2 through the opening 30, the reflection unit 302, and the infrared transmission filter. That is, the imaging device 29 images infrared light whose path has been changed by the reflecting unit 302.

(Ninth embodiment)
In the ninth embodiment of the present invention, the authentication system is mounted on a door knob.

  FIG. 19A is an explanatory diagram of the knob 264 of the door 262 according to the ninth embodiment of this invention. FIG. 19B is a side view of the input device 2 mounted on the knob 264 of the door 262 according to the ninth embodiment of this invention.

  The knob 264 of the door 262 is equipped with an authentication system. The knob 264 may be mounted with any of the authentication systems of the first to sixth embodiments.

  That is, the input device 2, the authentication processing unit 10, and the communication cable 268 are installed on the knob 264. The communication cable 268 connects the input device 2 and the authentication processing unit 10.

  The configuration of the authentication system mounted on the knob 264 is the same as that of the authentication system according to the first embodiment (FIG. 1). The processing of the authentication system mounted on the knob 264 is the same as that of the authentication system of the first embodiment (FIG. 7 etc.). The description of the same configuration and processing is omitted.

  The user grips the knob 264 when opening the door 262. At this time, the input device 2 mounted on the knob 264 acquires the finger vein pattern image and transmits the acquired image to the authentication processing unit 10.

  The authentication processing unit 10 performs an authentication process on the image received from the input device 2. And the authentication process part 10 will unlock | release a door, if the said image and the authentication data memorize | stored in the memory | storage device 14 correspond.

  Therefore, the user only needs to pull the knob 264.

  Since the authentication system according to the present embodiment can perform authentication by a natural operation of the user, the convenience for the user can be improved.

  Similar to the knob 264 of the door 262, the authentication system of this embodiment may be mounted on a mobile phone, a car handle, a motorcycle grip, or the like. The authentication system can be authenticated by a natural operation of the user by being mounted on a part held by the user.

  Further, when the user grasps the part, the authentication system completes the authentication, so that the next operation of the user can be assisted by using the authentication result.

  For example, when the authentication is completed, the authentication system assists the operation of the user who opens the door 262. Specifically, the authentication system may automatically tilt the knob 264, automatically open the door 262, or control the door 262 to open with a light force.

  Thus, the authentication system can not only authenticate the user but also assist the user's operation.

(Tenth embodiment)
The tenth embodiment of the present invention is applied to a probe type authentication apparatus.

  FIG. 20A is a probe-type authentication device according to the tenth embodiment of the present invention. FIG. 20B is a side view of the input device 2 applied to the probe-type authentication device according to the tenth embodiment of the present invention.

  The probe type authentication device authenticates the probe by placing the probe 282 on a part of the body.

  The probe 282 is equipped with an authentication system. The probe 282 may be mounted with any of the authentication systems of the first to sixth embodiments.

  The configuration of the authentication system mounted on the probe 282 is the same as that of the authentication system according to the first embodiment (FIG. 1). The processing of the authentication system mounted on the probe 282 is the same as that of the authentication system (FIG. 7 etc.) of the first embodiment. The description of the same configuration and processing is omitted.

  By applying the probe 282 to a part of the body, the authentication system images the vein pattern of the part. Parts of the body include, for example, fingers (palm-side surfaces, back-side surfaces, side surfaces, fingertips, etc.), palms, back of hands, wrists, arms, legs, faces, ears, cheeks, etc. Also good.

  In the probe type authentication device, a vein pattern at an arbitrary site can be used for personal authentication. Therefore, in the probe type authentication device, the information about the body part registered in advance in the authentication system is also a password, so that the security can be further strengthened.

  Further, the probe type authentication device may perform vein pattern matching after determining the identity of a body part.

  Specifically, the probe type authentication device stores body position information corresponding to the registered authentication data. The probe-type authentication device identifies the body part imaged by the imaging device 29 during authentication.

  For example, in the probe-type authentication device, the body part may be input from the input unit 16 by the user. Further, a feature amount may be calculated from an image captured by the imaging device 29, and a body part may be specified based on the calculated feature amount. Further, the body part may be specified by using general image processing on an image around the part imaged by the imaging device 29.

  The probe type authentication device collates the vein pattern only when the specified body part matches the registered body position information. That is, the probe-type authentication device does not perform collation processing when the specified body part is different from the registered body position information.

  As a result, the probe-type authentication apparatus can prevent an authentication error due to comparison of vein patterns at different sites, so that the accuracy of authentication can be improved.

  Of course, it is within the scope of the present disclosure to combine any one of the second to fifth embodiments with the first to sixth embodiments. Furthermore, the configurations of the first to sixth embodiments may be appropriately combined with the seventh to tenth embodiments as long as there is no contradiction.

  INDUSTRIAL APPLICABILITY The present invention can be used for a personal authentication device mounted on a PC, a portable terminal, an ATM, an automobile, or entrance / exit management.

It is a block diagram of the authentication system of the 1st Embodiment of this invention. It is a block diagram of the memory of the authentication process part of the 1st Embodiment of this invention. It is a side view of the input device of a 1st embodiment of the present invention. It is a front view of the input device of a 1st embodiment of the present invention. It is a top view of the input device of a 1st embodiment of the present invention. It is explanatory drawing of the effect by the shape of the finger rest of the 1st Embodiment of this invention. It is explanatory drawing of the effect by the shape of the finger rest of the 1st Embodiment of this invention. It is explanatory drawing of the effect by the shape of the finger rest of the 1st Embodiment of this invention. It is explanatory drawing of the effect by the shape of the finger rest of the 1st Embodiment of this invention. It is explanatory drawing of the relationship between the distance from the light source of the 1st Embodiment of this invention, and the luminance value of the image of a finger vein pattern. It is a flowchart of the authentication process of the authentication process part of the 1st Embodiment of this invention. It is explanatory drawing of the finger vein which the imaging device of the 1st Embodiment of this invention images. It is explanatory drawing of the image which the imaging device of the 1st Embodiment of this invention images. It is explanatory drawing of the characteristic data which the authentication process part of the 1st Embodiment of this invention converted. It is explanatory drawing of the characteristic data bonding process of the authentication process part of the 1st Embodiment of this invention. It is a side view of the input device of the 2nd Embodiment of this invention. It is a top view of the input device of the 3rd Embodiment of this invention. It is explanatory drawing of the light source of the input device of the 3rd Embodiment of this invention. It is a front view of the input device of the 3rd Embodiment of this invention. It is a front view of the input device of the 4th Embodiment of this invention. It is a side view of the input device of the 5th Embodiment of this invention. It is a side view of the input device of the 6th Embodiment of this invention. It is explanatory drawing of the relationship between the distance from the light source of the 6th Embodiment of this invention, and the luminance value of the image of a finger vein pattern. It is explanatory drawing of the image imaged when the light source of the base of the finger | toe of the 6th Embodiment of this invention is strong. It is explanatory drawing of the image imaged when the light source of the fingertip side of the 6th Embodiment of this invention is strong. It is explanatory drawing of the image which the authentication process part of the 6th Embodiment of this invention synthesize | combined. It is explanatory drawing of the information portable terminal of the 7th Embodiment of this invention. It is a side view of the input device mounted in the information portable terminal of the 7th Embodiment of this invention. It is explanatory drawing of the information portable terminal of the 8th Embodiment of this invention. It is a front view of the input device mounted in the information portable terminal of the 8th Embodiment of this invention. It is explanatory drawing of the knob of the door of the 9th Embodiment of this invention. It is a side view of the input device mounted in the knob of the door of the 9th Embodiment of this invention. It is a probe type authentication device of a 10th embodiment of the present invention. It is a side view of the input device applied to the probe type authentication apparatus of the 10th Embodiment of this invention.

Explanation of symbols

1 finger 2 input device 10 authentication processing unit 11 CPU 11
12 memory 12
13 Interface 14 Storage Device 15 Display Unit 16 Input Unit 17 Speaker 18 Image Input Unit 23 Light Source 29 Imaging Device

Claims (11)

An image processing apparatus,
A first light source, a second light source, and an imaging unit located on the opposite side of the finger with respect to the surface of the image processing apparatus facing the imaged finger;
An opening provided in the surface;
A processing unit that extracts a blood vessel pattern of the finger from an image of the transmitted light of the finger that has passed through the opening imaged by the imaging unit,
The first and second light sources are arranged side by side in the longitudinal direction of the imaged finger across the opening,
Each of the first and second light sources is constituted by a plurality of light source elements arranged in the width direction of the finger to be imaged. An image processing apparatus,
A finger rest on which a finger is placed;
Two light sources for illuminating the placed finger stored in the image processing apparatus;
An imaging unit that is stored in the image processing apparatus and that images light that has been irradiated to the placed finger and that has passed through the image processing apparatus through an opening provided in the image processing apparatus;
A processing unit that extracts the blood vessel pattern of the finger using the captured image that is stored in the image processing apparatus, and
The two light sources are disposed on the tip side and the root side of the finger to be installed, with the opening interposed therebetween,
Each of the two light sources is constituted by a plurality of light source elements arranged in the width direction of the installed finger. First and second light sources that irradiate light from the ventral side of the imaged finger;
An opening located between the first and second light sources and through which the light transmitted through the finger passes;
An imaging unit that is located on the ventral side of the finger and images the light that has passed through the opening;
A processing unit that extracts the blood vessel pattern of the finger from the captured image,
The opening, the first light source, and the second light source are arranged side by side in the longitudinal direction of the finger,
Each of the first and second light sources is composed of a plurality of light source elements arranged in the longitudinal direction of the finger. An image processing apparatus,
A first light source, a second light source, and an imaging unit located on the opposite side of the finger with respect to the surface of the image processing apparatus facing the imaged finger;
An opening provided in the surface;
A processing unit that extracts a blood vessel pattern of the finger from an image of transmitted light of the finger that has been imaged by the imaging unit,
The first and second light sources are arranged side by side in the longitudinal direction of the imaged finger across the opening,
Each of the first light source and the second light source has a shape that is longer in the width direction than the longitudinal direction of the imaged finger.   The image processing apparatus according to claim 1, wherein a surface on which the finger faces or a surface on which the finger is placed is a flat surface. The light passing through the opening is reflected by a mirror,
The image processing apparatus according to claim 1, wherein the imaging unit images the reflected light. An image processing apparatus stored in an input unit of an information terminal,
The image processing apparatus according to claim 1, wherein a surface of the input unit is configured as a surface on which the finger faces or a surface on which the finger is placed.   The image processing apparatus according to claim 1, wherein the processing unit adjusts light amounts of the first and second light sources based on a distance from the imaging unit.   The image processing apparatus according to claim 1, further comprising: an authentication processing unit that performs personal authentication by collating pre-registered collation data with the extracted blood vessel pattern. An opening provided on the surface of the image processing apparatus facing the imaged finger;
Two light sources arranged side by side with an opening in the longitudinal direction of the finger;
Imaging the light emitted from the two light sources, an imaging unit located on the ventral side of the finger;
A processing unit that extracts a blood vessel pattern of the finger from an image of transmitted light of the finger that has passed through the opening imaged by the imaging unit, and a personal authentication method using a personal authentication device comprising:
The two light sources emit light to the ventral side of the finger by causing a plurality of light source elements arranged in the width direction of the finger to be imaged to emit light ,
The imaging unit images the transmitted light of the finger that has passed through the opening,
The processing unit extracts a blood vessel pattern of the finger from the captured image,
The personal authentication method, wherein the processing unit performs personal authentication by comparing the extracted blood vessel pattern with a collation pattern. An opening provided on the surface of the image processing apparatus facing the imaged finger;
Two light sources that are arranged side by side in the longitudinal direction of the finger across the opening and that are longer in the width direction than the longitudinal direction of the imaged finger;
An imaging unit that captures light emitted from the two light sources;
A processing unit that extracts a blood vessel pattern of the finger from an image of light transmitted through the finger that has been imaged by the imaging unit, and an image processing method using the image processing apparatus,
The two light sources illuminate the belly of the finger by causing a plurality of light source elements arranged side by side in the longitudinal direction of the finger to be imaged to emit light ,
The imaging unit images the transmitted light of the finger that has passed through the image processing apparatus through the opening,
The image processing method, wherein the processing unit extracts a blood vessel pattern of the finger from the captured image.