JP6407565B2 - Authentication processing apparatus and authentication processing method - Google Patents

Description

  The present invention relates to an authentication processing apparatus and an authentication processing method for performing personal authentication of a person to be authenticated.

  In recent years, biometric authentication for performing personal authentication using information on human physical characteristics and behavioral characteristics has become widespread. One type of biometric authentication is palmprint authentication (see, for example, Patent Document 1 below).

JP 2007-52534 A

  However, in the palm print authentication described in Patent Document 1 described above, the person to be authenticated needs to perform an operation of spreading the entire palm so that the entire palm can be seen in order to perform the palm print authentication.

  The present invention has been made in view of such problems, and when performing authentication processing using the hands of the authentication subject, the authentication subject does not perform any special operation for the authentication processing. The purpose is to provide a mechanism that can perform authentication processing in a natural operation.

The authentication processing apparatus of the present invention is provided with an imaging unit provided inside a handle and configured to be able to capture a grip image of the hand when the handle is gripped by a hand, and an authentication registrant can register the handle at the time of registration. A storage means for storing a handheld image taken by the photographing means as an authentication registration image when the hand is held by a hand, and a photographed by the photographing means when the person to be authenticated holds the handle by hand during authentication. An acquisition means for acquiring a handshake image as an authentication target image; and extracting a fingertip pattern portion of the authentication registrant's hand from the authentication registration image as an authentication registration fingertip pattern image; and acquiring the authentication registrant from the authentication registration image. First part extracting means for extracting the palm pattern part of the hand of the user as an authentication registered palm pattern image, and extracting the fingertip pattern part of the hand of the authentication target person from the authentication target image as the authentication target fingertip pattern image, and the authentication target Second part extracting means for extracting a palm pattern part of the authentication subject's hand from the image as an authentication target palm pattern image; and a fingertip pattern matching process for matching the authentication registered fingertip pattern image with the authentication target fingertip pattern image; on the basis of the authentication registered palmprint image and the authentication object palmprint result between palmprint collation processing for collating the images, possess an authentication processing unit for performing authentication processing of the authentication target person, the authentication processing unit, wherein As an authentication process, a first fingertip pattern matching process for matching a feature point of the authentication registered fingertip pattern image with a feature point of the authentication target fingertip pattern image, a feature point of the authentication registered palmprint image, and the authentication target palmprint image A first authentication process based on a result of the first palm pattern matching process for matching the feature point of the first registered fingertip pattern, and a feature point of the authentication registered fingertip pattern image as a result of the first fingertip pattern matching process. Recognition When the number of matches with the feature point of the target fingertip pattern image is greater than or equal to the first threshold value, or as a result of the first palm print matching process, the feature point of the authentication registered palm print image and the feature point of the authentication target palm print image When the number of matches is equal to or greater than a second threshold, authentication of the authentication subject is permitted in the first authentication processing, and authentication of the authentication subject is not permitted in the first authentication processing. A first feature line extracting unit that extracts a feature line of the authentication registered fingertip pattern image and a feature line of the authentication target fingertip pattern image, and authentication of the authentication target person is permitted in the first authentication process. A second feature line extracting unit that extracts a feature line of the authentication registered palm print image and a feature line of the authentication target palm print image if not, the authentication processing unit further comprising: As the first authentication process In addition, a second fingertip pattern matching process for matching a feature line of the authentication registered fingertip pattern image extracted by the first feature line extraction unit with a feature line of the authentication target fingertip pattern image; A second authentication process based on a result of a second palmprint matching process for matching the feature line of the authentication registered palmprint image extracted by the feature line extraction means and the feature line of the authentication target palmprint image. Yes, as a result of the second fingertip pattern matching process, the similarity between the feature line of the authentication registered fingertip pattern image and the feature line of the authentication target fingertip pattern image is a third threshold value or more, and In the second authentication process, when the similarity between the feature line of the authentication registered palm print image and the feature line of the authentication target palm print image is equal to or greater than a fourth threshold as a result of the second palm print matching process, The authentication of the person to be authenticated is permitted .
Further, in another aspect of the authentication processing device of the present invention, an imaging unit provided inside the handle and configured to be able to capture a grip image of the hand when the handle is gripped with a hand, Storage means for storing a handheld image taken by the photographing means as an authentication registration image when an authentication registrant grips the handle with a hand, and when an authentication target person holds the handle with a hand during authentication An acquisition means for acquiring a handgrip image captured by the imaging means as an authentication target image; a fingertip pattern portion of the authentication registrant's hand is extracted as an authentication registration fingertip pattern image from the authentication registration image; and the authentication registration A first part extracting unit that extracts a palm pattern part of the authentication registrant's hand as an authentication registration palm pattern image from the image; and a fingertip pattern part of the authentication target person's hand is extracted as an authentication target fingertip pattern image from the authentication target image. Do Both the second partial extraction means for extracting the palm print portion of the authentication subject's hand from the authentication target image as the authentication target palm print image, and the fingertip for comparing the authentication registered fingertip pattern image with the authentication target fingertip pattern image Authentication processing means for performing authentication processing of the person to be authenticated based on a result of pattern matching processing and palm pattern matching processing for matching the authentication registered palm pattern image and the authentication target palm pattern image. The first partial extraction means detects the skin color area of the authentication registration image, rotates the authentication registration image so that the center of gravity of the skin color area becomes a predetermined position, and each of the authentication registration images after the rotation A predetermined area is extracted as the authentication registration fingertip pattern image and the authentication registration palm pattern image, and the second partial extraction unit detects a skin color area of the authentication target image and overlaps the skin color area. Position by rotating the authentication object image to a predetermined position, and extracts each predetermined region in the authentication target image after the rotation as the authentication object finger A pattern image and said authenticated palmprint image.

The authentication processing method of the present invention is an authentication processing method by an authentication processing device provided with an imaging means provided inside a handle and configured to be able to capture a grip image of the hand when the handle is gripped by a hand. A storage step of storing in the storage means as an authentication registration image a grip image taken by the imaging means when the authentication registrant grips the handle with his / her hand at the time of registration; An acquisition step of acquiring a grip image taken by the photographing means as an authentication target image when the handle is grasped by a hand, and a fingertip pattern portion of the authentication registrant's hand from the authentication registration image. A first partial extraction step of extracting the palm print portion of the authentication registrant's hand as an authentication registration palm print image from the authentication registration image, and the fingertip of the authentication subject's hand from the authentication target image A second part extracting step of extracting a palm part of the authentication subject's hand from the authentication target image as an authentication target palm pattern image, and extracting the authentication part as a certification target fingertip pattern image; Based on the results of the fingertip pattern matching process for matching the authentication target fingertip pattern image and the palmprint matching process for matching the authentication registered palmprint image and the authentication target palmprint image, the authentication target person authentication process is performed. It possesses the authentication process step, wherein the authentication processing step, said as the authentication processing, the first fingertip pattern matching process for matching the characteristic points of the certification fingertip a pattern feature points and the authentication object finger a pattern image of the image And a first authentication process based on a result of a first palm pattern matching process for matching the feature points of the authentication registered palm pattern image and the feature points of the authentication target palm pattern image. As a result of the first fingertip pattern matching process, when the number of matches between the feature points of the authentication registered fingertip pattern image and the feature points of the authentication target fingertip pattern image is equal to or greater than a first threshold, or the first If the number of matches between the feature points of the authentication registered palm print image and the feature points of the authentication target palm print image is greater than or equal to a second threshold as a result of the palm print matching process, the person to be authenticated in the first authentication process When the authentication target person authentication is not permitted in the first authentication process, the feature line of the authentication registered fingertip pattern image and the feature line of the authentication target fingertip pattern image are extracted. Extracting the feature line of the authentication registered palmprint image and the feature line of the authentication target palmprint image when the authentication of the authentication target person is not permitted in the first feature line extraction step and the first authentication processing Second feature line drawing The authentication processing step includes a feature of the authentication registered fingertip pattern image extracted in the first feature line extraction step in addition to the first authentication processing as the authentication processing. A second fingertip pattern matching process for matching a line with a feature line of the authentication target fingertip pattern image, a feature line of the authentication registered palmprint image extracted in the second feature line extraction step, and the authentication target palmprint image A second authentication process based on the result of the second palm print matching process for matching the feature line with the feature line of the authentication registration fingertip pattern image as a result of the second fingertip pattern match process. When the similarity with the feature line of the authentication target fingertip pattern image is greater than or equal to a third threshold, and as a result of the second palm print matching process, the feature line of the authentication registered palm print image and the authentication target Similar to the feature line of palmprint image There when it is more than the fourth threshold value, allows authentication of the authentication target person at the second authentication process.
In another aspect of the authentication processing method of the present invention, an authentication processing apparatus is provided with an imaging unit that is provided inside a handle and configured to be able to capture a grip image of the hand when the handle is gripped by a hand. An authentication processing method according to claim 1, wherein at the time of registration, a storage step of storing, in the storage means, a grip image taken by the imaging means when the authentication registrant holds the handle with a hand; An acquisition step of acquiring, as an authentication target image, a handheld image captured by the imaging unit when the authentication target person grips the handle; and a fingertip pattern portion of the authentication registrant's hand from the authentication registration image Is extracted as an authentication registration fingertip pattern image, and a palm pattern portion of the authentication registrant's hand is extracted as an authentication registration palm pattern image from the authentication registration image. A second partial extraction step of extracting the fingertip pattern portion of the authentication subject's hand as an authentication target fingertip pattern image and extracting the palm portion of the authentication subject's hand as an authentication target palmprint image from the authentication target image; Based on the results of a fingertip pattern matching process for matching the authentication registered fingertip pattern image and the authentication target fingertip pattern image and a palmprint matching process for matching the authentication registered palmprint image and the authentication target palmprint image. An authentication processing step for performing authentication processing of the subject, wherein the first partial extraction step detects a skin color area of the authentication registration image so that the center of gravity position of the skin color area becomes a predetermined position. Rotating the authentication registration image, extracting predetermined areas in the authentication registration image after the rotation as the authentication registration fingertip pattern image and the authentication registration palm pattern image, The second partial extraction step detects the skin color area of the authentication target image, rotates the authentication target image so that the center of gravity of the skin color area becomes a predetermined position, and the authentication target image after the rotation. Are extracted as the authentication target fingertip pattern image and the authentication target palm print image.

  According to the present invention, when performing an authentication process using the hand of the person to be authenticated, the person to be authenticated can perform the authentication process in a natural operation without performing a special operation for the authentication process. it can.

It is a schematic diagram which shows an example of the external appearance of the authentication processing apparatus which concerns on embodiment of this invention. It is a schematic diagram which shows an example of a function structure of the authentication processing apparatus which concerns on embodiment of this invention. It is a flowchart which shows an example of the process sequence of the authentication processing method by the authentication processing apparatus which concerns on embodiment of this invention. FIG. 3 is a flowchart illustrating an example of a processing procedure of an authentication processing method performed by the authentication processing apparatus according to the embodiment of the present invention, following FIG. 3-1. It is a figure which shows embodiment of this invention and shows an example of the handshake image received in the handshake image receiving part of FIG. FIG. 3 is a diagram illustrating an image extraction process performed by a first partial extraction unit and a second partial extraction unit in FIG. 2 according to the embodiment of this invention. FIG. 3 is a diagram illustrating an image extraction process performed by a first partial extraction unit and a second partial extraction unit in FIG. 2 according to the embodiment of this invention. FIG. 3 is a diagram illustrating an image extraction process performed by a first partial extraction unit and a second partial extraction unit in FIG. 2 according to the embodiment of this invention. FIG. 3 is a diagram illustrating an image extraction process performed by a first partial extraction unit and a second partial extraction unit in FIG. 2 according to the embodiment of this invention. FIG. 3 is a diagram illustrating an embodiment of the present invention and illustrating a first authentication process by a first authentication processing unit in FIG. 2. It is a figure which shows embodiment of this invention and shows the experimental result in the number of pairs of the feature points which the fingertip pattern part (fingertip pattern image) corresponds when the 1st authentication process is performed with respect to the person and others. It is a figure which shows the embodiment of this invention and shows the experimental result in the number of pairs of the feature points which the palm print part (palm print image) corresponds when the 1st authentication process is performed with respect to the person and others. It is a figure for demonstrating the process of step S204-S206 of FIG. 3-2. FIG. 3 is a diagram illustrating an embodiment of the present invention and illustrating feature line extraction processing by a first feature line extraction unit and a second feature line extraction unit in FIG. 2. It is a figure which shows embodiment of this invention and shows the experimental result in the similarity degree of the fingertip pattern part (fingertip pattern image) at the time of performing a 2nd authentication process with respect to the person and others. It is a figure which shows embodiment of this invention and shows the experimental result in the similarity of the palm print part (palm print image) at the time of performing a 2nd authentication process with respect to the person and others.

  Hereinafter, embodiments (embodiments) for carrying out the present invention will be described with reference to the drawings. In the embodiment of the present invention described below, an example in which a so-called door knob is applied as the “grip” according to the present invention is shown, and the door knob is provided when the authentication of the person to be authenticated is permitted. However, the present invention is not limited to this mode. For example, as a “grip” according to the present invention, a handle in a household appliance is applied, and when the authentication of the person to be authenticated is permitted, the household appliance can be used, or the “grip” according to the present invention. As an example, a configuration may be adopted in which a vehicle handle is applied and the vehicle engine is turned on when the authentication of the person to be authenticated is permitted.

FIG. 1 is a schematic diagram illustrating an example of an appearance of an authentication processing apparatus according to an embodiment of the present invention.
As shown in FIG. 1, the authentication processing device 100 according to the present embodiment includes a photographing device 110, a lighting device 120, an information processing device 130, a display device 140, an operation input device 150, and an electric lock device 160. It is configured.

  The imaging device 110 is an omnidirectional camera that is provided inside a door knob, which is a handle attached to a door, and configured to be able to capture a handheld image of the hand 300 when the hand knob is gripped by the hand 300. The door knob is formed in a cylindrical shape. More specifically, the portion of the door knob that is gripped by the hand 300 is formed of a transparent member so that the photographing device 110 can photograph the palm of the hand 300 over the entire circumference of the cylindrical shape.

  The illuminating device 120 is provided inside a door knob that is a handle attached to the door, and serves as a light source when a photographing image of the hand 300 is photographed by the photographing device 110, and is configured by, for example, an LED lamp. Yes.

  The information processing apparatus 130 controls the overall operation of the authentication processing apparatus 100.

  Based on the control by the information processing device 130, the display device 140 displays an image photographed by the photographing device 110, and displays various images and various information processed by the information processing device 130.

  The operation input device 150 is operated when an operator such as a security administrator inputs information to the information processing device 130, for example. The operation input device 150 includes, for example, a keyboard 150a and a mouse 150b that is a pointing device.

  The electric lock device 160 is attached to the inside of the door, and locks / unlocks the door based on control by the information processing device 130.

  FIG. 2 is a schematic diagram illustrating an example of a functional configuration of the authentication processing apparatus according to the embodiment of the present invention. Here, in FIG. 2, the same components as those in FIG. 1 are denoted by the same reference numerals, and detailed description thereof is omitted.

The information processing apparatus 130 has functional configurations of a mode setting unit 131, a handshake image receiving unit 132, a registration unit 133, and an authentication unit 134.
In the present embodiment, for example, the mode setting unit 131 includes a program recorded in the CPU and ROM of the information processing apparatus 130. Further, for example, the handshake image receiving unit 132 is configured by a program recorded in the CPU and ROM of the information processing apparatus 130 and a communication interface. Further, for example, a registration unit 133 and an authentication unit 134 are configured from a program recorded in the CPU and ROM of the information processing apparatus 130 and an external memory.

  For example, the mode setting unit 131 performs processing for setting an operation mode in the authentication processing device 100 based on an operation input from the operation input device 150. Here, in this embodiment, it is assumed that two operation modes of “registration mode” and “authentication mode” can be set.

  The handshake image receiving unit 132 performs processing for receiving a handshake image taken by the image capturing device 110 when the authentication registrant or the authentication target person holds the door knob with the hand 300 from the image capturing device 110.

When the “registration mode” is set by the mode setting unit 131 (that is, at the time of registration), the registration unit 133 performs an authentication registrant registration process.
Specifically, the registration unit 133 has functional configurations of an authentication registration image acquisition unit 210, a first partial extraction unit 220, and an authentication registration image storage unit 230.

  When the “registration mode” is set by the mode setting unit 131, the authentication registration image acquisition unit 210 of the registration unit 133 performs processing for acquiring the handshake image received by the handshake image reception unit 132 as an authentication registration image. .

  The first partial extraction unit 220 of the registration unit 133 extracts the fingertip pattern portion of the authentication registrant's hand 300 from the authentication registration image acquired by the authentication registration image acquisition unit 210 as an authentication registration fingertip pattern image, and A process of extracting the palm print portion of the authentication registrant's hand 300 from the registration image as an authentication registration palm print image is performed. Although details will be described later, the first partial extraction unit 220 of the registration unit 133 detects the skin color region of the authentication registration image acquired by the authentication registration image acquisition unit 210, and the center of gravity position of the skin color region is a predetermined position. The authentication registration image is rotated so that the predetermined areas in the authentication registration image after rotation are extracted as the authentication registration fingertip pattern image and the authentication registration palm pattern image.

  The authentication registration image storage unit 230 of the registration unit 133 includes the authentication registration image 231 acquired by the authentication registration image acquisition unit 210 and the authentication registration fingertip pattern extracted by the first partial extraction unit 220 in association with the authentication registration image 231. The image 231a and the authentication registration palm print image 231b are stored. In the present embodiment, for the sake of simplicity, an example in which one authentication registration image (231) is stored in the authentication registration image storage unit 230 is shown. The present invention is not limited to this, and a mode in which a plurality of authentication registration images are stored in the authentication registration image storage unit 230 is also applicable.

When the “authentication mode” is set by the mode setting unit 131 (that is, at the time of authentication), the authentication unit 134 performs authentication processing for the person to be authenticated.
Specifically, the authentication unit 134 has functional configurations of an authentication target image acquisition unit 240, a second partial extraction unit 250, an image rotation correction unit 260, a feature line extraction unit 270, and an authentication processing unit 280. Yes.

  The authentication target image acquisition unit 240 of the authentication unit 134 performs processing for acquiring the handshake image received by the handshake image reception unit 132 as the authentication target image when the “authentication mode” is set by the mode setting unit 131. .

  The second partial extraction unit 250 of the authentication unit 134 extracts the fingertip pattern portion of the authentication target person's hand 300 from the authentication target image acquired by the authentication target image acquisition unit 240 as an authentication target fingertip pattern image, and A process of extracting the palm print portion of the authentication subject's hand 300 from the target image as the authentication target palm print image is performed. Although details will be described later, the second partial extraction unit 250 of the authentication unit 134 detects the skin color area of the authentication target image acquired by the authentication target image acquisition unit 240, and the barycentric position of the skin color area is a predetermined position. The authentication target image is rotated so that the predetermined areas in the authentication target image after the rotation are extracted as the authentication target fingertip pattern image and the authentication target palm pattern image.

The authentication processing unit 280 of the authentication unit 134 includes a fingertip pattern matching process for matching the authentication registered fingertip pattern image 231a and the authentication target fingertip pattern image, and a palmprint matching process for matching the authentication registered palmprint image 231b and the authentication target palmprint image. Based on the result of the above, authentication processing of the person to be authenticated is performed. The authentication processing unit 280 of the authentication unit 134 includes a first authentication processing unit 281 and a second authentication processing unit 282. Here, only the first authentication processing unit 281 will be described, and the second authentication processing unit 282 will be described later.
The first authentication processing unit 281 of the authentication unit 134 compares the feature points of the authentication registered fingertip pattern image 231a with the feature points of the authentication target fingertip pattern image extracted by the second partial extraction unit 250. The first authentication process based on the result of the collation process and the first palm print collation process for collating the feature points of the authentication registered palm print image 231b and the feature points of the authentication target palm print image extracted by the second partial extraction unit 250 I do. Specifically, the first authentication processing unit 281 of the authentication unit 134 determines that the number of matches between the feature points of the authentication registered fingertip pattern image 231a and the feature points of the authentication target fingertip pattern image as a result of the first fingertip pattern matching process. When the number of matches between the feature points of the authentication registered palm print image 231b and the feature points of the authentication target palm print image is greater than or equal to the second threshold as a result of the first palm print matching process. In the first authentication process, a process for permitting authentication of the person to be authenticated is performed.

The image rotation correction unit 260 of the authentication unit 134 performs the following processing when the authentication of the person to be authenticated is not permitted in the first authentication processing by the first authentication processing unit 281.
Specifically, the image rotation correction unit 260 of the authentication unit 134 includes the feature points of the matching authentication fingertip pattern image 231a obtained as a result of the first fingertip pattern matching process by the first authentication processing unit 281 and the authentication target. A process of calculating an angle difference between the authentication registered fingertip pattern image 231a and the authentication target fingertip pattern image based on the feature point of the fingertip pattern image and rotationally correcting the authentication target fingertip pattern image according to the angle difference I do. Similarly, the image rotation correction unit 260 of the authentication unit 134 includes the feature points of the matching authentication registered palm print image 231b obtained as a result of the first palm print collation processing by the first authentication processing unit 281 and the authentication target palm print image. An angle difference between the authentication registered palm print image 231b and the authentication target palm print image is calculated based on the feature point, and a process of rotationally correcting the authentication target palm print image according to the angle difference is performed.

The feature line extraction unit 270 of the authentication unit 134 performs a process of extracting a feature line from each image when authentication of the person to be authenticated is not permitted in the first authentication process by the first authentication processing unit 281. The feature line extraction unit 270 of the authentication unit 134 includes a first feature line extraction unit 271 and a second feature line extraction unit 272.
Specifically, the first feature line extraction unit 271 of the authentication unit 134 authenticates the authentication registered fingertip pattern image when authentication of the person to be authenticated is not permitted in the first authentication processing by the first authentication processing unit 281. A process of extracting the feature line 231a and the feature line of the fingertip pattern image to be authenticated is performed. At this time, when the first feature line extraction unit 271 of the authentication unit 134 extracts the feature line of the authentication target fingertip pattern image, the feature line of the authentication target fingertip pattern image that has been rotationally corrected by the image rotation correction unit 260. The process which extracts is performed.
Specifically, the second feature line extraction unit 272 of the authentication unit 134 performs authentication registration palmprint when authentication of the person to be authenticated is not permitted in the first authentication processing by the first authentication processing unit 281. A process of extracting the feature line of the image 231b and the feature line of the authentication target palm print image is performed. At this time, the second feature line extraction unit 272 of the authentication unit 134 extracts the feature line of the authentication target palm print image that has been rotationally corrected by the image rotation correction unit 260 when extracting the feature line of the authentication target palm print image. Perform the process.

Here, the second authentication processing unit 282 of the authentication unit 134 will be described.
The second authentication processing unit 282 of the authentication unit 134 compares the feature line of the authentication registered fingertip pattern image 231a extracted by the first feature line extraction unit 271 with the feature line of the authentication target fingertip pattern image. Based on the result of the pattern matching process and the second palm pattern matching process for matching the feature line of the authentication registered palm pattern image 231b extracted by the second feature line extraction unit 272 with the feature line of the authentication target palm pattern image. Perform authentication process. Specifically, the second authentication processing unit 282 of the authentication unit 134 has a similarity between the feature line of the authentication registered fingertip pattern image 231a and the feature line of the authentication target fingertip pattern image as a result of the second fingertip pattern matching process. The similarity between the feature line of the authentication registered palm print image 231b and the feature line of the authentication target palm print image is greater than or equal to the fourth threshold as a result of the second palm print matching process. In some cases, a process of permitting authentication of the person to be authenticated is performed in the second authentication process.

  Next, an example of the processing procedure of the authentication processing method by the authentication processing apparatus 100 will be described.

  FIG. 3A is a flowchart illustrating an example of a processing procedure of the authentication processing method by the authentication processing apparatus according to the embodiment of the present invention.

  When the process of FIG. 3A is started, first, in step S101, the mode setting unit 131 determines whether or not the set operation mode is “registration mode”.

  As a result of the determination in step S101, when the set operation mode is not “registration mode” (in this embodiment, “authentication mode”), the process proceeds to the flowchart illustrated in FIG.

On the other hand, if it is determined in step S101 that the set operation mode is “registration mode”, the process proceeds to step S102.
When the process proceeds to step S102, first, based on the control by the information processing apparatus 130, the imaging apparatus 110 indicates that when the authentication registrant holds the door knob with the hand 300, the fluctuation of the hand 300 is equal to or less than a predetermined threshold. As a trigger, a handshake image of the hand 300 is taken. At the time of shooting, the information processing apparatus 130 performs control to turn on the lighting device 120. Next, the handshake image reception unit 132 receives the handshake image, and the authentication registration image acquisition unit 210 of the registration unit 133 acquires the handshake image received by the handshake image reception unit 132 as an authentication registration image. I do. In this embodiment, an example in which one handshake image is taken as a handshake image serving as an authentication registration image is shown. However, in the present embodiment, the present invention is not limited to this. A mode in which a handshake image is taken is also applicable.

  Subsequently, in step S103, the first partial extraction unit 220 of the registration unit 133 extracts the fingertip pattern portion of the authentication registrant's hand 300 as an authentication registration fingertip pattern image from the authentication registration image acquired in step S102. At the same time, a process of extracting the palm print portion of the authentication registrant's hand 300 as the authentication registration palm print image from the authentication registration image is performed. The image extraction processing by the first partial extraction unit 220 in step S103 will be described in detail with reference to FIGS.

FIG. 4A is a diagram illustrating an example of the handshake image received by the handshake image receiving unit 132 of FIG. 2 according to the embodiment of the present invention.
Here, it is assumed that the handshake image shown in FIG. 4A is acquired as an authentication registration image in step S102.

  FIGS. 4-2 to 4-5 illustrate the embodiment of the present invention, and are diagrams for explaining image extraction processing by the first partial extraction unit 220 and the second partial extraction unit 250 of FIG.

First, the first partial extraction unit 220 of the registration unit 133 masks unnecessary portions of the handshake image (in this case, the authentication registration image) shown in FIG. A handshake image (here, an authentication registration image) is obtained.
Next, the first partial extraction unit 220 of the registration unit 133 performs processing for detecting a skin color region on the image illustrated in FIG. 4-2 to obtain the image illustrated in FIG. 4-3. Here, in the image shown in FIG. 4C, a skin color region 401 and a reference line 402 indicating a reference position (predetermined position) for alignment are shown.
Next, the first partial extraction unit 220 of the registration unit 133 performs image rotation processing so that the barycentric position of the skin color region 401 becomes the reference position (predetermined position) indicated by the reference line 402 in the image shown in FIG. I do. The image is shown in Fig. 4-4. Then, the first partial extraction unit 220 of the registration unit 133 performs this image rotation process on the handshake image (here, the authentication registration image) shown in FIG. A handshake image (here, an authentication registration image) is obtained. Then, the first partial extraction unit 220 of the registration unit 133 uses a fingertip pattern image (here, authentication registration) for each predetermined area in the rotated handshake image (here, authentication registration image) shown in FIG. Extracted as a fingertip pattern image 410 and a palm pattern image (here, an authentication registered palm pattern image) 420.
By performing the image rotation processing described with reference to FIGS. 4-2 to 4-5, the fingertip pattern portion and the palm pattern portion can be aligned, and each region of interest (predetermined region) is designated. Thus, the fingertip pattern image (here, the authentication registered fingertip pattern image) 410 and the palm pattern image (here, the authentication registered palm pattern image) 420 can be automatically extracted.

Here, the description returns to FIG. 3-1.
When the process of step S103 ends, the process proceeds to step S104.
In step S104, the registration unit 133 stores the authentication registration fingertip pattern image 231a and the authentication registration palm pattern image 231b extracted in step S103 in association with the authentication registration image 231 together with the authentication registration image 231 acquired in step S102. It is stored and registered in the authentication registration image storage unit 230. For example, in the example illustrated in FIG. 4-5, the entire image illustrated in FIG. 4-5 is stored as the authentication registration image 231, the fingertip pattern image 410 is stored as the authentication registration fingertip pattern image 231 a, and the palmprint is stored as the authentication registration palmprint image 231 b. The image 420 is stored.

  When the process of step S104 ends, the process of the flowchart shown in FIG. If there are a plurality of authentication registrants, the process shown in the flowchart of FIG. 3A is performed for each authentication registrant, and each authentication registrant is associated with the authentication registration image together with the authentication registration image. Thus, the authentication registration fingertip pattern image and the authentication registration palm pattern image are stored in the authentication registration image storage unit 230 and registered.

As described above, when the set operation mode is not “registration mode” (in the case of the present embodiment, “authentication mode”) as a result of the determination in step S101 of FIG. 3A, FIG. -2 transitions to the flowchart shown.
Here, FIG. 3-2 is a flowchart illustrating an example of a processing procedure of the authentication processing method by the authentication processing apparatus according to the embodiment of the present invention, following FIG. 3-1.

  When transitioning to the authentication mode illustrated in FIG. 3B, first, in step S <b> 201, the imaging device 110 performs the operation of the hand 300 when the person to be authenticated holds the door knob with the hand 300 based on the control by the information processing device 130. When the fluctuation is equal to or less than a predetermined threshold, a handshake image of the hand 300 is taken. At the time of shooting, the information processing apparatus 130 performs control to turn on the lighting device 120. Next, the handshake image reception unit 132 receives the handshake image, and the authentication target image acquisition unit 240 of the authentication unit 134 acquires the handshake image received by the handshake image reception unit 132 as an authentication target image. I do. In this embodiment, an example in which one handshake image is captured as a handshake image serving as an authentication target image is shown. However, in this embodiment, the present invention is not limited to this. A mode in which a handshake image is taken is also applicable.

  Subsequently, in step S202, the second partial extraction unit 250 of the authentication unit 134 extracts the fingertip pattern portion of the authentication target person's hand 300 from the authentication target image acquired in step S201 as an authentication target fingertip pattern image. At the same time, processing is performed to extract the palm print portion of the authentication subject person's hand 300 from the authentication target image as the authentication target palm print image. Although it is the same as the detail of the process in step S103 mentioned above, the image extraction process by the 2nd partial extraction part 250 in this step S202 is demonstrated in detail using FIGS. 4-1-FIGS. 4-5.

As described above, FIG. 4A is a diagram illustrating an example of the handshake image received by the handshake image receiving unit 132 of FIG. 2 according to the embodiment of the present invention.
Here, it is assumed that the handshake image shown in FIG. 4A is acquired as the authentication target image in step S201.

First, the second partial extraction unit 250 of the authentication unit 134 masks an unnecessary portion of the handshake image (here, the authentication target image) illustrated in FIG. A handshake image (here, the authentication target image) is obtained.
Next, the second partial extraction unit 250 of the authentication unit 134 performs a process of detecting a skin color region on the image illustrated in FIG. 4-2 to obtain the image illustrated in FIG. 4-3. Here, in the image shown in FIG. 4C, a skin color region 401 and a reference line 402 indicating a reference position (predetermined position) for alignment are shown.
Next, the second partial extraction unit 250 of the authentication unit 134 performs image rotation processing so that the barycentric position of the skin color region 401 becomes the reference position (predetermined position) indicated by the reference line 402 in the image illustrated in FIG. I do. The image is shown in Fig. 4-4. Then, the second partial extraction unit 250 of the authentication unit 134 performs this image rotation process on the handheld image (here, the authentication target image) illustrated in FIG. A handshake image (here, the authentication target image) is obtained. Then, the second partial extraction unit 250 of the authentication unit 134 uses a fingertip pattern image (here, the authentication target) for each predetermined area in the rotated hand-grip image (here, the authentication target image) illustrated in FIG. Extracted as a fingertip pattern image 410 and a palm print image (here, authentication target palm print image) 420.
By performing the image rotation processing described with reference to FIGS. 4-2 to 4-5, the fingertip pattern portion and the palm pattern portion can be aligned, and each region of interest (predetermined region) is designated. Thus, the fingertip pattern image (here, the authentication target fingertip pattern image) 410 and the palm pattern image (here, the authentication target palm pattern image) 420 can be automatically extracted.

Here, it returns to description of FIG. 3-2 again.
When the process of step S202 ends, the process proceeds to step S203.
In step S203, the first authentication processing unit 281 of the authentication unit 134 extracts the feature points of the authentication registered fingertip pattern image 231a (in this example, the feature points based on SURF (Speeded Up Robust Features)) and the step S202. The first fingertip pattern matching process for matching the feature point of the authentication target fingertip pattern image (in this example, the feature point by SURF) and the feature point of the authentication registered palmprint image 231b (in this example, the feature point by SURF) And a first authentication process based on the result of the first palm pattern matching process for matching the feature point of the authentication target palm print image extracted in step S202 (in this example, the feature point by SURF), It is determined whether or not the authentication process is OK. Specifically, the first authentication processing unit 281 of the authentication unit 134 determines that the number of matches between the feature points of the authentication registered fingertip pattern image 231a and the feature points of the authentication target fingertip pattern image as a result of the first fingertip pattern matching process. When the number of matches between the feature points of the authentication registered palm print image 231b and the feature points of the authentication target palm print image is greater than or equal to the second threshold as a result of the first palm print matching process. Then, it is determined that the first authentication process is OK. The first authentication process performed by the first authentication processing unit 281 in step S203 will be described in detail with reference to FIGS.

FIG. 5A is a diagram for explaining the first authentication process by the first authentication processing unit 281 in FIG. 2 according to the embodiment of the present invention.
5A and 5B, the authentication registration palmprint image 231b is shown as the authentication registration image, and the authentication target palmprint image is shown as the authentication target image. In FIG. 5A and FIG. 5B, a pair of the feature point of the matching authentication registration image and the feature point of the authentication target image is illustrated as one line segment. Here, FIG. 5-1 (a) shows a case where the number of matching feature points (number of matching feature points) is equal to or greater than a certain threshold value (in FIG. 5A, it is painted black). The line segments connecting the areas (mask areas) are shown, but these line segments are not counted as matching feature point pairs.) FIG. 5-1 (b) shows matching feature point pairs. This shows a case where the number (number of matching feature points) is less than a certain threshold.

FIG. 5-2 shows an embodiment of the present invention, and shows the experimental result of the number of pairs of feature points that match the fingertip pattern part (fingertip pattern image) when the first authentication process is performed on the person and others. FIG. In FIG. 5-2, the principal is indicated by ◇ and the others are indicated by ●.
From the experimental result shown in FIG. 5B, the first authentication processing unit 281 of the authentication unit 134 sets the number of pairs as 15 as the first threshold value 501, and it is determined that the other person is OK in the first authentication processing. (Other people's rejection rate 100%). In the experimental results shown in FIG. 5B, when the number of pairs is set to 15 as the first threshold value 501, the result that the acceptance rate is 87.5% is obtained.

FIG. 5-3 illustrates the embodiment of the present invention, and is a diagram illustrating experimental results of the number of pairs of feature points that coincide with palm print portions (palm print images) when the first authentication process is performed on the person and others. It is. In FIG. 5-3, the principal is indicated by ◇ and the others are indicated by ●.
From the experimental results shown in FIG. 5C, the first authentication processing unit 281 of the authentication unit 134 sets the number of pairs as 6 as the second threshold value 502, and it is determined that the other person is OK in the first authentication processing. (Other people's rejection rate 100%). In the experimental results shown in FIG. 5C, when the number of pairs is set as the second threshold value 502, the result that the person acceptance rate is 62.5% is obtained.

  As shown in FIGS. 5-2 and 5-3, the first authentication processing unit 281 of the authentication unit 134 determines the feature points of the authentication registered fingertip pattern image 231a and the authentication target as a result of the first fingertip pattern matching process. When the number of matches with the feature point of the fingertip pattern image is equal to or greater than the first threshold value 501, or as a result of the first palmprint matching process, the feature point of the authentication registered palmprint image 231b and the feature point of the authentication target palmprint image When the number of matches is equal to or greater than the second threshold value 502, it is determined that the user is the person himself / herself, and the first authentication process is determined to be OK. In the case of the example shown in FIG. 5B and FIG. 5C, as a result of performing the first authentication process described above, the result is that the rejection rate of others is 100% and the acceptance rate of the principal is 92.5%. .

Here, it returns to description of FIG. 3-2 again.
As a result of the determination in step S203, if it is determined that the first authentication process is OK, the process proceeds to step S208.
In step S208, the first authentication processing unit 281 (or the authentication processing unit 280) of the authentication unit 134 performs processing for permitting authentication of the authentication target person. For example, the first authentication processing unit 281 (or the authentication processing unit 280) performs a process of unlocking the electric lock device 160 as a process for permitting authentication of the authentication target person, and the authentication target person opens the door. To enter the room. Furthermore, the first authentication processing unit 281 (or the authentication processing unit 280) performs processing for displaying the result of the authentication processing (indicating that authentication is OK) on the display device 140 as necessary.
Thereafter, the process of the flowchart of FIG.

On the other hand, as a result of the determination in step S203, if it is determined that the first authentication process is not OK (NG), the process proceeds to step S204.
In step S204, the image rotation correction unit 260 of the authentication unit 134 recognizes the feature points and authentication of the matching authentication fingertip pattern image 231a obtained as a result of the first fingertip pattern matching process by the first authentication processing unit 281. An angle difference between the authentication registered fingertip pattern image 231a and the authentication target fingertip pattern image is calculated based on the feature point of the target fingertip pattern image, and the authentication target fingertip pattern image is rotationally corrected according to the angle difference. Process. Similarly, the image rotation correction unit 260 of the authentication unit 134 includes the feature points of the matching authentication registered palm print image 231b obtained as a result of the first palm print matching process by the first authentication processing unit 281 and the features of the authentication target palm print image. Based on the point, an angle difference between the authentication registered palm print image 231b and the authentication target palm print image is calculated, and the authentication target palm print image is rotationally corrected according to the angle difference. The image rotation correction process in step S204 will be described in detail with reference to FIG.

  FIG. 6 is a diagram for explaining the processing of steps S204 to S206 of FIG. 3-2.

FIG. 6 shows an authentication registration image, an authentication target image before rotation correction, and an authentication target image after rotation correction. In this case, for example, the image rotation correction unit 260 of the authentication unit 134 performs the authentication registration image and the authentication target before the rotation correction for each pair of the matching feature point of the authentication registration image and the feature point of the authentication target image before the rotation correction. An angle difference between the image and the image is calculated, and the angle difference calculated for each pair of matching feature points is averaged to obtain a rotation correction angle. Specifically, the authentication target image after the rotation correction illustrated in FIG. 6 is obtained by rotating and correcting the authentication target image before the rotation correction by a rotation correction angle of −5.83 °. For example, as an image of the rotation correction processing in step S204, as shown in FIGS. 5-1 (a) and 5-1 (b), when the authentication registration image and the authentication target image are arranged side by side, they match. When a line segment indicating a pair of feature points of both images is inclined with respect to the horizontal direction, the authentication target image is rotationally corrected so that the line segment is in the horizontal direction.
In this step, the rotation correction processing of the authentication target fingertip pattern image and the authentication target palm print image is performed in this way.

Here, it returns to description of FIG. 3-2 again.
When the process of step S204 ends, the process proceeds to step S205.
In step S205, the first feature line extraction unit 271 of the authentication unit 134 obtains the feature line of the authentication registered fingertip pattern image 231a and the feature line of the authentication target fingertip pattern image subjected to the rotation correction process in step S204. Perform the extraction process. The feature line extraction process in step S205 will be described in detail with reference to FIG.

FIG. 7 illustrates an embodiment of the present invention and is a diagram for describing feature line extraction processing by the first feature line extraction unit 271 and the second feature line extraction unit 272 of FIG.
First, as shown in FIG. 7A, the first feature line extraction unit 271 of the authentication unit 134 applies LoG () to the fingertip pattern image 720 indicating the authentication registered fingertip pattern image 231a and the authentication target fingertip pattern image 720. A filter process using a Laplacian of Gaussian filter is performed to obtain a fingertip pattern image 721 after the filter process. Specifically, the fingertip pattern image 720 is smoothed with a Gaussian filter, edge detection is performed with a Laplacian filter, and a filtered fingertip pattern image 721 is obtained.
Next, the first feature line extraction unit 271 of the authentication unit 134 performs binarization processing on the post-filtering fingertip pattern image 721 as illustrated in FIG. A fingertip pattern image 722 is obtained. Then, the first feature line extraction unit 271 of the authentication unit 134 extracts a portion indicated by white in the binarized fingertip pattern image 722 as a feature line. FIG. 6 shows an example of an image of the feature line of the authentication registration image and the feature line of the authentication target image.
In this step, processing for extracting the feature line of the authentication registered fingertip pattern image 231a and the feature line of the authentication target fingertip pattern image subjected to the rotation correction processing in step S204 is performed in this way.

Here, it returns to description of FIG. 3-2 again.
When the process of step S205 ends, the process proceeds to step S206.
In step S206, the second feature line extraction unit 272 of the authentication unit 134 extracts the feature line of the authentication registered palm print image 231b and the feature line of the authentication target palm print image subjected to the rotation correction process in step S204. Process. The feature line extraction process in step S206 will be described in detail with reference to FIG.

First, as shown in FIG. 7A, the second feature line extraction unit 272 of the authentication unit 134 performs a filtering process using a LoG filter on the authentication registered palm print image 231b and the palm print image 710 indicating the authentication target palm print image. To obtain a filtered palm print image 711. Specifically, the palm print image 710 is smoothed with a Gaussian filter, and edge detection is performed with a Laplacian filter to obtain a filtered palm print image 711.
Next, the second feature line extraction unit 272 of the authentication unit 134 performs binarization processing on the post-filtering palm print image 711 as shown in FIG. An image 712 is obtained. Then, the second feature line extraction unit 272 of the authentication unit 134 extracts a portion indicated by white in the binarized palm print image 712 as a feature line. FIG. 6 shows an example of an image of the feature line of the authentication registration image and the feature line of the authentication target image.
In this step, processing for extracting the feature line of the authentication registered palm print image 231b and the feature line of the authentication target palm print image subjected to the rotation correction processing in step S204 is performed in this way.

Here, it returns to description of FIG. 3-2 again.
When the process of step S206 ends, the process proceeds to step S207.
In step S207, the second authentication processing unit 282 of the authentication unit 134 compares the feature line of the authentication registered fingertip pattern image 231a extracted in step S205 with the feature line of the authentication target fingertip pattern image. A second authentication process is performed based on the result of the fingertip pattern matching process and the second palm pattern matching process for matching the feature line of the authentication registered palm pattern image 231b extracted in step S206 with the feature line of the authentication target palm pattern image. Thus, it is determined whether or not the second authentication process is OK. Specifically, the second authentication processing unit 282 of the authentication unit 134 has a similarity between the feature line of the authentication registered fingertip pattern image 231a and the feature line of the authentication target fingertip pattern image as a result of the second fingertip pattern matching process. The similarity between the feature line of the authentication registered palm print image 231b and the feature line of the authentication target palm print image is greater than or equal to the fourth threshold as a result of the second palm print matching process. If there is, it is determined that the second authentication process is OK. The second authentication process performed by the second authentication processing unit 282 in step S207 will be described in detail with reference to FIGS. 6 and 8-1 to 8-2.

FIG. 6 shows an example of an image of the feature line of the authentication registration image and the feature line of the authentication target image. First, the second authentication processing unit 282 of the authentication unit 134 calculates the similarity shown in the following equation (1) for the feature lines of both the authentication registration image and the authentication target image.
Similarity [%] = (common edge amount of both images) ÷ (edge amount of authentication registration image) × 100
... (1)
In the above equation (1), the “common edge amount of both images” is the image indicated by “AND” in FIG. In FIG. 6, the similarity between the feature line of the authentication registration image and the feature line of the authentication target image before the rotation correction is 5.29%, and the feature line of the authentication registration image and the authentication target image after the rotation correction are displayed. If the similarity to the feature line is 76.27%, and the positions of the feature points of the matching images are shifted, it is shown that it is effective to perform the image rotation correction processing in step S204. ing.

FIG. 8A is a diagram illustrating an embodiment of the present invention and a result of an experiment on the similarity of the fingertip pattern portion (fingertip pattern image) when the second authentication process is performed on the person and others. In FIG. 8A, the principal is indicated by ◇ and the others are indicated by ●. Here, the similarity is calculated by the above-described equation (1). Also, the principal (◇) shown in FIG. 8A is a person who has not been determined to be the principal in the first authentication process described above.
Based on the experimental results illustrated in FIG. 8A, the second authentication processing unit 282 of the authentication unit 134 sets the similarity to 50% as the third threshold value 503. In this case, the rejection rate of others was 97.2%, and the acceptance rate was 97.2%.

FIG. 8B is a diagram illustrating an embodiment of the present invention and a result of an experiment on the similarity of the palm print portion (palm print image) when the second authentication process is performed on the person and others. In FIG. 8-2, the principal is indicated by ◇ and the others are indicated by ●. Here, the similarity is calculated by the above-described equation (1). Also, the principal (（) shown in FIG. 8-2 is a person who is not determined to be the principal in the first authentication process described above.
From the experimental result shown in FIG. 8B, the second authentication processing unit 282 of the authentication unit 134 sets the similarity to 50% as the fourth threshold value 504. In this case, the result was a rejection rate of 100% and an acceptance rate of 83.3%.

  As illustrated in FIGS. 8A and 8B, the second authentication processing unit 282 of the authentication unit 134 determines the feature line of the authentication registered fingertip pattern image 231a and the authentication target as a result of the second fingertip pattern matching process. When the similarity with the feature line of the fingertip pattern image is equal to or greater than the third threshold value 503, and as a result of the second palm print matching process, the feature line of the authentication registered palm print image 231b and the feature of the authentication target palm print image When the similarity with the line is equal to or greater than the fourth threshold value 504, it is determined that the user is the person, and the second authentication process is determined to be OK. In the case of the examples shown in FIGS. 8A and 8B, the second authentication process described above was performed, and as a result, the rejection rate of others was 100% and the acceptance rate of the person was 83.3%. .

Here, it returns to description of FIG. 3-2 again.
As a result of the determination in step S207, if it is determined that the second authentication process is OK, the process proceeds to step S208.
In step S208, the second authentication processing unit 282 (or authentication processing unit 280) of the authentication unit 134 performs processing for permitting authentication of the authentication target person. For example, the second authentication processing unit 282 (or the authentication processing unit 280) performs a process of unlocking the electric lock device 160 as a process for permitting authentication of the authentication target person, and the authentication target person opens the door. To enter the room. Further, the second authentication processing unit 282 (or the authentication processing unit 280) performs processing for displaying the result of the authentication processing (indicating that authentication is OK) on the display device 140 as necessary.
Thereafter, the process of the flowchart of FIG.

On the other hand, as a result of the determination in step S207, if it is determined that the second authentication process is not OK (NG), the process proceeds to step S209.
In step S209, the second authentication processing unit 282 (or the authentication processing unit 280) of the authentication unit 134 performs processing for disallowing authentication of the authentication target person. For example, the second authentication processing unit 282 (or the authentication processing unit 280) performs a process of locking the electric lock device 160 (maintaining locking) as a process for disabling authentication of the person to be authenticated, Ensure that the person to be authenticated cannot enter the room without opening the door. Further, the second authentication processing unit 282 (or the authentication processing unit 280) performs processing for displaying the result of the authentication processing (indicating that the authentication is NG) on the display device 140 as necessary.
Thereafter, the process of the flowchart of FIG.

  According to the present embodiment, a photographing device (omnidirectional camera) is provided inside the handle, and the authentication target person's authentication is performed using the handshake image photographed by the photographing device when the authentication target person holds the handle with the hand. Since the authentication process is performed, the authentication target person can perform the authentication process in a natural operation without performing a special operation for the authentication process.

  Furthermore, according to the first embodiment, the fingertip pattern matching process for matching the authentication registered fingertip pattern image with the authentication target fingertip pattern image, and the palmprint matching process for matching the authentication registered palmprint image with the authentication target palmprint image Since the authentication target person authentication process is performed based on the result, for example, the authentication accuracy can be improved as compared with the case where the authentication target person authentication process is performed only from the palmprint matching process. For example, in the authentication processing apparatus 100 according to the embodiment of the present invention, another person is obtained by performing the fingertip pattern matching process and the palm pattern matching process shown in FIGS. 5-2 to 5-3 and FIGS. 8-1 to 8-2. The result was that the rejection rate was 100% and the person acceptance rate was 98.75%. However, when only the palm print matching process was performed as a comparative example, the other person rejection rate was 100% and the person acceptance rate was 93. The result was 7%. That is, in this case, it can be seen that the present embodiment can improve the authentication accuracy with respect to the person acceptance rate as compared with the case where the authentication target person authentication process is performed only from the palmprint matching process.

(Other embodiments)
In the embodiment of the present invention described above, the first partial extraction unit 220 is provided in the registration unit 133, and at the time of registration, the authentication registration fingertip pattern image and the authentication registration palm print image are extracted from the authentication registration image. The present invention is not limited to this form. For example, the first partial extraction unit 220 is provided in the authentication unit 134, stores and registers only the authentication registration image at the time of registration, and extracts the authentication registration fingertip pattern image and the authentication registration palm pattern image from the authentication registration image at the time of authentication. A form in which authentication processing is performed is also included in the present invention.

The present invention can also be realized by executing the following processing.
That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed. This program and a computer-readable recording medium storing the program are included in the present invention.

  Note that the above-described embodiments of the present invention are merely examples of implementation in practicing the present invention, and the technical scope of the present invention should not be construed as being limited thereto. It is. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100: Authentication processing device 110: Imaging device (omnidirectional camera) 120: Illumination device 130: Information processing device 131: Mode setting unit 132: Handshake image receiving unit 133: Registration unit 134: Authentication unit 140: display device, 150: operation input device, 160: electric lock device, 210: authentication registration image acquisition unit, 220: first partial extraction unit, 230: authentication registration image storage unit, 231: authentication registration image, 231a : Authentication registered fingertip pattern image, 231b: Authentication registered palm print image, 240: Authentication object image acquisition unit, 250: Second partial extraction unit, 260: Image rotation correction unit, 270: Feature line extraction unit, 271: First Feature line extraction unit, 272: second feature line extraction unit, 280: authentication processing unit, 281: first authentication processing unit, 282: second authentication processing unit, 300: hand

Claims (7)

An imaging means provided inside the handle and configured to be able to take a grip image of the hand when the handle is gripped by a hand;
Storage means for storing, as an authentication registration image, a grip image taken by the photographing means when an authentication registrant grips the handle with his / her hand during registration;
At the time of authentication, an acquisition unit that acquires, as an authentication target image, a handheld image captured by the imaging unit when the authentication target person grips the handle with a hand;
First, a fingertip pattern portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration fingertip pattern image, and a palmprint portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration palmprint image. A partial extraction means of
A fingertip pattern portion of the authentication subject's hand is extracted as an authentication target fingertip pattern image from the authentication target image, and a palmprint portion of the authentication subject's hand is extracted as an authentication target palmprint image from the authentication target image. A partial extraction means of
Based on the results of a fingertip pattern matching process for matching the authentication registered fingertip pattern image and the authentication target fingertip pattern image and a palmprint matching process for matching the authentication registered palmprint image and the authentication target palmprint image. An authentication processing means for performing authentication processing of the target person;
I have a,
The authentication processing means includes
As the authentication process, a first fingertip pattern matching process for matching a feature point of the authentication registered fingertip pattern image with a feature point of the authentication target fingertip pattern image, a feature point of the authentication registered palmprint image, and the authentication target palmprint A first authentication process based on a result of a first palm print matching process for matching feature points of an image;
As a result of the first fingertip pattern collation process, when the number of matches between the feature points of the authentication registered fingertip pattern image and the feature points of the authentication target fingertip pattern image is equal to or greater than a first threshold, or the first If the number of matches between the feature points of the authentication registered palm print image and the feature points of the authentication target palm print image is greater than or equal to a second threshold as a result of the palm print matching process, the authentication target person's Allow authentication,
First feature line extraction for extracting a feature line of the authentication registered fingertip pattern image and a feature line of the authentication target fingertip pattern image when authentication of the authentication target person is not permitted in the first authentication process Means,
Second feature line extraction means for extracting a feature line of the authentication registration palmprint image and a feature line of the authentication subject palmprint image when authentication of the person to be authenticated is not permitted in the first authentication process; ,
Further comprising
The authentication processing means includes
As the authentication process, in addition to the first authentication process, a feature line of the authentication registered fingertip pattern image extracted by the first feature line extraction unit is matched with a feature line of the authentication target fingertip pattern image. A second fingertip pattern matching process, and a second palmprint matching process for matching the feature line of the authentication registered palmprint image extracted by the second feature line extraction unit with the feature line of the authentication target palmprint image A second authentication process based on the result,
As a result of the second fingertip pattern collation process, the similarity between the feature line of the authentication registered fingertip pattern image and the feature line of the authentication target fingertip pattern image is a third threshold value or more, and If the similarity between the feature line of the authentication registered palm print image and the feature line of the authentication target palm print image is greater than or equal to a fourth threshold as a result of the second palm print matching process, the authentication process is performed in the second authentication process. An authentication processing device, characterized by permitting authentication of a subject . The authentication registered fingertip pattern image and the authentication target fingertip based on the matching feature point of the authentication registered fingertip pattern image and the feature point of the authentication target fingertip pattern image obtained as a result of the first fingertip pattern matching process Calculating an angle difference with the pattern image, rotationally correcting the authentication target fingertip pattern image in accordance with the angle difference, and the matching authentication registered palm pattern image obtained as a result of the first palm pattern matching process; An angle difference between the authentication registered palm print image and the authentication target palm print image is calculated based on the feature point of the authentication target palm print image and the authentication target palm print image, and the authentication target palm print image is rotated according to the angle difference. It further has an image rotation correction means for correcting,
The first feature line extraction unit extracts the feature line of the authentication target fingertip pattern image that has been subjected to rotation correction by the image rotation correction unit when extracting the feature line of the authentication target fingertip pattern image;
The second feature line extraction unit extracts a feature line of the authentication target palmprint image that has been subjected to rotation correction by the image rotation correction unit when extracting a feature line of the authentication target palmprint image. The authentication processing device according to claim 1 . An imaging means provided inside the handle and configured to be able to take a grip image of the hand when the handle is gripped by a hand;
Storage means for storing, as an authentication registration image, a grip image taken by the photographing means when an authentication registrant grips the handle with his / her hand during registration;
At the time of authentication, an acquisition unit that acquires, as an authentication target image, a handheld image captured by the imaging unit when the authentication target person grips the handle with a hand;
First, a fingertip pattern portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration fingertip pattern image, and a palmprint portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration palmprint image. A partial extraction means of
A fingertip pattern portion of the authentication subject's hand is extracted as an authentication target fingertip pattern image from the authentication target image, and a palmprint portion of the authentication subject's hand is extracted as an authentication target palmprint image from the authentication target image. A partial extraction means of
Based on the results of a fingertip pattern matching process for matching the authentication registered fingertip pattern image and the authentication target fingertip pattern image and a palmprint matching process for matching the authentication registered palmprint image and the authentication target palmprint image. An authentication processing means for performing authentication processing of the target person;
I have a,
The first partial extraction means detects the skin color area of the authentication registration image, rotates the authentication registration image so that the center of gravity of the skin color area becomes a predetermined position, and the authentication registration image after the rotation. A predetermined area in each of the authentication registration fingertip pattern image and the authentication registration palm print image,
The second partial extraction means detects the skin color area of the authentication target image, rotates the authentication target image so that the center of gravity of the skin color area becomes a predetermined position, and the authentication target image after the rotation An authentication processing apparatus characterized in that predetermined regions in each are extracted as the authentication target fingertip pattern image and the authentication target palm print image . The storage means stores the authentication registration fingertip pattern image and the authentication registration palmprint image extracted by the first partial extraction means in association with the authentication registration image together with the authentication registration image. Item 4. The authentication processing device according to any one of Items 1 to 3 . An authentication processing method provided by an authentication processing apparatus provided with an imaging unit provided inside a handle and configured to be able to capture a grip image of the hand when the handle is gripped by a hand,
A storage step of storing, in the storage unit, a handshake image photographed by the photographing unit when the authentication registrant grips the handle with a hand at the time of registration;
At the time of authentication, an acquisition step of acquiring a grip image captured by the imaging unit as an authentication target image when the authentication target person grips the handle with a hand;
First, a fingertip pattern portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration fingertip pattern image, and a palmprint portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration palmprint image. A partial extraction step of
A fingertip pattern portion of the authentication subject's hand is extracted as an authentication target fingertip pattern image from the authentication target image, and a palmprint portion of the authentication subject's hand is extracted as an authentication target palmprint image from the authentication target image. A partial extraction step of
Based on the results of a fingertip pattern matching process for matching the authentication registered fingertip pattern image and the authentication target fingertip pattern image and a palmprint matching process for matching the authentication registered palmprint image and the authentication target palmprint image. An authentication processing step for performing authentication processing of the target person;
I have a,
The authentication processing step includes
As the authentication process, a first fingertip pattern matching process for matching a feature point of the authentication registered fingertip pattern image with a feature point of the authentication target fingertip pattern image, a feature point of the authentication registered palmprint image, and the authentication target palmprint A first authentication process based on a result of a first palm print matching process for matching feature points of an image;
As a result of the first fingertip pattern collation process, when the number of matches between the feature points of the authentication registered fingertip pattern image and the feature points of the authentication target fingertip pattern image is equal to or greater than a first threshold, or the first If the number of matches between the feature points of the authentication registered palm print image and the feature points of the authentication target palm print image is greater than or equal to a second threshold as a result of the palm print matching process, the authentication target person's authentication is performed in the first authentication process. Allow authentication,
First feature line extraction for extracting a feature line of the authentication registered fingertip pattern image and a feature line of the authentication target fingertip pattern image when authentication of the authentication target person is not permitted in the first authentication process Steps,
A second feature line extracting step of extracting a feature line of the authentication registration palmprint image and a feature line of the authentication subject palmprint image when authentication of the authentication subject is not permitted in the first authentication process; ,
Further comprising
The authentication processing step includes
As the authentication process, in addition to the first authentication process, the feature line of the authentication registered fingertip pattern image extracted in the first feature line extraction step and the feature line of the authentication target fingertip pattern image are collated. A second fingertip pattern matching process, and a second palmprint matching process for matching the feature line of the authentication registered palmprint image extracted in the second feature line extraction step with the feature line of the authentication target palmprint image A second authentication process based on the result,
As a result of the second fingertip pattern collation process, the similarity between the feature line of the authentication registered fingertip pattern image and the feature line of the authentication target fingertip pattern image is a third threshold value or more, and If the similarity between the feature line of the authentication registered palm print image and the feature line of the authentication target palm print image is greater than or equal to a fourth threshold as a result of the second palm print matching process, the authentication process is performed in the second authentication process. An authentication processing method characterized by permitting authentication of a subject . The authentication registered fingertip pattern image and the authentication target fingertip based on the matching feature point of the authentication registered fingertip pattern image and the feature point of the authentication target fingertip pattern image obtained as a result of the first fingertip pattern matching process Calculating an angle difference with the pattern image, rotationally correcting the authentication target fingertip pattern image in accordance with the angle difference, and the matching authentication registered palm pattern image obtained as a result of the first palm pattern matching process; An angle difference between the authentication registered palm print image and the authentication target palm print image is calculated based on the feature point of the authentication target palm print image and the authentication target palm print image, and the authentication target palm print image is rotated according to the angle difference. An image rotation correction step for correcting,
In the first feature line extraction step, when extracting the feature line of the authentication target fingertip pattern image, the feature line of the authentication target fingertip pattern image that has been rotationally corrected by the image rotation correction step is extracted;
In the second feature line extraction step, when extracting a feature line of the authentication target palm print image, a feature line of the authentication target palm print image subjected to rotation correction in the image rotation correction step is extracted. The authentication processing method according to claim 5. An authentication processing method provided by an authentication processing apparatus provided with an imaging unit provided inside a handle and configured to be able to capture a grip image of the hand when the handle is gripped by a hand,
A storage step of storing, in the storage unit, a handshake image photographed by the photographing unit when the authentication registrant grips the handle with a hand at the time of registration;
At the time of authentication, an acquisition step of acquiring a grip image captured by the imaging unit as an authentication target image when the authentication target person grips the handle with a hand;
First, a fingertip pattern portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration fingertip pattern image, and a palmprint portion of the authentication registrant's hand is extracted from the authentication registration image as an authentication registration palmprint image. A partial extraction step of
A fingertip pattern portion of the authentication subject's hand is extracted as an authentication target fingertip pattern image from the authentication target image, and a palmprint portion of the authentication subject's hand is extracted as an authentication target palmprint image from the authentication target image. A partial extraction step of
Based on the results of a fingertip pattern matching process for matching the authentication registered fingertip pattern image and the authentication target fingertip pattern image and a palmprint matching process for matching the authentication registered palmprint image and the authentication target palmprint image. An authentication processing step for performing authentication processing of the target person;
I have a,
The first partial extraction step detects the skin color area of the authentication registration image, rotates the authentication registration image so that the center of gravity position of the skin color area becomes a predetermined position, and the authentication registration image after the rotation A predetermined area in each of the authentication registration fingertip pattern image and the authentication registration palm print image,
The second partial extraction step detects the skin color area of the authentication target image, rotates the authentication target image so that the center of gravity position of the skin color area becomes a predetermined position, and the authentication target image after the rotation The authentication processing method characterized in that each predetermined area in is extracted as the authentication target fingertip pattern image and the authentication target palm print image .