JP2002288671A - Personal authentication device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a personal authentication device, capable of providing suppression effects to unauthorized users and superiority in accuracy, without using a sequence which may be estimated from the attributes of a user. SOLUTION: The user photographs for itself by a photographing part 2. The image of the user itself is displayed on a display part 3. Since the image of the user itself is fetched into the device 1, a threatening effect can be expected to the unauthorized user. A specified portion can be extracted from the image. When the user has not photographed the image of the user himself, the portion will not be extracted and the access is determined as being unauthorized.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a personal authentication apparatus for authenticating an individual (user) who wants to access a place or data to which access is restricted.

[0002]

2. Description of the Related Art Conventionally, an access key such as a password has been used for personal authentication when an access-restricted place or data is accessed. For example, in an ATM of a bank, an access key consisting of a character string registered in an ATM system is compared with an access key entered by a user, and if they match, the access is authenticated as an access by a regular user. Was.

[0003] A technique has also been proposed in which an indicated position and an indicated order of an image displayed on a monitor are used as an access key (see Japanese Patent Application Laid-Open No. 11-88324). This method displays an image on a monitor at the time of access, prompts the user to indicate a position in the image, and compares the designated position and designated order with designated positions and designated orders registered in advance for each user. Perform personal authentication.

[0004]

However, when an access key consisting of a number string is used, if a random number string is used, it becomes difficult for the user to memorize it. For this reason, the user uses an easy-to-remember numeric string based on the attributes of the user such as the date of birth and the telephone number. If such a string of numbers is used and a document that describes the identity of the person, such as a license or insurance card, is passed to a third party, the access key is decrypted based on the information and the access key is decrypted. Restrictions were sometimes breached.

Further, in the technique using the designated position or designated order in an image as an access key, since only a sequence of numbers is changed to a sequence of coordinates of an image, a deterrent effect to unauthorized users and superiority in accuracy cannot be expected. . An object of the present invention is to provide a personal authentication device that does not use only a numeric string that may be inferred from the attributes of a user, and that has a deterrent effect on unauthorized users and superiority in accuracy. And

[0006]

According to the present invention, there is provided a personal authentication apparatus comprising: an image pickup unit for photographing a person to be authenticated; a display unit for displaying an image photographed by the image pickup unit; and a part included in the image And extracting means for judging the validity of the photographed image based on the extracted part.

[0007] When the user is going to be authenticated by using the personal authentication device of the present invention, the user operates the device and takes an image of the user himself by the imaging means. At this time, the user is instructed to photograph a face, a whole body image, or the like. When the imaging is completed, one or more parts are extracted from the image. If the image is a face image,
If there are eyes, nose, lips, ears, etc., and the image is the whole body, the face,
There are heads, hands, feet, etc. The determining means determines whether or not an image instructed to the user has been obtained based on the extraction result.

[0008] According to the personal authentication apparatus of the present invention, a step of taking an image of a face or the like is taken, so that a crime-preventing effect can be obtained from the viewpoint of trails against unauthorized users. what if,
If the user photographs something other than a person in order to leave no evidence, it can be identified by the extraction means and the determination means that a valid image has not been obtained. Also, in the present invention, since there is no need to use a complicated image authentication algorithm,
A simple configuration can be provided.

The personal authentication apparatus of the present invention can collate a part registered in advance for each user with a part selected by the user, and if the parts match, authenticate the individual. Furthermore, a plurality of sites can be selected, and the order can be checked. In this way, the selection of the site can be used like a password to further ensure authentication. Further, the selected part can be used as a part of the password.

[0010] The personal authentication device of the present invention can improve the trailability in the case of unauthorized access by recording the taken image in the storage unit. Further, since the image of the user is stored, it is easy to make a backup by visual confirmation.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows an appearance of a personal authentication device to which the present invention is applied, and FIG. 2 shows a circuit configuration. The personal authentication device 1 can be realized in various forms. For example, it is configured by a small computer capable of shooting and is arranged in a store or the like. In this case, it is passed to the user for personal authentication at the time of payment. It can be incorporated in an ATM or the like. In this case,
After inserting the cash card into the ATM, an access key for selecting a part such as a face is input in addition to the conventional input of a personal identification number.

The image pickup section 2 is composed of a video camera, and is used for photographing a whole place or a face of a user who wants to access a place or data where access should be restricted. The display unit 3 displays an image captured by the imaging unit 2 and the like. The selection unit 4 is arranged on the front of the display unit 3. The selection unit 4 is configured by a touch panel. The display unit 3 displays a numeric keypad display area 5 for inputting a password and an image display area 6. When the user touches a specific part of the image displayed on the display unit 3, the selection unit 4 detects the coordinates. The display unit 3 may further display a cancel button for canceling the operation and a shooting start button for starting shooting with the camera.

The image processing section 7 extracts a specific part from the image taken by the image pickup section 2. The control unit 8 normalizes the image captured by the imaging unit 2 to a predetermined position and size based on the extracted part, and displays the image on the display unit 3. Further, the extracted part is stored in an access key authentication unit 9 described later.
And the authentication of the access key and the face image performed by the face image authentication unit 10.

The storage unit 11 stores one site or a plurality of sites registered in advance as an access key for each user and a designated order. Access key authentication unit 9
Is a part or a plurality of parts acquired by the selection unit 4 and their designation order, and the one stored in the storage unit 11.
It is determined whether one part or a plurality of parts and their designation order are the same.

If they are the same, then the face image authentication unit 1
At 0, a face image authentication process using the image feature amount of the part is performed. When it is determined that they are not the same, an unauthorized access is displayed (for example, an alarm sound output from the output unit 12). The face image authentication unit 10 compares the image feature amount calculated from the part specified by the image processing unit 7 with the image feature amount of the part registered in advance in the storage unit 11 for each user as an access key. Then, it is determined whether or not they belong to the same person.

When the user completes shopping or the like and intends to pay by card, or after inserting a cash card into the ATM, an access key is input by the personal authentication device 1. When a face image is used as the image of the user, an instruction is displayed on the display unit 3 to photograph the face of the user. At this time, the face image needs to be displayed at the center of the monitor screen in a size that ensures sufficient trailability. For this purpose, a part included in the face image is authenticated and automatically adjusted, or a guide for adjusting each part is displayed on a monitor screen, and the user performs face alignment by himself. When the positioning is completed, the user touches the touch panel area corresponding to the shooting start button.

FIG. 1 shows an example of a guide as left and right eyes,
Circles 15 to 18 are displayed on the left and right ears, nose, and lips.
Other than this, for example, it is possible to display a straight line connecting both eyes or a frame in which the entire face is to be inserted. Next, the flow of personal authentication in the personal authentication device 1 will be described.
This process is roughly divided into two stages of “access key authentication process” and “face image authentication process”.

<Access Key Authentication Processing> The access key authentication processing will be described with reference to the operation flow shown in FIG. Prior to use, multiple sites (right eye,
A combination of the left ear, chin, nose, lips, etc.) is registered in advance as an access key together with the instruction order. This access key may be registered in the recording unit 11 of the personal authentication device 1 or may be registered in a center device (not shown) such as an ATM system.

In the following description, it is assumed that the part and the order are registered as “access right key, nose, lips, lips, left eye” as an access key. When the user touches the display unit 3 for the first time, the selection unit 4 detects this, and the guidance "The face image is to be shot from now on, so face the camera and touch the shooting start button." It is displayed on the screen (S31). In addition, an ultrasonic sensor may be installed in the present apparatus, and the display may be automatically performed when the approach of the user is detected. The display may be output as an audio signal.

When a photographing start button (not shown) displayed on the display unit 3 is pressed, a face image is captured from the imaging unit 2 (S32). The image processing unit 7 extracts each part of the face used as an access key from the captured face image (S33). The extraction process of each part (S33) will be described with reference to FIG.

A difference image is created between the input face image and a background image in which a person who has been photographed in advance is not shown, and is binarized using a predetermined threshold value (S41). The image of the user is extracted from the input image by calculating the logical product of this image and the input face image (S42). Next, an eye region is extracted. Since the eyes have the feature that the horizontal edges are strong in the face image, the edge strength and the relative positional relationship within the head region (for example, the upper part of the head region above the center of the Y axis coordinate and the head region The eye region is cut out as a rectangular region having a certain area by combining the positions substantially symmetrically with respect to the vertical center line and having a strong horizontal edge (S4).
3). The eye candidate area generally includes left and right eyes, eyebrows, and eyeglass frames.

Next, the nose and lip regions are extracted (S44).
These are cut out as a rectangular area having a fixed area in consideration of the relative position from the eye area (for example, being located at a predetermined distance below the center of the two eye areas).
The positions of the extracted parts on the monitor screen (for example, the coordinates of the center of gravity of the part area) are stored in the storage unit 11, and the part specified by the user in the face image authentication process (S38) described later is which part. It is used to determine whether or not

When each part of the face is extracted, the position and size of the face image are corrected using the coordinates of the center of gravity of the binocular region (S34 in FIG. 3). Specifically, the center of gravity of the eye region extracted in S43 is calculated, and the roll of the face is corrected by, for example, making a straight line connecting the positions of the left and right centers of gravity horizontal, or the face is calculated from the center of gravity position interval. The position of the face image is adjusted based on the position of the center of gravity of the eye area, such as correcting the distance between the face image and the camera.

As shown in FIG. 1, a guide for matching the eyes, nose, lips, and both ears is displayed on the monitor screen, or a straight line for aligning the left and right eyes or the ears in the vertical direction is displayed as a guide (not shown). ), It is also possible for the user to adjust the position of the face by himself. When the correction of the position and the size of the face image is completed, the corrected face image is displayed on the display unit 3 (S35), and is stored in the storage unit 11 together with the photographing time (S36). The face image and the photographing time are used as criminal investigation information when there is unauthorized access. The correction result may be used only for internal processing, and the captured face image may be displayed on the display unit 2 as it is.

When the user himself / herself adjusts the position of the face in accordance with the guide display, when the user presses the shooting start button, the face image that is currently being shot is displayed on the display unit 3, and the user can change the position of the face. By pressing the shooting start button again after the adjustment, the face image and the current time are recorded. Next, the user touches a part displayed on the display unit 3 while looking at his / her own face image displayed on the display unit 3, and accesses an access key registered in advance for each user (instructed order and its order). Which part is, here, "right eye, nose, lips, lips, left eye") is input. The image processing unit 7 reads the input access key and compares it with the access key registered in advance (S37). If the access key has been registered with the center, data is transmitted to and received from the center, and the access key is received.

In the authentication process, specifically, the coordinates of the part specified by the user by the selection unit 4 are read, and the part whose barycentric coordinates stored in the storage unit 11 are closest in the part extraction processing (S33) described above is determined. The part designated by the user is compared with the access key in accordance with the designated order. If the distance between the coordinates exceeds a predetermined threshold, a message prompting the user to input again can be output.

As a result, if it is determined that they are the same, a face image authentication process is performed (S38). If it is not determined that they are the same, the access is rejected as an unauthorized access (S55 described later). For example, a face image recorded in the storage unit 11 in S36 is flagged for unauthorized access, or a warning sound is issued. And the like. <Face Image Authentication Process> Next, the face image authentication process will be described with reference to FIG. Here, “right eye, nose, lips, lips, left eye” is described as an example of the access key, so authentication is performed for each of the four parts, and a comprehensive judgment is performed using the results.

It is assumed that each user has previously registered an image of a part to be used as an access key. Here, the region image used as the access key is a rectangular image having a predetermined area including the peripheral region of the region. Further, prior to the operation of the present apparatus, by extracting an eye region from a plurality of face images of the same person captured by the same input system, correcting the eye region so that the distance between the left and right eyes is constant, and averaging it, Create a standard eye template. This template
An eye image in which personality is more likely to appear than in other parts is stored in S43.
It is used to extract with higher accuracy from the eye region cut out by.

First, an area to be collated with the registrant data specified in the access key authentication processing (S37) is extracted based on the image of each part extracted from the photographed face image (S51). More specifically, for the neighboring area around the square image of the eye area, a shift matching using the standard eye template is performed, and the area having the largest correlation value is extracted, and this area is used as the eye image. .

For the nose area and the lip area, step S
A shift matching is performed between a rectangular area having a certain area that satisfies the relative positional relationship from the eye area used in the nose and lip area extraction processing in 43 and an image of the nose area and the lip area registered in advance. Do. As a result, the area where the Euclidean distance is minimum is defined as the nose or lip area. next,
The Euclidean distance Di from the registered image is calculated for each part used as the access key (S52). Here, “i” represents each part. With respect to the eye area, the Euclidean distance is calculated using the eye images corresponding to the left and right eyes, and this is set as the left and right eye area distance. For the nose region and the lip region, the minimum value of the Euclidean distance is set as the nose or lip region distance.

As a result of the above processing, the distance values of the specified number of parts (four parts excluding the overlap) are obtained. The calculated result is normalized by an average value and a variance value, and weights are equally applied between parts. Alternatively, it is also possible to collect a large number of face image data in advance for each registered user and statistically process them to obtain a weight coefficient for each part and calculate a weighted Euclidean distance.

Next, the four distance values Di are compared with a threshold value Thi to authenticate a face image (S53). Specifically, each distance value Di is compared with a threshold value Thi prepared for each part, and these are comprehensively determined to perform face image authentication. As a criterion, the threshold value Thi
It is possible to use such a condition that a portion that is less than or equal to or less than the threshold Thi occupies a majority.

If the result is less than the threshold value Thi, the user is accepted as a valid user (S54). If it is larger than the threshold value Thi, the access is rejected as an unauthorized access, and processing such as setting an unauthorized access flag on the face image recorded in the storage unit 11 in S36 or generating an alarm sound is performed. (S55). Note that it is also possible to calculate the average of the obtained distance values Di and compare this value with a threshold value.

As described in detail above, according to the present embodiment, information that is not likely to be inferred from the designation of the part of the human body and any attribute of the user such as the order of designation is used as the access key. Therefore, even if a driver's license or insurance card is acquired by a third party, there is no unauthorized access. Further, since the face image is photographed during the operation and displayed to the user, the effect of suppressing the unauthorized user can be expected as compared with the case where the card in which the access key is recorded is used. Further, since the photographed face image is recorded together with the use time, even in the event of unauthorized access, it is possible to provide information effective for criminal investigation.

Further, since the authentication process using the part of the face image is performed, unauthorized access can be prevented even if a situation where a third party is using it can be seen. In addition, since the designation order of the parts of the face is used as the access key, there is a feature that it is more resistant to a drawing action using a face photograph than personal authentication using only a face image.

While one embodiment of the present invention has been described above, the present invention can be variously modified. For example, even if the face image authentication processing (S38) is not performed, it is possible to prevent unauthorized access by intimidating a fraudulent user simply by photographing the face image. Further, when the photographed face image is displayed on the monitor, the same effect can be expected only by confirming that the face image is photographed and recorded without designating the part.

When the authentication is performed using the designated parts and the order thereof, the data used for the authentication includes (right eye, nose, lips, lips, left ear).
, The same authentication system as the conventional cash card password can be used. It is preferable that a human face is to be photographed from the viewpoint of trail characteristics. However, although the trailing property is slightly lower than that of the face image, any image data other than the face image, such as the user's whole body, palms, earlobes, teeth arrangement, etc., can be used similarly.

[0038]

According to the personal authentication apparatus of the present invention, a personal authentication apparatus having a deterrence effect for an unauthorized user and a superior precision can be provided by making the operator aware that the user has been photographed. This eliminates the need to use a numeric string that may be inferred from the attributes of the user.

[Brief description of the drawings]

FIG. 1 is a diagram showing the appearance of a personal authentication device to which the present invention is applied.

FIG. 2 is a block diagram showing a circuit configuration of the device of FIG.

FIG. 3 is a flowchart illustrating a flow of an entire authentication process.

FIG. 4 is a flowchart illustrating a flow of a face image part extraction process.

FIG. 5 is a flowchart illustrating a flow of a face image authentication process.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Personal authentication apparatus 2 ... Photographing part 3 ... Display part 4 ... Selection part 5 ... Ten key display area 6 ... Image display area 7 ... Image processing part 8 ... Control part 9 ... Access key authentication part 10 ... Face image authentication part 11 ... Storage unit 12 ... Output unit 15, 16, 17, 18 ... Guide

Continued on the front page F term (reference) 5B043 AA09 BA04 CA03 DA05 EA06 GA02 GA05 GA17 HA02 5B057 AA19 BA02 CA12 CA16 CE09 DA07 DA12 DB02 DC05 DC09 DC36 5L096 BA03 CA02 EA35 FA19 FA32 FA33 FA76 JA11

Claims (7)

[Claims] 1. An image capturing means for capturing an image of a person to be authenticated, a display means for displaying an image captured by the image capturing means, an extracting means for extracting a part included in the image, and the extracted part Determining means for determining the legitimacy of a captured image based on a personal authentication device. 2. A selection means for detecting a part selected by the person to be authenticated, and an authentication means for authenticating an individual when the part detected by the selection means matches a predetermined part. The personal authentication device according to claim 1, wherein 3. The personal authentication apparatus according to claim 2, wherein the authentication unit authenticates the individual when the order of selecting the parts matches a predetermined order. 4. The personal authentication apparatus according to claim 2, wherein said authentication means authenticates an individual using a feature amount of said part. 5. The personal authentication device according to claim 1, further comprising a storage unit that records the image and the photographing time. 6. The personal authentication device according to claim 1, wherein the image is a face image. 7. The personal authentication device according to claim 2, wherein the selected part forms a part of a password used for personal authentication.