JP2004362079A - Personal identification device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent another person from impersonating an objective individual even when the person carries one face image of the objective individual with him or her. <P>SOLUTION: This personal identification device is provided with: an imaging part 110 to be moved relative to a user for generating, at the time of identification, user images by imaging the user from a plurality of angles; an objective individual information holding part 210 for preliminarily holding the three-dimensional information of the face of the user himself/herself to be used at the time of identifying the user; and an objective individual identifying part 230 for generating the three-dimensional information of the user at identification by using the plurality of user images in identification and the photographic angles of the plurality of user images, and for collating the three-dimensional information of the user in identification with the three-dimensional information of the user himself/herself in order to identify that the user is the objective individual. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a personal authentication device that authenticates an individual using three-dimensional face information.
[0002]
[Prior art]
One technique for authenticating whether or not a user is the person is a technique for capturing the face of the user and collating it with an image of the person registered in advance (see, for example, Patent Document 1).
[0003]
[Patent Document 1]
Japanese Patent Laid-Open No. 6-309457
[Problems to be solved by the invention]
When another person owns the person's face photo, the other person can obtain the person's face image by taking the person's face photograph or reading it with a scanner.
For this reason, when a face image possessed by another person is read, the person authentication system needs to reduce the probability of authenticating the other person as the person.
Therefore, an object of the present invention is to provide a personal authentication device that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.
[0005]
[Means for Solving the Problems]
In other words, according to the first aspect of the present invention, there is provided a personal authentication device that images a user and authenticates the identity, and is moved with respect to the user so that the user can be viewed from a plurality of angles. An imaging unit for capturing and generating a user image for authentication, a personal information holding unit for preliminarily storing three-dimensional information of the user's face used when authenticating the user, and a plurality of user images for authentication 3D information at the time of user authentication is generated using the respective imaging angles of the plurality of user images, and the 3D information at the time of user authentication is collated with the 3D information of the user himself / herself and used. A personal authentication device is provided that includes a personal authentication unit that authenticates that the user is the person.
[0006]
In this personal authentication device, the personal authentication unit generates the three-dimensional information at the time of authentication on the condition that the background of the user image at the time of authentication is a predetermined background, or that the user is the user. You may authenticate.
In addition, the personal authentication unit may generate the three-dimensional information at the time of authentication on the condition that the background of each of the plurality of user images at the time of authentication is continuous, or may authenticate that the user is the user. .
[0007]
The identity authentication unit requires that the difference between the depth of the eyes and the nose indicated by the three-dimensional information at the time of user authentication matches the difference between the depths of the eyes and the nose indicated by the three-dimensional information of the user. The user may be authenticated as the person.
[0008]
The imaging unit captures at least a user from the front to generate one authentication user image, and the personal authentication unit includes a background in the other authentication user image, a background of the one authentication user image, and The imaging angle of another user image at the time of authentication may be calculated based on the size of the overlapping portion.
The imaging unit captures at least a user from the front to generate one user image during authentication, and the personal authentication unit determines whether one of the user's eyes in the other user images during authentication The imaging angle of another authentication user image may be calculated based on the ratio of the eyes to the eye interval in the authentication user image.
[0009]
The imaging unit is a portable imaging device that is carried by a user, and further includes a location information acquisition unit that acquires imaging location information indicating a location where the portable imaging device captured a plurality of user images at the time of authentication. The unit may authenticate that the user is the person on the condition that the location indicated by the imaging location information is a predetermined location.
Further, the image capturing unit includes a date / time information acquiring unit that acquires the date / time when the user image is captured at the time of authentication, and the personal authentication unit is provided with the requirement that the date / time indicated by the date / time information is a predetermined date / time. May be authenticated as the person.
[0010]
The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.
[0011]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.
[0012]
FIG. 1 is a diagram illustrating a usage example of a personal authentication system 10 according to an embodiment of the present invention. The personal authentication system 10 includes a mobile communication terminal 100 that is carried by a user and an authentication server 200. The mobile communication terminal 100 has an imaging unit 110. When the user needs to be authenticated as the person himself / herself, such as when paying or receiving goods, the user can cause the imaging unit 110 of the mobile communication terminal 100 to image his / her face from a plurality of angles, A plurality of authentication captured images are generated. Here, the user once captures his / her face from the front and generates a captured image at the time of authentication captured from the front.
The mobile communication terminal 100 transmits the generated plurality of authentication captured images to the authentication server 200 via the wireless communication network. The authentication server 200 generates three-dimensional information at the time of authentication that indicates the three-dimensional shape of the user's face to be authenticated, using the plurality of received captured images at the time of authentication. Then, the three-dimensional information at the time of authentication is collated with the three-dimensional information indicating the three-dimensional shape of the person's face held in advance to authenticate that the user is the person. Then, the authentication result is transmitted to the storefront terminal 300.
[0013]
For this reason, even if another person has one face image of the person, information indicating the three-dimensional shape of the person's face cannot be obtained, so the person cannot be impersonated. In addition, the mobile communication terminal 100 possessed by the user captures the user's face image to generate authentication three-dimensional face information, and the authentication server 200 transmits the authenticated three-dimensional information via the wireless communication network. Therefore, the personal authentication system 10 can determine whether or not the user is the user even in a place where the imaging device is not installed.
[0014]
FIG. 2 is a block diagram showing a configuration of the personal authentication system 10. The mobile communication terminal 100 includes a date / time information acquisition unit 120 and a location information acquisition unit 130 in addition to the imaging unit 110. The date / time information acquisition unit 120 generates date / time information indicating the date and time when the imaging unit 110 generates a captured image during authentication, and transmits the date / time information to the authentication server 200. The location information acquisition unit 130 acquires imaging location information indicating a location where the captured image at the time of authentication of the imaging unit 110 is generated, and transmits it to the authentication server 200. The location information acquisition unit 130 may acquire latitude and longitude as imaging location information using GPS, for example, or may acquire information indicating a facility where the user is present as imaging location information.
[0015]
The authentication server 200 includes a personal information holding unit 210, a registered background holding unit 220, and a personal authentication unit 230. The principal information holding unit 210 holds the three-dimensional information of the person's face in advance in association with the identification information of the person. The registered background holding unit 220 holds in advance a background image when a user is imaged in association with a place where the person should be when the person is authenticated. The personal authentication unit 230 uses the plurality of authentication-captured images received from the mobile communication terminal 100 to generate authentication-time three-dimensional information that is three-dimensional information of the user's face. At this time, it is confirmed that the background of the captured image at the time of authentication matches the background image stored in advance by the registered background holding unit 220, and it is determined that the captured image at the time of authentication is captured at a predetermined location. . Then, the three-dimensional information at the time of authentication is collated with the three-dimensional information of the person's face held in advance by the person information holding unit 210 to authenticate that the user is the person.
[0016]
In this way, the personal authentication system 10 can determine whether or not the user is the user by using the three-dimensional information of the user's face and the three-dimensional information of the user's face.
[0017]
FIG. 3 is a table showing the data structure of the personal information holding unit 210. The principal information holding unit 210 is an example of identification information of the principal, and holds in advance three-dimensional information of the person's face in association with user IDs that identify a plurality of users from each other. The user ID may be a telephone number of a mobile communication terminal, for example. The principal information holding unit 210 holds information indicating the date and time when the person can be authenticated in advance in association with the user ID. In addition, the personal information holding unit 210 holds in advance information indicating a place where the person to be authenticated is to be associated with the user ID. The information indicating the location may be information indicating a range of latitude and longitude, for example, or may be information indicating a place name. Moreover, the information which specifies the base station which should communicate with the portable communication terminal 100 at the time of personal authentication may be sufficient.
[0018]
When the data configuration of the personal information holding unit 210 is thus configured, the personal authentication unit 230 does not authenticate the user with a user other than a predetermined time, that is, a date and time when the user may be authenticated. Further, when the user is not in a predetermined place, that is, the place where the person is to be authenticated, the user is not authenticated as the person.
[0019]
FIG. 4 is a table showing the data configuration of the registered background holding unit 220. The registered background holding unit 220 holds information indicating a facility (for example, a store) at the location in advance in association with information indicating the location (for example, latitude / longitude information). In addition, the registered background holding unit 220 holds a background image in advance when the mobile communication terminal 100 generates a captured image at the time of authentication in association with information indicating a facility.
For this reason, the personal authentication unit 230 can determine whether the background image of the received captured image at the time of authentication matches the background image held in association with the facility indicated by the imaging location information. Therefore, the personal authentication unit 230 can determine whether the captured image at the time of authentication is captured at the facility.
[0020]
FIG. 5 is a flowchart illustrating an operation example of the mobile communication terminal 100 of the personal authentication system 10. When the personal authentication system 10 authenticates the user, the imaging unit 110 of the mobile communication terminal 100 images the user's face from the front according to the user's operation (S10), and then displays the user's face on the imaging unit 110. Images are taken from different angles, for example, obliquely in front (S20). The location information acquisition unit 130 acquires imaging location information indicating a location where the authentication-captured captured image is captured (S30). The date / time information acquisition unit 120 acquires date / time information indicating the date and time when the captured image at the time of authentication is captured (S40).
Then, the mobile communication terminal 100 associates the captured image at the time of authentication, the imaging location information, the date information, and the user ID with each other and transmits them to the authentication server 200 (S50). Therefore, the authentication server 200 can recognize which user has transmitted the captured image at the time of authentication, imaging location information, and date / time information.
[0021]
FIG. 6 is a flowchart illustrating an operation example of the authentication server 200 of the personal authentication system 10. The personal authentication unit 230 of the authentication server 200 receives a plurality of authentication-time captured images, imaging location information, date / time information, and user IDs from the mobile communication terminal 100 in association with each other (S100). As a result, the personal authentication unit 230 determines that a plurality of authentication-captured images have been captured by the same image capturing unit 110, and proceeds with the personal authentication process. The personal authentication unit 230 compares the received user ID with the personal information holding unit 210 and recognizes the user (S110). Then, it is confirmed that the date and time indicated by the received date and time information is included in the date and time associated with the user ID in the principal information holding unit 210 (S120: Yes), and the location indicated by the received imaging location information Is included in the latitude / longitude range associated with the user ID in the principal information holding unit 210 (S130: Yes). Here, when receiving the information indicating the facility where the user is present as the imaging location information, the personal authentication unit 230 reads the latitude and longitude of this facility from the registered background holding unit 220 using the information indicating the facility and reads the information. The latitude / longitude is collated with the latitude / longitude associated with the user ID in the personal information holding unit 210.
[0022]
If the date and time indicated by the received date and time information is not included in the date and time associated with the user ID in the personal information holding unit 210 (S120: No), the personal authentication unit 230 ends the personal authentication process. To do. If the location indicated by the received imaging location information is not included in the latitude / longitude range associated with the user ID in the identity information holding unit 210 (S130: No), the identity authentication process is terminated.
[0023]
In this way, the personal authentication unit 230 authenticates the person on the condition that the captured image at the time of authentication was captured at a predetermined date and time. Further, the user is authenticated on the condition that the captured image at the time of authentication is captured at a predetermined location. Therefore, if the person registers in advance the place and date / time to be authenticated in advance, it becomes difficult for others to impersonate the person.
Then, the personal authentication unit 230 reads an image that should be the background of the captured image at the time of authentication from the registered background holding unit 220 (S140). Here, when the information indicating the facility where the user is present is received as the imaging location information, the personal authentication unit 230 reads the background image associated with the information indicating the facility from the registered background holding unit 220. When the latitude / longitude information is received as the imaging location information, the personal authentication unit 230 reads the background image associated with the latitude / longitude from the registered background holding unit 220.
Then, the personal authentication unit 230 determines whether or not the background image in the authentication captured image obtained by capturing the user from the front in the received authentication captured image matches the read background image (S150).
When another person transmits a face image of a user captured at another place from a certain facility, the background of the captured image at the time of authentication does not match the background read from the registered background holding unit 220. In this case, the personal authentication unit 230 does not authenticate the user with the user. Therefore, even if another person possesses the person's face image, it is difficult for someone else to impersonate the person.
[0024]
When it is determined that the backgrounds match (S150; Yes), the personal authentication unit 230 determines whether the background image of the other authentication-captured image is continuous with the background image of the authentication-captured image captured from the front. (S160). If it is determined that they are continuous (S160: Yes), the personal authentication unit 230 determines that a plurality of authentication-captured images are captured at the same place, and generates three-dimensional information during authentication of the user's face ( S170), the authentication process of the person is performed (S180).
In this way, the personal authentication unit 230 authenticates the individual when a plurality of authentication-captured images are captured at the same location. Therefore, even if another person collects the face images of the person himself / herself that are imaged at different locations and arranges the person's face images taken from a plurality of angles, the other person cannot impersonate the person himself / herself.
[0025]
FIG. 7 is a flowchart showing a detailed example of S170 of FIG. The personal authentication unit 230 calculates the interval between eyes in each of the plurality of authentication-time captured images (S200). Then, the ratio of the eye-to-eye interval in the authentication-captured image captured from other than the front to the eye-eye interval in the authentication-captured image captured from the front is calculated, and using this ratio and the trigonometric formula, The imaging angle of the authentication-captured image captured from other than the front is calculated (S210). Then, the three-dimensional information at the time of authentication of the user's face is generated using the imaging angle and the captured image at the time of authentication (S220).
In this way, the personal authentication unit 230 can generate the three-dimensional information of the user's face by calculating the imaging angle of the captured image during authentication.
[0026]
FIG. 8 is a flowchart showing another detailed example of S170 of FIG. The identity authentication unit 230 extracts, for each authentication-captured image captured from other than the front, an overlapping portion of the background image of the authentication captured image captured from other than the front with respect to the background image of the authentication captured image captured from the front ( S300). Then, the ratio of the overlapping portion to the entire background image is calculated for each authentication-captured image captured from other than the front (S310). Based on the calculated ratio, the imaging angle of the authentication-captured image captured from other than the front is calculated (S320). Here, it is preferable that the personal authentication unit 230 calculates the imaging angle after correcting image distortion caused by the aberration of the lens of the imaging unit 110.
Then, the personal authentication unit 230 generates the three-dimensional information at the time of authentication of the user's face using the imaging angle and the captured image at the time of authentication (S330).
Even in this way, the personal authentication unit 230 can calculate the imaging angle of the captured image at the time of authentication and generate the three-dimensional information of the user's face.
[0027]
FIG. 9 is a flowchart showing a detailed example of S180 in FIG. If the three-dimensional information at the time of authentication matches the three-dimensional information of the face of the person that the person information holding unit 210 holds in advance, the person authentication unit 230 authenticates the user as the person. Specifically, when the user is viewed from the front, the relative positions of the eyes and nose match (S400: Yes), and the difference between the top of the nose and the depth of the eyes matches (S410: Yes). When confirmed, it authenticates that the user is the user (S420). In other cases (S400: No or S410: No), it is determined that the user is not the user (S430). Then, the authentication result is transmitted to the storefront terminal 300 (S440).
In this way, the personal authentication unit 230 authenticates that the user is the user on the condition that the difference in depth between the eyes and the nose matches. Therefore, even if there is another person who is similar to the person when viewed from the front, this person is unlikely to impersonate the person.
[0028]
Note that the mobile communication terminal 100 may transmit the time when each of the plurality of authentication captured images is captured to the personal authentication unit 230. In this case, the personal authentication unit 230 may make it a necessary condition for authenticating the user that a plurality of authentication-captured images have been captured within a predetermined time.
Further, the authentication server 200 may hold personal information such as medical information in association with the identification information of the person. In this case, the authentication server 200 outputs personal information to the outside when the person authentication unit 230 authenticates the person.
[0029]
As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.
[0030]
【The invention's effect】
As is apparent from the above description, according to the present invention, even if another person impersonates the person, the possibility of authenticating the person is low.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating an example of use of a personal authentication system 10 according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a configuration of the personal authentication system 10. FIG. 3 illustrates a data configuration of a personal information holding unit 210. Table FIG. 4 is a table showing a data configuration of the registered background holding unit 220. FIG. 5 is a flowchart showing an operation example of the mobile communication terminal 100. FIG. 6 is a flowchart showing an operation example of the authentication server 200. FIG. FIG. 8 is a flowchart showing another detailed example of S170 in FIG. 6. FIG. 9 is a flowchart showing a detailed example of S180 in FIG.
DESCRIPTION OF SYMBOLS 10 ... Identity authentication system 100 ... Mobile communication terminal 110 ... Imaging part 120 ... Date information acquisition part 130 ... Location information acquisition part 200 ... Authentication server 210 ... Personal information holding part 220 ... Registration background holding part 230 ... Personal authentication part 300 ... Store Terminal

Claims (8)

A user authentication device that images a user and authenticates the identity of the user,
An imaging unit that images the user from a plurality of angles and generates a user image at the time of authentication by being moved with respect to the user;
A user information holding unit that holds in advance three-dimensional information of the user's own face used when authenticating the user;
The three-dimensional information at the time of authentication of the user is generated using the imaging angles of the plurality of user images at the time of authentication and the plurality of user images, and the three-dimensional information at the time of authentication of the user is A personal authentication apparatus comprising: a personal authentication unit that verifies that the user is the user by checking the three-dimensional information of the user. The personal authentication unit generates the three-dimensional information at the time of authentication on the condition that the background of the user image at the time of authentication is a predetermined background, or authenticates that the user is the user. The personal authentication device according to claim 1. The personal authentication unit generates the three-dimensional information at the time of authentication on the condition that the backgrounds of the plurality of user images at the time of authentication are continuous, or authenticates that the user is the user. The personal authentication device according to claim 1. The identity authentication unit confirms that the difference between the depth of the eyes and the nose indicated by the three-dimensional information at the time of authentication of the user coincides with the difference between the depths of the eyes and the nose indicated by the three-dimensional information of the user. The personal authentication apparatus according to claim 1, wherein the user is authenticated as a necessary condition. The imaging unit captures at least the user from the front to generate one authentication user image,
The personal authentication unit is configured to determine whether the background of the other authentication user image is based on the size of a portion where the background of the other authentication user image overlaps the background of the one authentication user image. The personal authentication device according to claim 1, wherein the authentication angle is calculated. The imaging unit captures at least the user from the front to generate one authentication user image,
The identity authentication unit may determine the other authentication based on a ratio of an interval between the eyes of the user in the other user image at the time of authentication to an interval between the eyes of the user image at the time of the authentication. The personal authentication device according to claim 1, wherein an imaging angle of the hour user image is calculated. The imaging unit is a portable imaging device carried by the user,
Furthermore, the portable imaging device includes a location information acquisition unit that acquires imaging location information indicating a location where the plurality of authentication user images are captured,
The personal authentication apparatus according to claim 1, wherein the personal authentication unit authenticates that the user is the user on the condition that the location indicated by the imaging location information is a predetermined location. Furthermore, the image capturing unit includes a date and time information acquisition unit that acquires the date and time when the user image is captured at the time of authentication.
The personal authentication apparatus according to claim 1, wherein the personal authentication unit authenticates that the user is an individual on the condition that the date and time indicated by the date and time information is a predetermined date and time.

Images