JP2023047654A - Face authentication system and face authentication method - Google Patents

Abstract

To provide a face authentication system and method for reducing authentication time.SOLUTION: A storage unit stores a face image of a person to be authenticated in association with unique data allocated to the person to be authenticated. A face authentication system is configured to: capture an image which includes the face of a person to be authenticated and unique data allocated to the person (S1); acquire face data stored in the storage unit in association with the unique data included in the captured image (S2-S4); compare the acquired face data with the face image in the captured image to determine whether the person to be authenticated is identical with a registered person (S5); and display an authentication result on a display unit (S7, S8). The unique data is, for example, numerical values, characters, symbols, bar-codes, two-dimensional codes, graphics, or colors, or combinations thereof.SELECTED DRAWING: Figure 3

Description

The present invention relates to systems and methods for face authentication.

2. Description of the Related Art Conventionally, there has been known a face authentication method of photographing the face of a person to be authenticated, comparing the photographed face image with face data of the person to be authenticated stored in advance in a storage unit, and determining whether or not the person is the same person. (See, for example, Patent Document 1).

JP-A-2004-265267

In the conventional face authentication method, when the face data of many people are stored in the storage unit, there is a problem that the face data to be compared with the photographed face image is large, and the authentication takes time.

An object of the present invention is to provide a face authentication system and method capable of shortening the authentication time.

The face authentication system of the present invention is
a storage unit in which face data of a person to be authenticated and unique data assigned to the person to be authenticated are stored in association with each other;
a photographing unit for photographing an image including both the face of the person to be authenticated and the unique data;
a face data acquisition unit that acquires the face data stored in the storage unit in association with the unique data in the image captured by the imaging unit;
a comparison unit that compares the face data acquired by the face data acquisition unit with a face image in the image captured by the imaging unit;
Prepare.

The face authentication method of the present invention is
an image acquisition step of acquiring an image including both the face of the person to be authenticated and the unique data assigned to the person to be authenticated;
a face data acquisition step of acquiring face data of the person to be authenticated, which is stored in a storage unit in association with the unique data in the image acquired in the image acquisition step;
a comparison step of comparing the face data acquired in the face data acquisition step with a face image in the image acquired in the image acquisition step;
Prepare.

According to this, since the face data stored in the storage unit is obtained based on the unique data assigned to the person to be authenticated, the face data to be compared with the photographed face image can be obtained in a short time, and the authentication time can be shortened. can be shortened. In addition, since an image containing both the face and the unique data of the person to be authenticated is acquired, the unique data can be acquired at the same time as the face image. configuration and processing can be simplified, and authentication can be performed in a shorter time.

The face authentication system of the present invention is
a storage unit in which face data of a person to be authenticated and unique data assigned to the person to be authenticated are stored in association with each other;
a photographing unit for photographing the face of the person to be authenticated;
a unique data acquisition unit that acquires the unique data separately from the photographing of the face by the imaging unit;
a face data acquisition unit that acquires the face data stored in the storage unit in association with the unique data acquired by the unique data acquisition unit;
a comparison unit that compares the face data acquired by the face data acquisition unit and the face image captured by the imaging unit;
Prepare. In this way, the face image and the unique data may be acquired separately. This also shortens the authentication time as compared with the case where only the face image is used for authentication.

Further, the unique data includes a code for error detection,
A determination unit that determines whether the acquired unique data has an error based on the code,
The comparison unit may stop comparing the face data and the face image when the acquired unique data has an error. As a result, it is possible to prevent face authentication from being performed based on incorrect unique data.

Also, the unique data may be numerical values, characters, symbols, barcodes, two-dimensional codes, graphics or colors, or a combination thereof. Numbers, characters, symbols, barcodes, two-dimensional codes, graphics or colors can be recognized easily and with high accuracy. can shorten the face recognition time.

1 is a configuration diagram of a face authentication system; FIG. FIG. 4 is a diagram showing unique data (numbers) and face data stored in a storage unit; 4 is a flowchart of authentication processing; FIG. 4 is a schematic diagram of an image showing both the face of a person to be authenticated and unique data; It is a block diagram of the face authentication system (facility side apparatus) which concerns on a modification.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a block diagram of the face authentication system of this embodiment. A system 1 in FIG. 1 includes a facility-side device 2 and a number card 8 carried by a person H to be authenticated. The facility-side device 2 is provided, for example, in a facility that performs authentication processing. Further, the facility-side device 2 may be configured as a portable device such as a smart phone or a tablet terminal carried by a person in charge of the facility. Further, the facility may be any facility, for example, a facility that can be used only by members or employees, or a facility (bank, credit union, etc.) where cash can be deposited and withdrawn.

The facility-side device 2 includes an imaging unit 3, a storage unit 4, a display unit 5, an operation unit 6, and a processing unit 7. The photographing unit 3 is for photographing the face of the person to be authenticated H, and includes a lens that captures the light of the subject and an imaging device such as a CMOS sensor that generates image data representing the subject from the light captured by the lens. configured with The imaging unit 3 is electrically connected to the processing unit 7 .

As shown in FIG. 2, the storage unit 4 stores, for each person H to be authenticated, the face data of the person H to be authenticated and the unique data assigned to the person H to be authenticated in association with each other. In this embodiment, the storage unit 4 stores a number (numerical value) unique to the person to be authenticated as the unique data. For example, the number consists only of numerical values of 0 to 9, and in the case of two or more digits, it consists of a combination of numerical values of 0 to 9. In addition, the face image of the person to be authenticated H is stored in the storage unit 4 as face data. As shown in FIG. 2, for example, an image X of a person's face to which the number "123" is assigned is stored in the storage unit 4 in association with the number "123".

Any method may be used to store (in other words, register) the unique data (number) and the face data (face image) in the storage unit 4 . For example, when registering personal information such as the name, address, and phone number of a target person when joining a facility, the face image of the target person is also registered, and the number is automatically transferred from the facility side to the target person. , and personal information (including a face image) may be stored (registered) in the storage unit 4 in association with the number. The storage unit 4 is electrically connected to the processing unit 7 .

The display unit 5 displays an image captured in the photographing range of the photographing unit 3, and displays the authentication result of the person to be authenticated H (whether or not the person has been authenticated). The display section 5 is electrically connected to the processing section 7 .

The operation unit 6 is a part for performing various operations related to authentication processing. For example, the operation unit 6 includes an authentication execution switch for instructing execution of authentication processing, a photographing switch for instructing photographing by the photographing unit 3, and the like.

The number card 8 is an individual identifying member on the surface of which unique data for identifying the person to be authenticated H is displayed. ) is displayed on the surface of the card. The number card 8 is issued by the facility when the face data is registered in the storage unit 4, for example. The number card 8 may be, for example, a membership card, an employee card, or the like.

The processing unit 7 performs authentication processing to determine whether the person H to be authenticated is a registered person. Specifically, the processing unit 7 performs authentication processing shown in FIG. 3, for example. The authentication processing in FIG. 3 will be described below.

When the processing of FIG. 3 is started, first, the processing unit 7 causes the photographing unit 3 to simultaneously photograph the face of the person H to be authenticated and the number card 8 distributed to the person H to be authenticated (S1). Specifically, for example, the processing unit 7 causes the display unit 5 to display an image within the imaging range 100 (see FIG. 4) of the imaging unit 3 . Then, the person H to be authenticated is moved so that both the face of the person H to be authenticated and the number displayed on the number card 8 distributed to the person H to be authenticated are captured within the shooting range 100 . The operation instruction to the person to be authenticated H may be given by the person in charge of the facility, or may be given by the facility-side device 2 by means of automatic voice or operation instruction display. If the facility-side device 2 is a portable device, the person in charge of the facility should move the portable device to the person to be authenticated H so that both the face of the person to be authenticated and the number card 8 are captured within the shooting range 100. Place it in front of your face.

In a state in which both the face and the number card 8 are photographed within the photographing range 100, the processing unit 7 causes the photographing unit 3 to operate the photographing switch of the operation unit 6 by the person to be authenticated H or the person in charge of the facility. to start shooting. Note that the imaging unit 3 may be automatically caused to perform imaging after a predetermined time has elapsed since the imaging range 100 was displayed on the display unit 5 . A processing unit 7 acquires an image captured by the imaging unit 3 . Below, the image captured by the imaging unit 3 is denoted by reference numeral "100". In this way, as shown in FIG. 4, the photographing unit 3 captures an image including both the facial image 101 of the person to be authenticated H and the image 102 indicating the number displayed on the number card 8 (hereinafter referred to as the number image). Take a picture of 100 and get it. Note that step S1 corresponds to the image acquisition step of the present invention.

Next, the processing unit 7 performs number authentication to determine whether the number indicated by the number image 102 in the image 100 captured by the image capturing unit 3 is the number stored in the storage unit 4 (S2). Specifically, first, the number appearing in the image 100 is specified. For example, a reference image indicating each numerical value from 0 to 9 is stored in a memory (not shown) in the processing unit 7, and each area in the image 100 is compared with the reference image. The corresponding number image 102 is identified (extracted). After identifying the number indicated by the number image 102 , it is determined whether or not the number is registered in the storage unit 4 . In the example of FIG. 4, the number is "123", and the number "123" is determined to be the number registered in the storage unit 4 (see FIG. 2).

If the number authentication fails, that is, if the number is not included in the image taken in step S1, or if the number included in the image is not registered in the storage unit 4 (S3: No), process The unit 7 causes the display unit 5 to display the authentication failure (S8).

If the number authentication is successful, that is, if the number included in the image captured in step S1 is the number registered in the storage unit 4 (S3: Yes), the processing unit 7 next checks the number in the captured image. from the storage unit 4 (S4). In the example of FIG. 4, the number is “123”, so the face image X (see FIG. 2) associated with the number “123” is read out from the storage section 4 . Note that the processing section 7 that executes steps S2 to S4 corresponds to the face data acquisition section of the present invention. Also, steps S2 to S4 correspond to the face data acquisition step of the present invention.

Next, the processing unit 7 performs face authentication of the person to be authenticated H based on the photographed image acquired in step S1 and the face image acquired in step S4 (S5). Specifically, taking the photographed image 100 of FIG. 4 as an example, the facial image 101 is extracted from the photographed image 100 . For example, a reference image representing a human face (an image including the outline of the face and each part of the face (eyes, nose, mouth, ears, etc.)) is stored in a memory (not shown) in the processing unit 7 . , an area 101 similar to this reference image may be extracted as a face image. Then, by comparing the extracted face image 101 with the face image X acquired in step S4, collation (face authentication) is performed to determine whether the face image 101 matches the face image X. Any known method such as the method described in Patent Document 1 may be adopted as the face authentication method. In face authentication, basically, facial parts such as eyes, nose, mouth, and ears are extracted from the face image 101, the feature amount of each facial part is calculated, and the calculated feature amount is used as the face image to be compared. It is determined whether the feature amount of X matches. Note that the processing unit 7 that executes step S5 corresponds to the comparison unit of the present invention. Step S5 corresponds to the comparison step of the present invention.

When the face authentication fails, that is, when the face image 101 (see FIG. 4) and the face image X (see FIG. 2) do not match (S6: No), the processing unit 7 notifies the display unit 5 of authentication failure. is displayed (S8). In this case, it means that the person at the time of issuing the number "123" and the person at the time of authentication (at the time of processing in FIG. 3) are different people.

When the face authentication is successful, that is, when the face image 101 (see FIG. 4) and the face image X (see FIG. 2) match (S6: Yes), the processing unit 7 displays authentication success on the display unit 5. is displayed (S7).

If the authentication fails, for example, the person H to be authenticated is prohibited from performing a predetermined action (for example, entering the facility or withdrawing cash if the facility is a bank). If the authentication succeeds, for example, the person H to be authenticated is permitted to perform a predetermined action.

As described above, in this embodiment, first, the number assigned to the person to be authenticated H is authenticated, then the face data associated with the authenticated number is read out from the storage unit 4, and the face data is read out. Since the data is compared with the face image in the captured image (face recognition), face recognition can be performed in a short time. If number authentication is not performed, the face data of each person stored in the storage unit 4 and the photographed image (face image) must be compared in order to search for face data that matches the photographed image. Therefore, the authentication time becomes longer. For example, assuming that the face data matching the face image 101 in FIG. , corresponding to numbers “1” to “122”, and the face image 101 must be compared. In this embodiment, the comparison of the facial images A, B, C, D, .

Also, assuming that the number of the person to be authenticated H is "123", comparison with face data associated with numbers other than the number "123" can be omitted. It is possible to suppress erroneous authentication as a person assigned to. In addition, since face authentication is performed after number authentication with high authentication accuracy, personal authentication accuracy can be increased.

Further, in step S1, an image showing both the face of the person to be authenticated H and the number assigned to the person to be authenticated H is obtained. The configuration and processing of the system 1 (facility-side device 2) can be simplified as compared with the case of obtaining them separately.

It should be noted that the present invention is not limited to the above embodiments, and various modifications are possible. For example, in step S1 in FIG. 3, an image including both the face of the person to be authenticated and the unique data (number) assigned to the person to be authenticated is captured. You can go to In this case, instead of the facility-side device 2 of FIG. 1, the facility-side device 10 of FIG. 5 can be exemplified. In addition, in FIG. 5, the same code|symbol is attached|subjected to the structure similar to FIG. The facility-side device 10 of FIG. 5 differs from the facility-side device 2 of FIG.

The unique data acquisition unit 9 is provided separately from the photographing unit 3 and is a part that acquires the unique data assigned to the person H to be authenticated. The unique data acquisition unit 9 may be configured, for example, as a photographing unit for capturing an image of a member on which unique data is displayed (for example, the number card 8 in FIG. 1), or as an operation unit for inputting unique data (such as a number). (keyboard, touch panel, etc.). Further, when the individual identification member is a member such as an IC card or a magnetic card in which unique data is stored electrically or magnetically, the unique data acquisition section 9 can communicate the unique data from the individual identification member. It may be configured as a reading unit for reading.

When applying the facility-side device 10 of FIG. 5, in step S1 of FIG. A step of obtaining unique data from the unit 9 is executed before step S2 of FIG. Step S2 and subsequent steps are the same as when the facility-side device 2 of FIG. 1 is applied.

In addition, when applying the facility-side device 2 of FIG.

In this way, even if the face image and unique data of the person to be authenticated are obtained separately, personal authentication (face authentication) can be performed in a short period of time.

Further, in the above embodiment, numbers (numerical values) are exemplified as unique data, but data other than numbers (specifically, characters, symbols, barcodes, two-dimensional codes (for example, QR code (registered trademark)), graphics or color, etc.), or unique data may be configured by combining numerical values, characters, symbols, barcodes, two-dimensional codes, figures, colors, and the like. In addition, the unique data is the address, name, telephone number, and personal number of the person to be authenticated A 12-digit number assigned to a resident), driver's license number, or the like may also be used.

Further, in the above embodiment, each component of the face authentication system is provided within the same facility or within the same device, but each component may be distributed over a plurality of facilities or locations. For example, the face authentication system is configured as a system including a remote server and a terminal at the facility where the person to be authenticated is located. In addition, the server side is provided with a storage unit that stores a face image and unique data for each person to be authenticated. Then, the terminal captures an image containing the face and unique data of the person to be authenticated, and sends the captured image from the terminal to the server. The server performs processing corresponding to steps S2 to S5 in FIG. 3 based on the captured image sent from the terminal. Then, the result of the authentication process is sent from the server to the terminal. The terminal may display the authentication result sent from the server.

Further, in the above embodiment, an example in which the personal identification member having unique data displayed on its surface is the number card 8 (see FIG. 1) has been shown, but the personal identification member may be a member of any form, for example, The unique data may be displayed on the screen of a portable device such as a smart phone carried by the person to be authenticated, and the portable device displaying the unique data may be used as the personal identification member. In this case, in step S1 of FIG. 3, the portable device displaying the unique data is also photographed at the same time as photographing the face of the person to be authenticated.

In addition, when the person to be authenticated forgets the personal identification member (such as the number card 8 in FIG. 1), the person to be authenticated is asked to write the unique data on a piece of paper, and the paper is used as the personal identification member as shown in FIG. An image may be taken in step S1.

Moreover, the face data stored in association with the unique data in the storage unit may be the face image itself or the feature amount extracted from the face image.

The unique data notified (issued) by the facility to the person to be authenticated may be data that satisfies a predetermined condition for error detection. Specifically, the unique data may be data containing code for error detection. Here, among the unique data including the code, the data excluding the code is referred to as first data, and the code is referred to as second data. The second data (code for error detection) is set so as to satisfy a predetermined relationship with the first data. Specifically, for example, the second data is set to the value of the least significant digit or the value of the most significant digit of the value obtained by adding the numerical values of the respective digits of the first data. In this case, for example, if the first data is "123", the second data is "6".

The facility side issues (notifies) unique data including the first data and the second data to the person to be authenticated. In this case, the second data is added after the first data, for example. Assuming that the first data is "123" and the second data is "6", the person to be authenticated is notified of "1236" as unique data. The facility-side storage unit 4 (see FIG. 1) may store only "first data" or "first data+second data" as unique data.

At step S1 in FIG. 3, the unique data including the first data and the second data is also photographed at the same time as the face is photographed. In step S2, the processing unit 7 (see FIG. 1) as a determination unit determines whether the first data and the second data of the unique data in the captured image obtained in step S1 satisfy a predetermined relationship. , to determine whether there is an error in the unique data. For example, when the second data is set to the value of the least significant digit or the value of the most significant digit of the value obtained by adding the numerical values of the respective digits of the first data, the second data and the first data It is determined whether or not the value of the least significant digit or the value of the most significant digit of the value obtained by adding the numerical values of each digit is equal. If they are equal, it is determined whether the first data of the detected unique data is data registered in the storage unit 4, assuming that there is no error in the unique data detected from the captured image.

On the other hand, if the value of the least significant digit or the value of the most significant digit of the value obtained by adding the numerical values of each digit of the second data and the first data are different, the unique data detected from the captured image Assuming that there is an error, the number authentication in step S2 is judged to be "failure". If the number authentication fails, the face authentication in steps S4 and S5 in FIG. 3 is stopped. For example, if the original unique data is "1236" (first data "123" + second data "6") and the unique data detected from the captured image is "1336", then the first data Since the added value of each digit "7" is different from the second data "6", it is determined that the detected unique data "1336" has an error. For example, in step S1, when the person to be authenticated writes his or her own unique data on a piece of paper and takes a photograph, the person to be authenticated mistakenly writes "1336" instead of "1236" as the unique data. However, the number authentication in step S2 fails. Therefore, it is possible to prevent the face data of the person whose first data is assigned to be "133" from being read out from the storage unit 4 as the face data to be compared with the photographed image, and the face authentication in step S5 being performed. .

In this way, by including the error detection code (second data) in the unique data, it is possible to perform personal authentication with higher accuracy. Note that the unique data including the code for error detection may be obtained at the same time as photographing the face of the person to be authenticated, or may be obtained separately from photographing the face.

1 face authentication system 2, 10 facility side device 3 imaging unit 4 storage unit 5 display unit 6 operation unit 7 processing unit 8 number card 9 unique data acquisition unit

Claims (5)

a storage unit in which face data of a person to be authenticated and unique data assigned to the person to be authenticated are stored in association with each other;
a photographing unit for photographing an image including both the face of the person to be authenticated and the unique data;
a face data acquisition unit that acquires the face data stored in the storage unit in association with the unique data in the image captured by the imaging unit;
a comparison unit that compares the face data acquired by the face data acquisition unit with a face image in the image captured by the imaging unit;
face recognition system. a storage unit in which face data of a person to be authenticated and unique data assigned to the person to be authenticated are stored in association with each other;
a photographing unit for photographing the face of the person to be authenticated;
a unique data acquisition unit that acquires the unique data separately from the photographing of the face by the imaging unit;
a face data acquisition unit that acquires the face data stored in the storage unit in association with the unique data acquired by the unique data acquisition unit;
a comparison unit that compares the face data acquired by the face data acquisition unit and the face image captured by the imaging unit;
face recognition system. The unique data includes code for error detection,
A determination unit that determines whether the acquired unique data has an error based on the code,
3. The face authentication system according to claim 1, wherein the comparison unit stops comparing the face data and the face image when the acquired unique data contains an error. 4. The face authentication system according to any one of claims 1 to 3, wherein the unique data is numerical values, characters, symbols, barcodes, two-dimensional codes, graphics or colors, or combinations thereof. an image acquisition step of acquiring an image including both the face of the person to be authenticated and the unique data assigned to the person to be authenticated;
a face data acquisition step of acquiring face data of the person to be authenticated, which is stored in a storage unit in association with the unique data in the image acquired in the image acquisition step;
a comparison step of comparing the face data acquired in the face data acquisition step with a face image in the image acquired in the image acquisition step;
A face authentication method comprising:

Images