JP2023100064A - Authentication system, authentication device, and authentication method - Google Patents

Abstract

To efficiently and accurately authenticate a user when performing two-factor authentication using biological information of the user and his or her belongings.SOLUTION: In response to receiving an ID from a user terminal 10 which has detected a beacon wave, an image of a face of a user is captured, and matching is requested to a management server 30 including the image of the face and the ID, and a matching score is acquired from the management server 30. Thereafter, an authentication terminal 20 specifies a threshold corresponding to the number of received IDs and uses the matching score and the threshold to perform authentication processing.SELECTED DRAWING: Figure 1

Description

The present invention relates to an authentication system, an authentication device, and an authentication method capable of efficiently and accurately authenticating a user when performing two-factor authentication using the user's biometric information and the user's belongings. .

2. Description of the Related Art Conventionally, there has been known an authentication technique for authenticating a user by using biometric information of the user and other elements different from the biometric information. For example, Patent Literature 1 discloses an authentication system that authenticates a user using biometric information and a PIN code, which is knowledge of the user.

There is also known a technique of performing two-factor authentication using a user's belongings together with biometric information. For example, Patent Literature 2 discloses a technique of authenticating a user by using the user's face image and the user's property (IC card). In Patent Document 2, a first authentication unit that performs first authentication on a user's face image based on a threshold value, a second authentication unit that performs second authentication using an IC card, and a second authentication unit. A face authentication device is disclosed that includes a detection unit that detects whether or not an authentication unit is used, and a threshold value change unit that sets a larger threshold value when the second authentication unit is used than when the second authentication unit is not used. .

Japanese Patent Application Laid-Open No. 2021-081860 Japanese Patent Application Laid-Open No. 2019-125000

However, since the technique disclosed in Patent Document 1 employs a mechanism in which a user inputs information, the user himself/herself must accurately store the information. In addition, if the user inputs information incorrectly, it will not be authenticated correctly, so the user must pay attention when inputting the information, and there is a problem that the information input work becomes complicated.

On the other hand, the technique of Patent Document 2 uses a constant threshold regardless of the number of registrants to be compared with the user, so there is a problem that efficient authentication with high authentication accuracy cannot be performed. For example, the same threshold is used for one-to-one authentication of the user's face image and one registrant and one-to-N authentication of the user's face image and N registrants. Therefore, the false acceptance rate of the latter becomes high.

The present invention has been made to solve the problems (problems) of the prior art described above. An object of the present invention is to provide an authentication system, an authentication device, and an authentication method capable of authenticating a user effectively and accurately.

In order to solve the above-described problems and achieve the object, the present invention registers registration authentication information related to a plurality of registrants, and stores the authentication information related to the user and the registration authentication information related to the plurality of registrants. An authentication system that performs user authentication processing based on a detection unit that detects information transmitted from a terminal that is present at a predetermined distance, an authentication information acquisition unit that acquires authentication information related to the user, When information transmitted from one or more terminals is detected by the detection unit, the number of terminal information, which is the number of detected information, is obtained, and the authentication is performed based on the authentication parameter specified by the number of terminal information An authentication processing unit that performs authentication processing of the authentication information related to the user acquired by the information acquisition unit and the registered authentication information.

Further, according to the present invention, in the above invention, the information transmitted from the terminal is user identification information that identifies a user associated with the terminal, and the terminal information count is the detected user. It is the number of identification information.

Further, according to the present invention, in the above invention, the information transmitted from the terminal is terminal identification information for specifying the terminal, and the number of terminal information is the number of terminals existing at the predetermined distance. .

Further, according to the present invention, in the above invention, the authentication processing unit, when a matching score between the registration authentication information of the registrant and the authentication information of the user is equal to or higher than a threshold included in the authentication parameter, The user is authenticated as the registrant.

Further, in the present invention, in the above invention, the authentication parameter specifies a first threshold when the number of terminal information is equal to or greater than a first number, and specifies a first threshold when the number of terminal information is less than the first number. If there is and is not 0, a second threshold lower than the first threshold is identified, and if the number of terminal information is 0, a third threshold higher than the first threshold is identified.

Further, in the present invention, in the above invention, when the number of terminal information items satisfies a predetermined condition, the authentication processing unit uses authentication processing by matching a pre-registered password and an input password, and the verification score. authentication processing;

Further, according to the present invention, in the above invention, the authentication processing unit possesses M terminals out of N registrants when information transmitted from M terminals is detected by the detection unit. When performing authentication processing of the registered authentication information related to M registrants and the authentication information related to the user acquired by the authentication information acquisition unit, authentication processing is performed using a fourth threshold, and the When information transmitted from M terminals is detected by the detection unit, registration of (NM) registrants out of N registrants, excluding registrants possessing M terminals When performing the authentication processing of the authentication information and the authentication information related to the user acquired by the authentication information acquisition unit, the authentication processing is performed using a fifth threshold higher than the fourth threshold.

Further, in the present invention, in the above invention, the authentication processing unit detects information transmitted from M terminals by the detection unit, and detects M registrants possessing M terminals out of N registrants. A first authentication process using a fourth threshold between the registered authentication information of the registrants and the authentication information of the user acquired by the authentication information acquiring unit, and the registered authentication information of the N registrants and the authentication information of the user acquired by the authentication information acquisition unit, the second authentication process using a fifth threshold higher than the fourth threshold is performed in parallel with do.

Further, according to the present invention, in the above invention, the registration authentication information is a feature quantity specified based on the biometric information of the registrant, and the authentication information related to the user is based on the biometric information of the user. is a feature value specified by

Further, the present invention provides an authentication apparatus that registers registration authentication information related to a plurality of registrants, and performs user authentication processing based on the authentication information related to the user and the registration authentication information related to the plurality of registrants. A detection unit that detects information transmitted from a terminal present at a predetermined distance, an authentication information acquisition unit that acquires authentication information related to the user, and a transmission from one or more terminals by the detection unit When the information is detected, the number of terminal information, which is the number of detected information, is obtained, and based on the authentication parameter specified by the number of terminal information, the authentication information acquisition unit relates to the user acquired An authentication processing unit that performs authentication processing of the authentication information and the registered authentication information.

Further, the present invention provides an authentication apparatus that registers registration authentication information related to a plurality of registrants, and performs user authentication processing based on the authentication information related to the user and the registration authentication information related to the plurality of registrants. An authentication method in an authentication system having a detection step of detecting information transmitted from a terminal existing at a predetermined distance, an authentication information acquisition step of acquiring authentication information related to the user, and the detection step When information transmitted from one or more terminals is detected, the number of terminal information, which is the number of detected information, is obtained, and the authentication information acquisition step is performed based on the authentication parameter specified by the number of terminal information and an authentication processing step of performing authentication processing of the acquired authentication information related to the user and the registered authentication information.

ADVANTAGE OF THE INVENTION According to this invention, when performing two-factor authentication using a user's biometric information and the said user's property, a user can be authenticated efficiently and correctly.

FIG. 1 is an explanatory diagram for explaining the outline of the authentication system according to this embodiment. FIG. 2 is a diagram showing the system configuration of the authentication system according to this embodiment. FIG. 3 is a functional block diagram showing the configuration of the user terminal shown in FIG. 2; FIG. 4 is a functional block diagram showing the configuration of the authentication terminal shown in FIG. 3; FIG. 5 is a diagram showing an example of the threshold table shown in FIG. FIG. 6 is a functional block diagram showing the configuration of the management server shown in FIG. 2; FIG. 7 is a diagram showing an example of the user DB shown in FIG. 6. As shown in FIG. FIG. 8 is a sequence diagram showing a user registration procedure. FIG. 9 is a sequence diagram showing a user authentication procedure. FIG. 10 is a sequence diagram showing the threshold selection procedure shown in FIG. FIG. 11 is an explanatory diagram for explaining authentication processing according to Modification 1. As shown in FIG. FIG. 12 is an explanatory diagram for explaining authentication processing according to Modification 2. As shown in FIG.

Embodiments of an authentication system, an authentication device, and an authentication method according to the present embodiment will be described below in detail with reference to the drawings. In the embodiments described below, the case of using "face information" as the biometric information representing the physical characteristics of a person will be described, but the present invention can also be applied to the case of using biometric information other than the face. Further, in the embodiments shown below, a case will be described in which the user pays at a cash register of a retail store such as a supermarket or a drugstore, or a restaurant such as a restaurant. Furthermore, "user" in this embodiment refers to a person to be authenticated by the authentication system, and "registrant" refers to a user who has been registered in the registrant DB 34a.

<Overview of Authentication System According to Embodiment>
First, an outline of an authentication system according to this embodiment will be described. Here, a case is shown in which two-factor authentication is performed using a face image of a user and a user terminal such as a smartphone possessed by the user. FIG. 1 is an explanatory diagram for explaining the outline of the authentication system according to this embodiment. FIG. 2 is a diagram showing the system configuration of the authentication system according to this embodiment.

In the authentication system according to this embodiment, a user terminal 10, an authentication terminal 20, and a management server 30 are connected to a network. The user terminal 10 is a terminal device such as a smart phone possessed by a user who authenticates using the authentication system. It is assumed that an application for using the authentication system (hereinafter referred to as “user terminal application”) is installed in this user terminal 10 .

The authentication terminal 20 is a terminal device such as a tablet that is provided so as to be able to communicate with a POS (Point Of Sales) terminal or the like in a store, and that authenticates a user using an authentication system. This authentication terminal 20 itself may be a POS terminal. Assume that the authentication terminal 20 is installed with an application (hereinafter referred to as “authentication application”) for performing user authentication in cooperation with the management server 30 . This authentication application is different from the user terminal application installed in the user terminal 10 . A beacon transmitter 23 is attached to the authentication terminal 20 .

The management server 30 uses a registrant database (hereinafter referred to as "registrant DB") 34a to manage the feature amount of the face image of the user registered in the authentication system, and photographs the user from the authentication terminal 20. When receiving the face image and the user identification information (hereinafter referred to as "ID") that uniquely identifies the user, the feature amount of the face image of the user and the registrant registered in the registrant DB 34a It is a processing unit that performs matching processing with the feature amount of the face image, calculates a matching score, and notifies the authentication terminal 20 of the calculated matching score. The matching score is a value obtained by normalizing the matching degree (matching degree) of the feature amount of the face image, and can be a cross-correlation coefficient or an output value using a trained model of deep learning.

[User registration]
User registration using the user terminal 10 shown in FIGS. 1 and 2 will be described. In this embodiment, for convenience of explanation, a case where one user possesses one user terminal 10 will be explained.

Following the guidance of the user terminal application installed in the user terminal 10, the user takes a picture of the face with the camera 12 (S1) and inputs personal information such as address and name. After that, the user management unit 16a, which is one of the functional units of the user terminal application, requests the management server 30 to register the face image and personal information (S2).

When receiving a registration request from the user terminal 10, the management server 30 extracts a feature amount from the face image included in the registration request. A description of this feature amount will be given later. Then, a new ID is issued, the user's name, address, face image, feature amount, etc. included in the registration request are registered in association with this ID, and the ID is notified to the user terminal 10 (S3). When the user terminal 10 is notified of the ID from the management server 30, the user management section 16a stores this ID in the storage section 15 (S4).

[User Authentication]
Next, user authentication using the user terminal 10 shown in FIGS. 1 and 2 will be described. The authentication terminal 20 transmits a beacon wave from a beacon transmitter 23 by short-range wireless communication using BLE (Bluetooth (registered trademark) Low Energy). This beacon wave contains identification information that uniquely identifies this authentication system (hereinafter referred to as "system ID" to distinguish it from "ID"). The beacon wave may contain identification information that uniquely identifies the beacon transmitter 23 .

When the beacon receiver 13 receives the beacon wave (S5), the user terminal 10 determines the system ID included in this beacon wave. The unit 16 b reads the ID stored in the storage unit 15 and transmits it to the authentication terminal 20 . A user terminal 10 located within a predetermined distance from the authentication terminal 20 can receive the beacon wave.

When the ID reception unit 26b receives the ID (terminal information transmitted from the user terminal 10) (S7), the authentication terminal 20 activates the camera 22 to photograph the user's face (S8). When IDs are transmitted from a plurality of user terminals 10, a plurality of IDs are received. Even if the ID receiving unit 26b does not receive the ID, the camera 22 is activated to photograph the user's face if a predetermined operation is performed. After that, the authentication processing unit 26c makes a matching request including one or a plurality of IDs and face images (S9). In addition, ID may not be included in this collation request.

When the management server 30 receives the verification request from the authentication terminal 20, the verification score calculation unit 35d extracts the feature value associated with the ID from the registrant DB 34a. When a plurality of IDs are included in the collation request, feature amounts associated with each of the plurality of IDs are extracted from the registrant DB 34a. In addition, when ID is not included in the collation request, feature amounts associated with all IDs are extracted.

On the other hand, the matching score calculation unit 35d extracts a feature amount from the face image included in the matching request, performs matching processing with the feature amount extracted from the registrant DB 34a, and calculates a matching score (S10). The obtained matching score is notified to the authentication terminal 20 (S11). When feature amounts corresponding to a plurality of IDs are extracted from the registrant DB 34a, the verification score corresponding to each ID is notified. Various methods such as calculation of a matching score using cross-correlation and calculation of a matching score using a trained model of deep learning can be used for such matching processing.

The authentication processing unit 26c of the authentication terminal 20 obtains the number of received IDs (the number of terminal information) received by the ID receiving unit 26b, and selects a threshold that forms part of the authentication parameter based on the obtained number of received IDs ( S12). Specifically, when the number of received IDs is "0", the threshold Th is set to "85", when the number of received IDs is "1", the threshold Th is set to "75", and the number of received IDs is set to " 2 to 4”, the threshold Th is set to “80 (reference)”, and if the number of received IDs is “5 or more”, the threshold Th is set to “82”. When the number of received IDs is "1", one-to-one authentication is performed, and when the number of received IDs is other than "1", one-to-N authentication is performed. The reason for changing the threshold is that as the number of feature values to be matched increases, the threshold is set higher than the standard to lower the false acceptance rate. This is because the

Note that the numerical value shown as the threshold Th here is merely an example. The standard (e.g. "80"), the difference from the standard (e.g. "+5", "-5", "+2"), and the correspondence between these and the number of received IDs depend on the severity of the authentication system and the number of users. etc., a predetermined relationship (for example, a linear relationship, a proportional relationship, or a correlation relationship) is established. Here, four levels of "0", "1", "2 to 4", and "5 or more" are defined, but depending on the requirements of the authentication system, four levels or more may be defined, or less than four levels may be defined.

Thereafter, if there is only one ID with a matching score equal to or greater than the threshold, the authentication processing unit 26c authenticates that the user is the registrant corresponding to this ID, and the ID with a matching score equal to or greater than the threshold is If there are more than one, for example, it is possible to authenticate that the user is the registrant corresponding to the ID with the highest collation score. If there is no ID whose matching score is equal to or higher than the threshold value, or if the difference in matching score between the ID with the highest matching score and the ID with the next highest matching score is less than a predetermined value, it is determined as an authentication error. You can also

As described above, in the authentication system according to the present embodiment, when the authentication terminal 20 receives the ID from the user terminal 10 that has detected the beacon wave, the authentication terminal 20 photographs the user's face and sends the face image to the management server 30. A matching request including an image and an ID is issued, and a matching score is obtained from the management server 30 . After that, the authentication terminal 20 specifies a threshold value corresponding to the number of received IDs, and is configured to perform authentication processing using the matching score and the threshold value. When performing two-factor authentication, a user can be authenticated efficiently and accurately.

<Configuration of user terminal 10>
Next, the configuration of the user terminal 10 shown in FIG. 1 will be described. FIG. 3 is a functional block diagram showing the configuration of the user terminal 10 shown in FIG. 1. As shown in FIG. As already explained, the user terminal 10 is a terminal device such as a smart phone possessed by a user who authenticates using the authentication system, and the user terminal application is installed. Such a user terminal application is installed by downloading it from a predetermined web server and executing it.

As shown in FIG. 3 , the user terminal 10 has a display operation section 11 , a camera 12 , a beacon receiver 13 , a communication I/F section 14 , a storage section 15 and a control section 16 . The user terminal 10 also has a short-range wireless communication function such as Bluetooth (registered trademark) or infrared rays, but detailed description thereof will be omitted here.

The display operation unit 11 is an input/output device composed of a liquid crystal panel, organic EL (electroluminescence), etc., and the camera 12 is an imaging unit composed of elements such as a CCD (Charge Coupled Device), and captures the facial image of the user. to shoot.

The beacon receiver 13 is a device that receives beacon waves, which are BLE radio waves, transmitted from the authentication terminal 20 . The beacon wave contains identification information (system ID) that uniquely identifies the authentication system transmitted from the authentication terminal 20 . The communication I/F unit 14 is an interface unit that communicates with the management server 30 via a network.

The storage unit 15 is a storage device such as a hard disk device or a non-volatile memory, and stores ID data 15a. The ID data 15 a is an ID issued by the management server 30 .

The control unit 16 is a control unit that performs overall control of the user terminal 10, and has a user management unit 16a and an ID notification unit 16b. In practice, a user terminal application, which is a program corresponding to the user management unit 16a and the ID notification unit 16b, is stored in the storage unit 25 or the like, and this user terminal application is loaded into the memory and executed by the CPU. , the processes corresponding to the user management unit 16a and the ID notification unit 16b are executed.

The user management unit 16 a is a processing unit that requests the management server 30 to register a user and stores the ID notified from the management server 30 in the storage unit 15 . The ID notification unit 16b is a processing unit that notifies the ID stored in the storage unit 15 when the beacon receiver 13 receives the beacon wave and if the system ID of the authentication system is included in the beacon wave. be. When notifying such an ID, short-range wireless communication such as Bluetooth (registered trademark) or infrared rays can be used.

<Configuration of Authentication Terminal 20>
Next, the configuration of the authentication terminal 20 shown in FIG. 1 will be described. FIG. 4 is a functional block diagram showing the configuration of authentication terminal 20 shown in FIG. As already described, the authentication terminal 20 is a terminal device such as a tablet that performs authentication processing in conjunction with the management server 30, and an authentication application is installed. Such an authentication application is installed by downloading it from a predetermined web server and executing it.

As shown in FIG. 4 , the authentication terminal 20 has a display operation section 21 , a camera 22 , a beacon transmitter 23 , a communication I/F section 24 , a storage section 25 and a control section 26 . The authentication terminal 20 also has a short-range wireless communication function such as Bluetooth (registered trademark) or infrared rays, but detailed description thereof will be omitted here.

The display operation unit 21 is an input/output device such as a liquid crystal panel and organic EL (electroluminescence), and the camera 22 is an imaging unit such as a CCD and captures a user's facial image.

The beacon transmitter 23 is a device that transmits a beacon wave including identification information (system ID) that uniquely identifies this authentication system. The communication I/F unit 24 is a communication interface unit for communicating with the management server 30 via the network.

The storage unit 25 is a storage device such as a hard disk device or a non-volatile memory, and stores a threshold table 25a. The threshold table 25a is a table used when determining thresholds to be compared with matching scores, and as shown in FIG. 5, the number of received IDs, authentication methods, and thresholds (Th) are associated with each other. The authentication method and the threshold (Th) are authentication parameters when authenticating the user. In FIG. 5, the number of received IDs "0" corresponds to "1-to-N authentication" and a threshold value of "85", and the number of received IDs of "1" corresponds to "1-to-1 authentication" and a threshold value of "75". ``1 to N authentication'' and a threshold of ``80 (reference)'' are associated with the number of received IDs ``2 to 4'', and ``1 to N authentication'' and a threshold of ``80 (reference)'' are associated with the number of received IDs ``5 or more''. 82” are associated with each other.

The control unit 26 is a control unit that performs overall control of the authentication terminal 20, and has a beacon control unit 26a, an ID reception unit 26b, and an authentication processing unit 26c. In practice, an authentication application, which is a program corresponding to the beacon control unit 26a, the ID reception unit 26b, and the authentication processing unit 26c, is stored in the storage unit 25 or the like. , the processes corresponding to the beacon control unit 26a, the ID reception unit 26b, and the authentication processing unit 26c are executed.

The beacon control unit 26 a is a control unit that controls the operation of the beacon transmitter 23 . The beacon control unit 26a controls to transmit a beacon wave when an authentication start operation is performed while the authentication terminal 20 is communicably connected to a POS terminal or the like. For example, a POS terminal capable of communicating with the authentication terminal 20 transmits a beacon wave when an operation for reading a product or the like and performing payment processing is performed.

The ID receiving unit 26b is a processing unit that, upon receiving an ID transmitted from the user terminal 10, notifies the ID to the authentication processing unit 26c. When a plurality of IDs are received, all the received IDs are notified to the authentication processing unit 26c.

The authentication processing unit 26c is a processing unit that performs user authentication in conjunction with the management server 30, and has a collation requesting unit 26c1, a threshold selection unit 26c2, and an authentication unit 26c3. Specifically, when the ID is received from the ID receiving section 26b, the camera 22 is activated to photograph the face image of the user. Also, even if the ID is not received, when a predetermined authentication start operation is received, the camera 22 is activated to photograph the face image of the user.

Upon receiving the face image from the camera 22, the matching requesting unit 26c1 requests the management server 30 to match the face image and the ID. When receiving a plurality of IDs from the ID receiving unit 26b, the matching requesting unit 26c1 requests the management server 30 to match all the IDs and face images. A matching request including a face image is issued to the management server 30 .

The threshold selection unit 26c2 selects a threshold based on the threshold table 25a stored in the storage unit 25 and the number of IDs received from the ID reception unit 26b. When the number of received IDs is "0", the threshold Th is set to 85, when the number of received IDs is "1", the threshold Th is set to 75, and when the number of received IDs is "2 to 4", The threshold Th is set to 80, and if the number of received IDs is "5 or more", the threshold Th is set to 82. In this manner, the false acceptance rate is lowered by increasing the threshold as the number of IDs to be collated increases. When the number of received IDs is "1", one-to-one authentication is performed, and when the number of received IDs is other than "1", one-to-N authentication is performed.

Upon receiving notification of one or more matching scores from the management server 30, the authentication unit 26c3 compares each matching score with a threshold to authenticate the user. Specifically, when there is one ID with a matching score equal to or greater than the threshold Th, the user is authenticated as the registrant corresponding to this ID, and there are multiple IDs with a matching score equal to or greater than the threshold Th. In some cases, for example, the user is authenticated as the registrant corresponding to the ID with the highest matching score. If there is no ID whose matching score is equal to or greater than the threshold Th, or if the difference in matching score between the ID with the highest matching score and the ID with the next highest matching score is less than a predetermined value, an authentication error occurs. judge.

<Configuration of Management Server 30>
Next, the configuration of the management server 30 shown in FIG. 1 will be described. FIG. 6 is a functional block diagram showing the configuration of the management server 30 shown in FIG. 1. As shown in FIG. As already explained, the management server 30 is a device that performs user registration in response to a registration request from the user terminal 10 and calculates a matching score in response to a matching request from the authentication terminal 20. be.

As shown in FIG. 6 , the management server 30 has an input section 31 , a display section 32 , a communication I/F section 33 , a storage section 34 and a control section 35 . The input unit 31 is an input device such as a keyboard and mouse, and the display unit 32 is a display device such as a liquid crystal panel, organic EL (electroluminescence), display device, or the like. The communication I/F unit 33 is a communication interface unit for communicating with the user terminal 10 and the authentication terminal 20 via the network.

The storage unit 34 is a storage device such as a hard disk device or a non-volatile memory, and stores a registrant DB 34a. Although a database management unit is provided to manage this registrant DB 34a, this point is an existing technology and is not a feature of the present embodiment, so a detailed description thereof will be omitted here.

The registrant DB 34a is a database having IDs, names, addresses, face images, feature amounts, etc. of registrants registered in the authentication system. FIG. 7 is a diagram showing an example of the registrant DB 34a shown in FIG. Here, for each ID that uniquely identifies a registrant, personal information such as the name and address of the registrant, a face image, a feature amount of the face image, and the like are registered. In the figure, the registrant with the ID "001" has the name "Yamada O", the address is "Tokyo...", the file name of the face image is "001.jpg", and the feature amount is It shows a situation that is "a12345678". When a new user makes a registration request to the authentication system, a new ID is issued and registered in the registrant DB 34a.

The control unit 35 is a control unit that performs overall control of the management server 30, and has a registrant management unit 35a, an ID issuing unit 35b, a feature amount extraction unit 35c, and a matching score calculation unit 35d. In practice, programs corresponding to the registrant management unit 35a, the ID issuing unit 35b, the feature amount extraction unit 35c, and the matching score calculation unit 35d are stored in the storage unit 34 or the like, and these programs are loaded into the memory. , the CPU causes the corresponding process to be executed.

The registrant management unit 35a is a management unit that manages registrants using the registrant DB 34a, and associates personal information (name, address, etc.), face information (face image, feature amount), etc. of the registrant with the ID. This is the management department that manages The ID issuing unit 35b is a processing unit that, when receiving a user registration request from the user terminal 10, issues an ID that uniquely identifies the user.

The feature amount extraction unit 35c is a processing unit that extracts the feature amount of the face image. Various well-known techniques can be used for the extraction of such feature amounts. For example, it is possible to extract feature points of facial parts such as eyes, nose, and mouth included in a face image and use the result as a feature amount. It is also possible to input a face image to a trained model that has undergone supervised learning in a multi-layer neural network in advance, and output a feature amount from the trained model.

The matching score calculation unit 35d performs a matching process on the feature amount extracted from the face image included in the matching request received from the authentication terminal 20 and the feature amount of the face image registered in the registrant DB 34a to calculate a matching score. processing unit. If the ID is not included in the verification request received from the authentication terminal 20, verification processing is performed with the feature amounts of all the face images (N pieces) registered in the registrant DB 34a. When one ID is included in the verification request received from the authentication terminal 20, verification processing is performed with the feature quantity of the face image corresponding to the ID registered in the registrant DB 34a. If the verification request received from the authentication terminal 20 includes a plurality of IDs, verification processing is performed with the feature amount of the face image corresponding to each ID registered in the registrant DB 34a. Cross-correlation can be used for such collation processing. It is also possible to input two feature values into a trained model that has undergone supervised learning in a multi-layer neural network in advance, and output a matching score from the trained model.

<User registration procedure>
Next, a user registration procedure for the registrant DB 34a of the management server 30 shown in FIG. 6 will be described. FIG. 8 is a flow chart showing a user registration procedure for the registrant DB 34a of the management server 30 shown in FIG.

As shown in the figure, the user terminal 10 is in a state of waiting for reception of a predetermined registration operation (step S101; No). Then, the user's personal information (name, address, etc.) is accepted (step S103), along with photographing a face image through guidance (step S102). Then, a registration request including the personal information and the face image is sent to the management server 30 (step S104).

The management server 30 is in a state of waiting for reception of a registration request (step S105; No), and upon reception of the registration request (step S105; Yes), issues an ID that uniquely identifies the user (step S106). . In addition, the feature amount is extracted from the face image included in the registration request (step S107), the ID, name, address, face image, feature amount, etc. are registered in the registrant DB 34a (step S108), and the user who made the registration request ID is notified to the user terminal 10 (step S109). If not (step S110; No), the process proceeds to step S105.

The user terminal 10 is in a state of waiting for reception of an ID (step S111; No). When the ID is received (step S111; Yes), the ID is stored in the storage unit 15 (step S112), and processing is performed. finish.

<User authentication procedure>
Next, a user authentication procedure in the authentication terminal 20 shown in FIG. 6 will be described. FIG. 9 is a flow chart showing a user authentication procedure in the authentication terminal 20 shown in FIG. Here, for convenience of explanation, the processing of the management server 30 is omitted from the illustration.

As shown in FIG. 9, the authentication terminal 20 transmits a beacon wave (step S201). For example, a POS terminal capable of communicating with the authentication terminal 20 transmits a beacon wave when an operation for reading a product or the like and performing payment processing is performed.

The user terminal 10 is waiting to receive a beacon wave (step S202; No), and if it receives a beacon wave containing the system ID of the authentication system (step S202; Yes), the ID is sent to the authentication terminal 20. is notified (step S203).

The authentication terminal 20 is waiting for reception of an ID (step S204; No), and if the ID is received (step S204; Yes), the camera 22 takes a face image of the user (step S205). Although not shown here for convenience of explanation, the face image of the user is photographed when a predetermined authentication start operation is performed even when the ID is not received. This is because the user may not have the user terminal 10 with him or the user may have the user terminal 10 but may not be detected for some reason.

After that, the authentication terminal 20 makes a verification request including the ID and face image to the management server 30 (step S206). Upon receiving the matching request, the management server 30 extracts the feature amount of the face image included in the matching request, and matches it with the feature amount corresponding to the ID included in the matching request. If the collation request includes a plurality of IDs, the feature amount corresponding to each ID is collated. If the ID is not included in the verification request, the feature values corresponding to all IDs are verified.

The authentication terminal 20 is waiting to receive a matching score (step S207; No), and if it receives a matching score (step S207; Yes), it selects a threshold value (step S208). The threshold selection process will be described later.

After that, the authentication terminal 20 performs authentication processing using the matching score and the threshold value corresponding to the ID (step S208). Specifically, if there is only one ID whose matching score is equal to or higher than the threshold, the user is authenticated as the registrant corresponding to this ID, and if there are multiple IDs whose matching score is equal to or higher than the threshold For example, the user is authenticated as the registrant corresponding to the ID with the highest collation score. If not (step S210; No), the process proceeds to step S201 and similar processing is repeated.

Next, the threshold selection process shown in S208 of FIG. 9 will be described. As shown in FIG. 10, when the number of received IDs is "0" (step S301; Yes), the threshold Th is set to 85 (step S302). The number of IDs being "0" indicates that the user does not possess the user terminal 10, or that the user possesses the user terminal 10 but the user terminal 10 cannot be detected. Therefore, one-to-N authentication processing is performed for all IDs. Therefore, the threshold Th in such a case is set to the highest value.

If the number of IDs is "1" (step S301; No, step S303; Yes), the threshold Th is set to 75 (step S304). If the number of IDs is "1", it is highly possible that the authentication is one-to-one authentication, so the threshold Th in such a case is set to the lowest value. If the user does not possess the user terminal 10 or the user possesses the user terminal 10, the user terminal 10 is not detected and the ID of the user terminal 10 of another person is notified. However, in this case, an error will occur in the authentication process.

If the number of IDs is "2 to 4" (step S303; No, step S305; Yes), the threshold Th is set to 80 (step S306). When the number of IDs is "2 to 4", the threshold Th is set to "80" which is the reference value. This is because the situation in which the IDs of several users are notified is the most common. If the number of IDs is "5 or more" (step S305; No), the threshold Th is set to 82 (step S307). This is because when the number of IDs is 5 or more, the number of IDs is larger than the reference value.

As described above, in the present embodiment, the authentication terminal 20 stores the threshold table 25a in which the number of IDs, the threshold, and the authentication method are associated with each other in the storage unit 25. The ID is detected by being notified of the ID from the user terminal 10, and the number of IDs is obtained. Since the authentication process is performed using the image feature amount, the feature amount corresponding to the ID registered in the registrant DB 34a, and the threshold value, there are two factors using the user's biometric information and the user's property. When performing authentication, a user can be authenticated efficiently and accurately.

In this embodiment, one user possesses one user terminal 10 , but one user may possess a plurality of user terminals 10 . In such a case, if the same user ID is stored in each user terminal 10, the number of users will not increase and the same processing can be performed. This can be applied to modified examples 1 and 2, which will be described later. In addition, each case described later (when a plurality of users share one user terminal 10, when calculating a matching score in the authentication terminal 20, and when prompting the input of a password), Modification 1 and modification 2.

In addition, a plurality of users can share one user terminal 10, such as family members sharing one user terminal 10. FIG. In such a case, a plurality of IDs are registered in association with one user terminal 10, and the feature amount corresponding to each of the plurality of IDs is used for authentication processing. Specifically, multiple IDs are transmitted from one user terminal 10, and the authentication terminal 20 receives the multiple IDs. The authentication terminal 20 has a plurality of IDs (not only the ID received from one user terminal 10, but also IDs received from other user terminals 10 if there are other user terminals 10). Authentication processing is performed using the corresponding feature amount.

In the above embodiment, the management server 30 calculates the matching score, but the present invention is not limited to this, and the authentication terminal 20 can also calculate the matching score. In this case, the management server 30 may notify the authentication terminal 20 of the feature amount of the face image corresponding to the ID. Also, all functions of the management server 30 can be provided to the authentication terminal 20 . Furthermore, threshold selection and authentication processing for the authentication terminal 20 can also be performed by the management server 30 .

Further, when the number of IDs notified from the user terminal 10 to the authentication terminal 20 is "0" (when no ID is notified), the authentication terminal 20 prompts the user to enter a password. It is also possible to collate a password registered in advance in association with a registrant, and use this collation result together with face authentication processing to determine whether or not the user is the registrant. In addition, when the number of IDs notified from the user terminal 10 is equal to or greater than a predetermined number, the authentication terminal 20 uses the matching process using the password in combination with the face authentication process to determine whether or not the user is a registrant. It is also possible to determine whether

<Modification 1>
By the way, in the above embodiment, when the management server 30 receives one or a plurality of IDs from the authentication terminal 20, if the IDs are included in the verification request, "corresponding to the ID registered in the registrant DB 34a Although the case of calculating the matching score between the "feature amount of the face image included in the matching request" and the "feature amount of the face image included in the matching request" has been shown, the present invention is not limited to this. It is also possible to calculate matching scores for all IDs and change thresholds for at least some of the IDs. Thereby, even if the user does not possess the user terminal 10 and the ID information is not notified to the authentication terminal 20, the authentication terminal 20 can identify the user by face authentication.

FIG. 11 is an explanatory diagram for explaining authentication processing according to Modification 1. As shown in FIG. As shown in the figure, when the feature amounts of 1 to N registrants (N is a natural number equal to or greater than 1) are registered in the registrant DB 34a of the management server 30, "all registered in the registrant DB 34a A matching score is calculated between "the feature amount corresponding to each of the IDs (that is, N IDs)" and "the feature amount of the face image included in the matching request".

When the authentication terminal 20 is notified of a total of M IDs (1 to M) (M is a natural number equal to or greater than 1. M<N) from the user terminal 10, the authentication terminal 20 receives M IDs from 1 to M. A first process of obtaining the highest matching score among the matching scores corresponding to and comparing the matching score with a low threshold value (for example, "75") is performed. In parallel with the first processing, the highest matching score among the matching scores corresponding to (N−(M+1)+1) IDs of the other IDs ((M+1) to N) is obtained, and the matching score is A second process is performed that compares to a high threshold (eg, "85"). The first process identifies the first ID with the highest matching score among the IDs exceeding the threshold, and the second process identifies the second ID with the highest matching score among the IDs exceeding the threshold. Among the first ID and the second ID, it is determined that the registrant corresponding to the ID identified earlier is the user.

Then, it is possible to authenticate that a registrant whose ID has a matching score equal to or higher than the threshold is a user. If there are a plurality of IDs whose verification score is greater than or equal to the threshold value, the registrant whose ID has the largest difference between the verification score and the threshold value may be authenticated as the user.

<Modification 2>
FIG. 12 is an explanatory diagram for explaining authentication processing according to Modification 2. As shown in FIG. As shown in the figure, when the feature amounts of 1 to N registrants are registered in the registrant DB 34a of the management server 30, "all IDs registered in the registrant DB 34a (that is, N IDs )” and the “feature amount of the face image included in the matching request” are calculated.

Then, when M IDs are notified from the authentication terminal 20, the highest matching score among the matching scores corresponding to all N IDs from 1 to N is obtained, and the matching score is set to a high threshold value (for example, , "85"). In parallel with the first processing, the highest matching score among matching scores corresponding to M IDs from 1 to M is obtained, and the matching score is compared with a low threshold (for example, "75"). 2 is processed. The first process identifies the first ID with the highest matching score among the IDs exceeding the threshold, and the second process identifies the second ID with the highest matching score among the IDs exceeding the threshold. Among the first ID and the second ID, it is determined that the registrant corresponding to the ID identified earlier is the user. As a result, even if the user cannot be specified in the first process, the user can be specified in the second process.

In addition, in the above embodiment and modification, the case where an ID (user identification information) is transmitted from the user terminal 10 has been described, but instead of the information that uniquely identifies the user, the user terminal 10 Information for unique identification (terminal identification information, hereinafter referred to as “terminal ID”) may be transmitted. User registration and authentication in such a case will be described below, but the same processing as in the case of using an ID will be omitted from the description.

<User registration>
When registering a user, the management server 30 receives a registration request from the user terminal 10, issues a new terminal ID, and associates the terminal ID with the name, address, and face image of the user included in the registration request. and register the feature amount and the like, and notify the terminal ID to the user terminal 10 . When the management server 30 notifies the user terminal 10 of the terminal ID, the user management section 16 a stores the terminal ID in the storage section 15 . In the registrant DB 34a, the user's personal information, face image, feature amount, etc. are registered in association with the terminal ID.

<User Authentication>
When authenticating a user, when the ID receiving unit 26b receives the terminal ID, the authentication terminal 20 activates the camera 22 to photograph the user's face. A verification request including the terminal ID and face image is made.

When the management server 30 receives a matching request from the authentication terminal 20, the matching score calculation unit 35d extracts the feature value associated with the terminal ID from the registrant DB 34a, and extracts from the face image included in the matching request. A matching score is calculated by performing matching processing with the obtained feature amount.

The authentication processing unit 26c of the authentication terminal 20 selects a threshold Th according to the number of terminal IDs received from the user terminal 10, and compares the matching score with the threshold Th. The threshold value Th is set to a value higher than the reference as the number of terminal IDs increases, and to a value lower than the reference as the number of terminal IDs decreases. However, when the number of terminal IDs is "0", the user may be prompted to enter a password while authenticating the face with the highest threshold value Th. The condition for requesting the password input is not limited to the case where the number of terminal IDs is "0", but when the number is equal to or greater than a predetermined number (for example, "10"), the user may be required to input the password.

Note that when extracting feature amounts associated with terminal IDs from the registrant DB 34a, the matching score calculation unit 35d extracts the same or similar feature amounts from different terminal IDs. , and only one of the feature amounts may be used for the matching process. Instead of judging whether or not the user is the same user based only on the feature amount, information other than the feature amount (such as the user's name and address) may be used.

In addition, in the above embodiments and modifications, it is assumed that the user uses the cash register to checkout at a retail store such as a supermarket or a drug store, or a restaurant such as a restaurant, but the present invention is not limited to this. not something. For example, it can be used when a store clerk holds the tablet at the seat where the user is sitting and pays (pays at the seat instead of at the cash register).

Further, in the above-described embodiment and modifications, the user terminal application is used to register the user's personal information and face image, but the present invention is not limited to this. It can also include a preference for using loyalty cards. A user is allowed to preset the order of priority for using a plurality of point cards, the preset information is collated with the point card information usable in the store at the store, and the point card which is actually used based on the collation result. By setting , the user can use the point card without making detailed judgments.

In addition, each configuration illustrated in the above embodiment is a functional schematic, and does not necessarily need to be physically configured as illustrated. That is, the form of distribution/integration of each device is not limited to the illustrated one, and all or part of them can be functionally or physically distributed/integrated in arbitrary units according to various loads and usage conditions. Can be configured.

INDUSTRIAL APPLICABILITY The authentication system, authentication device, and authentication method according to the present invention are suitable for performing two-factor authentication using the user's biometric information and the user's belongings.

10 user terminal 11 display operation unit 12 camera 13 beacon receiver 14 communication I/F unit 15 storage unit 15a ID data 16 control unit 16a user management unit 16b ID notification unit 20 authentication terminal 21 display operation unit 22 camera 23 beacon transmission device 24 communication I/F unit 25 storage unit 25a threshold table 26 control unit 26a beacon control unit 26b ID reception unit 26c authentication processing unit 26c1 matching request unit 26c2 threshold selection unit 26c3 authentication unit 30 management server 31 input unit 32 display unit 33 communication I/F unit 34 Storage unit 34a Registrant DB
35 control unit 35a registrant management unit 35b ID issuing unit 35c feature amount extraction unit 35d matching score calculation unit

Claims (11)

An authentication system for registering registered authentication information related to a plurality of registrants and performing user authentication processing based on the authentication information related to the user and the registered authentication information related to the plurality of registrants,
a detection unit that detects information transmitted from a terminal existing at a predetermined distance;
an authentication information acquisition unit that acquires authentication information related to the user;
When information transmitted from one or more terminals is detected by the detection unit, the number of terminal information, which is the number of detected information, is obtained, and the authentication is performed based on the authentication parameter specified by the number of terminal information An authentication system comprising: an authentication processing unit that performs authentication processing of authentication information related to a user acquired by an information acquisition unit and the registered authentication information. The information transmitted from the terminal is user identification information that identifies a user associated with the terminal,
The authentication system according to claim 1, wherein the terminal information count is the number of detected user identification information. The information transmitted from the terminal is terminal identification information that identifies the terminal,
The authentication system according to claim 1, wherein the number of terminal information is the number of terminals existing at the predetermined distance. The authentication processing unit
The user is authenticated as the registrant when a matching score between the registration authentication information of the registrant and the authentication information of the user is equal to or greater than a threshold value included in the authentication parameter. 4. The authentication system according to any one of 3. The authentication parameters are
When the number of terminal information is equal to or greater than the first number, a first threshold is specified,
If the number of terminal information is less than the first number and is not 0, a second threshold lower than the first threshold is specified,
The authentication system according to claim 4, wherein when the number of pieces of terminal information is 0, a third threshold higher than the first threshold is specified. The authentication processing unit
6. The authentication system according to claim 5, wherein when the number of pieces of terminal information satisfies a predetermined condition, authentication processing by matching a password registered in advance with an input password and authentication processing using the collation score are performed. The authentication processing unit
When information transmitted from M terminals is detected by the detecting unit, registration authentication information relating to M registrants possessing M terminals among N registrants and acquisition of the authentication information When performing authentication processing with the authentication information related to the user acquired by the unit, performing authentication processing using the fourth threshold,
When information transmitted from M terminals is detected by the detection unit, the information related to (NM) registrants out of N registrants excluding the registrants who have M terminals When performing authentication processing of the registered authentication information and the authentication information related to the user acquired by the authentication information acquiring unit, the authentication processing is performed using a fifth threshold value higher than the fourth threshold value. 5. The authentication system according to 4. The authentication processing unit
Information transmitted from M terminals is detected by the detection unit, and registration authentication information relating to M registrants possessing M terminals among the N registrants is acquired by the authentication information acquisition unit. A first authentication process using a fourth threshold with authentication information related to the user who has been obtained;
A fifth threshold higher than the fourth threshold is used when performing authentication processing of the registered authentication information of N registrants and the authentication information of the user acquired by the authentication information acquisition unit. 5. The authentication system according to claim 4, wherein said second authentication process is performed in parallel. The registration authentication information is a feature amount specified based on the biometric information of the registrant,
The authentication system according to any one of claims 1 to 8, wherein the authentication information related to the user is a feature amount specified based on the biometric information of the user. An authentication device that registers registration authentication information related to a plurality of registrants, and performs user authentication processing based on the authentication information related to the user and the registration authentication information related to the plurality of registrants,
a detection unit that detects information transmitted from a terminal existing at a predetermined distance;
an authentication information acquisition unit that acquires authentication information related to the user;
When information transmitted from one or more terminals is detected by the detection unit, the number of terminal information, which is the number of detected information, is obtained, and the authentication is performed based on the authentication parameter specified by the number of terminal information An authentication device comprising: an authentication processing unit that performs authentication processing of authentication information related to a user acquired by an information acquisition unit and the registered authentication information. Authentication in an authentication system having an authentication device that registers registration authentication information related to multiple registrants and performs user authentication processing based on the authentication information related to the user and the registered authentication information related to multiple registrants a method,
a detection step of detecting information transmitted from a terminal present at a predetermined distance;
an authentication information acquisition step of acquiring authentication information related to the user;
When information transmitted from one or more terminals is detected by the detecting step, the number of terminal information, which is the number of detected information, is obtained, and the authentication based on the authentication parameter specified by the number of terminal information An authentication method, comprising: an authentication processing step of performing authentication processing of the user authentication information acquired in the information acquisition step and the registered authentication information.

Images