JP2022047542A - Server device, system, method for controlling server device, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique enabling a user to detect occurrence of erroneous authentication in biometric authentication.

SOLUTION: A server device includes an acquisition part and an authentication part. The acquisition part acquires biometric information of a person to be authenticated from a terminal. The authentication part controls the biometric authentication using the biological information of the person to be authenticated and the biological information of each of a plurality of users registered in advance. Moreover, when the biometric authentication succeeds and a predetermined condition is satisfied, the authentication part transmits an authentication result, including the biometric information obtained from the terminal and the registered biometric information corresponding to a successful authentication person who has succeeded in the biometric authentication, to an office staff terminal used by the office staff.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present invention relates to techniques related to biometric authentication.

Immigration is carried out at airports and ports. The immigration officer will compare the face photo affixed to the passport with the face of the person in front of him, and if the face image of the passport matches the face of the person in front of him, he will allow the person to enter and leave the country.

Technology is being developed to carry out the above immigration procedures using biometrics.

For example, Patent Document 1 describes that since the operator can grasp the factor of the face recognition result at a glance, the face recognition result can be confirmed or corrected on the spot.

The display control device of Patent Document 1 includes a similarity acquisition unit and a display control unit. The similarity acquisition unit acquires the similarity derived by the collation process for each partial region of the face image. The display control unit controls to superimpose and display at least one of the first region whose similarity exceeds the threshold value and the second region whose similarity does not exceed the threshold value on the face image.

Patent Document 2 describes that it provides a security inspection confirmation system capable of strengthening security inspections at airports. The system of Patent Document 2 includes a storage unit, a collation unit, and a notification unit. The storage unit stores the first face image data of the person included in the first captured image acquired by the first imaging unit. The collation unit collates the passenger's second face image data included in the second image captured by the second image pickup unit with the first face image data. The notification unit notifies the result of the collation in the collation unit.

International Publication No. 2017/043132 JP-A-2019-125237

As disclosed in Patent Documents 1 and 2, various technological developments related to biometric authentication have been carried out. However, the accuracy of biometric authentication is limited, and a certain ratio of false authentication (acceptance of others, refusal of the person) may occur. If an incorrect authentication occurs in the procedure at the airport, it may take time to correct the incorrect authentication, or the user may leave the country while boarding the incorrect boarding machine.

An object of the present invention is to provide a server device, a system, a control method for the server device, and a storage medium that contribute to detecting the occurrence of false authentication (particularly, acceptance by another person) in biometric authentication.

According to the first viewpoint of the present invention, the acquisition unit that acquires the biometric information of the authenticated person from the terminal, the biometric information of the authenticated person, and the biometric information of each of the plurality of users registered in advance are used. The authentication unit includes an authentication unit that performs biometric authentication, and the authentication unit includes biometric information acquired from the terminal and registered biometric information of a successful authentication person who has succeeded in biometric authentication when a predetermined condition is satisfied. A server device is provided that transmits authentication result information including the above to the staff terminal used by the staff.

According to the second aspect of the present invention, the terminal includes the terminal, the staff terminal used by the staff, the terminal and the server device connected to the staff terminal, and the server device is from the terminal to the authenticated person. The authentication unit includes an acquisition unit that acquires biometric information and an authentication unit that performs bioauthentication using the biometric information of the person to be authenticated and the biometric information of each of a plurality of pre-registered users. Provided is a system for transmitting authentication result information including biometric information acquired from the terminal and registered biometric information of a successful authentication person to the staff terminal when a predetermined condition is satisfied. To.

According to the third viewpoint of the present invention, in the server device, the biometric information of the authenticated person is acquired from the terminal, and the biometric information of the authenticated person and the biometric information of each of the plurality of users registered in advance are used. When biometric authentication is performed and certain conditions are met, the staff member uses the authentication result information including the biometric information acquired from the terminal and the registered biometric information of the successful authentication person who succeeded in the biometric authentication. A method of controlling the server device to be transmitted to the terminal is provided.

According to the fourth viewpoint of the present invention, the process of acquiring the biometric information of the authenticated person from the terminal on the computer mounted on the server device, and the biometric information of the authenticated person and a plurality of users registered in advance. The process of performing biometric authentication using each biometric information, and authentication including the biometric information acquired from the terminal and the registered biometric information of the successful authentication person who succeeded in the biometric authentication when a predetermined condition is satisfied. A computer-readable storage medium is provided that stores a process for transmitting the result information to the staff terminal used by the staff and a program for executing the process.

According to each viewpoint of the present invention, there is provided a server device, a system, a control method of the server device, and a storage medium that contribute to detecting the occurrence of false authentication (particularly, acceptance of another person) in biometric authentication. The effect of the present invention is not limited to the above. According to the present invention, other effects may be produced in place of or in combination with the effect.

It is a figure for demonstrating the outline of one Embodiment. It is a figure which shows an example of the schematic structure of the boarding procedure system which concerns on 1st Embodiment. It is a figure for demonstrating the operation of the terminal which concerns on 1st Embodiment. It is a figure for demonstrating the operation of the terminal which concerns on 1st Embodiment. It is a figure which shows an example of the processing configuration of the check-in terminal which concerns on 1st Embodiment. It is a figure for demonstrating the operation of the system registration part which concerns on 1st Embodiment. It is a figure which shows an example of the processing structure of the system registration part which concerns on 1st Embodiment. It is a figure which shows an example of the processing structure of the boarding gate apparatus which concerns on 1st Embodiment. It is a figure which shows an example of the authentication request which concerns on 1st Embodiment. It is a figure which shows an example of the processing configuration of the server apparatus which concerns on 1st Embodiment. It is a figure which shows an example of the token ID information database which concerns on 1st Embodiment. It is a figure which shows an example of the business information database which concerns on 1st Embodiment. It is a sequence diagram which shows an example of the operation of the boarding procedure system which concerns on 1st Embodiment. It is a figure which shows an example of the schematic structure of the boarding procedure system which concerns on 2nd Embodiment. It is a figure for demonstrating the operation of the staff terminal which concerns on 2nd Embodiment. It is a figure which shows an example of the information which the server apparatus which concerns on 2nd Embodiment stores. It is a figure which shows an example of the hardware configuration of a server device. It is a figure for demonstrating the operation of the terminal which concerns on the modification of the present disclosure. It is a figure for demonstrating the operation of the staff terminal which concerns on the modification of the present disclosure.

First, an outline of one embodiment will be described. It should be noted that the drawing reference reference numerals added to this outline are added to each element for convenience as an example for assisting understanding, and the description of this outline is not intended to limit anything. Further, unless otherwise specified, the blocks described in each drawing represent not the configuration of hardware units but the configuration of functional units. Connection lines between blocks in each figure include both bidirectional and unidirectional. The one-way arrow schematically shows the flow of the main signal (data), and does not exclude bidirectionality. In the present specification and the drawings, the same reference numerals may be given to elements that can be similarly described, so that duplicate description may be omitted.

The server device 100 according to one embodiment includes an acquisition unit 101 and an authentication unit 102 (see FIG. 1). The acquisition unit 101 acquires the biometric information of the person to be authenticated from the terminal. The authentication unit 102 performs biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of the plurality of users registered in advance. When a predetermined condition is satisfied, the authentication unit 102 sends the authentication result information including the biometric information acquired from the terminal and the registered biometric information of the successful authentication person to the staff terminal used by the staff. Send.

When the server device 20 succeeds in authenticating the person to be authenticated, the biometric information used for the authentication (for example, an acquired face image acquired by a terminal, a registered face image registered in advance) is satisfied when a predetermined condition is satisfied. ) Is sent to the terminal used by the staff. The staff terminal presents this information to staff at airports and the like. The staff compares the two presented facial images and detects the occurrence of false authentication (acceptance of others). At that time, the staff terminal displays the authentication result (two face images) narrowed down in advance by the server device 20. As a result, staff members only have to carefully check the narrowed down authentication results, reducing the probability of overlooking the occurrence of acceptance of others. That is, the system including the server device 100 can detect the occurrence of erroneous authentication (particularly, acceptance of another person) in biometric authentication.

Specific embodiments will be described in more detail below with reference to the drawings.

[First Embodiment]
The first embodiment will be described in more detail with reference to the drawings.

[System configuration]
FIG. 2 is a diagram showing an example of a schematic configuration of the boarding procedure system according to the first embodiment. The boarding procedure system according to the first embodiment is a system that realizes a series of procedures (baggage deposit, security check, etc.) at the airport by biometric authentication. The boarding procedure system shown in FIG. 2 is operated by, for example, a public institution such as an immigration control bureau or a trustee who has been entrusted with business by the public institution.

In the disclosure of the present application, "boarding procedure" refers to a series of procedures performed from check-in to boarding an aircraft.

Referring to FIG. 2, the boarding procedure system includes a check-in terminal 10, a baggage deposit machine 11, a passenger transit system 12, a gate device 13, a boarding gate device 14, and a server device 20.

The check-in terminal 10, the baggage deposit machine 11, the passenger passage system 12, the gate device 13, and the boarding gate device 14 are terminals (touch points) installed at the airport. These terminals are connected to the server device 20 via a network. The network shown in FIG. 2 is composed of a LAN (Local Area Network) including an airport premises communication network, a WAN (Wide Area Network), a mobile communication network, and the like. The connection method is not limited to the wired method and may be a wireless method.

The server device 20 is installed in a facility such as an airport company. Alternatively, the server device 20 may be a server installed in the cloud on the network.

The configuration shown in FIG. 2 is an example, and does not mean to limit the configuration of the boarding procedure system. The boarding procedure system may include devices and the like (not shown).

The user boarding procedure is performed by each terminal shown in FIG. Specifically, a series of procedures when a user leaves Japan is sequentially carried out at terminals installed at five locations. In the boarding procedure system shown in FIG. 2, the boarding procedure of the user is realized by authentication using biometric information (biometric authentication).

The biological information disclosed in the present application is a face image, a fingerprint image, an iris image, a finger vein image, a palm print image, a palm vein image, and the like. Alternatively, the biometric information may be voice data (voiceprint) that stores a human voice. The biometric information may be one or a plurality. The wording of "biological information" in the disclosure of the present application means image data including all or part of the living body, audio data, and feature quantities extracted from the image.

Upon arriving at the airport, a user (system user) who wishes to carry out boarding procedures by biometric authentication operates the check-in terminal 10 to perform "check-in procedures". The system user presents a paper ticket, a two-dimensional bar code on which boarding information is described, a mobile terminal displaying a copy of the e-ticket, and the like to the check-in terminal 10. The check-in terminal 10 outputs a boarding pass when the check-in procedure is completed. The boarding pass includes a paper boarding pass and an electronic boarding pass.

A system user who has completed the check-in procedure and wishes to carry out the boarding procedure by biometric authentication performs system registration using the check-in terminal 10. Specifically, the system user causes the check-in terminal 10 to read the acquired boarding pass and passport. In addition, the check-in terminal 10 acquires biometric information (for example, a face image) of the system user.

The check-in terminal 10 transmits information related to these (boarding pass, passport, biometric information) to the server device 20.

The server device 20 confirms the validity of the information acquired from the check-in terminal 10. Specifically, the server device 20 confirms the validity of the presented passport. When the confirmation is completed, the server device 20 registers the system user. Specifically, the server device 20 issues a token used for the boarding procedure of the user registered in the system.

The issued token is identified by a token ID (Identifier). Information required for boarding procedures (for example, biometric information, business information required for boarding procedures, etc.) is associated via a token ID. That is, the "token" is issued together with the registration of the system user, and is the identification information for the registered system user to undergo the boarding procedure using the biometric information. When the token (token ID) is issued, the system user can use the boarding procedure using biometric authentication.

Depending on the generation of the token, the server device 20 adds an entry to each of the token ID information database and the business information database.

The token ID information database is a database that stores detailed information of the generated token. The database stores at least the token ID and biometric information (face image, feature amount) in association with each other. The server device 20 refers to the token ID information database and executes biometric authentication.

The business information database is a database that stores business information. The business information database stores the token ID and the business information in association with each other.

When the system user to whom the token is issued arrives at the terminal, biometric information (for example, a face image) is acquired at the terminal. The terminal sends an authentication request including a face image to the server device 20.

In the disclosure of the present application, the term "terminal" means a device, a device, or the like that transmits an authentication request including biometric information to the server device 20. In the example of FIG. 2, the baggage deposit machine 11, the passenger passage system 12, the gate device 13, and the boarding gate device 14 correspond to "terminals". Alternatively, if the check-in procedure is also performed by biometric authentication, the check-in terminal 10 also corresponds to a "terminal".

The server device 20 performs biometric authentication using the biometric information acquired from the terminal and the biometric information registered in the system. If the biometric authentication is successful, the server device 20 transmits an acknowledgment including the biometric information (registered face image) and business information of the registered side used for the biometric authentication to the terminal. If the biometric authentication fails, the server device 20 sends a negative response to that effect to the terminal.

The terminal that receives the successful authentication performs the boarding procedure of the user based on the acquired business information. In addition, the terminal opens a gate or the like as necessary to allow the user to pass through.

The terminal that has received the authentication result (authentication success, authentication failure) displays according to the result. Specifically, the terminal provides information to passengers (certified persons) using a liquid crystal display or the like. The display device such as a liquid crystal display is installed in a place where the person to be authenticated can easily see. The liquid crystal display or the like may be installed in the terminal or may be installed away from the terminal. Alternatively, an image or the like may be projected on the floor through which the passenger passes, and information may be provided to the person to be authenticated.

The terminal that has received the successful authentication displays the biometric information (face image on the registration side) acquired from the server device 20. For example, the terminal makes a display as shown in FIG. The terminal that has received the authentication failure displays, for example, as shown in FIG. The person to be authenticated confirms the display on the terminal.

The display shown in FIG. 3 is an example and does not mean to limit the content thereof. In addition, the displayed contents may differ depending on the type of terminal. For example, items such as name, destination, airline, and flight number may be displayed in common on each terminal, and the departure time of the boarding flight may be displayed only on the boarding gate device 14.

Here, there are four combinations of the authentication result (authentication success, authentication failure) by the server device 20 and the correctness (authentication result is correct, error) of the authentication result.

The first combination is when the authentication is successful and the authentication result is correct. Specifically, the case where the user A is the authenticated person and the server device 20 also recognizes the authenticated person as the user A corresponds to the first combination.

The second combination is the case where the authentication is successful and the authentication result is incorrect (occurrence of acceptance of another person). For example, the case where the user A is the authenticated person and the server device 20 recognizes the user B as the authenticated person corresponds to the second combination.

The third combination is when the authentication fails and the authentication result is correct. Specifically, a third combination may occur when the biometric information of the person to be authenticated is not registered in the server device 20.

The fourth combination is a case where the authentication fails and the authentication result is incorrect (occurrence of personal refusal). For example, even though the biometric information of the user A is registered in the server device 20, the case where the server device 20 fails to authenticate the user A corresponds to the fourth combination.

In the case of the first combination, the person to be authenticated passes through the gate or the like without any doubt even if he / she comes into contact with the display as shown in FIG. Since the image of his / her face is displayed on the terminal, the person to be authenticated considers that the procedure by biometric authentication has been completed normally.

In the case of the second combination, the person to be authenticated is wondering whether he / she may pass through the gate or the like when he / she comes into contact with the display as shown in FIG. This is because the gate and the like are open and can pass through, but the face image of another person is displayed. Also, even if information different from the flight information (destination, airline, etc.) that the certified person thinks is displayed, the certified person wonders whether it is okay to pass through the gate. In such a case, the person to be authenticated (successful authentication person) informs the staff or the like waiting in the vicinity of the terminal of the above fact (the face image of another person is displayed). The staff, etc. confirm the passport, etc. possessed by the user, support the procedure of the user, and correct the authentication result of the server device 20 as necessary.

In the case of the third combination and the fourth combination, the person to be authenticated inquires the staff who are waiting in the vicinity of the terminal when they come into contact with the display as shown in FIG.

The staff will hear about the situation of the person to be authenticated (certification failure person) (for example, whether or not the token issuance procedure for receiving biometric authentication has been performed). If the person to be authenticated has not performed the above procedure, the staff will request the person to be authenticated to carry out the token issuance procedure. Alternatively, if the person to be authenticated is in the process of issuing a token, the staff may confirm the passport or boarding pass possessed by the person to be authenticated and proceed with the procedure.

Subsequently, the schematic configuration, functions, and the like of each device will be described.

The check-in terminal 10 is installed in the check-in lobby in the airport. As described above, the user performs system registration for realizing the boarding procedure using biometric authentication using the check-in terminal 10. In addition, the system user operates the check-in terminal 10 to perform the check-in procedure. That is, the check-in terminal 10 is also a self-terminal for performing a check-in procedure by being operated by the user. The check-in terminal 10 is also referred to as a CUSS (Common Use Self Service) terminal. After completing the check-in procedure, the user will be transferred to the baggage deposit area or security checkpoint.

The baggage deposit machine 11 is installed in an area adjacent to the baggage counter (manned counter) in the airport or in an area near the check-in terminal 10. The baggage depository machine 11 is a self-terminal for performing a procedure (baggage deposit procedure) for depositing baggage that is not brought into an aircraft by being operated by the user. The baggage deposit machine 11 is also referred to as a CUBD (Common Use Bag Drop) terminal. After completing the baggage check-in procedure, the user will move to the security checkpoint. If the user does not check the baggage, the baggage check-in procedure is omitted.

The passenger passage system 12 is a gate device installed at the entrance of a security checkpoint in an airport. The passenger passage system 12, also called a PRS (Passenger Reconciliation System), is a system for determining whether or not a user can pass through at the entrance of a security checkpoint. When the user completes the security inspection procedure after passing through the passenger passage system 12, the user moves to the immigration checkpoint.

The gate device 13 is installed at the immigration checkpoint in the airport. The gate device 13 is a device that automatically performs the departure examination procedure of the user. After completing the departure examination procedure, the user will move to the departure area where duty-free shops and boarding gates are provided.

The boarding gate device 14 is a traffic control device installed for each boarding gate in the departure area. The boarding gate device 14 is the final stage gate device in a series of procedures for departure examination (examination using biometric information). The boarding gate device 14 is also referred to as an ABG (Automated Boarding Gates) terminal. The boarding gate device 14 confirms that the user is a passenger of an aircraft that can board from the boarding gate. After passing through the boarding gate device 14, the user boarded the aircraft and departed for a second country.

The boarding procedure using biometric authentication by each device shown in FIG. 2 (check-in terminal 10, baggage deposit machine 11, passenger passage system 12, gate device 13, boarding gate device 14) is an example and is used for the procedure. It is not intended to limit the equipment to be used. For example, a device different from the above device may be used for the boarding procedure, or some of the above devices may not be used for the procedure. For example, the gate device 13 may not be included in the check-in system.

The server device 20 is a server device for supporting and managing the boarding procedure. The server device 20 manages the token ID. Specifically, the server device 20 issues or invalidates the token ID. In addition, the server device 20 processes authentication requests from various terminals in the airport.

Subsequently, the details of each device included in the boarding procedure system according to the first embodiment will be described. In the following description, the user's "face image" and "features generated from the face image" will be taken as examples of biometric information.

[Check-in terminal]
As described above, the check-in terminal 10 is a device that provides system users with operations related to check-in procedures and system registration.

FIG. 5 is a diagram showing an example of a processing configuration (processing module) of the check-in terminal 10 according to the first embodiment. Referring to FIG. 5, the check-in terminal 10 includes a communication control unit 201, a system registration unit 202, a token issuance request unit 203, a message output unit 204, a check-in execution unit 205, and a storage unit 206. include.

The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the server device 20. Further, the communication control unit 201 transmits data to the server device 20. The communication control unit 201 passes the data received from the other device to the other processing module. The communication control unit 201 transmits the data acquired from the other processing module to the other device. In this way, the other processing module transmits / receives data to / from the other device via the communication control unit 201.

The system registration unit 202 is a means for registering the system of a user who wishes to carry out boarding procedures by biometric authentication. For example, the system registration unit 202 provides the user with a GUI (Graphical User Interface) for confirming whether or not the user desires "boarding procedure using a face image" after the check-in procedure is completed. (See Fig. 6).

When the user wishes to carry out the boarding procedure using the face image, the system registration unit 202 acquires three pieces of information (information written on the boarding pass, information written on the passport, and biometric information) using the GUI.

The system registration unit 202 includes three submodules. FIG. 7 is a diagram showing an example of a processing configuration (processing module) of the system registration unit 202 according to the first embodiment. As shown in FIG. 7, the system registration unit 202 includes a boarding pass information acquisition unit 211, a passport information acquisition unit 212, and a biometric information acquisition unit 213.

The boarding pass information acquisition unit 211 is a means for acquiring the information described in the boarding pass possessed by the system user (hereinafter referred to as boarding pass information). The boarding pass information acquisition unit 211 controls a reader (not shown) such as a scanner to acquire boarding pass information.

Boarding pass information includes name (last name, first name), airline code, flight number, boarding date, departure place (boarding airport), destination (arrival airport), seat number, boarding time, arrival time and the like.

The passport information acquisition unit 212 is a means for acquiring the information described in the passport possessed by the system user (hereinafter referred to as passport information). The passport information acquisition unit 212 controls a reader such as a scanner to acquire passport information.

The passport information includes a face image (hereinafter referred to as a passport face image), name, gender, nationality, passport number, passport issuing country, and the like.

The biometric information acquisition unit 213 is a means for acquiring biometric information of a system user. The biological information acquisition unit 213 controls the camera and acquires a facial image of the system user. For example, when the biometric information acquisition unit 213 detects a face in an image to be constantly or periodically photographed, the biometric information acquisition unit 213 photographs the user's face and acquires the face image.

It is desirable that the biological information acquisition unit 213 displays a guidance message regarding the acquisition of the face image via the message output unit 204 before photographing the face image. For example, the biometric information acquisition unit 213 displays a message such as "The customer's face image is taken and registered in the system. The registered face image will be deleted from the system after boarding is completed."

The system registration unit 202 delivers the acquired three pieces of information (boarding pass information, passport information, and biometric information) to the token issuance request unit 203.

The token issuance request unit 203 shown in FIG. 5 is a means for requesting the server device 20 to issue a token. The token issuance request unit 203 generates a token issuance request including boarding pass information, passport information, and biometric information (face image). The token issuance request unit 203 transmits the generated token issuance request to the server device 20.

The token issuance request unit 203 delivers the response (response to the token issuance request) acquired from the server device 20 to the message output unit 204.

The message output unit 204 is a means for outputting various messages. For example, the message output unit 204 outputs a message according to the response acquired from the server device 20.

When a response (affirmative response) to the effect that the token has been successfully issued is received, the message output unit 204 outputs to that effect. For example, the message output unit 204 outputs a message such as "Future procedures can be performed by face recognition".

When a response (negative response) to the effect that the token issuance has failed is received, the message output unit 204 outputs to that effect. For example, the message output unit 204 outputs a message such as "Sorry. The procedure by face recognition cannot be performed. Please go to the manned booth."

The check-in execution unit 205 is a means for performing a user's check-in procedure. The check-in execution unit 205 executes a check-in procedure such as seat selection based on the ticket presented by the user. For example, the check-in execution unit 205 transmits the information described in the ticket to the DCS (Departure Control System), and acquires the information described in the boarding pass from the DCS. Since the operation of the check-in execution unit 205 can be the same as the operation of the existing check-in terminal, a more detailed description will be omitted.

The storage unit 206 is a means for storing information necessary for the operation of the check-in terminal 10.

[Boarding gate device]
FIG. 8 is a diagram showing an example of a processing configuration (processing module) of the boarding gate device 14 according to the first embodiment. Referring to FIG. 8, the boarding gate device 14 includes a communication control unit 301, a biometric information acquisition unit 302, an authentication request unit 303, a message output unit 304, a function realization unit 305, and a storage unit 306. ..

The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the server device 20. Further, the communication control unit 301 transmits data to the server device 20. The communication control unit 301 passes the data received from the other device to the other processing module. The communication control unit 301 transmits the data acquired from the other processing module to the other device. In this way, the other processing module transmits / receives data to / from other devices via the communication control unit 301.

The biometric information acquisition unit 302 is a means for controlling a camera (not shown) to acquire biometric information of a user. The biological information acquisition unit 302 images the front of the own device at regular intervals or at predetermined timings. The biological information acquisition unit 302 determines whether or not the acquired image includes a human face image, and if the acquired image includes a face image, extracts the face image from the acquired image data.

Since existing techniques can be used for the face image detection process and the face image extraction process by the biological information acquisition unit 302, detailed description thereof will be omitted. For example, the biological information acquisition unit 302 may extract a face image (face region) from the image data by using a learning model learned by a CNN (Convolutional Neural Network). Alternatively, the biological information acquisition unit 302 may extract a face image by using a technique such as template matching.

The biological information acquisition unit 302 delivers the extracted face image to the authentication request unit 303.

The authentication request unit 303 is a means for requesting the server device 20 to authenticate the user in front of him. The authentication request unit 303 generates an authentication request including an identifier of the own device (hereinafter referred to as a terminal identifier), the acquired face image, and the like (see FIG. 9). A MAC (Media Access Control address) address, an IP (Internet Protocol) address, or the like can be used as the terminal identifier. The authentication request unit 303 transmits the generated authentication request to the server device 20.

The server device 20 can uniquely identify the terminal that is the source of the authentication request by confirming the terminal identifier included in the authentication request. The server device 20 can also specify the type of terminal (baggage deposit machine 11, passenger passage system 12, gate device 13, boarding gate device 14) based on the terminal identifier. The terminal identifier is shared between each terminal included in the system and the server device 20. For example, a system administrator or the like may determine a terminal identifier and input the determined terminal identifier into each terminal. Further, the system administrator may input table information or the like in which the terminal identifier and the type of the terminal are associated with each other in the server device 20.

The authentication request unit 303 receives a response from the server device 20 to the authentication request. The authentication request unit 303 passes the response acquired from the server device 20 to the message output unit 304 and the function realization unit 305.

The message output unit 304 is a means for outputting various messages. For example, the message output unit 304 displays as shown in FIGS. 3 and 4 according to the authentication result (authentication success, authentication failure) acquired from the server device 20.

When the authentication is successful, the message output unit 304 displays the face image (registered face image) acquired from the server device 20. Alternatively, as shown in FIG. 3, the message output unit 304 may use personal information (name, etc.) of the successful authentication person (certified person determined to be successful in authentication) or information on the flight of the successful authentication person (information on the airline company, etc.). Information about the arrival airport, flight number of boarding aircraft, departure time, etc.) may be included in the display.

The information about the airline company is exemplified by the name of the airline company, the airline code, and the like. Information on the arrival airport includes the name of the arrival airport, the name of the country to which the arrival airport belongs, and the like. The message output unit 304 may extract and generate personal information and flight information of a successful authentication person from the business information acquired from the server device 20.

When the authentication failure is acquired, the message output unit 304 displays as shown in FIG. That is, the message output unit 304 notifies the authentication failure person (the person to be authenticated who is determined to be the authentication failure) of the fact of the authentication failure.

The function realization unit 305 is a means for realizing the function of the boarding gate device 14. The function realization unit 305 realizes the procedure regarding the successful authentication person. The function realization unit 305 identifies the flight number of the aircraft on which the user (successful authentication person) can board from the acquired business information. The function realization unit 305 permits the successful person to pass through the gate when the specified flight number and the flight number assigned to the own device match. Since the operation of the function realization unit 305 can be the same as the operation of the existing boarding gate device, detailed description thereof will be omitted. In addition, a staff member working for the airline of the aircraft boarding from the boarding gate device 14 may assign (input) a required flight number to the boarding gate device 14.

When the function realization unit 305 permits the successful authentication person to pass through the gate, the function realization unit 305 notifies the server device 20 to that effect.

The storage unit 306 is a means for storing information necessary for the operation of the boarding gate device 14.

[Other terminals]
The basic processing configuration of the other terminals (baggage deposit machine 11, passenger passage system 12, gate device 13) included in the boarding procedure system can be the same as the processing configuration of the boarding gate device 14 shown in FIG. Therefore, detailed explanation is omitted. Each terminal acquires the biometric information (face image) of the system user, and requests the server device 20 to authenticate using the acquired biometric information. If the authentication is successful, the function assigned to each terminal is executed. In addition, each terminal outputs a display (message) according to the authentication result (authentication success, authentication failure).

[Server device]
FIG. 10 is a diagram showing an example of a processing configuration (processing module) of the server device 20 according to the first embodiment. Referring to FIG. 10, the server device 20 includes a communication control unit 401, a token generation unit 402, a database management unit 403, an authentication unit 404, and a storage unit 405.

The communication control unit 401 is a means for controlling communication with other devices. For example, the communication control unit 401 receives data (packet) from the check-in terminal 10. Further, the communication control unit 401 transmits data to the check-in terminal 10. The communication control unit 401 passes the data received from the other device to the other processing module. The communication control unit 401 transmits the data acquired from the other processing module to the other device. In this way, the other processing module transmits / receives data to / from other devices via the communication control unit 401. The communication control unit 401 has a function as an "acquisition unit" that acquires the biometric information of the person to be authenticated from the terminal. Alternatively, the communication control unit 401 has a function as a "receiving unit" for receiving an authentication request including the biometric information of the person to be authenticated and a "transmitting unit" for transmitting a response to the authentication request.

The token generation unit 402 is a means for generating tokens in response to a token generation request from the check-in terminal 10. At that time, the token generation unit 402 determines the validity of the passport presented by the user.

Specifically, the token generation unit 402 determines whether or not the person who presented the passport to the check-in terminal 10 and the person who received the issuance of the passport are the same person. In order to execute the determination, the token generation unit 402 extracts the face image (system user's face image) included in the token generation request and the passport face image included in the passport information. The token generation unit 402 determines whether or not these two facial images substantially match.

The token generation unit 402 executes collation (one-to-one collation) of the two face images. The token generation unit 402 calculates a feature vector from each of the two images. The token generation unit 402 calculates the similarity (for example, Euclidean distance) between the two images, and determines whether the two images are facial images of the same person based on the result of the threshold processing for the calculated similarity. do. For example, if the similarity is greater than a predetermined value (if the distance is shorter than a predetermined value), the token generation unit 402 determines that the two facial images are from the same person.

When the token generation unit 402 succeeds in determining the validity of the passport using the biometric information, the token generation unit 402 issues a token. For example, the token generation unit 402 generates a unique value as the token ID based on the date and time at the time of processing, the sequence number, and the like.

When the token generation unit 402 generates a token (token ID), it sends an acknowledgment (token issuance) to the check-in terminal 10. When the token ID generation unit 402 fails to generate the token ID, the token generation unit 402 sends a negative response (not issued a token) to the check-in terminal 10.

When the token ID generation unit 402 succeeds in generating (issuing) the token ID, the token generation unit 402 hands over the generated token ID, boarding pass information, passport information, and face image (face image of the system user) to the database management unit 403.

The database management unit 403 is a means (management unit) for managing various databases built in the server device 20.

The server device 20 includes a token ID information database and a business information database.

The token ID information database stores at least the token ID and the biometric information of the user in association with each other. FIG. 11 is a diagram showing an example of a token ID information database. Referring to FIG. 11, the token ID information database has a field for storing a token ID, a registered face image, a feature amount, a token issuing time, a token issuing device name, and the like.

As mentioned above, the token ID is a temporarily issued identifier. When the user completes the procedure at the boarding gate device 14, the token ID is invalidated. That is, the token ID is not an identifier that is used permanently, but a one-time ID that has a valid period (life cycle).

The registered face image is a face image of the system user. For example, the registered face image may be a user's face image captured by the check-in terminal 10 or a passport face image. The feature quantity is a feature vector generated from the face image. The token issuance time is the time when the server device 20 issues the token ID. The device name is the device name (check-in terminal 10) from which the registered face image was acquired, which triggered the issuance of the token ID.

The business information database is a database that manages information (business information) necessary for performing boarding procedures for users. FIG. 12 is a diagram showing an example of a business information database. Referring to FIG. 12, the business information database has fields for storing a token ID, a passenger name, a departure place, a destination, an airline code, a flight number, an operation date, and the like. In addition to the above fields, the business information database may have fields for storing sheet numbers, nationalities, passport numbers, surnames, first names, dates of birth, gender, and the like. The business information database stores business information required for a predetermined business (procedure business performed at each touch point) for each token ID.

The above information stored in the business information database is acquired from boarding pass information and passport information.

When the database management unit 403 acquires the token ID from the token generation unit 402 (when the token ID is issued), the database management unit 403 adds a new entry to the above two databases. The database management unit 403 sets the set values in the fields of each database. For example, the database management unit 403 generates a feature amount from the registered face image and registers the generated feature amount in the token ID information database. For fields for which setting values cannot be set, the database management unit 403 may set initial values (default values).

The authentication unit 404 is a means for performing biometric authentication. The authentication unit 404 processes the authentication request acquired from the terminal. The authentication unit 404 performs biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of the plurality of users registered in the token ID information database in advance.

Specifically, the authentication unit 404 processes authentication requests from each of the plurality of terminals including the boarding gate device 14 with reference to the token ID information database. The authentication request includes the biometric information of the person to be authenticated. The authentication unit 404 executes a collation process (one-to-N collation) using the biometric information included in the authentication request and the biometric information registered in the token ID information database.

The authentication unit 404 generates a feature amount from a face image acquired from a terminal (baggage deposit machine 11, passenger passage system 12, gate device 13, boarding gate device 14). Since existing techniques can be used for the feature quantity generation process, detailed description thereof will be omitted. For example, the authentication unit 404 extracts eyes, nose, mouth, and the like as feature points from the face image. After that, the authentication unit 404 calculates the position of each feature point and the distance between each feature point as a feature quantity, and generates a feature vector composed of a plurality of feature quantities.

The authentication unit 404 sets the generated feature amount (feature vector) as the feature amount on the collation side and the feature amount stored in the token ID information database as the feature amount on the registration side.

The authentication unit 404 calculates the degree of similarity (score) between the feature amount on the collation side and each of the plurality of feature amounts on the registration side. For the similarity, a chi-square distance, an Euclidean distance, or the like can be used. The farther the distance is, the lower the similarity is, and the closer the distance is, the higher the similarity is.

The authentication unit 404 authenticates if, among a plurality of feature quantities (valid feature quantities) registered in the token ID information database, there is a feature quantity whose similarity with the feature quantity to be collated is equal to or higher than a predetermined value. Judge that it was successful.

If the authentication is successful, the authentication unit 404 identifies the token ID corresponding to the feature amount having the highest degree of similarity. The authentication unit 404 searches the business information database using the specified token ID as a key, and identifies the corresponding entry.

The authentication unit 404 transmits the authentication result to the terminal (responds to the authentication request).

If the authentication is successful, the authentication unit 404 sends an acknowledgment including the entry (token ID, business information) specified from the business information database and the face image of the successful authentication person (face image of the registered side) to the terminal. Send. In this way, the authentication unit 404 transmits the registered biometric information (registered face image) of the successful authentication person who succeeded in biometric authentication and the information about the flight of the successful authentication person to the terminal.

If the authentication fails, the authentication unit 404 sends a negative response indicating the authentication failure to the terminal.

The storage unit 405 stores various information necessary for the operation of the server device 20. A token ID information database and a business information database are constructed in the storage unit 405. The token ID information database is a first database that stores at least biometric information of each of a plurality of users in association with token IDs issued to each of the plurality of users. The business information database is a second database that stores at least the token IDs issued to each of the plurality of users in association with the business information of each of the plurality of users. The business information database stores at least information about flights as business information.

[System operation]
Subsequently, the operation of the boarding procedure system according to the first embodiment will be described. FIG. 13 is a sequence diagram showing an example of the operation of the boarding procedure system according to the first embodiment. The operation when the user authentication process is executed will be described with reference to FIG. The description of the operation related to system registration is omitted.

The terminal (any of the baggage deposit machine 11, the passenger passage system 12, the gate device 13, and the boarding gate device 14) acquires the face image of the user (certified person) and sends an authentication request to the server device 20 (one of them). Step S01).

The server device 20 generates a feature amount from the face image included in the authentication request, and executes an authentication process using the token ID information database (step S02).

If the authentication is successful (step S03, Yes branch), the server device 20 searches the business information database using the token ID obtained by the collation process as a key (step S04).

If the authentication fails (step S03, No branch), the server device 20 executes the processes after step S05.

The server device 20 transmits the authentication result (authentication success, authentication failure) to the terminal (touch point) (step S05). If the authentication is successful, the server device 20 transmits a response including the contents of the entry (token ID, business information) identified in the search in step S04 and the registered face image of the successful authentication person to the terminal.

The terminal displays according to the authentication result acquired from the server device 20 (step S06). Upon receiving the response regarding the successful authentication, the terminal displays, for example, as shown in FIG. That is, the terminal displays the biometric information of the successfully authenticated person and the information related to the flight. Upon receiving the response regarding the authentication failure, the terminal displays, for example, as shown in FIG.

In addition, the terminal executes the boarding procedure of the user according to the authentication result. The description of the operation will be omitted. Each terminal may perform the assigned function.

As described above, when the boarding procedure system according to the first embodiment succeeds in authenticating the authenticated person, the face image registered in advance (the face image registered in the system by the check-in terminal 10) and the flight information ( Information on the destination, airline, etc.) is presented to the user. The user (successful authentication person) can confirm this information, and if the information of another person (face image of another person, flight information of another person) is displayed, it can recognize that the processing of the system is not normal. That is, the server device 20 and the terminal generate information that enables the user to detect erroneous authentication due to the occurrence of acceptance of another person, and present it to the user. As a result, even if an erroneous authentication occurs, the problem, contradiction, etc. caused by the erroneous authentication can be solved by the user informing the staff or the like to that effect.

[Second Embodiment]
Subsequently, the second embodiment will be described in detail with reference to the drawings.

In the first embodiment, the terminal simultaneously displays the registered face image of the authenticated successful person, the personal information of the authenticated successful person, and the flight information. By displaying the above information, even if another person is accepted, the person to be authenticated can detect the occurrence of another person's acceptance because his / her face and flight information are displayed. That is, in the first embodiment, it is entrusted to the user to detect the occurrence of acceptance of another person.

In the second embodiment, a case where an airport, an airline employee, or the like can detect the occurrence of acceptance of another person will be described.

Since the processing configuration of the server device 20 and the terminal according to the second embodiment can be the same as that of the first embodiment, the description thereof will be omitted.

Hereinafter, the differences between the first and second embodiments will be described.

FIG. 14 is a diagram showing an example of a schematic configuration of the boarding procedure system according to the second embodiment. Referring to FIG. 14, the boarding procedure system according to the second embodiment includes the staff terminal 30.

The staff terminal 30 is a terminal used by staff of an airport, an airline company, or the like. The boarding procedure system may include one staff terminal 30 or a plurality of staff terminals 30. When a plurality of staff terminals 30 are included in the system, at least one staff terminal 30 may be installed at each procedure place (for example, an immigration checkpoint). That is, the staff terminal 30 may be installed corresponding to each terminal used for the boarding procedure.

The staff terminal 30 may be a stationary computer as shown in FIG. 14, or may be a portable terminal such as a mobile phone, a smartphone, a tablet, or a laptop computer. The staff terminal 30 may have any form and form as long as it is a terminal used by staff.

The staff terminal 30 may be provided with a display device such as a liquid crystal panel and an operation device such as a touch panel, and may be provided with an information providing function and an information input function. The staff terminal 30 can be realized by a commercially available computer or the like, and the internal processing configuration and the like are obvious to those skilled in the art, and the description thereof will be omitted.

When the server device 20 succeeds in authenticating the authenticated person, the server device 20 transmits the authentication result information to the staff terminal 30. The authentication result information includes the face image of the person to be authenticated (acquired face image) acquired by the terminal and the face image of the person determined to be the same person as the person to be authenticated by biometric authentication (face image registered in the token ID information database; Registered face image) is included.

In response to receiving the authentication result information, the staff terminal 30 displays as shown in FIG. The staff confirms the display of the staff terminal 30. The staff compares the two facial images to determine whether or not the acceptance of another person has occurred. Specifically, when it is determined that the two facial images are the facial images of the same person, it is determined that the acceptance of another person has not occurred. If it is determined that the two facial images are not the same person's facial image, it is determined that acceptance of another person has occurred.

If there is no acceptance of others, the staff will not take any special action. If the acceptance of another person has occurred, the staff will correct or correct the authentication result by the server device 20 by relying on the authentication ID or the like. Specifically, the staff inputs an authentication ID into the server device 20 and identifies two parties involved in accepting others. Based on the name and flight number of the party, the staff will modify the token ID information database, or go to the party to inform them of the occurrence of false authentication and take necessary measures. It should be noted that the response when the acceptance of another person occurs differs depending on the terminal and the passenger situation (before or after boarding the boarding machine) when the acceptance of another person occurs, and it is difficult for the system to perform uniform processing. That is, since it is premised that the staff and the like respond flexibly when the acceptance of another person occurs, a more detailed explanation will be omitted. When the acceptance of another person occurs, the staff may appropriately correct the inconvenience and contradiction caused by the false authentication.

If the biometric authentication is successful, the authentication unit 404 generates an authentication ID that uniquely identifies the result of the biometric authentication. The authentication unit 404 assigns a unique value and generates an authentication ID each time the biometric authentication is successful.

The authentication unit 404 stores the generated authentication ID in association with the information acquired from the authentication unit 404 (see FIG. 16).

After generating the authentication ID, the authentication unit 404 generates the authentication result information. Specifically, the authentication unit 404 generates authentication result information including an authentication ID, a terminal identifier, an acquired face image, and a registered face image. The authentication unit 404 transmits the generated authentication result information to the staff terminal 30.

Alternatively, the authentication unit 404 may generate authentication result information including personal information (name, etc.) and flight information (flight number, etc.) of the successful authentication person. The authentication unit 404 can acquire (read) the personal information and the like of the successful authentication person from the business information database by using the token ID.

When the predetermined condition is satisfied, the authentication unit 404 may transmit the authentication result information to the staff terminal 30. For example, when the similarity between two images (acquired face image and registered face image) at the time of successful authentication is smaller than a predetermined threshold value, the server device 20 may transmit the authentication result information to the staff terminal 30. good. That is, when the similarity between the two images is larger than the first threshold value for determining that the authentication is successful and smaller than the predetermined second threshold value, the server device 20 uses the authentication result information as a staff member. It may be transmitted to the terminal 30.

In this way, the authentication unit 404 may execute the threshold value processing on the calculated similarity and determine whether or not to transmit the authentication result information to the staff terminal 30 according to the result. As a result, when the accuracy (accuracy) of the authentication result is sufficiently high (when the similarity between the images is equal to or higher than the second threshold value), the authentication result information is transmitted from the server device 20 to the staff terminal 30. There is no. In other words, if the biometric authentication is successful but the accuracy is not sufficient, the authentication result information is transmitted to the staff terminal 30.

By confirming the authentication result information sorted (filtered) by the server device 20, the staff can detect the occurrence of acceptance of another person with higher concentration.

Alternatively, the server device 20 has the highest similarity (first similarity) and the next highest similarity (second similarity; first similarity) among the plurality of similarity calculated at the time of authentication processing. > Second similarity) may be used to determine whether or not the authentication result information needs to be transmitted. Specifically, the server device 20 may transmit the authentication result information to the staff terminal 30 when the difference between the first similarity degree and the second similarity degree is smaller than a predetermined threshold value.

The fact that the difference between the first similarity and the second similarity is large indicates that the face of the person determined to be second similar to the subject does not resemble the face of the subject (principal). .. On the other hand, the fact that the difference between the first similarity and the second similarity is small means that the face of the person determined to be second similar to the subject is similar to the face of the subject. show. For example, when the subject to be authenticated is a twin and both facial images are registered, the similarity between the face image of the person (first similarity) and the similarity between the other facial images of the twin (similarity) (similarity). The difference in second similarity) becomes smaller.

The server device 20 may determine whether or not the authentication result information needs to be transmitted based on the difference in the degree of similarity. In this case as well, the authentication unit 404 may execute threshold processing on the difference between the first similarity degree and the second similarity degree, and determine whether or not the authentication result information can be transmitted according to the result.

As described above, in the boarding procedure system according to the second embodiment, when the server device 20 succeeds in authenticating the authenticated person, the server device 20 transmits the authentication result information including the acquired face image and the registered face image to the staff terminal 30. .. The staff terminal 30 provides the staff and the like with information capable of verifying whether or not erroneous authentication due to acceptance of another person has occurred. The staff detects the occurrence of false authentication by comparing the two facial images. In the second embodiment, a staff member who is proficient in business monitors the occurrence of false authentication, so that the occurrence of acceptance of another person is detected more reliably. Also in the second embodiment, problems, contradictions, etc. caused by erroneous authentication are solved.

Next, the hardware of each device constituting the boarding procedure system will be described. FIG. 17 is a diagram showing an example of the hardware configuration of the server device 20.

The server device 20 can be configured by an information processing device (so-called computer), and includes the configuration illustrated in FIG. For example, the server device 20 includes a processor 311, a memory 312, an input / output interface 313, a communication interface 314, and the like. The components such as the processor 311 are connected by an internal bus or the like and are configured to be able to communicate with each other.

However, the configuration shown in FIG. 17 is not intended to limit the hardware configuration of the server device 20. The server device 20 may include hardware (not shown) or may not include an input / output interface 313 if necessary. Further, the number of processors 311 and the like included in the server device 20 is not limited to the example shown in FIG. 17, and for example, a plurality of processors 311 may be included in the server device 20.

The processor 311 is a programmable device such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a DSP (Digital Signal Processor). Alternatively, the processor 311 may be a device such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). Processor 311 executes various programs including an operating system (OS).

The memory 312 is a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like. The memory 312 stores an OS program, an application program, and various data.

The input / output interface 313 is an interface of a display device or an input device (not shown). The display device is, for example, a liquid crystal display or the like. The input device is, for example, a device that accepts user operations such as a keyboard and a mouse.

The communication interface 314 is a circuit, a module, or the like that communicates with another device. For example, the communication interface 314 includes a NIC (Network Interface Card) and the like.

The function of the server device 20 is realized by various processing modules. The processing module is realized, for example, by the processor 311 executing a program stored in the memory 312. The program can also be recorded on a computer-readable storage medium. The storage medium may be a non-transient such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. Further, the above program can be downloaded via a network or updated by using a storage medium in which the program is stored. Further, the processing module may be realized by a semiconductor chip.

The check-in terminal 10, the boarding gate device 14, the staff terminal 30, and the like can also be configured by the information processing device in the same manner as the server device 20, and the basic hardware configuration thereof is not different from that of the server device 20. The explanation is omitted. The check-in terminal 10 or the like may be provided with a camera or the like.

The server device 20 is equipped with a computer, and the function of the server device 20 can be realized by causing the computer to execute a program. Further, the server device 20 executes the control method of the server device by the program.

[Modification example]
The configuration, operation, and the like of the boarding procedure system described in the above embodiment are examples, and are not intended to limit the system configuration and the like.

In the above embodiment, it has been described that the system registration is performed after the user's check-in procedure, but the system registration may be performed before the check-in procedure. In this case, since the boarding pass has not been issued before the check-in procedure, the server device 20 may register the system using the ticket information instead of the boarding pass.

In the above embodiment, a case where system registration (registration for realizing boarding procedure using biometric authentication) is performed by the check-in terminal 10 has been described. However, the system registration may be performed by a device or terminal other than the check-in terminal 10. For example, a device dedicated to system registration may be installed at the airport, or system registration may be performed at a terminal (touch point) such as a baggage deposit machine 11 or a passenger passage system 12.

In the above embodiment, the case where a series of boarding procedures are performed by biometric authentication has been described, but some procedures may be performed by biometric authentication. For example, in FIG. 2, the system may be registered in the baggage deposit machine 11 and the procedures (security inspection, etc.) after the baggage deposit may be performed by biometric authentication. In other words, some of the boarding procedures may be carried out at a manned booth or the like.

In the above embodiment, the case where the server device 20 includes two databases has been described. However, the token ID information database and the business information database built in the server device 20 may be built in a database server different from that of the server device 20. That is, the boarding procedure system may include various means (for example, token generation means) described in the above embodiment.

In the above embodiment, the case where the face image is included in the authentication request has been described, but the feature amount generated from the face image may be included in the authentication request. In this case, the server device 20 may process the authentication request using the feature amount extracted from the authentication request and the feature amount registered in the token ID information database.

In the first embodiment, the case where the server device 20 includes the registered face image in the response of the authentication request has been described. However, the server device 20 may transmit the registered face image to the terminal by a method different from the response of the authentication request. For example, the server device 20 may transmit the authentication result information as described in the second embodiment to the terminal.

The server device 20 according to the first embodiment may include a registered face image or the like in an acknowledgment to an authentication request when a predetermined condition is satisfied. For example, as described in the second embodiment, the server device 20 may include a registered face image or the like in the acknowledgment according to the result of the threshold value processing for the similarity calculated at the time of the authentication processing. In this case, the terminal may output a display as shown in FIG. 3 when receiving an acknowledgment including the registered face image.

Information about the seat of the successful authentication person may also be displayed in the display for providing the authentication result to the successful authentication person. For example, the seat number of a successful certified person, the seat class (first class, business class, economy class), etc. may be displayed together with the registered face image. The authenticated person can detect the occurrence of acceptance of another person based on this information.

The terminal may generate a GUI including a button or the like for acquiring that the successful authentication person has visually recognized the display when performing the display as shown in FIG. 3 (see FIG. 18). That is, the terminal may use the GUI to acquire whether or not the successful authentication person has confirmed that the acceptance of another person has not occurred based on the displayed biometric information and the information related to the flight. The terminal may proceed with the procedure of the successful authentication person in response to the fact that the successful authentication person presses the OK button. Alternatively, the terminal may control the gate or the like so that a successful authentication person can pass through in response to the pressing of the OK button. Alternatively, the terminal may acquire that the successful authentication person has visually recognized (confirmed) the displayed content by non-contact input such as voice or gesture.

In the second embodiment, the staff terminal 30 and the terminal may operate in cooperation with each other. For example, the staff terminal 30 may control the gate provided in the terminal. For example, the staff terminal 30 displays a GUI as shown in FIG. By comparing the two facial images, the staff presses the procedure interruption button when it is determined that the acceptance of another person has occurred. In response to the pressing of the button, the staff terminal 30 gives an instruction to suspend the procedure to the terminal for which biometric authentication has been performed (boarding gate device 14 in the example of FIG. 19). The terminal (terminal function realization unit 305) that receives the instruction suspends the procedure of the successful authentication person. For example, the terminal controls the successful authentication person from passing through the gate. The staff will go to the terminal where the procedure was interrupted and take necessary measures.

In this way, the staff terminal 30 acquires by GUI whether or not the staff has determined that acceptance of another person has occurred based on the biometric information acquired from the terminal and the registered biometric information of the successful authentication person. Further, the staff terminal 30 may instruct the terminal to suspend the procedure when it is determined by the staff that acceptance of another person has occurred. That is, the staff terminal 30 may control the terminal according to the operation of the staff (determination result of acceptance of another person by the staff or the like).

The server device 20 (authentication unit 404) may include an "alarm flag" in the acknowledgment including the registered face image and the authentication result information when a predetermined condition is satisfied. The alarm flag is information for notifying the terminal or the staff terminal 30 that the above-mentioned predetermined condition is satisfied. The alert flag is set when requesting successful authentication personnel and staff to carefully consider the authentication results. For example, the server device 20 sets the alarm flag according to the result of the threshold value processing for the similarity described in the second embodiment. More specifically, if the authentication is successful but the accuracy is assumed to be low, the server device 20 sets the alarm flag.

The terminal or the staff terminal 30 may change the display mode provided to the successful authentication person or the staff depending on whether or not the alarm flag is set. For example, the terminal may change the mode of the display (for example, the display shown in FIG. 3) including the biometric information of the successfully authenticated person and the information regarding the flight, depending on whether or not a predetermined condition is satisfied.

For example, if the alarm flag is set, the terminal or the staff terminal 30 may display (highlight) a lot of colors that attract more attention than when the flag is not set, or the screen may be displayed. It may be made to blink in whole or in part. Alternatively, the terminal or the like may be urged to carefully check the registered face image by using voice.

In the above description, the case where the authentication result information is transmitted to the staff terminal 30 when a predetermined condition is satisfied has been described. The predetermined condition described above is an example, and the necessity of transmitting the authentication result information may be determined by other conditions. For example, it may be determined whether or not the authentication result information needs to be transmitted based on the seat class (seat class; highest-class seats, senior guest rooms, ordinary seats) and travel history of the successfully authenticated person. For example, when the seat class of the successful authentication person is the first class, the authentication result information may be transmitted to the staff terminal 30. In this case, staff can carefully monitor the occurrence of false positives for first class passengers (passengers that airlines want to avoid trouble).

Alternatively, the server device 20 may transmit an acknowledgment including authentication result information and a registered face image based on an index different from the similarity between face images based on the feature amount generated from the face image. The occurrence of false authentication (acceptance of others) in biometric authentication is due to the fact that the "faces" of the collation side and the registration side are similar. More precisely, if the positions of the eyes and nose and the distances between these feature points are the same, erroneous authentication (acceptance of others) may occur even on the faces of others. Here, in the boarding procedure system at the airport, the registered face image is input to the server device 20 at the time of check-in, and then the terminal (boarding gate device 14 or the like) requests the server device 20 for biometric authentication in a relatively short time. become. It is unlikely that the hairstyle, whether or not the person wearing glasses, clothes, etc. will change in such a short period of time. The server device 20 may determine whether or not the authentication result information can be transmitted by utilizing the characteristics and characteristics of biometric authentication at such an airport.

More specifically, the server device 20 (authentication unit 404) calculates the similarity between the two images by a method different from the method using the feature amount. For example, the server device 20 sets a low value for the degree of similarity if the hairstyles of the people appearing in the two facial images are different. Alternatively, the server device 20 sets a value with a low degree of similarity if the spectacles are shown in one face image and the spectacles are not shown in the other face image. Alternatively, the server device 20 sets a low value for the degree of similarity if the clothes of the persons appearing in the two facial images are different. The server device 20 may transmit the authentication result information to the staff terminal 30 when the similarity calculated by the above method is lower than a predetermined threshold value. That is, the server device 20 may determine whether or not the authentication result information needs to be transmitted based on the similarity between the images calculated by a method different from the similarity based on the feature amount. Similarly, the server device 20 may transmit an acknowledgment including a registered face image to the terminal based on the similarity between images calculated by a method different from the similarity based on the feature amount.

Regarding the determination of the similarity of hairstyles, the server device 20 may compare the area of the upper part of the face or may use the shape of the area. Further, the server device 20 may determine whether or not to wear eyeglasses by using a method such as template matching. Regarding the determination of clothing identity, the server device 20 may use the frequency analysis result in a region other than the face region. The server device may determine the identity of the clothes depending on whether or not the pattern and texture of the area other than the face area are different.

In the second embodiment, the case where the authentication result information is transmitted to the staff terminal 30 has been described, but the information may be transmitted to the terminal. The terminal may display using the registered face image included in the response to the authentication request and display using the registered face image included in the authentication result information on different display devices. For example, the former display may be performed on the main display that can be visually recognized by the person to be authenticated, and the latter display may be performed on the sub-display that can be visually recognized by the staff (the staff waiting in the vicinity of the terminal).

In the above embodiment, the case where the staff detects the occurrence of acceptance of another person by using the staff terminal 30 has been described. However, the occurrence detection of the acceptance of others may be performed using a learning model generated by machine learning. Specifically, the system administrator or the like collects a large number of data (acquired face image, registered face image) at the time of acceptance of another person. The system administrator or the like attaches a label related to the authentication failure to the collected data and generates teacher data. The system administrator or the like inputs the teacher data into the learner and generates a learning model (classification model). Implement the above learning model on a computer. The computer inputs two facial images acquired from the server device 20 into the learning model, and outputs a determination result (acceptance of others, non-occurrence). The staff and the like may take necessary actions according to the result determined by the computer. Any algorithm such as a support vector machine, boosting, or a neural network can be used to generate the learning model. Since known techniques can be used for algorithms such as the support vector machine, the description thereof will be omitted.

In the above embodiment, the face image and the feature amount generated from the face image are treated as "biological information", and the operation of the system and the like are explained. However, other information may be used as "biological information" instead of the face image or the like. For example, when voiceprint authentication is used, pre-registered voiceprint information (voice data) may be reproduced and flight information or the like may be displayed.

Further, when biometric information other than the facial image is used, the biometric information on the registration side may not be displayed. For example, personal information (name), flight information (destination, etc.) of the person to be authenticated may be displayed on the terminal. If this information is different from its own information, the user can detect false authentication.

The server device 20 may notify the terminal or the staff terminal 30 of the similarity used in the authentication process (similarity of the successful authentication person). The staff terminal 30 or the like may provide the similarity to the staff or the like. The staff can take measures such as checking the two facial images more carefully according to the presented similarity.

The form of data transmission / reception between the check-in terminal 10 and the like and the server device 20 is not particularly limited, but the data transmitted / received between these devices may be encrypted. Boarding pass information and passport information include personal information, and it is desirable that encrypted data be sent and received in order to properly protect the personal information.

In the flow chart (flow chart, sequence diagram) used in the above description, a plurality of steps (processes) are described in order, but the execution order of the steps executed in the embodiment is not limited to the order of description. In the embodiment, the order of the illustrated processes can be changed within a range that does not hinder the contents, for example, each process is executed in parallel.

The above embodiments have been described in detail to facilitate understanding of the present disclosure and are not intended to require all of the configurations described above. Moreover, when a plurality of embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace a part of the configuration of the embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of the embodiment. Further, it is possible to add, delete, or replace a part of the configuration of the embodiment with another configuration.

Although the industrial applicability of the present invention is clear from the above description, the present invention is suitably applicable to a boarding procedure system at an airport or the like. However, the application of the disclosure of the present application is not limited to the procedures at the airport, and the disclosure of the present application can be applied to a system requiring a plurality of procedures. For example, the disclosure of the present application can be applied to the entrance / exit control of an event venue or the like. For example, the server device 20 may analyze the authentication history at the event venue and notify the event organizer or the like of the result that erroneous authentication is strongly suspected.

Some or all of the above embodiments may also be described, but not limited to:
[Appendix 1]
The acquisition unit that acquires the biometric information of the person to be authenticated from the terminal,
An authentication unit that performs biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of a plurality of pre-registered users.
Equipped with
The authentication unit uses the authentication result information including the biometric information acquired from the terminal and the registered biometric information of the successful authentication person who succeeded in the biometric authentication when the predetermined conditions are satisfied. A server device that sends to a terminal.
[Appendix 2]
The authentication unit calculates the degree of similarity between the biometric information of the person to be authenticated and the biometric information of each of the plurality of pre-registered users.
In Appendix 1, the authentication result information is transmitted to the staff terminal when the similarity having the largest value among the plurality of calculated similarities is larger than the first threshold value and smaller than the second threshold value. The server device described.
[Appendix 3]
The authentication unit calculates the degree of similarity between the biometric information of the person to be authenticated and the biometric information of each of the plurality of pre-registered users.
The difference between the first similarity with the largest value and the second similarity with the second largest value among the plurality of calculated similarities is calculated.
The server device according to Appendix 1, which transmits the authentication result information to the staff terminal when the calculated difference is smaller than a predetermined threshold value.
[Appendix 4]
The server device according to Appendix 1, wherein the authentication unit determines whether or not to transmit the authentication result information to the staff terminal based on the seat grade of the successful authentication person.
[Appendix 5]
The server device according to Appendix 4, wherein the authentication unit transmits the authentication result information to the staff terminal when the seat class of the successful authentication person is the highest-class seat.
[Appendix 6]
The server device according to any one of Supplementary note 1 to 5, further comprising a database for storing biometric information of each of the plurality of users.
[Appendix 7]
The server device according to any one of Supplementary note 1 to 6, wherein the biological information is a face image or a feature amount extracted from the face image.
[Appendix 8]
The server device according to any one of Supplementary note 1 to 7, wherein the authentication unit transmits the authentication result information to the terminal in place of the staff terminal.
[Appendix 9]
With the terminal
The staff terminal used by the staff and
The server device connected to the terminal and the staff terminal,
Including
The server device is
The acquisition unit that acquires the biometric information of the person to be authenticated from the terminal,
An authentication unit that performs biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of a plurality of pre-registered users.
Equipped with
When a predetermined condition is satisfied, the authentication unit transmits authentication result information including biometric information acquired from the terminal and registered biometric information of a successful authentication person to the staff terminal. ,system.
[Appendix 10]
The system according to Appendix 9, wherein the staff terminal displays biometric information acquired from the terminal and registered biometric information of the successful authentication person.
[Appendix 11]
The staff terminal is
The system according to Appendix 10, wherein the staff member acquires whether or not it is determined that acceptance of another person has occurred based on the biometric information acquired from the terminal and the biometric information registered by the successful authentication person.
[Appendix 12]
The staff terminal is
The system according to Appendix 11, which instructs the terminal to suspend the procedure when it is determined that acceptance of another person has occurred.
[Appendix 13]
In the server device
Obtain the biometric information of the person to be authenticated from the terminal and
Biometric authentication is performed using the biometric information of the person to be authenticated and the biometric information of each of the plurality of users registered in advance.
When a predetermined condition is satisfied, the authentication result information including the biometric information acquired from the terminal and the registered biometric information of the authentication successful person who succeeded in the biometric authentication is transmitted to the staff terminal used by the staff. How to control the server device.
[Appendix 14]
For the computer installed in the server device,
The process of acquiring the biometric information of the person to be authenticated from the terminal,
The process of performing biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of the plurality of users registered in advance,
A process of transmitting authentication result information including biometric information acquired from the terminal and registered biometric information of a successful authentication person to the staff terminal used by the staff when a predetermined condition is satisfied. When,
A computer-readable storage medium that stores programs for executing.

The disclosures of the above-mentioned prior art documents cited shall be incorporated into this document by citation. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be appreciated by those skilled in the art that these embodiments are merely exemplary and that various modifications are possible without departing from the scope and spirit of the invention. That is, it goes without saying that the present invention includes all disclosure including claims, various modifications and modifications that can be made by those skilled in the art in accordance with the technical idea.

10 Check-in terminal 11 Baggage deposit machine 12 Passenger passage system 13 Gate device 14 Boarding gate device 20, 100 Server device 30 Staff terminal 101 Acquisition unit 102 Authentication unit 102 Authentication unit 201, 301, 401 Communication control unit 202 System registration unit 203 Token issuance request unit 204, 304 Message output unit 205 Check-in execution unit 206, 306, 405 Storage unit 211 Boarding pass information acquisition unit 212 Passenger information acquisition unit 213, 302 Biometric information acquisition unit 303 Authentication request unit 311 Processor 312 Memory 313 Input / output interface 314 Communication Interface 402 Token generator 403 Database management 404 Authentication

Claims (14)

The acquisition unit that acquires the biometric information of the person to be authenticated from the terminal,
An authentication unit that controls biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of a plurality of pre-registered users.
Equipped with
The authentication unit includes biometric information acquired from the terminal when the biometric authentication is successful and a predetermined condition is satisfied, and registered biometric information corresponding to the authentication successful person who succeeds in the biometric authentication. Send the authentication result information including, to the staff terminal used by the staff,
Server device. The authentication result information includes personal information corresponding to the successful authentication person.
The server device according to claim 1. The certification result information corresponds to the certified successful person and includes information on a flight including at least one of information on an airline, information on an arrival airport, information on a flight number of a boarding aircraft and information on a departure time.
The server device according to claim 1 or 2. The predetermined condition is a condition regarding the degree of similarity between the biometric information of the authenticated person and the biometric information of each of the plurality of users registered in advance.
The authentication unit transmits the authentication result information to the staff terminal when the predetermined condition is satisfied.
The server device according to any one of claims 1 to 3. The predetermined condition is a condition relating to the seat grade corresponding to the certified successful person.
The authentication unit transmits the authentication result information to the staff terminal when the predetermined condition is satisfied.
The server device according to any one of claims 1 to 3. The authentication unit transmits the authentication result information to the staff terminal when the condition that the seat class corresponding to the successful authentication person is the highest-class seat is satisfied.
The server device according to claim 5. Further equipped with a database for storing biometric information of each of the plurality of users.
The server device according to any one of claims 1 to 6. The authentication unit transmits the authentication result information to the terminal instead of the staff terminal.
The server device according to any one of claims 1 to 7. With the terminal
The staff terminal used by the staff and
The server device connected to the terminal and the staff terminal,
Including
The server device is
The acquisition unit that acquires the biometric information of the person to be authenticated from the terminal,
An authentication unit that controls biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of a plurality of pre-registered users.
Equipped with
The authentication unit includes biometric information acquired from the terminal when the biometric authentication is successful and a predetermined condition is satisfied, and registered biometric information corresponding to the authentication successful person who succeeds in the biometric authentication. Send the authentication result information including
system. The staff terminal is
Information including biometric information acquired from the terminal and registered biometric information corresponding to the successful authentication person is displayed.
The system according to claim 9. The staff terminal is
Based on the biometric information acquired from the terminal and the registered biometric information corresponding to the successful authentication person, information on whether or not the staff has determined that acceptance of another person has occurred is acquired.
The system according to claim 10. The staff terminal is
When the staff determines that acceptance of another person has occurred, the terminal is instructed to suspend the procedure.
The system according to claim 11. Depending on the server device
Obtain the biometric information of the person to be authenticated from the terminal and
By controlling biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of the plurality of users registered in advance,
Authentication result information including the biometric information acquired from the terminal and the registered biometric information corresponding to the successful authentication person who succeeded in the biometric authentication when the biometric authentication is successful and a predetermined condition is satisfied. To the staff terminal used by the staff,
How to control the server device. For the computer installed in the server device,
The process of acquiring the biometric information of the person to be authenticated from the terminal,
A process for controlling biometric authentication using the biometric information of the person to be authenticated and the biometric information of each of a plurality of pre-registered users.
Authentication result information including the biometric information acquired from the terminal and the registered biometric information corresponding to the successful authentication person who succeeded in the biometric authentication when the biometric authentication is successful and a predetermined condition is satisfied. To the staff terminal used by the staff, and
A computer program to run.

Images