JP2019159801A - Authentication apparatus, station system, authentication method, and authentication program - Google Patents

Abstract

To provide a technology for confirming the use of a user.SOLUTION: The authentication device 2 includes: an imaging image acquisition unit 212 for acquiring a captured image taken by a user; a face detection unit 233 for detecting whether the face of the user is imaged from the captured image; a biometric information acquisition unit 211 for acquiring biological information other than the face of the user; a biometric authentication unit 231 for verifying whether or not the user is a registered person on the basis of a result of collation between the biometric information acquired by the biometric information acquiring unit 211 and registered data stored in the data storage unit 22; and a settlement unit 234 which prohibits settlement when the face detection unit 233 does not detect that the face of the user is captured in the captured image even if the user is authenticated to be a registrant.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a biometric authentication technique for authenticating a user with biometric information.

  Conventionally, there is a fingerprint verification ticket gate system that authenticates an individual with biometric information such as a fingerprint (for example, Patent Document 1). In the fingerprint verification ticket gate system described in Patent Document 1, when a user tries to pass the fingerprint verification ticket gate, the user's finger is placed on the fingerprint detection unit of the fingerprint verification ticket gate. The fingerprint detector reads a fingerprint image from the user's finger, extracts fingerprint feature data by image processing, and sends it to the server. The server collates the fingerprint feature data with the fingerprint feature data stored in the passenger database. If there is matching registered fingerprint feature data, the server determines that the server is a user who can get on and off at its own station, and sends an open signal of the switch to the fingerprint verification ticket gate.

JP 2001-307144 A

  However, in the ticket gate system, it is assumed that the user proposes that the payment of the fare for the section where the user uses the railroad is based on the biometric information, that the payment is erroneous regarding the payment. That is, when a user offers that an unrecognized payment has been made, it is difficult to prove whether or not the user has actually used the railway in the payment. In such a case, if the authentication device can confirm the details of the payment for this user, the railway company proves that the user who offered the payment as an incorrect payment used the railway as described in the payment details. can do. That is, there is a demand for an authentication device that can confirm that the user has used the payment contents so that the payment contents for the user can be proved.

  An object of the present invention is to provide a technology that can confirm the use of a user regarding the use of a railway, a store, and the like.

  In order to achieve the above object, the user management apparatus according to the present invention is configured as follows.

  The authentication apparatus includes a captured image acquisition unit that acquires a captured image obtained by capturing a user, a face detection unit that detects whether the user's face is captured from the captured image, and other than the user's face The biometric information acquisition unit for acquiring the biometric information and the biometric information acquired by the biometric information acquisition unit based on the collation result that is collated with the registration data stored in the data storage unit, the user is a registrant. A biometric authentication unit that authenticates whether or not the user is authenticated by the biometric authentication unit, and the face detection unit captures the user's face in the captured image. A payment unit that prohibits payment if it is not detected.

  In this configuration, if it is detected that the face of the user authenticated by biometric authentication is captured in the captured image, the user is settled. That is, the authentication device can confirm the user's use of the railway as a settlement target on the captured image. In this configuration, payment is prohibited unless it is detected that the face of the user authenticated by biometric authentication is captured in the captured image. Accordingly, in this configuration, the authentication apparatus can confirm the user by using the captured image in which it is detected that the user's face is captured.

  Further, in this authentication apparatus, when the biometric authentication unit authenticates that the user is not the registrant by the biometric information acquired from the user's face detected by the face detection unit, the user's face It is preferable not to authenticate the biometric information acquired from other sources.

  If comprised in this way, if it is not detected that the user's face is imaged, it cannot authenticate that a user is a registrant by face authentication, Therefore Efficiency of an authentication process can be achieved.

  Further, in this authentication apparatus, when the face detection unit detects that the user's face is captured in the captured image, the location and date / time when the captured image is captured are associated with the captured image. It is preferable to further include a history database that stores history data.

  If comprised in this way, in this authentication apparatus, a user's log | history can be left and it can confirm that a user used the railway even after payment is performed.

  The station service system according to the present invention is configured as follows in order to achieve the above object.

  This station service system is connected to the authentication device so as to be communicable with the authentication device, and inputs the biometric information acquired from the face and the biometric information acquired from other than the user's face to the authentication device. And an automatic ticket gate that performs ticket gate processing of the ticket gate passage by the authentication device, and the captured image that is connected to the authentication device and the automatic ticket gate so as to be communicable and detects that the face of the user has been imaged. A user management device that manages the user data including data corresponding to the captured image.

  In this configuration, the authentication device determines whether to make a payment to the user or prohibits the automatic ticket checker, and the automatic ticket checker performs ticket check processing based on this determination. The user management device manages user data indicating that the user has used the railway. Thereby, in this structure, in the station service system, the user using the railway can be confirmed by using the captured image in which it is detected that the user's face is captured.

  According to this invention, it is possible to confirm the use of the user regarding the use of the railway, the store, and the like.

It is the schematic which shows the structure of a station service system. It is a block block diagram which shows the structure of the principal part of an automatic ticket gate. It is an external view of the unit for participation of an automatic ticket gate. It is a block diagram which shows the structure of the principal part of a station server. FIG. 5A is an explanatory diagram illustrating an example of the relationship between the degree of similarity and the determination level for each type of biological information, and FIG. 5B illustrates the relationship between the degree of similarity and the determination level for each type of biological information. It is explanatory drawing which shows another example. It is a block diagram which shows the structure of the principal part of a user management apparatus. It is explanatory drawing which shows an example of the user data memorize | stored in the user database. It is a flowchart which shows an example of operation | movement of a station server. It is a flowchart which shows an example of operation | movement of the biometrics authentication process of a station server. It is a flowchart which shows an example of the operation | movement of the payment determination process of a station server.

  Hereinafter, an example of a station service system 1 which is one embodiment of the present invention will be described with reference to the drawings.

<1. Application example>
FIG. 1 is a schematic diagram showing a configuration of a station service system 1 according to this example. As shown in FIG. 1, the station service system 1 includes a station server 2, an automatic ticket gate 3, and a user management device 4. The user management apparatus 4 is installed in the center of the railway company A, for example. One to a plurality of automatic ticket gates 3 (three in FIG. 1) are installed at each of the stations A1, A2, and A3. The station server 2 is installed in each station A1, A2, A3. The station server 2 corresponds to the authentication device in the present invention.

  For example, the station server 2 of the station A1 is installed at the station A1, and is connected to three automatic ticket gates 3 installed at the station A1 by wire or wirelessly. The plurality of automatic ticket gates 3 at the station A1 are installed at the ticket gate of the station A1. The automatic ticket gate 3 at the station A2 and the automatic ticket gate 3 at the station A3 have the same configuration as the automatic ticket gate 3 at the station A1, and are installed at the ticket gates of the stations A2 and A3.

  The user management device 4 according to this example is communicably connected to the station server 2 installed in each station A1, A2, A3 via the network 5. The user management device 4 manages or controls the station server 2 via the network 5, for example.

  The station service system 1 according to this example performs biometric authentication using three types of biometric information. The station server 2 according to this example acquires each type of biological information of the user from the automatic ticket gate 3. In the station service system 1 according to this example, a user is authenticated using face authentication based on biometric information acquired from a face, fingerprint authentication based on biometric information acquired from a fingerprint, and vein pattern authentication based on biometric information acquired from a vein pattern. Authenticate whether is a registrant. The biometric information of the fingerprint and the biometric information of the vein pattern in this example are examples of biometric information acquired from other than the user's face of the present invention.

  Further, the station service system 1 makes a payment to a user who uses the railway. When the user is authenticated as a registrant by biometric authentication, the station service system 1 performs payment for the user. In the station service system 1, the user pays a fare related to the use of the railway by a prepaid method or a postpay method. In the station service system 1, when the user enters the stations A1, A2, and A3 and enters the stations A1, A2, and A3, the user is imaged by the camera 32 of the automatic ticket gate 3. If the station service system 1 detects that the face of the user is captured in the captured image of the user, the station service system 1 makes a payment to the user.

  For example, when the user enters the stations A1, A2, and A3, the user's face is captured in the captured image captured by the camera 32 while the user is authenticated as a registrant by biometric authentication. When this is detected, the station server 2 makes a settlement such as a minimum fare (initial fare) to the user. Further, for example, when the user enters from the stations A1, A2, and A3, the user's face is captured in the captured image captured by the camera 32 while the user is authenticated by biometric authentication. If it is detected, the station server 2 makes a settlement for the fare of the used railway to this user.

  The registrant referred to here is a person who has registered biometric information with respect to the railway company A.

<2. Configuration example>
FIG. 2 is a block diagram showing the configuration of the main part of the automatic ticket gate 3 according to this example. FIG. 3 is an external view of the entry unit 30 of the automatic ticket gate 3. As shown in FIG. 2, the automatic ticket gate 3 includes a control unit 31, a camera 32, a scanner 33, a position detection unit 34, a communication unit 35, a display unit 36, and a door opening / closing unit 37. Yes.

  The automatic ticket gate 3 includes an entrance unit (not shown) facing each other across the ticket gate and an exit unit 30 shown in FIG. The automatic ticket gate 3 places the entry unit 30 and the entry unit facing each other, and restricts the passage of users in the ticket gate passage formed between the two units (permitted / prohibited). The participation unit 30 performs a ticket gate process for users who participate from the station premises. The admission unit performs a ticket gate process for users who enter the station. Here, the automatic ticket gate 3 in which the entry unit 30 and the entry unit face each other will be described as an example.

  The control unit 31 controls operations of the camera 32, the scanner 33, the position detection unit 34, the communication unit 35, the display unit 36, and the door opening / closing unit 37.

  The camera 32 images the user. The camera 32 is installed at an angle at which the user's face can be captured from the captured image. As shown in FIG. 3, the camera 32 is provided above the entry unit 30 and the entrance unit and in the vicinity of the middle of the ticket gate passage. The camera 32 of the participation unit 30 is provided so that the imaging direction faces the user who wants to enter from the station (the inside of the station). Further, the camera 32 of the entrance unit is provided so that the imaging direction faces the user who wants to enter the station (outside the station).

  The scanner 33 images the user's fingerprint and finger vein pattern. The scanner 33 is provided above the entry unit 30 and the entry unit. The scanner 33 of the participation unit 30 is provided on the inner side of the station in order to capture the fingerprint and vein pattern of the user who wants to enter from the station. The entrance unit scanner 33 is provided outside the station to capture the fingerprint and vein pattern of the user who intends to enter the station. The scanner 33 images, for example, a fingerprint and a finger vein pattern from a user's finger placed in a reading area 331 provided on the upper side of the participation unit 30.

  The position detection unit 34 detects the position of the user passing through the ticket gate passage by using a plurality of sensors (not shown) arranged along the ticket gate passage. For example, the position detection unit 34 is disposed in the entry unit 30 at a position facing each of the plurality of light emitting elements arranged along the ticket gate passage and the plurality of light emitting elements across the ticket gate passage between the entrance unit. And a plurality of light receiving elements (not shown). If there is a light receiving element that does not receive the light emitted from the light emitting element, the position detecting unit 34 determines that the user exists at a position corresponding to the light receiving element.

  The communication unit 35 transmits / receives various data to / from the station server 2. The communication unit 35 transmits the captured image captured by the camera 32, the fingerprint image captured by the scanner 33, and the vein pattern image to the station server 2 as biometric information. Further, the communication unit 35 receives, for example, a determination result of whether or not the user is allowed to pass (passage permission / passage prohibition) from the station server 2.

  The display unit 36 displays a message to the user who is traveling through the ticket gate passage. The display unit 36 includes a liquid crystal panel 361, for example. The display unit 36 is disposed in each of the entrance unit and the exit unit 30. The liquid crystal panel 361 of the entry unit 30 is provided on the exit side of the ticket gate passage (outside the station building) for users who want to enter from the station building. Further, the liquid crystal panel 361 of the entrance unit is provided on the exit side (inside the station building) for the user who intends to enter the station building.

  For example, when the user is permitted to pass, a message notifying that the user can pass is displayed on the liquid crystal panel 361 provided in the entrance unit or the exit unit 30. In addition, on the liquid crystal panel 361 provided in the entrance unit or the exit unit 30, for example, when the user is not permitted to pass, a message notifying that the user cannot pass is displayed. .

  The door opening / closing unit 37 opens and closes the door 371 based on the determination result of passage permission received from the station server 2. Two doors 371 are provided in each of the entrance unit and the exit unit 30. The door opening / closing unit 37 opens the door 371 in order to allow the user to pass when the station server 2 performs payment for the user and the communication unit 35 receives the determination result indicating the user's passing permission. To do. Further, for example, when the settlement by the station server 2 is prohibited and the communication unit 35 receives a determination result for prohibiting the passage of the user, the door opening / closing unit 37 closes the door 371 because the passage of the user is not permitted. .

  FIG. 4 is a configuration diagram illustrating a configuration of a main part of the station server 2. As illustrated in FIG. 4, the station server 2 includes a terminal communication unit 21, a registration database 22, a control unit 23, a history database 24, and a network communication unit 25. Here, the station server 2 of the station A1 will be described as an example, but the station servers 2 of the station A2 and the station A3 have the same configuration as the station server 2 of the station A1.

  The terminal communication unit 21 is communicably connected to the three automatic ticket gates 3 installed at the station A1. The terminal communication unit 21 includes a biological information acquisition unit 211, a captured image acquisition unit 212, and an output unit 213.

  In the following description, the station server 2 authenticates whether the user is a registrant using three types of biological information. Note that the three types of biometric information indicate biometric information of a face (captured image), biometric information of a fingerprint (fingerprint image), and biometric information of a vein pattern (vein pattern image).

  The biometric information acquisition unit 211 acquires a fingerprint image and a vein pattern image captured by the scanner 33 of the automatic ticket checker 3.

  The captured image acquisition unit 212 acquires a captured image captured by the camera 32 of the automatic ticket gate 3.

  The output unit 213 transmits the pass / fail determination result to the automatic ticket gate 3.

  Registration data based on the biometric information of the registrant is registered in the registration database 22. More specifically, registration data in which the features of the biometric information of the registrant are extracted is registered in the registration database 22. In the registration database 22, registration data for face authentication obtained by extracting the facial features of the registrant is registered. Also, in the registration database 22, registration data for fingerprint authentication obtained by extracting the characteristics of the registrant's fingerprint is registered. In the registration database 22, registration data for vein pattern authentication obtained by extracting features of vein patterns is registered. In this example, registration data for the face authentication, registration data for fingerprint authentication, and registration data for vein pattern authentication of the registrant who uses the automatic ticket gate 3 are already registered in the registration database 22. The registration database 22 in this example corresponds to the data storage unit of the present invention.

  The control unit 23 controls the operation of the station server 2. The control unit 23 includes a face detection unit 233, a biometric authentication unit 231, a determination level storage unit 232, a settlement unit 234, and a history data generation unit 235.

  The determination level storage unit 232 stores determination levels 1A, 1B, and 1C for each type of biological information. The determination level 1A here is a determination level used for face authentication. Further, the determination level 1B here is a determination level used for fingerprint authentication. Furthermore, the determination level 1 </ b> C here is a determination level used for vein pattern authentication.

  The biometric authentication unit 231 generates collation data for fingerprint authentication in which the biometric information of the fingerprint acquired by the biometric information acquisition unit 211 is extracted. The biometric authentication unit 231 generates verification data for vein pattern authentication in which the biometric information of the vein pattern acquired by the biometric information acquisition unit 211 is extracted. In addition, the biometric authentication unit 231 generates collation data for face authentication in which facial features are extracted from the captured image acquired by the captured image acquisition unit 212.

  For each type of biometric information, the biometric authentication unit 231 compares the verification data with the registration data of all registrants registered in the registration database 22 and calculates the similarity. The biometric authentication unit 231 detects the highest similarity among the similarities calculated for each type of biometric information. The biometric authentication unit 231 selects the highest similarity among the highest similarities detected for each type of biometric information. The biometric authentication unit 231 acquires the similarities N1, N2, and N3 of each type of biometric information of the registrant corresponding to the selected similarity.

  Here, the similarity N1 refers to a similarity for face authentication. Further, the similarity N2 here refers to a similarity for fingerprint authentication. Furthermore, the similarity N3 here refers to the similarity for vein pattern authentication.

  For example, even if the registrant corresponding to the highest similarity is different for each type of biometric information, the biometric authentication unit 231 has the highest similarity among the highest similarities detected for each type of biometric information. The degree of similarity N1, N2, N3 of the registrant corresponding to the degree is acquired.

  The biometric authentication unit 231 compares the similarity levels N1, N2, and N3 with the corresponding determination levels 1A, 1B, and 1C for each type of biometric information. More specifically, the biometric authentication unit 231 determines whether the similarities N1, N2, and N3 are equal to or higher than the corresponding determination levels 1A, 1B, and 1C.

  The biometric authentication unit 231 compares the similarity N1 for face matching with the determination level 1A. More specifically, the biometric authentication unit 231 determines whether the similarity N1 for face matching is equal to or higher than the determination level 1A. The biometric authentication unit 231 compares the similarity N2 for fingerprint authentication with the determination level 1B. More specifically, the biometric authentication unit 231 determines whether the similarity N2 for fingerprint authentication is equal to or higher than the determination level 1B. Furthermore, the biometric authentication unit 231 compares the similarity N3 for vein pattern matching with the determination level 1C. More specifically, the biometric authentication unit 231 determines whether the similarity N3 for vein pattern matching is equal to or higher than the determination level 1C.

  FIG. 5A is an explanatory diagram illustrating an example of the relationship between the similarities N1, N2, and N3 and the determination levels 1A, 1B, and 1C for each type of biological information. FIG. 5B is an explanatory diagram illustrating another example of the relationship between the similarities N1, N2, and N3 and the determination levels 1A, 1B, and 1C for each type of biological information. As shown in FIG. 5A, the biometric authentication unit 231 determines that the user is a registrant if all the similarities N1, N2, and N3 are the corresponding determination levels 1A, 1B, and 1C. . That is, the biometric authentication unit 231 authenticates that the user is a registrant.

  Further, as shown in FIG. 5B, when the biometric authentication unit 231 has a similarity level N1 of at least one of the three types of biometric information lower than the corresponding determination level 1A, the user It is determined that the user is not a registered person. That is, the biometric authentication unit 231 authenticates that the user is not a registrant.

  The face detection unit 233 detects whether the user's face is captured in the captured image.

  The history data generation unit 235 adds the user ID number, the location (station) where the captured image was captured, and the captured image to the captured image in which the face detection unit 233 detects that the user's face is captured. History data associating the imaged date and time with the entry / exit status is generated.

  The entry / exit status is 1 when the user enters the station, and 0 when the user enters from the station. The history data generation unit 235 inputs history data to the history database 24.

  The settlement unit 234 performs user settlement. More specifically, when the user passes through the ticket gate, the biometric authentication unit 231 authenticates that the user is a registrant, and the face detection unit 233 captures the user's face from the captured image. When this is detected, the user is settled.

  Further, even when the biometric authentication unit 231 authenticates the user as a registrant, if the user's face is not detected by the face detection unit 233 in the captured image, the settlement unit 234 Prohibits settlement for this user.

  When the biometric authentication unit 231 authenticates that the user is not a registrant, even if the face of the user is detected by the face detection unit 233 in the captured image, the settlement unit 234 Prohibit payment.

  The network communication unit 25 is connected to the user management apparatus 4 or another station server 2 via the network 5. For example, the network communication unit 25 transmits the history data stored in the history database 24 to the user management apparatus 4 via the network 5.

  Further, when the history data stored in the history database 24 is transmitted to the user management apparatus 4 by the network communication unit 25, the history data generation unit 235 deletes the transmitted history data from the history database 24.

  The control unit 23 of the station server 2 includes a hardware CPU, a memory (determination level storage unit 232), and other electronic circuits. When the hardware CPU executes the authentication program according to the present embodiment, the hardware CPU operates as the face detection unit 233, the biometric authentication unit 231 and the settlement unit 234. The memory also has an area for developing the authentication program according to the present embodiment and an area for temporarily storing data generated when the authentication program is executed. The control unit 23 may be an LSI in which a hardware CPU, a memory, and the like are integrated. The hardware CPU is a computer that executes the authentication method according to the present embodiment.

  FIG. 6 is a configuration diagram illustrating a configuration of a main part of the user management device 4. As shown in FIG. 6, the user management device 4 includes a user database 41, a control unit 42, and a communication unit 43.

  FIG. 7 is an explanatory diagram showing an example of data stored in the user database 41. As shown in FIG. 7, the user database 41 stores user data for each user based on history data received from the stations A1, A2, and A3. In the user data, the station (A1; A2; A3) used by the user, the date and time of use, and the entrance status are associated with the captured image and stored in the user database 41.

  The control unit 42 controls the user management device 4. The control unit 42 acquires history data from the station servers 2 of the stations A1, A2, and A3 at every desired time. The control unit 42 performs control such as updating the user database 41 with the acquired history data. The control unit 42 manages or controls the station server 2.

  The communication part 43 communicates various data with the station server 2 of each station A1, A2, A3 via the network 5 (refer FIG. 1). For example, the communication unit 43 receives history data from each of the stations A1, A2, and A3. Further, for example, when receiving an inquiry about user data of a user from the station server 2, the communication unit transmits an inquiry result to the station server 2 that inquired about the user data.

  In the station service system 1 according to this example, the station server 2 uses three types of biological information to authenticate whether the user is a registrant. When the station server 2 authenticates that the user is a registrant, the station server 2 performs payment for the user if it detects that the user's face is captured in the captured image. In other words, even if the station server 2 is authenticated that the user is a registrant, the station server 2 prohibits payment to the user if it does not detect that the user's face is captured in the captured image. That is, the authentication apparatus can confirm the use of the user who is the object of settlement by using the captured image in which the user's face is captured. Thereby, this station server 2 can confirm a user's utilization regarding a railroad utilization.

  In addition, although the station administration system 1 of this embodiment is described using the stations A1, A2, and A3, the number of stations that the railway company A has is not limited to three. Furthermore, the number of user management devices 4 used in the station service system 1 is not limited to one. The station service system 1 can also have a plurality of user management devices 4. For example, the plurality of user management apparatuses 4 may share information with each other via the network 5.

  Further, when paying the fare by the prepaid method, the user can check the contents of the settlement (charge amount or history) with A1, A2, A3 ticket machines or the like. In this case, the station server 2 inquires of the user management device 4 about information such as a history desired by the user. The user management device 4 transmits the user usage data to the station server 2. Further, when the user pays the fare by the post-pay method, the payment made when the user's face is detected from the captured image is detected in the payment statement sent monthly. Can be confirmed (settlement amount or history).

<3. Example of operation>
The operation of the station server 2 will be described with reference to FIG. FIG. 8 is a flowchart showing the operation of the station server 2. The terminal communication unit 21 acquires each type of biometric information in order to perform biometric authentication (S11). The control unit 23 authenticates whether the user is a registrant (S12). When the control unit 23 authenticates that the user is a registrant (S13: Yes), the control unit 23 performs a payment determination process (S14). The output unit 213 of the terminal communication unit 21 outputs the passability determination result to the outside (S15). When it is determined that the user is not a registrant (S13: No), the control unit 23 does not perform the payment determination process, and the output unit 213 of the terminal communication unit 21 displays the pass / fail determination result as an automatic ticket gate. 3 (S15).

  The biometric authentication process of the station server 2 will be described with reference to FIG. FIG. 9 is a flowchart illustrating an example of the biometric authentication process performed by the station server 2.

  The biometric authentication unit 231 generates collation data obtained by extracting features of biometric information from each image (S21). The biometric authentication unit 231 compares the collation data with the registration data of all registrants for each type of biometric information, and detects the highest similarity (S22). The biometric authentication unit 231 selects the highest similarity among the similarities of the three types of biometric information (S23). The biometric authentication unit 231 detects a registrant corresponding to the selected similarity (S24). The biometric authentication unit 231 acquires the similarities N1, N2, and N3 of each type of biometric information of the registrant (S25). The biometric authentication unit 231 determines whether all the similarities N1, N2, and N3 are equal to or higher than the determination levels 1A, 1B, and 1C (S26). When all the similarities N1, N2, and N3 are equal to or higher than the determination levels 1A, 1B, and 1C, the biometric authentication unit 231 determines that the user is a registrant (S27) (see FIG. 5A).

  On the other hand, when at least one of the similarities N1, N2, and N3 of the three types of biometric information is lower than the determination level (1A; 1B; 1C) (S26: No), the biometric authentication unit 231 indicates that the user is a registrant. If not, authentication is performed (S28) (see FIG. 5B).

  The operation of the payment determination process of the station server 2 will be described with reference to FIG. FIG. 10 is a flowchart illustrating an example of the operation of the payment determination process of the station server 2.

  The face detection unit 233 detects that the user's face is captured in the captured image (S31). If it is detected that the user's face has been captured in the captured image, the settlement unit 234 performs settlement (S32). The history data generation unit 235 generates history data and inputs the generated history data to the history database 24 (S33).

  If the face detection unit 233 does not detect that the user's face is captured in the captured image, the settlement unit 234 prohibits settlement for the user (S34).

  In the station service system 1 according to this example, the station server 2 authenticates whether or not the user is a registrant using three types of biological information, and the user is captured in the captured images captured at the entrance station and the departure station. If it is detected that the face is captured, the user is settled. In other words, even if the station server 2 is authenticated that the user is a registrant, it is not detected that the face of the user is captured in the captured images captured at the entrance station and the exit station. The settlement for this user is prohibited. Thereby, this station server 2 can confirm a user's utilization regarding a railroad utilization.

<4. Modification>
The station service system 1 according to the modification stores user data stored in the user database 41 of the user management device 4 for a certain period. As a result, even if the user proposes that there is an erroneous settlement after settlement, for example, it is possible to confirm that the railway has been used with the captured image obtained by capturing the face.

  Moreover, the station server 2 concerning another modification does not authenticate the biometric information acquired from other than a user's face, when it authenticates that the user is not a registrant by the biometric information acquired from the user's face. May be. That is, the biometric authentication unit 231 does not need to perform fingerprint authentication and vein pattern authentication when authenticating that the user is not a registrant based on biometric information acquired from the user's face.

  In the station server 2 according to this modified example, when it is not possible to detect that the user's face is captured from the captured image, it is not possible to authenticate that the user is a registrant by face authentication. If it is authenticated that the person is not a registrant, there is no need to authenticate other biological information. Thereby, in the station server 2 concerning this modification, the efficiency of an authentication process can be aimed at.

  Further, the station server 2 according to another modified example makes a payment to the user when the user's face can be recognized (face recognition) from the captured image. Here, the face recognition means that gender, age, etc. are identified from the user's face detected from the captured image. In other words, the station server 2 according to this modified example prohibits payment to the user unless the gender or age is recognized from the face of the user detected from the captured image.

  In addition, the station server 2 according to another modification may perform biometric authentication using only the biometric information acquired by the biometric information acquisition unit 211. That is, the station server 2 according to this modification may authenticate whether the user is a registrant using the fingerprint image and the vein pattern image.

  In addition, the biological information acquisition unit 211 may acquire one type of biological information. For example, the biometric information acquisition unit 211 may acquire a fingerprint image.

  In the above-described example, the station server 2 is described as being provided at each of the stations A1, A2, and A3. The station server 2 according to another modification is provided only at the station A1, for example, and is connected to the automatic ticket gates 3 of the stations A2 and A3 so that users who use the stations A1, A2, and A3 are connected. You may be comprised so that it may authenticate whether it is a registrant.

  Moreover, the station server 2 concerning another modification may be provided with two or more by one station.

  Moreover, although the authentication apparatus concerning this invention demonstrated as the station server 2, it is not limited to this. In another variation, the authentication device may be, for example, a PSP (Payment Service Provider) server or a card company server. In this case, for example, the gate is installed between the cash register and the exit, and the face of the user is imaged by a camera provided at the gate. For example, when a user possessing an article registered at a cash register in a store tries to pass through the gate, the server of the PSP or the card company can detect the user's face from the captured image obtained by capturing the user. Make a payment.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  Furthermore, the correspondence between the configuration according to the present invention and the configuration according to the above-described embodiment can be described as the following supplementary notes.

<Appendix>
A captured image acquisition unit (212) that acquires a captured image of the user, a face detection unit (234) that detects whether or not the user's face is captured in the captured image, and the user's face A biometric information acquisition unit (211) that acquires biometric information other than the biometric information, and the biometric information acquired by the biometric information acquisition unit (211) based on a matching result that is collated with registration data stored in the storage unit (21). Even if the user is authenticated as the registrant by the biometric authentication unit (231) that authenticates whether the user is a registrant and the biometric authentication unit (232), the face detection An authentication device (2), comprising: a settlement unit (236) that prohibits settlement if the unit (234) does not detect that the user's face is captured in the captured image.

DESCRIPTION OF SYMBOLS 1 ... Station service system 2 ... Station server 3 ... Automatic ticket gate 4 ... User management apparatus 211 ... Biometric information acquisition part 212 ... Captured image acquisition part 231 ... Biometric authentication part 234 ... Face detection part 236 ... Settlement part

Claims (6)

A captured image acquisition unit that acquires a captured image of the user;
A face detection unit that detects whether the user's face is captured in the captured image;
A biometric information acquisition unit for acquiring biometric information from other than the user's face;
A biometric authentication unit that authenticates whether or not the user is a registrant based on a collation result collated with registration data stored in a data storage unit for the biometric information acquired by the biometric information acquisition unit;
Even if the user is authenticated as the registrant by the biometric authentication unit, if the face detection unit does not detect that the user's face is captured in the captured image, the settlement is made. The payment department to ban,
Comprising
Authentication device. The biometric authentication unit, when the biometric information acquired from the user's face detected by the face detection unit authenticates that the user is not the registrant, the biometric acquired from other than the user's face Do not authenticate information,
The authentication device according to claim 1. When the face detection unit detects that the user's face is captured in the captured image, a history database that stores history data in which the captured image is associated with a location and date / time of the captured image Further comprising
The authentication device according to claim 1 or 2. The authentication device according to any one of claims 1 to 3,
The biometric information acquired from the user's face and the biometric information acquired from other than the user's face is input to the authentication apparatus and connected to the authentication apparatus so as to be communicable. An automatic ticket gate that performs the ticket gate processing,
Use for managing user data including the captured image, which is connected to the authentication device and the automatic ticket gate, and has detected that the face of the user has been captured, and data corresponding to the captured image A person management device,
Comprising
Station service system. A face detection step of detecting that the face of the user is imaged from a captured image obtained by imaging the user;
For biometric information other than the user's face, a biometric authentication step for authenticating whether or not the user is a registrant based on a collation result collated with registration data stored in a data storage unit;
Even if the user is authenticated as the registrant in the biometric authentication step, if the face detection step does not detect that the user's face is captured in the captured image, settlement is performed. An authentication method in which a computer executes a prohibited payment step. A face detection step of detecting that the user's face is imaged from a captured image obtained by imaging the user;
For biometric information other than the user's face, a biometric authentication step for authenticating whether or not the user is a registrant based on a collation result collated with registration data stored in a data storage unit;
Even if the user is authenticated as the registrant in the biometric authentication step, if the face detection step does not detect that the user's face is captured in the captured image, settlement is performed. An authentication program that causes a computer to execute a prohibited payment step.

Images