EP4734078A1

EP4734078A1 - Information processing device, information processing method, and recording medium

Info

Publication number: EP4734078A1
Application number: EP23942406.2A
Authority: EP
Inventors: Kazushi Miyagi; Kensaku Sato; Masato Kitada; Hirokazu Hamada; Akito Suga
Original assignee: NEC Corp
Current assignee: NEC Corp
Priority date: 2023-06-22
Filing date: 2023-06-22
Publication date: 2026-04-29
Also published as: WO2024261973A1; JPWO2024261973A1

Abstract

An information processing apparatus includes: an image acquisition unit that acquires an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information; a facial recognition unit that performs facial recognition on an authentication subject included in the image, based on the image; and a control unit that performs, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.

Description

Technical Field

The present disclosure relates to technical fields of an information processing apparatus, an information processing method, and a recording medium.

Background Art

As this type of apparatus, for example, there is proposed an automatic ticket gate that performs facial recognition processing on an authentication subject and media authentication processing based on IC ticket information from the authentication subject's IC ticket, wherein the automatic ticket gate permits passage of the authentication subject in a case where the IC ticket is authenticated after the authentication subject's facial information is acquired (see Patent Literature 1).

Citation List

Patent Literature

Patent Literature 1: JP2019-159795A

Summary

Technical Problem

It is an example object of the present disclosure to provide an information processing apparatus, an information processing method, and a recording medium that aim to improve the techniques/technologies disclosed in Citation List.

Solution to Problem

An information processing apparatus according to an example aspect includes: an image acquisition unit that acquires an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information; a facial recognition unit that performs facial recognition on an authentication subject included in the image, based on the image; and a control unit that performs, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.
An information processing method according to an example aspect includes: acquiring an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information; performing facial recognition on an authentication subject included in the image, based on the image; and performing, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.
A recording medium according to an example aspect is a recording medium on which a computer program that allows a computer to execute an information processing method is recorded, the information processing method including: acquiring an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information; performing facial recognition on an authentication subject included in the image, based on the image; and performing, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.

Brief Description of Drawings

[FIG. 1] FIG. 1 is a diagram illustrating an example of a ticket gate system.
[FIG. 2] FIG. 2 is a diagram illustrating an example of a facial information database.
[FIG. 3] FIG. 3 is a block diagram illustrating an example configuration of an information processing apparatus.
[FIG. 4] FIG. 4 is a diagram illustrating an example of a station ticket gate area.
[FIG. 5] FIG. 5 is a flowchart illustrating operation of the information processing apparatus according to the first example embodiment.
[FIG. 6] FIG. 6 is a block diagram illustrating another configuration of the information processing apparatus.
[FIG. 7] FIG. 7 is a diagram illustrating another example of the station ticket gate area.
[FIG. 8] FIG. 8 is a diagram for explaining person tracking processing.
[FIG. 9] FIG. 9 is a diagram illustrating an example of an ID correspondence table.

Description of Example Embodiments

An information processing apparatus, an information processing method, and a recording medium according to a first example embodiment will be described with reference to FIG. 1 to FIG. 5. The following describes the information processing apparatus, the information processing method, and the recording medium according to the first example embodiment, by using an information processing apparatus 10 provided in a ticket gate system 1.

(Overview of Ticket Gate System)

An overview of a ticket gate system according to the first example embodiment will be described with reference to FIG. 1. In FIG. 1, the ticket gate system 1 includes a station server 41 installed at a station A, a station server 42 installed at a station B, a center server 50, and a facial information database 60 (hereinafter referred to as a "facial information DB 60" as appropriate). The station servers 41 and 42, the center server 50, and the facial information DB 60 are connected via a network NW. The network NW is a wide area network such as, for example, the Internet. The "station" is not limited to a station for railway vehicles running on rails, but may also include a station for linear motor cars (e.g., superconducting magnetic levitation trains).
The ticket gate system 1 may include information processing apparatuses 10 and 10a, as well as automatic ticket gates 31 and 32. The information processing apparatus 10 and the automatic ticket gate 31 may be installed at the station A. Note that one of the information processing apparatus 10 and the automatic ticket gate 31 may not be installed at the station A. That is, at least one of the information processing apparatus 10 and the automatic ticket gate 31 may be installed at the station A. The information processing apparatus 10a and the automatic ticket gate 32 may be installed at the station B. Note that one of the information processing apparatus 10a and the automatic ticket gate 32 may not be installed at the station B. That is, at least one of the information processing apparatus 10a and the automatic ticket gate 32 may be installed at the station B.
At the station A, the station server 41, the information processing apparatus 10, and the automatic ticket gate 31 may be connected via a narrow area network such as, for example, a local area network (LAN). At the station B, the station server 42, the information processing apparatus 10a, and the automatic ticket gate 32 may be connected via a narrow area network such as, for example, a LAN.
The automatic ticket gates 31 and 32 are, for example, ticket gate apparatuses for which at least one of magnetic tickets, IC (Integrated Circuit) tickets, and mobile tickets are usable. Since existing various aspects are applicable to the automatic ticket gates 31 and 32, a detailed description of the automatic ticket gates is omitted.
The station server 41 may acquire, from the automatic ticket gate 31, passage information indicating that a user holding an IC ticket or mobile ticket has entered the station A. In this case, the station server 41 may link identification information about the IC ticket or mobile ticket, with the passage information indicating that the user has entered the station A, and may transmit the linked information to the center server 50. The center server 50 may register the information transmitted from the station server 41, in an entry/exit record 51.
The station server 41 may acquire, from the automatic ticket gate 31, passage information indicating that a user holding an IC ticket or mobile ticket has exited from the station A. In this case, the station server 41 may link the identification information about the IC ticket or mobile ticket, with the passage information indicating that the user has exited from the station A, and may transmit the linked information the center server 50. The center server 50 may register the information transmitted from the station server 41, in the entry/exit record 51.
The station server 42 may acquire, from the ticket gate apparatus, passage information indicating that a user holding an IC ticket or mobile ticket has entered the station B. In this case, the station server 42 may link the identification information about the IC ticket or mobile ticket, with the passage information indicating that the user has entered the station B, and may transmit the linked information to the center server 50. The center server 50 may register the information transmitted from the station server 42, in the entry/exit record 51.
The station server 42 may acquire, from the ticket gate apparatus, passage information indicating that a user holding an IC ticket or mobile ticket has exited from the station B. In this case, the station server 42 may link the identification information about the IC ticket or mobile ticket, with the passage information indicating that the user has exited from the station B, and may transmit the linked information to the center server 50. The center server 50 may register the information transmitted from the station server 42, in the entry/exit record 51.
For example, let us assume that one user enters the station A, travels by train from the station A to the station B, and exits from the station B. In this case, the entry/exit record 51 on the center server 50 may register that the one user has entered the station A and has exited from the station B. The center server 50 may calculate a railway usage fee (e.g., a fare) from the station A to the station B. The center server 50 may settle the calculated railway usage fee by using payment/settlement information about the one user. The payment information may be, for example, at least one of credit card information, debit card information, prepaid card information, IC card information, and account information.
The facial information DB 60 stores/registers therein information about those wishing to use the ticket gate system 1. Among those wishing to use the ticket gate system 1, a person whose information is registered in the facial information DB 60 is referred to as a "registrant" as appropriate. The facial information DB 60 stores/registers therein authentication IDs serving as identification information for respectively identifying/distinguishing a plurality of registrants. Information about each of the plurality of registrants is linked to the corresponding authentication ID and is registered in the facial information DB 60.
Here, the facial information DB 60 will be described with reference to FIG. 2. As illustrated in FIG. 2, facial information, ticket information, and payment information may be linked to the authentication ID of a single registrant. The facial information may be, for example, feature quantities themselves indicating facial features of the single registrant, or information (e.g., a file name) for identifying the feature quantities. Alternatively, the facial information may be, for example, a facial image itself including a face of the single registrant, or information (e.g., a file name) for identifying the facial image.
The ticket information is information about at least one of the IC ticket and the mobile ticket usable at automatic ticket gates (e.g., the automatic ticket gates 31 and 32). Therefore, it can be said that the ticket information is information for using the automatic ticket gates (e.g., the automatic ticket gates 31 and 32).
The payment information may be information about a payment method used for a deposit (a so-called charge amount) that is usable for paying railway charges. The payment information may be, for example, at least one of credit card information, debit card information, prepaid card information, IC card information, and account information.
The configuration and operation of the automatic ticket gates 31 and 32, the station servers 41 and 42, and the center server 50 may be the same as those of a system related to existing automatic ticket gates. Therefore, it can be said that the ticket gate system 1 is a system including the information processing apparatuses 10 and 10a and the facial information DB 60, in addition to the system related to the existing automatic ticket gates.

(Information Processing Apparatus)

The information processing apparatus 10 will be described with reference to FIG. 3. The information processing apparatus 10a may have a configuration similar to that of the information processing apparatus 10. Therefore, a description of the information processing apparatus 10a is omitted.
The information processing apparatus 10 performs facial recognition on users passing through a ticket gate(s) of the station A (in other words, subjects to be authenticated, or authentication subjects). The information processing apparatus 10 detects that a registrant corresponding to a user identified by the facial recognition has entered the station A or has exited from the station A. That is, the information processing apparatus 10 detects entry/exit of users at a railway station (e.g., the station A), as in the automatic ticket gates (e.g., the automatic ticket gates 31 and 32).
In FIG. 3, the information processing apparatus 10 includes an image acquisition unit 11, a facial recognition unit 12, a control unit 13, and a facial information database 14 (hereinafter referred to as a "facial information DB 14" as appropriate). Incidentally, the facial information DB 14 may store/register therein the same information as that registered in the facial information DB 60. The facial information DB 14 may be updated at predetermined intervals to ensure that the information registered in the facial information DB 14 is the same as that registered in the facial information DB 60.
Now, with reference to FIG. 4, the ticket gate of the station A will be described. As illustrated in FIG. 4, the automatic ticket gate 31 is installed at the ticket gate of the station A. The automatic ticket gate 31 may include a flapper. That is, the automatic ticket gate 31 may be a flapper-type gate apparatus. The automatic ticket gate 31 may read ticket information about an IC ticket or mobile ticket (e.g., at least one of identification information, a charge amount, a commuter pass section, and a validity period). The automatic ticket gate 31 may perform a flapper opening/closing operation based on the read ticket information. Note that the automatic ticket gate 31 is not limited to a flapper-type gate apparatus, but may also be, for example, an arm-type gate apparatus. The station A may have two or more automatic ticket gates installed.
In FIG. 4, an area above the automatic ticket gate 31 may be referred to as "inside the ticket gate." In FIG. 4, an area below the automatic ticket gate 31 may be referred to as "outside the gate." Only persons permitted to pass through the automatic ticket gate 31 (e.g., persons holding tickets) may go into the gate area. On the other hand, outside the ticket gate, there may also be persons not permitted to pass through the automatic ticket gate 31. Therefore, it can be said that the inside of the ticket gate and the outside of the ticket gate are different areas. It can be also said that the inside of the ticket gate and the outside of the ticket gate are areas partitioned by the automatic ticket gate 31.
Outside the ticket gate, a facial recognition area FRA1 is set for users entering the station A to pass through. Inside the ticket gate, a facial recognition area FRA2 is set for users exiting from the station A to pass through. The facial recognition areas FRA1 and FRA2 are virtual areas. Therefore, for example, any markings or the like indicating at least one of the facial recognition areas FRA1 and FRA2 may not be drawn, for example, at the station A. The station A, however, may have markings or the like indicating at least one of the facial recognition areas FRA1 and FRA2 drawn. In a case where the automatic ticket gate 31 is an automatic ticket gate dedicated for entry to the station A, the facial recognition area FRA2 may not be set. Alternatively, in a case where the automatic ticket gate 31 is an automatic ticket gate dedicated for exit from the station A, the facial recognition area FRA1 may not be set.
A camera CAM1 is installed/positioned to capture images of the facial recognition area FRA1. The camera CAM1 may not be positioned such that the entire facial recognition area FRA1 is included within its angle of view. In other words, the camera CAM1 may be positioned to capture images of at least a part of the facial recognition area FRA1. At the station A, two or more cameras, each being configured to capture images of at least a part of the facial recognition area FRA1, may be installed.
A camera CAM2 is installed/positioned to capture images of the facial recognition area FRA2. The camera CAM2 may not be positioned such that the entire facial recognition area FRA2 is included within its angle of view. In other words, the camera CAM2 may be positioned to capture images of at least a part of the facial recognition area FRA2. At the station A, two or more cameras, each being configured to capture images of at least a part of the facial recognition area FRA2, may be installed.
The cameras CAM1 and CAM2 may be installed at a position that does not obstruct the transit/passage of users (e.g., at a position higher than the users' heads). The cameras CAM1 and CAM2 may be high-resolution cameras, such as 4K resolution cameras. The cameras CAM1 and CAM2 may be connected to the information processing apparatus 10 via cables or using a wireless communication technology. Alternatively, the cameras CAM1 and CAM2 may be connected to the station server 41 via cables or using a wireless communication technology.
Returning to FIG. 3, the image acquisition unit 11 of the information processing apparatus 10 acquires a first image including the facial recognition area FRA1, which is generated by the camera CAM1 capturing the facial recognition area FRA1. The image acquisition unit 11 may acquire the first image directly from the camera CAM1 or may acquire it from the camera CAM1 via the station server 41.
The image acquisition unit 11 acquires a second image including the facial recognition area FRA2, which is generated by the camera CAM2 capturing the facial recognition area FRA2. The image acquisition unit 11 may acquire the second image directly from the camera CAM2 or may acquire it from the camera CAM2 via the station server 41.
The facial recognition unit 12 performs facial recognition, based on the image acquired by the image acquisition unit 11 (e.g., at least one of the first image and the second image). Note that various existing aspects, such as a two-dimensional (2D) authentication method or three-dimensional (3D) authentication method, may be applicable to the facial recognition. An example of processing related to the facial recognition process will be described below.
The facial recognition unit 12 may detect a face of a user included in the image (hereinafter referred to as an "authentication subject"). The facial recognition unit 12 may calculate facial feature quantities indicating the features of the detected face. The facial recognition unit 12 may identify a registrant corresponding to the authentication subject, by using the calculated facial feature quantities and the facial information DB 14.
The facial recognition unit 12 may calculate a matching score from the calculated facial feature quantities (i.e., facial feature quantities related to the face of the authentication subject) and from facial feature quantities based on the facial information on a single registrant registered in the facial information DB 14. In a case where the calculated matching score is greater than a predetermined threshold, the facial recognition unit 12 may determine that the single registrant is a registrant corresponding to the authentication subject.
In a case where the calculated matching score is less than the predetermined threshold, the facial recognition unit 12 may calculate a matching score from the calculated facial feature quantities and from facial feature quantities based on the facial information on another registrant registered in the facial information DB 14. In this case, the facial recognition unit 12 may determine that the single registrant is not the registrant corresponding to the authentication subject. In a case where the calculated matching score is "equal" to the predetermined threshold, it may be included in one of the cases.
The control unit 13 performs, based on a result of the facial recognition by the facial recognition unit 12, at least one of controlling the automatic ticket gate 31 to open or close the flapper, and displaying information (e.g., information about the result of the facial recognition).
For example, in a case where a registrant corresponding to an authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA1 (i.e., a user attempting to enter the station A) is identified by the facial recognition (in other words, in a case where the registrant has succeeded in the facial recognition) and in a case where the ticket information linked to the identified registrant indicates that the registrant is permitted to enter the station, the control unit 13 may permit the authentication subject to pass through the automatic ticket gate 31. Note that the "case where the ticket information indicates that the registrant is permitted to enter the station" may include, for example, at least one of the following cases: the ticket information indicates information about a ticket within its validity period; the ticket information indicates that the station A is included within a commuter pass section; and the ticket information indicates that a charge amount is greater than or equal to a first predetermined amount (e.g., a minimum railway usage fee).
In this case, the control unit 13 may control the automatic ticket gate 31 to open the flapper, via the station server 41. Alternatively, the control unit 13 may transmit, to the station server 41, the ticket information linked to the registrant corresponding to the authentication subject and information indicating that the authentication subject is permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to open the flapper in response to the information transmitted from the control unit 13.
In this case, the control unit 13 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is given, on a display DS (see FIG. 4) placed on the automatic ticket gate 31. The control unit 13 may further display, for example, information indicating that it is not necessary to have the automatic ticket gate 31 read the ticket information, on the display DS. In this case, the control unit 13 may not display the information on the display DS. The display DS may constitute a part of the information processing apparatus 10. The display DS may constitute a part of the automatic ticket gate 31.
In this case, the information processing apparatus 10 may link the ticket information (e.g., identification information about an IC ticket or mobile ticket) linked to the registrant corresponding to the authentication subject, with the passage information indicating that the authentication subject has entered the station A, and transmit the linked information to the station server 41. The station server 41 may transmit the ticket information and the passage information indicating entry to the station A, which are transmitted from the information processing apparatus 10, to the center server 50. As a result, the aforementioned registrant having entered the station A may be registered in the entry/exit record 51.
For example, in a case where a registrant corresponding to an authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA1 (i.e., a user attempting to enter the station A) is not identified by the facial recognition (in other words, in a case where the registrant has failed in the facial recognition), the control unit 13 may not permit the authentication subject to pass through the automatic ticket gate 31. Furthermore, even if the registrant corresponding to an authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA1 is identified by the facial recognition (in other words, in a case where the registrant has succeeded in the facial recognition), in a case where the ticket information linked to the identified registrant indicates that the registrant is not permitted to enter the station, the control unit 13 may not permit the authentication subject to pass through the automatic ticket gate 31.
Note that the "case where the ticket information indicates that the registrant is not permitted to enter the station" may include, for example, at least one of the following cases: the ticket information indicates that there is no information about a ticket within its validity period; and the ticket information indicates that the charge amount is less than the first predetermined amount.
In this case, the control unit 13 may control the automatic ticket gate 31 to close the flapper, via the station server 41. Alternatively, the control unit 13 may transmit, to the station server 41, the ticket information linked to the registrant corresponding to the authentication subject and information indicating that the authentication subject is not permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to close the flapper in response to the information transmitted from the control unit 13.
In this case, the control unit 13 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is not given, on the display DS. The control unit 13 may further display, for example, information indicating that it is necessary to have the ticket information read by the automatic ticket gate 31, on the display DS. Alternatively, the control unit 13 may display, for example, information indicating that deposit processing is required, on the display DS.
For example, in a case where a registrant corresponding to an authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA2 (i.e., a user attempting to exit from the station A) is identified by the facial recognition (in other words, in a case where the registrant has succeeded in the facial recognition) and in a case where the ticket information linked to the identified registrant indicates that the registrant is permitted to exit from the station, the control unit 13 may permit the authentication subject to pass through the automatic ticket gate 31. Note that the "case where the ticket information indicates that the registrant is permitted to exit from the station" may include, for example, at least one of the following cases: the ticket information indicates information about a ticket within its validity period; the ticket information indicates that the station A is included within a commuter pass section; and the ticket information indicates that a charge amount is greater than or equal to a second predetermined amount (e.g., an amount of money corresponding to a railway usage fee).
In this case, the control unit 13 may control the automatic ticket gate 31 to open the flapper, via the station server 41. Alternatively, the control unit 13 may transmit, to the station server 41, the ticket information linked to the registrant corresponding to the authentication subject and the information indicating that the authentication subject is permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to open the flapper in response to the information transmitted from the control unit 13.
In this case, the control unit 13 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is given, on the display DS. The control unit 13 may further display, for example, information indicating that it is not necessary to have the ticket information read by the automatic ticket gate 31, on the display DS. In this case, the control unit 13 may not display the information on the display DS.
In this case, the information processing apparatus 10 may link the ticket information (e.g., identification information about an IC ticket or mobile ticket) linked to the registrant corresponding to the authentication subject, with the passage information indicating that the authentication subject has exited from the station A, and transmit the linked information to the station server 41. The station server 41 may transmit the ticket information and the passage information indicating exit from the station A, which are transmitted from the information processing apparatus 10, to the center server 50. As a result, the aforementioned registrant having exited from the station A may be registered in the entry/exit record 51.
For example, in a case where a registrant corresponding to an authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA2 (i.e., a user attempting to exit from the station A) is not identified by the facial recognition (in other words, in a case where the registrant has failed in the facial recognition), the control unit 13 may not permit the authentication subject to pass through the automatic ticket gate 31. Furthermore, even if the registrant corresponding to an authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA2 is identified by the facial recognition (in other words, in a case where the registrant has succeeded in the facial recognition), in a case where the ticket information linked to the identified registrant indicates that the registrant is not permitted to exited from the station, the control unit 13 may not permit the authentication subject to pass through the automatic ticket gate 31.
Note that the "case where the ticket information indicates that the registrant is not permitted to exit from the station" may include, for example, at least one of the following cases: the ticket information indicates that there is no information about a ticket within its validity period; and the ticket information indicates that the charge amount is less than the second predetermined amount.
In this case, the control unit 13 may control the automatic ticket gate 31 to close the flapper, via the station server 41. Alternatively, the control unit 13 may transmit, to the station server 41, the ticket information linked to the registrant corresponding to the authentication subject and the information indicating that the authentication subject is not permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to close the flapper in response to the information transmitted from the control unit 13.
In this case, the control unit 13 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is not given, on the display DS. The control unit 13 may further display, for example, information indicating that it is necessary to have the ticket information read by the automatic ticket gate 31, on the display DS. Alternatively, the control unit 13 may display, for example, information indicating that deposit processing is required, on the display DS.
Next, with reference to a flowchart in FIG. 5, the operation of the information processing apparatus 10 will be described. In FIG. 5, the image acquisition unit 11 acquires at least one of the first image including the facial recognition area FRA1 and the second image including the facial recognition area FRA2 (step S101). The facial recognition unit 12 performs the facial recognition, based on the image acquired in the step S101 (e.g., at least one of the first image and the second image) (step S102).
The control unit 13 determines whether or not the authentication subject included in the image acquired in the step S101 (e.g., at least one of the first image and the second image) is permitted to pass through the automatic ticket gate 31, based on the result of the facial recognition (step S103).
In a case where it is determined in the step S103 that the authentication subject is permitted to pass through the automatic ticket gate 31 (step S103: Yes), the control unit 13 performs at least one of controlling the automatic ticket gate 31 to open the flapper, and displaying information (step S104).
In a case where it is determined in the step S103 that the authentication subject is not permitted to pass through the automatic ticket gate 31 (step S103: No), the control unit 13 performs at least one of controlling the automatic ticket gate 31 to close the flapper, and displaying information (step S105).
As described above, performed in the information processing apparatus 10 is an information processing method including: acquiring an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information; performing facial recognition on an authentication subject included in the image, based on the image; and performing, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.
The aforementioned information processing apparatus 10 may be realized by a computer reading a computer program recorded on a recording medium. In this case, it can be said that a computer program that allows a computer to execute an information processing method is recorded on a recording medium, the information processing method including: acquiring an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information; performing facial recognition on an authentication subject included in the image, based on the image; and performing, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.

(Technical Effect)

In a case where the information processing apparatus that detects entry to and exit from a station via the facial recognition (e.g., the information processing apparatus 10) is introduced, it is highly unlikely that the information processing apparatus is simultaneously introduced at all the stations. For example, in early stages of introducing the information processing apparatus, the information processing apparatus and the existing system related to the automatic ticket gates may coexist. Furthermore, from the perspective of user convenience at stations, the information processing apparatus and the existing system related to the automatic ticket gates need to coexist for a certain period of time.
Consequently, there may arise a situation where the information processing apparatus is installed at one railway station, while only the automatic ticket gates are installed at other stations. If no countermeasures are taken in such a situation, in a case where a user enters using the facial recognition at one railway station and then exits through the automatic ticket gate at another railway station, there is a possibility that railway usage fee (e.g., a fare) cannot be appropriately collected from that user.
The information processing apparatus 10 identifies a registrant corresponding to, for example, at least one of a user entering the station A and a user exiting from the station A, through the facial recognition. The information processing apparatus 10 then links the ticket information on the registrant identified by the facial recognition, with one of the passage information indicating entering the station A and the passage information indicating exiting from the station A, and transmits the linked information to the station server 41. As a result, the aforementioned user having entered the station A or having exited from the station A is registered in the entry/exit record 51 on the center server 50.
Through the above operation of the information processing apparatus 10, the information about entry to/exit from the station that is detected by the facial recognition, is integrated with the information about entry to/exit from the station that is detected by the automatic ticket gate. Consequently, even if a user enters using the facial recognition at one station and then exits from another station by having the ticket information read by the automatic ticket gate, it is possible to appropriately collect the railway usage fee (e.g., a fare) from that user.
For example, as illustrated in FIG. 4, by setting the facial recognition areas FRA1 and FRA2, the facial recognition may be performed before a station user reaches the automatic ticket gate 31. From another perspective, the facial recognition may be introduced while maintaining the existing automatic ticket gate 31. Therefore, even a station user who cannot use the facial recognition (e.g., a user having failed in the facial recognition) is allowed to enter and exit from the station, by having the ticket information read by the automatic ticket gate (e.g., the automatic ticket gate 31). That is, it can be said that the information processing apparatus 10 is capable of accommodating both a station user who can use the facial recognition and a station user who cannot use the facial recognition. Furthermore, as described above, the operation of opening/closing the flapper of the automatic ticket gate is performed depending on whether or not the authentication subject is permitted to pass through the automatic ticket gate based on the result of the facial recognition. Consequently, the authentication subject permitted to pass through the automatic ticket gate is allowed to do so without stopping at the automatic ticket gate. Therefore, the information processing apparatus 10 enhances the convenience for station users.
Furthermore, the information processing apparatus disclosed herein (e.g., the information processing apparatus 10) is applicable not only to a ticket gate system at a station (e.g., the ticket gate system 1), but also to a facility requiring an admission ticket, such as, for example, a theme park, a movie theater, and an event venue. In a case where there is no need to manage a user's exit from a facility, a facial recognition area corresponding to the aforementioned facial recognition area FRA2 (see FIG. 4) may not be set.

An information processing apparatus, an information processing method, and a recording medium according to a second example embodiment will be described with reference to FIG. 6 to FIG. 9. In the second example embodiment, the ticket gate system 1 may include an information processing apparatus 20, instead of the information processing apparatus 10. The following describes the information processing apparatus, the information processing method, and the recording medium according to the second example embodiment, by using the information processing apparatus 20. In the second example embodiment, a description that overlaps with that of the first example embodiment is omitted as appropriate.
In the second example embodiment, the information processing apparatus 20 may be installed, for example, at the station A. At the station A, the information processing apparatus 20 may be connected to the station server 41 via a narrow area network such as, for example, a LAN. Note that an information processing apparatus similar to the information processing apparatus 20 may also be installed, for example, at the station B.

(Configuration of Information Processing Apparatus)

In FIG. 6, the information processing apparatus 20 includes an arithmetic apparatus 21, a storage apparatus 22, and a communication apparatus 23. The information processing apparatus 20 may further include an input apparatus 24 and an output apparatus 25. The information processing apparatus 20 may include a facial information database 26 (hereinafter referred to as a "facial information DB 26" as appropriate). In the information processing apparatus 20, the arithmetic apparatus 21, the storage apparatus 22, the communication apparatus 23, the input apparatus 24, the output apparatus 25, and the facial information DB 26 may be connected via a data bus 27. The information processing apparatus 20 may not include at least one of the input apparatus 24 and the output apparatus 25.
Incidentally, the facial information DB 26 may store/register therein the same information as that registered in the facial information DB 60. The facial information DB 26 may be updated at predetermined intervals to ensure that the information registered in the facial information DB 26 is the same as that registered in the facial information DB 60.
The arithmetic apparatus 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.
The storage apparatus 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read-Only Memory), a hard disk apparatus, a magneto-optical disk apparatus, a SSD (Solid State Drive), and an optical disk array. That is, the storage apparatus 22 may include a non-transitory recording medium. The storage apparatus 22 is configured to store desired data. For example, the storage apparatus 22 may temporarily store a computer program to be executed by the arithmetic apparatus 21. The storage apparatus 22 may temporarily store data that are temporarily used by the arithmetic apparatus 21 when the arithmetic apparatus 21 is executing the computer program.
The communication apparatus 23 may be configured to communicate with an apparatus external to the information processing apparatus 20. The communication apparatus 23 may perform wired communication or wireless communication.
The input apparatus 24 is an apparatus that is configured to receive an input of information to the information processing apparatus 20 from an external source. The input apparatus 24 may include an operating apparatus (e.g., a keyboard, mouse, touch panel, etc.) that is operable by an operator of the information processing apparatus 20. The input apparatus 24 may include a recording medium reading apparatus that is configured to read information recorded on a recording medium that is attachable to or detachable from the information processing apparatus 20, such as, for example, a USB (Universal Serial Bus) memory. In a case where information is inputted to the information processing apparatus 20 via the communication apparatus 23 (in other words, in a case where the information processing apparatus 20 acquires information via the communication apparatus 23), the communication apparatus 23 may function as an input apparatus.
The output apparatus 25 is an apparatus that is configured to output information to the outside of the information processing apparatus 20. The output apparatus 25 may output visual information such as characters/text and images, may output auditory information such as voice, or may output tactile information such as vibration, as the above information. The output apparatus 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output apparatus 25 may be configured to output information to a recording medium that is attachable to or detachable from the information processing apparatus 20, such as, for example, a USB memory. In a case where the information processing apparatus 20 outputs information via the communication apparatus 23, the communication apparatus 23 may function as an output apparatus.
The arithmetic apparatus 21 may include an image acquisition unit 211, a tracking unit 212, a facial recognition unit 213, and a control unit 214, as function blocks realized logically or as processing circuits realized physically.
At least one of the image acquisition unit 211, the tracking unit 212, the facial recognition unit 213, and the control unit 214 may be realized in a form in which logical function blocks and physical processing circuits (i.e., hardware) are mixed. In a case where at least a part of the image acquisition unit 211, the tracking unit 212, the facial recognition unit 213, and the control unit 214 is a function block, the at least a part of the image acquisition unit 211, the tracking unit 212, the facial recognition unit 213, and the control unit 214 may be realized by the arithmetic apparatus 21 executing a predetermined computer program.
The arithmetic apparatus 21 may acquire (in other words, read) the predetermined computer program from the storage apparatus 22. The arithmetic apparatus 21 may also read the predetermined computer program stored on a computer-readable, non-transitory recording medium, by using a not-illustrated recording medium reading apparatus provided in the information processing apparatus 20. The arithmetic apparatus 21 may acquire (in other words, may download or read) the predetermined computer program from a not-illustrated apparatus external to the information processing apparatus 20 via the communication apparatus 23. As the recording medium that records therein the predetermined computer program to be executed by the arithmetic apparatus 21, at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium configured to store a program may be used.
The "image acquisition unit 211," the "facial recognition unit 213," the "control unit 214," and the "facial information DB 26" are components corresponding to the "image acquisition unit 11," the "facial recognition unit 12," the "control unit 13," and the "facial information DB 14" in the example embodiment described above, respectively.
Now, with reference to FIG. 7, the ticket gate of the station A will be de described. In FIG. 7, the same components as those illustrated in FIG. 4 carry the same reference numerals as those illustrated in FIG. 4. Therefore, a detailed description of the components illustrated in FIG. 4 is omitted as appropriate.
As illustrated in FIG. 7, a tracking area TA including the facial recognition areas FRA1 and FRA2 is set. The tracking area TA is a virtual area. Therefore, for example, any markings or the like indicating the tracking area TA may not be drawn at the station A. However, markings or the like indicating the tracking area TA may be drawn at the station A. The tracking area TA may not include one of the facial recognition areas FRA1 and FRA2. In this case, a different tracking area from the tracking area TA, which includes the other of the facial recognition areas FRA1 and FRA2, may be set.
A camera CAM3 is installed/positioned to capture images of the tracking area TA. The camera CAM3 may not be positioned such that the entire tracking area TA is included within its angle of view. In other words, the camera CAM3 may be positioned to capture images of at least a part of the tracking area TA. As described above, the camera CAM1 is positioned to capture images of at least a part of the facial recognition area FRA1 included in the tracking area TA. The camera CAM2 is positioned to capture images of at least a part of the facial recognition area FRA2 included in the tracking area TA. Therefore, in addition to or instead of the camera CAM3, at least one of the cameras CAM1 and CAM2 may be used to capture images of the tracking area TA.
The camera CAM3 may be installed at a position that does not obstruct the transit/passage of users (e.g., at a position higher than the users' heads). The resolution of the camera CAM3 may be lower than that of at least one of the cameras CAM1 and CAM2. The resolution of the camera CAM3 may be equal to that of at least one of the cameras CAM1 and CAM2. The camera CAM3 may be connected to the information processing apparatus 20 via a cable or using a wireless communication technology. Alternatively, the camera CAM3 may be connected to the station server 41 via a cable or using a wireless communication technology. In the second example embodiment, the cameras CAM1 and CAM2 may be connected to the information processing apparatus 20 via cables or using a wireless communication technology.

(Operation of Information Processing Apparatus)

The information processing apparatus 20 performs facial recognition on an authentication subject (i.e., a user of the station A)m based on the image captured by at least one of the cameras CAM1, CAM2, and CAM3. The information processing apparatus 20 may perform the facial recognition on the authentication subject while the authentication subject is passing through the facial recognition area FRA1 or FRA2. That is, the information processing apparatus 20 may be an apparatus that is configured to perform walk-through facial recognition.
The image acquisition unit 211 acquires a first image including the facial recognition area FRA1, which is generated by the camera CAM1 capturing the facial recognition area FRA1. The image acquisition unit 11 may acquire the first image directly from the camera CAM1 or may acquire it from the camera CAM1 via the station server 41.
The image acquisition unit 211 acquires a second image including the facial recognition area FRA2, which is generated by the camera CAM2 capturing the facial recognition area FRA2. The image acquisition unit 211 may acquire the second image directly from camera CAM2 or may acquire it from the camera CAM2 via the station server 41.
The image acquisition unit 211 acquires a third image including the tracking area TA, which is generated by the camera CAM3 capturing the tracking area TA. The image acquisition unit 211 may acquire the third image directly from the camera CAM3 or may acquire it from the camera CAM3 via the station server 41.
The tracking unit 212 performs tracking processing on one or more authentication subjects (in other words, users of the station A) passing through the tracking area TA, using the image acquired by the image acquisition unit 211 (e.g., at least one of the first image, the second image, and the third image). The tracking unit 212 may perform the tracking processing on one authentication subject using the first image, in a case where the one authentication subject is passing through the facial recognition area FRA1. The tracking unit 212 may perform the tracking processing on one authentication subject using the second image, in a case where the one authentication subject is passing through the facial recognition area FRA2. The tracking unit 212 may perform the tracking processing on one authentication subject using the third image, in a case where the one authentication subject is passing through a part of the tracking area TA that is different from the facial recognition areas FRA1 and FRA2.
As a specific example of the tracking processing performed by the tracking unit 212, a case where the tracking unit 212 performs the tracking processing on a person P1 passing through the tracking area TA will be described with reference to FIG. 8. Images IMG1, IMG2, and IMG3 illustrated in FIG. 8 are images including the person P1 corresponding to the authentication subject (in other words, images in which the person P1 is captured). The image IMG1 may be an image generated by the camera CAM1 capturing the facial recognition area FRA1 at a time t1. The image IMG2 may be an image generated by the camera CAM1 capturing the facial recognition area FRA1 at a time t2, which is later than the time t1. The image IMG3 may be an image generated by the camera CAM1 capturing the facial recognition area FRA1 at a time t3, which is later than the time t2.
Each of the images IMG 1, IMG2, and IMG3 may correspond to a single frame of a video. In this case, the image IMG2 may not correspond to a frame immediately after a frame corresponding to the image IMG1. That is, the image IMG2 may correspond to a frame that is two or more frames later than the frame corresponding to the image IMG1. Similarly, the image IMG3 may not correspond to a frame immediately after the frame corresponding to the image IMG2. That is, the image IMG3 may correspond to a frame that is two or more frames later than the frame corresponding to the image IMG2.
The tracking unit 212 detects, from the image IMG1, a head of the person P1 included in the image IMG1. Since existing techniques/technologies are applicable to a method of detecting a human head from an image, a detailed description of the method is omitted. Based on the detected head of the person P1, the tracking unit 212 sets an area including the head of the person P1 as a target tracking area TA1. The tracking unit 212 may also detect an upper body or entire body of the person P1 included in the image IMG1. The tracking unit 212 may set an area including the upper body or entire body of the person P1 as the target tracking area TA1, based on the detected upper body or entire body of the person P1.
In a case where the target tracking area TA1 is set, the tracking unit 212 sets or assigns a tracking ID, which is identification information for identifying the person P1 related to the target tracking area TA1, to the person P1. The tracking unit 212 calculates a position of the person P1 (e.g., a position at the feet of the person P1) based on the target tracking area TA1. Since existing techniques/technologies are applicable to a method of calculating, from an image, the position of a subject included in the image, a detailed description of the method is omitted. The tracking unit 212 links the tracking ID with the position of the person P1 and registers it in an ID correspondence table 221 stored in the storage apparatus 22.
Here, with reference to FIG. 9 the ID correspondence table 221 will be described. As illustrated in FIG. 9, the tracking ID, a tracking position (e.g., a position at the feet of the person P1), the authentication ID, and an authentication time are linked with each other in the ID correspondence table 221. Note that the "position of the person P1" is an example of the tracking position.
In a case where the target tracking area TA1 is set, the tracking unit 212 determines whether or not a face of the person P1 is captured in the target tracking area TA1. In other words, the tracking unit 212 performs face detection on the target tracking area TA1. In a case where it is determined that the face of the person P1 is captured in the target tracking area TA1, the tracking unit 212 generates a facial image including a face area of the person P1. The tracking unit 212 links the generated facial image with the tracking ID of the person P1 and transmits it to the facial recognition unit 213. In a case where it is determined that the face of the person P1 is not captured in the target tracking area TA1, the tracking unit 212 may not generate a facial image.
The tracking unit 212 may identify the person P1 included in the image IMG2, by using the image IMG2 and the image IMG1. Identifying the person P1 included in the image IMG2 is synonymous with establishing correspondence/mapping between the person P1 included in the image IMG1 and the person P1 included in the image IMG2. Therefore, at least one of a matching method and an optical flow method associated with the correspondence/mapping between images, is applicable to identify the person P1 included in the image IMG2. Since existing various aspects are applicable to each of the matching method and the optical flow method, a detailed description of each method is omitted.
In a case where the person P1 included in the image IMG2 is identified, the tracking unit 212 detects the head of the person P1. Based on the detected head of the person P1, the tracking unit 212 sets an area including the head of the person P1 as a target tracking area TA2. Since the person P1 included in the image IMG1 and the person P1 included in the image IMG2 are the same person, the tracking ID of the person P1 related to the target tracking area TA2 is the same as the tracking ID of the person P1 related to the target tracking area TA1. The tracking unit 212 calculates the position of the person P1 based on the target tracking area TA2. The tracking unit 212 may also detect an upper body or entire body of the person P1 included in the image IMG2. The tracking unit 212 may set an area including the upper body or entire body of the person P1 as the target tracking area TA2, based on the detected upper body or entire body of the person P1.
The tracking unit 212 links the position of the person P1 to the tracking ID of the person P1 and registers it in the ID correspondence table 221. In this case, since the position of the person P1 calculated based on the target tracking area TA1 is registered in the ID correspondence table 221, the position of the person P1 is updated by the tracking unit 212 registering the position of the person P1 calculated based on the target tracking area TA2, in the ID correspondence table 221.
In a case where the target tracking area TA2 is set, the tracking unit 212 determines whether or not the face of the person P1 is captured in the target tracking area TA2. In other words, the tracking unit 212 performs the face detection on the target tracking area TA2. In a case where it is determined that the face of the person P1 is captured in the target tracking area TA2, the tracking unit 212 generates a facial image including the face area of the person P1. The tracking unit 212 links the generated facial image with the tracking ID of the person P1 and transmits it to the facial recognition unit 213. In a case where it is determined that the face of the person P1 is not captured in the target tracking area TA2, the tracking unit 212 may not generate a facial image. Even when it is determined that the face of the person P1 is captured in the target tracking area TA2, in a case where the tracking ID of the person P1 is linked with the authentication ID in the ID correspondence table 221 (i.e., in a case where the facial recognition is already successful), the tracking unit 212 may not generate a facial image.
The tracking unit 212 may identify the person P1 included in the image IMG3, by using the image IMG3 and the image IMG2. In a case where the person P1 included in the image IMG3 is identified, the tracking unit 212 detects the head of the person P1. Based on the detected head of the person P1, the tracking unit 212 sets an area including the head of the person P1 as a target tracking area TA3. Since the person P1 included in the image IMG2 and the person P1 included in the image IMG3 are the same person, the tracking ID of the person P1 related to the target tracking area TA3 is the same as the tracking ID of the person P1 related to the target tracking area TA2. The tracking unit 212 calculates the position of the person P1 based on the target tracking area TA3. The tracking unit 212 may also detect an upper body or entire body of the person P1 included in the image IMG3. The tracking unit 212 may set an area including the upper body or entire body of the person P1 as the target tracking area TA3, based on the detected upper body or entire body of the person P1.
The tracking unit 212 links the position of the person P1 to the tracking ID of the person P1 and registers it in the ID correspondence table 221. In this case, since the position of the person P1 calculated based on the target tracking area TA2 is registered in the ID correspondence table 221, the position of the person P1 is updated by the tracking unit 212 registering the position of the person P1 calculated based on the target tracking area TA3, in the ID correspondence table 221.
In a case where the target tracking area TA3 is set, the tracking unit 212 determines whether or not the face of the person P1 is captured in the target tracking area TA3. In other words, the tracking unit 212 performs the face detection on the target tracking area TA3. In a case where it is determined that the face of the person P1 is captured in the target tracking area TA3, the tracking unit 212 generates a facial image including the face area of the person P1. The tracking unit 212 links the generated facial image with the tracking ID of the person P1 and transmits it to the facial recognition unit 213. In a case where it is determined that the face of the person P1 is not captured in the target tracking area TA3, the tracking unit 212 may not generate a facial image. Even when it is determined that the face of the person P1 is captured in the target tracking area TA3, in a case where the tracking ID of the person P1 is linked with the authentication ID in the ID correspondence table 221 (i.e., in a case where the facial recognition is already successful), the tracking unit 212 may not generate a facial image.
By the way, it may be difficult for the tracking unit 212 to continue tracking the person P1 due to the head of the person P1 being hidden by another person, for example. In a case where the tracking of the person P1 is interrupted, the tracking unit 212 may perform the following processing. After the tracking of the person P1 is interrupted, the tracking unit 212 may determine whether or not a new person is detected from the image acquired by the image acquisition unit 211 (e.g., the image captured by the camera CAM1). The "new person" means a person for whom the tracking ID is not set.
In a case where a new person is detected, the tracking unit 212 may determine whether or not the person P1 and the new person are the same person, by comparing the feature quantities in the target tracking area related to the person P1 (e.g., at least one of the target tracking areas TA1, TA2, and TA3) with the feature quantities in the target tracking area related to the new person. In a case where it is determined that the person P1 and the new person are the same person, the tracking unit 212 may set or assign the tracking ID of the person P1, to the new person. As a result, the tracking unit 212 is allowed to track the person P1 again.
The feature quantities may be feature quantities related to the head of a person, feature quantities related to an upper body of the person, or feature quantities related to an entire body of the person. That is, the target tracking area (e.g., at least one of the target tracking areas TA1, TA2, and TA3) may include the head of the person, the upper body of the person, or the entire body of the person. The feature quantities may be obtained, for example, by using a Person Re-Identification technology.
The tracking unit 212 may repeat the aforementioned processing until the person P1 passes through the tracking area TA (see FIG. 7). The tracking unit 212 may perform the aforementioned processing on all the authentication subjects passing through the tracking area TA.
The facial recognition unit 213 performs facial recognition processing on one or more authentication subjects passing through the facial recognition area FRA1 or FRA2, by using the image acquired by the image acquisition unit 211 (e.g., at least one of the first image and the second image).
Specifically, the facial recognition unit 213 performs the facial recognition processing by using the facial image transmitted from the tracking unit 212. As described above, the tracking unit 212 generates a facial image by detecting the face of a person (e.g., the person P1) included in the image acquired by the image acquisition unit 211. Therefore, the facial recognition unit 213 performing the facial recognition processing using the facial image transmitted from the tracking unit 212, may mean the facial recognition unit 213 performing the facial recognition processing using the image acquired by the image acquisition unit 211.
For example, the facial recognition unit 213 may calculate facial feature quantities indicating the features of the face of the person P1 from the aforementioned facial image. The facial recognition unit 213 may calculate a matching score from the calculated facial feature quantities and from facial feature quantities based on the facial information on a single registrant registered in the facial information DB 26.
In a case where the calculated matching score is greater than a predetermined threshold, the facial recognition unit 213 determines that the facial recognition is successful. In this case, a single registrant corresponding to a person (e.g., the person P1) indicated by the facial image transmitted from the tracking unit 212 is identified from among a plurality of registrants registered in the facial information DB 26. On the other hand, in a case where the calculated matching score is less than the predetermined threshold, the facial recognition unit 213 determines that the facial recognition is failed. In this case, it is highly likely that a person corresponding to the person (here, the person P1) indicated by the facial image transmitted from the tracking unit 212 is not registered in the facial information DB 26. In a case where the calculated matching score is "equal" to the predetermined threshold, it may be included in one of the cases.
In a case where the facial recognition is successful, the facial recognition unit 213 links the authentication ID indicating the registrant registered in the facial information DB 26 corresponding to the person (e.g., the person P1) indicated by the facial image transmitted from the tracking unit 212, to the tracking ID linked to the facial image described above, and registers it in the ID correspondence table 221. In addition to the authentication ID, the facial recognition unit 213 may register an authentication time, which is a time at which the facial recognition processing is performed, in the ID correspondence table 221. In a case where the authentication time is already registered in the ID correspondence table 221 (i.e., in a case where the facial recognition was successful in the past), the facial recognition unit 213 may update the authentication time registered in the ID correspondence table 221. In a case where the facial recognition is failed, the facial recognition unit 213 may link information indicating that there is no matching person (e.g., "N/A (Not Applicable)") to the tracking ID linked to the facial image transmitted from the tracking unit 212, and may register it in the ID correspondence table 221.
Therefore, in a case where the tracking ID is linked with a specific authentication ID in the ID correspondence table 221, it indicates that a registrant corresponding to a person for whom the tracking ID is set is registered in the facial information DB 26. In a case where the tracking ID is linked with the character string "N/A", it indicates that a person corresponding to the person for whom the tracking ID is set is not registered in the facial information DB 26. In a case where the tracking ID is not linked with the authentication ID (i.e., in a case where a field of the authentication ID is blank), it indicates that the facial recognition processing has never been performed.
The control unit 214 performs, based on a result of the facial recognition by the facial recognition unit 213, at least one of controlling the automatic ticket gate 31 to open or close the flapper, and displaying information (e.g., information about the result of the facial recognition). Note that the ID correspondence table 221 corresponds to an example of the result of the facial recognition by the facial recognition unit 213.
For example, in a case where a registrant corresponding to one authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA1 (i.e., a user attempting to enter the station A) is identified by the facial recognition (in other words, in a case where the registrant has succeeded in the facial recognition), the control unit 214 may acquire the authentication ID linked to the tracking ID of the one authentication subject, in the ID correspondence table 221. The control unit 214 may acquire the ticket information linked to the acquired authentication ID, in the facial information DB 26. Based on the acquired ticket information, the control unit 214 may determine whether or not to permit the one authentication subject to pass through the automatic ticket gate 31.
For example, in a case where the acquired ticket information indicates that one authentication subject is to be permitted to enter the station A, the control unit 214 may permit the one authentication subject to pass through the automatic ticket gate 31. On the other hand, in a case where the acquired ticket information indicates that one authentication subject is not to be permitted to enter the station A, the control unit 214 may not permit the one authentication subject to pass through the automatic ticket gate 31. For example, in a case where a registrant corresponding to one authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA1 is not identified by the facial recognition (e.g., in a case where the tracking ID is linked with the character string "N/A" or the field of the authentication ID is blank in the ID correspondence table 221), in other words, in a case where the registrant has failed in the facial recognition, the control unit 214 may not permit the one authentication subject to pass through the automatic ticket gate 31.
In a case where one authentication subject is permitted to pass through the automatic ticket gate 31, the control unit 214 may control the automatic ticket gate 31 to open the flapper, via the station server 41. Alternatively, the control unit 214 may transmit, to the station server 41 via the communication apparatus 23, the ticket information linked to the registrant corresponding to the one authentication subject (i.e., the authentication ID linked to the tracking ID of the one authentication subject) and information indicating that the one authentication subject is permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to open the flapper in response to the information transmitted from the control unit 214.
In this case, the control unit 214 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is given, on a display DS (see FIG. 7) placed on the automatic ticket gate 31. The control unit 214 may further display, for example, information indicating that it is not necessary to have the ticket information read by the automatic ticket gate 31, on the display DS. In this case, the control unit 13 may not display the information on the display DS.
As described above, the tracking unit 212 may repeat the tracking processing until the authentication subject (e.g., the person P1 in FIG. 7) passes through the tracking area TA. Therefore, the tracking position in the ID correspondence table 221 may be repeatedly updated until the authentication subject passes through the tracking area TA. For example, in a case where the tracking position linked to the tracking ID of one authentication subject permitted to pass through the automatic ticket gate 31 indicates a position after passing through the automatic ticket gate 31, the control unit 214 may link the ticket information (e.g., identification information about an IC ticket or mobile ticket) linked to the registrant corresponding to the one authentication subject, with the passage information indicating that the one authentication subject has entered the station A, and may transmit the linked information to the station server 41 via the communication apparatus 23. The station server 41 may transmit the ticket information and the passage information indicating entry to the station A, which are transmitted from the control unit 214, to the center server 50. As a result, the aforementioned one authentication subject having entered the station A may be registered in the entry/exit record 51.
This configuration makes it possible to prevent the information indicating that one authentication subject has entered the station A from being erroneously transmitted to the station server 41, in a case where the one authentication subject permitted to pass through the automatic ticket gate 31 does not pass through it (e.g., in a case where the one authentication subject makes a U-turn before reaching the automatic ticket gate 31).
For example, in a case where there is another automatic ticket gate around the automatic ticket gate 31, the control unit 214 may predict an automatic ticket gate to be used by one authentication subject permitted to pass through the automatic ticket gate, based on the tracking position in the ID correspondence table 221. In this case, the control unit 214 may control the predicted automatic ticket gate to open the flapper.
In a case where one authentication subject is not permitted to pass through the automatic ticket gate 31, the control unit 214 may control the automatic ticket gate 31 to close the flapper, via the station server 41. Alternatively, the control unit 214 may transmit, to the station server 41 via the communication apparatus 23, the ticket information linked to the registrant corresponding to the one authentication subject (i.e., the authentication ID linked to the tracking ID of the one authentication subject) and information indicating that the one authentication subject is not permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to close the flapper in response to the information transmitted from the control unit 214.
In this case, the control unit 214 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is not given, on the display DS. For example, the control unit 214 may display a message such as, for example, "Please have the ticket information read by the automatic ticket gate," on the display DS. For example, in a case where the permission to pass through the automatic ticket gate 31 is not given due to a failure in the facial recognition, the control unit 214 may display a message such as, for example, "Facial recognition is failed," on the display DS. For example, in a case where the permission to pass through the automatic ticket gate 31 is not given because the charge amount is less than the first predetermined amount (e.g., the minimum railway usage fee), the control unit 214 may display a message such as, for example, "Please recharge/add money to your card," on the display DS. For example, in a case where the automatic ticket gate 31 is an automatic ticket gate dedicated for users of cars requiring limited express tickets, and in a case where the permission to pass through the automatic ticket gate 31 is not given because the ticket information indicates a user does not have a limited express ticket, the control unit 214 may display a message such as, for example, "You are not allowed to use this gate," on the display DS.
The timing in which the control unit 214 gives notice of the information may be determined based on the tracking position and a face size of the authentication subject tracked by the tracking unit 212. For example, in a case where the tracking position of the authentication subject tracked by the tracking unit 212 is within a predetermined distance from the automatic ticket gate 31 and in a case where the facial recognition is not successful, the control unit 214 may give notice of the information or sound indicating a request to have the ticket information read by the automatic ticket gate. Furthermore, for example, in a case where the camera is oriented toward the facial recognition area from the gate, it can be expected that the detected face size will increase as the authentication subject approaches the gate. Therefore, the control unit 214 may give notice of the information in a case where the face size detected by the tracking unit 212 is larger than a predetermined size.
This configuration makes it possible to present a specific reason why the permission to pass through the automatic ticket gate 31 is not given to the authentication subject, while also prompting the authentication subject to take an appropriate action.
For example, in a case where a registrant corresponding to one authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA2 (i.e., a user attempting to exit from the station A) is identified by the facial recognition (in other words, in a case where the registrant has succeeded in the facial recognition), the control unit 214 may acquire the authentication ID linked to the tracking ID of the one authentication subject, in the ID correspondence table 221. The control unit 214 may acquire the ticket information linked to the acquired authentication ID, in the facial information DB 26. Based on the acquired ticket information, the control unit 214 may determine whether or not to permit the one authentication subject to pass through the automatic ticket gate 31.
For example, in a case where the acquired ticket information indicates that one authentication subject is to be permitted to exit from the station A, the control unit 214 may permit the one authentication subject to pass through the automatic ticket gate 31. On the other hand, in a case where the acquired ticket information indicates that one authentication subject is not to be permitted to exit from the station A, the control unit 214 may not permit the one authentication subject to pass through the automatic ticket gate 31. For example, in a case where a registrant corresponding to one authentication subject moving toward the automatic ticket gate 31 in the facial recognition area FRA2 is not identified by the facial recognition (e.g., in a case where the tracking ID is linked with the character string "N/A" or the field of the authentication ID is blank in the ID correspondence table 221), in other words, in a case where the registrant has failed in the facial recognition, the control unit 214 may not permit the one authentication subject to pass through the automatic ticket gate 31.
In this case, the control unit 214 may control the automatic ticket gate 31 to open the flapper, via the station server 41. Alternatively, the control unit 214 may transmit, to the station server 41, the ticket information linked to the registrant corresponding to the authentication subject and the information indicating that the authentication subject is permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to open the flapper in response to the information transmitted from the control unit 214.
In this case, the control unit 214 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is given, on the display DS. The control unit 214 may further display, for example, information indicating that it is not necessary to have the ticket information read by the automatic ticket gate 31, on the display DS. In this case, the control unit 13 may not display the information on the display DS.
For example, in a case where the tracking position linked to the tracking ID of one authentication subject permitted to pass through the automatic ticket gate 31 indicates a position after passing through the automatic ticket gate 31, the control unit 214 may link the ticket information (e.g., identification information about an IC ticket or mobile ticket) linked to the registrant corresponding to the one authentication subject, with the passage information indicating that the one authentication subject has exited from the station A, and may transmit the linked information to the station server 41 via the communication apparatus 23. The station server 41 may transmit the ticket information and the passage information indicating exit from the station A, which are transmitted from the control unit 214, to the center server 50. As a result, the aforementioned one authentication subject having exited from the station A may be registered in the entry/exit record 51.
In a case where one authentication subject is not permitted to pass through the automatic ticket gate 31, the control unit 214 may control the automatic ticket gate 31 to close the flapper, via the station server 41. Alternatively, the control unit 214 may transmit, to the station server 41 via the communication apparatus 23, the ticket information linked to the registrant corresponding to the one authentication subject (i.e., the authentication ID linked to the tracking ID of the one authentication subject) and the information indicating that the one authentication subject is not permitted to pass through the automatic ticket gate 31. The station server 41 may control the automatic ticket gate 31 to close the flapper in response to the information transmitted from the control unit 214.
In this case, the control unit 214 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is not given, on the display DS. For example, the control unit 214 may display a message such as, for example, "Please have the ticket information read by the automatic ticket gate," on the display DS. For example, in a case where the permission to pass through the automatic ticket gate 31 is not given due to a failure in the facial recognition, the control unit 214 may display a message such as, for example, "Facial recognition is failed," on the display DS. For example, in a case where the permission to pass through the automatic ticket gate 31 is not given because the charge amount is less than the second predetermined amount (e.g., the amount of money corresponding to a railway usage fee), the control unit 214 may display a message such as, for example, "Please recharge/add money to your card" on the display DS.

(Technical Effect)

According to the information processing apparatus 20 in the second example embodiment, as in the first example embodiment described above, even if a user enters using the facial recognition at one station and then exits from another station by having the ticket information read by the automatic ticket gate, it is possible to appropriately collect the railway usage fee (e.g., a fare) from that user. Furthermore, the information processing apparatus 20 enhances the convenience for station users.

An information processing apparatus, an information processing method, and a recording medium according to a third example embodiment will be described. The following describes the information processing apparatus, the information processing method, and the recording medium according to the third example embodiment, by using the information processing apparatus 20. In the third example embodiment, a description that overlaps with those of the first example and second embodiments is omitted as appropriate.
As described in the second example embodiment, for example, in a case where one authentication subject is permitted to pass through the automatic ticket gate 31, the control unit 214 may link the ticket information (e.g., identification information about an IC ticket or mobile ticket) linked to the registrant corresponding to the one authentication subject, with the passage information indicating that the one authentication subject has entered the station A or has exited from the station A, and may transmit the linked information to the station server 41 via the communication apparatus 23.
In this case, it can be said that, in a case where one authentication subject is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition and in a case where the one authentication subject passes through the automatic ticket gate, the communication apparatus 23 transmit the passage information, and the ticket information linked to the registrant corresponding to the one authentication subject identified by the facial recognition, to the outside of the information processing apparatus 20.
Thus, in a case where one authentication subject is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, the passage information indicating that the one authentication subject has entered the station A or has exited from the station A, may be transmitted to the station server 41.
By the way, even in a case where one authentication subject is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, the one authentication subject may sometimes have his/her IC ticket or mobile ticket read by the automatic ticket gate 31, for example. Such a behavior by the one authentication subject may be caused, for example, by the one authentication subject's habits, state of mind (e.g., anxiety), or unconsciously imitating the behavior of a person having passed through the automatic ticket gate 31 immediately before the one authentication subject, or the like.
In this case, in addition to the information processing apparatus 20, the automatic ticket gate 31 that reads the IC ticket or mobile ticket of the one authentication subject, also transmits, to the station server 41, the ticket information linked to the registrant corresponding to the one authentication subject and the passage information indicating that the one authentication subject has entered the station A or has exited from the station A. That is, the ticket information and the passage information about the one authentication subject are transmitted to the station server 41 in duplicate.
In this case, the station server 41 may delete (discard) one of the ticket information and the passage information about the one authentication subject transmitted from the information processing apparatus 20, and the ticket information and the passage information about the one authentication subject transmitted from the automatic ticket gate 31.
For example, in a case where one authentication subject enters the station A, the station server 41 may delete the ticket information and the passage information about the one authentication subject transmitted from the information processing apparatus 20, from among the ticket information and the passage information about the one authentication subject transmitted from the information processing apparatus 20 and the ticket information and the passage information about the one authentication subject transmitted from the automatic ticket gate 31. In a case where one authentication subject enters the station A, the station server 41 may delete the ticket information and the passage information about the one authentication subject transmitted from the automatic ticket gate 31, from among the ticket information and the passage information about the one authentication subject transmitted from the information processing apparatus 20 and the ticket information and the passage information about the one authentication subject transmitted from the automatic ticket gate 31.
For example, in a case where one authentication subject exits from the station A, the station server 41 may delete the ticket information and the passage information about the one authentication subject transmitted from the automatic ticket gate 31, from among the ticket information and the passage information about the one authentication subject transmitted from the information processing apparatus 20 and the ticket information and the passage information about the one authentication subject transmitted from the automatic ticket gate 31. In a case where one authentication subject exits from the station A, the station server 41 may delete the ticket information and the passage information about the one authentication subject transmitted from the information processing apparatus 20, from among the ticket information and the passage information about the one authentication subject transmitted from the information processing apparatus 20 and the ticket information and the passage information about the one authentication subject transmitted from the automatic ticket gate 31.
In a case where one authentication subject is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, and in a case where the one authentication subject has his/her IC ticket or mobile ticket read by the automatic ticket gate 31, the control unit 214 of the information processing apparatus 20 may control the automatic ticket gate 31 to make a sound indicating passage permission, regardless of a result of the automatic ticket gate 31 reading the IC ticket or mobile ticket.
Alternatively, in a case where one authentication subject is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, and in a case where the one authentication subject has his/her IC ticket or mobile ticket read by the automatic ticket gate 31, the automatic ticket gate 31 may make a sound corresponding to the result of reading the IC ticket or mobile ticket, and the control unit 214 of the information processing apparatus 20 may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is given, on the display DS (see FIG. 7).
Due to differences in the sound or displayed information, the authentication subject can determine how the passage is permitted, such as whether by the IC ticket or mobile ticket, or based on the result of the facial recognition, while performing the same action of presenting the IC ticket or mobile ticket to the automatic ticket gate 31. This allows the authentication subject to choose the action of presenting the IC ticket or mobile ticket to the automatic ticket gate 31, because, for example, as upon entry, the authentication subject can confidently know a success in the facial recognition while presenting the IC ticket or mobile ticket to the automatic ticket gate 31, and upon exit, the authentication subject knows the success in the facial recognition upon entry. For example, in a case where the facial recognition is completed before the authentication subject has the IC ticket or mobile ticket read by the automatic ticket gate 31, the action of having the IC ticket or mobile ticket read by the automatic ticket gate 31 may be detected and notice may be given.
As described in the second example embodiment, in a case where one authentication subject is not permitted to pass through the automatic ticket gate 31, the control unit 214 of the information processing apparatus 20 may display information indicating that permission to pass through the automatic ticket gate 31 is not given, on the display DS. In this case, when the authentication subject has the IC ticket or mobile ticket read by the automatic ticket gate 31 and is permitted to pass through the automatic ticket gate 31, the automatic ticket gate 31 may open the flapper and may display, for example, information indicating that permission to pass through the automatic ticket gate 31 is given, on the display DS (i.e., may change display on the display DS). Furthermore, in a case where the automatic ticket gate 31 reads the IC ticket or mobile ticket of one authentication subject, it may display, on the display DS, the result of the facial recognition related to the one authentication subject, in addition to a result of reading the ticket information. This configuration allows the one authentication subject to know the result of the facial recognition.

(Technical Effect)

According to the third example embodiment, in a case where one authentication subject is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, even if the one authentication subject has his/her IC ticket or mobile ticket read by the automatic ticket gate 31, it is possible to appropriately perform the processing related to the one authentication subject's entry to/exist from the station A.

An information processing apparatus, an information processing method, and a recording medium according to a fourth example embodiment will be described. The following describes the information processing apparatus, the information processing method, and the recording medium according to the fourth example embodiment, by using the information processing apparatus 20. In the fourth example embodiment, a description that overlaps with those of the first example to third embodiments is omitted as appropriate.
For example, a person permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, can pass through the automatic ticket gate 31 even without having a ticket (e.g., at least one of an IC ticket and a mobile ticket). Hereinafter, the person permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition will be referred to as a "legitimate right holder" as appropriate.
Consequently, in a case where a legitimate right holder uses a railway, a person who is different from the legitimate right holder could fraudulently use at least one of the legitimate right holder's ticket and mobile ticket.
For example, in a case where one authentication subject corresponding to the legitimate right holder is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, the control unit 214 links the ticket information (e.g., identification information about an IC ticket or mobile ticket) linked to a registrant corresponding to the one authentication subject, facial recognition information indicating that the one authentication subject has succeeded in the facial recognition, and the passage information indicating that the one authentication subject has entered the station A or has exited from the station A, with each other, and may then transmit the linked information to the station server 41 via the communication apparatus 23. The station server 41 may transmit the ticket information, the facial recognition information, and the passage information, which are transmitted from the information processing apparatus 20, to the center server 50. The facial recognition information may include a success in the facial recognition and a time at which the facial recognition is performed (e.g., corresponding to the "authentication time" in the ID correspondence table 221).
The center server 50 may prohibit the use at the station A of an IC ticket or mobile ticket with the identification information indicated by the ticket information linked to the registrant corresponding to one authentication subject (i.e., the legitimate right holder's IC ticket or mobile ticket), after a lapse of a first predetermined time from the facial recognition of the one authentication subject corresponding to the legitimate right holder. Alternatively, the center server 50 may perform identity verification processing at the time of the use at the station A of an IC ticket or mobile ticket with the identification information indicated by the ticket information linked to the registrant corresponding to one authentication subject (i.e., the legitimate right holder's IC ticket or mobile ticket), after a lapse of the first predetermined time from the facial recognition of the one authentication subject corresponding to the legitimate right holder.
This configuration makes it possible to prevent a person who is different from the legitimate right holder from fraudulently using at least one of the legitimate right holder's IC ticket and mobile ticket.
For example, in a case where one authentication subject corresponding to the legitimate right holder is permitted to pass through the automatic ticket gate 31 based on the result of the facial recognition, the control unit 214 links the payment information linked to the registrant corresponding to the one authentication subject, time information indicating the time at which the facial recognition is performed on the one authentication subject (e.g., corresponding to the "authentication time" in the ID correspondence table 221), and position information indicating the position of the one authentication subject (e.g., corresponding to the "tracking position" in the ID correspondence table 221) with each other, and may transmit the linked information to one system that provides a payment/settlement service (e.g., a payment/settlement service by a credit card, etc.) via the communication apparatus 23
The one system may prohibit the use of the one authentication subject's payment method (e.g., a credit card), within a second predetermined time from the time of the facial recognition of the one authentication subject corresponding to the legitimate rights holder, outside a range in which the one authentication subject can travel within the second predetermined time
This configuration makes it possible to prevent a person who is different from the legitimate rights holder from fraudulently using the legitimate rights holder's payment method.

(Technical Effect)

According to the fourth example embodiment, it is possible to prevent at least one of the legitimate rights holder's IC ticket, mobile ticket, and payment method from being fraudulently used by a person who is different from the legitimate rights holder.

With respect to the example embodiments described above, the following Supplementary Notes are further disclosed.

(Supplementary Note 1)

An information processing apparatus including:

an image acquisition unit that acquires an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information;
a facial recognition unit that performs facial recognition on an authentication subject included in the image, based on the image; and
a control unit that performs, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.

(Supplementary Note 2)

The information processing apparatus according to Supplementary Note 1, wherein the authentication subject is a person moving from a side of the one area toward a side of another area of the first area and the second area.

(Supplementary Note 3)

The information processing apparatus according to Supplementary Note 1 or 2, further including a tracking unit that tracks the authentication subject in a tracking area that includes the facial recognition area and that is larger than the facial recognition area.

(Supplementary Note 4)

The information processing apparatus according to Supplementary Note 3, wherein the tracking area includes at least a part of the one area and at least a part of the another area of the first area and the second area.

(Supplementary Note 5)

The information processing apparatus according to any one of Supplementary Notes 1 to 4, wherein the control unit displays information indicating whether or not the ticket information is necessary for the authentication subject to pass through the gate apparatus, based on the result of the facial recognition.

(Supplementary Note 6)

The information processing apparatus according to any one of Supplementary Notes 1 to 5, wherein

the control unit controls the gate apparatus to open the gate, in a case where the authentication subject is permitted to pass through the gate apparatus based on the result of the facial recognition, and
the control unit controls the gate apparatus to close the gate, in a case where the authentication subject is not permitted to pass through the gate apparatus based on the result of the facial recognition.

(Supplementary Note 7)

The information processing apparatus according to any one of Supplementary Notes 1 to 6, wherein the control unit displays information indicating a reason why the gate is closed, in a case where the control unit controls the gate apparatus to close the gate based on the result of facial recognition.

(Supplementary Note 8)

The information processing apparatus according to any one of Supplementary Notes 1 to 7, further including a transmission unit that transmits, to an outside of the information processing apparatus, the ticket information linked to a registrant corresponding to the authentication subject identified by the facial recognition, and passage information indicating that the authentication subject has passed through the gate apparatus, in a case where the authentication subject is permitted to pass through the gate apparatus based on the result of the facial recognition and in a case where the authentication subject has passed through the gate apparatus.

(Supplementary Note 9)

The information processing apparatus according to any one of Supplementary Notes 1 to 8, wherein the control unit controls the gate apparatus to make a sound indicating permission to pass through the gate apparatus, regardless of a result of reading the ticket information, in a case where the authentication subject is permitted to pass through the gate apparatus based on the result of the facial recognition, and in a case where the authentication subject has the ticket information read by the gate apparatus.

(Supplementary Note 10)

The information processing apparatus according to any one of Supplementary Notes 1 to 9, wherein the control unit displays the result of the facial recognition in a case where the authentication subject has the ticket information read by the gate apparatus.

(Supplementary Note 11)

The information processing apparatus according to any one of Supplementary Notes 1 to 10, further including a transmission unit that transmits, to an outside of the information processing apparatus, at least one of the ticket information linked to a registrant corresponding to the authentication subject identified by the facial recognition, and payment information about a payment method.

(Supplementary Note 12)

An information processing method including:

acquiring an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information;
performing facial recognition on an authentication subject included in the image, based on the image; and
performing, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.

(Supplementary Note 13)

A recording medium on which a computer program that allows a computer to execute an information processing method is recorded, the information processing method including:

The present disclosure is permitted to be changed, if desired, without departing from the essence or spirit of this disclosure which can be read from the claims and the entire specification. An information processing apparatus, an information processing method, and a recording medium with such changes are also intended to be within the technical scope of the present disclosure.

Description of Reference Codes

1... Ticket gate system
10, 20...Information processing apparatus
11, 211... Image acquisition unit
12, 213... Facial recognition unit
13, 214... Control unit
14, 26, 60... Facial information database
31, 32... Automatic ticket gate
41, 42... Station server
50... Center server
212... Tracking unit
221... ID correspondence table

Claims

An information processing apparatus comprising:
an image acquisition unit that acquires an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information;

a facial recognition unit that performs facial recognition on an authentication subject included in the image, based on the image; and

a control unit that performs, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.
The information processing apparatus according to Claim 1, wherein the authentication subject is a person moving from a side of the one area toward a side of another area of the first area and the second area.
The information processing apparatus according to Claim 1 or 2, further comprising a tracking unit that tracks the authentication subject in a tracking area that includes the facial recognition area and that is larger than the facial recognition area.
The information processing apparatus according to Claim 3, wherein the tracking area includes at least a part of the one area and at least a part of the another area of the first area and the second area.
The information processing apparatus according to any one of Claims 1 to 4, wherein the control unit displays information indicating whether or not the ticket information is necessary for the authentication subject to pass through the gate apparatus, based on the result of the facial recognition.
The information processing apparatus according to any one of Claims 1 to 5, wherein
the control unit controls the gate apparatus to open the gate, in a case where the authentication subject is permitted to pass through the gate apparatus based on the result of the facial recognition, and

the control unit controls the gate apparatus to close the gate, in a case where the authentication subject is not permitted to pass through the gate apparatus based on the result of the facial recognition.
The information processing apparatus according to any one of Claims 1 to 6, wherein the control unit displays information indicating a reason why the gate is closed, in a case where the control unit controls the gate apparatus to close the gate based on the result of facial recognition.
The information processing apparatus according to any one of Claims 1 to 7, further comprising a transmission unit that transmits, to an outside of the information processing apparatus, the ticket information linked to a registrant corresponding to the authentication subject identified by the facial recognition, and passage information indicating that the authentication subject has passed through the gate apparatus, in a case where the authentication subject is permitted to pass through the gate apparatus based on the result of the facial recognition and in a case where the authentication subject has passed through the gate apparatus.
The information processing apparatus according to any one of Claims 1 to 8, wherein the control unit controls the gate apparatus to make a sound indicating permission to pass through the gate apparatus, regardless of a result of reading the ticket information, in a case where the authentication subject is permitted to pass through the gate apparatus based on the result of the facial recognition, and in a case where the authentication subject has the ticket information read by the gate apparatus.
The information processing apparatus according to any one of Claims 1 to 9, wherein the control unit displays the result of the facial recognition in a case where the authentication subject has the ticket information read by the gate apparatus.
The information processing apparatus according to any one of Claims 1 to 10, further comprising a transmission unit that transmits, to an outside of the information processing apparatus, at least one of the ticket information linked to a registrant corresponding to the authentication subject identified by the facial recognition, and payment information about a payment method.
An information processing method comprising:
acquiring an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information;

performing facial recognition on an authentication subject included in the image, based on the image; and

performing, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.
A recording medium on which a computer program that allows a computer to execute an information processing method is recorded, the information processing method including:
acquiring an image including a facial recognition area that is set in one area of a first area and a second area, which are partitioned by a gate apparatus that reads ticket information and performs an operation of opening/closing a gate based on the read ticket information;

performing facial recognition on an authentication subject included in the image, based on the image; and

performing, based on a result of the facial recognition, at least one of controlling the gate apparatus to open or close the gate, and displaying information.