JP2016053896A - Gate system and method of controlling passage of gate - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a gate system and a method of controlling passage of a gate with which unauthorized passage of a gate can be prevented and an owner of a legitimate passport can smoothly pass a gate.SOLUTION: A collation device 100 includes a passport reader 103 that reads a face image from a passport P and cameras 101b and 108 that photograph a face image of a traveler T. The collation device 100 collates the face image read by the passport reader 103 with the face image photographed by the cameras 101b and 108, and when both the face images match with each other, sets both or either one of the face images as a reference face image. The collation device 100 collates a face image photographed by cameras 314 and 324 at a gate 40 with the reference face image to determine whether or not a person approaching the gate 40 can pass through the gate.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a gate system and a gate passing control method for confirming whether or not the person is a person based on information held in a passport and allowing a legitimate passport holder to pass the gate.

  In immigration screening, the examiner compares and contrasts the face photo affixed to the passport with the face of the person being screened to confirm that the person being screened is the rightful holder of the passport. Since this process takes a relatively long time, a gate system that automates the immigration examination has been proposed.

  For example, Patent Document 1 proposes a method of identity verification using issuance of a pass ticket. In this method, the face image stored in the passport is read by a pass ticket issuing machine. In addition, a face image of the person who possesses the passport is captured by the passport issuing machine. The two face images acquired in this way are collated, and when both coincide, a pass ticket is issued from the pass ticket issuing machine. By inserting the issued pass ticket into the gate, the gate is opened and can pass.

  Patent Document 1 also discloses a technique of acquiring a face image at a gate and confirming the identity without using issuance of a pass ticket. In this method, the gate is opened when the face image captured by the gate matches the face image read from the passport.

JP 2002-8070 A

  Among the methods described above, in the method of issuing a pass ticket, the gate can be illegally passed by handing the issued pass ticket to another person. In the technique of performing face matching at the gate, such illegal passage can be prevented. However, in the method of performing face matching at the gate, even if the passport is a legitimate holder, the face images may be mismatched due to aging or the like. For this reason, there is a concern that the passage efficiency of the gate is lowered and the gate is congested.

  In view of such problems, an object of the present invention is to provide a gate system and a gate passing control method that enable a legitimate holder of a passport to smoothly pass through the gate while preventing unauthorized passage of the gate. .

  A first aspect of the present invention relates to a gate system that determines whether or not a gate can pass based on a result of identity verification of a passport holder. The gate system according to this aspect includes a reading unit that reads personal information including a first face image from a storage medium arranged in a passport, and acquires a second face image by imaging a person facing the reading unit. A first imaging unit, a second imaging unit that captures a person proceeding to the gate and obtains a third facial image, the first facial image read by the reading unit, and the first imaging unit The second face image obtained by the above is collated, and when the first face image and the second face image match each other, at least the first face image and the second face image One of them is set as a reference face image, the third face image acquired by the second imaging unit is compared with the reference face image, and whether or not the person going to the gate can pass the gate is determined. And a control unit for determining.

  In the first aspect, “facing the reading unit” means that the face does not necessarily have to be directed to the reading unit, but is close to the reading unit in order to cause the reading unit to read the passport. To do. In addition, the “person who proceeds to the gate” does not necessarily have to advance toward the gate, and means a person who is in the state of proceeding to the gate, such as when temporarily stopping near the gate.

  A second aspect of the present invention relates to a gate system that determines whether or not a gate can pass based on a result of identity verification of a passport holder. A gate system according to this aspect includes a reading unit that reads personal information including biological information from a storage medium arranged in a passport, a first acquisition unit that acquires biological information of a person facing the reading unit, and the gate A second acquisition unit that acquires the biological information of the person who proceeds, the first biological information read by the reading unit and the second biological information acquired by the first acquisition unit; When two pieces of biological information and the first biological information match each other, at least one of the first biological information and the second biological information is set as reference biological information, and the second acquisition is performed. A control unit that collates the third biological information acquired by the unit with the reference biological information and determines whether or not the person who proceeds to the gate can pass through the gate.

  A third aspect of the present invention relates to a gate passage control method for determining whether or not a gate can be passed based on a result of identity verification of a passport holder. The gate passing control method according to this aspect reads the personal information from the storage medium arranged in the passport to acquire the first face image, images the person presenting the passport for the personal information reading operation, Two face images are acquired, the first face image and the second face image are collated, and at least the first face image and the second face image match each other. Any one of the face image and the second face image is set as a reference face image, and a third face image is obtained by capturing an image of a person proceeding to the gate, and the third face image and the reference A face image is collated to determine whether or not a person going to the gate can pass through the gate.

  According to the present invention, the first face image read by the reading unit and the second face image acquired by the first imaging unit are collated, and the first face image and the second face image are mutually compared. If they match, at least one of the first face image and the second face image is set as the reference face image. Then, the third face image acquired by the second imaging unit arranged in the gate and the reference face image are collated to determine whether or not the person going to the gate can pass through the gate. In this way, the reference face image set by prior identity verification and the face image acquired at the gate are collated to determine whether or not the gate can be passed. It can pass. Therefore, unauthorized passage of the gate can be prevented. In addition, since the right holder of the passport proceeds to the gate after confirming that the first face image and the second face image match in advance, the third face of the holder acquired at the gate The probability that the image and the reference face image match each other is considerably high, and normally the passage of the gate is permitted. Thus, a legitimate holder of the passport can smoothly pass through the gate.

  As described above, according to the present invention, it is possible to provide a gate system and a gate passage control method that allow a legitimate holder of a passport to smoothly pass through the gate while preventing unauthorized passage of the gate.

FIG. 1 is a perspective view showing a configuration of an examination area according to the embodiment. FIG. 2 is a plan view schematically showing a configuration of the examination area according to the embodiment and an arrangement example of staff members and examiners. FIG. 3A is a perspective view showing the configuration of the collation device according to the embodiment, and FIGS. 3B and 3C are front views showing the configuration of the head portion of the collation device according to the embodiment. is there. 4A and 4B are plan views showing the configuration of the passport reader according to the embodiment, respectively. FIG. 5A is a diagram schematically illustrating imaging angles by two cameras of the integrated device according to the embodiment, and FIGS. 5B and 5C are schematic examples of captured images at the respective angles. FIG. FIG. 6 is a front view showing the configuration of the gate device according to the embodiment. FIG. 7 is a block diagram showing a configuration of the gate system according to the embodiment. FIG. 8A and FIG. 8B are block diagrams each showing a configuration of a part of the gate system according to the embodiment. FIG. 9A is a flowchart showing identity verification processing in the booth server, and FIG. 9B is a flowchart showing processing at the time of face image reception in the gate server. FIGS. 10A to 10C are diagrams illustrating operations of the head unit, the notification unit, and the passport reader in the collation device, respectively. FIG. 11A is a flowchart showing flapper opening / closing control in the gate server, and FIG. 11B is a flowchart showing processing in the gate server when a traveler passes the gate. FIG. 12 is a diagram illustrating a configuration of the gate screen according to the embodiment. FIG. 13 is a diagram illustrating a configuration of a booth server according to the first modification. FIG. 14A is a flowchart illustrating the face image transmission processing of the booth server according to the first modification, and FIG. 14B is a flowchart illustrating reception processing of the face image of the booth server according to the first modification. FIGS. 15A and 15B are flowcharts showing the identity verification process of the collation device according to the first modification, and FIG. 15C is a flowchart showing the face image erasing process of the booth server according to the first modification.

  Embodiments of the present invention will be described below with reference to the drawings. The passport used in the present embodiment is an IC passport on which an IC chip is mounted, and is generally called an E passport. In addition to the identification items described on the passport, such as the nationality, name, date of birth, etc. of the holder, the face image of the owner is recorded on the IC chip. The IC passport is a booklet type like the conventional passport, but a card storing an IC chip and a communication antenna is incorporated in the center of the booklet.

  In the following embodiment, an example in which the present invention is applied to an airport departure gate system is shown. In the embodiment, the passport P and the passport reader 103 correspond to “passport” and “reading unit” described in the claims, respectively. Further, the face image read from the passport P corresponds to the “first face image” recited in the claims, and the face images captured by the cameras 101b and 108 are “second images” recited in the claims. Corresponding to the “face image”, the face image captured by the cameras 314 and 324 corresponds to the “third face image” recited in the claims. In the embodiment, the control units 501 and 601 of the booth servers 500 and 600 and the control unit 701 of the gate server 700 realize the “control unit” described in the claims.

  First, referring to FIG. 1, an examination area for carrying out an immigration examination will be described.

  The examination area is divided into two regions having entrances 10 and 20 by a plurality of belt pole partitions 1. The inlet 10 is followed by a barrel-shaped closed area 30, and a gate 40 is connected to the outlet of the closed area 30. The entrance 20 is followed by a lane 21. A traveler who intends to undergo immigration examination by an automated gate system (hereinafter referred to as “automated gate system”) proceeds to entrance 10, and a traveler who intends to undergo immigration examination by an examiner proceeds to entrance 20. . Children and care recipients are preferentially passed through the entrance 20.

  The closed region 30 is provided with face matching booths 31 and 32 on both sides. In each of these face matching booths 31 and 32, three matching devices 100 are arranged. In the collation apparatus 100, reading of information held in the passport and identity verification by face collation are performed. An IC chip is arranged in the passport, and information including a face image of the passport holder, personal information, a passport ID and the like is stored in the IC chip. The identity verification is performed based on whether or not the face image read from the passport matches the face image captured by the verification device 100. The flow of identity verification at the face matching booths 31 and 32 will be described later with reference to FIG.

  A video playback system 200 is disposed near the entrance 10 in the closed area 30. The video playback system 200 broadcasts guidance on how to use the automated gate system. The traveler views the guidance broadcast from the video playback system 200 at the waiting position 11 near the outside of the entrance 10 as appropriate. The closed area 30 is further provided with an outlet 33 that proceeds to the lane 21.

  The gate 40 includes two gate devices 310 and 320. In the gate devices 310 and 320, a face image of the traveler who goes to the gate 40 is captured, and the identity of the traveler is confirmed again. Depending on the result of identity verification, the flapper (not shown in FIG. 1) of the gate devices 310 and 320 is opened and closed. The flow of identity verification and flapper opening / closing control in the gate 40 will be described later with reference to FIG.

  A counter 50 is provided behind the gate 40 and the lane 21. A gate inspector is assigned to the counter 50 at the back of the gate 40, and a lane inspector is assigned to the counter 50 at the back of the lane 21. The traveler who has passed through the gate 40 proceeds to the exit 61 through the front of the counter 50. A traveler who has passed through the lane 21 is subjected to an exit examination by an examiner in front of the counter 50 and then proceeds to an exit 62.

  Next, with reference to FIG. 2, the arrangement of staff in the examination area and the flow of travelers will be described.

  As shown in FIG. 2, examiners E1 and E2 and staff members M1 and M2 are arranged in the examination area. The examiner E2 conducts a departure examination for the traveler T passing the lane 21. The traveler T who undergoes immigration examination by the automated gate system proceeds to the gate 40 after receiving identity verification at one of the face matching booths 31 and 32. The clerk M1 assists the traveler T in the closed area 30 and guides the traveler T, who is deemed inappropriate by the departure examination by the automated gate system, from the exit 33 to the lane 21. The clerk M2 monitors the traveler T traveling on the lane 21.

  The counter 50 is provided with a gate monitor 51 made of a touch panel. The examiner E1 monitors the traveler T passing through the gate 40 while referring to the screen displayed on the gate monitor 51, and manually opens the flapper of the gate 40 as appropriate. The opening and closing of the flapper by the examiner E1 will be described later with reference to FIG.

  Next, the configuration of the verification device 100 arranged in the face verification booths 31 and 32 in the examination area and the configuration of the gate devices 310 and 320 arranged in the gate 40 will be described.

  First, the configuration of the verification device 100 will be described with reference to FIGS. 3 (a) to 3 (c).

  As shown in FIG. 3A, the collation device 100 includes a head unit 101, a notification unit 102, a passport reader 103, a table 104, and two walls 105. The head unit 101 is supported by a support 107 on the back side of the notification unit 102 by a hollow shaft 106. A wiring that continues to the head portion 101 passes through the shaft 106.

  As shown in FIG. 3 (b), the identification number 101 a of the verification device 100 is printed on the head unit 101. A camera 101b is disposed below the identification number 101a, and a display lamp 101c is disposed around the camera 101b. The display lamp 101c lights up in red or blue. FIG. 3C schematically shows a state when the display lamp 101c is turned on. Further, in FIG. 3B, only the lens portion of the camera 101 b is visible, and the other configuration of the camera 101 b is accommodated in the head portion 101.

  The notification unit 102 displays a message using a dial. A camera 108 is arranged on the upper center side of the notification unit 102. In FIG. 3A, only the lens portion of the camera 108 is visible, and the other configuration of the camera 108 is accommodated inside the support base 107. A passport reader 103 is arranged at the center of the table 104 so that the detection surface faces upward. The passport reader 103 is covered with walls 105 on the left and right sides.

  FIG. 4A is a diagram illustrating the configuration of the passport reader 103.

  As shown in FIG. 4A, on the upper surface of the passport reader 103, a reading area 103a and two lamp portions 103b are arranged. The area 103c in front of the reading area 103a describes the method for placing the passport P on the reading area 103a. The traveler T places the passport P on the reading area 103a according to this explanation, and causes the passport reader 103 to read the passport P. A touch sensor is arranged on the upper surface of the reading area 103a in order to detect that the passport P is placed. The passport reader 103 has a known configuration for reading information from the IC chip of the passport P without contact.

  When the passport P is not placed in the reading area 103a (hereinafter referred to as “standby state”), the lamp unit 103b is in a blinking state (intermittent lighting). When the passport P is placed in the reading area 103a in the standby state, the lamp unit 103b is turned on (continuous lighting) as shown in FIG. 4B.

  Here, with reference to FIGS. 5A to 5C, how the face images of the traveler T facing the verification device 100 are captured by the cameras 101b and 108 will be described.

  As shown in FIG. 5A, the camera 101b of the head unit 101 is arranged so that the imaging direction (angle) is horizontal. The camera 108 disposed above the notification unit 102 is disposed such that the imaging direction (angle) is directed upward by a predetermined angle from the horizontal. The display surface of the notification unit 102 is also tilted in the same manner as the imaging direction of the camera 108. The cameras 101b and 108 respectively image the face of the traveler T facing the passport reader 103 from the front and the lower side. The cameras 101b and 108 respectively image the face of the traveler T facing the passport reader 103 at different angles in the vertical direction.

  FIGS. 5B and 5C schematically show the face images of the traveler T captured by the cameras 101b and 108, respectively. These face images are when the traveler T is looking in the direction of the passport P as shown in FIG. In this case, the face of the traveler T substantially faces the lower camera 108, and the upper camera 101b faces a position slightly shifted from the front of the face toward the top of the head. For this reason, the face image captured by the camera 101b is a face image in which the face is slightly crawled, as shown in FIG. 5B. Further, the face image captured by the camera 108 is a substantially frontal face image as shown in FIG.

  Unlike the case of FIG. 5A, when the traveler T is looking in the front direction, the face of the traveler T is directly facing the upper camera 108. Images are taken by the camera 101b. Further, since the lower camera 108 is opposed to a position slightly shifted from the front of the face of the traveler T to the chin side, a face image when the face of the traveler T is viewed from obliquely below is captured by the camera 108. The

  Next, the configuration of the gate devices 310 and 320 will be described with reference to FIG.

  The gate device 310 includes a pair of gate bodies 311 and 312 arranged side by side, a support column 313 extending upward from the back of the right gate body 311, a camera 314 installed at the upper end of the support column 313, and an upper portion of the camera 314. And a lamp 315 installed in the main body. The gate bodies 311 and 312 have a predetermined thickness in the left-right direction and are arranged in parallel to each other. A space between the gate bodies 311 and 312 is a passage for the traveler T.

  Rotating shafts 311 a and 312 a extending in the vertical direction are provided inside the gate bodies 311 and 312. Flappers 311b and 312b for blocking the passage are fixed to the rotary shafts 311a and 312a. When the rotation shafts 311a and 312a are rotated by a motor (not shown), the flappers 311b and 312b rotate in the inner direction, and the passage is opened. The gate bodies 311 and 312 are installed on the base B, and the passage portion of the base B has an inclined surface Ba.

  The camera 314 has a substantially horizontal imaging direction and captures a face image of the traveler T heading to the gate device 310. The camera 314 is positioned at the height of a standard stretched adult face. The camera 314 images the target area at a predetermined viewing angle. The vertical viewing angle of the camera 314 is large enough to cover the extension difference of the traveler T. The lamp 315 can be lit in blue or red.

  The gate device 310 is provided with a sensor (not shown) for detecting that the traveler T passes through the passage between the gate bodies 311 and 312 when the flappers 311b and 312b are opened. This sensor is composed of, for example, an optical sensor including a light emitting unit and a light receiving unit. In this case, one of the light emitting unit and the light receiving unit is provided in the gate body 311, and the other is provided in the gate body 312.

  The gate device 320 has the same configuration as the gate device 310. The gate device 320 includes a pair of gate bodies 321 and 322 arranged side by side, a column 323 extending upward from the back of the left gate body 321, a camera 324 installed at the upper end of the column 323, and an upper portion of the camera 324. And a lamp 325 installed in the main body. Rotating shafts 321a and 322a extending in the vertical direction are provided inside the gate bodies 321 and 322, and flappers 321b and 322b for blocking the passage are fixed to the rotating shafts 311a and 312a. Similarly to the gate device 310, the gate device 320 is provided with a sensor (not shown) for detecting the passage of the traveler T.

  Next, the overall configuration of the gate system will be described with reference to FIG.

  The six verification devices 100 arranged in the examination area are controlled by booth servers 500 and 600 arranged in offices outside the examination area. The gate devices 310 and 320 and the gate monitor 51 arranged in the examination area are controlled by the gate server 700 arranged in the office. The office further includes a console 801 for inputting / outputting information to / from the booth servers 500 and 600 and the gate server 700, and an office switch 802 including a switching hub.

  The booth server 500 includes a control unit 501, a communication unit 502, and a storage unit 503. The control unit 501 includes an arithmetic processing unit such as a CPU, and the storage unit 503 includes a hard disk drive and storage elements such as a ROM and a RAM. The control unit 501 controls the three matching devices 100 on the face matching booth 31 (see FIG. 1) according to the control program stored in the storage unit 503. The communication unit 502 is connected to the office switch 802 via a LAN cable, and is connected to the face authentication unit 504 via USB. The face authentication unit 504 processes the face image input from the control unit 501 and performs face authentication described later.

  The booth server 600 has the same configuration as the booth server 500. The booth server 600 includes a control unit 601, a communication unit 602, and a storage unit 603. The control unit 601 controls the three matching devices 100 on the face matching booth 32 (see FIG. 1) side according to the control program stored in the storage unit 603. The communication unit 602 is connected to the office switch 802 via a LAN cable, and is connected to the face authentication unit 604 via a USB. The face authentication unit 604 processes the face image input from the control unit 601 and performs face authentication described later.

  The gate server 700 has the same configuration as the booth server 500. The gate server 700 includes a control unit 701, a communication unit 702, and a storage unit 703. The control unit 701 controls the two gate devices 310 and 320 of the gate 40 (see FIG. 1) and the gate monitor 51 of the counter 50 (see FIG. 2) according to the control program stored in the storage unit 703. The communication unit 702 is connected to the office switch 802 via a LAN cable, and is connected to the face authentication unit 704 via USB. The face authentication unit 704 processes the face image input from the control unit 701 and performs face authentication described later.

  In the examination area, an area switch 901, a booth 1 POE switch 902, a booth 2 POE switch 903, and a gate POE switch 904 are arranged. The area switch 901 is composed of a switching hub. Booth 1 POE switch 902, booth 2 POE switch 903, and gate POE switch 904 are network switches corresponding to POE (Power Over Ethernet: Ethernet is a registered trademark) that uses an Ethernet communication cable.

  The area switch 901 is connected to the office switch 802 with a LAN cable. The booth 1 POE switch 902 is connected to the three verification devices 100 of the face verification booth 31 (see FIG. 1) via a LAN cable, and the booth 2 POE switch 903 is connected to the three verification devices 100 of the face verification booth 32 (see FIG. 1). Connected with a LAN cable. The gate POE switch 904 is connected to the two gate devices 310 and 320 of the gate 40 (see FIG. 1) with a LAN cable. Booth 1 POE switch 902, booth 2 POE switch 903, and gate POE switch 904 are connected to area switch 901 with a LAN cable. Further, the gate monitor 51 of the counter 50 (see FIG. 2) is connected to the area switch 901 with a LAN cable.

  FIG. 8A shows a connection form between the booth 1 POE switch 902 and one verification device 100. The booth 1 POE switch 902 includes cameras 101b and 108 (see FIGS. 3A and 3B) arranged in the verification device 100, a lamp control unit 109, a notification control unit 110, and a passport reader 103 (see FIG. 3). 3 (a)). The lamp control unit 109 controls the display lamp 101c (see FIG. 3B) arranged in the head unit 101 (see FIG. 3A). The notification control unit 110 controls the notification unit 102 (see FIG. 3A). The passport reader 103 reads information stored in the IC chip P1 of the passport P.

  The booth 1 POE switch 902 is connected to the other two verification devices 100 in the same manner as in FIG. The booth 2 POE switch 903 is connected to the three verification devices 100 in the same manner as in FIG.

  FIG. 8B is a diagram showing a connection form between the gate POE switch 904 and the gate device 310. The gate POE switch 904 is connected to a camera 314 (see FIG. 6) disposed in the gate device 310, a lamp control unit 316, and a gate flapper control unit 317. The lamp control unit 316 controls the lamp 315 disposed in the gate device 310 (see FIG. 6). The gate flapper control unit 317 controls the rotation shafts 311a and 312a arranged in the gate device 310 (see FIG. 6). The gate POE switch 904 is connected to the gate device 320 in the same manner as in FIG. The gate device 320 also has the same configuration as that in FIG.

  Next, the identity verification process in the booth server 500 will be described with reference to FIG. This process is performed by the control unit 501 of the booth server 500. FIG. 9A shows a process for authenticating one of the three verification devices 100 that the booth server 500 controls. The processing for personal authentication for the other two verification devices 100 is the same as the following. The personal authentication process in the booth server 600 is the same as the following.

  The control unit 501 waits for the passport P to be placed in the reading area 103a on the upper surface of the passport reader 103 (S101). As described above, the touch sensor is arranged on the upper surface of the reading area 103a. The control unit 501 monitors the output of the touch sensor and determines whether or not the passport P is placed in the reading area 103a. When the passport P is not placed in the reading area 103a (standby state), the pair of lamp portions 103b on the upper surface of the passport reader 103 are blinking.

  When the passport P is placed in the reading area 103a on the upper surface of the passport reader 103 (S101: YES), the control unit 501 controls the passport reader 103 to read various information stored in the IC chip P1 of the passport P (S102). ). At this time, the control unit 501 stores the information read from the IC chip P1 in the storage unit 503. Thereafter, the control unit 501 starts a face matching process in cooperation with the face authentication unit 504 (S103). Further, the control unit 501 controls the lamp control unit 109 to turn on the display lamp 101c of the head unit 101 in blue (S104). In addition, the control unit 501 switches the lamp unit 103b on the upper surface of the passport reader 103 to a lighting state.

  In the face collation process, the control unit 501 controls the cameras 101b and 108 to capture the face images of the traveler T facing the passport reader 103 at predetermined time intervals. The control unit 501 causes the storage unit 503 to sequentially store two face images captured at each imaging timing. The control unit 501 transmits the face image acquired from the IC chip P1 to the face authentication unit 504, and further transmits two face images captured at the first imaging timing to the face authentication unit 504.

  The face authentication unit 504 extracts facial features from the received face image, determines whether at least one of the two captured face images matches the face image acquired from the IC chip P1, and determines The result is transmitted to the control unit 501. The control unit 501 determines suitability of face matching based on the received determination result (S105). If neither of the two captured face images matches the face image stored in the IC chip P1 (S105: NO), the control unit 501 determines whether a time-out has occurred (whether a predetermined time has elapsed since the start of face matching). (S106). If not time-out (S106: NO), the control unit 501 transmits two face images captured at the next imaging timing to the face authentication unit 504, and determines whether face matching is appropriate (S105). In this way, the control unit 501 repeats face collation for the face image captured at each imaging timing. In S106, the timeout may be determined based on whether or not imaging or face matching has been performed a predetermined number of times.

  When at least one of the two face images captured at the predetermined imaging timing matches the face image acquired from the IC chip P1 (S106: YES), the control unit 501 determines that the traveler T facing the passport reader 103 is a valid passport P. It is determined that the user is the owner (person), and the face matching process is terminated (S107). Then, the control unit 501 transmits the face image acquired from the passport P and the face image at the imaging timing determined to match the face image to the gate server 700 (S108).

  In S108, not only one face image that matches the face image acquired from the passport P, but also the other face image that does not match, of the two face images captured by the cameras 101b and 108, is also the gate server. 700 is transmitted. In addition to these face images, the identification number 101a of the collation apparatus 100 that has been subjected to the identity verification process and information (passport ID) for specifying the passport P are transmitted to the gate server 700. Further, the control unit 501 controls the notification control unit 110 to display a predetermined notification when the face matching is matched on the notification unit 102 (S109). In addition, the control unit 501 and the lamp unit 103b on the upper surface of the passport reader 103 are switched to the off state.

  On the other hand, if it is determined that the face collation does not match (S105: NO) and time-out occurs (S106: YES), the control unit 501 ends the face collation process (S110) and controls the lamp control unit 109. Then, the lighting color of the display lamp 101c of the head unit 101 is switched from blue to red (S111). Furthermore, the control unit 501 controls the notification control unit 110 to display a notification when the face matching is inconsistent on the notification unit 102 (S112). In addition, the control unit 501 and the lamp unit 103b on the upper surface of the passport reader 103 are switched to the off state.

  When information including a face image is transmitted to the gate server 700 in S108 of FIG. 9A, the process of FIG. 9B is executed in the gate server 700. When the control unit 701 of the gate server 700 receives information including a face image from the booth server 500 (or booth server 600) (S201: YES), the control unit 701 stores the information in the storage unit 703 and uses the face for face matching. An image reference target is set (S202). Further, the control unit 701 updates a screen (hereinafter referred to as “gate screen”) displayed on the gate monitor 51 of the counter 50 based on the received information (S203). The configuration of the gate screen will be described later with reference to FIG.

  Next, with reference to FIGS. 10A to 10C, the operation of the verification apparatus 100 when the identity verification process of FIG. 9A is performed will be described. 10A to 10C schematically show the states of the head unit 101, the notification unit 102, and the passport reader 103, respectively.

  In the standby state in which the passport P is not placed in the reading area 103a, the lamp unit 103b is set in a blinking state as described above. At this time, the display lamp 101c of the head unit 101 is in the off state. Further, the notification unit 102 is not notified in any way.

  In the standby state, the traveler T places the passport P on the reading area 103a, and when this is detected by the passport reader 103, as shown in the lower part of FIG. Switch from blinking to lit. Further, as shown in the upper part of FIG. 10A, the display lamp 101c of the head unit 101 is lit in blue. At this time, the notification unit 102 is maintained in the non-notification state as shown in the middle part of FIG.

  After that, when face matching is determined to be coincident by the face collation processing in S103 to S106 in FIG. 9A, the face collation is informed to the notification unit 102 as shown in the middle part of FIG. In the event of a failure, a predetermined notification is made. Here, a notification sentence that prompts the traveler T to proceed to the gate 40 is displayed on the notification unit 102. At this time, the display lamp 101c of the head unit 101 remains in a blue lighting state as shown in the upper part of FIG. Further, as shown in the lower part of FIG. 10B, the lamp unit 103b of the passport reader 103 is switched from the lighting state to the extinguishing state.

  In response to the notification shown in the middle part of FIG. 10B, the traveler T removes the passport P from the reading area 103 a and proceeds to the gate 40. Thus, when the passport P is removed from the reading area 103a, the head unit 101, the notification unit 102, and the passport reader 103 are returned to the standby state.

  On the other hand, if it is determined that the face matching is unmatched by the face matching processing in S103 to S106 in FIG. 9A, the face matching is not matched in the notification unit 102 as shown in the middle part of FIG. A predetermined notification in the case of Here, a notification sentence that prompts the traveler T to wait for an attendant is displayed on the notification unit 102. At this time, as shown in the upper part of FIG. 10C, the lighting color of the display lamp 101c of the head unit 101 is switched from blue to red. Further, as shown in the lower part of FIG. 10C, the lamp unit 103b of the passport reader 103 is switched from the lighting state to the extinguishing state.

  In response to the notification shown in the middle part of FIG. 10C, the traveler T waits for an attendant M1 (see FIG. 2) to come. Since the head unit 101 is at the highest position of the verification device 100, the clerk M1 sees the display lamp 101c of the head unit 101 from a position away from the verification device 100 in the closed region 30 (see FIG. 2). Can do. Therefore, the clerk M1 can grasp the progress status of the face matching and the determination result of the face matching by the lighting state of the display lamp 101c of the head unit 101 even at a position away from the matching device 100.

  The clerk M1 sees that the display lamp 101c of the head unit 101 is lit in red as shown in the upper part of FIG. 10 (c), grasps that the face matching is inconsistent, and approaches the traveler T to travel. Assist person T. Specifically, the clerk M1 explains to the traveler T that the face matching is inconsistent, and urges the traveler T to undergo the departure examination by the examiner E2 (see FIG. 2). Then, the clerk M1 guides the traveler T from the exit 33 to the lane 21.

  With the assistance from the staff member M1, the traveler T removes the passport P from the reading area 103a and proceeds from the exit 33 to the lane 21. Thus, when the passport P is removed from the reading area 103a, the head unit 101, the notification unit 102, and the passport reader 103 are returned to the standby state.

  Next, flapper opening / closing control in the gate server 700 will be described with reference to FIG. This control is performed by the control unit 701 of the gate server 700. FIG. 11A shows control of one of the two gate devices 310 and 320 that the gate server 700 is responsible for. The other control is performed in the same manner as described below. Here, for the sake of convenience, description will be made assuming that the control target is the gate device 310.

  The control unit 701 detects a person based on the captured image from the camera 314, and determines whether or not the traveler T has approached the entrance of the gate device 310 (S211). When the traveler T approaches the entrance of the gate device 310 (S211: YES), the control unit 701 starts a face matching process in cooperation with the face authentication unit 704 (S212).

  In the face collation process, the control unit 701 controls the camera 314 to capture the face image of the traveler T who proceeds to the gate device 310 at a predetermined time interval. The control unit 701 causes the storage unit 703 to sequentially store face images captured at each imaging timing. Hereinafter, the face image captured by the camera 314 is referred to as a “gate face image”.

  In addition, the control unit 701 reads out the face images acquired from the booth servers 500 and 600 by the processing of FIG. 9B from the storage unit 703 and transmits the face images to the face authentication unit 704. As described above, the face images acquired from the booth servers 500 and 600 include the face image read from the passport P by the verification device 100 and the two face images captured by the cameras 101b and 108 in the verification device 100. . These three types of face images are set as face images that are referred to in face matching in the gate device 310. Hereinafter, these three types of face images are referred to as “reference face images”.

  In addition, in the storage unit 703, a traveler T (hereinafter referred to as a “non-passing traveler”) whose face matching is determined to be the same by any of the matching devices 100 and has not yet passed through the gate 40. Reference face images for the number of persons (referred to as “T”) are stored. The control unit 701 reads the reference face images of all non-passing travelers T from the storage unit 703 and transmits them to the face authentication unit 704. Further, the control unit 701 transmits the gate face image captured by the camera 314 at the first imaging timing to the face authentication unit 704.

  The face authentication unit 704 extracts facial features from the received face image, determines whether or not the gate face image matches at least one of the three reference face images of each non-passing traveler. The result is transmitted to the control unit 701. The control unit 701 determines whether face matching is appropriate based on the received determination result (S213). When the gate face image does not match any reference face image of each non-passing traveler (S213: NO), the control unit 701 determines whether or not a timeout has occurred (whether or not a predetermined time has elapsed since the start of face matching). Is determined (S214). If not time-out (S214: NO), the control unit 701 transmits the gate face image captured at the next imaging timing to the face authentication unit 704, and the gate face image is the three reference faces of each non-passing traveler. It is determined whether or not the image matches at least one of the images (S213). In this way, the control unit 701 repeats face collation for the gate face image captured at each imaging timing. In S214, the timeout may be determined based on whether or not imaging or face matching has been performed a predetermined number of times.

  When the gate face image captured at a predetermined imaging timing matches at least one of the reference face images (S213: YES), the control unit 701 determines that the traveler T heading for the gate device 310 is a valid owner of the passport P (the person himself / herself). ), The face matching process is terminated (S215). Then, the control unit 701 controls the lamp control unit 316 to turn on the lamp 315 installed on the upper part of the camera 314 in blue (S216). Further, the control unit 701 updates the gate screen on the gate monitor 51 installed in the counter 50 so as to include the screen in the case where the face matching is the same (S217). Then, the control unit 701 controls the gate flapper control unit 317 to open the flappers 311b and 312b of the gate device 310 (S218). Thus, the gate device 310 can pass through.

  On the other hand, if it is determined that the face collation does not match (S213: NO) and time-out occurs (S214: YES), the control unit 701 ends the face collation process (S219) and controls the lamp control unit 316. Then, the lighting color of the lamp 315 installed on the upper part of the camera 314 is switched from blue to red (S220). Further, the control unit 701 updates the gate screen on the gate monitor 51 installed in the counter 50 so as to include a screen in the case where the face matching is not matched (S221). In this case, the gate device 310 is maintained in a state in which it cannot pass through without the flappers 311b and 312b being opened.

  Next, the gate screen 400 displayed on the gate monitor 51 will be described with reference to FIG.

  The gate screen 400 includes areas 401, 402, and 403. In the area 401, a list of face images 401a of the travelers T who have not been passed through the gate 40, that is, those who have not passed through the gate 40, is displayed. Of the three reference face images, the face image read from the passport P is used as the face image 401a. Alternatively, a face image that matches the face image read from the passport P among the two face images captured by the collation device 100 may be used as the face image 401a.

  On the upper side and the lower side of each face image 401a, the position (booth number) of the collation device where the face collation is performed for each traveler and the time when the face collation is performed are added. The time is added based on the time when the gate server 700 receives the reference face image and the identification number of the verification device 100 from the booth servers 500, 600, and the booth number is added based on the received identification number of the verification device 100. The

  In S203 of FIG. 9B, the image displayed in the area 401 is updated. When the control unit 701 of the gate server 700 receives the information including the reference face image for the new non-passing traveler T, the control unit 701 displays the face image 401a of the non-passing traveler T in the region 401 based on the received reference face image. Add to.

  In the area 402, the face matching result in the gate device 310 is displayed. In the example of FIG. 12, a screen (hereinafter referred to as “passing OK screen”) when the face matching is the same is displayed in the area 402. The passage OK screen includes a mark 402a for specifying the gate device 310, three face image areas 402b to 402d, a mark 402e indicating that the gate can be passed, and text indicating that the gate can be passed. 402f is included. Here, the gate device 310 is set to A gate. In the face image areas 402b to 402d, a face image read from the passport P, an image captured by the collation device 100, and a face image captured by the gate device 310 are displayed. In the face image area 402c, a face image that matches the face image read from the passport P among the face images captured by the two cameras 101b and 108 of the collation apparatus 100 is displayed.

  In a region 403, the face matching result in the gate device 320 is displayed. In the example of FIG. 12, a screen (hereinafter referred to as “passing NG screen”) when face matching does not match is displayed in area 403. The passing NG screen includes a mark 403a for specifying the gate device 320, three face image areas 403b to 403d, a mark 403e indicating that the gate cannot be passed, and text indicating that the gate cannot be passed. 403f and a manual release button 403g. Here, the gate device 320 is set to the B gate. On the passing NG screen, no face image is displayed in the face image areas 403b and 403c. The face image captured by the gate device 320 is displayed in the face image area 403d. When the manual release button 403g is pressed, the flappers 321b and 322b of the manual release button 403g are released.

  If the face matching result in the gate device 310 does not match, a pass NG screen is displayed in the area 402. In addition, when the face collation result in the gate device 320 is the same, a pass OK screen is displayed in the area 403. The passing OK screen has a green background color, and the passing NG screen has a red background color.

  In S217 and S221 of FIG. 11A, the screens displayed in the areas 402 and 403 are updated. In S217, the control unit 701 of the gate server 700 displays a pass OK screen in one of the regions 402 and 403, and displays a pass NG screen in any of the regions 402 and 403 in S221.

  The examiner E1 (refer to FIG. 2) arranged on the counter 50 refers to the lighting colors of the lamps 315 and 325 (refer to FIG. 6) and the screens displayed in the areas 402 and 403 to thereby determine the gate devices 310 and 320. It is possible to grasp whether or not the face collation result is consistent. In the example of FIG. 12, the lamp 315 is lit in green, and the lamp 325 is lit in red. In this case, the gate device 310 can pass through with the flappers 311b and 312b opened. The non-passing traveler T that has proceeded to the gate device 310 proceeds to the exit 61 (see FIG. 2) through the gate device 310. The examiner E1 allows the non-passing traveler T to pass through the gate while referring to the lighting color of the lamp 315 and the display of the area 402.

  On the other hand, in the example of FIG. 12, the gate device 320 cannot pass through because the flappers 321b and 322b are closed. In this case, the examiner E1 compares the face image displayed in the face image area 403d of the area 403 with the face image 401a of the non-passing traveler T displayed in the area 401, and proceeds to the gate device 320. It is confirmed whether or not the traveler T is a non-passing traveler T. When it is confirmed that the traveler T who intends to proceed to the gate device 320 is one of the non-passing travelers T, the examiner E1 operates the manual release button 403g in the region 403 to operate the gate device 320. The flappers 321b and 322b are opened. Thus, the gate device 320 can pass through. The traveler T passes through the gate device 320 and proceeds to the counter 50. Examiner E1 prompts the traveler T to present his passport P as appropriate and conducts an exit examination. Alternatively, the traveler T is prompted to proceed to the exit 61 as it is, and the traveler T is allowed to leave the country.

  On the other hand, when confirming that the traveler T who intends to proceed to the gate device 320 does not match any of the non-passing travelers T, the examiner E1 instructs the attendant M1 (see FIG. 2) to guide the traveler T. Ask. The clerk M1 explains the situation to the traveler T and guides it to the exit 33 as appropriate. Alternatively, when the traveler T has not yet received face matching by the matching device 100, the traveler T is guided to the matching device 100.

  Next, with reference to FIG. 11B, a process in the gate server 700 when the non-passing traveler T passes the gate 310 will be described. This process is performed by the control unit 701 of the gate server 700.

  In the example of FIG. 12, when the non-passing traveler T passes the gate device 310 (S231: YES), the control unit 701 closes the flappers 311b and 312b of the gate device 310 (S232), and further turns off the lamp 315. (S233). In addition, the control unit 701 deletes the three reference face images corresponding to the face images displayed in the face image areas 402b to 402d from the storage unit 703 (S234). Further, the control unit 701 updates the gate screen 400 to reflect the passage of the non-passing traveler T (S235). Here, the three face images, the mark 402e and the text 402f are deleted from the area 402, and the background color of the area 402 is set to gray. Further, the face image 401 a corresponding to the non-passing traveler T is deleted from the area 401.

  When the non-passing traveler T passes through the gate device 320 when the gate device 320 is in a passable state, the information in the storage unit 703 is deleted and the gate screen 400 is updated by the processing in FIG. Is done.

<Effect of embodiment>
According to the present embodiment, the following effects can be achieved.

  When the face image read from the passport P by the passport reader 103 matches one of the two face images acquired by the cameras 101b and 108 of the collation apparatus 100, these three face images are set as reference face images. Is done. These reference face images and the gate face images acquired by the cameras 314 and 324 arranged in the gate devices 310 and 320 are collated to determine whether or not the traveler T traveling to the gate can pass through the gate. In this way, identity verification is performed in advance via the verification device 100. Further, the reference face image set by the identity verification and the gate face image acquired at the gate are verified to determine whether the gate can pass. Therefore, only a legitimate holder (person) of the passport P can pass through the gate 40. Therefore, unauthorized gate passage can be prevented. In addition, since a valid holder of the passport P proceeds to the gate 40 after confirming that the face matching is the same in the matching device 100 in advance, the reference face image set by the face matching and the gate 40 The probability of matching the owner's gate face image acquired in step 1 with each other is considerably high, and normally the passage of the gate 40 is permitted. Therefore, a legitimate holder of the passport P can pass through the gate 40 smoothly without being denied at the gate 40.

  The fact that the face collation at the gate 40 is inconsistent is notified by the lighting color of the lamps 315 and 325. Thus, the examiner E1 and the staff member M1 can take an appropriate and prompt response to the traveler T heading for the gate 40.

  In the collation device 100, the face images of the traveler T are captured by two cameras 101b and 108 at different angles up and down, and face collation is performed. Thereby, even if the orientation of the face changes up and down, the probability that the face matching is matched increases, and the face matching in the matching device 100 can be efficiently advanced.

  When one of the two face images captured at different angles by the cameras 101b and 108 matches the face image of the passport P, both of the captured face images are set as reference face images, and face matching at the gate 40 is performed. To be served. Thus, since face images of different angles are used for face matching in the gate 40, the probability that the face matching in the gate 40 matches is increased, and face matching in the gate 40 can be efficiently advanced.

  Since the camera 108 is arranged around the upper side of the passport reader 103, the traveler T easily faces the camera 108 when the passport reader 103 reads the passport P. For this reason, it is easy to acquire a face image of the front view by the camera 108, and the face image acquired by the camera 108 and the face image of the passport P are easily matched. Therefore, face matching in the matching device 100 can be efficiently advanced.

  When the collation apparatus 100 does not determine that the face collation is coincident, a notification sentence (refer to the middle row in FIG. 10C) regarding the handling method is displayed on the notification unit 102. In addition, even when it is determined that the face matching is the same, a notification sentence (see the middle row in FIG. 10B) regarding the next progress is displayed on the notification unit 102. Thereby, traveler T can advance a subsequent response smoothly.

  When the collation apparatus 100 does not determine that the face collation is the same, the display lamp 101c that can be seen from a distant position is lit in red, and the attendant M1 is notified that the face collation does not coincide. Thereby, the attendant M1 can assist quickly without making the traveler T wait.

  Six verification devices 100 are assigned to one closed area 30, and no lane for restricting the travel of the traveler T is provided in the closed area 30. For this reason, the traveler T can arbitrarily access the six matching devices 100, and can smoothly and efficiently advance face matching by the matching device 100. Therefore, the stay of the traveler T in the automated gate system can be suppressed, and the departure procedure by the automated gate system can be advanced promptly.

<Modification 1>
In the first modification, the face image captured by the matching device 100 is used in face matching of the automated gate system in another area.

  FIG. 13 is a diagram illustrating a configuration of the first modification. As shown in FIG. 13, in the first modification, the automated gate system shown in the above embodiment is arranged in a plurality of regions (airports) in and outside the country. Booth servers 500 and 600 arranged in the automated gate system in each region are connected to each other via a network communication network 1000 such as the Internet. As in the above embodiment, the booth servers 500 and 600 control the verification device 100 of the automated gate system in each region.

  The automated gate system for each region is not limited to the departure gate, but is also located at the entry gate. Based on the automated gate system installed at the departure gate, the automated gate system installed at the entry gate in the same region is also treated as an automated gate system in other regions.

  For example, in an automated gate system (departure gate) arranged in a predetermined area, when a non-passing traveler T passes through the gate 40, a notification to that effect is associated with the reference face image of the non-passing traveler T. Along with the passport specifying information (passport ID), the information is transmitted from the gate server 700 to the booth server that performed face matching of the non-passing traveler T among the booth servers 500 and 600 in the same region. For example, when the matching device 100 that performed face matching on the non-passing traveler T that has passed through the gate 40 is controlled by the booth server 500, the notification and the passport specifying information are transmitted to the booth server 500.

  FIG. 14A is a diagram illustrating a process when the booth server 500 in the same area receives the notification and the passport specifying information from the gate server 700. This process is performed by the control unit 501 of the booth server 500.

  When the control unit 501 of the booth server 500 in the same area receives the notification and the passport specifying information (S121: YES), the face image associated with the passport specifying information among the face images captured by the cameras 101b and 108 is displayed. The face image read from the storage unit 503 is transmitted to the booth servers 500 and 600 in other areas together with the passport specifying information (S122). The passport identification information transmitted at this time includes, in addition to the passport ID, other information for identifying the passport P read from the IC chip P1, such as the name, address, date of birth, etc. of the owner of the passport P. Also good. These pieces of information are also transmitted and stored in other booth servers 600 arranged in the same area.

  FIG. 14B is a diagram showing processing when the booth servers 500 and 600 in other regions receive the face image and the passport specifying information by the processing of FIG. This process is performed by the control units 501 and 601 of the booth servers 500 and 600 in other areas.

  When the control units 501 and 601 of the booth servers 500 and 600 in other areas receive a face image and passport specifying information from a certain area via the network communication network 1000 (S131: YES), the control unit 501 and 601 receives the received face image and passport specifying information. The data are stored in the storage units 503 and 603 (S132). In this way, the face image and the passport specifying information are shared by the booth servers 500 and 600 in each region connected by the network communication network 1000.

  FIGS. 15A and 15B are flowcharts showing identity verification processing in the booth server 500 in each region. Here, S141 is added to the flowchart of FIG. 9A, and S108 is modified. Other steps are the same as those in FIG. The identity verification process in the booth server 600 is also modified in the same manner as FIGS. 15 (a) and 15 (b).

  When the control unit 501 of the booth server 500 reads information from the passport P in S102, the control unit 501 further searches the storage unit 503 using the passport specifying information in the read information as reference information (S141). In this search, the control unit 501 checks whether or not the face image associated with the passport specifying information (a face image captured by face collation processing in another area) is stored in the storage unit 503. When the face image associated with the passport specifying information is stored in the storage unit 503, the control unit 501 reads the face image from the storage unit 503 and uses it for face matching in the matching device 100.

  That is, when face collation is started in S103, the control unit 501 determines whether at least one of the face images captured by the cameras 101b and 108 matches the face image read from the passport P or the face image read from the storage unit 503. Is determined (S105 in FIG. 9A). If the two face images match (S105: YES), the control unit 501 gates the face image read from the passport P, the face image taken by the cameras 101b and 108, and the face image read from the storage unit 503. It transmits to the server 700 (S108). In this way, these face images are set as reference face images to be referred to in the face collation of the gate 40. That is, in the present modification example, the reference face image further includes the face image read from the storage unit 503.

  The gate server 700 performs face matching in the gate 40 and flapper opening / closing control based on the reference face image thus set. The control in the gate 40 is the same as that in FIG. 11A except that the face image read from the storage unit 503 is included in the reference face image.

  According to the modification example 1, since the face images stored in the storage units 503 and 603 are further used for face matching in the matching apparatus 100, the probability that the face matching is determined to be further increased. That is, in the above embodiment, only the face image read out from the passport P is compared with the face image captured by the cameras 101b and 108, so the face image stored in the passport P is old, When there is a change in the face of the passport holder, it is easy to determine that the face matching in the matching device 100 is inconsistent. On the other hand, in the first modification, the face images at the time closer to the present than the time stored in the passport P are stored in the storage units 503 and 603, and this is further used for face matching in the matching device 100. Therefore, the probability that the face collation in the collation apparatus 100 is determined to match is increased, and the identity of the traveler T can be confirmed more efficiently. Similarly, the face matching at the gate 40 increases the probability that the face matching is determined to match, so that the passage through the gate 40 can be made more efficient.

  For example, if a traveler T who has left the country stays overseas for a short period of time and enters the home country after sunburn or haircut during that period, it is determined that the face image at the time of entry does not match the face image of the passport P. easy. In the modified example 1, even in such a case, since the face image captured and stored at the time of departure is used for face matching, it is easy to determine that face matching is a match.

  The face image and the passport specifying information in the booth servers 500 and 600 can be deleted after a certain period of time has elapsed from the time of storage as shown in FIG. 15C (S151: YES, S152). . In this case, when the traveler T travels a plurality of times and a plurality of face images are stored in association with the same passport specifying information, only the face images that have passed a predetermined time from the time of storage are deleted. The other face images are stored in the storage units 503 and 603. For face collation, the latest face image stored in the storage units 503 and 603 may be used, or all face images stored in the storage units 503 and 603 may be used.

<Other changes>
In the embodiment, both the face image read from the passport P and the face images captured by the cameras 101b and 108 are set as the reference face images used for the face collation of the gate 40. It may be set as a reference face image. For example, only face images captured by the cameras 101b and 108 may be set as reference face images.

  In addition, face images captured by the cameras 101b and 108 may be further included in the reference face image at a certain time before and after the capturing timing of the face image that matches the face image read from the passport P. This makes it easier to determine that face matching at the gate 40 is appropriate.

  In the embodiment, whether or not the gate 40 can pass is determined depending on whether any one of the three face images set as the reference face image matches the face image captured by the cameras 314 and 324 of the gate devices 310 and 320. Of the three face images set as the reference face image, one of the face image acquired from the passport P and the two face images captured by the matching device 100 is captured by the cameras 314 and 324. It may be determined whether the face image matches the face image captured, or it may be determined whether all the three face images set as the reference face image match the face images captured by the cameras 314 and 324. good.

  In the embodiment, the face images are captured by the cameras 101 b and 108 after the passport P is placed on the passport reader 103. Instead of this method, imaging of a face image by the cameras 101b and 108 may be started when it is detected that the traveler T has arrived in front of the verification device 100. In this case, in response to the passport P being placed on the passport reader 103, the face image captured so far is compared with the face image read from the passport P, and collation processing is executed.

  In the embodiment, the example in which the automated gate system is installed at the departure gate is shown, but the present invention can also be applied when the automated gate system is installed at the entry gate.

  In the embodiment, the booth servers 500 and 600 and the gate server 700 are installed in the office, and the verification device 100 and the gate devices 310 and 320 are controlled. However, the control for controlling the verification device 100 and the gate devices 310 and 320 is performed. The apparatus may be arranged in the examination area, and the control apparatus installed in the office and the control apparatus installed in the examination area may cooperate to control the collation apparatus 100 and the gate apparatuses 310 and 320. The booth servers 500 and 600 and the gate server 700 may be integrated into one server.

  In the embodiment, the face authentication units 504, 604, and 704 are arranged. However, the functions of the face authentication units 504, 604, and 704 may be provided in the booth servers 500 and 600 and the gate server 700 in advance. In this case, the face authentication units 504, 604, and 704 are omitted.

  In the embodiment, the gate devices 310 and 320 are provided with the flappers 311b and 312b and the flappers 321b and 322b, respectively. However, a configuration in which the flap devices are not provided in the gate devices 310 and 320 may be assumed. For example, the travel person T may determine whether or not the gate devices 310 and 320 can be passed by looking at the lighting colors of the lamps 315 and 325, and whether the examiner E1 or the staff M1 can pass the gate devices 310 and 320. May be notified to the traveler T and the passage arrangement at the gate 40 may be performed.

  Further, the gate passage blocking means is not limited to the flapper but may be a bar or the like. Further, the notification means for determining whether or not the gate can pass is not limited to the lamps 315 and 325, and may be notification by voice, for example.

  The collation result in the collation apparatus 100 is not limited to the display lamp 101c but may be transmitted by voice. Alternatively, the clerk M1 may be configured as a wireless terminal, and the collation result in the collation device 100 may be notified from the wireless terminal to the clerk M1.

  In the embodiment, the collation apparatus 100 is provided with the two cameras 101b and 108 at different angles in the vertical direction, but the arrangement of the cameras is not limited to this. For example, cameras may be provided at different angles in the horizontal direction, and three or more cameras may be arranged.

  In the gate screen 400 of FIG. 12, for example, when the traveler T goes to the lane 21 without passing through the gate 40 after receiving the face matching in the matching device 100, the non-passing traveler is displayed in the region 401. There is a possibility that the face image 401a of T remains without being erased. In order to cope with such a case, it is preferable to provide a configuration in which the examiner E1 can erase the face image 401a that is not erased for a long time. For example, a configuration in which the face image 401 a is erased from the area 401 when the examiner E1 continues to touch the face image 401 on the area 401 for a certain period of time can be considered. In addition, since there is a certain limitation on the size of the area 401, a configuration in which the face image 401a in the area 401 can be appropriately scrolled may be provided.

  In the above embodiment, the biometric information used for identification is a face image. However, when other biometric information such as a fingerprint, a voiceprint, a vein pattern, etc. is stored in the passport P, the biometric information is used. Can also be used for identity verification. However, since the face image can be acquired without contact with the traveler T and even when the traveler T is walking, the optimal biological body at the present time is required to smoothly and efficiently pass through the automated gate system. It can be said that it is information.

  Furthermore, the present invention is not limited to a gate system at an airport, but can be applied to other gate systems such as a gate system when boarding a ship. The embodiment of the present invention can be variously modified in addition to the above.

30 ... Closed region 40 ... Gate 100 ... Collating device 101b, 108 ... Camera (first imaging unit)
101c ... Indicator lamp (transmission part)
102 ... Notification unit 103 ... Passport reader (reading unit)
310, 320 ... Gate device (gate)
311b, 312b, 321b, 322b ... Flapper (blocking mechanism)
314, 324 ... Camera (second imaging unit)
315, 325 ... Lamp (notification part)
500, 600 ... Booth server (control unit)
700 ... Gate server (control unit)

Claims (13)

A gate system that determines whether or not a passport can be passed according to the identity verification result of the passport holder,
A reading unit for reading personal information including the first face image from a storage medium arranged in the passport;
A first imaging unit that captures a person facing the reading unit and obtains a second face image;
A second imaging unit that captures a person who proceeds to the gate and acquires a third face image;
The first face image read by the reading unit and the second face image acquired by the first imaging unit are collated, and the first face image and the second face image are mutually matched. If they match, at least one of the first face image and the second face image is set as a reference face image, and the third face image acquired by the second imaging unit and the reference A control unit that collates a face image and determines whether or not the person who goes to the gate can pass through the gate,
A gate system characterized by that. The gate includes an openable / closable blocking mechanism that blocks the passage,
2. The gate system according to claim 1, wherein the control unit opens the blocking mechanism when the person proceeding to the gate is allowed to pass through the gate. The gate includes a gate notification unit for notifying that a person who proceeds to the gate refuses to pass the gate,
3. The gate system according to claim 1, wherein the control unit activates the gate notification unit when a person proceeding to the gate refuses to pass the gate. 4. The first imaging unit includes a plurality of cameras that capture images of persons facing the reading unit at different angles,
4. The control unit according to claim 1, wherein the control unit collates the second face image captured by each of the plurality of cameras with the first face image read by the reading unit. 5. The described gate system.   The control unit, when any one of the second face images captured by the plurality of cameras matches the first face image, the second face that matches the first face image. The gate system according to claim 4, wherein together with the image, the second face image of another angle that does not match the first face image is set as the reference face image.   The gate system according to claim 4 or 5, wherein one of the plurality of cameras is arranged around the reading unit. A notification unit for notifying a person facing the reading unit of predetermined information;
When the first face image read by the reading unit and the second face image acquired by the first imaging unit do not match each other, the control unit passes through the notification unit. The gate system according to any one of claims 1 to 6, wherein information on a handling method is notified to a person facing the reading unit. A notification unit that enables the collation result of the first face image and the second face image to be grasped even at a position away from the reading unit;
In response to the fact that the first face image read by the reading unit and the second face image acquired by the first imaging unit do not match each other, the control unit The gate system according to claim 1, wherein the gate system is operated. The reading unit is disposed in a closed region having an inlet and an outlet,
The gate is disposed at the exit of the closed region;
The gate system according to claim 1, wherein the reading unit and the gate are installed in the closed region so that one gate is allocated to the plurality of reading units.   The gate system according to any one of claims 1 to 9, wherein the closed region is configured such that there is no lane restriction and an attendant can freely walk in the area. A communication unit capable of communicating with other gate systems through a network;
A storage unit,
The controller is
The second face image that matches the first face image is stored in the storage unit together with specific information that can specify the passport, and further, the second face image and Sending the specific information to another gate system;
When the second face image captured by the other gate system and the specific information read by the other gate system are received from the other gate system via the communication unit, Storing the second face image and the specific information in the storage unit;
The second face image captured by the first imaging unit, together with the first face image acquired by the reading unit reading the passport, and corresponding to the passport stored in the storage unit 11. The gate system according to claim 1, wherein the gate system is collated with a second face image to determine whether or not the reference face image can be set. A gate system that determines whether or not a passport can be passed according to the identity verification result of the passport holder,
A reading unit for reading personal information including biological information from a storage medium arranged in the passport;
A first acquisition unit for acquiring biological information of a person facing the reading unit;
A second acquisition unit for acquiring biological information of a person who proceeds to the gate;
The first biological information read by the reading unit and the second biological information acquired by the first acquisition unit are collated, and the second biological information and the first biological information match each other. In this case, at least one of the first biological information and the second biological information is set as reference biological information, and the third biological information and the reference biological information acquired by the second acquisition unit And a control unit that determines whether or not the person going to the gate can pass through the gate,
A gate system characterized by that. A gate passage control method for determining passability of a passport holder based on the identity confirmation result of the passport holder,
Read the personal information from the storage medium placed on the passport to obtain the first face image,
Capture a person presenting the passport in the reading operation of the personal information to obtain a second face image,
When the first face image and the second face image are collated, and the first face image and the second face image match each other, at least the first face image and the second face image Set any one of the face images as the reference face image,
Capture a person going to the gate to obtain a third face image,
Collating the third face image with the reference face image to determine whether or not the person going to the gate can pass through the gate;
A method for controlling the passage of a gate.

Images