JP2023057099A - Information processing device, information processing method, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device, information processing method, and recording medium, which allow for quickly completing acquisition of information and verification of biological information.

SOLUTION: An information processing device is provided, comprising a reading unit configured to read a medium of a user to acquire information including biological information of the user from the medium, and a biological information acquisition unit configured to acquire biological information of the user form the user while reading the medium.

SELECTED DRAWING: Figure 21

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an information processing device, an information processing method, and a recording medium.

Patent Document 1 describes an immigration control card system using a smart passport card. The system described in Patent Literature 1 obtains baggage declaration card information from the smart passport card by placing the smart passport card on a terminal at a customs check facility and performs customs check.

Japanese Unexamined Patent Application Publication No. 2002-304448

However, as in the system described in Patent Document 1, if biometric information is collated for identity verification separately from acquiring information from a card, it is difficult to obtain information and collate biometric information in a short time. is difficult to complete.

SUMMARY OF THE INVENTION An object of the present invention is to provide an information processing apparatus, an information processing method, and a recording medium capable of completing acquisition of information and collation of biometric information in a short period of time.

According to one aspect of the present invention, a reading unit that reads a medium of the user and acquires information including biometric information of the user from the medium; An information processing apparatus having a biometric information acquisition unit that acquires biometric information of a user is provided.

According to another aspect of the present invention, the reading unit reads the user's medium to acquire information including the user's biometric information from the medium, and the biometric information acquisition unit reads the medium. An information processing method for acquiring biometric information of the user from the user is provided.

According to still another aspect of the present invention, an information processing apparatus having a reading unit and a biometric information acquiring unit reads a medium of the user by the reading unit and acquires the biometric information of the user from the medium. A recording medium is provided in which a program is recorded that acquires information contained therein and causes the biometric information acquisition unit to acquire biometric information of the user from the user during reading of the medium.

ADVANTAGE OF THE INVENTION According to this invention, acquisition of information and collation of biometric information can be performed in a short time.

FIG. 1 is a schematic diagram showing the overall configuration of an information processing system according to one embodiment of the present invention. FIG. 2 is a schematic diagram showing a customs inspection area equipped with a kiosk terminal and an electronic gate according to an embodiment of the present invention. FIG. 3 is a block diagram showing an example of the hardware configuration of the mobile terminal according to one embodiment of the present invention. FIG. 4A is a schematic diagram showing the appearance of a kiosk terminal according to one embodiment of the present invention. FIG. 4B is a schematic diagram showing the appearance of a kiosk terminal according to one embodiment of the present invention. FIG. 5 is a block diagram showing an example of the hardware configuration of the kiosk terminal according to one embodiment of the present invention. FIG. 6A is a schematic diagram showing a configuration when one kiosk terminal is installed according to an embodiment of the present invention. FIG. 6B is a schematic diagram showing a configuration when one kiosk terminal is installed according to an embodiment of the present invention. FIG. 7A is a schematic diagram showing a configuration when two kiosk terminals are installed according to an embodiment of the present invention. FIG. 7B is a schematic diagram showing a configuration when two kiosk terminals are installed according to an embodiment of the present invention. FIG. 8A is a schematic diagram showing a configuration in which three kiosk terminals are installed according to an embodiment of the present invention. FIG. 8B is a schematic diagram showing a configuration in which three kiosk terminals are installed according to an embodiment of the present invention. FIG. 9 is a schematic diagram illustrating prevention of prying eyes in a kiosk terminal according to an embodiment of the present invention. FIG. 10 is a schematic diagram showing a configuration when kiosk terminals are installed at different heights according to an embodiment of the present invention. FIG. 11 is a schematic diagram showing the appearance of an entrance gate terminal and an exit gate terminal that constitute an electronic gate according to an embodiment of the present invention. FIG. 12 is a block diagram showing an example of hardware configuration of an entrance gate terminal that constitutes an electronic gate according to an embodiment of the present invention. FIG. 13 is a block diagram showing an example of hardware configuration of an exit gate terminal that constitutes an electronic gate according to one embodiment of the present invention. FIG. 14 is a block diagram showing an example hardware configuration of a management server according to an embodiment of the present invention. FIG. 15A is a schematic diagram showing an example of a declaration information input screen on a mobile terminal according to one embodiment of the present invention. FIG. 15B is a schematic diagram showing an example of a declaration code display screen on the mobile terminal according to one embodiment of the present invention. FIG. 16 is a sequence diagram showing operations of the kiosk terminal and management server in the information processing system according to one embodiment of the present invention. FIG. 17 is a sequence diagram showing the language setting operation of the kiosk terminal in the information processing system according to one embodiment of the present invention. FIG. 18A is a schematic diagram showing an example of a reception screen on a kiosk terminal according to one embodiment of the present invention. FIG. 18B is a schematic diagram showing an example of a declaration content confirmation screen in the kiosk terminal according to one embodiment of the present invention. FIG. 18C is a schematic diagram showing an example of a guidance screen on a kiosk terminal according to an embodiment of the invention. FIG. 19 is a sequence diagram showing operations of the entrance gate terminal, the exit gate terminal, and the management server in the information processing system according to one embodiment of the present invention. FIG. 20 is a schematic diagram showing an example of a notification screen at an exit gate terminal according to an embodiment of the present invention. FIG. 21 is a block diagram showing the configuration of an information processing apparatus according to another embodiment of the invention.

[One embodiment]
An information processing device, a gate device, an information processing method, and a gate device control method according to an embodiment of the present invention will be described with reference to FIGS. 1 to 20. FIG.

First, the overall configuration of the information processing system according to this embodiment will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 is a schematic diagram showing the overall configuration of an information processing system according to this embodiment. FIG. 2 is a schematic diagram showing a customs inspection area equipped with kiosk terminals and electronic gates according to the present embodiment.

As shown in FIG. 1, an information processing system 1 according to the present embodiment includes a kiosk terminal 10, an electronic gate 20, a management server 50, and a mobile terminal 60. FIG. The electronic gate 20 has an entrance gate terminal 30 and an exit gate terminal 40 . For example, the information processing system 1 accepts declarations for customs procedures at the time of entry of users U such as passengers and crew members entering from abroad at airports, seaports, etc., and specific users U who have completed declarations pass through. It is a system for controlling the electronic gate 20 .

For example, when the information processing system 1 is installed at an airport in Japan, the user U is a passenger or crew member who arrived at the airport from a foreign country by airplane and returned to Japan from the foreign country from which he/she left the country. Japanese nationals who enter Japan as foreign nationals, and foreign nationals who enter Japan from other countries. A customs declaration, which is a declaration in customs procedures accepted by the information processing system 1, is more specifically, for example, a declaration in travel customs clearance. It is a declaration with the same contents as the declaration by the declaration form.

The management server 50 is installed, for example, in a customs facility. The kiosk terminal 10 and the electronic gate 20 are installed, for example, at a customs inspection area C where customs inspections are conducted at airports, seaports, and the like.

As shown in FIG. 2, a kiosk terminal 10 is installed near the entrance of the customs inspection area C where the user U enters. A digital signage terminal 70 is installed in the vicinity of the kiosk terminal 10 to guide the user by displaying the procedures for the kiosk terminal 10 using moving images or still images. At the exit of the customs inspection site C, an electronic gate 20 and a manned booth M are installed. A digital signage terminal 80 is installed in the vicinity of the entrance gate terminal 30 of the electronic gate 20 to guide the user by displaying cautionary notes when passing through the electronic gate 20 by moving or still images. At the manned booth M, customs officials S conduct face-to-face customs inspections, such as acceptance of declarations in customs procedures and inspection of baggage.

The mobile terminal 60 is a terminal that the user U possesses or carries. A customs declaration application for customs declaration at the kiosk terminal 10 is installed in the portable terminal 60 . The user U can use the customs declaration code generated by the customs declaration application of the portable terminal 60 to make a customs declaration at the kiosk terminal 10, as will be described later.

The kiosk terminal 10, the entrance gate terminal 30, the exit gate terminal 40 and the management server 50 are connected to the network NW. The network NW is composed of a WAN (Wide Area Network), a LAN (Local Area Network), a mobile communication network, and the like. The kiosk terminal 10 and the management server 50 are communicable via the network NW. The entrance gate terminal 30 and the exit gate terminal 40 can communicate via the network NW or not via the network NW. The exit gate terminal 40 and the management server 50 are communicable via the network NW. The mobile terminal 60 can communicate with a server such as the management server 50 via the network NW.

Next, each component in the information processing system 1 according to this embodiment will be further described with reference to FIGS. 3 to 14. FIG.

First, the configuration of the mobile terminal 60 will be described with reference to FIG. FIG. 3 is a block diagram showing an example of the hardware configuration of the mobile terminal 60. As shown in FIG.

The mobile terminal 60 is a terminal possessed or carried by the user U, and is, for example, a mobile information device such as a smart phone, a tablet terminal, or a mobile phone. As shown in FIG. 3, the mobile terminal 60 includes a CPU (Central Processing Unit) 602, a RAM (Random Access Memory) 604, a storage device 606, an input device 608, a display 610, and a mobile wireless communication unit 612. , and a short-range wireless communication unit 614 . The CPU 602 , RAM 604 , storage device 606 , input device 608 , display 610 , mobile radio communication section 612 and short-range radio communication section 614 are connected to bus line 616 .

CPU 602 operates by executing a program stored in storage device 606 and functions as a control unit that controls the operation of mobile terminal 60 as a whole. The CPU 602 also executes application programs stored in the storage device 606 to perform various processes as the mobile terminal 60 . A RAM 604 provides a memory area necessary for the operation of the CPU 602 .

For example, a customs declaration application for customs declaration at the kiosk terminal 10 is installed in the storage device 606 . The CPU 602 can perform various processes for the user U to declare customs by executing the customs declaration application.

More specifically, the CPU 602 can, for example, accept input by the user U of declaration information required for customs declaration. The declaration information is, for example, information of the same content as the items to be declared in the declaration of personal belongings/unaccompanied goods. That is, the declaration information includes, for example, the name of the user U, current address or place of stay in the country of entry, occupation, date of birth, passport number, flight number, place of departure, date of entry, matters to be declared in customs declaration including information necessary for customs declaration such as

Further, the CPU 602 can generate, for example, a declaration code, which is a code such as a two-dimensional code including the declaration information input by the user U, and display it on the display 610, as will be described later. The mobile terminal 60 can function as a medium for displaying the declaration code.

The declaration code is not particularly limited as long as it can contain declaration information, but is, for example, a two-dimensional code such as a QR code (registered trademark). Also, the declaration code may be, for example, a one-dimensional code such as a bar code. The CPU 602 can also generate a declaration code with an expiration date set. The CPU 602 can display the set expiration date on the display 610 together with the reporting code. A declaration code with an expiration date becomes invalid after the date and time set as the expiration date has passed after it is generated. By setting an expiration date to the declaration code, it is possible to urge the user U to make a customs declaration immediately after generating the declaration code.

If the user U has an accompanying family member who accompanies the user U, the user U and the accompanying family member can use their respective mobile terminals 60 to declare customs, or the user U can act as a representative. You can also make a customs declaration. When the user U makes a customs declaration on behalf of the user U, the CPU 602 stores the declaration code used by the user U at the kiosk terminal 10 and the declaration code for the accompanying family members used at the kiosk terminal 10. It can be generated and displayed on display 610 . The accompanying family member can use the kiosk terminal 10 in the same manner as the user U by using the declaration code for the accompanying family member displayed on the mobile terminal 60 of the user U. After using the kiosk terminal 10, the accompanying family members are guided to the electronic gate 20 or the manned booth M like the user U.

Also, the code display medium for displaying the declaration code is not necessarily the portable terminal 60, and may be another medium. For example, the declaration code may be printed on paper as a code display medium.

Also, the customs declaration application supports multiple languages such as Japanese, English, Chinese, and Korean. As a result, the customs declaration application can be displayed and input in a language set by selecting from among a plurality of languages in the language setting of the mobile terminal 60, for example. In addition, the customs declaration application may allow display and input in, for example, a language selected from a plurality of languages in the settings of the application, in addition to the language setting of the mobile terminal 60 . The customs declaration application can be used in the preferred language, which is the language thus set.

The CPU 602 can further include language information, which is information indicating the language used by the customs declaration application, in the declaration code. The language information is, for example, information indicating the language set in the language setting of the mobile terminal 60, or information about the language if the language is set in the customs declaration application.

A storage device 606 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit. The storage device 606 stores programs executed by the CPU 602, data referred to by the CPU 602 during execution of the programs, and the like. Storage device 606 stores a customs declaration application as an application program executed by CPU 602 .

Storage device 606 may store information such as declaration information entered in a customs declaration application. Storage device 606 may also store filing codes generated by customs filing applications.

Input device 608 is, for example, a touch panel incorporated into display 610 . The input device 608 functions as an input unit that receives input from the user U. FIG. The user U can input various types of information and instructions to execute processing to the mobile terminal 60 via the input device 608 . For example, the user U can input declaration information or an instruction to generate a declaration code through the input device 608, which is a touch panel, to the portable terminal 60 that executes the customs declaration application. can.

The display 610 functions as a display unit that displays various screens to the user U. FIG. For example, in the mobile terminal 60 executing the customs declaration application, the display 610 displays a declaration information input screen for accepting input of declaration information, a declaration code display screen for displaying declaration codes, and the like, as described later.

The mobile wireless communication unit 612 connects to the network NW via the mobile communication network under the control of the CPU 602 . The communication method of the mobile radio communication unit 612 is not particularly limited, but examples thereof include the third generation mobile communication method, the LTE (Long Term Evolution) method, the fourth generation mobile communication method, and the like.

The short-range wireless communication unit 614 performs wireless communication with an access point, an external device, etc., under the control of the CPU 602, and connects to the network NW, for example, via an access point such as an airport premises. The communication method of the short-range wireless communication unit 614 is not particularly limited, but may be, for example, a wireless LAN method such as Wi-Fi (registered trademark), a Bluetooth (registered trademark) communication method, or an NFC (Near Field Communication) method. , an infrared communication system, and the like.

Thus, the mobile terminal 60 is configured.

Next, the configuration of the kiosk terminal 10 will be described with reference to FIGS. 4A to 10. FIG. 4A and 4B are schematic diagrams showing the appearance of the kiosk terminal 10. FIG. 4A is a perspective view showing the entire kiosk terminal 10 installed on the pole 100, and FIG. 4B is an enlarged perspective view showing the kiosk terminal 10 installed on the pole 100. FIG. FIG. 5 is a block diagram showing an example of the hardware configuration of the kiosk terminal 10. As shown in FIG. 6A and 6B are schematic diagrams showing the configuration when one kiosk terminal 10 is installed. 7A and 7B are schematic diagrams showing a configuration when two kiosk terminals 10 are installed. 8A and 8B are schematic diagrams showing a configuration when three kiosk terminals 10 are installed. FIG. 9 is a schematic diagram illustrating prevention of peeping in the kiosk terminal 10. As shown in FIG. FIG. 10 is a schematic diagram showing a configuration when the kiosk terminals 10 are installed at different heights.

The kiosk terminal 10 receives the customs declaration by the declaration code displayed on the mobile terminal 60 of the user U, and performs information processing to guide the user U to the electronic gate 20 or the manned booth M according to the contents of the customs declaration. It is a device. As shown in FIGS. 4A and 4B, the kiosk terminal 10 is installed by being attached to the side of a pole 100 which is a support installed with its longitudinal direction vertical. One or a plurality of kiosk terminals 10 can be installed on one pole 100 as described later.

The kiosk terminal 10 also has a CPU 102, a RAM 104, a storage device 106, an input device 108, and a display 110, as shown in FIG. Furthermore, the kiosk terminal 10 has a passport reader 112 , a code reader 114 , a camera 116 , a depth camera 118 , a communication section 120 and a status lamp 122 . CPU 102 , RAM 104 , storage device 106 , input device 108 , display 110 , passport reader 112 , code reader 114 , camera 116 , depth camera 118 , communication unit 120 and status lamp 122 are connected to bus line 124 .

As shown in FIGS. 4A and 4B, kiosk terminal 10 has housing 126 attached to pole 100 . The housing 126 has a first housing section 126a provided with a display 110 and a camera 116, and a second housing section 126b provided with a passport reader 112 and a code reader 114. As shown in FIG. The housing 126 accommodates the CPU 102 , the RAM 104 , the storage device 106 and the communication section 120 .

The first housing section 126a has a display surface on which the display 110 is provided. The second housing part 126b has a reading surface on which the passport reader 112 and the code reader 114 are provided. A second housing portion 126b is integrally connected to the lower portion of the first housing portion 126a so that the display surface and the reading surface form an obtuse angle with each other. When the kiosk terminal 10 is installed on the pole 100, the display surface of the first housing part 126a and the second housing part 126b are arranged so that the display surface of the first housing part 126a is diagonally upward and forward, opposite to the rear on the pole 100 side. , and the reading surface of the second housing portion 126b is substantially horizontal.

For example, the kiosk terminal 10 is installed on the pole 100 so that the user U who is taller than a predetermined height can look down at the display 110, the passport reader 112, and the code reader 114. .

The display 110 is provided on the display surface of the first housing section 126a so that the screen faces obliquely forward and upward. The display 110 incorporates an input device 108 as a touch panel.

A camera 116 is provided at the center of the portion between the display 110 and the second housing portion 126b on the lower portion of the display surface of the first housing portion 126a. The camera 116 is placed between the display 110, which is a display section provided in the first housing section 126a, and the passport reader 112 and the code reader 114, which are information acquisition sections provided in the second housing section 126b. is provided. Note that one camera 116 may be provided, or two cameras may be provided above and below the display 110 . In this case, the lower camera 116 is provided, for example, in the center of the portion between the display 110 and the second housing portion 126b below the display surface of the first housing portion 126a as described above. On the other hand, the upper camera 116 is provided, for example, in the center of the upper portion of the display 110 above the display surface of the first housing section 126a.

The camera 116 is provided so that its photographing direction is directed obliquely forward and upward. A user U in front of the kiosk terminal 10 operates the kiosk terminal 10 by looking down at the display 110, the passport reader 112, or the code reader 114 with the line of sight directed obliquely forward and downward. The camera 116 has an angle of view capable of photographing the face of the user U operating the kiosk terminal 10 looking down at the display 110, the passport reader 112 or the code reader 114 in this way.

Further, a depth camera 118 is provided at the upper center of the display surface of the first casing section 126a. The depth camera 118 is provided so as to acquire three-dimensional information of the object photographed by the camera 116 . Note that the depth camera 118 may be arranged adjacent to the one or two cameras 116 as described above.

Further, plate-shaped visors 128 are provided along the display 110 on both sides of the display surface of the first casing section 126a so as to protrude from the display surface. The visor 128 blocks the line of sight directed to the display 110 from the side, obliquely behind, and obliquely in front of the kiosk terminal 10, making it difficult for anyone other than the user U who uses the kiosk terminal 10 to look into the display 110. functions as a department.

Further, on both sides of the display surface of the first housing section 126a, lighting 130, which is a lighting section for illuminating the face of the user U who operates the kiosk terminal 10, is provided. The illumination 130 can be composed of, for example, a light source that illuminates the display 110 from below upward, or a light source such as a rod-shaped light source provided along the display 110 . Although the light source is not particularly limited, an LED (Light Emitting Diode) or the like can be used. The lights 130 provided on both sides of the display 110 ensure sufficient brightness when the camera 116 photographs the face of the user U who operates the kiosk terminal 10 . Note that the illumination 130 may be lit all the time while the kiosk terminal 10 is in operation. Also, the illumination 130 does not necessarily have to be lit all the time while the kiosk terminal 10 is in operation, and may be configured to be lit when the user U's face is photographed by the camera 116 . In this case, the illumination 130 can be configured to illuminate, for example, when a passport is read by the passport reader 112 or a declaration code is read by the code reader 114 . Also, the lighting 130 can be configured to turn on when the user U is detected by a motion sensor (not shown) provided in the kiosk terminal 10, for example. Further, the lights 130 that are turned on at predetermined timings can be configured to be turned off after the camera 116 finishes photographing the face of the user U or after a predetermined period of time has elapsed.

On the reading surface of the second housing portion 126b, a passport reader 112 is provided on the left side of the display 110, and a code reader 114 is provided on the right side. Other kiosk terminals installed at airports and the like generally have a reading device for reading codes such as QR codes on the right side of the terminal. Since the kiosk terminal 10 is also provided with the code reader 114 on the right side of the display 110, the user U can smoothly hold the declaration code displayed on the portable terminal 60 over the code reader 114. can be read.

The passport reader 112 is provided, for example, with a reading section for reading a passport facing upward, and configured to have a slot into which a passport is inserted on the reading section. In this case, the user U inserts the passport with the identification information page open into the slot with the page facing downward and holds it over the reading unit of the passport reader 112 to cause the passport reader 112 to read the passport. can be done. In the method of inserting the passport into the slot, if the passport is inserted into the slot, it is not necessary for the user U to keep holding the passport in order to keep the page open. can be precisely positioned. This makes it possible to realize smooth passport reading.

The configuration of the passport reader 112 is not limited to the configuration described above, and various configurations can be adopted. For example, the passport reader 112 can be configured so that the user U holds a passport whose identification information page is opened in the reader. In this case, the user U can cause the passport reader 112 to read the passport by holding the passport with the page of the identification information open and holding it over the reading unit of the passport reader 112 with the page facing downward. .

Further, the code reader 114 is also provided, for example, with a reading unit for reading the declaration code facing upward. In this case, the user U causes the code reader 114 to read the declaration code by holding the display 610 of the portable terminal 60 on which the declaration code is displayed downward over the reading unit of the code reader 114 . can be done.

The configuration of the code reader 114 is not limited to the configuration described above, and various configurations can be adopted. For example, code reader 114 may be configured such that its reader reads the declaration code from above. In this case, the user U causes the code reader 114 to read the declaration code by holding up the display 610 of the portable terminal 60 displaying the declaration code over the reading unit of the code reader 114. can be done.

A status lamp 122 is provided on the top of the pole 100 so as to be positioned above the first housing 126 a including the display 110 . The status lamp 122 is provided at the tip of an arm 132 attached to the top of the pole 100 so that the status lamp 122 is positioned above the kiosk terminal 10 indicating the status. Arm 132 protrudes from pole 100 to the upper side of kiosk terminal 10 .

Also, the arm 132 is provided with a monitoring camera 134 for monitoring the status of the kiosk terminal 10 . More specifically, the monitoring camera 134 functioning as a monitoring unit photographs and monitors the state of the kiosk terminal 10 and its surroundings, the state of the user U operating the kiosk terminal 10, and the like. The surveillance camera 134 is connected to the corresponding kiosk terminal 10 or connected to the network NW. The monitoring camera 134 can transmit a video image of the user U to the management server 50 via the kiosk terminal 10 or via the network NW without the kiosk terminal 10 .

The CPU 102 operates by executing programs stored in the storage device 106 and functions as a control unit that controls the overall operation of the kiosk terminal 10 . The CPU 102 also executes application programs stored in the storage device 106 to perform various processes as the kiosk terminal 10 . RAM 104 provides a memory area necessary for the operation of CPU 102 .

More specifically, the CPU 102 functions as a collation requesting unit that requests the management server 50 to collate the face of the user U who uses the kiosk terminal 10 to declare customs. The CPU 102 as a collation requesting unit requests collation of the captured face image of the user U and the face image of the passport of the user U as the face collation of the user U. FIG. A captured face image is a face image of the user U captured by the camera 116 when the kiosk terminal 10 is used. The passport face image is a face image acquired from the passport of the user U by the passport reader 112 . In order to request verification, the CPU 102 transmits the photographed face image and the passport face image or the face feature quantity extracted from them to the management server 50 together with the verification request. The CPU 102 reads at least one of the passport and the declaration code to obtain a photographed face image of the user U, and when the other of the passport and the declaration code is read, the CPU 102 performs face matching of the user U to the management server 50. can be requested. The timing at which the CPU 102 acquires a photographed face image and the timing at which the CPU 102 requests face matching are not limited to these, and various variations are possible.

The CPU 102 can perform wearing object estimation on the photographed face image during photographing by the camera 116 . The CPU 102 can detect facial attachments such as masks, sunglasses, eyeglasses, and caps in the photographed face image by estimating the attachments. When the CPU 102 detects a face attachment that is attached to the face of the user U, the CPU 102 can warn the user U to remove the face attachment that hinders face matching. . For example, the CPU 102 displays on the display 110 a display instructing the user U to remove the face attachment, or emits a sound from a speaker or the like instructing the user U to remove the face attachment. A warning can be given.

Further, the CPU 102 functions as a matching information acquisition unit that receives and acquires matching information, which is information indicating the result of face matching requested to the management server 50 , from the management server 50 . As a result of face matching, the face image of the passport matches the photographed face image, and the identity of the user U who declares customs at the kiosk terminal 10 is successfully verified. Indicates that verification failed. Note that the case where the passport face image and the photographed face image match includes the case where the matching score indicating the degree of similarity between the two face images exceeds a predetermined threshold and the two face images show a high degree of similarity.

Note that instead of functioning as a matching request unit and a matching information acquiring unit, the CPU 102 functions as a matching unit that acquires matching information by matching a passport face image with a photographed face image for face matching of the user U. can also When matching the passport face image and the captured face image, the CPU 102 matches the face feature amount extracted from the passport face image with the face feature amount extracted from the captured face image, thereby matching both face images. can.

Further, the CPU 102 functions as a user information transmission unit that transmits user information of the user U to the management server 50 . The user information of the user U includes the identification item information, face information and report information of the user U which are associated with each other.

The identification item information includes information about the user U individual, such as the user U's name and date of birth. In addition, the identification item information includes information on the passport of the user U, such as the passport number of the user U and the expiration date of the passport. The identification item information is acquired from the passport of the user U by the passport reading device 112 .

The face information is the photographed face image and the passport face image of the user U. Moreover, the face information may not be the captured face image and the passport face image themselves, but may be face feature amounts extracted from the captured face image and the passport face image, respectively. In this case, the CPU 102 extracts facial features from each of the captured facial image and the passport facial image.

The declaration information includes information to be declared in customs declaration when the user U enters the country. The declaration information is acquired from the declaration code displayed on the portable terminal 60 of the user U by the code reading device 114 . As described above, the declaration information includes, for example, the user U's name, current address or place of stay in the country of entry, occupation, date of birth, passport number, boarding flight number, place of departure, date of entry, declaration in customs declaration It contains information necessary for customs declaration such as matters to be done.

The user information of the user U transmitted to the management server 50 is registered in a user information database (DB, Database) 506a in the management server 50 as described later. A photographed face image or a passport face image included in the user information is registered in the user information DB 506a as a registered face image which is registered biometric information in advance.

The CPU 102 also functions as a determination requesting unit that requests the management server 50 to determine the content of the declaration included in the declaration information of the user U who uses the kiosk terminal 10 to declare customs. The CPU 102 as a determination requesting unit requests the management server 50 to determine the contents of the declaration included in the transmitted declaration information. The CPU 102 receives determination information from the management server 50, which is information indicating the determination result of the content of the declaration included in the declaration information.

Further, the CPU 102 functions as a determination information acquisition unit that receives and acquires determination information from the management server 50, which is information indicating the determination result of the content of the declaration requested to the management server 50. FIG. The judgment information indicates whether or not the user U is subject to taxation, and whether or not the user U is at risk as a result of the judgment. When User U is subject to taxation, for example, if User U has goods that exceed the scope of tax exemption in the declaration, the declaration to the effect that User U has merchandise cargo or merchandise samples is in the content of the declaration. If user U is at risk, for example, if the content of the declaration states that he/she has an item that is prohibited or restricted from being brought into the country, or that he or she has an item entrusted to him/her by another person. is included in the contents of the declaration.

Note that the CPU 102 can also function as a determination unit that determines the declaration content included in the user U's declaration information, instead of functioning as the determination request unit and the determination information acquisition unit. In this case, like the management server 50, the CPU 102 can determine the declaration content included in the declaration information.

The CPU 102 also functions as a determination unit that determines whether or not the user U can use the electronic gate 20 based on the verification information and determination information received from the management server 50 . The CPU 102 as a determination unit determines whether the user U is at the electronic gate 20 when the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, and the user U has no risk. is determined to be available. On the other hand, the CPU 102 determines that the user U is subject to taxation, or that the user U is at risk, if the passport face image of the user U does not match the photographed face image, or if the user U is at the electronic gate 20 is determined to be unavailable.

In addition, the CPU 102 can transmit to the management server 50 gate usability information, which is information indicating the determination result of the usability of the electronic gate 20 . In this case, the gate availability information transmitted to the management server 50 is registered in the user information DB 506a in the management server 50 in association with the user information, as will be described later. If the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, and the user U is not at risk, the gate usage permission information is based on the information that the user U 20 is available.

The CPU 102 also functions as a display control unit that causes the display 110 to display a screen for guidance, notification, etc. for the user U who makes a customs declaration at the kiosk terminal 10 . For example, the CPU 102 as a display control unit causes the display 110 to display a guidance screen that guides how to use the kiosk terminal 10 . In addition, the CPU 102 causes the display 110 to display a declaration content confirmation screen for the user U to confirm the declaration content included in the declaration information acquired from the user U's mobile terminal 60 and correct it as necessary.

In addition, the CPU 102 functions as a processing unit that performs processing for the user U who has made a customs declaration at the kiosk terminal 10 according to the judgment result of the electronic gate 20 . More specifically, the CPU 102 causes the display 110 to display a guidance screen for guiding the user U to the electronic gate 20 or the manned booth M according to the determination result of whether or not the electronic gate 20 can be used. U is guided to the electronic gate 20 or the manned booth M.

The CPU 102 also functions as a language setting unit that sets the language used by the kiosk terminal 10 based on the language information read from the declaration code displayed on the mobile terminal 60 of the user U who declares customs at the kiosk terminal 10. do. Further, when a change input for changing the language used by the kiosk terminal 10 to another language is input from the user U via the input device 108, the CPU 102 changes the language used according to the change input. The language used by the kiosk terminal 10 is, for example, a language for displaying various information on the display 110 and accepting input from the input device 108 . The kiosk terminal 10, like the customs declaration application of the mobile terminal 60, supports multiple languages such as Japanese, English, Chinese, and Korean. As a result, the kiosk terminal 10 is capable of displaying and inputting in a language set from among a plurality of languages.

The storage device 106 is configured by a storage medium such as a non-volatile memory and a hard disk drive, and functions as a storage unit. The storage device 106 stores programs executed by the CPU 102, data referred to by the CPU 102 during execution of the programs, and the like.

Input device 108 is, for example, a touch panel incorporated in display 110 . The input device 108 functions as an input unit that receives input of instructions from the user U. FIG. The user U can input various types of information and instructions to execute processing to the kiosk terminal 10 via the input device 108 .

The display 110 functions as a display unit that displays various screens to the user U who uses the kiosk terminal 10 . For example, the display 110 displays a guidance screen that guides how to use the kiosk terminal 10, a declaration content confirmation screen for the user U, a guidance screen for the user U, and the like. The display 110 can also display matching information indicating the result of matching between the photographed face image and the passport face image, and determination information indicating the determination result of the content of the declaration.

The display 110 can be installed vertically, for example. The vertically long display 110 can display an amount of information equivalent to that of a horizontally long display of the same size, while allowing the kiosk terminal 10 to be installed in a narrow space. Furthermore, the vertically long display 110 can prevent the user U standing in front of the display 110 from peeking at the display 110 from behind.

The passport reader 112 functions as a reading unit that reads the passport of the user U and acquires information recorded in the passport. The passport reader 112 is composed of, for example, an image scanner, a non-contact IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, and the like. The passport reading device 112 reads the passport, which is a medium held over the reading unit, and acquires information from the passport.

For example, the passport reading device 112 reads and acquires the identification item information of the user U displayed on the face of the passport by the OCR device. Further, for example, the passport reading device 112 reads and acquires the passport face image of the user U displayed on the passport surface by an image scanner. In the case of an IC passport, the passport reading device 112 reads and acquires the identification information, the passport face image, etc. of the user U recorded in the IC chip of the IC passport using a non-contact IC reader. The biometric information of the user U recorded and included in the passport is not limited to the face image, and may be other biometric information such as an iris image. The passport reader 112 can acquire biometric information of the user U included in the passport.

The code reading device 114 functions as a reading unit that reads the reporting code displayed on the mobile terminal 60 of the user U and acquires reporting information and language information included in the reporting code. The code reader 114 is, for example, a QR code reader, bar code reader, or other code reader corresponding to the type of declaration code to be read. The code reader 114 reads the declaration code displayed on the portable terminal 60, which is the code display medium held over the reading unit, and acquires information from the declaration code.

The camera 116 functions as a biometric information acquiring unit that acquires a face image of the user U as biometric information of the user U who uses the kiosk terminal 10 to declare customs. The camera 116 is, for example, a photographing device such as a digital camera for photographing the face of the user U in front of the kiosk terminal 10 as a moving image or a still image. Get a face image. Under the control of the CPU 102, the camera 116 captures the face image of the user U who has the passport reader 112 read the passport or the code reader 114 reads the declaration code in front of the kiosk terminal 10, as will be described later. to acquire a photographed face image. In this way, when the camera 116 reads at least one of the passport and the declaration code, the camera 116 can photograph the face image of the user U to acquire the photographed face image. Instead of the camera 116, a biometric information acquiring unit that acquires the same kind of biometric information from the user U as the biometric information acquired from the passport by the passport reader 112 can be provided.

The CPU 102 can set the number of pixels between the eyes in the captured face image captured by the camera 116 within a predetermined range. In this case, the CPU 102 can, for example, exclude, from among the face images captured by the camera 116, face images in which the number of pixels between the eyes is less than a predetermined number. Accordingly, the camera 116 can reliably photograph the user U operating the kiosk terminal 10 without photographing a distant person behind the user U operating the kiosk terminal 10 .

Also, the CPU 102 can mask predetermined ranges on both sides of the imaging range of the camera 116 . Accordingly, the camera 116 can reliably photograph the user U operating the kiosk terminal 10 while preventing people around the user U operating the kiosk terminal 10 from being reflected.

Note that the kiosk terminal 10 can be configured so that the photographed face image photographed by the camera 116 is not displayed on the display 110 or the like. In this case, the user U does not recognize that the kiosk terminal 10 has captured his or her face. Therefore, the user U can comfortably use the kiosk terminal 10 without feeling resistance to photography and without being psychologically oppressed by photography.

Depth camera 118 acquires three-dimensional information of the object imaged by camera 116 . Based on the three-dimensional information obtained by the depth camera 118, the CPU 102 determines whether the facial image of the user U captured by the camera 116 is obtained by photographing a real person, or whether it is a two-dimensional image such as a photograph. It can be determined whether it was obtained from This makes it possible to prevent fraudulent acts such as impersonation of others.

The communication unit 120 is connected to the network NW and transmits and receives data via the network NW. The communication unit 120 communicates with the management server 50 and the like under the control of the CPU 102 .

The status lamp 122 functions as a status display section that indicates the status of the kiosk terminal 10 . More specifically, the status lamp 122 indicates the status of the kiosk terminal 10, for example, the progress of customs declaration by the user U at the kiosk terminal 10, whether there is an abnormality in the kiosk terminal 10, and whether the kiosk terminal 10 can be used. etc. can be indicated by different lamp colors. The status lamp 122 can be lit in a lamp color according to the status of the kiosk terminal 10 under the control of the CPU 102 . A monitoring camera may be provided between the status lamp 122 and the pole 100 to detect suspicious behavior. This surveillance camera can be configured to start photographing, for example, when the passport is read by the passport reader 112 or the declaration code is read by the code reader 114 .

The status lamp 122 can illuminate in different lamp colors, such as green, yellow, red, flashing green, flashing yellow, or flashing red, depending on the situation. In this case, for example, each lamp color indicates the following situation. That is, green indicates that the face match matches and the customs information is fine. Yellow indicates cases where face matching fails. Red indicates if there is a problem with customs information. Blinking green indicates slow customs declaration status. Blinking yellow indicates that there is a problem with the system that includes the kiosk terminal 10 . Blinking red indicates a case where the person is determined to be a blacklisted person through illegal passport or face matching. Note that these are just examples, and other combinations of lamp colors and situations may be used. Thus, the status lamp 122 may illuminate differently based on at least one of the information read by the passport reader 112 or code reader 114, the result of a face match, and/or the status of the procedure, for example. Also, the illumination 130 provided on the side of the display 110 may also light up in the same color as the status lamp 122 . Light 130, like status lamp 122, may also illuminate differently based on, for example, information read by passport reader 112 or code reader 114, face matching results, and/or procedural status. . In this case, the illumination 130 can be provided, for example, on the top surface or top edge of the visor 128 . While the screen contents of the display 110 are hidden from the surroundings by the visor 128, the relevant personnel such as staff who know the relationship between the lamp color and the situation such as an error can display the kiosk terminal 10 according to the lighting status of the status lamp 122 and the lighting 130. You can grasp the situation. As a result, the concerned parties can take appropriate measures such as taking immediate measures when the display 110 or the illumination 130 blinks in red, for example.

Thus, the kiosk terminal 10 is configured.

One kiosk terminal 10 configured as described above can be installed on one pole 100 , or a plurality of kiosk terminals 10 can be installed on one pole 100 . FIG. 6B is a perspective view showing the configuration when one kiosk terminal 10 is installed, and FIG. 6A is a top view of FIG. 6B. FIG. 7B is a perspective view showing a configuration when two kiosk terminals 10 are installed, and FIG. 7A is a top view of FIG. 7B. FIG. 8B is a perspective view showing a configuration in which three kiosk terminals 10 are installed, and FIG. 8A is a top view of FIG. 8B.

In the case of a configuration in which one kiosk terminal 10 is installed on one pole 100, one kiosk terminal 10 faces a predetermined direction and faces the side of the pole 100 as shown in FIGS. 6A and 6B. is set up.

Also, by installing a plurality of kiosk terminals 10 on one pole 100, a kiosk terminal group, which is a group of information processing devices, can be configured.

In the case of a configuration in which two kiosk terminals 10 are installed on one pole 100, as shown in FIGS. It is installed on the side of the pole 100 . The angular interval between two adjacent kiosk terminals 10 is, for example, 120°. Thus, a kiosk terminal group including two kiosk terminals 10 is configured.

In the case of a configuration in which three kiosk terminals 10 are installed on one pole 100, as shown in FIGS. It is installed on the side of the pole 100 . The angular intervals between two adjacent kiosk terminals 10 among the three kiosk terminals 10 are, for example, equal angles of 120°. Thus, a kiosk terminal group including three kiosk terminals 10 is configured.

In this way, when a plurality of kiosk terminals 10 are installed, by installing them radially around the pole 100, each user who uses the adjacent kiosk terminals 10 can use the adjacent kiosk terminals 10 rather than installing them in a straight line in the lateral direction. A larger space between U can be secured. This makes it difficult for the user U in front of the adjacent kiosk terminal 10 to peek at the display 110 of the kiosk terminal 10 .

When a plurality of kiosk terminals 10 are radially installed, the angular interval between two adjacent kiosk terminals 10 is not limited to 120° as described above, and can be set as appropriate. Also, the number of kiosk terminals 10 installed on one pole 100 is not limited to the number described above, and may be four or more.

In addition, the kiosk terminal 10 is provided with visors 128 on both sides of the display 110 along the display 110 respectively. In the kiosk terminal 10, the visor 128 also makes it difficult to peek at the display 110. - 特許庁

FIG. 9 shows line-of-sight blocking by the visor 128 in a configuration in which three kiosk terminals 10 are installed as shown in FIGS. 8A and 8B. As shown in FIG. 9, the line of sight directed to the adjacent kiosk terminal 10 by the user U in front of the kiosk terminal 10 is blocked by the visor 128 provided on the adjacent kiosk terminal 10, as indicated by the dashed arrow in the figure. will be Thus, the visor 128 also makes viewing the display 110 difficult.

Also, when a plurality of kiosk terminals 10 are installed on one pole 100, the plurality of kiosk terminals 10 can be installed at different heights. For example, as shown in FIG. 10, in a configuration in which three kiosk terminals 10 are installed, one kiosk terminal 10 can be installed at a lower position than the other two kiosk terminals 10. By installing a plurality of kiosk terminals 10 at different heights in this way, users U of a wide range of heights can use the kiosk terminals 10 . Also, the kiosk terminal 10 installed at a position lower than the other kiosk terminals 10 can be used by, for example, a user U who uses a wheelchair while using the wheelchair.

The means for attaching and fixing the kiosk terminal 10 to the pole 100 is not particularly limited, and various means can be used. For example, the kiosk terminal 10 can be fixed to any one of a plurality of mounting positions with different heights provided on the pole 100 by screwing. Further, for example, the kiosk terminal 10 can be installed on the pole 100 such that the user U himself who uses the kiosk terminal 10, a customs officer who manages the kiosk terminal 10, or the like can slide up and down. In this case, the user U or the like can slide the kiosk terminal 10 installed on the pole 100 up and down to adjust the height of the kiosk terminal 10 .

Cords or cables such as a power cord and a communication cable (not shown) connected to the kiosk terminal 10 are housed and hidden inside the pole 100 . Also, excess cords or cables can be accommodated within the housing 126 of the kiosk terminal 10 .

In addition to the pole 100 described above, the kiosk terminal 10 can be installed on various supports such as a support table and a counter.

Next, the configuration of the electronized gate 20 will be described with reference to FIGS. 11 to 13. FIG. FIG. 11 is a schematic diagram showing the appearance of an entrance gate terminal 30 and an exit gate terminal 40 that constitute the electronic gate 20. As shown in FIG. FIG. 12 is a block diagram showing an example of the hardware configuration of the entrance gate terminal 30. As shown in FIG. FIG. 13 is a block diagram showing an example of the hardware configuration of the exit gate terminal 40. As shown in FIG.

The electronic gate 20 is a gate device that permits or denies the user U guided to the electronic gate 20 by the kiosk terminal 10 to pass through based on the result of facial collation at the electronic gate 20 or the like. A user U who is permitted to pass through the electronic gate 20 can exit the customs inspection area C. A user U who is not permitted to pass through the electronic gate 20 is guided to a manned booth M by a customs officer and receives individual treatment such as face-to-face customs inspection by the customs officer.

As shown in FIG. 11, an entrance gate terminal 30 and an exit gate terminal 40, which constitute the electronic gate 20, pass through a user U guided to the electronic gate 20 assuming that the electronic gate 20 can be used. are installed at the entrance and exit of the gate passage P, respectively. A user U who has entered the gate passage P is restricted from exiting from any place other than the exit gate terminal 40 by partition plates, walls, fences, inspection tables, etc. installed on both sides along the gate passage P. ing.

First, the entrance gate terminal 30 will be described with reference to FIGS. 11 and 12. FIG. As shown in FIG. 11, the entrance gate terminal 30 is a gate device installed at the entrance of the gate passage P through which the user U guided to the electronic gate 20 passes. As shown in FIG. 12, the entrance gate terminal 30 has a CPU 302, a RAM 304, a storage device 306, an entrance gate door 308, a passage detection sensor 310, a communication section 312, and a guidance indicator 314. there is The CPU 302 , RAM 304 , storage device 306 , entrance gate door 308 , passage detection sensor 310 , communication section 312 and guide display 314 are connected to bus line 316 .

In addition, as shown in FIG. 11, the entrance gate terminal 30 has a pair of housings 318 which are installed so as to face each other with the entrance of the gate passage P interposed therebetween. The pair of housings 318 is provided with an entrance gate door 308 capable of closing between the pair of housings 318 . A pair of housings 318 are provided with a plurality of passage detection sensors 310 so as to line up in the direction of entering the gate passage P. As shown in FIG. Further, the pair of housings 318 are provided with guide indicators 314 directed forward of the entrance gate terminal 30 outside the gate passage P. As shown in FIG. The CPU 302 , the RAM 304 , the storage device 306 and the communication unit 312 may be housed in the housing 318 or may be housed in a housing separate from the housing 318 .

The CPU 302 operates by executing a program stored in the storage device 306 and functions as a control unit that controls the operation of the entrance gate terminal 30 as a whole. The CPU 302 also executes application programs stored in the storage device 306 to perform various processes as the entrance gate terminal 30 . A RAM 304 provides a memory area necessary for the operation of the CPU 302 .

More specifically, the CPU 302 determines whether or not the user U has passed through the entrance gate terminal 30 and entered the gate passage P based on the output signals of the plurality of passage detection sensors 310 and their output order. functions as a department.

The CPU 302 also functions as a door control unit that controls opening and closing operations of the entrance gate door 308 . When the user U has not entered the gate passage P, the CPU 302 keeps the entrance gate door 308 open. When the CPU 302 determines that the user U has passed through the entrance gate terminal 30 and entered the gate passage P based on the output signal of the passage detection sensor 310 , the CPU 302 closes the entrance gate door 308 . Further, the CPU 302 keeps the entrance gate door 308 closed until it determines that the user U who has entered the gate passage P has passed through the exit gate terminal 40 and left the gate passage P. Further, the CPU 302 determines that the user U has left the gate passage P based on the exit passage information transmitted from the exit gate terminal 40 . When the CPU 302 determines that the user U has left the gate passage P, the entrance gate door 308 is opened.

When the CPU 302 determines that the user U has passed through the entrance gate terminal 30 and entered the gate passage P as described above, the CPU 302 determines that the user U has passed through the entrance gate terminal 30 and entered the gate passage P. to the exit gate terminal 40.

The CPU 302 also functions as a display control unit that controls the display of the guide indicator 314 according to the open/close state of the entrance gate door 308 . When the entrance gate door 308 is open, the CPU 302 causes the guidance indicator 314 to display an indication that entry into the gate passage P is permitted. In addition, when the entrance gate door 308 is closed, the CPU 302 causes the guidance indicator 314 to display an indication that entry into the gate passage P is prohibited.

The storage device 306 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit. The storage device 306 stores programs executed by the CPU 302, data referred to by the CPU 302 during execution of the programs, and the like.

The entrance gate door 308 is a door that opens and closes under the control of the CPU 302, and transitions between an open state that allows the user U to pass through and a closed state that blocks the user U from passing through. . The opening and closing method of the entrance gate door 308 is not particularly limited, but may be, for example, a flapper type, a slide type, a rotary type, or the like.

The passage detection sensor 310 outputs an output signal indicating the passage of the user U when the passage of the user U is detected. The CPU 302 determines whether the user U has passed through the entrance gate terminal 30 based on the output signals of a plurality of passage detection sensors 310 provided on a pair of housings 318 so as to be aligned in the direction of entering the gate passage P and the output order thereof. It can be determined whether or not the vehicle has entered the gate passage P. Passage detection sensor 310 is not particularly limited, but may be, for example, a transmissive photoelectric sensor, a reflective photoelectric sensor, or the like. A transmissive photoelectric sensor has an irradiation section that emits light such as infrared rays, and a light receiving section that receives the light emitted by the irradiation section. outputs an output signal that indicates

The communication unit 312 is connected to the network NW and transmits and receives data via the network NW. The communication unit 312 communicates with the exit gate terminal 40 and the like under the control of the CPU 302 . Note that the communication unit 312 may be connected to the exit gate terminal 40 so as to be communicable with the exit gate terminal 40 without going through the network NW.

The guide display 314 displays a display indicating whether or not entry into the gate passage P is permitted under the control of the CPU 302 . The guide display 314 displays a display indicating that entry into the gate passage P is permitted when the entrance gate door 308 is open. Further, when the entrance gate door 308 is closed, the guide display 314 displays a display indicating that entry into the gate passage P is prohibited. The guidance indicator 314 can display a display indicating permission or denial of entry into the gate passage P by, for example, color display, symbol display, character display, or the like.

The entrance gate terminal 30 is thus configured.

Next, the configuration of the exit gate terminal 40 will be described with reference to FIGS. 11 and 13. FIG. As shown in FIG. 11, the exit gate terminal 40 is a gate device installed at the exit of the gate passage P through which the user U guided to the electronic gate 20 passes. The exit gate terminal 40 also has a CPU 402, a RAM 404, a storage device 406, and a display 408, as shown in FIG. Furthermore, the exit gate terminal 40 has a first camera 410 , a second camera 412 , an exit gate door 414 , a passage detection sensor 416 , a communication section 418 and a guidance indicator 420 . CPU 402 , RAM 404 , storage device 406 , display 408 , first camera 410 , second camera 412 , exit gate door 414 , passage detection sensor 416 , communication unit 418 and guide display 420 are connected to bus line 422 .

In addition, as shown in FIG. 11, the exit gate terminal 40 has a pair of housings 424 that face each other with the exit of the gate passage P interposed therebetween. The pair of housings 424 is provided with an exit gate door 414 capable of closing between the pair of housings 424 . In addition, a plurality of passage detection sensors 416 are provided on the pair of housings 424 so as to line up in the exit direction from the gate passage P. As shown in FIG. Further, the pair of housings 424 are provided with guide indicators 420 directed forward of the exit gate terminal 40 inside the gate passage P. As shown in FIG. The CPU 402 , the RAM 404 , the storage device 406 and the communication unit 418 may be housed in the housing 424 or may be housed in a housing separate from the housing 424 .

A display 408 is installed on one of the pair of housings 424 . The display 408 is installed, for example, so that its screen faces the center of the gate passage P in front of the exit gate terminal 40 . A first camera 410 and a second camera 412 are provided at the bottom and top of the display 408 on the screen side, respectively. The installation position of the display 408 is not particularly limited, and any position in the gate passage P where the user U can see the display 408 is acceptable.

The first camera 410 is a long-distance camera capable of photographing at least the inside of the gate passage P between the entrance gate terminal 30 and the exit gate terminal 40 and capable of photographing a longer distance than the second camera 412 . The second camera 412 is a short-range camera that captures at least the area in front of the exit gate terminal 40 . Note that the positions at which the first camera 410 and the second camera 412 are provided are not particularly limited, and may be any positions that can achieve their respective photographable ranges.

The first camera 410 captures the user U moving along the gate passage P from the entrance gate terminal 30 toward the exit gate terminal 40 and acquires the face image as the first target face image. If necessary, the second camera 412 moves through the gate passage P, reaches the exit gate terminal 40, photographs the user U who is in front of the exit gate door 414, and uses the facial image as the second target facial image. get. The image of the user U by the first camera 410 is performed without the user U being aware of it. On the other hand, the image of the user U by the second camera 412 is performed for the user U who has been notified of the image capturing by, for example, the display on the display 408 . The exit gate terminal 40 can perform non-positive authentication for identity verification by face collation using the first target face image captured by the first camera 410 without the user U being aware of it. In addition, when the non-active authentication fails, the exit gate terminal 40 performs active authentication for confirming the identity by face collation using the second target face image consciously captured by the user U with the second camera 412. It can be carried out.

The CPU 402 operates by executing programs stored in the storage device 406 and functions as a control unit that controls the operation of the exit gate terminal 40 as a whole. The CPU 402 also executes application programs stored in the storage device 406 to perform various processes as the exit gate terminal 40 . A RAM 404 provides a memory area necessary for the operation of the CPU 402 .

More specifically, the CPU 402 functions as a collation requesting unit that requests the management server 50 to collate the face of the user U who has entered the gate passage P through the entrance gate terminal 30 .

The CPU 402 as a matching request unit compares a first target face image, which is a face image of the user U captured by the first camera 410, and a plurality of registered face images registered in the user information DB 506a of the management server 50. The management server 50 is requested to perform 1:N collation. Therefore, the CPU 402 transmits the face feature amount extracted from the first target face image or the first target face image itself to the management server 50 together with the matching request.

Note that the CPU 402 can function as a quality determination unit that calculates a quality value indicating the quality of the first target face image and determines whether the calculated quality value is equal to or greater than a predetermined threshold. The quality value can be set to a larger value as the quality of the first target face image is higher. The CPU 402 as a collation requesting unit can request the management server 50 to collate the high-quality first target face image whose quality value is equal to or higher than a predetermined threshold with the registered face image. The quality value can also be set to a smaller value as the quality of the first target face image is higher. In this case, the CPU 402 as a quality determination unit can determine whether the calculated quality value is equal to or less than a predetermined threshold. Further, in this case, the CPU 402 as a matching request unit can request the management server 50 to match the high-quality first target face image whose quality value is equal to or less than a predetermined threshold with the registered face image. In this manner, the CPU 402 can determine the quality of the first target face image and request that the high quality first target face image having a certain quality or higher be compared with the registered face image.

The first target face image is captured by the first camera 410 without the user U being aware of it. For this reason, when the first target face image cannot be obtained with a quality value above a certain level, or when a face attachment such as a mask, sunglasses, glasses, or a hat is attached to the face of the user U, the first target face image Face matching using images may result in a mismatch. In these cases, the CPU 402 as a matching request unit selects a second target face image, which is a face image of the user U captured by the second camera 412, and a plurality of registered face images registered in the user information DB 506a. The management server 50 is requested to perform 1:N collation. Therefore, the CPU 402 transmits the face feature amount extracted from the second target face image or the second target face image itself to the management server 50 together with the matching request.

Further, the CPU 402 functions as a warning unit that warns the user U according to the state of the user U's face while the first camera 410 is shooting. More specifically, the CPU 402 can issue a warning as follows, for example.

First, the CPU 402 can perform line-of-sight detection in the first target face image while the first camera 410 is shooting. The CPU 402 can issue a warning according to the line of sight of the user U detected from the first target face image by line of sight detection. That is, when the CPU 402 determines that the user U is facing downward or sideways as a result of the line-of-sight detection, the CPU 402 can warn the user U to face forward, which is the side of the exit gate terminal 40 . can. For example, the CPU 402 displays on the display 408 a display instructing the user U to change the direction of the face to face forward, or instructs the user U to change the direction of the face to face forward from a speaker or the like. A warning can be given by uttering a warning sound. In this case, the warning display on the display 408 can be performed before performing face matching in order to prevent unnecessary face matching failures.

Further, the CPU 402 can perform wearing object estimation in the captured first target face image during the capturing by the first camera 410 . The CPU 402 can detect facial attachments such as masks, sunglasses, eyeglasses, and caps in the first target facial image by the attachment estimation. When the CPU 402 detects a face-mounted object, the CPU 402 can warn the user U to remove the face-mounted object that interferes with face matching. For example, the CPU 402 displays on the display 408 a display instructing the user U to remove the face attachment, or emits a sound from a speaker or the like instructing the user U to remove the face attachment. A warning can be given. In this case, the warning display on the display 408 can be performed before performing face matching in order to prevent unnecessary face matching failures.

The CPU 402 also functions as a verification information acquisition unit that acquires verification information indicating the result of face verification of the first target face image or the second face image requested from the management server 50 from the management server 50 . The verification information indicates that, as a result of verification, a registered face image that matches the first target face image or the second target face image has been found, and the identity of the user U has been successfully verified, or that no matching registered face image has been found. indicates that the identity verification of user U has failed. Note that when the first target face image or the second target face image and the registered face image match, the matching score indicating the degree of similarity between the two face images exceeds a predetermined threshold, and the two face images are highly similar. This includes cases that indicate degrees.

Instead of functioning as a matching request unit and a matching information acquisition unit, the CPU 402 performs 1:N matching between the first target face image or the second target face image and the registered face image in the user information DB 506a. It can also be configured to function as a collation unit that outputs collation information. In this case, the CPU 402 refers to the user information DB 506a of the management server 50, or refers to the user information DB stored in the storage device 406 in synchronization with the user information DB 506a to perform face image collation. can be done.

In addition, the CPU 402 functions as an information acquisition unit that acquires gate availability information associated with the user information of the user U from the management server 50 when the identification of the user U is successful by face matching. can be done. The gate usability information is information indicating the determination result as to whether the user U can use the electronic gate 20 as described above.

In addition, the CPU 402 determines whether or not the user U in the gate passage P is allowed to use the electronic gate 20 based on the face verification result of the first target face image or the second target face image and the determination result of whether or not the electronic gate 20 can be used. It functions as a determination unit that determines whether or not to pass through the The CPU 402 as a determination unit determines whether the face verification of the first target face image or the second target face image is matched, the identification of the user U is successful, and the user U can use the electronic gate 20. In some cases, it is determined that passage through the electronic gate 20 is possible. Successful identity verification means that the first target face image or the second target face image matches the registered face image, which is the photographed face image or the passport face image acquired by the kiosk terminal 10 . The case where the user U can use the electronic gate 20 is associated with the user information including the matching registered face image, and indicates that the user U can use the electronic gate 20. This is the case when information exists.

The CPU 402 also functions as a door control unit that controls opening and closing operations of the exit gate door 414 . When the CPU 402 determines that the user U can pass through the electronic gate 20, the CPU 402 opens the exit gate door 414 whose normal state is the closed state. When the CPU 402 determines that the user U has passed through the exit gate terminal 40 and left the gate passage P based on the output signal of the passage detection sensor 416 , the CPU 402 closes the exit gate door 414 .

The CPU 402 also functions as a determination unit that determines whether or not the user U has passed through the exit gate terminal 40 and left the gate passage P based on the output signals of the plurality of passage detection sensors 416 and their output order. .

When the CPU 402 determines that the user U has passed through the exit gate terminal 40 and left the gate passage P as described above, the CPU 402 determines that the user U has passed through the exit gate terminal 40 and left the gate passage P. to the entrance gate terminal 30.

The CPU 402 also functions as a display control unit that controls display on the display 408 . The CPU 402 can display various notifications for the user U in the gate passage P on the display 408 . For example, the CPU 402 causes the display 408 to display a warning instructing the user U in the gate passage P to remove facial attachments such as masks, sunglasses, eyeglasses, hats, etc. that hinder face matching. can be done. In addition, for example, the CPU 402 can cause the display 408 to display a notification to the effect that the second camera 412 will take a face image for the user U who stays in front of the exit gate door 414 as necessary. The CPU 402 causes the display 408 to instruct the user U to stay in front of the exit gate 414 when the matching between the first target face image and the registered face image does not match or when the matching cannot be performed. can be done. In this case, the CPU 402 can also cause the display 408 to instruct the user U to stay in front of the exit gate door 414 and look at the display 408 . Thereby, the user U can be guided so that the user U's face image can be captured by the second camera 412 .

The CPU 402 also functions as a display control unit that controls the display of the guide indicator 420 according to the open/close state of the exit gate door 414 . When the exit gate door 414 is open, the CPU 402 causes the guidance indicator 420 to display an indication that exiting from the gate passage P is permitted. In addition, when the exit gate door 414 is in a closed state, the CPU 402 causes the guidance indicator 420 to display an indication that exiting from the gate passage P is prohibited.

The storage device 406 is composed of a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit. The storage device 406 stores programs executed by the CPU 402, data referred to by the CPU 402 during execution of the programs, and the like.

The display 408 functions as a display unit that displays various screens to the user U in the gate passage P. FIG. For example, display 408 displays a warning to remove facial attachments that interfere with face matching, such as masks, sunglasses, glasses, and hats. Also, for example, the display 408 displays a notification to the effect that the second camera 412 will capture the face as necessary. Specifically, when the first target face image captured by the first camera 410 cannot be matched, the display 408 stops in front of the display 408 and moves toward the second camera 412 so that positive authentication can be performed. Display a display instructing the user to focus on the . For example, the display 408 can display an indication that the user should stop in front of the display 408 and look at the second camera 412, etc., because face authentication is performed. In addition, the display 408 displays the results of non-active authentication using the first target face image, which is the face image of the moving user U, and the positive authentication using the second target face image, which is the face image of the stationary user U. can be displayed.

The first camera 410 captures the image of the user U entering the gate passage P and moving through the gate passage P toward the exit gate terminal 40, and captures a face image of the user U as biometric information of the user U. It functions as a biometric information acquisition unit that acquires one target face image. The first target facial image captured by the first camera 410 is the facial image of the user U in motion. The first camera 410 is, for example, a photographing device such as a digital camera that photographs a moving image or a still image of the user U moving through the gate passage P. to get The first camera 410, as described above, has at least the inside of the gate passage P between the entrance gate terminal 30 and the exit gate terminal 40 as its imageable range, and has a long range capable of capturing a longer distance than the second camera 412. It's a camera. The first camera 410 photographs the user U without making the user U aware that he is being photographed. Instead of the first camera 410, a biometric information acquiring unit that acquires from the user U biometric information of the same kind as the registered biometric information registered in the user information DB 506a of the management server 50 can be provided.

If necessary, the second camera 412 takes an image of the user U who moves through the gate passage P, reaches the exit gate door 414 of the exit gate terminal 40 and stops, and uses the biometric information of the user U as biometric information. It functions as a biometric information acquiring unit that acquires a second target facial image that is U's facial image. The second target face image captured by the second camera 412 is the face image of the user U who is still. The second camera 412 is, for example, a photographing device such as a digital camera that photographs the user U in front of the exit gate door 414 as a moving image or a still image. Get an image. The second camera 412 is a short-range camera that captures at least the area in front of the exit gate terminal 40 as described above. The second camera 412 takes an image of the user U who has received a shooting notification, for example, through display on the display 408, voice guidance, or the like. The second camera 412 acquires a second target facial image to be compared with the registered facial image from the user U who remains in front of the exit gate door 414 in a predetermined case. The predetermined case referred to here is, as will be described later, a case where the matching between the first target face image and the registered face image is inconsistent or the matching is impossible. Specifically, the predetermined case is when the face of the user U moving toward the exit gate door 414 in the closed state does not face the exit gate door 414, and the wearable object is not placed on the face of the user U. For example, it is installed. Instead of the second camera 412, a biometric information acquiring unit that acquires from the user U biometric information of the same type as the registered biometric information registered in the user information DB 506a of the management server 50 can be provided.

The exit gate door 414 is an opening/closing door that performs an opening operation and a closing operation according to control by the CPU 402, and transitions between a closed state that blocks the passage of the user U and an open state that allows the passage of the user U. . The opening and closing method of the exit gate door 414 is not particularly limited, but may be, for example, a flapper type, a slide type, a rotary type, or the like.

When the passage detection sensor 416 detects that the user U has passed, it outputs an output signal indicating that the user U has passed. The CPU 402 determines whether the user U has passed through the exit gate terminal 40 based on the output signals of a plurality of passage detection sensors 416 provided on a pair of housings 424 so as to line up in the exit direction of the gate passage P and their output order. It is possible to determine whether or not the vehicle has exited from the gate passage P. The passage detection sensor 416 is not particularly limited, but similar to the passage detection sensor 310 of the entrance gate terminal 30, may be, for example, a transmissive photoelectric sensor, a reflective photoelectric sensor, or the like.

The communication unit 418 is connected to the network NW and transmits and receives data via the network NW. The communication unit 418 communicates with the management server 50, the entrance gate terminal 30, and the like under the control of the CPU 402. FIG. Note that the communication unit 418 may be connected to the entrance gate terminal 30 so as to be communicable with the entrance gate terminal 30 without going through the network NW.

The guide display 420 displays a display indicating permission or denial of exit from the gate passage P under the control of the CPU 402 . The guide display 420 displays a display indicating that exiting from the gate passage P is prohibited when the exit gate door 414 is closed. Further, the guide display 420 displays a display indicating that exit from the gate passage P is permitted when the exit gate door 414 is open. The guidance indicator 420 can display a display indicating permission or denial of exit from the gate passage P by, for example, color display, symbol display, character display, or the like.

Thus, the exit gate terminal 40 is constructed.

Next, the configuration of the management server 50 will be explained using FIG. FIG. 14 is a block diagram showing an example of the hardware configuration of the management server 50. As shown in FIG.

The management server 50 manages the information processing system 1, compares the first target face image or the second target face image with a plurality of registered face images in the user information DB 506a, determines the contents of the report included in the report information, and the like. It is an information processing device that performs Note that the functions of the management server 50 may be implemented by a single server, or may be implemented by a plurality of servers.

The management server 50 has a CPU 502, a RAM 504, a storage device 506, and a communication section 508, as shown in FIG. The CPU 502 , RAM 504 , storage device 506 and communication section 508 are connected to a bus line 510 .

The CPU 502 operates by executing programs stored in the storage device 506 and functions as a control unit that controls the overall operation of the management server 50 . The CPU 502 also executes application programs stored in the storage device 506 to perform various processes as the management server 50 . A RAM 504 provides a memory area necessary for the operation of the CPU 502 .

More specifically, the CPU 502 functions as a matching unit that performs face matching of the user U when receiving a matching request requesting face matching of the user U from the kiosk terminal 10 . The CPU 502 as a collating unit collates the photographed facial image and the passport facial image included in the user information at a ratio of 1:1. When matching the photographed face image and the passport face image, the CPU 502 compares the face feature amount extracted from the photographed face image with the face feature amount extracted from the passport face image, thereby matching both face images. can.

The CPU 502 also functions as a transmission unit that transmits matching information indicating the result of face matching of the user U to the kiosk terminal 10 that has transmitted the matching request. The match information indicates match match or match mismatch. That is, the verification information indicates that, as a result of verification, the photographed face image and the passport face image match, and the identification of the user U who declares customs has been successful, or the photographed face image and the passport face image do not match. indicates that the identity verification of user U has failed.

Further, the CPU 502 functions as a determination unit that determines the content of declaration included in the declaration information of the user U when receiving the user information of the user U from the kiosk terminal 10 . The CPU 502 as a determination unit determines whether or not the user U is subject to taxation, and whether or not the user U is at risk, based on the declaration contents included in the user U's declaration information. The case where user U is taxable and the case where user U is at risk are as described above.

In addition, the CPU 502 functions as a transmission unit that transmits determination information indicating the determination result of the declaration content included in the declaration information of the user U to the kiosk terminal 10 that transmitted the user information. As described above, the determination information indicates whether or not the user U is subject to taxation and whether or not the user U is at risk as a result of the determination.

The CPU 502 functions as an information management unit that stores and manages the user information of the user U received from the kiosk terminal 10 in the storage device 506 . The CPU 502 as an information management unit registers the user information received from the kiosk terminal 10 in the user information DB 506a stored in the storage device 506 and manages it. Each time the CPU 502 receives user information from the kiosk terminal 10, it registers the received user information in the user information DB 506a.

The user information of the user U includes the identification item information, face information and report information of the user U which are associated with each other, as described above. The face information is a photographed face image and a passport face image acquired by the kiosk terminal 10, or face feature amounts extracted from these. A photographed face image or a passport face image registered in the user information DB 506a is used as a registered face image, which is registered biometric information registered in advance. As the registered face image, either a photographed face image or a passport face image can be used, but a photographed face image newer than the passport face image can be used as the registered face image. A registered face image, which is a photographed face image or a passport face image registered in the user information DB 506a, or the face feature amount thereof is used for face matching for identity verification of the user U at the electronic gate 20. FIG.

In addition, when the CPU 502 receives gate availability information from the kiosk terminal 10, the CPU 502 registers the gate availability information in the user information DB 506a in association with the user information. As described above, the gate usability information is information indicating the determination result as to whether or not the electronic gate 20 can be used for the user U who makes a customs declaration.

The CPU 502 can also register the user information of the user U who is determined to be able to use the electronic gate 20 in the user information DB 506a based on the gate availability information. In other words, the CPU 502 may not register the user information of the user U who is determined to be unable to use the electronic gate 20 in the user information DB 506a.

In addition, instead of receiving the gate usability information from the kiosk terminal 10, the CPU 502 determines whether the user U can use the electronic gate 20 in the same way as the kiosk terminal 10 and obtains the gate usability information. can also

Also, the CPU 502 can delete the user information in the user information DB 506a after a certain period of time has passed since its registration. For example, the CPU 502 can delete the user information after the time normally required from completion of customs declaration at the kiosk terminal 10 to passing through the electronic gate 20 at the customs inspection area C has elapsed.

Further, the CPU 502 functions as a matching unit that performs face matching of the user U when receiving a matching request requesting face matching of the user U from the exit gate terminal 40 . The CPU 502 as a collating unit compares the first target face image or the second target face image or its facial feature amount with a plurality of registered facial images registered in the user information DB 506a or their facial feature amounts at a ratio of 1:N. match. When matching the first target face image or the second target face image with the registered face image, the CPU 502 compares the face feature amount extracted from the first target face image or the second target face image and the face feature amount extracted from the registered face image. Both face images can be matched by matching the amount.

The CPU 502 as a matching unit compares the first target face image or the second target face image with the plurality of registered face images, and selects the first target face image or the second target face image from among the plurality of registered face images. Attempt to find matching enrolled face images. In addition, the CPU 502 compares the facial feature amounts of the first target face image or the second target face image with the facial feature amounts of the plurality of registered face images to select the first face feature amount from among the facial feature amounts of the plurality of registered face images. An attempt is made to find a face feature quantity of a registered face image that matches the face feature quantity of the target face image or the second target face image. Note that when the first target face image or the second target face image and the registered face image match, the matching score indicating the degree of similarity between the two face images exceeds a predetermined threshold, and the two face images are highly similar. This includes cases that indicate degrees. Further, when the face feature amount of the first target face image or the second target face image and the face feature amount of the registered face image match, the matching score indicating the degree of similarity between the two face feature amounts is a predetermined threshold value. This includes the case where both facial feature values show a high degree of similarity exceeding .

The CPU 502 functions as a transmission unit that transmits collation information indicating the result of collation to the exit gate terminal 40 that has transmitted the collation request. The match information indicates match match or match mismatch. That is, the collation information indicates that, as a result of collation, a registered face image that matches the first target face image or the second target face image has been found and the identity of the user U has been successfully verified, or that a matching registered face image has been found. This indicates that the identification of the user U has failed without being verified. Also, the matching information indicates that, as a result of matching, the face feature amount of the registered face image that matches the face feature amount of the first target face image or the second target face image has been found, and the identity of the user U has been successfully verified. Alternatively, it indicates that the identification of the user U has failed because the matching face feature amount of the registered face image was not found. It should be noted that the CPU 502 may collate the first target face image or the second target face image or its facial feature quantity with one registered face image or its facial feature quantity.

The CPU 502 can delete the registered face image that matches the first target face image or the second target face image or the user information including the registered face image from the user information DB 506a. In addition, the CPU 502 uses the facial feature amount of the registered face image that matches the facial feature amount of the first target face image or the facial feature amount of the second target face image, or the user information including the facial feature amount of the registered face image. It can be deleted from the person information DB 506a.

In addition, the CPU 502 functions as a transmission unit that transmits information on whether or not the gate can be used to the exit gate terminal 40 as necessary.

A storage device 506 is configured by a storage medium such as a nonvolatile memory and a hard disk drive, and functions as a storage unit. The storage device 506 stores programs executed by the CPU 502, data referred to by the CPU 502 during execution of the programs, and the like.

The storage device 506 also stores a user information DB 506a. In the user information DB 506a, user information of a plurality of users U who have made customs declarations using the kiosk terminal 10 is registered. In addition, in the user information DB 506a, information on whether or not the user U can use the gate is registered in association with the user information.

The communication unit 508 is connected to the network NW and transmits and receives data via the network NW. The communication unit 508 communicates with the kiosk terminal 10, the exit gate terminal 40, etc., under the control of the CPU 502. FIG.

Thus, the management server 50 is configured.

In the kiosk terminal 10 according to this embodiment, a camera 116 provided between the display 110 and the passport reader 112 and code reader 114 photographs the user U operating the kiosk terminal 10 . The user U faces the camera 116 when viewing the display 110, holding the passport over the passport reader 112, or holding the portable terminal 60 over the code reader 114. As a result, the kiosk terminal 10 photographs the face of the user U with the camera 116 while reading the passport by the passport reader 112 or reading the declaration code by the code reader 114 in parallel. Get an image. Since the user U inevitably faces the camera 116 provided between the display 110 and the passport reader 112 and the code reader 114, the operation of the kiosk terminal 10 by the user U is interrupted and the camera 116 is turned on. No need to turn your face. Also, the kiosk terminal 10 can read the passport by the passport reader 112 and the declaration code by the code reader 114 at the same time or in any order.

Therefore, according to the kiosk terminal 10 according to the present embodiment, it is possible to complete procedures at the kiosk terminal 10 in a short time including reading a passport, reading a declaration code, and acquiring a photographed face image used for face matching. In addition, since the kiosk terminal 10 can photograph the face of the user U while the passport or the declaration code is being read, the user U does not have to be conscious of the photographing, which puts a psychological burden on the user U. can be reduced.

In addition, the exit gate terminal 40 of the electronic gate 20 according to the present embodiment captures the user U moving toward the exit gate terminal 40 with the first camera 410 and acquires the first target face image, and the management server 50 is compared with the registered face image registered in the user information DB 506a. The user U can acquire the first target face image without stopping. Therefore, according to the electronic gate 20 according to the present embodiment, it is possible to efficiently perform face matching of the user U using the first target face image. Thereby, the time required for the user U to pass through the electronic gate 20 can be shortened. In addition, the exit gate terminal 40 shoots the user U standing in front of the exit gate door 414 with the second camera 412 when the collation of the first target face images is inconsistent or the collation is not possible. The acquired second target face image and the registered face image are matched. Therefore, according to the electronic gate 20 according to the present embodiment, it is possible to reliably confirm the identity of the user U by face matching.

Furthermore, the exit gate terminal 40 of the electronic gate 20 according to the present embodiment opens the exit gate door 414 according to the judgment result of whether or not the gate can be used. Therefore, according to the electronic gate 20 of this embodiment, the time required for the user U to pass through the electronic gate 20 can be shortened.

15A to 20, the operation of each component in the information processing system 1 according to the present embodiment and the control method for realizing these operations will be further described below.

First, the operation of the kiosk terminal 10 and the operation of the management server 50 will be described with reference to FIGS. 15A to 18C. FIG. 15A is a schematic diagram showing an example of a declaration information input screen on mobile terminal 60. As shown in FIG. FIG. 15B is a schematic diagram showing an example of a declaration code display screen on the mobile terminal 60. As shown in FIG. FIG. 16 is a sequence diagram showing operations of the kiosk terminal 10 and the management server 50. As shown in FIG. FIG. 17 is a sequence diagram showing the language setting operation of the kiosk terminal 10. As shown in FIG. FIG. 18A is a schematic diagram showing an example of a reception screen on the kiosk terminal 10. FIG. FIG. 18B is a schematic diagram showing an example of a declaration content confirmation screen on the kiosk terminal 10. As shown in FIG. FIG. 18C is a schematic diagram showing an example of the guidance screen on the kiosk terminal 10. As shown in FIG.

For example, a user U arriving at an airport from a foreign country by air passes through immigration inspection at an immigration inspection area, receives checked baggage at a baggage claim area, and so on, and heads for a customs inspection area C to declare customs. The user U inputs declaration information in the customs declaration application executed on the mobile terminal 60, and generates and displays a declaration code including the declaration information. Note that the user U may generate and display the declaration code before using the kiosk terminal 10 .

15A shows the declaration information input screen SHE of the customs declaration application on the mobile terminal 60. FIG. The declaration information input screen SHE has, for example, a declaration information input field SHE10 for inputting information to be declared in customs declaration for travel goods. In the case of Japan, for example, the declaration information input field SHE10 allows the entry of information to be declared in the declaration of Personal Effects and Unaccompanied Goods Declaration of Customs Form C No. 5360. That is, in the declaration information input field SHE10, it is possible to input boarding information, which is information related to the boarding of the user U such as boarding flight number, departure place, date of entry, etc., and answers to questions. In the customs declaration application, among the declaration information, user U's basic information such as user U's name, current address, telephone number, date of birth, passport number, etc., which does not change each time a customs declaration is made, is not shown. It can be registered by inputting it on a user registration screen, a setting screen, or the like.

FIG. 15B shows the declaration code display screen SHC of the customs declaration application on the mobile terminal 60 . The declaration code display screen SHC has a declaration code display field SHC10 in which a declaration code including the declaration information input on the declaration information input screen SHE is generated and displayed. The declaration code displayed in the declaration code display field SHC10 further includes language information regarding the language used by the customs declaration application in addition to declaration information. Further, the declaration code display field SHC10 can display the date and time when the declaration code is valid, how to use the declaration code, and the like.

A user U entering the customs inspection site C declares customs at a kiosk terminal 10 installed near the entrance of the customs inspection site C. It should be noted that the user U can generate and display the declaration code on the portable terminal 60 before going to the kiosk terminal 10 . At that time, the user U is asked how to use the declaration code displayed by the customs declaration application of the mobile terminal 60, and how to proceed with the kiosk terminal 10 displayed on the digital signage terminal 70 installed near the kiosk terminal 10. You can refer to guidance such as

As shown in FIG. 16, the CPU 102 of the kiosk terminal 10 continuously determines whether or not the passport has been held over the passport reader 112 and whether or not the declaration code has been held over the code reader 114 (step S102). In this way, the CPU 102 waits until at least one of the passport and the declaration code is held up (step S102, NO).

FIG. 18A shows an example of a reception screen SKR displayed on the display 110 of the kiosk terminal 10 waiting for the user U to hold up at least one of the passport and the declaration code. The reception screen SKR displays, for example, that a declaration code is required to use the kiosk terminal 10 and how to hold the passport and the declaration code.

As shown in FIG. 16, when the CPU 102 determines that the passport has been held up (step S102, YES), the passport reader 112 reads the passport information such as the identification information of the user U and the passport face image from the passport. Acquire (step S104). When the CPU 102 determines that the declaration code has been held up (step S102, YES), the code reader 114 reads and acquires declaration information and language information from the declaration code (step S106).

The user U may hold the passport over the passport reader 112 before the declaration code is read, or may hold the declaration code over the code reader 114 before the passport is read. good. In addition, the user U may simultaneously hold the passport and the declaration code over the passport reader 112 and the code reader 114 to read them. The CPU 102 can cause the passport reading device 112 to read the passport and the code reading device 114 to read the declaration code in an arbitrary order or at the same time according to the timing of reading the passport and the declaration code of the user U. can.

Further, when the CPU 102 detects that a certain period of time has elapsed or the user U has left the kiosk terminal 10 without the other being held up after reading one of the passport and the declaration code, the process can be interrupted. In this case, the CPU 102 can, for example, display an error display on the display 110, or perform reset processing to invalidate the processing up to that point. The CPU 102 can then proceed to step S102. Note that the CPU 102 can detect that the user U has left the kiosk terminal 10 based on, for example, moving images captured by the camera 116 or still images continuously captured.

Further, when the CPU 102 determines that the passport or the declaration code has been held up (step S102, YES), the camera 116 photographs the face of the user U to obtain the photographed face image of the user U (step S108). . In parallel with the reading of the passport by the passport reader 112 or the reading of the declaration code by the code reader 114, the CPU 102 photographs the face of the user U by the camera 116 during the reading of the passport or the declaration code. can be done. The camera 116 can start shooting when the passport or declaration code is held up.

In this way, the CPU 102 captures the facial image of the user U who has the passport reader 112 read the passport in front of the kiosk terminal 10 or has the code reader 114 read the declaration code in front of the kiosk terminal 10 by the camera 116 . get.

As described above, the camera 116 is provided so that its photographing direction is directed obliquely forward and upward. It has an angle of view that can capture the face of For this reason, the camera 116 directs the line of sight diagonally forward and downward, looks down at the display 110, the passport reader 112, or the code reader 114, and consciously captures the face of the user U who operates the kiosk terminal 10. You can shoot without worrying. For example, there is no need to request the user U to face the camera 116 when photographing with the camera 116 .

In addition, the camera 116 can acquire a plurality of face images of the user U who operates the kiosk terminal 10 by capturing moving images at a predetermined frame rate or capturing still images at predetermined time intervals. In this case, the CPU 102 can select and acquire the face image with the highest quality among the plurality of face images of the user U photographed by the camera 116 as the photographed face image of the user U. The camera 116 can start photographing triggered by the passport or declaration code being held up. The quality of the face image can be evaluated, for example, based on the orientation of the face with respect to the camera 116. If the orientation of the face with respect to the camera 116 is within a predetermined range, the face image is judged to have a certain level of quality or higher. can be evaluated.

When the CPU 102 acquires the passport face image of the user U from the passport and acquires the photographed face image of the user U by the camera 116, the CPU 102 transmits a matching request requesting the face matching of the user U to the management server 50 through the network. Transmit via NW (step S110). The CPU 102 transmits the photographed face image and the passport face image or the face feature amounts thereof to the management server 50 together with a verification request.

Upon receiving the matching request from the kiosk terminal 10, the CPU 502 of the management server 50 performs face matching of the user U (step S112). The CPU 502 collates the photographed facial image and the passport facial image at a ratio of 1:1.

Next, the CPU 502 transmits matching information indicating the result of matching between the photographed face image and the passport face image to the kiosk terminal 10 via the network NW (step S114).

In this way, while the user U is operating the kiosk terminal 10, face matching of the user U is performed by matching the photographed face image with the passport face image.

If the photographed face image and the passport face image are not matched, the kiosk terminal 10 repeats step S108 of photographing the face of the user U with the camera 116 to acquire the photographed face image of the user U. By executing it, the captured face image can be re-captured. The kiosk terminal 10 can re-capture the captured face image only once or multiple times.

In addition, the CPU 102 sets the language to be used for the kiosk terminal 10 so that the user U can confirm and, if necessary, correct the contents of the declaration (step S116). In setting the language to be used, the CPU 102 first acquires language information read from the declaration code, as shown in FIG. 17 (step S202).

Next, the CPU 102 sets the language used for the customs declaration application indicated in the acquired language information as the language used for the kiosk terminal 10 (step S204). Here, the language used by the customs declaration application set as the language used by the kiosk terminal 10 is the language set in the language setting of the mobile terminal 60, or the language set in the customs declaration application if the language is set. is. As a result, the CPU 102 can display various information on the display 110 in the same language as the customs declaration application of the portable terminal 60 used by the user U. In addition, the CPU 102 can accept input from the user U from the input device 108 such as a touch panel incorporated in the display 110 in the same language as the customs declaration application of the mobile terminal 60 used by the user U. can.

The CPU 102 also determines whether or not the user U has input a change instruction to change the language used to another language via the input device 108 (step S206). If no change instruction is input (step S206, NO), CPU 102 maintains the language used set in step S204.

If a change instruction is input (step S206, YES), the CPU 102 changes the working language of the kiosk terminal 10 to another language indicated by the change instruction (step S208).

In this way, even if the user U is a foreigner, the user U can confirm the displayed contents and input information in the language he/she uses or the language he/she instructs to change in the kiosk terminal 10 . Therefore, the user U can smoothly use the kiosk terminal 10 without language being an obstacle.

After setting the language to be used for the kiosk terminal 10, the CPU 102 displays, on the display 110, the contents of the declaration information read from the declaration code on the display 110 as shown in FIG. is received as necessary (step S118). The user U confirms the content of the declaration displayed on the display 110, and corrects the content of the declaration through the input device 108 if the content of the declaration needs to be corrected. After confirming the contents of the declaration, the user U inputs, through the input device 108, a confirmation instruction for confirming the contents of the declaration and confirming the contents of the declaration. As a result, the contents of the declaration made by the user U in the customs declaration are determined.

FIG. 18B shows an example of the declaration content confirmation screen SKC displayed on the display 110 of the kiosk terminal 10 where the user U confirms the declaration content and corrects it as necessary. The declaration content confirmation screen SKC displays the declaration content included in the declaration information. The declaration content confirmation screen SKC can shift to a declaration content correction screen where the declaration content can be corrected, for example, by pressing a correction button by the user U's touch input. For example, when the user U presses a confirmation button on the declaration content confirmation screen SKC, a confirmation instruction is input to the kiosk terminal 10 . As a result, the contents of the declaration made by the user U in the customs declaration are determined.

The CPU 102 can display the declaration information input screen SHE of the customs declaration application shown in FIG. By unifying the layout of both screens, it is possible to realize a screen display that makes it difficult for the user to get lost in operating the kiosk terminal 10 .

When the contents of the declaration are confirmed, as shown in FIG. 16, the CPU 102 transmits the user information of the user U to the management server 50 via the network NW (step S120). The user information includes user U's identification information, face information, and report information that are associated with each other. Since the CPU 102 transmits the photographed face image and the passport face image along with the verification request in step S110, it is not necessary to retransmit the face information in the user information.

Next, the CPU 502 determines the report content included in the report information of the user information of the user U (step S122). The CPU 502 determines whether or not the user U is subject to taxation, and whether or not the user U is at risk, based on the declaration contents included in the user U's declaration information.

Furthermore, the CPU 502 can verify the passport number in addition to determining the content of the declaration. In this case, the CPU 502 collates the passport number included in the identification information of the user information with the passport number included in the report information of the user information.

Next, the CPU 502 transmits judgment information indicating the judgment result of the content of declaration included in the declaration information of the user U to the kiosk terminal 10 via the network NW (step S124). In addition, the CPU 502 can include the result of checking the passport number in the determination information.

Upon receiving the determination information from the management server 50, the CPU 102 of the kiosk terminal 10 determines whether or not the user U can use the electronic gate 20 based on the received determination information and the previously received verification information (step S126). The previously received collation information was transmitted from the management server 50 in step S114. Note that the CPU 102 can display collation information indicating the result of collation between the photographed face image and the passport face image and determination information indicating the determination result of the content of the declaration on the display 110 for the user U.

The CPU 102 determines that the user U can use the electronic gate 20 when the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, and the user U has no risk. judge. If the determination information includes the result of matching the passport number, the CPU 102 determines that the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, and the user U is not at risk. Furthermore, when the passport numbers match, it is determined that the user U can use the electronic gate 20 .

On the other hand, the CPU 102 determines that the user U is subject to taxation, or that the user U is at risk, if the passport face image of the user U does not match the photographed face image, or if the user U is at the electronic gate 20 is determined to be unavailable. If the determination information includes the result of matching the passport numbers, the CPU 102 determines that the user U cannot use the electronic gate 20 even if the passport numbers do not match.

The CPU 102 transmits to the management server 50 gate usability information indicating the determination result of the usability of the electronic gate 20 (step S128). The gate availability information indicates that the passport face image of the user U matches the photographed face image, the user U is not subject to taxation, and the user U is not at risk. 20 is available. If the determination information includes the result of matching the passport number, the gate availability information indicates that the user U can use the electronic gate 20 if the passport numbers match.

When the CPU 502 of the management server 50 receives the gate usability information from the kiosk terminal 10, it registers the user information of the user U in the user information DB 506a in association with the gate usability information (step S130). Note that instead of receiving the gate usability information from the kiosk terminal 10, the CPU 502, like the CPU 102 of the kiosk terminal 10, determines whether the user U can use the electronic gate 20 based on the collation information and the determination information. can also be determined.

In addition, the CPU 502 can register user information of a specific user U in the user information DB 506a instead of associating the user information with gate availability information and registering it in the user information DB 506a. That is, the CPU 502 can also register the user information of the user U determined to be able to use the electronic gate 20 in the user information DB 506a based on the gate availability information. In other words, the CPU 502 can also avoid registering user information of users U other than a specific user U in the user information DB 506a.

Next, when CPU 102 of kiosk terminal 10 determines that user U can use electronic gate 20 (step S132, YES), CPU 102 executes processing for guiding user U to electronic gate 20 (step S134). ). The CPU 102 guides the user U to the electronic gate 20 by causing the display 110 to display a guidance screen for guiding the user U to the electronic gate 20, for example.

FIG. 18C shows an example of a guidance screen SKG displayed on the display 110 of the kiosk terminal 10 that guides the user U to the electronic gate 20. FIG. The guidance screen SKG shows, for example, words, symbols, pictures, etc., that guide the passenger to the electronic gate 20, and also shows words, symbols, pictures, etc. that indicate that the customs declaration has been completed.

On the other hand, when the CPU 102 determines that the user U cannot use the electronic gate 20 (step S132, NO), CPU 102 executes a handling process for the user U who cannot use the electronic gate 20 (step S136). As a corresponding process, the CPU 102 guides the user U to the manned booth M by causing the display 110 to display a guidance screen for guiding the user U to the manned booth M, for example.

Thus, customs declaration by the user U is performed at the kiosk terminal 10 .

Next, the operation of the electronic gate 20 to which the user U is guided at the kiosk terminal 10 will be described together with the operation of the management server 50 with reference to FIGS. 19 and 20. FIG. FIG. 19 is a sequence diagram showing operations of the entrance gate terminal 30 and the exit gate terminal 40 that constitute the electronic gate 20, and the management server 50. As shown in FIG.

In the standby state of the electronic gate 20 when the user U does not enter the gate passage P, the entrance gate door 308 of the entrance gate terminal 30 is in the open state, and the exit gate door 414 of the exit gate terminal 40 is in the closed state. It's becoming Further, in the standby state, the guide display 314 of the entrance gate terminal 30 displays a display indicating permission to enter the gate passage P, and the guide display 420 of the exit gate terminal 40 displays a display prohibiting exit from the gate passage P. is displayed.

The user U who has completed the customs declaration at the kiosk terminal 10 and is guided to the electronic gate 20 enters the gate passage P through the entrance gate terminal 30 with the entrance gate door 308 open.

As shown in FIG. 19, in the standby state, the CPU 302 of the entrance gate terminal 30 determines whether or not the user U has passed through the entrance gate terminal 30 and entered the gate passage P (step S302). Wait for U to pass (step S302, NO). The CPU 302 can determine whether or not the user U has passed through the entrance gate terminal 30 and entered the gate passage P based on the output signals of the plurality of passage detection sensors 310 and their output order.

When the CPU 302 determines that the user U has passed through the entrance gate terminal 30 and entered the gate passage P (step S302, YES), the CPU 302 closes the entrance gate door 308 (step S304). In addition, the CPU 302 changes the display of the guide display 314 from the display indicating that entry into the gate passage P is permitted to the display indicating that entry into the gate passage P is prohibited.

The entrance gate door 308 is controlled so as not to open until the user U who has entered the gate passage P passes through the exit gate terminal 40 and leaves the gate passage P, as will be described later. Therefore, only one user U can enter the gate passage P. As a result, it is possible to prevent a situation in which a plurality of users U are photographed by the first camera 410, and it is possible to reliably perform matching of the first target face image.

The CPU 302 also transmits entrance passage information indicating that the user U has passed through the entrance gate terminal 30 and entered the gate passage P to the exit gate terminal 40 (step S306). Note that the CPU 302 can execute either step S304 or step S306 in the first order, or can execute both steps S304 and S306 at the same time.

The CPU 402 of the exit gate terminal 40, which has received the entrance passage information from the entrance gate terminal 30, uses the first camera 410 to photograph the user U moving toward the exit gate terminal 40 along the gate passage P. A first target face image is obtained (step S308). The first camera 410 acquires a plurality of first target face images of the user U moving through the gate passage P by capturing moving images at a predetermined frame rate or capturing still images at predetermined time intervals. Thus, the first target facial image, which is the facial image of the user U moving in the gate passage P, is acquired. The user U can move toward the exit gate terminal 40 without stopping in the gate passage P while the first camera 410 is shooting.

While photographing by the first camera 410, the CPU 402 performs line-of-sight detection in the first target face image. A warning can be given to face forward, which is the side of the exit gate terminal 40 . The CPU 402 can warn the user U to face forward, for example, by means of a display on the display 408 or sound from a speaker or the like. This makes it possible to obtain a high-quality first target face image more reliably.

Contrary to the above warning, when the user U does not face forward, the CPU 402 does not perform the quality determination in step S310 and the matching request in step S312, and does not perform matching of the first target face image. You can also

Also, during the shooting by the first camera 410, the CPU 402 performs wearing object estimation in the shot first target facial image, and attempts to detect facial wearing objects such as sunglasses, eyeglasses, and hats in the first target facial image. When the CPU 402 detects the face attachment, the CPU 402 can warn the user U to remove the face attachment by means of display on the display 408, sound from a speaker, or the like. As a result, it is possible to remove factors that hinder matching of the first target face image.

If the face attachment is not removed from the user U's face contrary to the above warning, the CPU 402 does not perform the quality determination in step S310 and the matching request in step S312, and performs matching of the first target face image. You can also choose not to do

The CPU 402 calculates a quality value for each acquired first target face image, and determines the quality of the first target face image based on the calculated quality value (step S310).

As a result of the quality determination, the CPU 402 sequentially transmits a matching request to the management server 50 via the network NW for the first target face images having a certain quality or higher (step S312). As a result, the CPU 402 instructs the management server 50 to perform a 1:N collation of the first target face image of a certain quality or higher with a plurality of registered face images registered in the user information DB 506a of the management server 50. request. The CPU 402 transmits the face feature amount extracted from the first target face image or the first target face image itself to the management server 50 together with a matching request.

Note that the CPU 402 may transmit all acquired first target face images to the management server 50 regardless of quality. In this case, the CPU 502 of the management server 50 can similarly determine the quality of the first target face image, and compare the first target face image with a certain quality or higher with the registered face image. Also, the CPU 502 can match the first target face image and the registered face image regardless of quality.

When the CPU 502 of the management server 50 receives the request for collation of the first target face image from the exit gate terminal 40, it collates the first target face image (step S314). The CPU 502 collates the facial feature amount of the first target facial image received from the exit gate terminal 40 with the facial feature amounts of a plurality of registered facial images registered in the user information DB 506a on a 1:N basis. The facial features of the first target facial image are those received from the exit gate terminal 40 or extracted from the first target facial image received from the exit gate terminal 40 .

Next, the CPU 502 transmits verification information indicating the verification result of the first target face image to the exit gate terminal 40 via the network NW (step S316).

The CPU 402 of the exit gate terminal 40 and the CPU 502 of the management server 50 can repeatedly execute steps S312, S314, and S316 for a plurality of first target face images having a certain quality or higher.

The CPU 402 of the exit gate terminal 40 receives verification information from the management server 50 . The CPU 402, when the verification information for any of the first target face images indicates that a matching registered face image has been found and has successfully verified the identity of the user U moving through the gate passage P (step S318). , YES), and the photographing by the first camera 410 ends. Subsequently, the CPU 402 proceeds to step S336.

On the other hand, if the CPU 402 indicates that verification information for any of the first target face images has failed to find a matching registered face image by a predetermined time (step S318, NO), it is determined that the personal identification by matching the first target face image has failed. The predetermined point in time is, for example, the point in time when the user U reaches the exit gate door 414 of the exit gate terminal 40 . The CPU 402 can determine whether or not the user U has reached the exit gate door 414 from the image captured by the first camera 410 .

In addition, the CPU 402 can also determine that the identity verification by matching the first target face image has failed even when the matching information is not received by a predetermined time similar to the above. In this case, the first target face image having a certain quality or higher cannot be acquired, and the first target face image and the registered face image cannot be compared.

When the CPU 402 determines that the personal identification by matching the first target face image has failed, the CPU 402 notifies the user U that the second camera 412 will take a picture (step S320). In other words, the CPU 402 notifies the user U that the second camera 412 will take pictures when the first target face image and the registered face image do not match or cannot be matched. The CPU 402 can notify the user that the second camera 412 will shoot by, for example, the display on the display 408, voice guidance, or the like.

Next, the CPU 402 uses the second camera 412 to photograph the user U who has received the notification and stays in front of the exit gate door 414 (step S322). As a result, the CPU 402 acquires the second target face image of the user U who has reached in front of the exit gate door 414 of the exit gate terminal 40 and remains in front of the exit gate door 414 . In this way, the second target facial image, which is the facial image of the user U standing still in front of the exit gate door 414, is acquired.

The second camera 412 can acquire a plurality of face images of the user U in front of the exit gate door 414 by shooting moving images at a predetermined frame rate or shooting still images at predetermined time intervals. . In this case, the CPU 402 can select and acquire the face image with the highest quality as the second target face image of the user U from among the plurality of face images of the user U photographed by the second camera 412 . can.

The CPU 402 can guide the user U when the second camera 412 takes a picture, for example, by means of display on the display 408 or sound from a speaker or the like. For example, if a face attachment is detected in the second target face image, the CPU 402 can guide the user U to remove the face attachment, to turn the second camera 412 toward the display 408, and the like. can.

FIG. 20 shows an example of a guidance display displayed on the display 408 when shooting with the second camera 412 . As illustrated, the display on the display 408 can guide the user to remove the mask, which is a face attachment.

Next, CPU 402 transmits a matching request for the second target face image to management server 50 via network NW (step S324). Accordingly, the CPU 402 requests the management server 50 to match the second target face image with a plurality of registered face images registered in the user information DB 506a of the management server 50 at a ratio of 1:N. The CPU 402 transmits the face feature amount extracted from the second target face image or the second target face image itself to the management server 50 together with a matching request.

When the CPU 502 of the management server 50 receives the matching request for the second target face image from the exit gate terminal 40, the CPU 502 performs matching for the second target face image (step S326). The CPU 502 collates the facial feature amount of the second target facial image received from the exit gate terminal 40 with the feature amounts of a plurality of registered facial images registered in the user information DB 506a at a ratio of 1:N. The face feature quantity of the second target face image is received from the exit gate terminal 40 or extracted from the second target face image received from the exit gate terminal 40 .

Next, the CPU 502 transmits verification information indicating the verification result of the second target face image to the exit gate terminal 40 via the network NW (step S328).

The CPU 402 of the exit gate terminal 40 receives verification information from the management server 50 . If the verification information for the second target face image indicates that a matching registered face image has been found and the identification of the user U in front of the exit gate door 414 has succeeded (step S330, YES), the CPU 402 The process proceeds to step S336.

When the second target face image and the registered face image do not match, the exit gate terminal 40 captures the user U with the second camera 412 to acquire the second target face image of the user U. The second target face image can be re-captured by executing step S322 again. The exit gate terminal 40 can re-capture the second target face image only once or multiple times.

In addition, when the CPU 502 of the management server 50 succeeds in confirming the identity of the user U as a result of matching the first target face image or matching the second target face image (step S332, YES), the CPU 502 transmits the gate availability information. (step S334). That is, the CPU 502 acquires the gate availability information associated with the user information of the user U whose identity has been successfully verified from the user information DB 506a, and transmits the information to the exit gate terminal 40 via the network NW.

CPU 402 of exit gate terminal 40, if the verification information for the second target face image indicates that a matching registered face image has not been found and the identity verification of user U has failed (step S330, NO), Processing is executed (step S338). In this case, verification of the identity of the user U fails in both the verification of the first target face image and the verification of the second target face image. As a corresponding process, the CPU 402 can, for example, sound an alarm or send a notification to the terminal of the customs officer in order to call the customs officer to the gate passage P. In this case, the customs officer can, for example, guide the user U to the manned booth M or another room. In addition, after the customs officer conducts a face-to-face customs inspection on the inspection table provided on the side of the electronic gate 20, the user U exits the gate passage P through the manually opened exit gate door 414. be able to.

On the other hand, the CPU 402 succeeds in verifying the identity of the user U by matching the first target face image or matching the second target face image, and proceeds to step S336. is determined (step S336). The CPU 402 determines whether or not the electronic gate 20 can be used based on the gate availability information received from the management server 50 .

When CPU 402 determines that electronic gate 20 cannot be used (step S336, NO), CPU 402 executes a corresponding process (step S338). In this case, although the identification of the user U is successful through the matching of the first target facial image or the matching of the second target facial image, the user U is determined to be subject to taxation, and is at risk. Those who are judged to be As a corresponding process, the CPU 402 can, for example, sound an alarm or send a notification to the terminal of the customs officer in order to call the customs officer to the gate passage P. In this case also, the customs officer can deal with the user U in the same manner as described above.

On the other hand, when the CPU 402 determines that the electronic gate 20 can be used (step S336, YES), it opens the exit gate door 414 (step S340). In addition, the CPU 402 changes the display of the guide display 420 from the display indicating that exiting from the gate passage P is prohibited to the display indicating that exiting from the gate passage P is permitted.

Next, the CPU 402 determines whether or not the user U has passed through the exit gate terminal 40 and left the gate passage P (step S342), and waits for the user U to pass through (step S342, NO). The CPU 402 can determine whether or not the user U has passed through the exit gate terminal 40 and left the gate passage P based on the output signals of the plurality of passage detection sensors 416 and their output order.

When the CPU 402 determines that the user U has passed through the exit gate terminal 40 and left the gate passage P (step S342, YES), the CPU 402 closes the exit gate door 414 (step S344). In addition, the CPU 402 changes the display of the guidance indicator 420 from the display indicating permission to exit from the gate passage P to the display indicating prohibition from exiting the gate passage P. FIG.

The CPU 402 also transmits to the entrance gate terminal 30 the exit passage information indicating that the user U has passed through the exit gate terminal 40 and left the gate passage P (step S346). It should be noted that the CPU 402 can execute either step S344 or step S346 in that order, or can execute both steps S344 and S346 at the same time.

Upon receiving the exit passage information from the exit gate terminal 40, the CPU 302 of the entrance gate terminal 30 opens the entrance gate door 308 (step S348). In addition, the CPU 302 changes the display of the guidance indicator 314 from the display indicating that entry into the gate passage P is prohibited to the display indicating that entry into the gate passage P is permitted.

In this way, the electronic gate 20 shifts to a standby state waiting for the user U to enter the gate passage P.

As described above, according to the present embodiment, the kiosk terminal 10 acquires a photographed face image to be used for face collation, which is collation of biometric information, while reading a passport or a declaration code. Therefore, according to the present embodiment, it is possible to complete procedures at the kiosk terminal 10 in a short time, including acquisition of information by reading a passport and a declaration code, and face matching using a photographed face image. .

Further, according to the present embodiment, at the exit gate terminal 40 of the electronic gate 20, the user U moving toward the exit gate terminal 40 is photographed by the first camera 410, and face collation, which is collation of biometric information, is performed. Acquire a first target face image to be used for. Further, according to the present embodiment, the exit gate door 414 is opened according to the determination result of whether the gate can be used or not. Therefore, according to this embodiment, the time required for the user U to pass through the electronic gate 20 can be shortened.

[Other embodiments]
The information processing apparatus described in the above embodiment can also be configured as shown in FIG. 21 according to another embodiment. FIG. 21 is a schematic diagram showing the configuration of an information processing device according to another embodiment.

As shown in FIG. 21, an information processing apparatus 1000 according to another embodiment has a reading unit 1002 and a biometric information acquisition unit 1004 . A reading unit 1002 reads a user's medium and acquires information including the user's biometric information from the medium. A biometric information acquisition unit 1004 acquires the user's biometric information from the user while reading the medium.

According to the information processing apparatus 1000 according to another embodiment, the user's biometric information is acquired from the user who causes the reading unit 1002 to read the medium while the medium is being read. can be completed in a short time.

[Modified embodiment]
The present invention is not limited to the above embodiments, and various modifications are possible.

For example, in the above embodiment, the kiosk terminal 10 is used for customs declaration, but the present invention is not limited to this. The kiosk terminal 10 can be configured to accept various declarations by the user.

Further, in the above embodiment, the case where the camera 116, the first camera 410, and the second camera 412 photograph and acquire the facial image of the user U as the biological information of the user U has been described as an example, but the present invention is limited to this. not to be The camera 116, the first camera 410, and the second camera 412 may acquire, as biometric information of the user U, a facial image, which is facial information, an iris image, or the like.

Also, the kiosk terminal 10 according to the above embodiment can be configured as a system consisting of one or more devices. Also, the entrance gate terminal 30 according to the above embodiment can be configured as a system consisting of one or more devices. Also, the exit gate terminal 40 according to the above embodiment can be configured as a system consisting of one or more devices. Moreover, the management server 50 according to the above embodiment can be configured as a system consisting of one or more devices.

There is also a processing method in which a program for operating the configuration of each embodiment described above is recorded on a recording medium, the program recorded on the recording medium is read as code, and executed by a computer. It is included in the category of each embodiment. That is, a computer-readable recording medium is also included in the scope of each embodiment. In addition to recording media on which the computer programs described above are recorded, the computer programs themselves are also included in each embodiment.

As the recording medium, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM (Compact Disc-Read Only Memory), magnetic tape, nonvolatile memory card, and ROM can be used. In addition, the program is not limited to executing the processing by itself, which is recorded on the recording medium, but in cooperation with other software and functions of the expansion board, it operates on the OS (Operating System) to execute the processing. are also included in the scope of each embodiment.

Some or all of the above-described embodiments can also be described in the following supplementary remarks, but are not limited to the following.

(Appendix 1)
a reading unit that reads the user's medium and acquires information including the user's biometric information from the medium;
and a biometric information acquisition unit that acquires biometric information of the user from the user while reading the medium.

(Appendix 2)
1. The information processing apparatus according to Supplementary Note 1, further comprising a control unit that requests or performs collation between the biometric information acquired by the reading unit and the biometric information acquired by the biometric information acquisition unit.

(Appendix 3)
The reading unit
a first reading unit that reads a first medium containing the biological information and obtains first information containing the biological information from the first medium;
a second reading unit that reads a code displayed on a second medium and acquires second information from the code;
3. The information processing apparatus according to appendix 1 or 2, wherein the biometric information acquisition unit acquires the biometric information of the user from the user when at least one of the first medium and the code is read.

(Appendix 4)
The reading unit
a first reading unit that reads a first medium containing the biological information and obtains first information containing the biological information from the first medium;
a second reading unit that reads a code displayed on a second medium and acquires second information from the code;
The biometric information acquisition unit acquires the biometric information of the user from the user when reading either the first medium or the code,
When the other of the first medium and the code is read, the biometric information acquired by the reading unit is requested to be compared with the biometric information acquired by the biometric information acquisition unit, or control is performed. The information processing apparatus according to appendix 1, comprising:

(Appendix 5)
5. The information processing apparatus according to appendix 3 or 4, wherein the first reading unit and the second reading unit can read the first medium and the code, respectively, in any order or simultaneously.

(Appendix 6)
the code includes language information;
The reading unit obtains language information from the code,
6. The information processing apparatus according to any one of Appendices 3 to 5, further comprising a language setting unit that sets a language used by the information processing apparatus based on the language information.

(Appendix 7)
The first medium is the user's passport,
7. The information processing apparatus according to any one of Appendices 3 to 6, wherein the second medium is a mobile terminal that displays the code including declaration information necessary for customs declaration.

(Appendix 8)
Having a display unit provided at a position higher than the reading unit,
8. The information processing apparatus according to any one of Appendices 1 to 7, wherein the biometric information acquiring unit is provided between the reading unit and the display unit.

(Appendix 9)
Processing for the user according to a result of matching the biometric information acquired by the reading unit and the biometric information acquired by the biometric information acquisition unit, and a determination result of the information acquired from the medium 9. The information processing apparatus according to any one of appendices 1 to 8, comprising a processing unit that executes

(Appendix 10)
The display unit displays a comparison result of the biometric information acquired by the reading unit and the biometric information acquired by the biometric information acquisition unit, and a determination result of the information acquired from the medium. 9. The information processing device according to 8.

(Appendix 11)
11. The information processing apparatus according to any one of Supplements 1 to 10, wherein the biometric information acquisition unit acquires the face image with the highest quality among a plurality of face images of the user as the biometric information of the user. .

(Appendix 12)
reading a medium of the user by a reading unit to obtain information including biometric information of the user from the medium;
An information processing method for acquiring biometric information of the user from the user during reading of the medium by a biometric information acquisition unit.

(Appendix 13)
An information processing device having a reading unit and a biometric information acquiring unit,
reading the user's medium by the reading unit to obtain information including the user's biometric information from the medium;
A recording medium recording a program for causing the biometric information acquisition unit to acquire the biometric information of the user from the user while the medium is being read.

DESCRIPTION OF SYMBOLS 1... Information processing system 10... Kiosk terminal 20... Electronic gate 30... Entrance gate terminal 40... Exit gate terminal 50... Management server 60... Portable terminal

Claims (8)

a first acquisition unit that acquires the biometric information of the user in a procedure area where the user can select between an electronic gate that verifies the identity using biometric authentication and a manned booth that verifies the identity face-to-face;
a language setting unit that sets a language to be displayed based on the read language information;
a second acquisition unit that acquires declaration information related to the declaration content displayed based on the language used;
Based on the biometric information, the language used, and the reported information,
when the user is determined to be a target person of the electronic gate, displaying a message indicating that the user is a target person of the electronic gate;
and a display unit that displays that the user is a target person of the manned booth when it is determined that the user is not a target person of the electronic gate. The first acquisition unit acquires the biometric information from a first medium containing the biometric information,
The information processing apparatus according to claim 1, wherein the second acquisition unit acquires the report information from a code displayed on a second medium. 3. The information processing apparatus according to claim 2, wherein said second acquisition unit acquires said language information from said code. Having a biometric information acquisition unit that acquires biometric information of the user from the user,
4. The information processing apparatus according to claim 2, wherein the biometric information acquiring unit acquires the biometric information of the user from the user when at least one of the first medium and the code is read. 5. The information processing apparatus according to claim 4, further comprising a control unit that requests or performs collation between the biometric information acquired by the first acquisition unit and the biometric information acquired by the biometric information acquisition unit. . The first medium is the user's passport,
6. The information processing apparatus according to any one of claims 2 to 5, wherein said second medium is a portable terminal that displays said code including said declaration information. An information processing method executed by an information processing apparatus having a first acquisition unit and a second acquisition unit,
The information processing device uses the first acquisition unit to provide biometric information of the user in a procedure area where the user can select between an electronic gate for personal identification using biometric authentication and a manned booth for face-to-face personal identification. and get
The information processing device sets a language to be displayed based on the read language information,
the information processing device, through the second acquisition unit, acquires declaration information related to the declaration content displayed based on the language used;
The information processing device, based on the biometric information, the language used, and the report information,
when the user is determined to be a target person of the electronic gate, displaying a message indicating that the user is a target person of the electronic gate;
An information processing method for performing display indicating that the user is a target person of the manned booth when it is determined that the user is not a target person of the electronic gate. In an information processing device having a first acquisition unit and a second acquisition unit,
The first acquisition unit acquires the biometric information of the user in a procedure area where the user can select between an electronic gate for identity verification using biometric authentication and a manned booth for face-to-face identity verification,
The information processing device sets a language to be displayed based on the read language information,
obtaining, by the second obtaining unit, declaration information related to the declaration content displayed based on the language used;
Based on the biometric information, the language used, and the reported information,
when the user is determined to be a target person of the electronic gate, displaying a message indicating that the user is a target person of the electronic gate;
A program for displaying a message indicating that the user is a target person of the manned booth when it is determined that the user is not a target person of the electronic gate.

Images