JP7276590B2 - GATE DEVICE, GATE DEVICE CONTROL METHOD AND PROGRAM - Google Patents

Description

The present invention relates to a gate device, a gate device control method, and a storage medium.

Immigration checks are carried out at the airport. The immigration officer will compare the face photo affixed to the passport with the face of the person in front of him, and if the face image in the passport does not match the face of the person in front of him, he will not be allowed to enter or leave the country.

In recent years, devices have been introduced that automatically perform the immigration examination. For example, in the gate device disclosed in Non-Patent Document 1, immigration is examined by comparing pre-registered biometric information with biometric information acquired by the gate device.

Ministry of Justice, "Operation of Automated Gates (Notice)", [online], [searched December 2019], Internet <URL: http://www.moj.go.jp/nyuukokukanri/kouhou/nyuukokukanri01_00111.html>

In the gate device disclosed in Non-Patent Document 1, the user needs to stand in front of the gate device and perform a predetermined operation. Specifically, the user needs to put the passport on the passport scanner provided in the gate device. As described above, the user of the gate device disclosed in Non-Patent Document 1 is required to perform a predetermined action in front of the gate device. Therefore, a gate device or a space in the vicinity of the gate device is provided for placing the luggage of the user. The user puts the luggage in the space and operates the gate device, but there are cases where the luggage is left behind when leaving the gate device after the immigration inspection by the gate device is completed.

A main object of the present invention is to provide a gate device, a control method for the gate device, and a storage medium that contribute to preventing a user from leaving luggage behind.

According to a first aspect of the present invention, a detection unit that detects whether or not an object exists in a baggage storage area, and a warning unit that issues a warning about a forgotten baggage when an object exists in the baggage storage area. and a gate control unit that controls the gate so that a person to be screened cannot pass through when there is an object in the luggage storage area.

According to a second aspect of the present invention, the gate device detects whether or not an object exists in the luggage storage area, and if there is an object in the luggage storage area, issues a warning about the luggage left, and A control method for a gate device is provided for controlling a gate so that a person to be screened cannot pass through when an object exists in a storage area.

According to a third aspect of the present invention, a computer mounted on a gate device detects whether or not an object exists in the luggage storage area, and detects whether or not an object is left in the luggage storage area. and a process of controlling the gate so that a person to be screened cannot pass through if there is an object in the luggage storage area. be done.

According to each aspect of the present invention, there are provided a gate device, a gate device control method, and a storage medium that contribute to preventing a user from leaving luggage behind. In addition, the effect of this invention is not limited above. Other effects may be achieved by the present invention instead of or in addition to this effect.

1 is a diagram for explaining an overview of an embodiment; FIG. 1 is a diagram showing an example of a schematic configuration of an immigration examination system according to a first embodiment; FIG. It is a figure showing an example of processing composition of a server device concerning a 1st embodiment. It is a figure which shows an example of the hardware constitutions of the server apparatus which concerns on 1st Embodiment. It is a figure which shows an example of the external appearance of the gate apparatus which concerns on 1st Embodiment. It is a figure which shows typically the cross section of the gate apparatus which concerns on 1st Embodiment. It is an example of the front view which illustrated typically the luggage|baggage storage space with which the gate apparatus which concerns on 1st Embodiment is provided. It is a figure which shows an example of the hardware constitutions of the gate apparatus which concerns on 1st Embodiment. It is a figure which shows an example of the processing structure of the gate apparatus which concerns on 1st Embodiment. It is a figure which shows an example of an examination request. It is a figure which shows an example of the table information which defined the height and the luminous intensity of two light sources. It is a figure which shows an example of the warning message regarding a luggage|baggage left behind. 4 is a sequence diagram showing an example of the operation of the immigration examination system according to the first embodiment; FIG.

First, an overview of one embodiment will be described. It should be noted that the drawing reference numerals added to this outline are added to each element for convenience as an example to aid understanding, and the description of this outline does not intend any limitation. Also, unless otherwise specified, the blocks depicted in each drawing represent the configuration of each function rather than the configuration of each hardware unit. Connecting lines between blocks in each figure include both bi-directional and uni-directional. The unidirectional arrows schematically show the flow of main signals (data) and do not exclude bidirectionality. In addition, in the present specification and drawings, elements that can be described in the same manner can be omitted from redundant description by assigning the same reference numerals.

A gate device 100 according to one embodiment includes a detection unit 101, a warning unit 102, and a gate control unit 103 (see FIG. 1). The detection unit 101 detects whether or not an object exists in the baggage storage area. The warning unit 102 issues a warning about the luggage left behind when there is an object in the luggage storage space. The gate control unit 103 controls the gate so that the person to be screened cannot pass through when there is an object in the luggage storage space.

When the gate device 100 judges that the user has left the luggage in the luggage storage area, the gate device 100 issues a warning to that effect. Further, the gate device 100 does not open the gate unless the user moves the baggage from the baggage storage area even if the immigration examination for the user has been completed. These operations prevent the user from leaving the luggage behind.

Specific embodiments will be described in more detail below with reference to the drawings.

[First embodiment]
The first embodiment will be described in more detail with reference to the drawings.

[System configuration]
FIG. 2 is a diagram showing an example of the schematic configuration of the immigration examination system according to the first embodiment. Referring to FIG. 2, the immigration control system includes a plurality of gate devices 10-1 to 10-3 and a server device 20. In the following description, the gate devices 10-1 to 10-3 are simply referred to as "gate device 10" unless there is a particular reason to distinguish them. Although three gate devices 10 are shown in FIG. 2, it is needless to say that the number of gate devices 10 included in the system is not limited. The immigration control system should include at least one or more gate devices 10 .

The gate device 10 and the server device 20 are configured to be able to communicate with each other through wired or wireless communication means. The server device 20 may be installed in the same airport as the gate device 10, or may be installed on a network (cloud).

The gate device 10 is a device that automatically performs an examination procedure regarding immigration of a user. The gate device 10 includes a gate that can be opened and closed. When the gate device 10 determines that the person standing in front of the device has passed the immigration inspection and that the person is in possession of a valid passport, the gate device 10 opens the gate and allows the user to pass through. allow In this way, the gate device 10 controls the gate according to the result of immigration control of the user.

The server device 20 is a device for realizing immigration examination by the gate device 10 . The server device 20 stores information about users who can use the gate device 10 (hereinafter referred to as gate user information).

A user who desires automatic examination by the gate device 10 needs to register with the system in advance. For example, the user goes to a passport issuing office or the like and submits the passport to the staff in charge. The staff in charge examines whether the user who provided the passport is really the holder of the passport. As a result of examination, the staff member in charge determines that the user is the holder of the correct passport, and obtains the fingerprint image of the user. Specifically, a fingerprint image is acquired using a fingerprint scanner or the like. The fingerprint image is input to the server device 20 .

Server device 20 adds the acquired fingerprint image to a database (hereinafter referred to as a registrant database). A fingerprint image to be registered may be a fingerprint image taken from at least one finger. Furthermore, in addition to the fingerprint image of the user who has passed the examination, other information (eg, name, passport number) may be registered in the registrant database in association with the fingerprint image. Alternatively, in the registrant database, feature amounts (types of feature points, positions, etc.) required for matching processing using fingerprint images may be registered in association with fingerprint images.

[Overview of system operation]
Next, a schematic operation of the immigration examination system according to the first embodiment will be described with reference to FIG.

When the user arrives in front of the gate device 10 , the user places his or her finger on the scanner according to the instructions of the gate device 10 . The gate device 10 acquires the fingerprint image of the user and transmits an examination request including the acquired fingerprint image to the server device 20 .

The server device 20 performs matching processing (one-to-N matching; N is a positive integer, the same shall apply hereinafter) using the acquired fingerprint image and a plurality of fingerprint images registered in the registrant database. If a fingerprint image that substantially matches the obtained fingerprint image is registered in the registrant database, server device 20 sets the examination result to "departure/departure permission."

On the other hand, if a fingerprint image that substantially matches the obtained fingerprint image is not registered in the registrant database, the server device 20 sets the examination result to "not permitted to enter or leave the country." The server device 20 returns the examination result to the gate device 10 which is the transmission source of the examination request.

After receiving the examination result or transmitting the examination request, the gate device 10 determines whether or not the user in front of him/herself has a correct passport (passport of the user himself/herself). Specifically, the gate device 10 instructs the user to open the passport and place it on the scanner. The gate device 10 reads a face image or the like from an IC (Integrated Circuit) chip of the passport using the card reader function of the scanner. The gate device 10 acquires a user's face image using a camera device. The gate device 10 generates a feature quantity (hereinafter referred to as a face feature quantity) from each of the two face images, and determines whether or not the two feature quantities substantially match. That is, the gate device 10 performs one-to-one matching using facial feature amounts obtained by photographing the user in front of the user and facial feature amounts obtained from the IC chip of the passport.

The gate device 10 opens the gate and allows the user to pass through when the one-to-one verification is successful and the examination result by the server device 20 is "permission to enter or leave the country."

Next, details of each device included in the immigration control system according to the first embodiment will be described.

[Server device]
FIG. 3 is a diagram showing an example of a processing configuration (processing modules) of the server device 20 according to the first embodiment. Referring to FIG. 3 , server device 20 includes communication control section 201 , fingerprint image registration section 202 , examination section 203 , and storage section 204 .

The communication control unit 201 is means for controlling communication with other devices. Specifically, the communication control unit 201 receives data (packets) from the gate device 10 . Also, the communication control unit 201 transmits data to the gate device 10 .

The fingerprint image registration unit 202 is means for registering the obtained fingerprint image in the registrant database constructed in the storage unit 204 . Any method can be used to acquire the fingerprint image.

For example, a staff member in charge may input the fingerprint image into the server device 20 at the passport issuing counter. Specifically, the staff in charge operates the fingerprint scanner to acquire the fingerprint image of the user. The staff in charge operates a terminal (computer installed at the issuing window) to transmit the acquired fingerprint image to the server device 20 . Alternatively, the read data may be input to the server device 20 via an external storage device such as a USB (Universal Serial Bus) memory.

The examination unit 203 is means for processing an examination request transmitted by the gate device 10 . Specifically, the examination unit 203 sets the fingerprint image (biometric information) included in the examination request as a matching target, and performs matching processing with the fingerprint image registered in the registered user database.

More specifically, the examination unit 203 sets the fingerprint image extracted from the examination request as an object to be matched, and performs 1:N matching with a plurality of fingerprint images registered in the registrant database. The examination unit 203 calculates a score (similarity) between the fingerprint image to be matched and each of the plurality of fingerprint images on the registration side.

The examination unit 203 extracts feature points (end points, branch points) from the fingerprint images of the matching side and the registration side. The examination unit 203 calculates a score indicating the degree of similarity between the two fingerprint images based on the extracted feature points. Specifically, the examination unit 203 matches the core regions (central regions of the fingerprints) of the two fingerprint images, and determines the positions and number of feature points viewed from the core regions, the number of core lines existing between the feature points, and the like. Calculate the score above. A higher score indicates a higher degree of similarity between the two fingerprint images.

It should be noted that existing techniques can be used for the process of extracting minutiae from a fingerprint image and the process of calculating a score from the minutiae, and are obvious to those skilled in the art. .

Examining unit 203 determines whether or not there is at least one fingerprint image having a score equal to or greater than a predetermined value with respect to the fingerprint image to be matched among the plurality of fingerprint images registered in the registrant database. .

If a fingerprint image with a score equal to or greater than a predetermined value exists in the registrant database, the examination unit 203 sets the examination result to "departure/departure permission." On the other hand, the examination unit 203 sets the examination result to "departure/departure not permitted" if there is no fingerprint image with a score equal to or greater than a predetermined value in the registrant database. The examination unit 203 transmits the examination result to the gate device 10 that transmitted the examination request.

The storage unit 204 stores various information necessary for the operation of the server device 20 . Also, a registrant database is constructed in the storage unit 204 .

FIG. 4 is a diagram showing an example of the hardware configuration of the server device 20 according to the first embodiment. The server device 20 can be configured by an information processing device (so-called computer), and has a configuration illustrated in FIG. 4 . For example, the server device 20 includes a processor 211, a memory 212, an input/output interface 213, a communication interface 214, and the like. Components such as the processor 211 are connected by an internal bus or the like and configured to be able to communicate with each other.

However, the configuration shown in FIG. 4 is not meant to limit the hardware configuration of the server device 20 . The server device 20 may include hardware (not shown) and may not have the input/output interface 213 as necessary. Also, the number of processors 211 and the like included in the server device 20 is not limited to the example illustrated in FIG.

The processor 211 is, for example, a programmable device such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), DSP (Digital Signal Processor). Alternatively, the processor 211 may be a device such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The processor 211 executes various programs including an operating system (OS).

The memory 212 is RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), or the like. The memory 212 stores an OS program, application programs, and various data.

The input/output interface 213 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device such as a keyboard or mouse that receives user operations.

The communication interface 214 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 214 includes a NIC (Network Interface Card) or the like.

The functions of the server device 20 are implemented by various processing modules. The processing module is implemented by the processor 211 executing a program stored in the memory 212, for example. Also, the program can be recorded in a computer-readable storage medium. The storage medium can be non-transitory such as semiconductor memory, hard disk, magnetic recording medium, optical recording medium, and the like. That is, the present invention can also be embodied as a computer program product. Also, the program can be downloaded via a network or updated using a storage medium storing the program. Furthermore, the processing module may be realized by a semiconductor chip.

[Gate device]
FIG. 5 is a diagram showing an example of the appearance of the gate device 10 according to the first embodiment. As described above, the gate device 10 is a device that automatically performs an immigration examination on the user.

When the gate device 10 detects the presence of the user in front of itself, the gate device 10 displays on the display 401 the operation procedure required for the user when the immigration examination is automatically performed.

The gate device 10 instructs the user to place a finger (predetermined finger; finger corresponding to the fingerprint image registered in the registrant database) on the scanner 402 . The gate device 10 controls the scanner 402 and images the placed finger. The gate device 10 transmits an inspection request including the obtained fingerprint image to the server device 20 .

After obtaining the fingerprint image, the gate device 10 notifies the user that the face will be photographed, and controls the camera device 403 to photograph the user. At that time, the gate device 10 controls the luminous intensity of the upper stage lighting 404 and the lower stage lighting 405 which are mounted vertically.

The upper lighting 404 is installed on a ceiling portion 407 attached to a support portion 406 extending vertically upward from the main body of the gate device 10 . More specifically, the upper stage lighting 404 is installed so as to be embedded inside the ceiling section 407 . As shown in FIG. 5 , by widening the structure of the support portion 406 , the display 401 and the camera device 403 can be attached to the support portion 406 .

The lower lighting 405 is installed so as to be embedded in the main body of the gate device 10 . The "main body" of the gate device 10 is a structure that forms the center of the gate device 10, and is a member that contacts the floor and to which the gate 408 and the support portion 406 are attached.

FIG. 6 is a diagram schematically showing a cross section along line AA shown in FIG. In addition, in FIG. 6, the user (examination object person) of the gate apparatus 10 is illustrated for easy understanding. As shown in FIG. 6, the upper lighting 404 is installed so that the user is illuminated with light from above the user. In addition, the lower illumination 405 is arranged so that the user is illuminated with light from below the user (more precisely, below the user's face).

Note that the arrangement of the two lights shown in FIG. 6 is an example, and various modifications are conceivable. For example, top lighting 404 may be mounted on support 406 . Alternatively, the upper stage illumination 404 may be installed on the support portion 406 and attached so as to emit light toward the ceiling portion 407 . In this case, a reflector (for example, a mirror) may be arranged on the ceiling section 407 so that the light emitted from the upper lighting 404 is reflected by the mirror and the reflected light is emitted from above the user. In this way, the upper lighting 404 is installed so as to irradiate light in the direction of the ceiling part 407 , and the gate device 10 may be provided with a reflector that reflects the light emitted from the upper lighting 404 .

Similarly, the lower lighting 405 may be installed below the support 406 . Alternatively, the lower lighting 405 may be installed to irradiate a mirror attached to the main body of the gate device 10 with light. In this case, the light emitted from the lower illumination 405 is reflected by the mirror, and the reflected light is emitted from below the user. In this way, the lower lighting 405 is installed so as to irradiate light in the direction of the main body of the gate device 10, and the gate device 10 may be provided with a reflector that reflects the light emitted from the lower lighting 405. .

The gate device 10 controls the luminosity of the two illuminations so that a face image suitable for matching processing using a face image, which will be described later, can be obtained. The details of lighting control by the gate device 10 will be described later.

After finishing the imaging of the user, the gate device 10 extracts the face area from the image to acquire the face image.

In addition, the gate device 10 instructs the user to open the page of the passport in which the user's photo is taken and to place the opened passport on the scanner 402 . The gate device 10 reads information (hereafter referred to as MRZ information) written in a machine readable zone (MRZ) of the passport. The gate device 10 acquires the face image stored in the IC chip of the passport using the MRZ information.

The gate device 10 performs matching (one-to-one matching) using the face image acquired from the camera device 403 and the face image acquired from the IC chip of the passport. If the collation is successful (if the two facial images substantially match), the gate device 10 determines that the user has the correct passport. On the other hand, if the collation fails (if the two facial images are different), the gate device 10 determines that the user does not have the correct passport.

The gate device 10 opens the gate 408 when it is determined that the examination result from the server device 20 is "departure/departure permission" and that the user has a correct passport. allow passage.

If the examination result from the server device 20 is determined to be "not allowed to enter or leave the country" or that the user "does not have a correct passport", the gate device 10 keeps the gate 408 closed. message or the like is displayed on the display 401 . For example, the gate device 10 displays a message indicating that the person is heading to a manned examination booth, or instructs to redo the operation related to the automatic examination.

The gate device 10 monitors the state of the luggage storage area 430 . FIG. 7 is an example of a front view schematically illustrating a luggage storage space 430 provided in the gate device 10. As shown in FIG. FIG. 7 is a view of the luggage storage area 430 viewed from the direction in which the user is walking toward the gate device 10. As shown in FIG.

When the user operates the gate device 10 , the user puts the baggage on the top plate area 431 or the side portion 432 of the baggage storage space 430 . The gate device 10 detects whether or not an object exists in the top plate area 431 or the side portion 432 . For example, the gate device 10 detects an object placed on the top plate area 431 using means such as a weight sensor and a pressure sensor. Alternatively, the gate device 10 detects an object placed on the side portion 432 by analyzing an image obtained from a range sensor or camera using infrared rays.

The object detection method by the gate device 10 is an example, and the gate device 10 may detect an object placed in the luggage storage area 430 using any method or means. Further, the detection area of an object (user's luggage) by the gate device 10 is not limited to the top board area 431 or the side portion 432, and an area where the user may place the luggage is set as the detection area. In other words, the gate device 10 not only detects the existence of an object positioned vertically above or on the side of the luggage storage area 430, but also detects the presence or absence of an object in a place where the user may place the luggage.

When the gate device 10 detects the presence of an object in the luggage storage space 430, the gate device 10 sets the "luggage detection flag" to "1". The gate device 10 clears the "baggage detection flag" to "0" if no object is detected from the luggage storage area 430. FIG.

If the baggage detection flag is set to "1" at the time when the immigration examination of the person to be examined is finished (the examination result is received and the passport possession is finished), the gate device 10 informs the user to notify (warn) that a package has been forgotten. For example, the gate device 10 may display a message regarding the warning on the display 401, or may issue a warning by voice or the like.

In addition, regarding the opening/closing control of the gate 408, the gate device 10 sets, as one of the conditions for opening the gate 408, that the baggage detection flag is cleared to "0". Even if the user does not notice the display or voice regarding the luggage left behind, the gate 408 does not open, so the user is prevented from proceeding to the next procedure while leaving the luggage behind.

FIG. 8 is a diagram showing an example of the hardware configuration of the gate device 10 according to the first embodiment. Referring to FIG. 8 , gate device 10 includes processor 311 , memory 312 , and communication interface 313 . Further, gate device 10 includes display 401 , scanner 402 , camera device 403 , upper lighting 404 , lower lighting 405 , gate 408 , and object detector 409 . Components such as the processor 311 are connected by an internal bus or the like and configured to be able to communicate with each other. Note that FIG. 8 shows only components connected (electrically connected) to the processor 311 . In FIG. 8, illustration of the support portion 406, the ceiling portion 407, and the luggage storage area 430 is omitted. Further, as shown in FIG. 5, the main body of the gate device, the support portion 406 and the ceiling portion 407 form a U-shape. More specifically, the main body of the gate device 10 (the housing that supports the support section 406) and the ceiling section 407 face each other. The main body and ceiling part 407 are connected by a support part 406 . By configuring the gate device 10 as described above, the main body, the support portion 406 and the ceiling portion 407 form a U-shape (a shape in which the left and right of the letter "c" is reversed).

Note that the processor 311, the memory 312, and the communication interface 313 can have the same contents as the corresponding elements of the server device 20 described using FIG. 4, so detailed description thereof will be omitted.

A display 401 is a device (for example, a liquid crystal monitor, etc.) for outputting information.

A scanner 402 is a device that reads MRZ information from a passport and acquires a user's fingerprint image. The scanner 402 also has a function of accessing the IC chip mounted on the passport. Scanner 402 can be placed anywhere. However, the scanner 402 is preferably placed in a location where the user can easily place their passport or finger on the device. In the disclosure of the present application, the scanner 402 has a function as a card reader that accesses an IC chip, a function as a passport scanner that reads MRZ information from a passport, and a function as a fingerprint scanner that acquires a fingerprint image from a finger. A case will be described. However, these functions may be separated, and the card reader, passport scanner, and fingerprint scanner may be provided in the gate device 10, respectively.

The camera device 403 is, for example, a digital camera installed so as to be able to photograph the front of the gate device 10 . The camera device 403 can be installed at any location. For example, the camera device 403 may be installed in the main body of the gate device 10 or may be installed in a place away from the gate device 10 . The camera device 403 may be installed in any place as long as it can photograph the user (in particular, the user's face) standing in front of the gate device 10 .

As described above, the upper lighting 404 is a light source installed to emit light from above the user. A lower illumination 405 is a light source installed to emit light from below the user. The upper lighting 404 and the lower lighting 405 are configured such that their luminous intensity can be controlled. By varying the luminous intensity of the upper stage lighting 404 and the lower stage lighting 405, the illuminance irradiated to the user changes. That is, the brightness of the user viewed from the camera device 403 changes as the luminous intensity of the upper lighting 404 and the lower lighting 405 changes. For the upper lighting 404 and the lower lighting 405, any light source whose luminous intensity can be changed can be used. For example, LEDs (Light Emitting Diodes) can be used as the upper lighting 404 and the lower lighting 405 . When an LED is used as the light source, the luminous intensity can be changed by controlling the current flowing through the LED.

When the user passes through the immigration control, the gate 408 shifts from the closed state in the waiting state blocking the passage of the user to the open state permitting the passage of the user. The method of the gate 408 is not particularly limited, and may be, for example, a flapper gate in which flappers provided from one or both sides of the passage open and close, a turnstile gate in which three bars rotate, or the like.

Object detector 409 is a device for detecting an object placed in luggage storage area 430 . As described above, the object detector 409 can be a weight sensor, a distance sensor, or the like.

The functions of the gate device 10 are realized by various processing modules, like the server device 20 . The processing module is implemented by the processor 311 executing a program stored in the memory 312, for example.

FIG. 9 is a diagram showing an example of a processing configuration (processing modules) of the gate device 10 according to the first embodiment. The gate device 10 includes a communication control unit 301, a fingerprint image acquisition unit 302, an examination request unit 303, a face image acquisition unit 304, a passport possession determination unit 305, a baggage detection unit 306, and a baggage misplaced warning unit 307. , a gate control unit 308 and a storage unit 309 .

The communication control unit 301 is means for controlling communication with other devices. Specifically, the communication control unit 301 receives data (packets) from the server device 20 . Also, the communication control unit 301 transmits data to the server device 20 .

The fingerprint image acquisition unit 302 is means for acquiring the fingerprint image of the user standing in front of the gate device 10 . The fingerprint image acquisition unit 302 controls the scanner 402 and acquires the fingerprint image of the user. The fingerprint image acquisition unit 302 hands over the acquired fingerprint image to the examination request unit 303 .

The examination requesting unit 303 is means for requesting the server device 20 to conduct an examination regarding immigration of a person to be examined (a user standing in front of the gate device 10). Specifically, the examination request unit 303 generates an examination request including the acquired fingerprint image (biometric information), and transmits the generated examination request to the server device 20 via the communication control unit 301 .

For example, the examination request unit 303 generates an examination request including an identifier of its own device (hereinafter referred to as a gate identifier), a fingerprint image, and the like (see FIG. 10). The MAC (Media Access Control) address or IP (Internet Protocol) address of the gate device 10 can be used as the gate identifier.

The examination request section 303 receives a response from the server device 20 to the examination request via the communication control section 301 . The examination request unit 303 passes the response (examination result: immigration permission or immigration refusal) from the server device 20 to the baggage left-behind warning unit 307 and the gate control unit 308 .

The facial image acquisition unit 304 is means for acquiring the facial image (biological information) of the user standing in front of the gate device 10 . For example, the facial image acquisition unit 304 controls the camera device 403 and acquires the facial image of the user. The facial image acquisition unit 304 delivers the acquired facial image to the passport possession determination unit 305 .

As described above, the gate device 10 controls the luminous intensity of the upper stage lighting 404 and the lower stage lighting 405 when imaging the user. Specifically, the face image acquisition unit 304 controls the luminous intensity of the upper illumination 404 and the lower illumination 405 so that the illuminance of the light applied to the user's face when the user is photographed is substantially uniform. do. Note that the face image acquiring unit 304 may control the luminous intensity of either one of the upper illumination 404 and the lower illumination 405 as long as the uniformity can be achieved. The face image acquisition unit 304 has a function as a lighting control unit that controls at least two lights and a function as an acquisition unit that acquires the biological information of the user.

For example, the facial image acquisition unit 304 determines the luminous intensity of the upper stage illumination 404 and the lower stage illumination 405 according to the physical characteristics of the user (photographed person). For example, in the case of a tall user (when the height is higher than the first threshold), the face image acquisition unit 304 makes the luminous intensity of the lower lighting 405 relatively higher than the luminous intensity of the upper lighting 404 . Conversely, for a short user (whose height is less than the second threshold), face image acquisition section 304 makes the light intensity of upper stage illumination 404 relatively higher than the light intensity of lower stage illumination 405 . Note that when the user's height is within the range determined by the first and second thresholds (when the user is of average height), the facial image acquisition unit 304 sets the same luminosity of the two lights. You may The face image acquiring unit 304 controls the luminous intensity of the two illuminations as described above, so that the illuminance of the light applied to the user when the user is photographed becomes uniform.

When the illuminance is equalized, the face image acquisition unit 304 measures the height of the user. After that, the face image acquisition unit 304 refers to table information that predetermines the height and the luminosity of the two light sources. The face image acquisition unit 304 controls the upper stage lighting 404 and the lower stage lighting 405 so as to achieve the light intensity obtained from the table information.

FIG. 11 is a diagram showing an example of table information that defines height and luminosity of two light sources. The facial image acquisition unit 304 acquires the luminous intensity of each of the upper stage illumination 404 and the lower stage illumination 405 based on the height of the user. The face image acquisition unit 304 controls the currents flowing through the upper illumination 404 and the lower illumination 405 so that light with the acquired luminosity is emitted. Note that when determining the current value from the light intensity, the face image acquisition unit 304 may use table information or a function (a function that outputs a current value when the light intensity is input) that predetermines these relationships. In addition, when the current value of the light source is variable, the resistance value connected between the light source and the power supply may be changed, or PWM (Pulse Width Modulation) technology is used to apply the current to the light source. You may change the voltage applied.

Note that the face image acquisition unit 304 acquires the height of the user by any method. For example, a plurality of sensors (for example, infrared distance sensors) are vertically arranged on the support portion 406 of the gate device 10 . More specifically, a plurality of sensors are vertically arranged at predetermined intervals. The facial image acquisition unit 304 monitors the output of each of the plurality of sensors, and measures the height of the user from the difference in output value (voltage value in the case of an infrared distance sensor) of each sensor. That is, if the user is short, the number of sensors that respond to the user is small, and if the user is tall, the number of sensors that respond is large. The facial image acquisition unit 304 identifies the height of the user according to the sensor output change caused by the height difference of the user. That is, the facial image acquisition unit 304 identifies the user's height according to the position of the sensor that responds according to the user's height.

Alternatively, the face image acquisition unit 304 may capture an image of the user and analyze the obtained image to specify the height of the user prior to acquiring the face image for authentication (verification). Note that the luminous intensity of the upper stage illumination 404 and the lower stage illumination 405 at that time is set to an initial value (default value).

When the image for height identification is acquired, the face image acquisition unit 304 extracts a face region from the image. The face image acquisition unit 304 identifies (estimates) the height of the user according to the position of the extracted face image in the height identification image. Specifically, when the face image is located above the original image, the face image acquisition unit 304 estimates the height of the user. On the other hand, when the face image is positioned below the original image, the face image acquisition unit 304 estimates the height of the user to be low.

Alternatively, a learning model obtained by machine learning may be used in identifying the user's height. For example, a learning model is generated by preparing a large number of training data labeled with an image of a user and the height of the user. The face image acquiring unit 304 may acquire the height by inputting an image for specifying the height to the generated learning model. Arbitrary algorithms such as support vector machines, boosting, and neural networks can be used to generate learning models. Since well-known techniques can be used for algorithms such as the support vector machine, the description thereof is omitted.

As described above, the gate device 10 may control the luminosity of the upper lighting 404 and the lower lighting 405 based on face detection by image processing and sensor output values without specifying the user's height.

The passport possession determination unit 305 is means for determining whether or not the user possesses a valid passport. The passport possession determination unit 305 controls the scanner 402 to acquire the MRZ information written in the machine reading area of the passport. The passport possession determination unit 305 uses the acquired MRZ information to read information stored in the IC chip.

Here, as described in "Security Measures for IC Passports" in Reference 1 below, the information stored in the IC chip of the passport is encrypted (converted) using the MRZ information described in the same passport as a password. ing.
<Reference 1>
https://www.mofa.go.jp/mofaj/toko/passport/ic_faq.html#11

Passport possession determination unit 305 decodes the information read from the IC chip using the MRZ information obtained from scanner 402, and obtains the face image stored in the IC chip.

A passport possession determination unit 305 extracts feature points from each of the face image acquired from the face image acquisition unit 304 and the face image acquired from the IC chip. Since the existing technology can be used for the feature point extraction processing, detailed description thereof will be omitted. For example, the passport possession determination unit 305 extracts the eyes, nose, mouth, etc. from the face image as feature points. After that, the passport possession determination unit 305 calculates the positions of the feature points and the distances between the feature points as feature amounts, and generates a feature vector (vector information that characterizes the face image) composed of a plurality of feature amounts.

Passport possession determination unit 305 calculates the degree of similarity between the two feature amounts (feature vectors). Chi-square distance, Euclidean distance, or the like can be used for the degree of similarity. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

The passport possession determination unit 305 determines that the collation is successful when the calculated similarity is equal to or greater than a predetermined value. In other words, the passport possession determination unit 305 determines that the two face images are images of the same person's face when the calculated similarity is equal to or greater than a predetermined value.

If the one-to-one matching is successful, the passport possession determination unit 305 determines that the user standing in front has the correct passport. The passport possession determination unit 305 notifies the luggage left-behind warning unit 307 and the gate control unit 308 of the determination result (whether the user has the correct passport).

The luggage detection unit 306 is means for detecting whether or not there is an object in the luggage storage space 430 . The luggage detection unit 306 monitors the output of the object detector 409, and sets the "luggage detection flag" to "1" when the detector (object detection sensor) detects the presence of an object. In addition, when the presence of the object cannot be detected from the output of the object detector 409, the baggage detection unit 306 clears the "baggage detection flag" to "0".

The baggage misplaced warning unit 307 is means for issuing a warning about misplaced baggage when an object exists in the baggage storage area 430 . More specifically, when it is determined that the user has left the luggage in the luggage storage space 430, the baggage misplacement warning unit 307 issues a warning to that effect. The baggage left-behind warning unit 307 checks the baggage detection flag at the timing when the immigration examination by the gate device 10 is completed.

More specifically, the left-luggage warning unit 307 receives the examination result from the server device 20 via the communication control unit 301 and receives the judgment result from the passport possession judgment unit 305. end of The baggage left-behind warning unit 307 checks the baggage detection flag at the timing when the two results (examination result and judgment result) are obtained.

If the baggage detection flag is "1" at the timing described above, the baggage misplaced warning unit 307 determines that the user has misplaced the baggage, and issues a warning to that effect. For example, the baggage left-behind warning unit 307 displays on the display 401 as shown in FIG. Alternatively, the baggage left-behind warning unit 307 may output a voice from a speaker to the effect that the user has left the baggage behind. Alternatively, the baggage misplaced warning unit 307 may notify the user's terminal that the user has misplaced the baggage.

The gate control unit 308 is means for controlling the gate 408 provided in the gate device 10 . The gate control unit 308 controls the gate 408 so that the person to be screened can pass through at least when there is no object in the luggage storage area 430 . In other words, the gate control unit 308 controls the gate 408 so that the person to be screened cannot pass through when there is an object (baggage) in the luggage storage area 430 .

Specifically, the gate control unit 308 opens the gate 408 when three conditions are met. More specifically, the gate control unit 308 opens the gate 408 when the examination result of the server device 20 is "departure/departure permission", the passport possession determination result is "passport possession", and the baggage detection flag is "0". . In principle, the gate control section 308 does not open the gate 408 unless the above three conditions are met.

The gate control unit 308 closes the gate 408 after a user who is permitted to pass through the gate 408 (a user who has passed the immigration control) passes through the gate 408 .

The storage unit 309 is means for storing information necessary for the operation of the gate device 10 .

[Operation of immigration control system]
Next, the operation of the immigration examination system according to the first embodiment will be described.

FIG. 13 is a sequence diagram showing an example of the operation of the immigration examination system according to the first embodiment. FIG. 13 is a sequence diagram showing an example of system operation on the boarding date of the user. It is assumed that the user's "gate user information (fingerprint image)" is registered in advance in the server device 20 prior to the operation of FIG.

A user who has previously registered for use of the system moves in front of the gate device 10 . The gate device 10 acquires the fingerprint image of the user (step S01).

Gate device 10 transmits an examination request including a fingerprint image to server device 20 (step S02).

Server device 20 sets the acquired fingerprint image on the matching side (authenticated side) and sets the fingerprint image stored in the registrant database on the registration side, and executes one-to-N matching (step S03).

The server device 20 transmits the examination result (permission to enter or leave the country or not to be permitted to enter or leave the country) obtained by the one-to-N matching to the gate device 10 that transmitted the examination request (step S04).

Thus, the gate device 10 acquires the fingerprint image of the person to be screened. After that, the gate device 10 transmits an examination request including the acquired fingerprint image to the server device storing the fingerprint image of the user who is permitted to enter or leave the country, thereby requesting an examination regarding the entry or departure of the person to be examined. . The server device 20 determines the examination result by matching (one-to-N matching) using fingerprint images registered in advance, and transmits the examination result to the gate device 10 .

The gate device 10 photographs the user to obtain a facial image, and reads the facial image from the IC chip of the passport (acquisition of facial image; step S05). When photographing a user, the gate device 10 estimates the height of the user and controls the two light sources so that the luminous intensity is suitable for the height of the user.

The gate device 10 performs one-to-one matching using two face images to determine whether or not the user possesses the correct passport (step S06). The gate device 10 controls the camera device 403 to acquire the first facial image of the person to be screened. After that, the gate device 10 acquires the second face image stored in the passport possessed by the person to be screened, and compares the first and second face images to ensure that the person to be screened is in possession of the correct passport. determine whether or not

The gate device 10 detects whether or not any baggage is placed in the baggage storage area 430 in parallel with the operations of steps S01 to S06. Specifically, the gate device 10 monitors the output of the object detector 409 and detects the state of the luggage storage space 430 . When a package is placed in the package storage space 430, the package detection flag is set to "1". When the baggage is removed from the baggage storage space 430, the baggage detection flag is cleared to "0".

The gate device 10 checks whether or not the baggage detection flag is set to "1" at the timing when the immigration examination is finished (when the examination result is received from the server device 20 and the possession judgment of the passport is finished). (Step S07).

If the baggage detection flag is set to "1" (step S07, Yes branch), the gate device 10 issues a warning about the baggage left behind (step S08).

In this way, the gate device 10 issues a warning about the luggage left when an object exists in the luggage storage space 430 at the timing when the examination result is received from the server device 20 and the determination regarding the possession of the passport is completed. At that time, the gate device 10 sets the baggage detection flag when there is an object in the baggage storage area 430, and clears the baggage detection flag when there is no object in the baggage storage area 430. FIG. The gate device 10 controls the luggage detection flag, receives the examination result from the server device 20, and checks the luggage detection flag at the timing when the determination regarding possession of the passport is completed, thereby determining whether or not the luggage is left behind. do.

The gate device 10 continues to monitor the baggage storage area 430 and detects whether or not the baggage has been removed from the baggage storage area 430 . That is, the gate device 10 continues monitoring the luggage detection flag (step S09).

When the luggage detection flag is cleared to "0" (step S09, Yes branch), the examination result by the server device 20 is "departure/departure permission" and the user "has a valid passport", the gate device 10 Gate 408 is opened (step S10). In this way, the gate device 10 determines that the person to be examined can pass when the result of the examination from the server device 20 is permission to enter or leave the country, the person to be examined has a valid passport, and there is no object in the baggage area 430. Gate 408 is controlled so that In other words, if the examination result from the server device 20 is "not allowed to enter or leave the country" or if the person to be examined does not have a valid passport, the gate device 10 prevents the person to be examined from passing through. Control gate 408 .

As described above, the gate device 10 according to the first embodiment issues a verification request (examination request) using biometric information (fingerprint image) to the server device 20, and the verification result (examination request) is sent from the server device 20. result). In addition, the gate device 10 acquires a face image by controlling the two light sources so that the illuminance of the light applied to the face of the user is uniform. The gate device 10 compares the obtained face image with the face image read from the IC chip of the passport, and checks whether or not the user possesses the correct passport. When the gate device 10 determines that the person to be screened has left the luggage in the luggage storage area 430, the gate device 10 issues a warning to that effect. Further, the gate device 10 does not open the gate 408 unless the user moves the luggage from the luggage storage area 430 even if the immigration examination for the user has been completed. As a result, it is possible to prevent the user from leaving the luggage behind.

Further, the gate device 10 according to the first embodiment can obtain a face image suitable for face matching by controlling two light sources (upper lighting 404 and lower lighting 405) according to the height of the user. can. That is, the gate device 10 can obtain a high-quality image (face image) regardless of the height of the user by optimally controlling the luminosity of different illumination. More specifically, the gate device 10 changes the luminous intensity of the light emitted from each of the upper illumination 404 and the lower illumination 405 so that the illuminance of the light emitted to the user becomes uniform. As a result, biometric information suitable for authentication can be acquired without causing variations in the brightness of the light applied to the face or the like depending on the location.

Further, the gate device 10 according to the first embodiment has the upper lighting 404 attached to the ceiling portion 407 . This roof-equipped lighting (upper stage lighting 404 embedded in the ceiling portion 407) blocks light such as external light. As a result, the gate device 10 can create an environment suitable for acquiring the user's face image regardless of the time zone or the like. That is, the gate device 10 can suppress deterioration in the accuracy of face authentication due to disturbance by providing the roof-equipped illumination. In addition, the roof-equipped lighting is suspended by a support portion 406, and by forming the support portion 406 into a thick flat plate shape, it is possible to install the display 401 on the support portion 406 and to pass wiring inside. can.

[Modification]
The configuration, operation, and the like of the immigration examination system described in the above embodiment are examples, and are not intended to limit the configuration and the like of the system. For example, in the above embodiment, the case where the gate device 10 controls the luminous intensity of the upper stage illumination 404 and the lower stage illumination 405 when acquiring biometric information related to a face image has been described. However, the control of the two light sources can also be applied when acquiring an iris image for authentication or acquiring a fingerprint image for authentication. That is, when obtaining an iris image or a fingerprint image, the two light sources may be controlled so that the luminosity of the light that irradiates the eye region or the finger is uniform.

For example, all or part of the functions of the server device 20 may be realized by the gate device 10 . For example, a database of registrants may be constructed in the gate device 10, and the gate device 10 may use the database to examine immigration of the person to be examined. Alternatively, the registrant database included in server device 20 may be constructed in another database server.

In the above embodiment, after determining whether or not the fingerprint image obtained from the user is registered in the server device 20, it is determined whether or not the user possesses the correct passport. However, these two determinations may be performed in parallel, or the order of execution may be reversed. That is, it may be determined whether the fingerprint image is registered in the server device 20 after determining whether or not the user possesses the correct passport.

In the above embodiment, the fingerprint image acquired by the gate device 10 is used to identify the user who has completed immigration inspection in advance. good. For example, the server device 20 may perform collation using the obtained fingerprint image and the fingerprint image stored in a blacklist of fingerprints of criminals.

In the above embodiment, the server device 20 stores biometric information such as a fingerprint image, but the server device 20 may store other biometric information. For example, facial images, voiceprint information, iris information, etc., and feature amounts thereof may be stored as biometric information. Similarly, when biometric information other than a face image can be obtained from a passport, it may be determined whether or not the person to be screened has a valid passport using the biometric information other than the face image.

The form of data transmission/reception between the gate device 10 and the server device 20 is not particularly limited, but the data transmitted/received between these devices may be encrypted. A fingerprint image is personal information, and in order to appropriately protect the personal information, it is desirable to transmit and receive encrypted data. Also, the gate device 10 may transmit an examination request with a digital signature to the server device 20 . The server device 20 may process the acquired examination request when the verification of the digital signature is successful. In this way, the server device 20 may verify the legitimacy of the gate device 10, which is the source of the examination request, by verifying the digital signature.

In the above embodiment, the case of acquiring information from the IC chip of the passport using the MRZ information has been described, but the method disclosed in the present application can also be applied to other methods. That is, information corresponding to MRZ information may be used when reading information from an IC chip mounted on a card similar to a passport.

In the above embodiment, each of the upper lighting 404 and the lower lighting 405 is composed of one light source. good too. In this case, the face image acquiring unit 304 may change the luminosity of the upper lighting 404 and the lower lighting 405 by controlling the number of light sources that are turned on among the plurality of light sources. That is, the gate device 10 may control the luminous intensity of the light applied to the user's face by digitally controlling a plurality of light sources.

In the above embodiment, the case where two light sources (upper lighting 404 and lower lighting 405) are attached to the gate device 10 has been described. good. That is, middle lighting may be installed between the upper lighting 404 and the lower lighting 405, and the luminous intensity of the middle lighting may be controlled. In this case, the facial image acquisition unit 304 may control the luminosity of the three light sources according to the height of the user. That is, the gate device 10 may control the luminous intensity of a plurality of light sources so that the illuminance for the user is uniform.

In the above embodiment, a case has been described in which the luminous intensity of light emitted from a plurality of light sources is controlled based on the user's height, but the luminous intensity may be controlled based on other information. For example, the luminous intensity of the light source may be controlled according to the length of hair or whether glasses are worn. Alternatively, the luminous intensity of the light source may be controlled by comprehensively considering a plurality of factors (height, presence or absence of glasses). Specifically, the luminosity of the light emitted from the two light sources may be different between a tall user wearing glasses and a short user wearing glasses. It should be noted that whether or not the user is wearing eyeglasses can be determined using a learning model obtained by image processing using a template or machine learning.

The gate device 10 may analyze the captured face image and control the luminosity of the two light sources based on the analysis result of the face image. For example, the gate device 10 (face image acquisition unit 304) divides the face image into a plurality of regions, and calculates the average luminance value of the pixels forming the divided small regions. The gate device 10 controls the two light sources so that the calculated average value is equal to or greater than a predetermined value and the luminance variation (eg variance, standard deviation) of each small region is smaller than a threshold. good too. That is, the gate device 10 may feed back the analysis result of the captured face image to the control of the two configurations, and obtain a face image with uniform brightness.

The gate device 10 may use the information obtained from the passport to determine the contents of the warning regarding the luggage left behind. Specifically, the baggage left-behind warning unit 307 may change the content and expression method of the message based on the information obtained from the MRZ of the passport or the IC chip. For example, the baggage left-behind warning unit 307 may generate a warning message using the user's name. For example, if the user's name is "Taro", the package misplacement warning unit 307 may output a warning message such as "Mr. Taro, you have misplaced your package".

Alternatively, the baggage left-behind warning unit 307 may switch the language of the warning message according to the nationality of the user. For example, if the user has Japanese nationality, a warning message in Japanese may be output, and if the user has Chinese nationality, a warning message in Chinese may be output (displayed on the display 401 and output from a speaker). Alternatively, the luggage misplaced warning unit 307 may generate warning messages in multiple languages. For example, the baggage left-behind warning unit 307 may generate a warning message by fixing the first language to "English" and setting the second language to a language according to the nationality.

The baggage misplacement warning unit 307 may issue the above warning using a highly directional parametric speaker or the like when warning the baggage misplacement by voice. By using a parametric speaker or the like, it is possible to reliably notify the user of the warning message.

In the flowcharts (flowcharts, sequence diagrams) used in the above description, a plurality of steps (processes) are described in order, but the execution order of the steps executed in the embodiment is not limited to the described order. In the embodiment, the order of the illustrated steps can be changed within a range that does not interfere with the content, such as executing each process in parallel.

The above embodiments have been described in detail to facilitate understanding of the present disclosure, and are not intended to require all the configurations described above. Also, when a plurality of embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of the embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of the embodiment. Furthermore, additions, deletions, and replacements of other configurations are possible for some of the configurations of the embodiments.

From the above description, the industrial applicability of the present invention is clear, and the present invention can be preferably applied to airport immigration control systems and the like.

Some or all of the above embodiments may also be described in the following additional remarks, but are not limited to the following.
[Appendix 1]
a detection unit that detects whether or not an object exists in the baggage storage area;
a warning unit that warns about a forgotten baggage when an object exists in the baggage storage area;
a gate control unit that controls the gate so that a person to be screened cannot pass through when there is an object in the baggage storage area;
A gate device.
[Appendix 2]
a facial image acquiring unit that acquires a first facial image of the person to be screened by controlling a camera device;
Obtaining a second face image stored in the passport possessed by the person to be screened, and comparing the first and second face images to determine whether the person to be screened possesses the correct passport. a passport possession determination unit that determines whether
further comprising
The gate device according to appendix 1, wherein the gate control unit controls the gate so that the person to be screened cannot pass through when the person to be screened does not possess a valid passport.
[Appendix 3]
a fingerprint image acquisition unit that acquires the fingerprint image of the person to be screened;
an examination request unit that requests an examination regarding the entry and departure of the person to be examined by transmitting an examination request including the obtained fingerprint image to a server device that stores the fingerprint image of the user who is permitted to enter and leave the country;
further comprising
The gate device according to supplementary note 2, wherein the gate control unit controls the gate so that the person to be examined cannot pass through when the examination result from the server device indicates that immigration is not permitted.
[Appendix 4]
If an object exists in the baggage area at the timing when the examination result is received from the server device and the judgment regarding possession of the passport is completed, the warning unit issues a warning regarding the baggage left behind. Gate device as described.
[Appendix 5]
5. The gate device according to appendix 4, wherein the detector sets a baggage detection flag when an object exists in the baggage storage area, and clears the baggage detection flag when an object does not exist in the baggage storage area.
[Appendix 6]
6. The gate device according to appendix 5, wherein the warning unit receives an examination result from the server device and confirms the luggage detection flag at the timing when the determination regarding possession of the passport is finished.
[Appendix 7]
The passport possession determination unit reads MRZ (Machine Readable Zone) information described in a machine readable area of the passport, and uses the MRZ information to determine the second face image stored in the IC (Integrated Circuit) chip of the passport. 7. The gating device of claim 6, which obtains
[Appendix 8]
8. The gate device according to appendix 7, wherein the passport possession determination unit obtains the second face image by decoding information obtained from the IC chip using the MRZ information.
[Appendix 9]
The passport possession determination unit performs one-to-one collation using the first and second face images, and determines that the person to be examined possesses a correct passport when the one-to-one collation is successful. 9. The gating device of claim 8, wherein:
[Appendix 10]
10. The gate device according to appendix 9, wherein the detection unit detects the presence of an object positioned vertically above or on the side of the luggage storage space.
[Appendix 11]
11. The gate device according to any one of Appendices 1 to 10, wherein the warning section uses information obtained from a passport to determine the contents of the warning regarding the baggage left behind.
[Appendix 12]
12. The gate device according to any one of appendices 1 to 11, wherein the warning unit switches a language for warning that the baggage is left behind according to the nationality of the person to be screened.
[Appendix 13]
In the gate device,
Detect whether or not there is an object in the luggage storage area,
If there is an object in the luggage storage area, warn about the luggage left behind,
A control method for a gate device, wherein the gate is controlled so that a person to be screened cannot pass through when an object exists in the luggage storage space.
[Appendix 14]
The computer installed in the gate device,
A process of detecting whether or not an object exists in the baggage storage area;
a process of issuing a warning about the luggage left when there is an object in the luggage storage area;
A process of controlling a gate so that a person to be screened cannot pass through when there is an object in the luggage storage area;
A computer-readable storage medium that stores a program for executing
It should be noted that the modes of supplementary notes 13 and 14 can be developed into the modes of supplementary notes 2 to 12 in the same way as the form of supplementary note 1.

It should be noted that the respective disclosures of the cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will appreciate that these embodiments are illustrative only and that various modifications can be made without departing from the scope and spirit of the invention. That is, the present invention naturally includes various variations and modifications that can be made by those skilled in the art according to the entire disclosure including claims and technical ideas.

10, 10-1 to 10-3, 100 gate device 20 server device 101 detection unit 102 warning unit 103, 308 gate control unit 201, 301 communication control unit 202 fingerprint image registration unit 203 examination unit 204, 309 storage unit 211, 311 Processors 212, 312 Memory 213 Input/Output Interfaces 214, 313 Communication Interface 302 Fingerprint Image Acquisition Unit 303 Examination Request Unit 304 Face Image Acquisition Unit 305 Passport Possession Judgment Unit 306 Baggage Detection Unit 307 Luggage Loss Warning Unit 401 Display 402 Scanner 403 Camera Device 404 Upper lighting 405 Lower lighting 406 Supporting part 407 Ceiling part 408 Gate 409 Object detector 430 Luggage storage area 431 Top board area 432 Side part

Claims (14)

a detection unit that detects whether or not an object exists in the baggage storage area;
a warning unit that warns about a forgotten baggage when an object exists in the baggage storage area;
a gate control unit that controls the gate so that a person to be screened cannot pass through when there is an object in the baggage storage area;
with
The gate device, wherein the warning section uses information obtained from a passport to determine the contents of the warning regarding the baggage left behind . a facial image acquiring unit that acquires a first facial image of the person to be screened by controlling a camera device;
Obtaining a second face image stored in the passport possessed by the person to be screened, and comparing the first and second face images to determine whether the person to be screened possesses the correct passport. a passport possession determination unit that determines whether
further comprising
2. The gate device according to claim 1, wherein said gate control unit controls said gate so that said person to be screened cannot pass through when said person to be screened does not have a correct passport. a fingerprint image acquisition unit that acquires the fingerprint image of the person to be screened;
an examination request unit that requests an examination regarding the entry and departure of the person to be examined by transmitting an examination request including the obtained fingerprint image to a server device that stores the fingerprint image of the user who is permitted to enter and leave the country;
further comprising
3. The gate device according to claim 2, wherein said gate control unit controls said gate so that said person to be examined cannot pass through when the examination result from said server device indicates that immigration is not permitted. 4. If an object exists in the baggage area at the timing when the examination result is received from the server device and the judgment regarding possession of the passport is completed, the warning unit issues a warning about the baggage left behind. Gate device according to. 5. The gate device according to claim 4, wherein said detector sets a baggage detection flag when an object exists in said baggage storage area, and clears said baggage detection flag when an object does not exist in said baggage storage area. 6. The gate device according to claim 5, wherein said warning unit receives an examination result from said server device and confirms said luggage detection flag at the timing when the determination regarding possession of said passport is completed. The passport possession determination unit reads MRZ (Machine Readable Zone) information described in a machine readable area of the passport, and uses the MRZ information to determine the second face image stored in the IC (Integrated Circuit) chip of the passport. 7. The gate device according to claim 6, which obtains 8. The gate device according to claim 7, wherein said passport possession determination unit acquires said second face image by decoding information acquired from said IC chip using said MRZ information. The passport possession determination unit performs one-to-one collation using the first and second face images, and determines that the person to be examined possesses a correct passport when the one-to-one collation is successful. 9. The gating device of claim 8, determining. 10. The gate device according to claim 9, wherein said detection unit detects existence of an object located vertically above or on the side of said luggage storage area. 11. The gate device according to any one of claims 1 to 10 , wherein the warning unit switches languages for warning that the baggage is left behind according to the nationality of the person to be screened. a facial image acquiring unit that acquires a first facial image of a person to be screened by controlling a camera device;
a reading unit that reads a second face image stored in a passport possessed by the person to be screened;
When it is determined that the person to be screened does not possess a correct passport based on the result of collation of the first face image and the second face image, the gate is controlled so that the person to be screened cannot pass through. a gate controller; and
a warning unit that issues a warning about a forgotten luggage when an object exists in the luggage storage area at the timing when the determination regarding possession of the passport is completed;
A gate device. In the gate device,
Detect whether or not there is an object in the luggage storage area,
If there is an object in the luggage storage area, warn about the luggage left behind,
If there is an object in the luggage storage area, control the gate so that the person to be screened cannot pass through ;
A method of controlling a gate device , wherein information obtained from a passport is used to determine the content of the warning regarding the luggage left behind . The computer installed in the gate device,
A process of detecting whether or not an object exists in the luggage storage area;
a process of issuing a warning about the luggage left when there is an object in the luggage storage area;
A process of controlling a gate so that a person to be screened cannot pass through when there is an object in the luggage storage area;
a process of determining the content of the warning about the luggage left behind using information obtained from the passport;
program to run the

Images