JP2024061800A - Facial recognition system, entrance/exit management system, management system, program - Google Patents

Abstract

[Problem] To provide a technology for appropriately executing security settings. [Solution] A face authentication unit 360 executes face authentication processing based on an image including a face captured by an imaging unit 130. A control unit 330 executes control over a door 160 provided at the entrance to a specified area based on the result of the face authentication processing in the face authentication unit 360. An instruction unit 332 instructs security setting of the specified area when security setting conditions are met. An operation unit 180 accepts an operation to enable security setting of the specified area. Security setting conditions include a case where the operation unit 180 accepts an operation to enable security setting. [Selected Figure] FIG.

Description

This disclosure relates to authentication technology, and in particular to a face authentication system for authenticating people, an entrance/exit management system, a management system, and a program.

The entrance/exit management system manages the entry and exit of people to specific managed areas in a facility. This entrance/exit management system compares identification information recorded on a recording medium such as an IC (Integrated Circuit) card with pre-registered identification information, and determines whether or not a person can enter or leave the room based on the comparison result (see, for example, Patent Document 1).

JP 2015-36469 A

In face recognition systems that perform face recognition processing based on images of people's faces, and in access control systems, it is desirable to be able to properly set security settings for specific areas.

This disclosure has been made in light of these circumstances, and its purpose is to provide technology that properly implements alert settings.

In order to solve the above problems, a face recognition system according to an embodiment of the present disclosure includes a face recognition unit that executes face recognition processing based on an image including a face captured by an imaging unit, a control unit that executes control over a door provided at the entrance to a specified area based on the results of the face recognition processing in the face recognition unit, an instruction unit that instructs the security setting of the specified area when security setting conditions are met, and an operation unit that accepts an operation to enable the security setting of the specified area. The security setting conditions include a case where the operation unit accepts an operation to enable the security setting.

Another aspect of the present disclosure is an entrance/exit management system. This entrance/exit management system includes an ID authentication unit that executes ID authentication processing for a non-contact ID device, a control unit that executes control over a door provided at the entrance to a specified area based on the result of the ID authentication processing in the ID authentication unit, an operation unit that accepts an operation to enable an alert setting for the specified area, a communication unit that communicates with a face authentication system that executes face authentication processing based on a captured image, and an instruction unit that instructs the alert setting for the specified area when the operation unit accepts an operation to enable the alert setting and the communication unit receives information indicating the completion of the face authentication processing from the face authentication system.

Yet another aspect of the present disclosure is also an entrance/exit management system. This entrance/exit management system includes an ID authentication unit that executes ID authentication processing for a non-contact ID device, a control unit that executes control over a door provided at the entrance to a specified area based on the result of the ID authentication processing in the ID authentication unit, an operation unit that accepts an operation to enable an alert setting for the specified area, a communication unit that communicates with a face authentication system that executes face authentication processing based on a captured image, and an instruction unit that instructs the alert setting for the specified area when the operation unit accepts an operation to enable the alert setting and the ID authentication processing in the ID authentication unit is completed.

Yet another aspect of the present disclosure is also an entrance/exit management system. This entrance/exit management system includes an ID authentication unit that executes ID authentication processing for a non-contact ID device, a control unit that executes control over a door provided at the entrance to a specified area based on the result of the ID authentication processing in the ID authentication unit, an operation unit that accepts an operation to enable an alert setting for the specified area, a communication unit that communicates with a face authentication system that executes face authentication processing based on a captured image, and an instruction unit that issues an instruction to enable an alert setting for the specified area when the operation unit accepts an operation to enable the alert setting, the ID authentication processing in the ID authentication unit is completed, and the door is closed.

Yet another aspect of the present disclosure is also an entrance/exit management system. This entrance/exit management system includes an ID authentication unit that executes ID authentication processing for a non-contact ID device, a control unit that executes control over a door provided at the entrance to a specified area based on the result of the ID authentication processing in the ID authentication unit, a communication unit that communicates with a face authentication system that executes face authentication processing based on a captured image, and an instruction unit that instructs an alert setting for the specified area when the last person to leave the specified area has left and the communication unit has received information from the face authentication system indicating the completion of the face authentication processing.

In addition, any combination of the above components, and any conversion of the expressions of this disclosure between methods, devices, systems, recording media, computer programs, etc., are also valid aspects of this disclosure.

This disclosure allows for appropriate implementation of alert settings.

1A and 1B are diagrams illustrating a configuration of a management system according to a first embodiment. 2(a)-(g) are diagrams showing a first pattern of operations performed by the management system of FIG. 1(a). 3(a)-(f) are diagrams showing a second pattern of operation by the management system of FIG. 1(a). 4(a)-(d) are diagrams showing a third pattern of operation by the management system of FIG. 1(a). 5A and 5B are diagrams illustrating a configuration of a management system according to a second embodiment. 6(a)-(f) are diagrams showing a fourth pattern of operation by the management system of FIG. 5(a). 7(a)-(d) are diagrams showing a fifth pattern of operation by the management system of FIG. 5(a). 8A to 8D are diagrams illustrating a sixth pattern of the operation of the management system according to the third embodiment. 9A to 9D are diagrams illustrating a seventh pattern of the operation of the management system according to the fourth embodiment. 10A to 10D are diagrams illustrating an eighth pattern of the operation of the management system according to the fourth embodiment.

Example 1
Before describing the present disclosure in detail, an overview will be provided. Example 1 relates to a management system that manages people's entry into a predetermined area in a facility or their exit from the area. In order to manage people's entry or exit, the management system authenticates people who have the authority to enter and exit the area (hereinafter, referred to as "authorized persons"). One example of this authentication is authentication processing using a face image (hereinafter, referred to as "face authentication processing").

In the face recognition process, for each identification information assigned to an authorized person (hereinafter referred to as "face identification information"), a facial image of the authorized person is prepared in advance as a reference image. When the authorized person arrives at the entrance to the area, the face is captured by an imaging device installed at the entrance to the area. The management system compares the facial image captured by the imaging device with the reference image to determine whether the person is an authorized person. The management system controls the open/closed state or the locked/unlocked state of the door installed at the entrance depending on the result of the face recognition process.

In such a management system, a mode called an alert setting (alert set) is prepared in advance. In the alert setting, if an attempt is made to open the door when it is closed and locked, a sensor detects this, an alarm sounds, and a security company is contacted. The alert setting is enabled, for example, when the door is closed and an action is taken to enable the alert setting and an authorized person confirms the action. More specifically, when the door is closed, the authorized person presses a button to enable the alert setting and face authentication processing for the authorized person is successful, and the alert setting is enabled. On the other hand, to disable (cancel) the alert setting, an action is taken to disable the alert setting and an authorized person must confirm the action.

If the door is an automatic door, when an authorized person passes near the entrance, the facial recognition process will be successful and the door will be opened. This will prevent the authorized person from enabling the security setting. To address this, in this embodiment, when an action to enable the security setting is received, the facial recognition process to open the door is stopped, and the action to enable the security setting and the operation by the authorized person are confirmed while the door is closed.

Figures 1(a)-(b), particularly Figure 1(a), show the configuration of a management system 1000. The management system 1000 manages the entry and exit of people from a first area 100a to an Nth area 100n provided in a facility. The first area 100a to the Nth area 100n are collectively referred to as areas 100, and each area 100 is equipped with an imaging unit 130, a monitor 140, an operation unit 180, a door control device 150, and a door 160. The management system 1000 may manage only one area 100.

The management system 1000 includes a facial authentication system 300. The facial authentication system 300 also includes an imaging unit 130, a monitor 140, an operation unit 180, and a facial authentication management device 310. The facial authentication management device 310, the imaging unit 130, the monitor 140, the door control device 150, and the operation unit 180 of each area 100 are communicatively connected via a network 400 such as a LAN (Local Area Network).

The management system 1000 performs an authentication process on a person located at the entrance of the area 100, and controls at least one of opening, unlocking, closing, and locking the entrance door 160 only if the authentication is successful. For example, the management system 1000 opens the entrance door 160, which is normally closed. One example of the authentication process is a facial recognition process, and based on the results of the facial recognition process, it is determined whether or not the person is an authorized person who has the authority to enter the area 100.

In order to perform the face recognition process, the imaging unit 130 is installed near the door 160. The imaging unit 130 captures the face of a person who wishes to enter or exit the area 100 at the entrance of the area 100. Since multiple images are arranged in chronological order in the captured video, the video and the image are collectively referred to as images below. Since the face of a person extracted from the captured image is used for face recognition processing, the imaging unit 130 is required to capture an image that can perform face recognition processing on a person located at the entrance with high accuracy. For this reason, the imaging unit 130 is installed, for example, at a position at the average height of a person's face near the door 160, and captures the image of the entrance. This is because a person who is entering or exiting the area 100 usually faces the door 160 at the entrance. The imaging unit 130 transmits the captured image to the face recognition management device 310 via the network 400. At that time, the imaging unit 130 may also transmit information identifying the area 100 in which the imaging unit 130 is installed (hereinafter referred to as "area information") to the face authentication management device 310 via the network 400.

The facial authentication management device 310 performs facial authentication processing on the face of a person included in an image received from the imaging unit 130. The facial authentication processing is a process of determining whether or not a person included in an image is an authorized person who has the authority to enter the area 100 based on the face of the person. The facial authentication management device 310 determines the control content for the door 160 based on the result of the facial authentication processing. The control content may be, for example, opening the door 160 or closing the door 160. The control content may also be unlocking or locking an electronic lock provided on the door 160. The facial authentication management device 310 transmits the control content as control information to the monitor 140 and the door control device 150 via the network 400.

A monitor 140 is also installed near the door 160 together with the imaging unit 130 described above. The monitor 140 receives control information from the face authentication management device 310. The monitor 140 displays the control content in the control information as a message. The message may be, for example, that the door 160 is to be opened or that the door 160 is to be closed. The message may also be that the electronic lock provided on the door 160 is to be unlocked or locked. At the entrance to the area 100, a person who wishes to enter or exit the area 100 can recognize, for example, whether the door 160 is to be opened or not by checking the message displayed on the monitor 140.

The door control device 150 receives control information from the face authentication management device 310, and controls the opening and closing of the door 160, i.e., opening or closing, according to the received control information. Opening the door 160 may include unlocking the electronic lock of the door 160 and opening the door 160 as an automatic door. Closing the door 160 may include locking the electronic lock of the door 160 and closing the door 160 as an automatic door. The door control device 150 closes the door 160 in the normal state. The door 160 is provided at the entrance of the area 100, and is the part through which people entering the area 100 pass. The door 160 is, for example, a door with an electronic lock or an automatic door.

The management system 1000 is provided with a mode called an alert setting. The alert setting is sometimes called an alert set. In the alert setting, if an attempt is made to open the door 160 while the door 160 is closed and locked, a sensor (not shown) connected to the door 160 or a sensor (not shown) installed near the door 160 detects this. The sensor notifies the face authentication management device 310 of the detection result via the network 400. When the face authentication management device 310 receives the detection result from the sensor, it sounds an alarm (not shown) or notifies the security company of the detection result.

The alert setting is enabled, for example, when the door 160 is closed, an operation to enable the alert setting is performed, and the operation is confirmed by an authorized person. The operation to enable the alert setting is performed by operating an operation unit 180 installed near the door 160. The operation unit 180 is, for example, a button, and pressing the button corresponds to the operation to enable the alert setting. Furthermore, confirmation of the operation by the authorized person corresponds to successful face authentication processing for the authorized person in the face authentication management device 310.

To disable (cancel) the alert setting, for example, an operation to disable the alert setting and confirmation of the operation by an authorized person are required. The operation to disable (cancel) the alert setting is performed by operating a button on the operation unit 180 installed near the door 160. A button for enabling the alert setting and a button for disabling (cancel) the alert setting may be provided separately. Here again, confirmation of the operation by the authorized person corresponds to the face authentication process for the authorized person being successful in the face authentication management device 310.

As described above, if the door 160 is an automatic door, when an authorized person passes near the area 100, the imaging unit 130 captures an image of the authorized person's face, and if the facial recognition process is successful in the facial recognition management device 310, the door 160 is opened. Even if the authorized person operates the operation unit 180 in this state, the security setting is not enabled. It is desirable to execute the security setting even in such a situation.

1B shows the configuration of the face authentication management device 310. The face authentication management device 310 includes a communication unit 320, a control unit 330, a face detection unit 340, a face information storage unit 350, a face authentication unit 360, and an alarm unit 370. The control unit 330 includes an instruction unit 332. The communication unit 320 is a communication interface for connecting to a network 400, and can communicate with the imaging unit 130, the monitor 140, the door control device 150, and the operation unit 180 in FIG. 1 via the network 400. The communication unit 320 can also communicate with a sensor (not shown), an alarm device (not shown), and a security company server (not shown) used in the alert setting via the network 400. The face detection unit 340 receives an image from the imaging unit 130 via the communication unit 320 and the control unit 330. The face detection unit 340 also detects a face from the received image using the face detection information stored in the face information storage unit 350. The face detection unit 340 outputs information indicating the area of the detected face or information indicating the features of the detected face to the face authentication unit 360. Face detection in the face detection unit 340 is performed periodically.

The face information storage unit 350 stores face detection information for detecting a face from an image including the face. The face detection information represents, for example, face image features such as Gabor features of the face obtained from a large number of face image samples, and image patterns of each face part such as the eyes and mouth. The face information storage unit 350 also stores face reference information to be referenced for determining whether the detected face is the face of an authorized person, in association with the face identification information of the authorized person for each face of the authorized person. The face reference information indicates, for example, face features such as the ratio of the width of the face to the distance between the outer corners of the left and right eyes and the distance between the corners of the left and right mouth. Furthermore, the face information storage unit 350 also stores permission area information indicating the area 100 to which the authorized person corresponding to the face identification information is permitted to enter. In the permission area information, for example, the first area 100a is indicated as the area 100 to which the authorized person is permitted to enter. The information stored in the face information storage unit 350 may be set by an administrator via a user interface (not shown) such as a monitor, keyboard, and mouse provided in the face authentication management device 310, or may be set remotely from an external device (not shown).

The face authentication unit 360 uses the face reference information in the face information storage unit 350 to perform face authentication processing on the face detected by the face detection unit 340. Here, in cases where a person stands at the entrance for a long time, the face authentication processing may be performed multiple times. If the face authentication processing is successful, the face authentication unit 360 identifies the face identification information of the authorized person corresponding to the face reference information at that time. The face authentication unit 360 outputs the result of the face authentication processing to the control unit 330. If the result of the face authentication processing is successful, the face authentication unit 360 also outputs the identified face identification information to the control unit 330.

When the result of the facial authentication process from the facial authentication unit 360 indicates success, the control unit 330 transmits control information from the communication unit 220 to the monitor 140 and the door control device 150, instructing at least one of opening and unlocking the door 160. The control information may instruct at least one of closing and locking the door 160. On the other hand, when the result of the facial authentication process from the facial authentication unit 360 indicates failure, the control unit 330 transmits control information from the communication unit 220 to the monitor 140 and the door control device 150, instructing to close the door 160 for a certain period of time. In other words, the control unit 330 controls at least one of opening, unlocking, closing and locking the door 160 provided at the entrance to the specified area 100.

In addition, when the result of the face authentication process from the face authentication unit 360 indicates success, the control unit 330 may manage the authorized persons present inside the facility based on the face identification information received from the face authentication unit 360. Furthermore, the control unit 330 may acquire the status of the door 160 by communicating with the door control device 150 via the communication unit 320, and manage the status of the door 160. The status of the door 160 indicates whether the door 160 is open, unlocked, closed, or locked.

The notification unit 370 acquires the control content determined by the control unit 330 and generates a screen on which the control content is displayed as a message. The notification unit 370 notifies the user of the control content by displaying the generated screen on the monitor 140 in FIG. 1 via the communication unit 320 and the network 400.

The process for enabling the alert setting according to this embodiment is performed in any one of the following patterns: (1) Pattern 1, (2) Pattern 2, and (3) Pattern 3. In the following, the process will be described in the order of (1) Pattern 1, (2) Pattern 2, and (3) Pattern 3.
(1) First Pattern Here, Fig. 2(a)-(g) will also be used to explain the first pattern. Fig. 2(a)-(g) show a first pattern of operation by the management system 1000. Fig. 2(a)-(e) show screens displayed on the monitor 140. Fig. 2(f) shows the operation of the face recognition system 300, particularly the face recognition management device 310, where a high level indicates execution of face recognition processing and a low level indicates non-execution of face recognition processing. Fig. 2(g) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these figures, the horizontal axis indicates time.

At time T1, the door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures an image of the authorized person's face. The facial authentication unit 360 of the facial authentication management device 310 executes facial authentication processing based on an image including the face captured by the imaging unit 130. If the facial authentication processing in the facial authentication unit 360 is successful, the control unit 330 executes control over the door 160 provided at the entrance to the area 100. Here, the door 160 is opened at time T2.

At time T3 when the door 160 is open, an authorized person operates the operation unit 180 shown in FIG. 2A, and the operation unit 180 accepts an operation for enabling the alert setting of the area 100 (hereinafter referred to as a "valid operation"). The operation unit 180 notifies the face authentication management device 310 of the valid operation via the network 400. The communication unit 320 of the face authentication management device 310 receives the valid operation from the operation unit 180. The control unit 330 predefines the case where the operation unit 180 accepts a valid operation as an authentication stop condition, and when the control unit 330 accepts a valid operation from the communication unit 320, it determines that the authentication stop condition is satisfied. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, face authentication processing is not performed from time T3. The suspension of face authentication processing continues until time T4 when the open door 160 closes. During that time, the screen shown in FIG. 2B is displayed on the monitor 140.

At time T4, the door 160 is closed. When the control unit 330 receives a notification from the door control device 150, it resumes the face authentication process. As a result, the imaging unit 130 captures the face of the authorized person, and the face authentication unit 360 executes the face authentication process based on the image including the face captured by the imaging unit 130. Even if the face authentication process in the face authentication unit 360 is successful, the control unit 330 does not execute the above-mentioned control over the door 160 if a valid operation is received from the communication unit 320. On the other hand, the instruction unit 332 predefines the case where the face authentication unit 360 completes the face authentication process and the operation unit 180 receives an operation to enable the alert setting as an alert setting condition. The instruction unit 332 determines that the alert setting condition is met because the valid operation was received at time T3 and the face authentication process was completed at time T4. At time T5, the instruction unit 332 determines that the alert setting of the area 100 is enabled if the alert setting condition is met. Following this, the instruction unit 332 instructs the door control device 150 to execute the alert setting for the area 100. At that time, the screen shown in FIG. 2(d) is displayed on the monitor 140.

When the door control device 150 is instructed by the facial authentication management device 310 to execute the alert setting at time T5, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the facial authentication management device 310 via the network 400. When the communication unit 320 of the facial authentication management device 310 receives the detection result from the sensor, the control unit 330 sounds an alarm (not shown) or notifies a security company of the detection result. In addition, when the alert setting of the area 100 is enabled, the control unit 330 stops at least one of the imaging unit 130 and the facial authentication unit 360. When the alert setting is enabled, the screen shown in FIG. 2(e) is displayed on the monitor 140.

(2) Second Pattern Here, Fig. 3(a)-(f) will also be used to explain the second pattern. Fig. 3(a)-(f) show a second pattern of operation by the management system 1000. Fig. 3(a)-(d) show screens displayed on the monitor 140. Fig. 3(e) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates that face authentication processing is being executed and a low level indicates that face authentication processing is not being executed. Fig. 3(f) shows the operation of the door 160, where a high level indicates that the door is open and a low level indicates that the door is closed. In these figures, the horizontal axis indicates time.

The processing from time T1 to time T4 is the same as the first pattern. Therefore, FIG. 3(a)-(b) is the same as FIG. 2(a)-(b). At time T4, the door 160 is closed. The control unit 330 receives a notification from the door control device 150. The instruction unit 332 predefines, as an alert setting condition, a case in which the operation unit 180 receives an operation to enable the alert setting within a predetermined period after the face authentication unit 360 completes the face authentication processing. The instruction unit 332 determines that the alert setting condition is met if the face authentication processing is completed at time T1, a valid operation is received at time T3, and the time difference between time T1 and time T3 is within a predetermined period. This corresponds to using the face authentication processing performed before the valid operation is received, rather than performing the face authentication processing again after the valid operation is received as in the first pattern, if the time difference between time T1 and time T3 is within the predetermined period. At time T4, if the alert setting conditions are met, the instruction unit 332 determines to enable the alert setting for area 100. Following this, the instruction unit 332 instructs the door control device 150 to execute the alert setting for area 100. At this time, the screen shown in FIG. 3(c) is displayed on the monitor 140.

When the door control device 150 is instructed by the face authentication management device 310 to execute the alert setting at time T4, the door control device 150 executes the alert setting. The execution of the alert setting is the same as in the first pattern, so a description thereof will be omitted here. When the alert setting is enabled, the screen shown in FIG. 3(d) is displayed on the monitor 140.

(3) Third Pattern Here, to explain the third pattern, Fig. 4(a)-(d) will also be used. Fig. 4(a)-(d) shows a third pattern of operation by the management system 1000. Fig. 4(a)-(b) shows a screen displayed on the monitor 140. Fig. 4(c) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates execution of face authentication processing and a low level indicates non-execution of face authentication processing. Fig. 4(d) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these figures, the horizontal axis indicates time. The alert setting condition in the third pattern is defined as a case where the operation unit 180 accepts an operation to enable the alert setting, unlike the previous cases.

At time T1, an authorized person operates the operation unit 180 shown in FIG. 4(a), causing the operation unit 180 to accept a valid operation. The operation unit 180 notifies the face authentication management device 310 of the valid operation via the network 400. The communication unit 320 of the face authentication management device 310 receives the valid operation from the operation unit 180. When the instruction unit 332 accepts the valid operation from the communication unit 320, it determines that the alert setting conditions are met. At time T2, if the alert setting conditions are met, the instruction unit 332 decides to enable the alert setting of the area 100. Following this, the instruction unit 332 instructs the door control device 150 to execute the alert setting of the area 100.

When the door control device 150 is instructed by the face authentication management device 310 to execute the alert setting at time T2, the door control device 150 executes the alert setting. Furthermore, when the alert setting for the area 100 is enabled, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. When the alert setting is enabled, the screen shown in FIG. 4(b) is displayed on the monitor 140.

The subject of the device, system, or method of the present disclosure includes a computer. The computer executes a program to realize the function of the subject of the device, system, or method of the present disclosure. The computer includes a processor that operates according to the program as the main hardware configuration. The type of processor is not important as long as it can realize the function by executing the program. The processor is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or an LSI (Large Scale Integration). The multiple electronic circuits may be integrated into one chip or may be provided on multiple chips. The multiple chips may be integrated into one device or may be provided on multiple devices. The program is recorded on a non-transitory recording medium such as a computer-readable ROM, optical disk, or hard disk drive. The program may be stored in the recording medium in advance, or may be supplied to the recording medium via a wide area communication network including the Internet.

According to this embodiment, when the authentication stop condition is satisfied, at least one of the imaging unit 130 and the face authentication unit 360 is stopped, so that the face authentication process can be stopped. Furthermore, when the authentication stop condition is satisfied, the face authentication process is stopped, so that the face authentication process can be executed appropriately. Furthermore, the authentication stop condition includes a case where the operation unit 180 receives an operation to enable the alert setting, so that the face authentication process can be stopped appropriately. Furthermore, the authentication stop condition includes a case where the operation unit 180 receives an operation to enable the alert setting within a predetermined period after the face authentication unit 360 completes the face authentication process, so that the face authentication process can be stopped appropriately.

When the alert setting conditions are met, an alert setting for a specified area is instructed, so that the alert setting can be executed appropriately. The alert setting conditions include a case where the operation unit 180 has accepted an operation to enable the alert setting, so that the alert setting can be executed appropriately. The alert setting conditions include a case where the face authentication unit 360 has completed face authentication processing and the operation unit 180 has accepted an operation to enable the alert setting, so that the alert setting can be executed appropriately. The alert setting conditions include a case where the operation unit 180 has accepted an operation to enable the alert setting within a specified period after the face authentication unit 360 has completed face authentication processing, so that the alert setting can be executed appropriately.

An overview of one aspect of the present disclosure is as follows. An overview of one aspect of the present disclosure is as follows. A face authentication system (300) of one aspect of the present disclosure includes a face authentication unit (360) that executes face authentication processing based on an image including a face captured by an imaging unit (130), and a control unit (330) that controls at least one of the imaging unit (130) and the face authentication unit (360). When an authentication stop condition is satisfied, the control unit (330) stops at least one of the imaging unit (130) and the face authentication unit (360).

The authentication stopping condition may include a case where an image from the imaging unit (130) contains a face with a specified expression.

The device may further include an operation unit (180) that accepts an operation to enable an alert setting for a specified area. The authentication stop condition may include a case where the operation unit (180) accepts an operation to enable the alert setting.

The authentication stop condition may include a case where the operation unit (180) receives an operation to enable an alert setting within a predetermined period of time after the face authentication unit (360) completes the face authentication process.

Another aspect of the present disclosure is also a face recognition system (300). This face recognition system (300) includes a face recognition unit (360) that executes face recognition processing based on an image including a face captured by an imaging unit (130), a control unit (330) that executes control over a door provided at an entrance to a specified area based on the result of the face recognition processing in the face recognition unit (360), and an instruction unit (332) that instructs alert setting of the specified area when alert setting conditions are met.

The device may further include an operation unit (180) that accepts an operation to enable an alert setting for a specified area. The alert setting condition may include a case where the operation unit (180) accepts an operation to enable the alert setting.

The alert setting condition may include a case where the face authentication unit (360) completes face authentication processing and the operation unit (180) accepts an operation to enable the alert setting.

The alert setting condition may include a case where the operation unit (180) receives an operation to enable the alert setting within a predetermined period of time after the face authentication unit (360) completes the face authentication process.

Example 2
Next, a second embodiment will be described. As with the first embodiment, the second embodiment relates to a management system that manages the entry of people into a predetermined area in a facility or the exit of people from the area. In the first embodiment, a face recognition process is executed as an example of authentication. In the second embodiment, in addition to the face recognition process, authentication using an IC (Integrated Circuit) card (hereinafter, referred to as "ID authentication process") is also executed.

In the ID authentication process, an IC card holding identification information assigned to an authorized person (hereinafter referred to as "card identification information") is given to the authorized person in advance. When the authorized person arrives at the entrance to the area, he or she brings the IC card close to a card reader installed at the entrance to the area. When the card reader acquires the card identification information from the IC card, the management system determines whether or not the person is an authorized person based on the acquired card identification information. The management system controls the open/closed state or the locked/unlocked state of the door installed at the entrance depending on the result of the ID authentication process.

In Example 2, the alert setting is enabled, for example, when the door is closed, an action to enable the alert setting is performed, and the action is confirmed by an authorized person. More specifically, when the door is closed, the alert setting is enabled when an authorized person presses a button to enable the alert setting and the ID authentication process for the authorized person is successful. On the other hand, to disable (cancel) the alert setting, an action to disable the alert setting and confirmation of the action by the authorized person are required.

If the door is an automatic door, when an authorized person passes near the entrance, the face recognition process will be successful and the door will be opened. This will prevent the authorized person from activating the security setting. To address this, in this embodiment as well, when an action to activate the security setting is received, the face recognition process to open the door is stopped, and while the door is closed, the action to activate the security setting and the operation by the authorized person are confirmed. Here, the differences from the past will be mainly explained.

Figures 5(a)-(b), especially Figure 5(a), show the configuration of the management system 1000. The first area 100a to the Nth area 100n are provided in the facility in the same manner as in Figure 1(a). Each area 100 is equipped with a card reader 110, an imaging unit 130, a monitor 140, an operation unit 180, a door control device 150, and a door 160.

The management system 1000 includes an entrance/exit management system 200 and a facial authentication system 300. The entrance/exit management system 200 also includes a card reader 110, an operation unit 180, and an entrance/exit management device 210, and the facial authentication system 300 includes an imaging unit 130, a monitor 140, and a facial authentication management device 310. The entrance/exit management device 210 and the facial authentication management device 310 are communicatively connected to the card reader 110, the imaging unit 130, the monitor 140, the door control device 150, and the operation unit 180 of each area 100 via a network 400.

Another example of authentication processing in the management system 1000 is ID authentication processing, and based on the results of the ID authentication processing, it is determined whether or not the person is an authorized person who has the authority to enter the area 100. The person holds an IC card 120, and the IC card 120 stores card identification information, such as a character string assigned to the authorized person.

When the IC card 120 is brought close to the card reader 110 installed near the door 160, it wirelessly transmits card identification information to the card reader 110. If the IC card 120 is a non-contact IC card, the IC card 120 wirelessly transmits card identification information between the card reader 110 and the card reader 110 using an electromagnetic induction method. In this case, the communication distance between the card reader 110 and the IC card 120 is about 2 mm to about 70 cm. The card reader 110 acquires card identification information from the IC card 120 only when an IC card operation is performed. The card reader 110 transmits the acquired card identification information to the entrance/exit management device 210 via the network 400. At that time, the card reader 110 also transmits information identifying the area 100 in which the card reader 110 is installed (hereinafter referred to as "area information") to the entrance/exit management device 210 via the network 400.

The entrance/exit management device 210 receives card identification information from the card reader 110 and executes ID authentication processing based on the card identification information. The ID authentication processing is a process for determining whether or not the person is an authorized person who has the right to enter the area 100 based on the card authentication information. The entrance/exit management device 210 determines the control content for the door 160 based on the result of the ID authentication processing. The control content may be, for example, opening the door 160 or closing the door 160. The control content may also be unlocking or locking the electronic lock installed on the door 160. The entrance/exit management device 210 transmits the control content as control information to the monitor 140 and the door control device 150 via the network 400.

As described above, the facial authentication management device 310 performs facial authentication processing on the faces of people included in an image captured by the imaging unit 130 installed near the door 160. The facial authentication management device 310 determines the control content for the door 160 based on the results of the facial authentication processing. The facial authentication management device 310 transmits the control content as control information to the monitor 140 and the door control device 150 via the network 400.

The monitor 140 installed near the door 160 receives control information from the entrance/exit management device 210 or the face authentication management device 310. The monitor 140 displays the control content in the control information as a message. Here, whether the door 160 is opened or not may be recognized by a person who wishes to enter the area 100 or a person who wishes to exit the area 100 by lighting up an LED (Light Emitting Diode) provided in the card reader 110. The door control device 150 receives control information from the entrance/exit management device 210 or the face authentication management device 310, and controls the opening and closing of the door 160, i.e., opening or closing, according to the received control information.

The management system 1000 is provided with a mode called an alert setting. The alert setting is enabled, for example, when the door 160 is closed and an operation to enable the alert setting is performed and the operation is confirmed by an authorized person. In the first embodiment, the operation to enable the alert setting is performed by operating the operation unit 180, and the confirmation of the operation by the authorized person corresponds to the successful face authentication process for the authorized person in the face authentication management device 310. On the other hand, in the second embodiment, the operation to enable the alert setting is performed by operating the operation unit 180, and the confirmation of the operation by the authorized person corresponds to the successful ID authentication process for the authorized person in the entry/exit management device 210. The same applies to the operation to disable (cancel) the alert setting.

As in the first embodiment, if the door 160 is an automatic door, when an authorized person passes near the area 100, the imaging unit 130 captures an image of the authorized person's face, and the facial recognition process is successful in the facial recognition management device 310, allowing the door 160 to be opened. Even if the authorized person operates the operation unit 180 in this state, the security setting is not enabled. It is desirable to execute the security setting even in this situation.

Figure 5 (b) shows the configuration of the entrance/exit management device 210. The entrance/exit management device 210 includes a communication unit 220, a control unit 230, a card information storage unit 240, an ID authentication unit 250, and a storage unit 260. The control unit 230 includes an instruction unit 232. The communication unit 220 is a communication interface for connecting to a network 400, and can communicate with the card reader 110, the door control device 150, the operation unit 180, and the face authentication management device 310 in Figure 1 via the network 400. The control unit 230 can also communicate with sensors (not shown), alarms (not shown), and security company servers (not shown) used in the alert setting via the network 400.

The card information storage unit 240 stores card identification information. The card information storage unit 240 also stores permitted area information indicating the area 100 to which the authorized person corresponding to the card identification information is permitted to enter. In the permitted area information, for example, the first area 100a is indicated as the area 100 to which the authorized person is permitted to enter. The information stored in the card information storage unit 240 may be set by an administrator via a user interface (not shown) such as a monitor, keyboard, and mouse provided in the card information storage unit 240, or may be set remotely from an external device (not shown).

The ID authentication unit 250 receives card identification information from the card reader 110 via the communication unit 220. The ID authentication unit 250 executes ID authentication processing for a person located at the entrance based on the received card identification information. Specifically, the ID authentication unit 250 determines whether the received card identification information matches any of the multiple card identification information stored in the card information storage unit 240. This corresponds to executing ID authentication processing for the IC card 120 (non-contact ID device). The ID authentication unit 250 may also receive area information from the card reader 110 via the communication unit 220, and may also use the received area information in the ID authentication processing. If the ID authentication processing is successful, the ID authentication unit 250 outputs authentication success to the control unit 230, and if the ID authentication processing is unsuccessful, it outputs authentication failure to the control unit 230.

When the control unit 230 receives successful authentication from the ID authentication unit 250, it transmits control information from the communication unit 220 to the monitor 140 and the door control device 150, instructing at least one of opening and unlocking the door 160. The control information may instruct at least one of closing and locking the door 160. On the other hand, when the control unit 230 receives unsuccessful authentication from the ID authentication unit 250, it transmits control information from the communication unit 220 to the monitor 140 and the door control device 150, instructing to close the door 160 for a certain period of time. In other words, the control unit 230 controls at least one of opening, unlocking, closing and locking the door 160 provided at the entrance to the specified area 100.

When the result of the ID authentication process from the ID authentication unit 250 indicates success, the control unit 230 manages the authorized persons present inside the facility based on the card identification information received from the ID authentication unit 250. Information on the authorized persons present inside the facility is exchanged with the face authentication management device 310 via the communication unit 220. Furthermore, the control unit 230 communicates with the door control device 150 via the communication unit 220 to obtain the status of the door 160 and manage the status of the door 160. The status of the door 160 indicates whether the door 160 is open, unlocked, closed, or locked. This managed information is stored in the memory unit 260.

The process for enabling the alert setting according to this embodiment is performed in either pattern (4) 4 or pattern (5) 5. In the following, the process will be described in the order of pattern (4) 4 and pattern (5) 5.
(4) Fourth Pattern Here, to explain the fourth pattern, Fig. 6(a)-(f) will also be used. Fig. 6(a)-(f) shows a fourth pattern of operation by the management system 1000. Fig. 6(a)-(c) shows screens displayed on the monitor 140. Fig. 6(d) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates execution of face authentication processing and a low level indicates non-execution of face authentication processing. Fig. 6(e) shows the operation of the entrance/exit management system 200, particularly the entrance/exit management device 210. Fig. 6(f) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these figures, the horizontal axis indicates time.

At time T1, the door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures an image of the authorized person's face. The facial authentication unit 360 of the facial authentication management device 310 performs facial authentication processing based on an image including the face captured by the imaging unit 130. During this time, the screen shown in FIG. 6(a) is displayed on the monitor 140. If the facial authentication processing in the facial authentication unit 360 is successful, the control unit 330 performs control over the door 160 located at the entrance to the area 100. Here, the door 160 is opened at time T2.

At time T3 when the door 160 is open, the IC card 120 is brought close to the card reader 110 shown in FIG. 5(a), causing the ID authentication unit 250 of the entrance/exit management device 210 to execute ID authentication processing on the IC card 120. Following this, at time T4, an authorized person operates the operation unit 180 shown in FIG. 5(a), causing the operation unit 180 to accept a valid operation for enabling the alert setting of the area 100. The operation unit 180 notifies the entrance/exit management device 210 of the valid operation via the network 400.

The communication unit 220 of the entry/exit management device 210 receives a valid operation from the operation unit 180. The instruction unit 232 determines that the ID authentication process is completed at time T3 and that a valid operation is accepted at time T4, but that the door 160 is open and therefore the alert setting conditions are not met. Therefore, at time T5 when the door 160 is closed, the instruction unit 232 determines that the alert setting conditions are met. If the alert setting conditions are met, the instruction unit 232 decides to enable the alert setting for the area 100. The instruction unit 232 instructs the door control device 150 to execute the alert setting for the area 100. At that time, the screen shown in FIG. 6(b) is displayed on the monitor 140.

On the other hand, when the operation unit 180 accepts a valid operation at time T4, the instruction unit 232 transmits information (hereinafter referred to as a "stop instruction") for stopping at least one of the facial authentication processing and image capture performed in the facial authentication management device 310 from the communication unit 220 to the facial authentication management device 310. The communication unit 320 of the facial authentication management device 310 receives the stop instruction from the entrance/exit management device 210 via the network 400 within a predetermined period after the facial authentication unit 360 completes the facial authentication processing. The control unit 330 predefines the authentication stop condition as a case where the communication unit 320 receives a stop instruction within a predetermined period after the facial authentication unit 360 completes the facial authentication processing, and determines that the authentication stop condition is satisfied when the control unit 330 accepts the stop instruction from the communication unit 320. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the image capture unit 130 and the facial authentication unit 360. As a result, the facial authentication processing is no longer performed from time T4.

At time T5, the door 160 is closed. As described above, the instruction unit 232 of the entry/exit management device 210 instructs the door control device 150 to execute the alert setting. When the door control device 150 is instructed by the entry/exit management device 210 to execute the alert setting at time T5, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entry/exit management device 210 via the network 400. When the communication unit 220 of the entry/exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies the security company of the detection result. If the alert setting is enabled, the screen shown in FIG. 6(c) is displayed on the monitor 140.

(5) Fifth Pattern Here, to explain the fifth pattern, Figs. 7(a)-(d) are also used. Figs. 7(a)-(d) show the fifth pattern of operation by the management system 1000. Fig. 7(a) shows a screen displayed on the monitor 140. Fig. 7(b) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates that face authentication processing is being performed, and a low level indicates that face authentication processing is not being performed. Fig. 7(c) shows the operation of the entrance/exit management system 200, particularly the entrance/exit management device 210. Fig. 7(d) shows the operation of the door 160, where a high level indicates that the door is open, and a low level indicates that the door is closed. In these figures, the horizontal axis indicates time.

In the fifth pattern, unlike the fourth pattern, the facial authentication process is not performed by the facial authentication management device 310. At time T1, the IC card 120 is brought close to the card reader 110 shown in FIG. 5(a), and the ID authentication unit 250 of the entrance/exit management device 210 executes the ID authentication process on the IC card 120. Following this, at time T2, an authorized person operates the operation unit 180 shown in FIG. 5(a), and the operation unit 180 accepts a valid operation for enabling the alert setting of the area 100. The operation unit 180 notifies the entrance/exit management device 210 of the valid operation via the network 400.

The communication unit 220 of the entry/exit management device 210 receives a valid operation from the operation unit 180. The instruction unit 232 determines that the alert setting conditions are met because the ID authentication process was completed at time T1 while the door 160 was closed and a valid operation was received at time T2. If the alert setting conditions are met, the instruction unit 232 decides to enable the alert setting for the area 100. The instruction unit 232 instructs the door control device 150 to execute the alert setting for the area 100.

When the door control device 150 is instructed by the entry/exit management device 210 to execute the alert setting at time T3, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entry/exit management device 210 via the network 400. When the communication unit 220 of the entry/exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies the security company of the detection result. If the alert setting is enabled, the screen shown in FIG. 7(a) is displayed on the monitor 140.

On the other hand, when the operation unit 180 accepts a valid operation at time T2, the instruction unit 232 transmits a stop instruction from the communication unit 220 to the face authentication management device 310. The communication unit 320 of the face authentication management device 310 receives the stop instruction from the entrance/exit management device 210 via the network 400. The control unit 330 predefines the case where the communication unit 320 receives a stop instruction as an authentication stop condition, and when it accepts a stop instruction from the communication unit 320, it determines that the authentication stop condition is satisfied. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, face authentication processing is no longer performed from time T2.

According to this embodiment, the authentication stop condition includes a case where the communication unit 320 receives a stop instruction, so that the facial recognition process can be stopped appropriately. In addition, the authentication stop condition includes a case where the communication unit 320 receives a specified signal within a specified period after the facial recognition unit 360 completes the facial recognition process, so that the facial recognition process can be stopped appropriately. In addition, when the operation unit 180 accepts an operation to enable the alert setting, information for stopping at least one of the facial recognition process and image capture performed in the facial recognition management device 310 is transmitted to the facial recognition management device 310, so that the facial recognition process can be stopped appropriately.

An overview of one aspect of the present disclosure is as follows. The device may further include a communication unit (320) that communicates with the outside. The authentication stop condition may include a case where the communication unit (320) receives a specified signal.

The authentication stop condition may include a case where the communication unit (320) receives a predetermined signal within a predetermined period of time after the face authentication unit (360) completes the face authentication process.

Yet another aspect of the present disclosure is an entrance/exit management system (200). This entrance/exit management system (200) includes an ID authentication unit (250) that executes ID authentication processing for a non-contact ID device, a control unit (230) that executes control of a door provided at the entrance of a specified area based on the result of the ID authentication processing in the ID authentication unit (250), an operation unit (180) that accepts an operation to enable an alert setting for the specified area, and a communication unit (220) that communicates with a face authentication system (300) that executes face authentication processing based on a captured image. When the operation unit (180) accepts an operation to enable the alert setting, the communication unit (220) transmits information to the face authentication system (300) for stopping at least one of the face authentication processing and image capture performed in the face authentication system (300).

Example 3
Next, a third embodiment will be described. As in the past, the third embodiment relates to a management system that manages the entry of people into a predetermined area in a facility or the exit of people from the area. In the third embodiment, face authentication processing and ID authentication processing are executed, as in the second embodiment. In the third embodiment, the alert setting is also enabled, for example, when the door is closed and an operation for enabling the alert setting is performed and the operation is confirmed by an authorized person. However, the alert setting is enabled when the face authentication processing for the authorized person is successful as confirmation of the operation by the authorized person. Here, the differences from the past embodiments will be mainly described.

In the following, (6) the sixth pattern will be described as a process for enabling the alert setting according to this embodiment.
(6) Sixth Pattern Here, to explain the sixth pattern, Fig. 8(a)-(d) will also be used. Fig. 8(a)-(d) show the sixth pattern of operation by the management system 1000. Fig. 8(a) shows a screen displayed on the monitor 140. Fig. 8(b) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates that face authentication processing is being performed, and a low level indicates that face authentication processing is not being performed. Fig. 8(c) shows the operation of the entrance/exit management system 200, particularly the entrance/exit management device 210. Fig. 8(d) shows the operation of the door 160, where a high level indicates that the door is open, and a low level indicates that the door is closed. In these figures, the horizontal axis indicates time.

At time T1, an authorized person operates the operation unit 180 shown in FIG. 5(a), whereby the operation unit 180 accepts a valid operation for enabling the alert setting for the area 100. The operation unit 180 notifies the entrance/exit management device 210 of the valid operation via the network 400. The communication unit 220 of the entrance/exit management device 210 receives the valid operation from the operation unit 180. When the communication unit 220 receives the valid operation, the instruction unit 232 causes the communication unit 220 to transmit information for requesting the facial authentication management device 310 to execute facial authentication processing (hereinafter referred to as a "request signal") to the facial authentication management device 310.

When the communication unit 320 of the face authentication management device 310 receives a request signal from the entrance/exit management device 210, the control unit 330 causes the imaging unit 130 to capture an image of the face of the authorized person. At time T2, the face authentication unit 360 executes face authentication processing based on the image including the face captured by the imaging unit 130. During this time, the screen shown in FIG. 8(a) is displayed on the monitor 140. If the face authentication processing in the face authentication unit 360 is successful, the control unit 330 causes the communication unit 320 to transmit information indicating the completion of the face authentication processing (hereinafter referred to as the "completion signal") to the entrance/exit management device 210.

At time T3, the communication unit 220 of the entrance/exit management device 210 receives a completion signal from the facial authentication management device 310. The instruction unit 232 determines that the alert setting conditions are met because, with the door 160 closed, it accepted a valid operation at time T1 and received information from the facial authentication management device 310 indicating the completion of the facial authentication process at time T3. If the alert setting conditions are met, the instruction unit 232 decides to enable the alert setting for the area 100. The instruction unit 232 instructs the door control device 150 to execute the alert setting for the area 100.

When the door control device 150 is instructed by the entry/exit management device 210 to execute the alert setting, it executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entry/exit management device 210 via the network 400. When the communication unit 220 of the entry/exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) and/or notifies the security company of the detection result.

According to this embodiment, when the operation unit 180 receives an operation to enable the alert setting, it transmits a request signal to the face authentication management device 310, so that the face authentication process can be executed appropriately. In addition, when a completion signal is received, it instructs the alert setting, so that the alert setting can be executed appropriately.

An overview of one aspect of the present disclosure is as follows. Yet another aspect of the present disclosure is also an entrance/exit management system (200). This entrance/exit management system (200) includes an ID authentication unit (250) that executes ID authentication processing for a non-contact ID device, a control unit (230) that executes control of a door provided at the entrance of a specified area based on the result of the ID authentication processing in the ID authentication unit (250), an operation unit (180) that accepts an operation to enable an alert setting for the specified area, a communication unit (220) that communicates with a face authentication system (300) that executes face authentication processing based on a captured image, and an instruction unit (232) that instructs an alert setting for the specified area when the operation unit (180) accepts an operation to enable the alert setting and the communication unit (220) receives information indicating the completion of the face authentication processing from the face authentication system (300).

Example 4
Next, a fourth embodiment will be described. As in the previous embodiments, the fourth embodiment relates to a management system that manages the entry of people into a predetermined area in a facility or the exit of people from the area. In the fourth embodiment, face authentication processing and ID authentication processing are executed as in the second and third embodiments. The alert setting in the fourth embodiment is enabled, for example, when the door is closed, there is no authorized person inside the facility, and the face authentication processing for the authorized person is successful. Here, the differences from the previous embodiments will be mainly described.

The process for enabling the alert setting according to this embodiment is performed in either (7) Pattern 7 or (8) Pattern 8. In the following, the process will be described in the order of (7) Pattern 7 and (8) Pattern 8.
(7) Seventh Pattern Here, to explain the seventh pattern, Figs. 9(a)-(d) are also used. Figs. 9(a)-(d) show the seventh pattern of operation by the management system 1000. Fig. 9(a) shows the setting contents of the alert setting, with a high level indicating enabled and a low level indicating disabled. Fig. 9(b) shows the operation of the door 160, with a high level indicating open and a low level indicating closed. Fig. 9(c) shows the operation of the face authentication system 300, particularly the face authentication management device 310, with a high level indicating execution of face authentication processing and a low level indicating non-execution of face authentication processing. Fig. 9(d) shows the operation of the entrance/exit management system 200, particularly the entrance/exit management device 210. In these figures, the horizontal axis indicates time.

At time T1, the door 160 is closed, and an authorized person who wants to activate the alert setting passes in front of the imaging unit 130, causing the imaging unit 130 to capture an image of the authorized person's face. The facial authentication unit 360 of the facial authentication management device 310 executes facial authentication processing based on an image including the face captured by the imaging unit 130. If the facial authentication processing in the facial authentication unit 360 is successful, the control unit 330 executes control over the door 160 provided at the entrance to the area 100. Here, the door 160 is opened at time T2. If the facial authentication processing in the facial authentication unit 360 is successful and the door 160 is opened, the control unit 330 causes the communication unit 320 to transmit information indicating the completion of the facial authentication processing (hereinafter referred to as a "completion signal") to the entrance/exit management device 210. The completion signal includes information about the authorized person whose facial authentication processing has been successful, such as face identification information.

The communication unit 220 of the entrance/exit management device 210 receives a completion signal from the face authentication management device 310. The control unit 230 updates the information on the authorized person present inside the facility based on the information on the authorized person contained in the completion signal. If the update results in no information on the authorized person present inside the facility, the control unit 230 determines that the last person to leave has left. The instruction unit 232 predefines, as an alert setting condition, a case in which the last person to leave the area 100 has left and the communication unit 220 has received information indicating the completion of face authentication processing from the face authentication management device 310. If the alert setting condition is met at time T3, the instruction unit 232 decides to enable the alert setting for the area 100.

On the other hand, when the last person to leave the area 100 has left, the instruction unit 232 transmits a stop instruction from the communication unit 220 to the face authentication management device 310. The communication unit 320 of the face authentication management device 310 receives the stop instruction from the entrance/exit management device 210 via the network 400 within a predetermined period after the face authentication unit 360 has completed the face authentication process. The control unit 330 predefines, as an authentication stop condition, a case in which the communication unit 320 receives a stop instruction within a predetermined period after the face authentication unit 360 has completed the face authentication process, and when the control unit 330 receives a stop instruction from the communication unit 320, it determines that the authentication stop condition is met. When the authentication stop condition is met, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, face authentication processing is no longer performed from time T3.

At time T4, the instruction unit 232 of the entry/exit management device 210 instructs the door control device 150 to execute the alert setting. When the door control device 150 is instructed to execute the alert setting by the entry/exit management device 210 at time T4, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entry/exit management device 210 via the network 400. When the communication unit 220 of the entry/exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies a security company of the detection result.

(8) Eighth Pattern Here, to explain the eighth pattern, Fig. 10(a)-(d) are also used. Fig. 10(a)-(d) show the eighth pattern of operation by the management system 1000. Fig. 10(a) shows the setting contents of the alert setting, with a high level indicating enabled and a low level indicating disabled. Fig. 10(b) shows the operation of the door 160, with a high level indicating open and a low level indicating closed. Fig. 10(c) shows the operation of the face authentication system 300, particularly the face authentication management device 310, with a high level indicating execution of face authentication processing and a low level indicating non-execution of face authentication processing. Fig. 10(d) shows the operation of the entrance/exit management system 200, particularly the entrance/exit management device 210. In these figures, the horizontal axis indicates time.

At time T1, the door 160 is closed, and when an authorized person who wants to activate the alert setting passes in front of the imaging unit 130, the imaging unit 130 captures an image of the authorized person's face. The facial authentication unit 360 of the facial authentication management device 310 executes facial authentication processing based on an image including the face captured by the imaging unit 130. If the facial authentication processing in the facial authentication unit 360 is successful, the control unit 330 executes control over the door 160 provided at the entrance to the area 100. Here, the door 160 is opened at time T2. If the facial authentication processing in the facial authentication unit 360 is successful and the door 160 is opened, the control unit 330 causes the communication unit 320 to transmit a completion signal to the entrance/exit management device 210.

The communication unit 220 of the entrance/exit management device 210 receives a completion signal from the face authentication management device 310. The control unit 230 updates the information on the authorized person present inside the facility based on the information on the authorized person included in the completion signal. If the information on the authorized person present inside the facility is no longer available as a result of the update, the control unit 230 determines that the last person to leave has left. The instruction unit 232 predefines, as an alert setting condition, a case in which the last person to leave the area 100 has left and the communication unit 220 has received information indicating the completion of the face authentication process from the face authentication management device 310. If the alert setting condition is met at time T3, the instruction unit 232 decides to enable the alert setting of the area 100. The instruction unit 232 transmits a notification indicating that the alert setting condition is met and a stop instruction from the communication unit 220 to the face authentication management device 310.

The communication unit 320 of the face authentication management device 310 receives a stop instruction from the entrance/exit management device 210 via the network 400 within a predetermined period of time after the face authentication unit 360 completes the face authentication process. The control unit 330 predefines, as an authentication stop condition, a case in which the communication unit 320 receives a stop instruction within a predetermined period of time after the face authentication unit 360 completes the face authentication process, and determines that the authentication stop condition is met when the control unit 330 receives a stop instruction from the communication unit 320. If the authentication stop condition is met, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, face authentication processing is no longer performed from time T4.

At time T4, the instruction unit 332 instructs the door control device 150 to execute the alert setting. When the door control device 150 is instructed to execute the alert setting by the entry/exit management device 210 at time T4, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the facial authentication management device 310 via the network 400. When the communication unit 320 of the facial authentication management device 310 receives the detection result from the sensor, the control unit 330 sounds an alarm (not shown) or notifies the security company of the detection result.

According to this embodiment, when the last person to leave the specified area leaves and the communication unit 220 receives a completion signal from the face authentication management device 310, an alert setting is instructed, so that the alert setting can be executed appropriately.

An overview of one aspect of the present disclosure is as follows. Yet another aspect of the present disclosure is also an entrance/exit management system (200). This entrance/exit management system (200) includes an ID authentication unit (250) that executes ID authentication processing for a non-contact ID device, a control unit (230) that executes control of a door provided at the entrance of a specified area based on the result of the ID authentication processing in the ID authentication unit (250), a communication unit (220) that communicates with a face authentication system (300) that executes face authentication processing based on a captured image, and an instruction unit (232) that instructs an alert setting for the specified area when the last person to leave the specified area has left and the communication unit (220) has received information indicating the completion of the face authentication processing from the face authentication system (300).

The present disclosure has been described above based on examples. These examples are merely illustrative, and it will be understood by those skilled in the art that various modifications are possible in the combination of each of the components or each of the processing processes, and that such modifications are also within the scope of the present disclosure.

In the first embodiment, the approval suspension condition includes a case where the operation unit 180 receives a valid operation. However, the authentication suspension condition is not limited to this, and may include, for example, a case where an image from the imaging unit 130 includes a face with a predetermined expression. According to this modified example, a valid operation on the operation unit 180 can be eliminated.

100 area, 110 card reader, 120 IC card, 130 imaging unit, 140 monitor, 150 door control device, 160 door, 180 operation unit, 200 entrance/exit control system, 210 entrance/exit control device, 220 communication unit, 230 control unit, 232 instruction unit, 240 card information storage unit, 250 ID authentication unit, 260 storage unit, 300 face authentication system, 310 face authentication management device, 320 communication unit, 330 control unit, 332 instruction unit, 340 face detection unit, 350 face information storage unit, 360 face authentication unit, 370 notification unit, 400 network, 1000 management system.

Claims (12)

a face authentication unit that executes face authentication processing based on an image including a face captured by the imaging unit;
A control unit that executes control over a door provided at an entrance of a predetermined area based on a result of the face authentication process in the face authentication unit;
an instruction unit that instructs to set an alert for the predetermined area when an alert setting condition is satisfied;
an operation unit that receives an operation for enabling the alert setting for the predetermined area;
Equipped with
A face authentication system, wherein the alert setting condition includes a case where the operation unit receives an operation for enabling the alert setting. The face authentication system according to claim 1, wherein the alert setting condition includes a case where the face authentication unit completes the face authentication process and the operation unit accepts an operation to enable the alert setting. The face authentication system according to claim 1, wherein the alert setting condition includes a case where the operation unit receives an operation to enable the alert setting within a predetermined period of time after the face authentication unit completes the face authentication process. an ID authentication unit that executes an ID authentication process for the contactless ID device;
a control unit that executes control over a door provided at an entrance of a predetermined area based on a result of the ID authentication process in the ID authentication unit;
an operation unit that receives an operation for enabling a security setting for the predetermined area;
A communication unit that communicates with a face recognition system that executes face recognition processing based on a captured image;
an instruction unit that instructs the alert setting of the predetermined area when the operation unit accepts an operation for enabling the alert setting and the communication unit receives information indicating completion of the face authentication process from the face authentication system;
An entrance/exit control system equipped with an ID authentication unit that executes an ID authentication process for the contactless ID device;
a control unit that executes control over a door provided at an entrance of a predetermined area based on a result of the ID authentication process in the ID authentication unit;
an operation unit that receives an operation for enabling a security setting for the predetermined area;
A communication unit that communicates with a face recognition system that executes face recognition processing based on a captured image;
an instruction unit that instructs the security setting of the predetermined area when the operation unit accepts an operation for enabling the security setting and when the ID authentication process is completed in the ID authentication unit;
An entrance/exit control system equipped with an ID authentication unit that executes an ID authentication process for the contactless ID device;
a control unit that executes control over a door provided at an entrance of a predetermined area based on a result of the ID authentication process in the ID authentication unit;
an operation unit that receives an operation for enabling a security setting for the predetermined area;
A communication unit that communicates with a face recognition system that executes face recognition processing based on a captured image;
an instruction unit that instructs the security setting of the predetermined area when the operation unit receives an operation for enabling the security setting, the ID authentication process in the ID authentication unit is completed, and the door is in a closed state;
An entrance/exit control system equipped with The entrance/exit management system according to claim 6, wherein the instruction unit instructs the security setting of the specified area when the door is closed, when the operation unit accepts an operation to activate the security setting and the door is open at the time the ID authentication process is completed in the ID authentication unit. an ID authentication unit that executes an ID authentication process for the contactless ID device;
a control unit that executes control over a door provided at an entrance of a predetermined area based on a result of the ID authentication process in the ID authentication unit;
A communication unit that communicates with a face recognition system that executes face recognition processing based on a captured image;
an instruction unit that instructs to set an alert for the specified area when a last person has exited the specified area and the communication unit has received information indicating completion of the face recognition process from the face recognition system; and
An entrance/exit control system equipped with A communication unit that communicates with the entrance/exit management system according to any one of claims 4 to 8;
A face authentication system comprising: a face authentication unit that executes face authentication processing based on an image including a face captured by an imaging unit. A management system comprising the entrance/exit management system according to any one of claims 4 to 7 and the face authentication system according to claim 9. A program for executing the face authentication system according to any one of claims 1 to 3 and 9. A program for causing the entrance/exit management system according to any one of claims 4 to 7 to be executed.

Images