JP2019219721A - Entry/exit authentication system and entry/exit authentication method - Google Patents

Abstract

To effectively suppress entry/exit of a person who does not intend to enter/exit and improve security.SOLUTION: In an entry/exit management system 5, a face authentication server 30 and an entry/exit management server 50 are communicably connected. The face authentication server 30 detects whether or not a person hm faces a door 161 on the basis of a captured image by a face authentication camera 10 capturing an image of the person hm located near the door 161 of a conference room 160, and transmits the detection result to the entry/exit management server 50. The entry/exit management server 50 controls an electric lock 168 of the door 161 to be locked or unlocked according to the result of the determination as to whether the person hm is a person permitted to enter or exit the conference room 160 when it is detected that the person hm is facing the door 161 on the basis of the detection result transmitted from the face authentication server 30.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to an entrance / exit authentication system and an entrance / exit authentication method for authenticating opening and closing of an entrance.

  According to Patent Literature 1, based on ID information wirelessly acquired from a terminal possessed by a person located at the entrance of the managed area, whether the person located at the entrance is a person who has authority to enter the managed area is determined. An ID authentication unit for performing ID authentication, and a face information obtaining unit for obtaining face information indicating whether a captured image obtained by shooting the entrance from a predetermined position includes a face image of a predetermined size And an entrance / exit management device having a door control unit for controlling an opening / closing state of an entrance based on a result of ID authentication and face information.

JP 2017-8638 A

  In Patent Literature 1, acquisition of ID information of an ID card for entering a management target area is performed on condition that the size of a human face image occupied by a camera image is not less than a predetermined value. And ID authentication is performed. However, in the configuration of Patent Literature 1, the direction of the human face or the direction of the line of sight is not considered. For this reason, for example, when a person who does not intend to enter and exit passes near the entrance of the management target area, if the size of the face image of the passing person with respect to the captured image is equal to or larger than a predetermined value, ID authentication is performed. Depending on the result, there is a possibility that security can be degraded in that it is possible to enter a management target area and to enter an undesired person.

  The present disclosure is devised in view of the conventional situation described above, and provides an entry / exit authentication system and an entry / exit authentication method for effectively suppressing entry / exit of a person who does not intend to enter / exit and improving security. The purpose is to:

  The present disclosure is an entrance / exit authentication system in which a face authentication device and an entrance / exit management device are communicably connected, wherein the face authentication device is a camera for imaging a person located near an entrance of a management target area. Based on the captured image, detects whether the person is facing the entrance, sends the detection result to the entrance management device, the entrance management device, the detection sent from the face authentication device, Based on the result, if it is detected that the person is facing the entrance, according to the determination result of whether the person is a person who is allowed to enter or leave the management target area, the entrance Provide an entrance / exit authentication system that controls the open / close state of a room.

  Further, the present disclosure is an entrance / exit authentication method using an entrance / exit authentication system in which a face authentication device and an entrance / exit management device are communicably connected, wherein the face authentication device is located near an entrance of a management target area. Based on a captured image of a camera that captures a person located at, detects whether the person is facing the entrance, sends the detection result to the entrance management device, the entrance management device, Based on the detection result sent from the face authentication device, when it is detected that the person faces the entrance, is the person permitted to enter or leave the management target area? An entrance / exit authentication method for controlling the opening / closing state of the entrance in accordance with a result of the determination.

  According to the present disclosure, entry and exit of a person who does not intend to enter and exit can be effectively suppressed, and security can be improved.

The figure which shows the inside of the facility in which the entrance / exit management system according to Embodiment 1 was installed. Diagram showing a configuration example of an entry / exit management system FIG. 2 is a diagram illustrating a hardware configuration example of a face authentication server and an entry / exit management server The figure which shows the setting screen in which the door area and the face detection area are set in the captured image from the side of the door The figure which shows the setting screen in which the door area and the face detection area are set in the captured image from the front direction of the door Sequence diagram showing the setting operation in the access control system Sequence diagram showing operation during operation in the entry / exit management system FIG. 7 is a diagram illustrating an operation state of a plurality of persons passing in front of a door when an angle of view of a face authentication camera is set to a wide angle; FIG. 9 is a diagram illustrating an operation state of a plurality of persons passing in front of a door when an angle of view of a face authentication camera is set to a narrow angle; FIG. 7 is a diagram showing an operation state for a plurality of persons passing in front of a door when two face authentication cameras are installed. Sequence diagram showing operation during operation in the entry / exit management system according to the second embodiment.

  Hereinafter, an embodiment that specifically discloses an entry / exit authentication system and an entry / exit authentication method according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, an unnecessary detailed description may be omitted. For example, a detailed description of well-known matters and a repeated description of substantially the same configuration may be omitted. This is to prevent the following description from being unnecessarily redundant and to facilitate understanding of those skilled in the art. It is noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter.

  In the following embodiments, as an example of an entry / exit authentication system according to the present disclosure, an entry / exit management system 5 that performs authentication when entering or leaving a conference room inside a facility or the like will be described as an example. .

(Embodiment 1)
FIG. 1 is a diagram showing the inside of a facility 200 in which the access control system 5 according to the first embodiment is installed. The facility 200 is, for example, a public facility in which many conference rooms are prepared. Inside the facility 200, a wide passage 130 through which many people pass is provided. A plurality of windows 131 are provided on one side wall of the passage 130. On the other side wall of the passage 130, the front faces of the conference rooms 150, 160, 170 are provided. Doors 151, 161, and 171 are provided in front of the conference rooms 150, 160, and 170, respectively. Although FIG. 1 shows a plurality of (for example, three) conference rooms, only one conference room may be used.

  Each door 151, 161, 171 is provided with an electric lock 158, 168, 178 which can be switched between a locked (locked) state and an unlocked (unlocked) state. When the electric lock is switched to the locked state, the door is closed and locked. When the electric lock is switched to the unlocked state, the door is opened and unlocked.

  Each of the doors 151, 161, 171 is provided with a card reader 155, 165, 175, respectively. The card readers 155, 165, and 175 perform non-contact communication with the card cd possessed by the person hm, and read card information (for example, ID information that is identification information) recorded on the card cd. The face authentication camera 10 is installed on a ceiling or a pillar of the passage 130 in front of the doors 151 and 161, respectively. The face authentication camera 10 is installed above the door 171.

  A monitoring room 180 is provided behind the meeting rooms 150, 160, and 170 in the facility 200. Inside the monitoring room 180, a face authentication server 30, an entry / exit management server 50, and a PC (Personal Computer) 70 are placed.

  FIG. 2 is a diagram illustrating a configuration example of the entry / exit management system 5. The management of entering and leaving the three conference rooms 150, 160, 170 is the same. Here, the conference room 160 will be mainly described. However, since the location where the face authentication camera 10 is installed differs depending on the conference room, the other conference rooms 150 and 170 will also be described as needed.

  The entry / exit management system 5 is configured to include a face authentication camera 10, a face authentication server 30, an entry / exit management server 50, and a PC 70 connected via a network NW. The face authentication camera 10 is installed on a side wall of a pillar 130z erected in the passage 130, for example. The face authentication camera 10 captures an image including the face of the person hm passing through the passage 130 as a subject. In the first embodiment, face authentication camera 10 is an always-on camera that constantly captures an image and repeatedly transmits the captured image to PC 70 and face-authentication server 30. The face authentication camera may be a sensitive camera with a human detection sensor that captures an image only when a person enters the face detection area. Here, the face authentication camera is a fixed camera, but may be a PTZ (Pan Tilt Zoom) camera capable of performing pan-tilt zoom processing.

  The face authentication server 30 detects, based on the captured image transmitted from the face authentication camera 10, face information (a face feature amount, a face direction, a gaze direction, and the like) of the person hm passing through the passage 130. The entry / exit management server 50 authenticates a person heading for the door 161 and controls opening and closing of the door 161. The PC 70 sets a door area and a face detection area.

  The entry / exit management system 5 includes a card reader 165, a card cd, and an electric lock 168. The card reader 165 and the electric lock 168 are connected to the entry / exit management server 50. The card reader 165 performs non-contact communication with a card cd held by a person. The electric lock 168 automatically opens and closes the door 161 to lock or unlock the door 161.

  FIG. 3 is a diagram illustrating a hardware configuration example of the face authentication server 30 and the entry / exit management server 50. The face authentication server 30 includes a face detection unit 31, a face direction / line-of-sight detection unit 32, a face information storage unit 33, a face matching unit 34, and a communication unit 35.

  The face detection unit 31 detects a face image of a person appearing in an image captured by the face authentication camera 10. The face detection unit 31 determines the positions of the feature points such as the eyes, eyebrows, nose, and mouth in the face and the distance between the feature points included in the captured image (that is, the current live image captured in real time). Is determined as a face image.

  The face direction / line-of-sight detection unit 32 detects the direction of the face and the direction of the line of sight of the detected person. Conventionally, various methods for detecting the direction of the face have been proposed. As an example, when estimating the face direction (face direction), the face direction / eye gaze detection unit 32 rotates based on the position coordinates of feature points such as eyes, nose, and mouth when the face is facing front. A matrix is calculated, and the position coordinates after the rotation matrix are compared with the position coordinates of the feature points such as eyes, nose, and mouth included in the face image. Angle, roll angle, yaw angle). Further, as another example, when estimating the direction of the face, the face direction / eye gaze detecting unit 32 performs a skin color detection process on the face image, and determines the center of gravity of the skin color region of the face image facing the front with a predetermined center. The amount of shift from the center of gravity of the skin color region of the face image facing the direction is calculated, and the face direction is determined from the amount of shift.

  The direction of the line of sight is determined by using a line of sight detection technique. Eye gaze detection is performed by detecting eye movement. The movement of the eye is specified by the position of the part where the eye moves (such as the iris) with respect to the position (reference point) of the part where the eye does not move (the inner or outer corner of the eye). For example, if the iris of the right eye is far from the inner corner of the eye and close to the outer corner of the eye, it is determined that the person is looking at the right side. Similarly, when the iris of the left eye is far from the inner corner of the eye and close to the outer corner of the eye, it is determined that the person is looking at the left side. Further, the movement of the eyes may be detected from the positional relationship between the corneal reflection and the pupil using the corneal reflection obtained by irradiating the eye with infrared rays as a reference point.

  The face information storage unit 33 stores face information of a person, for example, face information of an employee who works at the facility 200. The face information includes a face image and a feature amount of the face. The face images include a front face image and left and right face images of the same person. The facial feature quantity includes the positional relationship of the eyes, nose, mouth, etc., the presence or absence of glasses, the presence of hair, and the like. Further, the face information storage unit 33 stores the face information of the person when the face direction is the direction of the door and the line of sight information of the person when the direction of the line of sight is the direction of the door.

  The face direction / line-of-sight detection unit 32 determines whether the face direction detected by the face detection unit 31 is the direction of the door 161 based on the face information stored in the face information storage unit 33. Further, the face direction / line-of-sight detection unit 32 determines whether the direction of the line of sight detected by the face detection unit 31 is the direction of the door 161 based on the line-of-sight information stored in the face information storage unit 33. . When both the face direction and the line of sight are aligned in the door direction, the face direction / line-of-sight detection unit 32 may determine that the door is facing the door, or one of them may be the door direction. , It may be determined that the door is facing. Here, if either one is in the direction of the door, the face direction / sight line detection unit 32 determines that the face is facing the door.

  Further, the face direction is not limited to the case where the face direction of the person is detected once, but may be detected only when the face direction is detected a predetermined number of times or more. Further, the face direction may be detected for the first time when the face direction is continuously detected for a predetermined time or more. That is, when the degree of the face direction is large, the face direction may be detected. This can prevent an erroneous determination that a person looks at the door at a glance, that is, a so-called glance, as an intention to enter or leave. The same applies to the line of sight.

  If the direction of the face detected by the face detection unit 31 is the direction of the door 161 or if the direction of the line of sight detected by the face detection unit 31 is the direction of the door 161, the face matching unit 34 performs face detection. The face information of the face detected by the unit 31 is compared with the face information stored in the face information storage unit 33. For example, the face detection unit 31 determines the positions of the feature points such as the eyes, eyebrows, nose, and mouth in the face included in the captured image (that is, the current live image captured in real time), and between the feature points. Is determined as a face image based on the distance and the like, and a portion of the face image is cut out from the captured image. The face matching unit 34 performs template matching for matching the cut out face image with the face image (template) of each person registered in the face information storage unit 33. The face matching unit 34 calculates a similarity by comparing a feature amount such as a position of each feature point in the cut-out face image, a distance between feature points, and the like with a corresponding feature amount of the registered face image, If the similarity exceeds the threshold value, face authentication is performed to determine that the face images match.

  Note that the face matching unit 34 may perform face authentication using artificial intelligence (AI). In this case, the processor constituting the face matching unit 34 stores the face image of each person as teacher data. The processor performs machine learning such as deep learning using artificial intelligence using the above-described teacher data, updates the number of neurons and weighting coefficients of the intermediate layer of the neural network forming the learning model, and executes the learned model. To construct. The processor may use the learned model to input an image captured by the face authentication camera, authenticate a face image of a person appearing in the captured image, and output an authentication result.

  When the face images match as a result of the face matching, the face matching unit 34 transmits a permission signal to the electric lock control unit 51 of the entry / exit management server 50 via the communication unit 35 and the network NW. Upon receiving the permission signal from the face collating unit 34, the electric lock control unit 51 unlocks the electric lock 168 and automatically opens the door 161. Note that the face matching unit 34 does not transmit the permission signal if the face images do not match as a result of the face matching. Therefore, the electric lock 168 is not unlocked, and the door 161 remains closed.

  The communication unit 35 is connected to the network NW by wire or wirelessly, and communicates with the entry / exit management server 50, the face authentication camera 10, and the PC 70 via the network NW. Note that the communication unit 35 may be directly connected to the entry / exit management server 50, the face authentication camera 10, or the PC 70 without using the network NW to communicate with them.

  The entry / exit management server 50 includes an electric lock control unit 51, a communication unit 52, a card reader communication unit 53, an ID position detection unit 54, an ID information storage unit 55, an ID authentication unit 56, and an ID information setting unit 57.

  The electric lock controller 51 drives the electric lock 168 and controls opening and closing of the door 161 by the electric lock 168. The communication unit 52 is connected to the network NW by wire or wirelessly, and communicates with the face authentication server 30. The communication unit 52 may be directly connected to the face authentication server 30 and communicate with the face authentication server 30 without going through the network NW.

  The card reader communication unit 53 performs non-contact communication with the card reader 165 and acquires card information read by the card reader 165. The card reader 165 performs non-contact communication with a card cd held by a person using a short-range wireless communication method. As the short-range wireless communication method, for example, Bluetooth (registered trademark), Felica (registered trademark), or the like may be used. Note that the card reader 165 is not limited to the non-contact communication method, but may be a method of reading information recorded on the card cd in a state of being in contact with the card cd (that is, contact-type communication).

  The ID position detection unit 54 detects ID information included in the card information acquired by the card reader communication unit 53. The ID information includes information for identifying a person registered in the card cd. The ID position detection unit 54 detects not only the ID information but also the position information of the card reader 165 (for example, the identification information of the door on which the card reader 165 is disposed) from the card information acquired by the card reader communication unit 53. May be.

  The ID information storage unit 55 stores ID information of many persons and information about each person in association with each other. For example, the person may be an employee in the facility 200 or the like.

  The ID authentication unit 56 compares the ID information detected by the ID position detection unit 54 with the ID information stored in the ID information storage unit 55, and as a result of the verification, the ID authentication is approved (OK). ), A permission signal is output to the electric lock controller 51. When receiving the permission signal from the ID authentication unit 56, the electric lock control unit 51 unlocks the electric lock 168 and automatically opens the door 161. Note that the ID authentication unit 56 does not transmit the permission signal when the ID authentication is rejected (NG) as a result of the comparison. Therefore, the electric lock 168 is not unlocked, and the door 161 remains closed.

  The ID information setting unit 57 receives an operation performed by an operator or the like, sets ID information of a person and information about the person, and registers the information in the ID information storage unit 55.

  Here, two operations are possible: a case where a person is authenticated by face matching and a case where a person is confirmed by ID authentication. In the case of authenticating a person by face matching, processing takes time, but the authentication accuracy of whether or not the person is high is high, and the security is improved. On the other hand, when a person is confirmed by ID authentication, the person of the information recorded on the card may be different from the person holding the card, but the time required for the processing is shortened. Embodiment 1 shows a case where a person is authenticated by face matching, and Embodiment 2 shows a case where a person is confirmed by ID authentication. Note that a case where a person is authenticated by face matching and a case where a person is confirmed by ID authentication may be used together. Thereby, security can be further improved.

  FIG. 4 is a diagram showing a setting screen GM1 in which a door area DA1 and a face detection area SA1 are set in a captured image GZ1 from the side of the door 161. The setting screen GM1 is displayed on the PC 70 operated by an operator or the like. On the setting screen GM1, a captured image GZ1, a setting button bt1, and a delete button bt2 are displayed. In the case of the conference room 160, the captured image GZ1 is a live image that is captured by the face authentication camera 10 installed on the pillar 130z of the passage 130 and that looks at the front of the door including the door 161 from the side. The door 161 is a slide door that slides left and right to open and close. A card reader 165 is attached beside the door 161. The captured image GZ1 shows the person hm approaching the door 161.

  The setting button bt1 is pressed by an operator or the like when setting of the door area DA1 and the face detection area SA1 is started and when the set door area DA1 and face detection area SA1 are saved. The delete button bt2 is pressed by an operator or the like when deleting the door area DA1 and the face detection area SA1 that have already been set, or the door area DA1 and the face detection area SA1 that are being set.

  The operator sets the door area DA1 so as to surround the door 161 included in the captured image GZ1 using the cursor Ks operated by the mouse. On the setting screen GM1, the set door area DA1 is drawn with a red dotted frame. When the door area DA1 is set, the PC 70 automatically sets the face detection area SA1 within a predetermined distance from the door 161, for example, within 3 m from the front of the door 161. The operator may edit the automatically set face detection area SA1 with the cursor Ks. On the setting screen GM1, the set face detection area SA1 is drawn by a blue dotted frame.

  Here, the operator sets the door area DA1, but the PC 70 may detect the door image included in the captured image GZ1 by image processing and set the door area DA1 so as to surround the detected door image. When the door area DA1 is set, the PC 70 automatically sets a predetermined range with respect to the door position as the face detection area, but the operator may set the face detection area SA1. The face detection area may detect a person and may be set in a predetermined range around the height of the person. For example, an area that is １ ／ or more of the height of the person may be set as the face detection area. The face detection area is set to a rectangular area, but may be set to any shape. The number of face detection areas is not limited to one, and a plurality of face detection areas may be set.

  FIG. 5 is a diagram showing a setting screen on which a door area DA2 and a face detection area SA2 are set in a captured image GZ2 from the front direction of the door 161. In the case of the conference room 170, the captured image GZ2 is a live image captured by the face authentication camera 10 installed above the door 161 and viewing the front of the door from the front. The captured image GZ2 shows a person hm approaching while running to the door 161. The door 161 is not shown in the captured image GZ2. In this case, the operator specifies the direction in which the door is installed using the cursor Ks operated by the mouse. For example, it is specified by an operation of dragging the mouse or double-clicking on the screen position in the direction in which the door is installed. When the door area DA2 is set, the door area DA2 is drawn in a red dotted frame on the setting screen GM2. When the door area DA2 is set, the PC 70 automatically sets the face detection area SA2 within a predetermined distance from the door 161, for example, within 3 m from the front of the door 161. The operator may edit the automatically set face detection area SA2 with the cursor Ks. On the setting screen GM2, the set face detection area SA2 is drawn by a blue dotted frame.

  Note that, as in the case of the setting screen GM1, when the door area DA2 is set, the PC 70 automatically sets a predetermined range with respect to the door position as a face detection area, but the operator sets the face detection area SA2. You may. The face detection area may detect a person and may be set in a predetermined range around the height of the person. For example, an area that is １ ／ or more of the height of the person may be set as the face detection area. The face detection area is set to a rectangular area, but may be set to any shape such as an ellipse or a polygon. The number of face detection areas is not limited to one, and a plurality of face detection areas may be set.

  Next, an operation procedure of the entry / exit management system 5 according to the first embodiment will be described with reference to FIG.

  FIG. 6 is a sequence diagram showing a setting operation in the entry / exit management system 5.

  6, the face authentication camera 10 constantly captures an image of the vicinity of the door, and transmits the captured image to the PC 70 (T1). The PC 70 receives the image captured by the face authentication camera 10 and displays the received image on a screen. The PC 70 receives an operation by the operator for setting a door area for the captured image displayed on the screen (T2).

  The PC 70 automatically sets the face detection area based on the door area set by the operator. The PC 70 transmits information including the door area and the face detection area set in association with the door area to the face authentication server 30 (T3). When the communication unit 35 of the face authentication server 30 receives the information of the door area and the face detection area from the PC 70, the communication unit 35 stores the information in the face information storage unit 33.

  FIG. 7 is a sequence diagram showing an operation at the time of operation in the entry / exit management system 5. The face authentication camera 10 captures an image of the person hm passing through the passage 130 (T11). The face authentication camera 10 transmits the captured image to the face detection unit 31 of the face authentication server 30 (T12). The face detection unit 31 detects a face image included in the captured image, and notifies the face information (including the face image) to the face direction / sight line detection unit 32 (T13). The face direction / gaze detection unit 32 determines the face direction (face direction) and the gaze direction based on the face information. That is, it is determined whether the face direction is the direction of the door or the direction of the line of sight is the direction of the door. When the face direction or the line of sight is the direction of the door, the face direction / line of sight detection unit 32 transmits the determination result of the face direction or the line of sight to the face matching unit 34 (T14).

  The face matching unit 34 compares the face image detected by the face detection unit 31 with the face information (face image, face feature amount, etc.) of the person stored in the face information storage unit 33 (T15). The processing of steps T12 to T15 is repeated while a person is in the face detection area.

  When the verification is OK, the face verification unit 34 transmits a permission signal (door opening control information) to the entrance / exit management server 50 via the communication unit 35 and the network NW (T16).

  The communication unit 52 of the entry / exit management server 50 receives the door opening control information from the face authentication server 30. The communication unit 52 transmits the door opening control information to the electric lock control unit 51. The electric lock control unit 51 unlocks the electric lock 168 and opens the door 161 (T17). As a result, the door 161 automatically opens.

  FIG. 8 is a diagram illustrating operation states of a plurality of persons passing in front of the door 161 when the angle of view of the face authentication camera 10 is set to a wide angle. In FIG. 8, the positions of the door 161 and the face authentication camera 10 are schematically illustrated for easy understanding. The same applies to FIGS. 9 and 10. The face authentication camera 10 installed above the passage 130 captures images of three persons hm4 to hm6 passing in front of the door 161 and the door 161 so as to be included in the angle of view. In this case, among the three persons hm4 to hm6, the first person hm4 faces his / her face to the door 161, but the other two persons hm5 and hm6 move in different directions other than the door 161. It is suitable. The entrance / exit management system 5 operates to automatically open the door 161 assuming that the first person hm4 faces his / her face. Accordingly, the entry / exit management system 5 can control the unlocking of the door 161 so that only the first person hm4 can enter and exit, and prohibit the unlocking of the door 161 so that the persons hm5 and hm6 cannot enter and exit. .

  FIG. 9 is a diagram illustrating operation states of a plurality of persons passing in front of the door 161 when the angle of view of the face authentication camera 10 is set to a narrow angle. The face authentication camera 10 captures only the first person hm4 (the size of one person hm) among the three people hm4 to hm6 passing in front of the door 161. The first person hm4 faces his / her door 161 while the other two persons hm5 and hm6 face different directions other than the door 161. In this case, the entry / exit management system 5 operates to automatically open the door 161 assuming that the first person hm4 faces the door 161. In the first embodiment, regardless of whether the angle of view of the face authentication camera 10 is wide or narrow, the time during which the door 161 is controlled to be unlockable by the access control system 5 is the time during which one person can pass. It is. When the leading person hm4 passes, the door 161 closes. That is, the entry / exit management system 5 closes the door 161 until the next person hm5 is imaged by the face authentication camera 10 and the face is determined to be facing the door 161. Therefore, it is possible to prevent the actions of the persons hm5 and hm6 who are trying to enter the room together with each other without turning their faces to the door. When it is determined that the persons hm5 and hm6 face the door 161 respectively, the entrance / exit management system 5 opens the door 161 in each case.

  FIG. 10 is a diagram illustrating an operation state of a plurality of persons hm4 to hm6 passing in front of the door 161 when two face authentication cameras 10 are installed. In this case, the face authentication camera 10 at the rear can image the person hm from behind. For example, assume that there is a person hm7 who is an unqualified person behind the person hm4 at the head. In this case, the rear face authentication camera 10 can image the person hm7 behind. Therefore, it is also possible to find and track the person hm7 who is going to enter and leave with a tailgating.

  As described above, in the entry / exit management system 5 according to Embodiment 1, the face authentication server 30 (an example of a face authentication device) and the entry / exit management server 50 (an example of an entry / exit management device) are communicably connected. The face authentication server 30 is configured based on an image captured by the face authentication camera 10 that captures a person hm (an example of a person) located near a door 161 (an example of an entrance) of the conference room 160 (an example of a management target area). It detects whether the person hm is facing the door 161 and sends the detection result to the entry / exit management server 50. When it is detected that the person hm is facing the door 161 based on the detection result sent from the face authentication server 30, the entry / exit management server 50 enters or leaves the conference room 160. Is locked or unlocked (an example of an open / closed state) of the electric lock 168 of the door 161 according to the result of the determination as to whether or not the person is authorized.

  Accordingly, the entry / exit management system 5 can effectively suppress entry / exit of a person who does not intend to enter / exit the room, so that intrusion of an outsider can be eliminated and security can be improved. Further, according to the entrance / exit management system 5, since a person is authenticated by face collation, there is a high possibility that the person is an individual (eg, an employee) who intends to enter / exit the room, and high security can be secured.

  Further, the face authentication server 30 detects a face image of the person hm from the image captured by the face authentication camera 10 and detects whether the detected face image of the person hm faces the door 161. Thereby, according to the entrance / exit management system 5, a person who intends to enter / exit from the passersby can be appropriately selected. Therefore, according to the entry / exit management system 5, the chances of unlocking and opening the door unnecessarily are reduced. Further, according to the entrance / exit management system 5, the gesture of turning the face is a natural gesture performed by a person who intends to enter / exit the room, so that it is not necessary to force the person to intentionally enter / exit the room.

  Further, the face authentication server 30 detects a face image of the person hm from the image captured by the face authentication camera 10 and detects whether or not the line of sight in the detected face image is facing the door 161. Thus, according to the entrance / exit management system 5, appropriate actions can be taken without flipping a person who makes a gesture of turning only the eyes to the door without turning the face to the door. In addition, according to the entry / exit management system 5, it is possible to easily communicate the intention without performing a gesture of turning the face greatly.

  Further, the face authentication server 30 starts detecting a face image of the person hm in response to the detection that the person hm has entered the face detection area SA1 set in the image captured by the face authentication camera 10. Thus, according to the entry / exit management system 5, by setting the face detection area to an area where a person who intends to enter / exit faces, it is possible to exclude a person outside the face detection area from the target. it can. Therefore, according to the entry / exit management system 5, the processing load can be reduced. Further, according to the entry / exit management system 5, by performing face detection at the timing when the person hm enters the face detection area, it is possible to select a person who intends to enter / exit with high accuracy.

  The face detection area SA1 is set within a range of a predetermined distance from the door 161. Thus, according to the entry / exit management system 5, for example, the face detection area can be appropriately set for the door 161.

  Further, the face detection area SA1 has the size of one person hm appearing in the image captured by the face authentication camera 10. As a result, according to the entry / exit management system 5, it is possible to select individual persons even when there is a so-called tailgating, in which a friend walks along. Therefore, according to the entry / exit management system 5, it is possible to exclude a malicious person who attempts to enter / exit by imitating a tailgating.

  The face authentication camera 10 is arranged at a position where both the door 161 and the person hm approaching the door 161 are included in the angle of view. Thereby, according to the entrance / exit management system 5, the face authentication camera 10 can be arranged on the side of the door 161. In addition, the face authentication camera 10 can reliably image a person who intends to enter or leave the room. The operator can individually confirm whether or not the person heading to the door is a person who intends to enter or leave by looking at the captured image.

  The face authentication camera 10 is arranged at a position where the person hm approaching the door 161 is included in the angle of view. Thereby, according to the entrance / exit management system 5, the face authentication camera 10 can be attached to the door 161. Further, according to the entry / exit management system 5, the face of the person shown in the captured image can be captured from the front. Therefore, according to the entry / exit management system 5, erroneous detection can be reduced and the accuracy of face detection can be increased.

(Embodiment 2)
In the first embodiment, a case where a person is authenticated by face matching has been described. Embodiment 2 shows a case where a person is confirmed by ID authentication. The entry / exit management system according to the second embodiment has substantially the same configuration as the first embodiment. The same components as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.

  FIG. 11 is a sequence diagram illustrating an operation at the time of operation in the entry / exit management system 5 according to the second embodiment. The operations in steps T12 and T13 are the same as those in the first embodiment, and therefore the description of the overlapping contents will be simplified or omitted, and different contents will be described.

  When the face direction or the line of sight is the direction of the door 161, the face direction / line of sight detection unit 32 transmits the face direction / line of sight information to the entry / exit management server 50 via the communication unit 35 and the network NW ( T21). In this case, the face matching unit 34 allows the communication unit 35 to pass the face direction / line-of-sight information as it is. The communication unit 52 of the entry / exit management server 50 notifies the face direction / line-of-sight information to the ID authentication unit 56.

  The ID authentication unit 56 collates the ID information detected by the ID position detection unit 54 with the ID information stored in the ID information storage unit 55, and performs ID authentication (T22). If the result of the comparison is that the ID authentication is OK, the ID authentication unit 56 outputs a permission signal (door opening control information) to the electric lock control unit 51 (T23). Upon receiving the door opening control information from the ID authentication unit 56, the electric lock control unit 51 unlocks the electric lock 168 and opens the door 161 (T24). As a result, the door 161 automatically opens.

  As described above, in the entry / exit management system according to the second embodiment, by reading the ID information (an example of identification information) stored in the card cd held by the person, the person can be quickly confirmed by ID authentication. According to the entry / exit management system 5 according to the second embodiment, erroneous detection hardly occurs.

  Although various embodiments have been described with reference to the drawings, it is needless to say that the present disclosure is not limited to such examples. It is obvious that those skilled in the art can conceive various changes, modifications, substitutions, additions, deletions, and equivalents within the scope of the claims. It is understood that the present invention naturally belongs to the technical scope of the present disclosure. Further, the components in the above-described various embodiments may be arbitrarily combined without departing from the spirit of the invention.

  For example, in the above-described first and second embodiments, the opening and closing of the door for entering and exiting a room (meeting room) in the facility has been described. However, in order to enter and exit the front entrance of the facility, or a place such as a square or a park. The present disclosure is similarly applicable to the opening and closing of the gate.

  INDUSTRIAL APPLICABILITY The present disclosure is useful as an entry / exit authentication system and an entry / exit authentication method for effectively suppressing entry / exit of a person who does not intend to enter / exit and improving security.

5 Entry / Exit Management System 10 Face Authentication Camera 30 Face Authentication Server 31 Face Detection Unit 32 Face Direction / Gaze Detection Unit 33 Face Information Storage Unit 34 Face Collation Unit 35 Communication Unit 50 Entry / Exit Management Server 51 Electric Lock Control Unit 52 Communication Unit 53 Card reader communication unit 54 ID position detection unit 55 ID information storage unit 56 ID authentication unit 57 ID information setting unit 70 PC
161 Door 165 Card reader 168 Electric lock

Claims (9)

An entry / exit authentication system in which a face authentication device and an entry / exit management device are communicably connected,
The face authentication device,
Based on a captured image of a camera that captures a person located near the entrance of the management target area, detects whether the person is facing the entrance, and sends the detection result to the entrance / exit management device,
The access control device,
Based on the detection result sent from the face authentication device, when it is detected that the person faces the entrance, the person is a person who is allowed to enter or leave the management target area. According to the determination result of whether or not to control the opening and closing state of the entrance,
Access control system. The face authentication device,
Detecting the face image of the person from the captured image of the camera, and detecting whether the detected face image of the person faces the entrance;
The entry / exit authentication system according to claim 1. The face authentication device,
Detecting the face image of the person from the captured image of the camera, and detecting whether or not the line of sight in the detected face image faces the entrance;
The entry / exit authentication system according to claim 1. The face authentication device,
In response to the detection that the person has entered the face detection area set in the captured image of the camera, detection of the face image of the person is started,
An entry / exit authentication system according to claim 2 or 3. The face detection area is set within a range of a predetermined distance from the entrance,
An entry / exit authentication system according to claim 4. The face detection area further has a size for one person appearing in the captured image of the camera,
An entry / exit authentication system according to claim 5. The camera is arranged at a position where both the entrance and a person approaching the entrance are included in the angle of view.
The entry / exit authentication system according to claim 1. The camera is arranged at a position where a person approaching the entrance is included in the angle of view.
The entry / exit authentication system according to claim 1. An entry / exit authentication method using an entry / exit authentication system in which a face authentication device and an entry / exit management device are communicably connected,
The face authentication device,
Based on a captured image of a camera that captures a person located near the entrance of the management target area, detects whether the person is facing the entrance, and sends the detection result to the entrance / exit management device,
The access control device,
Based on the detection result sent from the face authentication device, when it is detected that the person faces the entrance, the person is a person who is allowed to enter or leave the management target area. According to the determination result of whether or not to control the opening and closing state of the entrance,
Entry and exit authentication method.

Images