JP7407432B2 - Facial recognition system and method - Google Patents

Description

The present invention relates to a face authentication system and a face authentication method that performs face authentication based on facial images of facility users and also performs body temperature measurement to obtain body temperature information of the users.

2. Description of the Related Art In recent years, for the purpose of ensuring safety and maintaining confidentiality, systems have become widespread that perform personal authentication on persons attempting to enter a specific area and restrict the entry of persons other than those who have been registered in advance. On the other hand, from the perspective of preventing the spread of infectious diseases such as the new coronavirus infection (COVID-19), the body temperature of people attempting to enter a specific area is monitored as a health check, and if there is an abnormality in body temperature, It is desirable to notify the person of this fact and, in some cases, to refuse entry to the person.

As technology related to such a system that performs personal authentication and body temperature monitoring, conventional security gates installed at the entrances of office buildings authenticate users using IC cards and use infrared sensors. If the user's body temperature is normal, the security gate door will be opened; if the user's body temperature is abnormal, the security gate door will be closed. There is a known technology that maintains the road and prevents users from passing through it (see Patent Document 1).

In addition, at the entrance of food factories, etc., facial recognition is performed based on facial images taken of people's faces, and sensors such as thermal cameras are used to measure people's body temperature to check whether the user's body temperature is normal. There is a known technology in which the door is unlocked in some cases, and if the user's body temperature is abnormal, the door is kept locked to prevent the user from entering (Patent Document 2). reference).

Japanese Patent Application Publication No. 2011-085004 International Publication No. 2020/050397

By the way, in conventional technology, it is determined whether or not a user is allowed to pass or enter based on the results of both personal authentication (card authentication and face authentication) and body temperature monitoring. On the other hand, depending on the system, there is a desire to change the conditions for determining whether or not a user is allowed to pass or enter based on the results of personal authentication or body temperature monitoring, as appropriate depending on the situation. In particular, regarding body temperature monitoring, for example, if conditions for determining body temperature abnormalities are set for each individual, or if a security gate is installed at the entrance of a multi-tenant building where multiple companies share the same building, companies may Conceivable operations include determining whether or not body temperature monitoring is to be performed depending on , no consideration has been given to the system in which facial recognition is operated after announcing the conditions for body temperature monitoring and obtaining consent.

Therefore, the main purpose of the present invention is to provide a face recognition system and a face recognition method that can operate face recognition after notifying the user of the conditions for body temperature monitoring and obtaining their consent. shall be.

The face authentication system of the present invention is a face authentication system that performs face authentication based on a facial image of a user to control passage through a gate device of a facility and body temperature determination based on body temperature information of the user. a registration unit that performs processing to obtain the user's consent to obtain the body temperature information and refuse passage through the gate device if the body temperature information is determined to be abnormal; and a registration unit that acquires a facial image for registration of the user; a face management unit that stores the facial image for registration; one or more face authentication units that acquires the facial image for authentication of the user and the body temperature information during facial authentication ; and the facial image for registration. a face verification unit that performs a face verification process with the authentication face image and a body temperature determination process to determine whether or not the body temperature information is abnormal; A request for the face matching process and the body temperature determination process including the face image and the body temperature information is transmitted to the face matching unit, and the face matching unit sends the face matching result and the body temperature determination result to the face as a response to the request. further configured to send a control signal to the gate device to open the door when the face matching result is successful and the body temperature determination result is normal; shall be.

Further, the face authentication method of the present invention is a face authentication method in which a server device performs facial authentication based on a facial image of a user to control passage through a gate device of a facility and body temperature determination based on body temperature information of the user. The system performs processing to obtain the user's consent to obtain the body temperature information during face authentication and to refuse passage through the gate device if the body temperature information is determined to be abnormal, and also to obtain the user's consent for the registration of the user's face for registration. acquires an image, stores the facial image for registration, acquires the facial image for authentication of the user and the body temperature information from the face authentication device at the time of face authentication , and stores the facial image for registration and the facial image for authentication. The face matching process includes the face image for authentication and the body temperature information obtained from the face authentication device, by performing a face matching process with a face image and a body temperature determination process to determine whether or not the body temperature information is abnormal. and as a response to the request for the body temperature determination process, the face verification result and the body temperature determination result are transmitted to the face authentication machine, and the face verification machine transmits the face verification result if the face verification result is successful and the body temperature determination result is normal. Then, a control signal for opening the door is transmitted to the gate device .

According to the present invention, it is possible to notify the user of the conditions for body temperature monitoring and obtain their consent, and then perform facial authentication and body temperature determination to control passage through the gate device of the facility .

Overall configuration diagram of a face recognition system according to this embodiment Front view showing the appearance of face recognition device 1 Block diagram showing the schematic configuration of face recognition device 1 Explanatory diagram showing an overview of the processing performed by the face authentication device 1 and the face matching server 6 Block diagram showing the schematic configuration of registration machine 2 Block diagram showing a schematic configuration of the face management server 5 Block diagram showing a schematic configuration of the face matching server 6 Sequence diagram showing the operation procedure of the registration machine, face management server 5, and face matching server 6 during user registration Explanatory diagram showing the screen displayed on the display 42 of the registration machine 2 at the time of user registration Sequence diagram showing the operation procedure of the face authentication device 1 and the face matching server 6 during face authentication Sequence diagram showing the operation procedure of the face authentication device 1 and the face matching server 6 during face authentication Explanatory diagram showing a screen displayed on the display 14 of the face authentication device 1 Explanatory diagram showing the settings screen displayed on the management terminal 4

A first invention made to solve the above problem is a face authentication system that performs facial authentication based on a facial image of a user and body temperature determination based on body temperature information of the user to control passage through a gate device of a facility. In addition, processing is performed to obtain the user's consent regarding the acquisition of the body temperature information at the time of face authentication and refusal of passage through the gate device if the body temperature information is determined to be abnormal. a registration unit that acquires a face image; a face management unit that stores the face image for registration; and one or more face authentication units that acquires the user's authentication face image and the body temperature information during face authentication ; a face matching unit that performs a face matching process between the registration face image and the authentication face image and a body temperature determination process to determine whether or not the body temperature information is abnormal; , transmits a request for the face matching process and the body temperature determination process including the acquired facial image for authentication and the body temperature information to the face matching unit, and the face matching unit sends a face matching result as a response to the request. and sends the body temperature determination result to the face authentication unit, and furthermore, the face authentication unit opens the door to the gate device when the face verification result is successful and the body temperature determination result is normal. The configuration is such that a control signal is transmitted .

According to this, after informing users of the conditions for body temperature monitoring and obtaining their consent, facial recognition and body temperature determination can be performed to control passage through the gate device of the facility .

Further, the second invention further includes a settings management unit that manages settings related to the conditions of the body temperature determination process according to an operation by an administrator or a user, and the settings management unit Depending on the operation, settings regarding an abnormality range when determining an abnormality in the body temperature information are configured as a condition for the body temperature determination process .

According to this, the administrator or the user can customize the conditions for body temperature determination processing as appropriate, and can set the abnormality range when determining abnormality in body temperature. Thereby, for example, by setting the abnormal range of body temperature for each user, it is possible to suppress the occurrence of erroneous determinations due to individual differences in body temperature determination.

Further, in a third aspect of the present invention, the setting management unit sets, as a condition for the body temperature determination process , a period for performing the body temperature determination process on the acquired body temperature information, in response to an operation by an administrator or a user. composition.

According to this, the body temperature determination process can be performed only during a period when a health check based on body temperature is necessary, for example, during an epidemic period of an infectious disease.

Further, a fifth invention is a face authentication method in which a server device performs facial authentication based on a facial image of a user to control passage through a gate device of a facility and body temperature determination based on body temperature information of the user, comprising: Processing is performed to obtain the user's consent to obtain the body temperature information during face authentication and to refuse passage through the gate device if the body temperature information is determined to be abnormal, and also to obtain the user's facial image for registration. acquires the facial image for registration, stores the facial image for registration, acquires the facial image for authentication of the user and the body temperature information from the face authentication device at the time of face authentication , and stores the facial image for registration and the facial image for authentication. and a body temperature determination process to determine whether or not the body temperature information is abnormal. As a response to the request for body temperature determination processing, the face verification result and the body temperature determination result are transmitted to the face authentication machine, and the face verification machine, if the face verification result is successful and the body temperature determination result is normal, A control signal for opening the door is transmitted to the gate device .

According to this, similar to the first invention, after informing the user of the conditions for body temperature monitoring and obtaining consent, facial recognition and body temperature determination are performed to control passage through the gate device of the facility. can do .

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is an overall configuration diagram of a face authentication system according to this embodiment.

This face authentication system includes a face authentication device 1 (face authentication device, face authentication section), a registration device 2 (face authentication registration device, registration section), a face authentication server 3 (server device), a management terminal 4, It is equipped with The face authentication server 3 includes a face management server 5 (server device, face management section) and a face verification server 6 (server device).

The face authentication device 1, the registration device 2, the management terminal 4, the face management server 5, and the face verification server 6 are connected via a network such as the Internet. A facial recognition system is constructed for each facial recognition service provider (operator). A plurality of facial recognition devices 1 are installed at each location where facial recognition is required, such as at the entrance of a building or a room. The registration machine 2 is placed at a reception counter or the like where visitors to the facility are accepted. A required number of face verification servers 6 are provided depending on the number of face authentication machines 1 and the like.

The face authentication device 1 photographs the user (person to be authenticated) to obtain a facial image for authentication, sends the facial image to the face matching server 6 for face matching, and receives the face from the face matching server 6. Acquire the matching results and present the face matching results to the user.

The registration device 2 photographs the user's face and obtains a facial image for registration in response to the user's operation. The facial image for registration acquired by the registration device 2 is registered in the face management server 5. Further, facial feature amounts extracted from the registration facial image are registered in the face matching server 6.

The management terminal 4 is operated by an administrator, is composed of a PC, and has a management application installed thereon that manages the operations of the face authentication device 1, the registration device 2, the face management server 5, and the face matching server 6. This management application allows administrators to perform various management tasks.

The face management server 5 manages information regarding registered users, specifically, information such as the user's name and face image. The face management server 5 also manages information regarding the face authentication device 1, specifically, information such as the device ID and installation location of the face authentication device 1, and processing conditions for the face authentication device 1. The face management server 5 also manages information regarding the face matching server 6, specifically, information such as the association between the face authentication device 1 and the face matching server 6, and processing conditions for the face matching server 6.

At the time of face authentication, the face matching server 6 acquires the face image of the user (person to be authenticated) from the face authentication device 1, generates the user's facial features from the face image, and generates facial features of the user. The user is identified by performing face verification by comparing the feature amount with the facial feature amount of the registrant (registered person) stored in the device itself.

Furthermore, prior to face authentication, the face verification server 6 acquires a user's face image from the management terminal 4 at the time of user registration, generates facial features from the face image, and stores it in its own device. Note that it is also possible to obtain a photographed image of the user from the management terminal 4 and to obtain a facial image from the photographed image in the face matching server 6.

The external device 7 is a gate device (security gate) installed at the entrance of a building, or a door lock device installed at the entrance door of an office or a conference room. Opening and closing of the gate device as the external device 7 is controlled by a face authentication machine 1 (room entry checker) attached to the gate device. The unlocking and locking of the door lock device as the external device 7 is controlled by a face authentication machine 1 (gate checker) provided at the entrance of an office or a conference room.

Note that in this embodiment, the face management server 5 and the face matching server 6 are configured as physically different information processing devices, but the functions of the face management server 5 and the face matching server 6 are simple. It may be realized by one information processing device.

Further, in this embodiment, the management terminal 4 and the face management server 5 are provided, but the management terminal 4 and the face management server 5 can be configured by a single information processing device. For example, by installing a management application on the face management server 5, the face management server 5 can also serve as the management terminal 4.

Furthermore, in this embodiment, facial feature amounts are matched as face matching, but face matching is not limited to matching facial feature amounts, and a matching method using machine learning or the like may be adopted. . Furthermore, this embodiment can be applied to biometric authentication other than face authentication.

Next, the appearance of the face authentication device 1 will be explained. FIG. 2 is a front view showing the appearance of the face authentication device 1. As shown in FIG. Figure 2 (A) is an example of a facial recognition machine 1 (entrance checker) installed at the entrance of an office or conference room, and Figure 2 (B) is an example of a gate device (security gate) installed at the entrance of a building. ) is an example of a face authentication machine 1 (gate checker) installed in

The face recognition machine 1 (room entry checker) shown in Figure 2 (A) is a wall-mounted type installed on the wall near the entrance of an office or conference room, and performs facial recognition when entering the office or conference room. . This face authentication device 1 includes a face authentication camera 11 (a sensor for face authentication), a thermal camera 12 (a sensor for temperature detection), a distance camera 13 (a sensor for measuring distance), and a display 14 (a display section). ).

The face authentication camera 11 photographs a user (person to be authenticated) as a subject. The face authentication camera 11 is an RGB camera (visible light camera) equipped with a visible light image sensor, and outputs an RGB image (color image) as a face authentication image.

The thermal camera 12, like the face authentication camera 11, photographs a user (person to be authenticated) as a subject. This thermal camera 12 is equipped with a far-infrared imaging device, and measures the temperature of a subject by detecting the strength of far-infrared rays, and a temperature image (temperature detection image) in which information regarding the temperature of the subject is stored in pixel units. ) is output.

The distance camera 13 measures the distance to the user as the subject. This distance camera 13 is a stereo camera (3D camera) equipped with two visible light cameras 13a and 13b above and below, and an internal processor (not shown) outputs output from the left and right visible light cameras 13a and 13b. Stereo distance measurement is performed based on the parallax between the left and right visible images, and 3D information (3D position information of the subject), specifically, a distance image in which information regarding the distance to the subject is stored in pixel units. (distance information). Further, the distance camera 13 includes a projector 13c that projects near-infrared rays for calibration. Note that the visible light camera can also detect near-infrared light.

The display 14 displays the progress status of face authentication, the face authentication results, etc., and allows the user (person to be authenticated) to check them. Note that a speaker may be provided as an output unit for outputting the user's authentication result, and the user may be notified of the face authentication result or the like by voice.

The face authentication machine 1 (gate checker) shown in FIG. 2(B) is installed in a gate device (security gate) as an external device 7 installed at the entrance of a building. In this case, the face authentication device 1 includes a face authentication camera 11, a thermal camera 12, and a distance camera 13, like the face authentication device 1 shown in FIG. 2(A), but the display 14 is omitted.

In addition, in order to perform facial recognition when entering an appropriate place, a stand-type facial recognition device 1 placed on the floor is also possible. In this case, a facial recognition camera 11, a thermal camera 12, and a distance It can also be configured to include a camera 13 and a display 14.

In addition, in this embodiment, the face authentication camera 11 shoots a face authentication image (visible image) using a visible light image sensor, but it is also capable of detecting infrared rays so that face authentication can be performed even in dark conditions. The configuration may include an image sensor. In this case, the face authentication camera 11 can also serve as the thermal camera 12. At this time, according to the signal processing method for the output of the image sensor, an infrared image suitable for face authentication (image recognition) is generated as a face authentication image, and an infrared image suitable for temperature detection is generated as a temperature image. can do.

Further, in this embodiment, a stereo camera type distance camera 13 is used, but the method is not particularly limited as long as it can measure the distance to the face of the person to be measured, and for example, TOF (Time Of Flight). A type sensor may also be used.

Next, a schematic configuration of the face authentication device 1 will be explained. FIG. 3 is a block diagram showing a schematic configuration of the face authentication device 1. As shown in FIG. FIG. 4 is an explanatory diagram showing an overview of the processing performed by the face authentication device 1 and the face matching server 6.

The face authentication device 1 includes a face authentication camera 11, a thermal camera 12, a distance camera 13, and a display 14, as well as a communication section 15, a control signal transmission section 16, a storage section 17, and a control section 18. We are prepared.

The communication unit 15 communicates with the face management server 5 via the network. Furthermore, the communication unit 15 communicates with the face matching server 6 via the network.

The control signal transmitter 16 transmits signals to an external device 7, specifically, a door lock device installed at the entrance door of an office or conference room, or a gate device (security gate) installed at the entrance of a building. A control signal is sent to control its operation.

The storage unit 17 stores control programs and the like executed by the processor that constitutes the control unit 18. The storage unit 17 also stores a face authentication image taken by the face authentication camera 11 and a face image extracted from the face authentication image.

The control unit 18 includes a face image extraction unit 21, a face matching request unit 22, a result notification unit 23, an external cooperation unit 24, a measurement target region information acquisition unit 25, and a body temperature measurement unit 26. . This control section 18 is composed of a processor, and each section of the control section 18 is realized by executing a program stored in the storage section 17 with the processor.

The face image extraction unit 21 acquires a face authentication image taken of the user by the face authentication camera 11, detects a person's face from the face authentication image, and cuts out a facial area, thereby identifying the user's face. Obtain a face image.

The face matching request unit 22 transmits a face matching request to the face matching server 6 through the communication unit 15.

The result notification unit 23 notifies the user of the face verification result and body temperature determination result by displaying the face verification result and body temperature determination result acquired from the face verification server 6 by the communication unit 15 on the display 14 .

The external cooperation unit 24 performs control in cooperation with the external device 7 (door lock device or gate device) based on the user's face verification result obtained from the face verification server 6. Specifically, the control signal transmitter 16 is controlled to transmit a control signal that causes the external device 7 to perform a required operation.

The measurement target part information acquisition section 25 includes a correspondence processing section 31 , a position acquisition section 32 , and a distance measurement section 33 .

The correspondence processing unit 31 calculates the temperature based on the distance image acquired by the distance camera 13 and calibration information acquired in advance, specifically, information regarding the positional relationship between the face authentication camera 11 and the thermal camera 12. Correlation information that associates a position on the image with a position on the face authentication image is generated. With this association information, it is possible to correct a positional shift on the image based on parallax between the face authentication image and the temperature image depending on the distance between the face authentication camera 11 and the thermal camera 12.

The position acquisition unit 32 acquires the position of the measurement target region on the face authentication image based on the position of the face area on the face authentication image acquired by the face detection performed by the face image extraction unit 21, and Based on the position of the measurement target part on the authentication image and the association information acquired by the association processing unit 31, the position of the measurement target part on the temperature image is acquired.

Here, in this embodiment, a part of the face area, for example, the forehead area and the area around the eyes, is the measurement target site. At this time, the eyes may be detected from the face image, and the portion above the eyes in the face image may be determined as the forehead portion. Furthermore, a predetermined range centered around the eye may be defined as the peripheral area of the eye.

Furthermore, if the user wears glasses, the temperature around the eyes cannot be detected accurately. Furthermore, if the user's forehead is hidden by the user's hair, the temperature of the forehead cannot be detected accurately. Therefore, a priority is set for the measurement target part, and it is determined whether the measurement target part is in a state where the temperature can be accurately detected.If the measurement target part with a high priority is not in a state where the temperature can be accurately detected, In this case, the temperature of the next ranked measurement target site may be acquired.

For example, the area around the eyes is ranked first, the forehead area is ranked second, and the cheek area is ranked third. Then, it is determined whether or not the user is wearing glasses, and if the user is not wearing glasses, the peripheral part of the eye ranked first is set as the measurement target part. On the other hand, if the user wears glasses, it is determined whether or not the forehead is hidden by hair, etc., and if the forehead is not hidden by hair, the forehead part of the second rank is the measurement target. Part. On the other hand, if the forehead part is hidden by hair or the like, the third ranking cheek part is set as the measurement target part. In this case, in order to suppress the influence of differences in the measurement target parts, the measured value may be corrected based on the standard temperature difference between the forehead, the area around the eyes, and the cheek area.

In addition, to determine whether or not a person is wearing glasses or whether or not the forehead is hidden by hair or the like, image recognition may be used to detect objects such as glasses or hair. If the wearer wears a mask, the temperature around the eyes will be abnormally low, and if the forehead is covered by hair, the temperature of the forehead will be abnormally low, so it may be detected. Based on the temperature, it may be determined whether the user is wearing glasses or whether the forehead is hidden by hair or the like.

Alternatively, the temperature of the body surface portion that is not covered by the user's hair or what the user is wearing (glasses, mask, etc.) may be detected as the measurement target site. In this case, the temperature will be abnormally low in areas covered by hair or clothing, so if the detected temperature is abnormally low, it will be determined that it is not the body surface temperature, and the area will be measured excluding that area. Detects temperature as a target part.

Alternatively, the entire face area may be the measurement target site. In this case, the highest temperature within the face area may be acquired. Further, the temperature of the face area may be statistically processed. For example, the most frequent temperature value of the face area may be acquired.

The distance measuring unit 33 acquires the distance to the measurement target site based on the distance image acquired by the distance camera 13.

The body temperature measurement section 26 includes a temperature detection section 35 and a temperature correction section 36.

The temperature detection section 35 performs measurement by detecting the temperature of the measurement target region on the temperature image based on the position of the measurement target region on the temperature image acquired by the position acquisition section 27 of the measurement target region information acquisition section 25. Obtain the temperature of the target area.

The temperature correction unit 36 corrects the measured value of the temperature of the measurement target site acquired by the temperature detection unit 35 based on the distance from the thermal camera 12 to the measurement target site acquired by the distance measurement unit 33. Specifically, the measured value of temperature is corrected by the correction width corresponding to the distance using a mathematical formula or table showing a characteristic that the temperature correction width becomes larger as the distance becomes longer. The corrected temperature of the measurement target site acquired by the body temperature correction unit 92 is transmitted to the face matching server 6 as body temperature information.

Note that in this embodiment, the measurement target part information acquisition unit 25 of the face authentication device 1 acquires the position of the measurement target part on the temperature image based on the face authentication image and the distance image. The processing of the information acquisition unit 25 may be performed by the face matching server 6. Furthermore, in this embodiment, the body temperature measurement section 26 of the face authentication device 1 acquires the temperature of the measurement target region based on the position of the measurement target region on the temperature image, but the processing of the body temperature measurement section 26 is The face matching server 6 may also perform this.

Furthermore, in this embodiment, the body temperature of a person is measured without contact based on the temperature image acquired by the thermal camera 12 of the face authentication device 1, but the temperature detected from this temperature image is the body surface temperature, Since the deep body temperature is different from the accurate body temperature, a process may be performed to correct the body surface temperature detected from the temperature image to the deep body temperature.

Next, a schematic configuration of the registration device 2 will be explained. FIG. 5 is a block diagram showing a schematic configuration of the registration device 2. As shown in FIG.

The registration device 2 includes a face photographing camera 41, a display 42 (display section), a communication section 43, a storage section 44, and a control section 45. Note that this registration device 2 can be configured by installing an application for face authentication registration on a tablet terminal.

The face photographing camera 41 can acquire a photographed image of the user (registration target person) by photographing the user's face.

The display 42 displays a screen (see FIG. 9) that guides the user through the registration procedure. Further, by configuring the display 42 with an integrated touch panel, the user can operate the screen by touch operation. Note that the registration machine 2 may be provided with a speaker to provide voice guidance to the user about the registration procedure and the like.

The communication unit 43 communicates with the face management server 5 via the network.

The storage unit 44 stores a control program executed by a processor constituting the control unit 45, and the like.

The control unit 45 includes a face image extraction unit 46, a registration request unit 47, and a GUI control unit 48. This control section 45 is composed of a processor, and each section of the control section 45 is realized by executing a program stored in the storage section 44 with the processor.

The face image extraction unit 46 obtains a photographed image of the user from the face photographing camera 41, detects a person's face from the photographed image, and cuts out a facial area from the photographed image, thereby extracting the user's face image. get.

The registration request unit 47 transmits a user registration request to the face management server 5 through the communication unit 43.

The GUI control unit 48 displays various guidance screens for the user distributed from the face management server 5 on the display 42. Further, in response to a user's input operation using the input function of the display 42 (here, a touch panel), input information is acquired and screen control is performed.

Note that the registration machine 2 is equipped with a card photography camera that photographs cards such as business cards and employee ID cards presented by the user, and the user's specific information (such as name) included in the image taken by this card photography camera. It is also possible to obtain a face image or the like. Further, a non-contact reader may be used to acquire specific information written on a user's IC card or RF tag or a facial image.

Next, a schematic configuration of the face management server 5 will be explained. FIG. 6 is a block diagram showing a schematic configuration of the face management server 5. As shown in FIG.

The face management server 5 includes a communication section 51, a storage section 52, and a control section 53.

The communication unit 51 communicates with the face authentication device 1 via the network. Further, the communication unit 51 communicates with the registration machine 2 . It also communicates with the management terminal 4 via the network. Further, the communication unit 51 communicates with the face matching server 6.

The storage unit 52 stores a control program executed by a processor constituting the control unit 53, and the like. The storage unit 52 also stores registration information of the face information database. In the face information database, the user's name, face image, etc. are registered as information regarding the registered user. Note that the user's face image may be stored in an encrypted state to protect privacy.

The control section 53 includes a user management section 61, a face information management section 62, and a setting management section 63. This control section 53 is composed of a processor, and each section of the control section 53 is realized by executing a program stored in the storage section 52 with the processor.

The user management unit 61 manages information regarding the user, such as a face image for registration of the user and specific information (name, etc.).

The settings management section 63 includes a face authentication device management section 64 and a face verification server management section 65.

The face authentication device management unit 64 manages settings related to processing conditions and the like of the face authentication device 1 in accordance with the administrator's operations on the management terminal 4 and the user's operations on the face authentication device 1. In the present embodiment, as processing conditions for the body temperature measurement unit 26 (see FIGS. 3 and 4) of the face authentication device 1, conditions regarding whether or not to perform body temperature measurement, conditions regarding the period during which body temperature measurement is performed, etc. are set.

The face matching server management unit 65 manages settings regarding processing conditions and the like of the face matching server 6 in response to operations by the administrator on the management terminal 4 and operations by the user on the face authentication device 1. In this embodiment, the processing conditions of the body temperature determination unit 76 (see FIGS. 4 and 7) of the face verification server 6 include conditions regarding the processing content of body temperature determination (such as an abnormal range), conditions regarding the implementation period of body temperature determination, etc. Set.

Next, a schematic configuration of the face matching server 6 will be explained. FIG. 7 is a block diagram showing a schematic configuration of the face matching server 6. As shown in FIG.

The face verification server 6 includes a communication section 71, a storage section 72, and a control section 73.

The communication unit 71 communicates with the face authentication device 1 via the network. Furthermore, the communication unit 71 communicates with the face management server 5 via the network.

The storage unit 72 stores a control program executed by a processor constituting the control unit 73, and the like. The storage unit 72 also stores registration information of the face matching database. In the face matching database, as information regarding the user (registered person), facial feature amounts of registered persons, etc., with which the facial feature amounts of the person to be authenticated are compared during face matching, are registered.

The control unit 73 includes a face verification unit 75, a body temperature determination unit 76, and an authentication log management unit 77. This control section 73 is composed of a processor, and each section of the control section 73 is realized by executing a program stored in the storage section 72 with the processor.

The face verification section 75 includes a facial feature generation section 81 , a facial feature management section 82 , and a facial feature verification section 83 .

The facial feature amount generation unit 81 detects facial feature points from the registration face image and the authentication face image and generates facial feature amounts at the time of user registration and face authentication.

The facial feature amount management section 82 registers the user's facial feature amount generated by the facial feature amount generation section 91 in the face matching database at the time of user registration.

At the time of face authentication, the facial feature matching unit 83 combines the facial features of the user (person to be authenticated) generated from the facial image for authentication acquired from the face authentication device 1 and the user's (registered person) stored in its own device. The user (person to be authenticated) is identified by comparing the facial features of the person who has been authenticated.

The body temperature determination unit 76 determines whether or not the user's body temperature is abnormal, that is, whether there is a possibility of fever based on the body temperature information (temperature of the part to be measured) acquired from the face authentication device 1. do. Specifically, abnormality in body temperature is determined depending on whether the temperature of the measurement target site is included in an abnormal range (heat generation range). In this embodiment, the abnormal range of body temperature is set based on the normal body temperature (normal body temperature) input in advance by the user identified in the face matching process. Specifically, a value obtained by adding a predetermined value (for example, 0.5 degrees or 1.0 degrees) to the normal temperature is set as the threshold value that is the lower limit of the abnormal range. Then, if the temperature of the part to be measured is included in the abnormal range, that is, if the temperature of the part to be measured is equal to or higher than the threshold value, it is determined that the body temperature is abnormal.

When the face authentication device 1 makes a request for face authentication to its own device, the authentication log management unit 77 collects the information at that time, such as the device ID of the face authentication device 1 that made the request for face authentication, the face matching result, etc. The information is stored in the storage unit 72 as an authentication log. Further, in response to a request from the face management server 5, the authentication log is provided to the face management server 5.

Note that in this embodiment, the body temperature determination section 76 of the face verification server 6 determines whether or not the user's body temperature is abnormal. It may also be done in

By the way, in this embodiment, the position of the measurement target part on the temperature image is acquired based on the position of the measurement target part on the face authentication image and the correspondence information, and the position of the measurement target part on the temperature image is acquired. Although the temperature of the measurement target site is acquired by detecting the temperature of the measurement target site on the temperature image based on the position, the present invention is not limited to this method.

For example, the temperature of the measurement target area is obtained by performing image processing to correct the overall deviation of the temperature image with respect to the face recognition image, and then detecting the temperature of the measurement target area on the temperature image. Good too. That is, based on the association information, image processing is performed to convert the temperature image into a state seen from the same viewpoint as the face authentication image, and image processing is performed based on the position of the measurement target part on the face authentication image. The temperature of the measurement target site is obtained by detecting the temperature of the measurement target site on the temperature image.

Next, the operating procedures of the registration machine 2, face management server 5, and face matching server 6 during user registration will be explained. FIG. 8 is a sequence diagram showing the operation procedure of the registration machine 2, face management server 5, and face matching server 6 during user registration.

In the registration machine 2, first, screens (see FIGS. 9A to 9E) on which the user performs user registration operations are sequentially displayed. When the user performs necessary operations on these screens, the registration device 2 transmits a request for user registration to the face management server 5. This user registration request includes an image of the user's face, information regarding normal body temperature, and information indicating that the user has agreed to the personal information handling regulations.

Upon receiving the user registration request from the registration device 2, the face management server 5 transmits a face registration request to the face matching server 6. This face registration request includes the user's face image.

Upon receiving the face registration request from the face management server 5, the face matching server 6 performs face registration processing. In this face registration process, facial features are generated from the user's face image, and the facial features are registered in the face matching database. Then, the face registration response is sent to the face management server 5.

Upon receiving the face registration response from the face matching server 6, the face management server 5 performs registration processing regarding the user if the processing at the face matching server 6 has been completed normally. In this registration process, the user information acquired from the registration device 2 is registered in the face information database. Then, a user registration response (completion report) is transmitted to the registration machine 2.

When the registration device 2 receives the user registration response from the face management server 5, it displays a registration completion screen (see FIG. 9(F)). Furthermore, the registration device 2 deletes the user's facial image and temperature information related to normal body temperature held in its own device.

Next, a user registration operation performed by the registration machine 2 will be explained. FIG. 9 is an explanatory diagram showing a screen displayed on the display 42 of the registration machine 2 at the time of user registration. Here, a case will be described in which the user (person for user registration) himself/herself operates the screen, but it is also possible for a person in charge of user registration to operate the screen.

First, the screen (initial screen) shown in FIG. 9(A) is displayed on the display 42 of the registration machine 2. A registration start button 101 is provided on the screen shown in FIG. 9(A). When the user operates this registration start button 101, the screen changes to the one shown in FIG. 9(B).

The screen shown in FIG. 9(B) allows the user to confirm the personal information handling regulations. On this screen, characters 102 representing personal information handling regulations in the face authentication system are displayed. The personal information handling regulations state that a facial image of the user is to be obtained by photographing the user's face at the time of registration and authentication, and that body temperature information is to be obtained by measuring the user's body temperature at the time of authentication. Further, this screen is provided with an agree button 103 and a cancel button 104. The user operates the consent button 103 or the cancel button 104 depending on whether or not he or she agrees to the personal information handling regulations. When the user operates the consent button 103, the screen changes to the one shown in FIG. 9(C). When the user operates the cancel button 104, user registration is canceled.

The screen shown in FIG. 9(C) allows the user to input their normal body temperature (normal body temperature). This screen includes characters 105 prompting the user to enter their normal body temperature, a body temperature display field 106 that displays the entered normal body temperature, a numeric keypad 107 for inputting the normal body temperature, a register button 108, and a skip button 109. and is provided. When a numerical value is selected by operating the numeric keypad 107, the selected numerical value is displayed in the body temperature display column 106. The user checks the numerical value displayed in the body temperature display field 106 and operates the registration button 117 if there is no error. As a result, the normal temperature is registered with the input value, and the screen changes to the one shown in FIG. 9(D). The skip button 109 is used to omit inputting the normal body temperature, and when the user operates this skip button 109, the screen changes to the next screen shown in FIG. 9(D) without inputting the normal body temperature.

In addition, on the screen shown in Figure 9(C), in order to set the abnormal body temperature range for each user based on the normal body temperature, the user is asked to input each person's normal body temperature (body temperature at normal times). It is also possible to uniformly set a predetermined value (for example, 37.5 degrees) or more as the abnormal range.

The screen shown in FIG. 9(D) allows the user to take a facial image. On this screen, characters 111 explaining the procedure for photographing a face image, a photographing frame 112, and a photographed image 113 are displayed. The photographed image 113 is an image photographed by the face authentication camera 11, and is displayed within the photographing frame 112. The user looks at the photographed image 113 displayed within the photographing frame 112 and adjusts the position and orientation of the user's face so that the user's face is appropriately photographed. Further, this screen is provided with a shooting button 114 and a cancel button 115. When the user operates the photographing button 114, the face authentication camera 11 of the registration device 2 photographs the user. When the user operates the cancel button 115, user registration is canceled. When the photographing of the face image by the face authentication camera 11 is completed normally, the screen changes to the one shown in FIG. 9(E).

The screen shown in FIG. 9(E) allows the user to confirm the facial image. On this screen, characters 116 prompting the user to confirm whether or not the face image has been appropriately photographed, and a photographed image (face image) 113 are displayed. Further, this screen is provided with a registration button 117, a reshoot button 118, and a cancel button 119. If the user's face is properly photographed, the user operates the registration button 117. In this case, the screen changes to a registration completion screen shown in FIG. 9(F). If the user's face is not properly photographed, the user operates the re-photographing button 118. In this case, the screen returns to the screen that allows the user to take a face image (see FIG. 9(D)). When the user operates the cancel button 119, user registration is canceled.

The screen shown in FIG. 9(F) notifies the user that registration has been completed. This screen is provided with an end button 120. When the user operates the end button 120, the registration operation in the registration machine 2 ends.

In this embodiment, the user's normal body temperature (normal body temperature) is registered by manual input by the user, but the registration machine 2 is equipped with a thermal camera to record the user's body temperature at the time of user registration. It is also possible to measure the body temperature and register the body temperature as the normal temperature automatically or with the consent of the user.

Next, the operating procedure of the face authentication device 1 and the face verification server 6 when performing face authentication using the face authentication device 1 (gate checker) provided in a gate device (security gate) installed at the entrance of a building will be explained. FIG. 10 is a sequence diagram showing the operating procedure of the face authentication device 1 and the face matching server 6 during face authentication.

In the face authentication device 1, first, when a person is detected from a face authentication image taken by the face authentication camera 11, a face image is acquired from the face authentication image. In addition, the face authentication device 1 acquires a temperature image taken by the thermal camera 12, and measures the temperature of the measurement target region as body temperature based on the temperature image. Then, a request for face verification and body temperature determination is sent to the face verification server 6. This request includes a facial image and body temperature information.

When the face verification server 6 receives a request for face verification and body temperature determination from the face authentication device 1, it retrieves the user's facial features generated from the facial image included in the request and the registrant ( It is determined whether the user is a registrant by comparing the facial features of a registered person (face matching process). Next, when the face verification is successful, the face verification server 6 determines whether or not the user's body temperature is abnormal based on the body temperature information acquired from the face authentication device 1 (body temperature determination process). Then, the face verification and body temperature determination responses are transmitted to the face authentication device 1. This response includes the face verification result and body temperature determination result.

Further, the face matching server 6 stores information such as face matching results (success, failure) and matching scores in a database as an authentication log (facial authentication history information) (authentication log management process).

Upon receiving the face verification and body temperature determination response from the face verification server 6, the face authentication device 1 transmits a control signal to open the door to the gate device as the external device 7 if the face verification is successful. This opens the door of the gate device and allows the user to pass through the gate device. On the other hand, if face verification fails, the door of the gate device remains closed and the user cannot pass through the gate device.

Next, the face authentication device 1 deletes the user's face image and body temperature information held in its own device. By sequentially deleting the authentication information of a user who has completed authentication in this way, the user's personal information can be reliably protected without being confused with the authentication information of an already acquired user at the time of the next authentication. Can be done.

Next, a description will be given of the operating procedure of the face authentication device 1 and the face verification server 6 when performing face authentication using the face authentication device 1 (room entry checker) provided at the entrance of an office or conference room. FIG. 11 is a sequence diagram showing the operating procedure of the face authentication device 1 and the face matching server 6 during face authentication.

In the face authentication device 1, first, a standby screen (see FIG. 12(A)) is displayed on the display 14. Next, when the face authentication device 1 detects a person from the face authentication image taken by the face authentication camera 11, a face image is acquired from the face authentication image. In addition, the face authentication device 1 acquires a temperature image taken by the thermal camera 12, and measures the temperature of the measurement target region as body temperature based on the temperature image. Then, a request for face verification and body temperature determination is sent to the face verification server 6. This request includes a facial image and body temperature information. Furthermore, the face authentication device 1 displays a face authentication screen (see FIG. 12(B)) on the display 14.

When the face verification server 6 receives a request for face verification and body temperature determination from the face authentication device 1, it retrieves the user's facial features generated from the facial image included in the request and the registrant ( It is determined whether the user is a registrant by comparing the facial features of a registered person (face matching process). Next, when the face verification is successful, the face verification server 6 determines whether or not the user's body temperature is abnormal based on the body temperature information acquired from the face authentication device 1 (body temperature determination process). Then, the face matching and body temperature determination responses are transmitted to the face authentication device 1. This response includes the face verification result and body temperature determination result.

Further, the face matching server 6 stores information such as face matching results (success, failure) and matching scores in a database as an authentication log (facial authentication history information) (authentication log management process).

Upon receiving the face verification and body temperature determination responses from the face verification server 6, the face recognition device 1 displays a notification screen for the face recognition results and body temperature determination results on the display 14 (Fig. 12 (C), (D), (E)).

In addition, in the face authentication device 1, when the face verification is successful, a control signal to unlock the door lock device as the external device 7 is transmitted. This unlocks the door lock device and allows the user to open the door and enter the room. On the other hand, if face verification fails, the door lock device remains locked and the user cannot enter the room.

Next, the face authentication device 1 deletes the user's face image and body temperature information held in its own device.

Next, the screen displayed on the display 14 of the face authentication device 1 will be explained. FIG. 12 is an explanatory diagram showing a screen displayed on the display 14 of the face authentication device 1.

Screens shown in FIGS. 12(A) to 12(E) are displayed on the display 14 of the face authentication device 1. These screens are provided with a photographed image display area 121 and an information display area 122. In the photographed image display area 121, an image photographed by the face authentication camera 11 is displayed. Information corresponding to each stage is displayed in the information display area 122. Note that information corresponding to each stage may be displayed in a superimposed manner on the image photographed by the face authentication camera 11 without dividing the display area.

First, a screen (standby screen) shown in FIG. 12(A) is displayed on the display 14 of the face authentication device 1. Here, when a user standing in front of the face recognition device 1 is photographed by the face recognition camera 11, the face verification server 6 performs a process (face verification) to determine whether or not the user is a registered person. ) is started. At this time, the display 14 changes to a screen shown in FIG. 12(B).

The screen shown in FIG. 12(B) informs the user that face authentication (face matching) is in progress. On this screen, characters 131 and graphics 132 are displayed in the information display area 122 to indicate that face authentication is in progress. At this time, the face verification server 6 performs body temperature determination along with face authentication.

Next, when the face authentication and body temperature determination performed by the face verification server 6 are completed, the display 14 of the face authentication machine 1 displays the results shown in FIGS. 12(C), (D), ( Transition to one of the screens shown in E). These screens present information regarding face authentication results, body temperature measurement results, and body temperature determination results to the user.

The screen shown in FIG. 12C is displayed when face authentication is successful and body temperature is determined to be normal. On this screen, in the information display area 122, characters 133 indicating the name of the user identified by face authentication, and characters 134 and a graphic 135 indicating that the face authentication was successful are displayed. Further, on this screen, in the information display area 122, characters 136 indicating the body temperature as the body temperature measurement result and characters 137 indicating that the body temperature is normal as the body temperature determination result are displayed. In this case, the door lock device is unlocked, and the person who has undergone facial recognition can open the door and enter the room.

The screen shown in FIG. 12(D) is displayed when face authentication fails. On this screen, characters 134 and a graphic 135 are displayed in the information display area 122, indicating that face authentication has failed. In this case, the door lock device is not unlocked and remains locked, and a person cannot open the door and enter the room. Note that if face authentication fails, the person whose face was authenticated is unknown, and it is unclear whether the person has consented to the body temperature measurement, so the body temperature measurement result will not be displayed. Additionally, since the normal body temperature of the person whose face has been recognized is unknown, body temperature determination results are also not displayed.

The screen shown in FIG. 12(E) is displayed when the face authentication is successful and the body temperature is determined to be abnormal in the body temperature determination. On this screen, in the information display area 122, characters 133 indicating the name of the user identified by face authentication, and characters 134 and a graphic 135 indicating that the face authentication was successful are displayed. Further, on this screen, in the information display area 122, characters 136 indicating the body temperature as a result of body temperature measurement, and characters 137 indicating that the body temperature is abnormal as a result of body temperature determination are displayed.

Further, in this embodiment, the background color of the information display area 122 changes depending on the result of body temperature determination as to whether or not the body temperature is abnormal. That is, when the body temperature is normal, that is, on the screen shown in FIG. 12(C), the background color of the information display area 122 is displayed in green, and when the body temperature is abnormal, that is, on the screen shown in FIG. 12(E). On the screen, the background color of the information display area 122 is displayed in red.

By the way, when face authentication is successful, there are cases where the body temperature is determined to be normal (see FIG. 12(C)) and cases where the body temperature is determined to be abnormal (see FIG. 12(E)). Here, if it is determined that the body temperature is normal, control may be performed to open the door of the gate device to allow the person to pass through, and to unlock the door lock device to allow the person to enter the room.

On the other hand, if the body temperature is determined to be abnormal, the gate device door will be opened to allow the person to pass, and the door lock device will be unlocked to allow the person to pass through, just as if the body temperature was determined to be normal. Control may be performed to allow people to enter the room, but conversely, control may be performed to deny people passage by keeping the gate device door closed, or denying people entry by keeping the door lock device locked. You can do it like this. In this case, the administrator may be able to select which control to perform. Furthermore, the user may be notified at the time of user registration that if the body temperature is determined to be abnormal, the user will be refused passage through the gate device or enter the room. Specifically, for example, on the screen that allows users to confirm the personal information handling regulations (see Figure 9 (B)), along with the personal information handling regulations, if the user's body temperature is determined to be abnormal, the user is required to pass through the gate device or enter the room. Indicate that the request is rejected.

In addition, if the face recognition machine 1 (room entry checker) installed at the entrance of the office or conference room determines that the body temperature is abnormal, it will indicate that the body temperature is abnormal, as shown in Figure 12 (E). will be notified to the user through screen display. On the other hand, the facial recognition machine 1 (gate checker) installed at the gate device (security gate) installed at the entrance of the building does not have a display, so if the body temperature is determined to be abnormal, The user may be notified by voice.

Next, a setting operation related to body temperature monitoring performed on the management terminal 4 will be explained. FIG. 13 is an explanatory diagram showing a setting screen displayed on the management terminal 4. In this embodiment, the body temperature measurement performed by the face authentication device 1 and the body temperature determination performed by the face matching server 6 are collectively referred to as body temperature monitoring.

On the management terminal 4, by accessing the face management server 5 and logging in in administrator mode, various management screens are displayed, and on the management screen, the administrator can configure various settings regarding the face authentication device 1 and the face matching server 6. operations can be performed. On the setting screen shown in FIG. 13, the administrator can perform setting operations related to body temperature monitoring (body temperature measurement and body temperature determination) for each face authentication device 1.

This setting screen is provided with a face authentication device selection section 141 and a body temperature monitoring selection section 142. In the face authentication device selection unit 141, the administrator can select the target face authentication device 1 (device ID) by selecting from a pull-down menu. In the body temperature monitoring selection section 142, the administrator can select whether or not to perform body temperature monitoring (body temperature measurement) by operating a radio button. It should be noted that a setting may be made such that body temperature measurement is performed but body temperature determination is not performed.

Further, this setting screen is provided with a body temperature display selection section 143, an abnormal range selection section 144, and a monitoring period input section 145 as detailed setting items.

In the body temperature display selection section 143, the administrator can select whether or not to display the body temperature measurement result on the face authentication device 1 by selecting a radio button. Specifically, on the screen displayed on the display 14 of the face authentication device 1 (see FIGS. 12C and 12E), it is possible to select whether or not to display the characters 136 indicating the body temperature measurement result. .

In the abnormal range selection section 144, the administrator can select a method for setting an abnormal range in the body temperature determination process by selecting a radio button. Specifically, either a range set for each user based on the user's input normal temperature, or a range that is equal to or higher than a predetermined value common to all users (for example, 37.5 degrees). , can be selected by the administrator.

In the monitoring period input section 145, the administrator can input a period (start date and end date) for implementing body temperature monitoring by inputting into an input box. Thereby, body temperature monitoring can be performed for a limited period of time. For example, body temperature monitoring can be performed only during periods when an infectious disease is prevalent. Note that it may be possible to specify whether or not to perform the processing and the period for the body temperature measurement performed by the face authentication device 1 and the body temperature determination performed by the face verification server 6 separately.

Further, a registration button 146 is provided on this setting screen. When the administrator operates the registration button 146 after performing necessary selection and input operations on each part of the setting screen, the face management server 5 performs a process of registering information based on the selection and input contents.

Note that a person's body surface temperature changes depending on the location. For example, in the face authentication machine 1 (gate checker) installed in a gate device installed at the entrance of a building, the temperature of the person's body surface is low because the surrounding temperature is low. On the other hand, in the face recognition machine 1 (room entry checker) installed at the entrance of an office or a conference room in a building, the body surface temperature of the person will be high because the surrounding temperature is high. Therefore, it may be possible to set an abnormal range for body temperature determination for each face authentication device 1. For example, the abnormal range for body temperature determination is set low in the face recognition machine 1 installed at the gate device, and the abnormal range for body temperature determination is set high in the face recognition machine 1 installed at the entrance of an office or conference room. Ru.

By the way, in this embodiment, as shown in FIG. 13, processing conditions regarding body temperature monitoring are set for each face authentication device 1. Thereby, appropriate settings can be made depending on the installation location of the face authentication device 1, etc. For example, a face recognition machine 1 installed in a gate device installed at the entrance of a building monitors body temperature, but a face recognition machine 1 installed at the entrance to an office or conference room is set not to monitor body temperature. can do.

On the other hand, the necessity of body temperature monitoring differs depending on the company. Therefore, in the facial recognition machine 1 installed in the gate device installed at the entrance of a multi-tenant building where the same building is shared by multiple companies, processing conditions regarding body temperature monitoring are set for each group of users in each company. It may also be used as a Furthermore, even within the same company, the need for body temperature monitoring varies depending on departments. Therefore, processing conditions related to body temperature monitoring may be set for each group of users, such as a department, in the face authentication machine 1 installed at the entrance of an office or a conference room.

In addition, in this embodiment, in body temperature determination to determine whether or not the body temperature is abnormal, the abnormal range is set based on the normal body temperature. (See FIG. 9(C)). On the other hand, in addition to normal body temperature, the range of fluctuations in body temperature also differs from person to person. Therefore, as a processing condition regarding body temperature monitoring, a predetermined value that is added to the normal body temperature when setting a threshold value that is the lower limit of the abnormal range in body temperature determination may be set for each user. The predetermined value to be added to the normal body temperature may be specified by the user, but may also be specified by the administrator.

Further, in the example shown in FIG. 13, processing conditions regarding body temperature monitoring are set for each face authentication device 1, but processing conditions regarding body temperature monitoring for each user may be set. On the management terminal 4, a management screen for managing various information regarding the user is displayed. On this management screen, new registrations and changes can be made to information such as the user's face image and name, and on this management screen, the administrator can also specify processing conditions regarding body temperature monitoring for each user. good.

Note that setting information regarding processing conditions related to body temperature monitoring is managed by the face management server 5. Specifically, setting information for each user regarding processing conditions related to body temperature monitoring is stored in a face information database stored in the storage unit 52 of the face management server 5. Further, setting information for each face authentication device 1 regarding processing conditions related to body temperature monitoring and setting information for each user group regarding processing conditions related to body temperature monitoring are stored in the storage unit 52 of the face management server 5.

As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments in which changes, replacements, additions, omissions, etc. are made. Furthermore, it is also possible to create a new embodiment by combining the components described in the above embodiments.

INDUSTRIAL APPLICABILITY The face authentication system and face authentication method according to the present invention have the effect of increasing the convenience of the system by allowing an administrator to appropriately customize conditions for body temperature monitoring in addition to face authentication. The present invention is useful as a face authentication system and a face authentication method that performs face authentication based on a user's face image and also measures body temperature to obtain body temperature information of the user.

1 Face recognition machine (face recognition section)
2 Registration machine (registration section)
3 Face authentication server 4 Management terminal 5 Face management server (face management department)
6 Face matching server (face matching section)
26 Body temperature measurement unit 63 Setting management unit 76 Body temperature determination unit

Claims (4)

A facial recognition system that performs facial recognition based on a facial image of a user to control passage through a gate device of a facility and body temperature determination based on body temperature information of the user, the system comprising:
Processing is performed to obtain the user's consent to obtain the body temperature information during face authentication and to refuse passage through the gate device if the body temperature information is determined to be abnormal, and also to obtain the user's facial image for registration. a registration unit to obtain;
a face management unit that stores the face image for registration;
one or more face authentication units that acquire a user's authentication face image and the body temperature information during face authentication ;
a face matching unit that performs a face matching process between the registration face image and the authentication face image, and a body temperature determination process to determine whether or not the body temperature information is abnormal;
The face authentication unit transmits a request for the face matching process and the body temperature determination process including the acquired facial image for authentication and the body temperature information to the face matching unit,
The face matching unit transmits a face matching result and a body temperature determination result to the face authentication unit as a response to the request,
Further, the face authentication unit may transmit a control signal to open the door to the gate device when the face verification result is successful and the body temperature determination result is normal. system. Furthermore, it includes a settings management unit that manages settings related to conditions for the body temperature determination process according to operations by an administrator or a user,
The settings management section includes:
2. The face authentication system according to claim 1, wherein, as a condition for the body temperature determination process , a setting regarding an abnormality range for determining an abnormality in the body temperature information is performed in response to an operation by an administrator or a user. The settings management section includes:
3. The face authentication system according to claim 2, wherein, as a condition for the body temperature determination process , a setting regarding an implementation period of the body temperature determination process for the acquired body temperature information is performed in response to an operation by an administrator or a user. . A face authentication method in which a server device performs facial authentication based on a facial image of a user to control passage through a gate device of a facility and body temperature determination based on body temperature information of the user, the method comprising:
Processing is performed to obtain the user's consent to obtain the body temperature information during face authentication and to refuse passage through the gate device if the body temperature information is determined to be abnormal, and also to obtain the user's facial image for registration. Acquired,
Accumulating the facial images for registration;
At the time of face authentication , the user's face image for authentication and the body temperature information are obtained from the face authentication machine ,
performing a face matching process between the registration face image and the authentication face image, and a body temperature determination process to determine whether or not the body temperature information is abnormal;
transmitting a face matching result and a body temperature determination result to the face authentication machine as a response to a request for the face matching process and the body temperature determination process including the face image for authentication and the body temperature information acquired from the face authentication machine;
The face authentication method is characterized in that the face authentication device transmits a control signal to open the door to the gate device when the face matching result is successful and the body temperature determination result is normal.

Images