JP2022119569A - Face authentication device and face authentication method - Google Patents

Abstract

To accurately acquire the temperature of a measurement object portion as the body temperature for a user when performing face authentication by imaging the user.SOLUTION: A face authentication device acquires an image for face authentication from a camera 11 for face authentication, acquires a temperature image from a thermal camera 12, acquires distance information from a distance camera 13, extracts a face image for authentication used for face authentication from the image for face authentication, generates association information that associates the position on the temperature image with the position on the image for face authentication on the basis of the distance information, acquires a position of a measurement object portion being a portion or all of the face region in the image for face authentication, and acquires the temperature of the measurement object portion on the temperature image as body temperature information on the basis of the portion of the measurement object portion on the image for face authentication and the association information.SELECTED DRAWING: Figure 3

Description

The present invention relates to a face authentication device and a face authentication method for performing processing related to face authentication by photographing a user of a facility and measuring body temperature for acquiring body temperature information of the user.

2. Description of the Related Art In recent years, for the purpose of ensuring safety and maintaining confidentiality, a system has been widely used that performs personal authentication on a person who attempts to enter a specific area and restricts the entry of persons other than pre-registered persons. On the other hand, from the viewpoint of preventing the spread of infectious diseases such as the new coronavirus infectious disease (COVID-19), we monitor the body temperature as a health check for people trying to enter a specific area, and if there is an abnormality in the body temperature, It is desirable to notify the person to that effect and, depending on the case, refuse the person's entry.

As a technology related to a system that performs such personal authentication and body temperature monitoring, conventional security gates installed at entrances of office buildings authenticate users who enter with IC cards and use infrared sensors. If the user's body temperature is normal, the security gate door is opened, and if the user's body temperature is abnormal, the security gate door is closed. is known to prevent the user from passing through (see Patent Literature 1).

In addition, at entrances to food factories, etc., face recognition is performed based on facial images taken of people's faces. In some cases, the door is unlocked, and if the user's body temperature is abnormal, the door is kept locked to prevent the user from entering (Patent Document 2). reference).

JP 2011-085004 A WO2020/050397

By the way, when measuring a person's body temperature in a non-contact manner using a temperature image obtained by a thermal camera, as in the conventional technology, it is necessary to detect the temperature of the part to be measured (for example, the forehead or the area around the eyes) on the temperature image. However, since it is difficult to accurately recognize the position of the measurement target site from the temperature image, there is a problem that the temperature of the measurement target site cannot be accurately measured using only the temperature image.

On the other hand, in the face authentication image captured by the visible light camera to extract the user's face image in face authentication, the position of the measurement target part can be obtained with high accuracy. Therefore, it is conceivable to acquire the position of the measurement target site on the face authentication image, specify the position of the measurement target site on the temperature image based on the information, and acquire the temperature of the measurement target site. However, since the mounting positions of the visible light camera and the thermal camera are shifted, parallax exists between the two images. Therefore, there is a problem that the position of the measurement target site cannot be accurately specified on the temperature image, and the temperature of the measurement target site cannot be accurately measured.

Accordingly, the present invention provides a face authentication device and a face authentication method capable of accurately acquiring the temperature of a measurement target site as body temperature information of a user when performing face authentication by photographing the user. Main purpose.

A face authentication device of the present invention is a face authentication device that photographs a user of a facility, performs processing related to face authentication, and performs body temperature measurement to obtain body temperature information of the user, and includes an image for face authentication, a temperature image, and a temperature image. , and a sensor that acquires distance information, a display, and a processor, wherein the processor extracts an authentication face image used for face authentication from the face authentication image, and based on the distance information , generating correspondence information that associates the positions on the temperature image with the positions on the face authentication image, and acquiring the position of the measurement target part that is part or all of the face region in the face authentication image. and obtaining the temperature of the measurement target site on the temperature image as the body temperature information based on the position of the measurement target site on the face authentication image and the association information.

Further, the face authentication method of the present invention is a face authentication method in which a processor executes a process related to face authentication by photographing a user of a facility and a body temperature measurement process of acquiring body temperature information of the user, to obtain an image for face authentication, a temperature image, and distance information, extract a face image for authentication used in the face authentication from the image for face authentication, and extract a position on the temperature image based on the distance information and a position on the face authentication image to generate correspondence information, acquire the position of the measurement target part that is part or all of the face region in the face authentication image, and obtain the position of the measurement target part on the face authentication image The temperature of the measurement target site on the temperature image is acquired as the body temperature information based on the position of the measurement target site and the association information.

According to the present invention, the position of the measurement target site on the temperature image is acquired with high accuracy based on the association information, and the temperature of the measurement target site is acquired as the body temperature information, so highly accurate body temperature information is acquired. can do.

Overall configuration diagram of the face authentication system according to the present embodiment Front view showing appearance of face authentication device 1 Block diagram showing a schematic configuration of the face authentication machine 1 Explanatory diagram showing an overview of the processing performed by the face authentication device 1 and the face matching server 6 Block diagram showing a schematic configuration of the registration machine 2 Block diagram showing a schematic configuration of the face management server 5 Block diagram showing a schematic configuration of the face matching server 6 Sequence diagram showing operation procedures of registration device, face management server 5, and face matching server 6 at the time of user registration Explanatory diagram showing a screen displayed on the display 42 of the registration device 2 at the time of user registration Sequence diagram showing the operation procedure of the face recognition device 1 and the face matching server 6 at the time of face recognition Sequence diagram showing the operation procedure of the face recognition device 1 and the face matching server 6 at the time of face recognition Explanatory drawing showing a screen displayed on the display 14 of the face authentication machine 1 Explanatory diagram showing a setting screen displayed on the management terminal 4

A first invention made to solve the above problems is a face authentication device that performs processing related to face authentication by photographing a user of a facility and performs body temperature measurement to acquire body temperature information of the user, a sensor that acquires an image for face authentication, a temperature image, and distance information; a display; and a processor, wherein the processor extracts an authentication face image used for face authentication from the face authentication image. and generating correspondence information that associates positions on the temperature image with positions on the face authentication image based on the distance information, and measuring a part or all of a face region in the face authentication image. A configuration for acquiring the position of a target site and acquiring the temperature of the measurement target site on the temperature image as the body temperature information based on the position of the measurement target site on the face authentication image and the association information. and

According to this, the position of the measurement target site on the temperature image is acquired with high accuracy based on the association information, and the temperature of the measurement target site is acquired as body temperature information, so that highly accurate body temperature information can be acquired. can be done.

In a second aspect of the invention, the processor acquires the temperature of the user's forehead portion or eye peripheral portion as the measurement target portion.

According to this, it is possible to obtain an appropriate temperature as the body temperature of the user.

In a third aspect of the invention, the processor acquires the temperature of a part of the body surface not covered by the user's hair or clothing as the part to be measured.

According to this, it is possible to avoid erroneous measurement when it is covered with the user's hair or wearing (glasses, mask, etc.). Note that, for example, the user's hair and clothing may be detected by image recognition, and when the hair and clothing are detected, they may be excluded from the measurement target regions.

In a fourth aspect of the invention, the processor causes the display to display a notification screen including characters or graphics indicating that user authentication is in progress.

According to this, the user can easily recognize that the authentication is in progress.

In a fifth aspect of the invention, the processor causes the display to display a notification screen including characters or graphics indicating that user authentication has been completed.

According to this, the user can easily recognize that the authentication has been completed.

In a sixth aspect of the present invention, the processor causes the display to display a notification screen showing, in at least one of characters, graphics, and colors, a body temperature determination result for determining whether or not the user's body temperature is abnormal. Configuration.

According to this, the user can easily recognize whether the body temperature is abnormal. In this case, for example, the background color of the screen may be changed according to the body temperature determination result. Note that the body temperature determination may be performed by the server device, and the face authentication device may acquire the result of the body temperature determination from the server device.

In a seventh invention, the processor deletes the face image and the body temperature information held in the own device after the face authentication is completed.

According to this, since the user's face image and body temperature information are not stored in the face authentication device, the user's face image and body temperature information can be safely managed.

An eighth aspect of the invention is a face authentication method in which a processor executes a process related to face authentication by photographing a user of a facility and a body temperature measurement process of acquiring body temperature information of the user, wherein the face is detected by a sensor. An image for authentication, a temperature image, and distance information are acquired, a face image for authentication used in the face authentication is extracted from the face authentication image, and based on the distance information, a position on the temperature image and the generating association information that associates a position on the face authentication image with a position of a measurement target part that is part or all of a face region in the face authentication image; Based on the position of the measurement target site and the association information, the temperature of the measurement target site on the temperature image is acquired as the body temperature information.

According to this, as in the first invention, the position of the measurement target site on the temperature image is acquired with high accuracy based on the association information, and the temperature of the measurement target site is acquired as body temperature information. high body temperature information can be obtained.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is an overall configuration diagram of a face authentication system according to this embodiment.

This face authentication system includes a face authentication device 1 (face authentication device, face authentication unit), a registration device 2 (face authentication registration device, registration unit), a face authentication server 3 (server device), a management terminal 4, It has The face authentication server 3 includes a face management server 5 (server device, face management unit) and a face matching server 6 (server device).

The face authentication machine 1, registration machine 2, management terminal 4, face management server 5, and face matching server 6 are connected via a network such as the Internet. A face authentication system is built for each face authentication service provider (enterprise). A plurality of face authentication devices 1 are installed at each location where face authentication is required, such as the entrance of a building or the doorway of a room. The registration machine 2 is arranged at a reception counter or the like that receives visitors to the facility. A required number of face matching servers 6 are provided according to the number of face authentication devices 1 and the like.

The face authentication machine 1 photographs a user (person to be authenticated) to acquire a face image for authentication, transmits the face image to the face matching server 6 to perform face matching, and receives the face image from the face matching server 6. A matching result is acquired, and the face matching result is presented to the user.

The registration device 2 photographs the user's face and acquires a face image for registration according to the user's operation. The registration face image acquired by the registration device 2 is registered in the face management server 5 . Also, the face feature amount extracted from the face image for registration is registered in the face matching server 6 .

The management terminal 4 is operated by an administrator, is composed of a PC, and has a management application installed therein for managing the operations of the face authentication device 1, the registration device 2, the face management server 5, and the face matching server 6. FIG. This management application allows administrators to perform various management tasks.

The face management server 5 manages information about registered users, specifically information such as user names and face images. The face management server 5 also manages information about the face authentication machine 1 , specifically information such as the device ID and installation location of the face authentication machine 1 and processing conditions of the face authentication machine 1 . The face management server 5 also manages information about the face matching server 6 , more specifically, information such as correspondence between the face authentication device 1 and the face matching server 6 and processing conditions of the face matching server 6 .

The face matching server 6 acquires the face image of the user (person to be authenticated) from the face authentication machine 1 at the time of face authentication, generates the face feature amount of the user from the face image, and identifies the face of the user. The user is identified by performing face collation by comparing the feature amount with the face feature amount of the registrant (registered person) stored in the own device.

Prior to face authentication, the face matching server 6 acquires the user's face image from the management terminal 4 when the user is registered, generates a face feature quantity from the face image, and stores it in its own device. It is also possible to obtain a photographed image of the user from the management terminal 4 and obtain a face image from the photographed image in the face matching server 6 .

The external device 7 is a gate device (security gate) installed at the entrance of a building, or a door lock device installed at the entrance door of an office or a conference room. The gate device as the external device 7 is controlled to open and close by the face authentication device 1 (entry checker) provided in the gate device. A door lock device as an external device 7 is controlled to be unlocked and locked by a face authentication device 1 (gate checker) provided at the entrance of an office or conference room.

In this embodiment, the face management server 5 and the face matching server 6 are configured by physically different information processing devices. It may be realized by one information processing device.

Further, in this embodiment, the management terminal 4 and the face management server 5 are provided, but the management terminal 4 and the face management server 5 can be configured by a single information processing device. For example, by installing a management application in the face management server 5, the face management server 5 can also serve as the management terminal 4. FIG.

In addition, in the present embodiment, facial feature amount matching is performed as face matching, but face matching is not limited to facial feature amount matching, and a matching method using machine learning or the like may be employed. . Furthermore, this embodiment can be applied to biometric authentication other than face authentication.

Next, the appearance of the face authentication machine 1 will be described. FIG. 2 is a front view showing the appearance of the face authentication machine 1. FIG. FIG. 2A shows an example of a face authentication device 1 (entry checker) installed at the entrance of an office or conference room, and FIG. ) is an example of the face authentication machine 1 (gate checker) provided in the .

The face authentication device 1 (entry checker) shown in FIG. 2A is a wall-mounted type installed on the wall near the entrance of an office or a conference room, and performs face authentication when entering the office or conference room. . This face authentication device 1 includes a face authentication camera 11 (face authentication sensor), a thermal camera 12 (temperature detection sensor), a distance camera 13 (distance measurement sensor), and a display 14 (display unit ), and

The face authentication camera 11 photographs a user (person to be authenticated) as a subject. The face authentication camera 11 is an RGB camera (visible light camera) having a visible light imaging element, and outputs an RGB image (color image) as an image for face authentication.

The thermal camera 12, like the face authentication camera 11, photographs a user (person to be authenticated) as a subject. The thermal camera 12 is equipped with a far-infrared imaging element, measures the temperature of the subject by detecting the intensity of the far-infrared rays, and stores a temperature image (temperature detection image) in which information about the temperature of the subject is stored in pixel units. ).

The distance camera 13 measures the distance to the user as a subject. This distance camera 13 is a stereo camera (3D camera) equipped with two upper and lower visible light cameras 13a and 13b, and an internal processor (not shown) outputs from the left and right visible light cameras 13a and 13b. Based on the left and right visible images, stereo distance measurement is performed using parallax between the two, and 3D information (3D position information of the subject), specifically, information related to the distance to the subject, is stored in pixel units. (distance information) is generated. The range camera 13 also has a projector 13c that projects near-infrared rays for calibration. Note that the visible light camera can also detect the near-infrared region.

The display 14 displays the progress of face authentication, the result of face authentication, and the like, so that the user (person to be authenticated) can confirm them. A speaker may be provided as an output unit for outputting the user's authentication result, and the face authentication result and the like may be notified to the user by voice.

The face authentication device 1 (gate checker) shown in FIG. 2B is provided in a gate device (security gate) as an external device 7 installed at the entrance of a building. In this case, the face authentication machine 1 includes a face authentication camera 11, a thermal camera 12, and a distance camera 13, like the face authentication machine 1 shown in FIG. 2A, but the display 14 is omitted.

In addition, in order to perform face authentication when entering an appropriate place, a stand-type face authentication machine 1 placed on the floor is also possible. A configuration including a camera 13 and a display 14 is also possible.

Further, in the present embodiment, the face authentication camera 11 captures an image for face authentication (visible image) using a visible light imaging element, but infrared rays can be detected so that face authentication can be performed even in dark conditions. It is also possible to adopt a configuration provided with an image pickup device. In this case, the face authentication camera 11 can also serve as the thermal camera 12 . At this time, an infrared image suitable for face authentication (image recognition) is generated as an image for face authentication and an infrared image suitable for temperature detection is generated as a temperature image according to the signal processing method for the output of the image sensor. can do.

Further, in the present embodiment, a stereo camera type distance camera 13 is used, but the method is not particularly limited as long as the distance to the face of the person to be measured can be measured. For example, TOF (Time Of Flight). A type sensor may be used.

Next, a schematic configuration of the face authentication machine 1 will be described. FIG. 3 is a block diagram showing a schematic configuration of the face authentication machine 1. As shown in FIG. FIG. 4 is an explanatory diagram showing an outline of processing performed by the face authentication device 1 and the face matching server 6. As shown in FIG.

The face authentication device 1 includes a face authentication camera 11, a thermal camera 12, a range camera 13, and a display 14, as well as a communication section 15, a control signal transmission section 16, a storage section 17, and a control section 18. I have.

The communication unit 15 communicates with the face management server 5 via the network. Also, the communication unit 15 communicates with the face matching server 6 via the network.

The control signal transmission unit 16 sends signals to the external device 7, specifically, the door lock device provided at the entrance door of the office or conference room, or the gate device (security gate) installed at the entrance of the building. It sends control signals to control its operation.

The storage unit 17 stores control programs and the like executed by the processors constituting the control unit 18 . The storage unit 17 also stores an image for face authentication captured by the face authentication camera 11 and a face image extracted from the face authentication image.

The control unit 18 includes a face image extraction unit 21, a face matching request unit 22, a result notification unit 23, an external cooperation unit 24, a measurement target site information acquisition unit 25, and a body temperature measurement unit 26. . The control unit 18 is configured by a processor, and each unit of the control unit 18 is realized by executing a program stored in the storage unit 17 by the processor.

The face image extracting unit 21 obtains a face authentication image of the user photographed by the face authentication camera 11, detects a person's face from the face authentication image, and cuts out a face area to extract the face region of the user. Get a face image.

The face matching request unit 22 transmits a face matching request to the face matching server 6 through the communication unit 15 .

The result notification unit 23 notifies the user of the face matching result and the body temperature determination result by displaying the face matching result and the body temperature determination result acquired from the face matching server 6 by the communication unit 15 on the display 14 .

The external linking unit 24 performs control in cooperation with the external device 7 (door lock device or gate device) based on the user's face matching result obtained from the face matching server 6 . Specifically, it controls the control signal transmitter 16 so as to transmit a control signal for causing the external device 7 to perform a desired operation.

The measurement target site information acquisition section 25 includes an association processing section 31 , a position acquisition section 32 and a distance measurement section 33 .

The association processing unit 31 calculates the temperature based on the distance image acquired by the distance camera 13 and the calibration information acquired in advance, specifically, information on the positional relationship between the face authentication camera 11 and the thermal camera 12. Correlation information that associates positions on the image with positions on the image for face authentication is generated. With this association information, it is possible to correct positional deviation on the image based on parallax between the face authentication image and the temperature image according to the distance between the face authentication camera 11 and the thermal camera 12 .

The position acquisition unit 32 acquires the position of the measurement target part on the face authentication image based on the position of the face region on the face authentication image acquired by the face detection performed by the face image extraction unit 21, and determines the position of the measurement target part on the face authentication image. Based on the position of the measurement target site on the authentication image and the association information acquired by the association processing unit 31, the position of the measurement target site on the temperature image is obtained.

Here, in the present embodiment, a portion of the face region, for example, the forehead portion and the peripheral portion of the eyes, is set as the measurement target portion. At this time, the eyes may be detected from the face image, and the portion above the eyes in the face image may be taken as the forehead portion. Also, a predetermined range around the eye may be defined as the peripheral portion of the eye.

Also, when the user wears spectacles, the temperature around the eye cannot be detected accurately. Also, if the user's forehead is hidden by hair or the like, the temperature of the forehead cannot be detected accurately. Therefore, a priority order is set for the measurement target site, and it is determined whether or not the measurement target site is in a state in which the temperature can be accurately detected. may acquire the temperature of the measurement target site of the next order.

For example, the area around the eyes is ranked first, the forehead area is ranked second, and the cheek area is ranked third. Then, it is determined whether or not the user wears spectacles, and if the user does not wear spectacles, the eye peripheral portion of the first order is taken as the measurement target region. On the other hand, if the eyeglasses are worn, it is determined whether or not the forehead is hidden by the hair, etc., and if the forehead is not hidden by the hair, etc., the forehead, which is ranked second, is the object of measurement. part. On the other hand, when the forehead part is hidden by the hair, etc., the cheek part of the third order is taken as the part to be measured. In this case, the measured value may be corrected based on the standard temperature difference between the forehead, the eye area, and the cheeks in order to suppress the influence of the difference in the measurement target site.

Further, when determining whether or not the user is wearing eyeglasses and determining whether or not the forehead is hidden by hair or the like, objects such as eyeglasses and hair may be detected by image recognition. If you are wearing it, the temperature around the eyes will be abnormally low, and if the forehead is hidden by hair, etc., the temperature of the forehead will be abnormally low. Based on the temperature, it may be determined whether glasses are worn or whether the forehead is hidden by hair or the like.

Alternatively, the body surface portion that is not covered by the user's hair or the user's clothing (glasses, mask, etc.) may be used as the measurement target site, and the temperature of the measurement target site may be detected. In this case, the temperature is abnormally low in areas covered by hair or clothing, so if the detected temperature is abnormally low, it is determined that it is not the body surface temperature, and the area excluding such areas is measured. Temperature is detected as a target part.

Also, the entire face region may be set as the measurement target region. In this case, the highest temperature in the face area may be obtained. Also, the temperature of the face area may be statistically processed. For example, the mode of the temperature of the face area may be acquired.

The distance measurement unit 33 obtains the distance to the measurement target site based on the distance image obtained by the distance camera 13 .

The body temperature measurement section 26 includes a temperature detection section 35 and a temperature correction section 36 .

The temperature detection unit 35 detects the temperature of the measurement target site on the temperature image based on the position of the measurement target site on the temperature image acquired by the position acquisition unit 27 of the measurement target site information acquisition unit 25, thereby performing the measurement. Get the temperature of the target part.

The temperature correction unit 36 corrects the temperature measurement value of the measurement target site acquired by the temperature detection unit 35 based on the distance from the thermal camera 12 to the measurement target site acquired by the distance measurement unit 33 . Specifically, the temperature measurement value is corrected by the correction width corresponding to the distance using a mathematical expression, a table, or the like showing the characteristic that the temperature correction width increases as the distance increases. The corrected temperature of the part to be measured acquired by the body temperature correction unit 92 is sent to the face matching server 6 as body temperature information.

In the present embodiment, the position of the target measurement site on the temperature image is acquired by the measurement target site information acquisition unit 25 of the face authentication machine 1 based on the face authentication image and the range image. The processing of the information acquisition unit 25 may be performed by the face matching server 6 . In addition, in the present embodiment, the body temperature measurement unit 26 of the face authentication device 1 acquires the temperature of the measurement target site based on the position of the measurement target site on the temperature image. It may be performed by the face matching server 6 .

Further, in the present embodiment, the body temperature of a person is measured without contact based on the temperature image acquired by the thermal camera 12 of the face authentication device 1. The temperature detected from this temperature image is the body surface temperature. Since it is different from the core body temperature as an accurate body temperature, the body surface temperature detected from the temperature image may be corrected to the body core temperature.

Next, a schematic configuration of the registration machine 2 will be described. FIG. 5 is a block diagram showing a schematic configuration of the registration device 2. As shown in FIG.

The registration device 2 includes a face photographing camera 41 , a display 42 (display section), a communication section 43 , a storage section 44 and a control section 45 . The registration machine 2 can be configured by installing an application for face authentication registration on a tablet terminal.

The face camera 41 can acquire a photographed image of the user by photographing the face of the user (person to be registered).

The display 42 displays a screen (see FIG. 9) that guides the user through the registration procedure. Further, by configuring the display 42 with a touch panel integrated, the user can operate the screen by touch operation. A speaker may be provided in the registration machine 2 so that the registration procedure and the like are guided to the user by voice.

The communication unit 43 communicates with the face management server 5 via the network.

The storage unit 44 stores control programs and the like executed by the processors constituting the control unit 45 .

The control unit 45 includes a facial image extraction unit 46 , a registration request unit 47 and a GUI control unit 48 . The control unit 45 is configured by a processor, and each unit of the control unit 45 is realized by executing a program stored in the storage unit 44 by the processor.

The facial image extracting unit 46 acquires a photographed image of the user from the face photographing camera 41, detects a person's face from the photographed image, and cuts out a face region from the photographed image to extract the face image of the user. to get

The registration request unit 47 transmits a user registration request to the face management server 5 through the communication unit 43 .

The GUI control unit 48 displays on the display 42 various guidance screens for the user distributed from the face management server 5 . In addition, according to the user's input operation using the input function of the display 42 (here, touch panel), input information is acquired and screen control is performed.

The registration machine 2 is equipped with a card photographing camera for photographing a card such as a business card or an employee ID card presented by the user. or a face image may be acquired. Further, a non-contact reader may be used to acquire specific information and facial images written in the user's IC card or RF tag.

Next, a schematic configuration of the face management server 5 will be described. FIG. 6 is a block diagram showing a schematic configuration of the face management server 5. As shown in FIG.

The face management server 5 includes a communication section 51 , a storage section 52 and a control section 53 .

A communication unit 51 communicates with the face authentication device 1 via a network. Also, the communication unit 51 communicates with the registration device 2 . It also communicates with the management terminal 4 via the network. Also, the communication unit 51 communicates with the face matching server 6 .

The storage unit 52 stores control programs and the like that are executed by the processor that constitutes the control unit 53 . The storage unit 52 also stores registration information of the face information database. In the face information database, the user's name, face image, etc. are registered as information about the registered user. The user's face image may be stored in an encrypted state for privacy protection.

The control section 53 includes a user management section 61 , a face information management section 62 and a setting management section 63 . The control unit 53 is configured by a processor, and each unit of the control unit 53 is realized by executing a program stored in the storage unit 52 by the processor.

The user management unit 61 manages information about users such as face images for user registration and specific information (names, etc.).

The setting management section 63 includes a face authentication machine management section 64 and a face matching server management section 65 .

The face authentication machine management unit 64 manages settings related to processing conditions and the like of the face authentication machine 1 in accordance with the operations of the administrator on the management terminal 4 and the operations of the user on the face authentication machine 1 . In the present embodiment, as the processing conditions of the body temperature measurement unit 26 (see FIGS. 3 and 4) of the face authentication device 1, conditions regarding whether or not to perform body temperature measurement, conditions regarding the implementation period of body temperature measurement, and the like are set.

The face matching server management unit 65 manages settings related to the processing conditions of the face matching server 6 according to the operations of the administrator on the management terminal 4 and the operations of the user on the face authentication machine 1 . In the present embodiment, the processing conditions of the body temperature determination unit 76 (see FIGS. 4 and 7) of the face matching server 6 include conditions related to body temperature determination processing (abnormal range, etc.), conditions related to body temperature determination implementation period, and the like. set.

Next, a schematic configuration of the face matching server 6 will be described. FIG. 7 is a block diagram showing a schematic configuration of the face matching server 6. As shown in FIG.

The face matching server 6 includes a communication section 71 , a storage section 72 and a control section 73 .

A communication unit 71 communicates with the face authentication device 1 via a network. Also, the communication unit 71 communicates with the face management server 5 via the network.

The storage unit 72 stores control programs and the like that are executed by the processor that constitutes the control unit 73 . The storage unit 72 also stores registration information of the face matching database. In the face collation database, as information on users (registered persons), facial feature amounts of registered persons to be compared with the facial feature amounts of the person to be authenticated at the time of face collation are registered.

The control unit 73 includes a face matching unit 75 , a body temperature determination unit 76 and an authentication log management unit 77 . The control unit 73 is configured by a processor, and each unit of the control unit 73 is realized by executing a program stored in the storage unit 72 by the processor.

The face matching unit 75 includes a facial feature amount generation unit 81 , a facial feature amount management unit 82 , and a facial feature amount matching unit 83 .

The face feature amount generation unit 81 detects face feature points from the face image for registration and the face image for authentication at the time of user registration and face authentication, and generates face feature amounts.

The face feature amount management unit 82 registers the user's face feature amount generated by the face feature amount generation unit 91 in the face matching database at the time of user registration.

At the time of face authentication, the face feature amount matching unit 83 compares the face feature amount of the user (person to be authenticated) generated from the face image for authentication acquired from the face authentication machine 1 and the user (registered The user (person to be authenticated) is identified by comparing the face feature amount of the person who has already been authenticated.

The body temperature determination unit 76 determines whether or not the body temperature of the user is abnormal, that is, whether or not there is a possibility of fever, based on the body temperature information (the temperature of the part to be measured) obtained from the face authentication device 1. do. Specifically, the body temperature abnormality is determined according to whether the temperature of the measurement target site is included in the abnormal range (heat generation range). In the present embodiment, the abnormal range of body temperature is set based on the normal body temperature (normal body temperature) input in advance by the user identified in the face matching process. Specifically, a value obtained by adding a predetermined value (for example, 0.5 degrees or 1.0 degrees) to the normal temperature is set as the threshold value that is the lower limit of the abnormal range. Then, when the temperature of the measurement target site is included in the abnormal range, that is, when the temperature of the measurement target site is equal to or higher than the threshold value, it is determined that the body temperature is abnormal.

When the face recognition device 1 requests its own device to perform face recognition, the authentication log management unit 77 stores information at that time, that is, the device ID of the face recognition device 1 requesting the face recognition, the result of face matching, and the like. The information is accumulated in the storage unit 72 as an authentication log. Also, in response to a request from the face management server 5, the authentication log is provided to the face management server 5. FIG.

In this embodiment, the body temperature determination unit 76 of the face matching server 6 determines whether or not the body temperature of the user is abnormal. It may be performed in

By the way, in the present embodiment, the position of the measurement target region on the temperature image is obtained based on the position of the measurement target region on the face authentication image and the association information, and the measurement target region on the temperature image is obtained. Although the temperature of the measurement target site is obtained by detecting the temperature of the measurement target site on the temperature image based on the position, the method is not limited to such a method.

For example, after performing image processing to correct the overall deviation of the temperature image with respect to the face authentication image, the temperature of the measurement target site is detected on the temperature image to obtain the temperature of the measurement target site. good too. That is, based on the association information, image processing is performed to convert the temperature image into a state viewed from the same viewpoint as the face authentication image, and image processing is performed based on the position of the measurement target site on the face authentication image. The temperature of the measurement target site is obtained by detecting the temperature of the measurement target site on the temperature image.

Next, operation procedures of the registration device 2, the face management server 5, and the face matching server 6 at the time of user registration will be described. FIG. 8 is a sequence diagram showing operation procedures of the registration device 2, the face management server 5, and the face matching server 6 at the time of user registration.

In the registration machine 2, first, screens (see FIGS. 9A to 9E) for the user to perform user registration operations are sequentially displayed. When the user performs necessary operations on these screens, the registration machine 2 transmits a user registration request to the face management server 5 . This user registration request includes the user's face image, information about normal temperature, and information indicating that the user has agreed to the personal information handling regulations.

Upon receiving the user registration request from the registration device 2, the face management server 5 transmits the face registration request to the face matching server 6. - 特許庁This face registration request includes the face image of the user.

Upon receiving the face registration request from the face management server 5, the face matching server 6 performs face registration processing. In this face registration processing, a face feature amount is generated from the user's face image, and the face feature amount is registered in the face collation database. Then, a face registration response is transmitted to the face management server 5 .

Upon receiving the face registration response from the face matching server 6, the face management server 5 performs registration processing for the user if the processing in the face matching server 6 has been completed normally. In this registration process, the user information obtained from the registration device 2 is registered in the face information database. Then, it transmits a user registration response (completion report) to the registration device 2 .

Upon receiving the user registration response from the face management server 5, the registration device 2 displays a registration completion screen (see FIG. 9F). Further, the registration machine 2 deletes the user's face image and the temperature information related to the normal temperature held in its own device.

Next, a user registration operation performed by the registration device 2 will be described. FIG. 9 is an explanatory diagram showing a screen displayed on the display 42 of the registration device 2 at the time of user registration. Here, a case will be described in which the user (person who is to be registered as a user) himself/herself operates the screen, but it is also possible for a person in charge of user registration to operate the screen.

First, the screen (initial screen) shown in FIG. 9A is displayed on the display 42 of the registration machine 2 . A registration start button 101 is provided on the screen shown in FIG. When the user operates this registration start button 101, the screen transitions to the screen shown in FIG. 9B.

The screen shown in FIG. 9B prompts the user to confirm the personal information handling regulations. This screen displays characters 102 representing the rules for handling personal information in the face authentication system. The personal information handling regulations state that a face image of a user is to be obtained by photographing the user's face at the time of registration and authentication, and body temperature information is to be obtained by measuring the user's body temperature at the time of authentication. This screen also has an agree button 103 and a cancel button 104 . The user operates the agree button 103 or the cancel button 104 depending on whether or not the user agrees with the personal information handling regulations. When the user operates the consent button 103, the screen transitions to the screen shown in FIG. 9(C). When the user operates the cancel button 104, user registration is canceled.

The screen shown in FIG. 9C prompts the user to input normal body temperature (normal body temperature). This screen has characters 105 prompting the user to enter the normal temperature, a body temperature display field 106 for displaying the inputted normal temperature, a numeric keypad 107 for inputting the normal temperature, a register button 108, and a skip button 109. and are provided. When a numerical value is selected by operating the numeric keypad 107 , the selected numerical value is displayed in the body temperature display field 106 . The user confirms the numerical value displayed in the body temperature display field 106 and operates the registration button 117 if there is no error. As a result, the normal temperature is registered with the input value, and the screen transitions to the screen shown in FIG. 9(D). The skip button 109 omits the input of normal temperature. When the user operates this skip button 109, the screen transitions to the next screen shown in FIG. 9D without inputting normal temperature.

In addition, in the screen shown in FIG. 9(C), in order to set the abnormal range of body temperature for each user based on normal body temperature, the user is asked to input the normal body temperature (normal body temperature) of each person. , it is also possible to uniformly set a predetermined value (for example, 37.5 degrees) or more as the abnormal range.

The screen shown in FIG. 9D prompts the user to take a face image. On this screen, characters 111 explaining how to photograph a face image, a photographing frame 112, and a photographed image 113 are displayed. A photographed image 113 is an image photographed by the face authentication camera 11 and displayed within the photographing frame 112 . The user looks at the photographed image 113 displayed within the photographing frame 112 and adjusts the position and orientation of the face so that the user's face is appropriately photographed. In addition, a shooting button 114 and a stop button 115 are provided on this screen. When the user operates the photographing button 114, the user is photographed by the face authentication camera 11 of the registration machine 2. FIG. When the user operates the cancel button 115, user registration is canceled. When the photographing of the face image by the face authentication camera 11 ends normally, the screen changes to the screen shown in FIG. 9(E).

The screen shown in FIG. 9E allows the user to confirm the face image. On this screen, characters 116 prompting confirmation as to whether or not the face image has been properly captured, and a captured image (face image) 113 are displayed. This screen also has a registration button 117 , a recapture button 118 , and a stop button 119 . When the user's face is properly photographed, the user operates the registration button 117 . In this case, the screen transitions to the registration completion screen shown in FIG. If the user's face is not properly captured, the user operates the re-capture button 118 . In this case, the screen returns to the screen (see FIG. 9D) for allowing the user to take a face image. When the user operates the cancel button 119, user registration is canceled.

The screen shown in FIG. 9F notifies the user that the registration has been completed. An end button 120 is provided on this screen. When the user operates the end button 120, the registration operation in the registration machine 2 ends.

In this embodiment, the user's normal body temperature (normal body temperature) is registered by manual input by the user. may be measured and the body temperature may be registered as normal temperature automatically or with the consent of the user.

Next, the operation procedure of the face recognition device 1 and the face matching server 6 at the time of face recognition by the face recognition device 1 (gate checker) provided in the gate device (security gate) installed at the entrance of the building will be described. FIG. 10 is a sequence diagram showing the operating procedures of the face authentication device 1 and the face matching server 6 during face authentication.

When the face recognition device 1 detects a person from the face recognition image captured by the face recognition camera 11, the face image is acquired from the face recognition image. Further, the face authentication device 1 acquires a temperature image captured by the thermal camera 12, and measures the temperature of the measurement target site as the body temperature based on the temperature image. A request for face matching and body temperature determination is then sent to the face matching server 6 . This request includes a facial image and body temperature information.

When the face matching server 6 receives the request for face matching and body temperature determination from the face authentication device 1, the user's face feature amount generated from the face image included in the request and the registrant ( It is determined whether or not the user is a registrant by comparing the face feature amount of a registered person (face matching process). Next, when the face verification is successful, the face verification server 6 determines whether or not the user's body temperature is abnormal based on the body temperature information acquired from the face authentication device 1 (body temperature determination processing). Then, the response for face matching and body temperature determination is transmitted to the face authentication device 1 . This response includes the face matching result and body temperature determination result.

In addition, the face matching server 6 stores information such as face matching results (success or failure) and matching scores in a database as an authentication log (face authentication history information) (authentication log management process).

Upon receiving the face verification and body temperature determination response from the face verification server 6, the face recognition device 1 transmits a control signal for opening the door to the gate device as the external device 7 if the face verification is successful. As a result, the door of the gate device is opened and the user can pass through the gate device. On the other hand, if face verification fails, the door of the gate device remains closed and the user cannot pass through the gate device.

Next, the face authentication machine 1 deletes the user's face image and body temperature information held in its own device. By sequentially deleting the authentication information of a user whose authentication has been completed in this way, the user's personal information can be reliably protected without being mistaken for the authentication information of an already acquired user at the time of the next authentication. can be done.

Next, the operation procedure of the face recognition device 1 and the face matching server 6 at the time of face recognition by the face recognition device 1 (entry checker) provided at the entrance of the office or conference room will be described. FIG. 11 is a sequence diagram showing the operating procedures of the face recognition device 1 and the face matching server 6 during face recognition.

The face authentication device 1 first displays a standby screen (see FIG. 12A) on the display 14 . Next, when the face recognition device 1 detects a person from the face recognition image captured by the face recognition camera 11, the face image is acquired from the face recognition image. Further, the face authentication device 1 acquires a temperature image captured by the thermal camera 12, and measures the temperature of the measurement target site as the body temperature based on the temperature image. A request for face matching and body temperature determination is then sent to the face matching server 6 . This request includes a facial image and body temperature information. Further, in the face authentication machine 1, the screen during face authentication (see FIG. 12B) is displayed on the display 14. FIG.

When the face matching server 6 receives the request for face matching and body temperature determination from the face authentication device 1, the user's face feature amount generated from the face image included in the request and the registrant ( It is determined whether or not the user is a registrant by comparing the face feature amount of a registered person (face matching process). Next, when the face verification is successful, the face verification server 6 determines whether or not the user's body temperature is abnormal based on the body temperature information acquired from the face authentication device 1 (body temperature determination processing). Then, the response for face matching and body temperature determination is transmitted to the face authentication device 1 . This response includes the face matching result and body temperature determination result.

In addition, the face matching server 6 stores information such as face matching results (success or failure) and matching scores in a database as an authentication log (face authentication history information) (authentication log management process).

When the face recognition device 1 receives the face recognition and body temperature determination responses from the face recognition server 6, the display 14 displays a face recognition result and body temperature determination result notification screen (Fig. 12 (C), (D), (E)).

Further, the face authentication device 1 transmits a control signal for unlocking to the door lock device as the external device 7 when the face verification is successful. Thereby, the door lock device is unlocked, and the user can open the door and enter the room. On the other hand, if face matching fails, the door lock device remains locked and the user cannot enter the room.

Next, the face authentication machine 1 deletes the user's face image and body temperature information held in its own device.

Next, screens displayed on the display 14 of the face authentication machine 1 will be described. FIG. 12 is an explanatory diagram showing a screen displayed on the display 14 of the face authentication machine 1. As shown in FIG.

The screens shown in FIGS. 12A to 12E are displayed on the display 14 of the face authentication machine 1. FIG. These screens are provided with a captured image display area 121 and an information display area 122 . An image captured by the face authentication camera 11 is displayed in the captured image display area 121 . Information corresponding to each stage is displayed in the information display area 122 . Information corresponding to each stage may be superimposed and displayed on the image captured by the face authentication camera 11 without dividing the display area.

A screen (standby screen) shown in FIG. 12A is first displayed on the display 14 of the face authentication machine 1 . Here, when the user standing in front of the face authentication device 1 is photographed by the face authentication camera 11, the face matching server 6 performs a process of determining whether or not the user is a registered person (face matching process). ) is started. At this time, the display 14 transitions to the screen shown in FIG. 12(B).

The screen shown in FIG. 12B informs the user that face authentication (face matching) is in progress. In this screen, the information display area 122 displays characters 131 and a graphic 132 indicating that face authentication is in progress. At this time, the face verification server 6 performs face recognition and body temperature determination.

Next, when the face authentication and body temperature determination performed by the face matching server 6 are completed, the display 14 of the face authentication machine 1 shows the results of the face authentication and body temperature determination shown in FIGS. E) Transition to one of the screens shown in FIG. These screens present the user with information on the result of face authentication and information on the result of body temperature measurement and body temperature determination.

The screen shown in FIG. 12C is displayed when the face authentication is successful and the body temperature is determined to be normal. In this screen, the information display area 122 displays characters 133 indicating the user's name identified by face authentication, and characters 134 and a graphic 135 indicating that the face authentication was successful. In this screen, the information display area 122 displays characters 136 indicating the body temperature as the body temperature measurement result and characters 137 indicating that the body temperature is normal as the body temperature determination result. In this case, the door lock device is unlocked, and the person whose face has been authenticated can open the door and enter the room.

The screen shown in FIG. 12D is displayed when face authentication fails. In this screen, the information display area 122 displays characters 134 and a graphic 135 indicating that face authentication has failed. In this case, the door lock device is not unlocked and is maintained in a locked state, and a person cannot open the door and enter the room. Note that when face authentication fails, the body temperature measurement result is not displayed because the person whose face has been authenticated is unknown and whether or not the person has consented to body temperature measurement. In addition, since the normal temperature of the person who has undergone face authentication is unknown, the body temperature determination result is not displayed.

The screen shown in FIG. 12E is displayed when the face authentication is successful and the body temperature is determined to be abnormal. In this screen, the information display area 122 displays characters 133 indicating the user's name identified by face authentication, and characters 134 and a graphic 135 indicating that the face authentication was successful. In this screen, the information display area 122 displays characters 136 indicating body temperature as the body temperature measurement result and characters 137 indicating that the body temperature is abnormal as the body temperature determination result.

Further, in this embodiment, the background color of the information display area 122 changes according to the body temperature determination result as to whether or not the body temperature is abnormal. That is, when the body temperature is normal, that is, in the screen shown in FIG. On the screen, the background color of the information display area 122 is displayed in red.

By the way, when the face authentication is successful, there are cases where the body temperature is determined to be normal (see FIG. 12(C)) and cases where the body temperature is determined to be abnormal (see FIG. 12(E)). Here, when the body temperature is determined to be normal, the door of the gate device is opened to allow the person to pass through, and the door lock device is unlocked to allow the person to enter the room.

On the other hand, if the body temperature is determined to be abnormal, the door of the gate device is opened to allow the person to pass through, and the door lock device is unlocked to allow the person to pass through, in the same way as when the body temperature is determined to be normal. However, conversely, control is performed to deny the passage of a person with the door of the gate device closed, or to deny the person from entering the room with the door lock device locked. You may do so. In this case, the administrator may be allowed to select which control is to be performed. Further, the user may be notified at the time of user registration that if the body temperature is determined to be abnormal, the user will be refused to pass through the gate device or enter the room. Specifically, for example, a screen (see FIG. 9B) that asks the user to confirm the personal information handling regulations is displayed along with the personal information handling regulations. Display a refusal.

Note that when the face authentication device 1 (entry checker) provided at the entrance of the office or conference room determines that the body temperature is abnormal, the body temperature is determined to be abnormal as shown in FIG. 12(E). is notified to the user by screen display. On the other hand, the face authentication device 1 (gate checker) installed in the gate device (security gate) installed at the entrance of the building does not have a display. This may be notified to the user by voice.

Next, a setting operation related to body temperature monitoring performed by the management terminal 4 will be described. FIG. 13 is an explanatory diagram showing a setting screen displayed on the management terminal 4. As shown in FIG. In this embodiment, the body temperature measurement performed by the face authentication device 1 and the body temperature determination performed by the face matching server 6 are collectively referred to as body temperature monitoring.

On the management terminal 4, various management screens are displayed by accessing the face management server 5 and logging in in administrator mode. operation can be performed. On the setting screen shown in FIG. 13 , the administrator can perform setting operations related to body temperature monitoring (body temperature measurement and body temperature determination) for each face authentication device 1 .

A face authentication device selection section 141 and a body temperature monitoring selection section 142 are provided on this setting screen. In the face authentication machine selection unit 141, the administrator can select the target face authentication machine 1 (device ID) by selecting the pull-down menu. In the body temperature monitoring selection section 142, the administrator can select whether or not to perform body temperature monitoring (body temperature measurement) by operating a radio button. It should be noted that a setting may be made such that body temperature measurement is performed but body temperature determination is not performed.

This setting screen is also provided with a body temperature display selection section 143, an abnormal range selection section 144, and a monitoring period input section 145 as detailed setting items.

In the body temperature display selection section 143, the administrator can select whether or not to display the body temperature measurement result in the face authentication machine 1 by selecting a radio button. Specifically, on the screen displayed on the display 14 of the face authentication device 1 (see FIGS. 12C and 12E), it is possible to select whether or not to display the characters 136 indicating the body temperature measurement result. .

In the abnormal range selection unit 144, the administrator can select a method of setting the abnormal range in the body temperature determination process by selecting a radio button. Specifically, either a range set for each user based on the input user's normal temperature, or a range that is equal to or higher than a predetermined value (for example, 37.5 degrees) common to all users , can be selected by the administrator.

In the monitoring period input section 145, the administrator can input a period (start date and end date) for body temperature monitoring by performing an input operation in the input box. Thereby, body temperature monitoring can be implemented for a limited period. For example, temperature monitoring can be implemented only during periods when an infectious disease is endemic. It should be noted that whether or not to perform processing and the period for body temperature measurement performed by the face authentication device 1 and body temperature determination performed by the face matching server 6 may be specified separately.

A registration button 146 is also provided on this setting screen. When the administrator operates the registration button 146 after performing necessary selection and input operations in each part of the setting screen, the face management server 5 performs processing for registering information based on the contents of the selection and input.

It should be noted that the body surface temperature of a person changes depending on the location. For example, in the face authentication device 1 (gate checker) installed in the gate device installed at the entrance of the building, the ambient temperature is low, so the body surface temperature of the person is rather low. On the other hand, in the face authentication device 1 (entry checker) installed at the entrance of the office or conference room in the building, the body surface temperature of the person is high because the surrounding temperature is high. Therefore, an abnormal range for body temperature determination may be set for each face authentication device 1 . For example, the face authentication device 1 installed in the gate device has a low body temperature determination abnormality range, and the face authentication device 1 installed at the entrance of an office or conference room has a high body temperature determination abnormality range. be.

By the way, in the present embodiment, as shown in FIG. 13, processing conditions related to body temperature monitoring are set for each face authentication device 1 . As a result, appropriate settings can be made according to the installation location of the face authentication device 1 and the like. For example, the face authentication device 1 installed in the gate device installed at the entrance of the building monitors body temperature, but the face authentication device 1 installed at the entrance of the office or conference room does not monitor body temperature. can do.

On the other hand, the need for body temperature monitoring differs from company to company. Therefore, in the face authentication device 1 provided in the gate device installed at the entrance of a multi-tenant building where multiple companies share the same building, processing conditions related to body temperature monitoring are set for each user group of each company. It may be Even within the same company, the need for body temperature monitoring differs depending on the department. Therefore, even in the face recognition device 1 installed at the entrance of an office or a conference room, processing conditions related to body temperature monitoring may be set for each user group such as a department.

In addition, in the present embodiment, in the body temperature determination for determining whether the body temperature is abnormal, the abnormal range is set based on the normal body temperature. set for each (see FIG. 9(C)). On the other hand, in addition to normal body temperature, the range of body temperature fluctuations also varies from person to person. Therefore, as a processing condition for body temperature monitoring, a predetermined value to be added to the normal temperature when setting a threshold value that is the lower limit value of the abnormal range in body temperature determination may be set for each user. The predetermined value to be added to the normal temperature may be specified by the user, or may be specified by the administrator.

Also, in the example shown in FIG. 13, the processing conditions for body temperature monitoring are set for each face authentication device 1, but the processing conditions for body temperature monitoring may be set for each user. The management terminal 4 displays a management screen for managing various information about users. On this management screen, it is possible to newly register or change information such as a user's face image or name. good.

The face management server 5 manages setting information regarding processing conditions for body temperature monitoring. Specifically, setting information for each user regarding processing conditions related to body temperature monitoring is stored in the face information database stored in the storage unit 52 of the face management server 5 . In addition, the storage unit 52 of the face management server 5 stores setting information for each face authentication device 1 regarding processing conditions for body temperature monitoring and setting information for each user group regarding processing conditions for body temperature monitoring.

As described above, the embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments with modifications, replacements, additions, omissions, and the like. Further, it is also possible to combine the constituent elements described in the above embodiments to create new embodiments.

The face authentication device and face authentication method according to the present invention have the effect of being able to accurately acquire the temperature of the measurement target site as the user's body temperature when performing face authentication by photographing the user of the facility. It is also useful as a face authentication device and face authentication method that performs body temperature measurement by photographing a user and performing processing related to face authentication, as well as acquiring body temperature information of the user.

1 Face authentication machine (face authentication device)
2 registration machine 3 face authentication server 4 management terminal 5 face management server 6 face matching server (server device)
18 control unit (processor)
11 Face authentication camera (sensor for face authentication)
12 Thermal camera (sensor for temperature detection)
13 distance camera (sensor for distance measurement)
14 display

A face authentication device of the present invention requests a face matching server that performs face authentication of a user of a facility to process the face authentication and body temperature determination, and notifies the user of the processing result. comprising a sensor that acquires an image for face authentication, a temperature image, and distance information, a display, and a processor, wherein the processor extracts a face image used for face authentication from the image for face authentication Then, based on the distance information, the temperature of the measurement target part on the temperature image corresponding to the measurement target part included in the face region in the face authentication image is acquired as the body temperature information, and the face image and transmitting the processing request including the body temperature information to the face matching server, receiving the processing result from the face matching server, generating a notification screen including the face authentication result and the body temperature determination result, and displaying the notification screen on the display. and the body temperature determination result is not displayed on the notification screen when the face authentication result is unsuccessful .

Further, the face authentication method of the present invention is a process of requesting a face matching server that executes face authentication of a user of a facility to process the face authentication and body temperature determination, and notifying the user of the processing result. is executed by a processor, a face authentication image, a temperature image, and distance information are acquired by a sensor, a face image used for face authentication is extracted from the face authentication image, and the distance information Based on, the temperature of the measurement target part on the temperature image corresponding to the measurement target part included in the face region in the face authentication image is obtained as the body temperature information, and the face image and the body temperature information are included transmitting the processing request to the face matching server, receiving the processing result from the face matching server, generating a notification screen including the face authentication result and body temperature determination result, and displaying the face authentication on a display; When the result is a failure, the body temperature determination result is not displayed on the notification screen .

According to the present invention, the body temperature information of the measurement target part on the temperature image corresponding to the measurement target part included in the face region in the face authentication image is obtained with high accuracy, and the user's face authentication result is unsuccessful. In this case, since the body temperature determination result is not displayed, it is possible to make a notification in consideration of the subject's consent to body temperature measurement .

A first invention, which has been made to solve the above-mentioned problems, issues a processing request regarding the face authentication and body temperature determination to a face matching server that executes face authentication of a user of the facility, and the processing result is used as the above-mentioned method. A face authentication device for notifying a person, comprising : a sensor for acquiring a face authentication image, a temperature image, and distance information; a display; based on the distance information, the temperature of the measurement target part on the temperature image corresponding to the measurement target part included in the face region in the face authentication image is used as the body temperature information and transmit the processing request including the face image and the body temperature information to the face matching server, receive the processing result from the face matching server, and generate a notification screen including the face authentication result and the body temperature determination result. When the face recognition result is unsuccessful, the body temperature determination result is not displayed on the notification screen .

According to this, the temperature information of the measurement target part on the temperature image corresponding to the measurement target part included in the face region in the face authentication image is obtained with high accuracy, and when the user's face authentication result is unsuccessful. does not display the body temperature determination result, it is possible to make a notification that considers the subject's consent to body temperature measurement .

In an eighth invention, a processor performs a process of requesting a face matching server for performing face authentication of a user of a facility to process the face authentication and body temperature determination, and notifying the user of the result of the process . wherein a sensor acquires a face authentication image, a temperature image, and distance information, extracts a face image used for face authentication from the face authentication image, and extracts a face image used for face authentication from the face authentication image, based on the distance information to obtain, as the body temperature information, the temperature of the measurement target part on the temperature image corresponding to the measurement target part included in the face region in the face authentication image, and the processing including the face image and the body temperature information A request is sent to the face matching server, the processing result is received from the face matching server, a notification screen including the face authentication result and the body temperature determination result is generated and displayed on a display, and the face authentication result is In the case of failure, the body temperature determination result is not displayed on the notification screen .

According to this, similarly to the first invention, the body temperature information of the measurement target part on the temperature image corresponding to the measurement target part included in the face region in the face authentication image is acquired with high accuracy, and the user's face is obtained. If the authentication result is unsuccessful, the body temperature determination result is not displayed, so that the notification can be given in consideration of the subject's consent to body temperature measurement .

Claims (8)

A face authentication device that photographs a user of a facility and performs processing related to face authentication, and performs body temperature measurement to acquire body temperature information of the user,
A sensor that acquires an image for face authentication, a temperature image, and distance information, a display, and a processor,
The processor
Extracting a face image for authentication used in the face authentication from the face authentication image,
generating correspondence information that associates a position on the temperature image with a position on the face authentication image based on the distance information;
Acquiring the position of a part to be measured, which is part or all of the face region in the face authentication image,
A face authentication device, wherein the temperature of the measurement target site on the temperature image is acquired as the body temperature information based on the position of the measurement target site on the face authentication image and the association information. The processor
2. The face authentication device according to claim 1, wherein the temperature of the user's forehead or eye peripheral portion is acquired as the measurement target portion. The processor
2. The face authentication device according to claim 1, wherein the temperature of a part of the user's body surface not covered by hair or clothing is obtained as the part to be measured. The processor
2. The face authentication device according to claim 1, wherein a notification screen including characters or graphics indicating that user authentication is in progress is displayed on the display. The processor
2. The face authentication device according to claim 1, wherein a notification screen including characters or graphics indicating that user authentication has been completed is displayed on the display. The processor
2. The face according to claim 1, wherein a notification screen is displayed on the display to indicate, in at least one of characters, graphics, and colors, a body temperature determination result for determining whether or not the user's body temperature is abnormal. Authenticator. The processor
2. The face authentication device according to claim 1, wherein after the face authentication is completed, the face image and the body temperature information held in the device are deleted. A face authentication method in which a processor executes a process related to face authentication by photographing a user of a facility and a body temperature measurement process for acquiring body temperature information of the user,
Acquire facial recognition image, temperature image, and distance information by sensor,
Extracting a face image for authentication used in the face authentication from the face authentication image,
generating correspondence information that associates a position on the temperature image with a position on the face authentication image based on the distance information;
Acquiring the position of a part to be measured, which is part or all of the face region in the face authentication image,
A face authentication method, wherein the temperature of the measurement target site on the temperature image is acquired as the body temperature information based on the position of the measurement target site on the face authentication image and the association information.

Images