TWI732627B - Face tracking temperature measurement system and method - Google Patents

Abstract

A face tracking temperature measurement system and method thereof include an image capturing lens, a thermal infrared capturing lens, and a central processing circuit board. The central processing circuit is used to pass the image capturing lens and the thermal infrared capturing Take the lens to capture one or more image data and one or more thermal imaging data, and then position the image data and the thermal imaging data to match, and then perform facial recognition on the image data to obtain no movement or movement And then mark the face position on the thermal imaging data according to the face position to obtain the temperature value of the face position.

Description

Face tracking temperature measurement system and method

The present invention relates to a face tracking temperature measurement system and a method thereof, in particular to a face tracking temperature measurement system and method that can be identified to obtain the position of the unmoving or moving face and its temperature value.

In order to effectively prevent the impact of the coronavirus disease, many countries now advocate wearing masks when entering and exiting public places to prevent the outbreak of large-scale infections. In addition, it is medically proven that when a patient starts to have a fever, The virus in the body becomes contagious. Therefore, in order to effectively control the physical condition of the personnel, devices such as thermometers, ear thermometers, and forehead thermometers will be installed at the entrance and exit to measure body temperature.

However, contact devices such as clinical thermometers and ear thermometers require the detection head to contact the human body to be able to detect. This detection process will cause inconvenience to the person to be tested. It has long-term and large-scale use by different people, and its hygiene problems are also Worry about.

Although devices such as forehead thermometers can measure body temperature in a non-contact manner, they are also susceptible to the influence of ambient temperature, which can easily cause errors in body temperature measurement. This is for places or companies that require strict control of entry and exit. Generally speaking, it will be a big risk.

Therefore, in order to solve the above problems, if the infrared sensor lens and the camera lens can be used, some of them can be used to shoot and record the images of the entering and exiting personnel, and the infrared sensor lens can be used to sense the body temperature, so that the entry and exit personnel can be accurately controlled Therefore, this case should be the best solution.

The face tracking temperature measurement system of the present invention includes: a housing; an image capturing lens arranged on the housing; a thermal infrared capturing lens arranged on the housing; and a central processing circuit board , Is disposed in the housing, the central processing circuit is electrically connected to the image capturing lens and the thermal infrared capturing lens, wherein the central processing circuit is used to be able to pass through the image capturing lens and the thermal infrared capturing The lens captures one or more image data and one or more thermal imaging data respectively, and then positions the image data and the thermal imaging data to match, and then performs face recognition on the image data to obtain the face position, and then According to the face part placed on the thermal imaging data for marking to obtain the temperature value of the face position.

More specifically, the central processing circuit board further includes a picture capture unit capable of capturing one or more image data and one image data through the image capture lens and the thermal infrared capture lens. Or multiple thermal imaging data.

More specifically, the central processing circuit board further includes a position adjustment unit for superimposing, matching and adjusting the position of the image data and the position of the thermal imaging data.

More specifically, the central processing circuit board further includes a face tracking unit for capturing multiple attributes related to the face to obtain the position of the face, and moving in the frame of the image data Track the position of the face to obtain one or more moving parameter coordinates.

More specifically, the central processing circuit board further includes a face feature acquisition unit connected to the face tracking unit for determining the position of the face of the tracked movement parameter coordinates based on a face ratio data The size and position of the facial features at the position of the face.

More specifically, the facial feature system can be the forehead.

More specifically, the central processing circuit board further includes a face position marking unit for placing the acquired face parts on the thermal imaging data for marking.

More specifically, the central processing circuit board further includes a face temperature acquiring unit connected to the face position marking unit, and is used to obtain the thermal imaging data according to the position marked by the face position marking unit Get the temperature value corresponding to the position of the face.

More specifically, the central processing circuit board further includes a heat source removal unit for removing heat sources other than the face position or/and the face position that is too large or too small.

More specifically, the heat source elimination unit can determine the size of the face position, and based on a face size data, eliminate the face position that is too large or too small, so as to reduce unnecessary face position temperature values. Detection.

More specifically, the central processing circuit board further includes a temperature correction unit for performing correction through a correction data and the detected thermal imaging data.

More specifically, the calibration data can be obtained through a black body radiation detector or a forehead thermometer.

More specifically, the central processing circuit board further includes a recording unit for recording the number of people passing by, over-temperature faces, or full-screen content, and can be exported as an information file.

A face tracking temperature measurement method, the steps are: (1) It uses an image capture lens and a thermal infrared capture lens to capture one or more image data and one or more thermal imaging data respectively; (2) The image data and thermal imaging data are then superimposed, matched and adjusted; (3) Afterwards, face recognition is performed on the image data to obtain the face position, and then the face part is placed on the thermal imaging data for marking to obtain the temperature value of the face position.

More specifically, said performing face recognition on the image data to obtain the position of the face can firstly capture a plurality of attributes related to the face to obtain the position of the face, and then add the position of the face to the image data. The position of the moving face in the screen is tracked to obtain one or more moving parameter coordinates.

More specifically, the face position of the tracked movement parameter coordinates can be further judged according to a face ratio data to determine the size and position of the face feature at the face position.

More specifically, the facial feature system can be the forehead.

More specifically, the heat source outside the face position or/and the face position that is too large or too small can be eliminated.

More specifically, the correction can be performed through a correction data and the detected thermal imaging data.

More specifically, the calibration data can be obtained through a black body radiation detector or a forehead thermometer.

More specifically, it can record the number of passing people, over-temperature faces, or full-screen content, so as to be able to export as an information file.

Other technical content, features and effects of the present invention will be clearly presented in the following detailed description of the preferred embodiment with reference to the drawings.

Please refer to Figures 1 to 3, which are the implementation structure diagram, internal structure diagram and central processing circuit board diagram of the face tracking temperature measurement system and method of the present invention. It can be seen from the figure that the face tracking temperature measurement system is A device is implemented, and the system has a housing 1 which includes an image capturing lens 11 and a thermal infrared capturing lens 12 and a central processing circuit board 13 in the housing 1.

The central processing circuit board 13 series includes: (1) An image capturing unit 131 is capable of capturing one or more image data and one or more thermal imaging data through the image capturing lens 11 and the thermal infrared capturing lens 12. (2) A position adjustment unit 132 for superimposing, matching and adjusting the position of the image data and the position of the thermal imaging data. (3) A face tracking unit 133 is used to capture multiple attributes related to the face to obtain the position of the face, and track the moving face position in the frame of the image data to obtain One or more moving parameter coordinates. (4) A face feature acquisition unit 134 is used to determine the size and position of the face feature at the face position based on the face position of the tracked movement parameter coordinates, and the face feature system Can be for the forehead. (5) A face position labeling unit 135 for placing the acquired face part on the thermal imaging data for labeling. (6) A face temperature acquisition unit 136 for acquiring the temperature value corresponding to the face position according to the position marked by the face position marking unit 135 and the thermal imaging data. (7) A heat source elimination unit 137 is used to eliminate heat sources outside the range of the face position of the thermal imaging data, and the heat source elimination unit 137 can further determine the size of the face position range based on a The face size data is used to exclude the face position range that is too large or too small, so as to reduce unnecessary face position temperature detection. (8) A temperature correction unit 138 is used to perform correction through a correction data and the detected thermal imaging data, and the correction data can be obtained through a black body radiation detector or a forehead thermometer. (9) A recording unit 139, used to record the number of people passing by, over-temperature faces, or full-screen content, and can be exported as an information file.

The face tracking temperature measurement method, as shown in Figure 4, has the following steps: (1) It uses an image capture lens and a thermal infrared capture lens to capture one or more image data and one or more thermal imaging data 401 respectively; (2) The image data and thermal imaging data are then superimposed, matched and adjusted 402; (3) Afterwards, face recognition is performed on the image data to obtain the face position 403, and then the face part is placed on the thermal imaging data for marking to obtain the temperature value 404 of the face position.

In actual operation, the face tracking temperature measurement system must be activated first, and then through the image capture lens 11 and thermal infrared capture lens 12 to capture one or more image data (RGB images) and one or Multiple thermal imaging data (IR Thermal image);

After that, the face temperature value is judged according to the following procedures, and the procedures are described as follows: (1) As shown in Figure 5, it can be connected to the face tracking temperature measurement system through an electronic device 2 (electronic device 2 is a desktop computer, a notebook computer, a tablet computer, or a smart handheld device). Line, and display the application engineering interface 22 on the software installed inside the electronic device 2 through the screen 21 of the electronic device 2, adjust the position (left and right position, size position) of the RGB lens and the thermal infrared lens (thermal IR) to change The displayed images (thermal imaging images, RGB images) are superimposed to facilitate correction; (2) After that, use the face detection algorithm (face recognition can detect the face in the image, and return the rectangular coordinates of its position), and before the face detection, a series of faces can be obtained. Department-related attributes (for example, posture, gender, age, head posture, facial hair, glasses, etc.). Get 128 feature values on RGB, get the position of the face or face wearing a mask, and the calculation is further explained as follows: (a) Obtaining the face: After the image is acquired, binarization (numerization) is performed, and all the values in the screen are compared with the developed face database, and 128 feature points are classified (such as the parameters of the nose or mouth) The range is two types), and calculate the value in this picture as the threshold value of the face, you can know whether this picture has a face and the size of the position. (b) Obtaining the face wearing a mask: Using the above threshold and the classified value, it can be judged whether there is a mask on the face, and the position of the face wearing the mask can be further obtained. (3) Use the ratio value to do a calculation, use the above-mentioned tracking face to further calculate and obtain the forehead size and position, where the forehead is the aforementioned known face size and position, the face ratio is usually the upper half of the frame The ratio is 30%~50% (due to the height of the forehead), so after obtaining the face frame, the ratio of eyebrows up (10%~20%) can be used to calculate the height of the forehead. (4) After that, the face position obtained by the image data (RGB image) is searched for the face position in the thermal imaging data (IR Thermal image) and displayed, and the search mentioned above means that the factory will use The engineering interface superimposes the size and size of the RGB image and the thermal imaging image. In the subsequent use, as long as the system calculates the size and position of the face, it can be automatically superimposed on the thermal imaging image to find the temperature of the forehead of the face. (5) Finally, the Row Data (bit data) on the thermal infrared lens is used for calculation to obtain the temperature value found on the thermal infrared lens, where the Row Data (bit data) is a string given by the thermal infrared lens The thermal imaging image is the image displayed by classifying and coloring Row Data (as shown in Figure 6); The above calculation for the use of Row Data (bit data) requires the calculation of the formula after obtaining the potential parameters through the Row Data (bit data). The four parameters RBFO are mainly used and calculated. The temperature calculation formula is T = B / Ln (R / (RawVal-O) + F), where the parameters B, R, RawVal, O and F, where RBFO is Planck constant, and RawVal is returned by the thermal infrared lens Row Data (bit data).

Since there are different heat sources in the environment, it is easy to cause misjudgment of the face temperature value. Therefore, this case proposes the following noise removal (removal) function, and the function is described as follows: (1) Due to the different installation environment, masking must be used to remove unnecessary heat sources displayed in the lens. The masking process here refers to the area that is not required to be recorded on the engineering interface. Displayed on the screen, as shown in Figure 7, when the system determines the face, it will confirm whether the position has overlapped the mask position. If there is, it will not record. (2) Eliminate non-face heat sources. (3) After obtaining the size of the face using the method mentioned in point 2 of [0033], the distance of the face is further calculated. This is because the characteristic of the thermal infrared lens is to receive the signal. The farther the signal is The person of will stand back and forth and calculate the face position to compensate for the temperature of the face position in the same picture. (4) Exclude faces that are too big or too small, and eliminate unnecessary low and high temperature detection.

In order to maintain the accuracy of the human face temperature value, the system can be calibrated through a calibration data and the detected thermal imaging data, and the calibration data can be passed through a black body radiation detector or a forehead Warm gun to obtain.

This case also has tracking and recording functions. The functions are described as follows: (1) Record the number of passing people, take photos and archive them, and export information files. (2) Record over-temperature faces, take photos and archive them, and export information files. (3) Record the full screen, track the relationship between people, and export information files.

When compared with other conventional technologies, the face tracking temperature measurement system and method provided by the present invention have the following advantages: 1. The present invention can be equipped with an infrared sensor lens and a camera lens, which can capture and record images of entering and exiting personnel, and can also sense body temperature through an infrared sensing lens, so that the body temperature status of entering and exiting personnel can be accurately controlled. 2. The present invention can perform multi-face tracking and obtain the temperature status of multiple faces at the same time, so it is very suitable for use in a crowded environment. In addition, this case has an exclusion function to detect real human faces or It removes heat sources other than the human face to eliminate unnecessary low and high temperature detection.

The present invention has been disclosed above through the above-mentioned embodiments, but it is not intended to limit the present invention. Anyone familiar with this technical field with ordinary knowledge should understand the aforementioned technical features and embodiments of the present invention without departing from the scope of the present invention. Within the spirit and scope, some changes and modifications can be made. Therefore, the patent protection scope of the present invention shall be subject to what is defined in the claims attached to this specification.

1: shell

11: Image capture lens

12: Thermal infrared capture lens

13: Central processing circuit board

131: Picture capture unit

132: Position adjustment unit

133: Face tracking unit

134: Face feature acquisition unit

135: Face position labeling unit

136: Face temperature acquisition unit

137: Heat source removal unit

138: Temperature correction unit

139: Recording Unit

14: Thermal infrared capture lens

2: electronic equipment

21: screen

22: Use engineering interface

[Figure 1] is a schematic diagram of the implementation structure of the face tracking temperature measurement system and method of the present invention. [Figure 2] is a schematic diagram of the internal structure of the face tracking temperature measurement system and method of the present invention. [Figure 3] It is a schematic diagram of the architecture of the central processing circuit board of the face tracking temperature measurement system and method of the present invention. [Figure 4] is a schematic flow diagram of the face tracking temperature measurement system and method of the present invention. [Figure 5] It is a schematic diagram of image overlay correction of the face tracking temperature measurement system and method of the present invention. [Figure 6] is a schematic diagram of the thermal imaging image of the face tracking temperature measurement system and method of the present invention. [Figure 7] is a schematic diagram of the mask processing of the face tracking temperature measurement system and method of the present invention.

1: shell

11: Image capture lens

12: Thermal infrared capture lens

13: Central processing circuit board

Claims (19)

A face tracking temperature measurement system includes: a housing; an image capturing lens arranged on the housing; a thermal infrared capturing lens arranged on the housing; a central processing circuit board, Is arranged in the housing, the central processing circuit is electrically connected to the image capturing lens and the thermal infrared capturing lens, wherein the central processing circuit is used to pass the image capturing lens and the thermal infrared capturing lens Respectively capture one or more image data and one or more thermal imaging data, and then position the image data and the thermal imaging data to match, and then perform face recognition on the image data to obtain the face position, and then according to The face part is placed on the thermal imaging data for marking to obtain the temperature value of the face position, wherein the central processing circuit board further includes a face tracking unit for capturing a plurality of attributes related to the face, The face position is acquired, and the moving face position in the frame of the image data is tracked to acquire one or more movement parameter coordinates. The face tracking temperature measurement system according to claim 1, wherein the central processing circuit board further includes a picture capturing unit, and the picture capturing unit is capable of capturing through the image capturing lens and the thermal infrared capturing lens Take one or more image data and one or more thermal imaging data. The face tracking temperature measurement system according to claim 1, wherein the central processing circuit board further includes a position adjustment unit for being able to superimpose and match the position of the image data and the position of the thermal imaging data. Adjustment. The face tracking temperature measurement system according to claim 1, wherein the central processing circuit board further includes a face feature acquisition unit connected to the face tracking unit, and is used to obtain the position of the face of the moving parameter coordinate of the tracking , To determine the facial features at the position of the face based on the data of a face ratio Size and location. The face tracking temperature measurement system according to claim 4, wherein the face feature can be the forehead. The face tracking temperature measurement system according to claim 1, wherein the central processing circuit board further includes a face position marking unit for placing the acquired face parts on the thermal imaging data for marking. The face tracking temperature measurement system according to claim 6, wherein the central processing circuit board further includes a face temperature acquisition unit connected to the face position marking unit, and is used to obtain a face temperature according to the mark marked by the face position marking unit The position of the face and the thermal imaging data are used to obtain the temperature value corresponding to the position of the face. The face tracking temperature measurement system according to claim 1, wherein the central processing circuit board further includes a heat source elimination unit to be able to remove heat sources other than the position of the face and/or the position of the face that is too large or too small To exclude. The face tracking temperature measurement system according to claim 8, wherein the heat source elimination unit can determine the size of the face position, and based on a face size data, eliminate the face position that is too large or too small to be able to Reduce unnecessary face position temperature detection. The face tracking temperature measurement system according to claim 1, wherein the central processing circuit board further includes a temperature correction unit for performing correction through a correction data and the detected thermal imaging data. The face tracking temperature measurement system according to claim 11, wherein the calibration data can be obtained through a black body radiation detector or a forehead thermometer. The face tracking temperature measurement system according to claim 1, wherein the central processing circuit board It also includes a recording unit for recording the number of people passing by, over-temperature faces or full-screen content, and can be exported as an information file. A face tracking temperature measurement method, the steps of which are: capturing one or more image data and one or more thermal imaging data through an image capturing lens and a thermal infrared capturing lens; and then combining the image data Overlay matching and adjustment with the thermal imaging data; then face recognition is performed on the image data to obtain the face position, and then the face part is placed on the thermal imaging data for marking to obtain the temperature value of the face position, Face recognition is performed on the image data to obtain the position of the face. It is possible to first capture multiple attributes related to the face to obtain the position of the face, and then move the face in the frame of the image data. Track the position of the part to obtain one or more moving parameter coordinates. The face tracking temperature measurement method according to claim 13, wherein the face position of the tracked movement parameter coordinate can be further judged according to a face ratio data to determine the size and position of the face feature at the face position. The face tracking temperature measurement method according to claim 14, wherein the face feature can be the forehead. The face tracking temperature measurement method according to claim 13, wherein heat sources other than the position of the face or/and the position of the face that is too large or too small can be excluded. The face tracking temperature measurement method according to claim 13, wherein a correction data and the detected thermal imaging data can be used for correction. The face tracking temperature measurement method according to claim 17, wherein the calibration data can be obtained through a black body radiation detector or a forehead thermometer. The face tracking temperature measurement method described in claim 13, wherein the number of people passing by, over-temperature faces or full-screen content can be recorded, so as to be able to export as an information file.

Images