CN111626125A - Face temperature detection method, system and device and computer equipment - Google Patents
Face temperature detection method, system and device and computer equipment Download PDFInfo
- Publication number
- CN111626125A CN111626125A CN202010338885.1A CN202010338885A CN111626125A CN 111626125 A CN111626125 A CN 111626125A CN 202010338885 A CN202010338885 A CN 202010338885A CN 111626125 A CN111626125 A CN 111626125A
- Authority
- CN
- China
- Prior art keywords
- face
- target
- temperature
- human
- target frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 110
- 238000000034 method Methods 0.000 claims abstract description 60
- 238000001931 thermography Methods 0.000 claims description 60
- 210000001061 forehead Anatomy 0.000 claims description 34
- 238000004590 computer program Methods 0.000 claims description 18
- 238000002372 labelling Methods 0.000 claims description 16
- 238000004422 calculation algorithm Methods 0.000 claims description 10
- 230000036544 posture Effects 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 9
- 238000009529 body temperature measurement Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 15
- 238000012549 training Methods 0.000 description 8
- 238000013135 deep learning Methods 0.000 description 7
- 230000005855 radiation Effects 0.000 description 7
- 230000036760 body temperature Effects 0.000 description 5
- 210000000746 body region Anatomy 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 206010011409 Cross infection Diseases 0.000 description 1
- 206010029803 Nosocomial infection Diseases 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 238000007635 classification algorithm Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 230000005693 optoelectronics Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/10—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
- G01J5/20—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using resistors, thermistors or semiconductors sensitive to radiation, e.g. photoconductive devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
Abstract
The application relates to a method, a system, a device and computer equipment for detecting face temperature, wherein the method for detecting the face temperature comprises the following steps: the method comprises the steps of obtaining an infrared image of a target, carrying out human body recognition on the infrared image through a human body detection model, outputting a human body target frame, carrying out human face recognition on the target through a human face detection model degree in the human body target frame, outputting a human face target frame, and calculating the human face temperature of the target according to the temperature information of a human face area in the human face target frame, so that the problem of low accuracy of human face recognition from the infrared image is solved, and the accuracy of human face recognition and temperature measurement is improved.
Description
Technical Field
The present application relates to the field of infrared detection, and in particular, to a method, a system, an apparatus, and a computer device for detecting human face temperature.
Background
In the process of epidemic situation prevention and control, body temperature detection is the most efficient confirmation means for suspected infected people, so that when serious epidemic situations occur, workers are required to carry out body temperature detection on citizens, and the citizens can go out under the condition that the body temperature detection is passed, otherwise, the risk of cross infection is caused. But carry out body temperature through the manual work and detect and waste time and energy, and staff's quantity reduces at night, leads to the prevention and control dynamics at night to be far less than daytime, has brought huge hidden danger for city safety.
In the related art, in order to realize body temperature detection at night, researchers realize training and outputting of face recognition on infrared images through a self-adaptive classification algorithm, but due to the fact that the contrast of the infrared images is low, the proportion of face regions in the whole images is small, the face recognition effect from the infrared images is poor, and accuracy is low.
At present, no effective solution is provided for the problem of low accuracy of face recognition from infrared images in the related art.
Disclosure of Invention
The embodiment of the application provides a method, a system, a device, computer equipment and a computer readable storage medium for detecting face temperature, so as to at least solve the problem of low accuracy of face recognition from an infrared image in the related art.
In a first aspect, an embodiment of the present application provides a method for detecting a face temperature, where the method includes:
acquiring infrared thermal imaging of a target, carrying out human body recognition on the infrared thermal imaging through a human body detection model, and outputting a human body target frame;
in the human body target frame, carrying out face recognition on the target through a face detection model, and outputting a face target frame;
and calculating the face temperature of the target according to the temperature information of the face area in the face target frame.
In some embodiments, the calculating the face temperature of the target according to the temperature information of the face region in the face target frame includes:
determining the posture angle of the face in the face target frame;
determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles;
and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to temperature information in the infrared thermal imaging.
In some embodiments, before the labeling the forehead area in the face target frame, the method further includes:
the method comprises the steps of obtaining infrared face images under various human body postures, and marking a forehead area and a characteristic point coordinate position in each infrared face image.
In some of these embodiments, after the calculating the face temperature of the target, the method further comprises:
in a preset time period, carrying out multiple times of face temperature detection on the target through a multi-target tracking algorithm, and calculating the average value of the multiple times of face temperature detection results;
and under the condition that the average value is greater than the temperature threshold value, the target is marked as an over-temperature person, and under the condition that the numerical value of the over-temperature person is greater than the warning threshold value, warning information is sent out.
In some of these embodiments, the method of generating the human detection model comprises:
obtaining a plurality of human body infrared thermal images, labeling human body regions in the human body infrared thermal images, training through a deep learning convolution network, and generating the human body detection model.
In some of these embodiments, the method of generating the face detection model comprises:
the method comprises the steps of obtaining a plurality of human body infrared thermal images, labeling human face regions in the human body infrared thermal images, training through a deep learning convolution network, and generating the human face detection model.
In some embodiments, after the identifying the face of the target by the face detection model, the method includes:
and acquiring temperature information in the face area, and not outputting the face frame under the condition that the temperature information is not in a preset temperature range.
In a second aspect, an embodiment of the present application provides a system for detecting a face temperature, where the system includes: an infrared thermal imager and a central processing unit;
acquiring infrared thermal imaging of a target through the infrared thermal imager, carrying out human body recognition on the infrared thermal imaging through a human body detection model by the central processing unit, outputting a human body target frame, carrying out human face recognition on the target through a human face detection model in the human body target frame, and outputting a human face target frame;
and the central processing unit calculates the face temperature of the target according to the temperature information of the face area in the face target frame.
In some embodiments, the central processor is further configured to determine a pose angle of the face in the face target frame; determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles; and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to temperature information in the infrared thermal imaging.
In a third aspect, an embodiment of the present application provides an apparatus for detecting a face temperature, where the apparatus includes: a multi-stage detection module and a temperature calculation module:
the multi-stage detection module is used for acquiring infrared thermal imaging of a target, performing human body recognition on the infrared thermal imaging through a human body detection model, outputting a human body target frame, performing human face recognition on the target through a human face detection model in the human body target frame, and outputting a human face target frame;
and the temperature calculation module is used for calculating the face temperature of the target according to the temperature information of the face area in the face target frame.
In some of these embodiments, the apparatus further comprises an area location module:
the region positioning module is used for determining the posture angle of the face in the face target frame; determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles; and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to temperature information in the infrared thermal imaging.
In a fourth aspect, the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the method for detecting the face temperature as described above.
In a fifth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method for detecting the face temperature as described above.
Compared with the related technology, the method for detecting the face temperature provided by the embodiment of the application comprises the steps of obtaining infrared thermal imaging of a target, carrying out human body recognition on the infrared thermal imaging through a human body detection model, outputting a human body target frame, carrying out face recognition on the target through a face detection model in the human body target frame, outputting the face target frame, and calculating the face temperature of the target according to the temperature information of a face area in the face target frame, so that the problem of low accuracy of face recognition in the infrared thermal imaging is solved, and the accuracy of face recognition and temperature measurement is improved.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic application environment diagram of a method for detecting a face temperature according to an embodiment of the present application;
FIG. 2 is a flow chart of a method of face temperature detection according to an embodiment of the present application;
FIG. 3 is a flow chart of another face temperature detection according to an embodiment of the present application;
FIG. 4 is a block diagram of a system for face temperature detection according to an embodiment of the present application;
FIG. 5 is a block diagram of an apparatus for face temperature detection according to an embodiment of the present application;
FIG. 6 is a block diagram of another apparatus for face temperature detection according to an embodiment of the present application;
fig. 7 is an internal structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application.
It is obvious that the drawings in the following description are only examples or embodiments of the present application, and that it is also possible for a person skilled in the art to apply the present application to other similar contexts on the basis of these drawings without inventive effort. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. The term "plurality" as referred to herein means two or more.
The method for detecting the face temperature can be applied to the application environment shown in figure 1, fig. 1 is a schematic application environment diagram of a method for detecting a face temperature according to an embodiment of the present application, as shown in fig. 1, a camera 102 with an infrared thermal imaging function is connected in communication with a server 104, the camera 102 obtains an infrared thermal image of a target pedestrian 106 in a public place, the server 104 obtains the infrared thermal image through the camera 102, and performs human body recognition on the infrared thermal imaging through a human body detection model, outputs a human body target frame of the target pedestrian 106, in the human body target frame, the server 104 performs face recognition on the target pedestrian 106 through a face detection model degree, and outputs a face target frame, the server 104 calculates the face temperature of the target pedestrian 106 according to the temperature information in the infrared thermal imaging, and the server 104 can be realized by an independent server or a server cluster formed by a plurality of servers.
The present embodiment provides a method for detecting a face temperature, fig. 2 is a flowchart of a method for detecting a face temperature according to an embodiment of the present application, and as shown in fig. 2, the method includes the following steps:
step S201, acquiring infrared thermal imaging of a target, carrying out human body recognition on the infrared thermal imaging through a human body detection model, and outputting a human body target frame. The target in the embodiment of the application is a human body, in other embodiments, the target can also be other objects capable of carrying out infrared radiation, the human body detection model can identify human body images in infrared thermal imaging, the infrared thermal imaging can be obtained through a camera device with an infrared camera shooting function, and the infrared thermal imaging can also be obtained through an infrared thermal imager or an infrared temperature measuring probe. In the process of identifying the human body through the human body detection model, the infrared thermal imaging shot in real time needs to be zoomed to 256 × 256 pixels, then the human body detection model is called to detect the infrared thermal imaging, and a human body target frame is output.
And S202, in the human body target frame, carrying out face recognition on the target through a face detection model, and outputting a face target frame. In the process of face recognition through the face detection model, under the condition that a human body target frame is not consistent with a template in size, a 1.5-time region of the human body target frame needs to be cut, the cut image is zoomed to 256 × 256 pixels, then the face detection model is called to detect the cut image, and the region containing the face in the image is recognized.
Step S203, calculating the face temperature of the target according to the temperature information of the face area in the face target frame. The principle of detecting the temperature of a human body by infrared thermal imaging is as follows: the infrared thermal imaging images an object through a thermal infrared sensitive Charge Coupled Device (CCD) so as to reflect the temperature field on the surface of the object, and the human body is a natural biological infrared radiation source and can continuously emit and absorb infrared radiation to the surroundings, and the temperature distribution of the normal human body has certain stability and characteristics. Under the condition that a certain part of a human body is diseased or has changed functions, the blood flow at the part can be correspondingly changed, so that the local temperature of the human body is changed and is expressed as higher or lower temperature. According to the principle, the infrared radiation of the human body is collected through a thermal imaging system and converted into digital signals to form a pseudo color thermal image, and the temperature of the corresponding position of the human body can be obtained by utilizing special analysis software.
Through the steps S201 to S203, the face temperature detection is divided into two stages, the whole body area of the target is firstly detected, after the body area is cut, the face detection is carried out, compared with the prior art, the face temperature detection method has the advantages that the contrast of infrared thermal imaging is low, the proportion of the face area in the whole image is small, the effect of detecting the face from the infrared thermal imaging at one time is not good, the face temperature detection method solves the problem that the accuracy of face identification is low directly from the infrared thermal imaging, and the accuracy of face identification and temperature measurement is improved.
In the embodiment, the face temperature detection is realized through infrared thermal imaging, and in other embodiments, the face temperature detection can also be realized through an infrared image and a visible light image. In the case of using an infrared image or a visible light image, it is necessary to coordinate-map the infrared image or the visible light image with infrared thermal imaging to obtain temperature information.
In some embodiments, calculating the face temperature of the target according to the temperature information of the face region in the face target frame includes: determining the posture angle of the face in the face target frame; determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles; and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to temperature information in infrared thermal imaging. In this embodiment, the pose angle of the face is an imaging angle between the face and the imaging device during the detection process, and when the size of the face target frame is not consistent with that of the model, the face target frame needs to be scaled to 64 × 64 pixels and then matched with the target face template image, the matching method is face recognition (FaceNet) based on deep learning or a traditional hidden markov model method, and the like, after matching is successful, forehead region position information of the face image is obtained, in the forehead region, 4 feature point coordinate positions are obtained, temperature information of the 4 points in infrared thermal imaging is respectively obtained, and the average value is taken as the result of face temperature detection. In this embodiment, after the face of the target is recognized, the forehead area of the target is further subjected to temperature detection, and the average value of a plurality of feature points on the forehead area is taken as a final face temperature detection result, so that the accuracy of face temperature detection is further improved.
In some embodiments, before labeling the forehead area in the face target frame, the method further includes: the method comprises the steps of obtaining infrared face images under various human body postures, and marking the forehead area and the coordinate position of a characteristic point in each infrared face image. The human body postures are different angles formed by the target and the camera device, for example, the target is opposite to the camera device, an angle of 30 degrees or 60 degrees is formed between the target and the camera device, the size of the face image is 64 x 64 pixels, and in the manual marking process, the position information of 4 characteristic points in the forehead area is marked. After the face of the target is recognized, the typical gesture of the target can be precisely recognized, the forehead area of the target is further subjected to temperature detection, and the accuracy of face temperature detection is improved.
In some embodiments, fig. 3 is a flowchart of another face temperature detection method according to an embodiment of the present application, and as shown in fig. 3, the method further includes the following steps:
step S301, in a preset time period, multiple times of face temperature detection are carried out on the target through a multi-target tracking algorithm, and the average value of the multiple times of face temperature detection results is calculated. For example, when the preset time period is 5s, the face temperature in each frame of infrared thermal imaging within 5s is detected and recorded, and then the average value of a plurality of temperatures is obtained, wherein the multi-target tracking algorithm is to perform correspondence and trajectory tracking on targets between frames through characteristic judgment, and the multi-target tracking algorithm is, for example, Sort or Deep Sort.
Step S302, under the condition that the average value is larger than the temperature threshold value, the target is marked as an overtemperature person, and under the condition that the numerical value of the overtemperature person is larger than the warning threshold value, warning information is sent out. In this embodiment, the temperature threshold may be 37.3 ℃, and when the average temperature is greater than 37.3 ℃, the target is determined to be an over-temperature person, and counting is performed, the warning threshold in this embodiment may be defined according to different requirements of a public place, for example, the warning threshold is set to 100, and when the counting result of the over-temperature person is greater than 100, an audible and visual warning signal is sent.
Through the step S301 and the step S302, multiple temperature detection is carried out on the target in 5S based on the multi-target tracking algorithm, so that the accuracy of face temperature detection is improved, the data error of face temperature detection caused by only once detection is reduced, the pedestrians are sparse at night, and the number of workers is limited, so that the workload of the workers can be effectively reduced, and the detection efficiency is improved.
In some embodiments, a method of generating a human detection model includes: and acquiring a plurality of human body infrared thermal images, labeling human body regions in the human body infrared thermal images, and training through a deep learning convolution network to generate the human body detection model. Wherein, under the condition that the human body infrared thermal imaging is not consistent with the size of the template, the human body infrared thermal imaging needs to be zoomed and then marked. The human body detection model can be built based on a deep learning convolutional neural network structure, such as a target detection network algorithm YOLO (young Only Look one, abbreviated as YOLO), a target detection algorithm SSD (Single shot multi box Detector, abbreviated as SSD), and the like. Before training the human body detection model, in the case of human body infrared thermal imaging with inconsistent template size, the collected training samples need to be scaled to 256 × 256 pixels. In the embodiment, the human body detection model is trained, so that the recognition efficiency of the human body region in the target infrared thermal imaging is improved.
In some embodiments, a method of generating a face detection model comprises: and acquiring a plurality of human body infrared thermal images, labeling human face regions in the human body infrared thermal images, and training through a deep learning convolution network to generate the human face detection model. Wherein, under the condition that the human body infrared thermal imaging is not consistent with the size of the template, the human body infrared thermal imaging needs to be zoomed and then marked. The face detection model can also be performed based on a deep learning convolutional neural network structure, such as a target detection network algorithm YOLO (young Only Look one, abbreviated as YOLO), a target detection algorithm SSD (Single shot multi box Detector, abbreviated as SSD), and so on. In the embodiment, the efficiency and the accuracy of face recognition in target infrared thermal imaging are improved through training of the face detection model.
In some embodiments, after the target is face-recognized by the face detection model, the method further comprises: and acquiring temperature information in the face area, and under the condition that the temperature information is not in a preset temperature range, not outputting the face frame. The temperature information in this embodiment may be a temperature average value in a face region, the preset temperature range may be 32-40 ℃, the preset temperature range is a temperature range of a human body, and when the temperature information is not within the preset temperature range, it indicates that a target in infrared thermal imaging does not meet a target requirement to a great extent, and the target may be filtered. In this embodiment, before the face detection frame is output, the temperature information in the image is detected, and the image that does not conform to the preset temperature range is filtered, so that the output of the face detection frame is reduced, and the calculation efficiency is improved.
It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here.
The present application further provides a system for detecting a face temperature, fig. 4 is a block diagram of a structure of the system for detecting a face temperature according to the embodiment of the present application, and as shown in fig. 4, the system includes: an infrared thermal imager 41 and a central processing unit 42.
The infrared thermal imaging of the target is obtained by the infrared thermal imager 41, the central processing unit 42 performs human body recognition on the infrared thermal imaging through the human body detection model, and outputs a human body target frame, and in the human body target frame, the human face recognition is performed on the target through the human face detection model, and the human face target frame is output. The central processor 42 calculates the face temperature of the target based on the temperature information of the face region in the face target frame. The infrared thermal imager 41 in this embodiment may convert the invisible infrared energy emitted by the object into visible thermal images in which different colors represent different temperatures of the measured object. By checking the thermal image, the distribution condition of the overall temperature of the detected target can be observed, and then the heating condition of the target is researched to carry out the next working judgment. The infrared thermal imager 41 operates on the principle of using an optoelectronic device to detect and measure radiation, and specifically, uses an infrared detector and an optical imaging objective lens to receive infrared radiation energy of a target to be detected and reflect the infrared radiation energy onto a photosensitive element of the infrared detector to obtain infrared thermal imaging, where the infrared thermal imaging corresponds to a thermal distribution field on a surface of an object.
The human face detection system analyzes the infrared thermal imaging obtained by the infrared thermal imager through the central processing unit 42, the human face temperature detection is carried out in two stages, the whole human body area of a target is firstly detected, the human body area is cut under the condition that the size of the human body area is inconsistent with the size of the template, and then the human face detection is carried out.
In some embodiments, the central processor 42 is further configured to determine a pose angle of the face in the face target frame; determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles; registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to the temperature information in the infrared thermal imaging. In this embodiment, after the central processing unit 42 recognizes the face of the target, the temperature of the forehead area of the target is further detected, and the average value of a plurality of feature points on the forehead area is taken as the final face temperature detection result, so that the accuracy of the face temperature detection is further improved.
The present embodiment further provides a device for detecting a face temperature, where the device is used to implement the foregoing embodiments and preferred embodiments, and the description of the device that has been already made is omitted. As used hereinafter, the terms "module," "unit," "subunit," and the like may implement a combination of software and/or hardware for a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
In some embodiments, fig. 5 is a block diagram of an apparatus for detecting a face temperature according to an embodiment of the present application, and as shown in fig. 5, the apparatus includes: a multi-stage detection module 51 and a temperature calculation module 52.
And a multi-stage detection module 51, configured to obtain an infrared thermal image of the target, perform human body recognition on the infrared thermal image through a human body detection model, output a human body target frame, perform face recognition on the target through a face detection model in the human body target frame, and output a face target frame.
And the temperature calculating module 52 is configured to calculate a face temperature of the target according to the temperature information of the face area in the face target frame.
Through the human face temperature detection device, the multi-stage detection module 51 divides the human face temperature detection into two stages to be carried out, at first, the whole human body region of the target is detected, then the temperature calculation module 52 carries out the calculation of the human face temperature, compared with the related art, because the contrast of infrared thermal imaging is lower, the proportion of the human face region in the whole image is smaller, therefore, the effect of detecting the human face from the infrared thermal imaging is often not good once, the human face temperature detection method provided by the application solves the problem that the accuracy of the human face identification is lower directly from the infrared thermal imaging, the efficiency and the accuracy of the human face identification and the temperature measurement are improved, and the influence caused by visible light factors is reduced.
In some embodiments, fig. 6 is a block diagram of another apparatus for detecting a face temperature according to an embodiment of the present application, and as shown in fig. 6, the apparatus further includes: an area location module 61. The region positioning module 61 is configured to determine a pose angle of a face in the face target frame, and determine a target face template image matched with the pose angle from a pre-stored face template image library, where the pre-stored face template image library includes face template images of the face at multiple pose angles; and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to the temperature information in the infrared thermal imaging. After the face of the target is recognized, the region positioning module 61 in this embodiment may accurately recognize the typical posture of the target, then perform temperature detection on the forehead region of the target through the temperature calculation module 52, and further improve the accuracy of the face temperature detection by taking the average value of a plurality of feature points on the forehead region as the final face temperature detection result.
The above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of face temperature detection. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
In one embodiment, fig. 7 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application, and as shown in fig. 7, there is provided an electronic device, which may be a server, and an internal structure diagram of which may be as shown in fig. 7. The electronic device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic equipment comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the electronic device is used for storing data. The network interface of the electronic device is used for connecting and communicating with an external terminal through a network. The computer program is executed by a processor to implement a method of face temperature detection.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is a block diagram of only a portion of the architecture associated with the subject application, and does not constitute a limitation on the electronic devices to which the subject application may be applied, and that a particular electronic device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor executes the computer program to implement the steps of the method for detecting the face temperature provided in the foregoing embodiments.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps in the method for detecting the face temperature provided by the above embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (11)
1. A method for detecting face temperature, the method comprising:
acquiring infrared thermal imaging of a target, carrying out human body recognition on the infrared thermal imaging through a human body detection model, and outputting a human body target frame;
in the human body target frame, carrying out face recognition on the target through a face detection model, and outputting a face target frame;
and calculating the face temperature of the target according to the temperature information of the face area in the face target frame.
2. The method of claim 1, wherein the calculating the face temperature of the target according to the temperature information of the face region in the face target frame comprises:
determining the posture angle of the face in the face target frame;
determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles;
and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to temperature information in the infrared thermal imaging.
3. The method for detecting face temperature according to claim 2, further comprising, before the labeling the forehead area in the face target frame:
the method comprises the steps of obtaining infrared face images under various human body postures, and marking a forehead area and a characteristic point coordinate position in each infrared face image.
4. The method of claim 1, wherein after the calculating the face temperature of the target, the method further comprises:
in a preset time period, carrying out multiple times of face temperature detection on the target through a multi-target tracking algorithm, and calculating the average value of the multiple times of face temperature detection results;
and under the condition that the average value is greater than the temperature threshold value, the target is marked as an over-temperature person, and under the condition that the numerical value of the over-temperature person is greater than the warning threshold value, warning information is sent out.
5. The method of claim 1, wherein after the target is face-recognized by a face detection model, the method comprises:
and acquiring temperature information in the face area, and not outputting the face frame under the condition that the temperature information is not in a preset temperature range.
6. A system for face temperature detection, the system comprising: an infrared thermal imager and a central processing unit;
acquiring infrared thermal imaging of a target through the infrared thermal imager, carrying out human body recognition on the infrared thermal imaging through a human body detection model by the central processing unit, outputting a human body target frame, carrying out human face recognition on the target through a human face detection model in the human body target frame, and outputting a human face target frame;
and the central processing unit calculates the face temperature of the target according to the temperature information of the face area in the face target frame.
7. The system for detecting human face temperature according to claim 6, wherein the central processor is further configured to determine a pose angle of the human face in the human face target frame; determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles; and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to temperature information in the infrared thermal imaging.
8. An apparatus for face temperature detection, the apparatus comprising: a multi-stage detection module and a temperature calculation module:
the multi-stage detection module is used for acquiring infrared thermal imaging of a target, performing human body recognition on the infrared thermal imaging through a human body detection model, outputting a human body target frame, performing human face recognition on the target through a human face detection model in the human body target frame, and outputting a human face target frame;
and the temperature calculation module is used for calculating the face temperature of the target according to the temperature information of the face area in the face target frame.
9. The apparatus for detecting human face temperature according to claim 8, wherein the apparatus further comprises a region locating module:
the region positioning module is used for determining the posture angle of the face in the face target frame; determining a target face template image matched with the attitude angle from a pre-stored face template image library, wherein the pre-stored face template image library comprises face template images of a face under a plurality of attitude angles; and registering the human face target frame with the target human face template image, labeling a forehead area in the human face target frame, and calculating the human face temperature of the target in the forehead area according to temperature information in the infrared thermal imaging.
10. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 5 when executing the computer program.
11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010338885.1A CN111626125B (en) | 2020-04-26 | 2020-04-26 | Face temperature detection method, system, device and computer equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010338885.1A CN111626125B (en) | 2020-04-26 | 2020-04-26 | Face temperature detection method, system, device and computer equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111626125A true CN111626125A (en) | 2020-09-04 |
| CN111626125B CN111626125B (en) | 2023-04-28 |
Family
ID=72271779
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010338885.1A Active CN111626125B (en) | 2020-04-26 | 2020-04-26 | Face temperature detection method, system, device and computer equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111626125B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112102207A (en) * | 2020-10-29 | 2020-12-18 | 北京澎思科技有限公司 | Method and device for determining temperature, electronic equipment and readable storage medium |
| CN112107301A (en) * | 2020-09-29 | 2020-12-22 | 深圳市优必选科技股份有限公司 | Human body temperature detection model realization method and device and human body temperature detection method |
| CN112163519A (en) * | 2020-09-28 | 2021-01-01 | 浙江大华技术股份有限公司 | Image mapping processing method, device, storage medium and electronic device |
| CN112380938A (en) * | 2020-11-04 | 2021-02-19 | 浙江大华技术股份有限公司 | Face recognition and temperature measurement method, device, equipment and medium |
| CN112432709A (en) * | 2020-10-28 | 2021-03-02 | 浙江大华技术股份有限公司 | Method and system for measuring temperature of human body |
| CN113537210A (en) * | 2021-05-31 | 2021-10-22 | 浙江大华技术股份有限公司 | Temperature detection method, device, system, computer equipment and storage medium |
| CN113643467A (en) * | 2021-06-29 | 2021-11-12 | 南京信息工程大学 | Integrated infrared imaging gate system based on single chip microcomputer, terminal and detection method |
| CN114061761A (en) * | 2021-11-17 | 2022-02-18 | 重庆大学 | Remote target temperature accurate measurement method based on monocular infrared stereoscopic vision correction |
| WO2022083130A1 (en) * | 2020-10-23 | 2022-04-28 | 深圳市商汤科技有限公司 | Temperature measurement method and apparatus, electronic device, and storage medium |
| CN116407093A (en) * | 2023-03-23 | 2023-07-11 | 北京鹰之眼智能健康科技有限公司 | Automatic acquisition system for infrared image temperature |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040005086A1 (en) * | 2002-07-03 | 2004-01-08 | Equinox Corporation | Method and apparatus for using thermal infrared for face recognition |
| US20160048727A1 (en) * | 2014-08-15 | 2016-02-18 | Konica Minolta Laboratory U.S.A., Inc. | Method and system for recognizing an object |
| CN107133592A (en) * | 2017-05-05 | 2017-09-05 | 国网江苏省电力公司无锡供电公司 | Electricity substation is using infrared thermal imaging and the human body target feature detection algorithm of visual light imaging technological incorporation |
| WO2018000737A1 (en) * | 2016-06-28 | 2018-01-04 | 深圳市元征科技股份有限公司 | Flying body temperature detector control method and device |
| WO2019061293A1 (en) * | 2017-09-29 | 2019-04-04 | 深圳市大疆创新科技有限公司 | Object detection method, object detection terminal, and computer readable medium |
| CN110411570A (en) * | 2019-06-28 | 2019-11-05 | 武汉高德智感科技有限公司 | Infrared human body temperature screening method based on human testing and human body tracking technology |
-
2020
- 2020-04-26 CN CN202010338885.1A patent/CN111626125B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040005086A1 (en) * | 2002-07-03 | 2004-01-08 | Equinox Corporation | Method and apparatus for using thermal infrared for face recognition |
| US20160048727A1 (en) * | 2014-08-15 | 2016-02-18 | Konica Minolta Laboratory U.S.A., Inc. | Method and system for recognizing an object |
| WO2018000737A1 (en) * | 2016-06-28 | 2018-01-04 | 深圳市元征科技股份有限公司 | Flying body temperature detector control method and device |
| CN107133592A (en) * | 2017-05-05 | 2017-09-05 | 国网江苏省电力公司无锡供电公司 | Electricity substation is using infrared thermal imaging and the human body target feature detection algorithm of visual light imaging technological incorporation |
| WO2019061293A1 (en) * | 2017-09-29 | 2019-04-04 | 深圳市大疆创新科技有限公司 | Object detection method, object detection terminal, and computer readable medium |
| CN110411570A (en) * | 2019-06-28 | 2019-11-05 | 武汉高德智感科技有限公司 | Infrared human body temperature screening method based on human testing and human body tracking technology |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112163519A (en) * | 2020-09-28 | 2021-01-01 | 浙江大华技术股份有限公司 | Image mapping processing method, device, storage medium and electronic device |
| CN112107301A (en) * | 2020-09-29 | 2020-12-22 | 深圳市优必选科技股份有限公司 | Human body temperature detection model realization method and device and human body temperature detection method |
| CN112107301B (en) * | 2020-09-29 | 2023-09-29 | 深圳市优必选科技股份有限公司 | Human body temperature detection model implementation method and device and human body temperature detection method |
| WO2022083130A1 (en) * | 2020-10-23 | 2022-04-28 | 深圳市商汤科技有限公司 | Temperature measurement method and apparatus, electronic device, and storage medium |
| CN112432709B (en) * | 2020-10-28 | 2022-03-01 | 浙江大华技术股份有限公司 | Method and system for measuring temperature of human body |
| CN112432709A (en) * | 2020-10-28 | 2021-03-02 | 浙江大华技术股份有限公司 | Method and system for measuring temperature of human body |
| WO2022088886A1 (en) * | 2020-10-28 | 2022-05-05 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for temperature measurement |
| CN112102207A (en) * | 2020-10-29 | 2020-12-18 | 北京澎思科技有限公司 | Method and device for determining temperature, electronic equipment and readable storage medium |
| CN112380938A (en) * | 2020-11-04 | 2021-02-19 | 浙江大华技术股份有限公司 | Face recognition and temperature measurement method, device, equipment and medium |
| CN113537210A (en) * | 2021-05-31 | 2021-10-22 | 浙江大华技术股份有限公司 | Temperature detection method, device, system, computer equipment and storage medium |
| CN113643467A (en) * | 2021-06-29 | 2021-11-12 | 南京信息工程大学 | Integrated infrared imaging gate system based on single chip microcomputer, terminal and detection method |
| CN114061761A (en) * | 2021-11-17 | 2022-02-18 | 重庆大学 | Remote target temperature accurate measurement method based on monocular infrared stereoscopic vision correction |
| CN114061761B (en) * | 2021-11-17 | 2023-12-08 | 重庆大学 | Remote target temperature accurate measurement method based on monocular infrared stereoscopic vision correction |
| CN116407093A (en) * | 2023-03-23 | 2023-07-11 | 北京鹰之眼智能健康科技有限公司 | Automatic acquisition system for infrared image temperature |
| CN116407093B (en) * | 2023-03-23 | 2023-11-10 | 北京鹰之眼智能健康科技有限公司 | Automatic acquisition system for infrared image temperature |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111626125B (en) | 2023-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111626125A (en) | Face temperature detection method, system and device and computer equipment | |
| CN108399367B (en) | Hand motion recognition method and device, computer equipment and readable storage medium | |
| CN108875524B (en) | Sight estimation method, device, system and storage medium | |
| WO2021047232A1 (en) | Interaction behavior recognition method, apparatus, computer device, and storage medium | |
| US11080434B2 (en) | Protecting content on a display device from a field-of-view of a person or device | |
| CN111426388A (en) | Personnel body temperature measuring method, system, computer storage medium and electronic equipment | |
| CN111062239A (en) | Human body target detection method and device, computer equipment and storage medium | |
| WO2021227350A1 (en) | Method and apparatus for measuring temperature, electronic device, and computer-readable storage medium | |
| CN109766882B (en) | Human body light spot label identification method and device | |
| CN105517680A (en) | Device, system and method for recognizing human face, and computer program product | |
| CN111639522A (en) | Living body detection method, living body detection device, computer equipment and storage medium | |
| CN112001953A (en) | Temperature detection method, device, equipment and computer equipment | |
| CN111307331A (en) | Temperature calibration method, device, equipment and storage medium | |
| CN111144398A (en) | Target detection method, target detection device, computer equipment and storage medium | |
| CN110428394A (en) | Method, apparatus and computer storage medium for target mobile detection | |
| CN105491307A (en) | Depth sensor system | |
| Caliwag et al. | Distance estimation in thermal cameras using multi-task cascaded convolutional neural network | |
| CN112525355A (en) | Image processing method, device and equipment | |
| JP2008236276A (en) | Camera apparatus | |
| CN112200002A (en) | Body temperature measuring method and device, terminal equipment and storage medium | |
| CN111695405B (en) | Dog face feature point detection method, device and system and storage medium | |
| CN112084882A (en) | Behavior detection method and device and computer readable storage medium | |
| CN110728172A (en) | Point cloud-based face key point detection method, device and system and storage medium | |
| CN109858363B (en) | Dog nose print feature point detection method, device, system and storage medium | |
| US20190316966A1 (en) | Image processing device and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |