CN111307289B - Body temperature abnormality identification method and device - Google Patents
Body temperature abnormality identification method and device Download PDFInfo
- Publication number
- CN111307289B CN111307289B CN202010099138.7A CN202010099138A CN111307289B CN 111307289 B CN111307289 B CN 111307289B CN 202010099138 A CN202010099138 A CN 202010099138A CN 111307289 B CN111307289 B CN 111307289B
- Authority
- CN
- China
- Prior art keywords
- target object
- video frame
- frame sequence
- body temperature
- visible light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000036760 body temperature Effects 0.000 title claims abstract description 115
- 230000005856 abnormality Effects 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000001931 thermography Methods 0.000 claims abstract description 83
- 238000001514 detection method Methods 0.000 claims abstract description 52
- 230000014509 gene expression Effects 0.000 claims description 39
- 230000006399 behavior Effects 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 12
- 230000004927 fusion Effects 0.000 claims description 4
- 230000003542 behavioural effect Effects 0.000 claims 5
- 230000008030 elimination Effects 0.000 claims 1
- 238000003379 elimination reaction Methods 0.000 claims 1
- 230000002159 abnormal effect Effects 0.000 description 19
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 230000005855 radiation Effects 0.000 description 6
- 208000035473 Communicable disease Diseases 0.000 description 5
- 230000008921 facial expression Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000010195 expression analysis Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 206010005908 Body temperature conditions Diseases 0.000 description 2
- 238000009529 body temperature measurement Methods 0.000 description 2
- 201000010099 disease Diseases 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 230000006806 disease prevention Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000005281 excited state Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 210000001097 facial muscle Anatomy 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000005802 health problem Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
- G01K13/00—Thermometers specially adapted for specific purposes
- G01K13/20—Clinical contact thermometers for use with humans or animals
- G01K13/223—Infrared clinical thermometers, e.g. tympanic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/49—Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Image Analysis (AREA)
Abstract
The application provides a body temperature abnormality identification method and device. The method comprises the following steps: receiving a thermal imaging video frame sequence and a visible light video frame sequence which are collected and sent by a terminal; fusing the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified; identifying the face of a target object in the video frame sequence to be identified; detecting the body temperature of the target object in the corresponding area in the video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized; and if the body temperature abnormality is detected, detecting the behavior state of the target object according to a thermal imaging video frame sequence and a visible light video frame sequence which contain the target object, and determining whether the body temperature abnormality of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object.
Description
Technical Field
The application relates to the technical field of image processing, in particular to a body temperature abnormality identification method and device.
Background
With the improvement of quality of life, people pay more and more attention to health problems. Body temperature is one of vital signs of a human body, reflects the health state of the human body to a certain extent, abnormal body temperature is a typical characteristic of people suffering from infectious diseases, and in stations, schools, large markets and other public places with intensive people, effective defense setting, control and detection on the infectious diseases are required.
At present, an infrared thermometer is used for non-contact body temperature measurement, but the infrared thermometer has strict requirements on the external environment, and factors such as distance, environmental temperature change and the like can influence the measurement result of the body temperature of a human body. For example, when a person is in a running or excited state, the body temperature of the person is generally high, and if a disease early warning is given only according to the infrared body temperature measurement result of the person, a large amount of false early warnings exist, and normal activities of the person are affected. Therefore, in a public place with complex and variable environment and dense people stream, the reliability of measuring the body temperature of the human body by using the infrared thermometer is extremely low, and the false alarm rate is extremely high.
Therefore, how to improve the accuracy of monitoring and early warning for prevention and control of infectious diseases in public places is a problem to be researched and solved urgently in the industry.
Disclosure of Invention
The embodiment of the application provides a body temperature abnormality identification method and device, which are used for improving body temperature abnormality identification precision.
The embodiment of the application provides a body temperature abnormality identification method, which comprises the following steps:
receiving a thermal imaging video frame sequence and a visible light video frame sequence which are collected and sent by a terminal;
fusing the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified;
identifying the face of a target object in a video frame sequence to be identified;
detecting the body temperature of a target object in a corresponding area in a video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized;
and if the body temperature abnormality is detected, detecting the behavior state of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which contain the target object, and determining whether the body temperature abnormality of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object.
In the embodiment of the present application, detecting the behavior state of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence including the target object, and determining whether to eliminate the body temperature abnormality of the target object according to the behavior state detection result and the body temperature detection result of the target object, includes:
detecting the expression of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the temperature abnormality of the target object is eliminated according to the expression detection result and the temperature detection result of the target object; or detecting the micro-motion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the temperature abnormality of the target object is eliminated according to the micro-motion detection result and the temperature detection result of the target object; or detecting the expression and the micromotion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the abnormal body temperature of the target object is eliminated according to the detection result of the expression and the micromotion and the body temperature detection result of the target object.
In an embodiment of the present application, detecting an expression of a target object according to a sequence of thermal imaging video frames and a sequence of visible light video frames containing the target object includes:
if the brightness value of the video frame in the visible light video frame sequence containing the target object is greater than a set threshold value, detecting the expression of the target object according to the video frame sequence formed by fusing the thermal imaging video frame sequence containing the target object and the visible light video frame sequence;
and if the brightness value of the video frame in the visible light video frame sequence containing the target object is lower than the set threshold, detecting the expression of the target object according to the thermal imaging video frame sequence containing the target object.
In an embodiment of the present application, detecting a micro-motion of a target object according to a sequence of thermal imaging video frames and a sequence of visible light video frames containing the target object includes:
and detecting the micro motion of the target object according to the video frame sequence fused by the thermal imaging video frame sequence containing the target object and the visible light video frame sequence.
In an embodiment of the application, the method further comprises: and if the body temperature abnormality of the target object is not excluded, sending alarm information of the body temperature abnormality of the target object.
An embodiment of the present application provides a server, including:
the receiving module is used for receiving a thermal imaging video frame sequence and a visible light video frame sequence which are collected and sent by a terminal;
the fusion module is used for fusing the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified;
the face recognition module is used for recognizing the face of a target object in a video frame sequence to be recognized;
the body temperature detection module is used for detecting the body temperature of the target object in the corresponding area in the video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized;
and the body temperature abnormality eliminating module is used for detecting the behavior state of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which contain the target object when the body temperature detecting module detects the body temperature abnormality, and determining whether the body temperature abnormality of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object.
In an embodiment of the present application, the body temperature abnormality eliminating module is specifically configured to:
detecting the expression of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the temperature abnormality of the target object is eliminated according to the expression detection result and the temperature detection result of the target object; or detecting the micro-motion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the temperature abnormality of the target object is eliminated according to the micro-motion detection result and the temperature detection result of the target object; or detecting the expression and the micromotion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the abnormal body temperature of the target object is eliminated according to the detection result of the expression and the micromotion and the body temperature detection result of the target object.
In an embodiment of the present application, the body temperature abnormality eliminating module is specifically configured to:
if the brightness value of the video frame in the visible light video frame sequence containing the target object is greater than a set threshold value, detecting the expression of the target object according to the video frame sequence formed by fusing the thermal imaging video frame sequence containing the target object and the visible light video frame sequence;
and if the brightness value of the video frame in the visible light video frame sequence containing the target object is lower than the set threshold, detecting the expression of the target object according to the thermal imaging video frame sequence containing the target object.
In an embodiment of the present application, the body temperature abnormality eliminating module is specifically configured to:
and detecting the micro motion of the target object according to the video frame sequence fused by the thermal imaging video frame sequence containing the target object and the visible light video frame sequence.
In an embodiment of the present application, the server further includes:
and the alarm module is used for sending alarm information of the abnormal body temperature of the target object under the condition that the abnormal body temperature eliminating module does not eliminate the abnormal body temperature of the target object.
An embodiment of the present application provides a server, including: a processor and a memory;
a memory coupled to the processor and configured to store computer instructions; a processor coupled to the memory and configured to execute the computer instructions to cause the server to:
receiving a thermal imaging video frame sequence and a visible light video frame sequence which are collected and sent by a terminal;
fusing the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified;
identifying the face of a target object in a video frame sequence to be identified;
detecting the body temperature of a target object in a corresponding area in a video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized;
and if the body temperature abnormality is detected, detecting the behavior state of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which contain the target object, and determining whether the body temperature abnormality of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object.
Embodiments of the present application provide a computer storage medium having computer program instructions stored therein, which when run on a computer, cause the computer to perform a method for body temperature abnormality identification.
In the embodiment of the application, when the body temperature of a human body is measured, on one hand, when light is dark, the thermal imaging video frame sequence and the visible light video frame sequence are fused to obtain the video frame sequence to be recognized, the face of a target object in the video frame sequence to be recognized is recognized, and the face recognition rate is improved; on the other hand, whether the body temperature of the target object is abnormal or not is determined through comprehensive analysis of the body temperature of the target object and the behavior state of the target object in the detected thermal imaging video frame sequence, and the monitoring and early warning accuracy of noticing the control of the infectious diseases in the places is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a diagram schematically illustrating an architecture of a body temperature abnormality recognition system provided by an embodiment of the present application;
fig. 2 is a flowchart illustrating a body temperature abnormality identification method provided by an embodiment of the present application;
fig. 3 schematically illustrates a structural diagram of a server 300 provided in an embodiment of the present application;
fig. 4 schematically shows a structural diagram of a server 400 according to another embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a diagram schematically illustrating an architecture of a body temperature abnormality recognition system according to an embodiment of the present application. As shown in fig. 1, includes: a plurality of terminals 101, a server 102, and a network 103. Each terminal is provided with a thermal imaging camera 1011 and a visible light camera 1012, and is used for acquiring a thermal imaging video frame sequence and a visible light video frame sequence of a monitoring place in real time and sending the thermal imaging video frame sequence and the visible light video frame sequence to a server. The server 103 may be a common web server, an enterprise server, or the like, and is used for implementing a method for identifying abnormal body temperature. The network 102 may be the internet, a local area network, the internet, etc., for connecting data communication between the terminals and the server.
In practical application, the terminal can be deployed in a public place where body temperature detection is needed, for example, at a station entrance position, so as to detect abnormal body temperature conditions of people entering the station.
For clarity of description of the embodiments of the present application, a detailed description of the thermal imaging camera and the visible light camera will be provided below.
A thermal imaging camera: thermal imaging is a camera that detects infrared energy (heat) by non-contact, converts it into an electrical signal, generates a thermal image and a temperature value, and can detect the temperature value. The thermal imaging camera has the following principle: the human body is a naturally occurring source of infrared radiation that does not continue to radiate and absorb infrared radiation. The temperature of each part of a normal human body is stable and special, different temperatures have different thermal fields, and when a certain part is diseased or abnormal, the blood flow at the part can be changed, so that the local temperature is changed. According to the principle, the infrared thermal imaging is to collect the infrared radiation of a human body through a thermal imager, convert the infrared radiation into a digital signal and generate a colorful thermal image. For example, experts in the physical examination center analyze and judge the location, nature and degree of disease of the lesion of the human body based on these heat maps.
Visible light camera: visible light imaging technology is built in the human visual range, carries out prediction in a visible light wave band and depends on natural illumination. In terms of the visual effect of the human eye, different wavelengths of visible radiation cause the human eye to receive different colors, and we refer to a color that corresponds to a wavelength of light radiation as monochromatic light or spectral color, most of which changes with the intensity of light. The visible light camera is manufactured based on a visible light imaging technology, can perform real-time transmission and information processing, and is high in resolution.
Fig. 2 is a flowchart illustrating a body temperature abnormality identification method according to an embodiment of the present application. The process comprises the following steps:
s201: and the server receives the thermal imaging video frame sequence and the visible light video frame sequence which are collected and transmitted by the terminal.
In the step, the thermal imaging video frame sequence is collected and transmitted by the thermal imaging camera, and the visible light video frame sequence is collected and transmitted by the visible light camera. Wherein the sequence of thermographic video frames comprises at least one thermographic video frame and the sequence of visible light video frames comprises at least one visible light video frame. The sequence of thermal imaging video frames may have the same frame rate as the sequence of visible light video frames.
S202: the server fuses the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified, and identifies the face of the target object in the video frame sequence to be identified.
In the step, when the light is dark, the face recognition of the target object is carried out according to the video frame sequence to be recognized after the thermal imaging video frame sequence and the visible light video frame sequence are fused, so that the face recognition rate is improved.
S203: the server detects the body temperature of the target object in the corresponding area in the video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized.
In the step, when the human body temperature is different, the infrared signals sent by the human body are different, and the thermal imaging camera determines the human body temperature condition according to the received infrared signals.
S204: and the server detects whether the body temperature of the target object is abnormal, if so, the step S205 is carried out, and if not, the analysis is finished.
S205: the server detects the behavior state of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which contain the target object.
In this step, the behavior state of the target object includes at least one of a facial expression of the target object and a micro-motion of the target object.
Through facial expression analysis of the target object, the states that the expression of the current target object is excited, happy, difficult and normal and the like can be obtained, and when the facial expression of the target object is happy and excited, the possibility of body temperature abnormality can be eliminated.
Specifically, in step S205 of the process shown in fig. 2, the server may determine whether the light intensity of the environment where the terminal collects the thermal imaging video frame sequence and the visible light video frame sequence is negligible, and if not, fuse the thermal imaging video frame sequence and the visible light video frame sequence of the target object to obtain a video frame sequence to be analyzed by the target object, and obtain the expression of the target object based on a pre-trained expression analysis model; if the expression of the target object can be ignored, the expression of the target object is obtained according to the thermal imaging video frame sequence of the target object based on a pre-trained expression analysis model.
Wherein, under the condition that the visible light can be ignored, the expression of the target object is obtained according to the thermal imaging video frame sequence of the target object because: facial expressions are different, facial muscle congestion is different, facial images of a target object acquired by a thermal imaging camera are different, a thermal imaging video frame sequence acquired by the thermal imaging camera is input into a human face expression analysis model trained in advance, and corresponding expressions can be analyzed.
Through the micro-motion analysis of the target object, when the body temperature of the target object is abnormal and the body state is poor, the situations of high limb action amplitude frequency, quick body gravity center shift and the like generally do not occur, and whether the body temperature of the target object is abnormal or not can be eliminated according to whether the micro-motion exists or not.
Specifically, in step S205 of the flow shown in fig. 2, the server may fuse the thermal imaging video frame sequence and the visible light video frame sequence of the target object to obtain a video frame sequence to be analyzed of the target object, and obtain the micro action of the target object based on a micro action analysis model trained in advance.
S206: and the server determines whether the abnormal body temperature of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object.
In the step, the abnormal body temperature value of the target object can be obtained according to the body temperature, the expression and the micro-action weight of the target object, whether the body temperature of the current target object is abnormal or not is determined according to the abnormal body temperature value, corresponding response is made, when the body temperature of the target object is abnormal, the alarm information can be sent, otherwise, the alarm information is not sent, and the monitoring accuracy of infectious disease prevention and control in public places is improved.
According to the above flow, if the server detects the expression of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence including the target object in S205, the server determines whether to exclude the body temperature abnormality of the target object according to the expression detection result of the target object in S205 and the body temperature detection result of the target object in S203 in S206.
According to the above-mentioned flow, if the server detects the micro-motion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence including the target object in S205, the server determines whether to exclude the body temperature abnormality of the target object according to the micro-motion detection result of the target object in S205 and the body temperature detection result of the target object in S203 in S206.
According to the above-mentioned flow, if the server detects the expression and the fine motion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence including the target object in S205, it is determined whether to exclude the body temperature abnormality of the target object in S206 according to the detection result of the expression and the fine motion of the target object in S205 and the body temperature detection result of the target object in S205.
Based on the same technical concept, the embodiment of the application also provides a server, and the server executes the method in the embodiment.
Referring to fig. 3, a server structure provided in the embodiment of the present application is shown. As shown in the figure, the server 300 includes a receiving module 301, a fusion module 302, a face recognition module 303, a body temperature detection module 304, a body temperature abnormality eliminating module 305, a body temperature detection module 306, and an alarm module 307.
A receiving module 301, configured to receive a thermal imaging video frame sequence and a visible light video frame sequence that are collected and sent by a terminal;
a fusion module 302, configured to fuse the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified;
a face recognition module 303, configured to recognize a face of a target object in a sequence of video frames to be recognized;
a body temperature detection module 304, configured to detect a body temperature of a target object in a corresponding region in a video frame sequence to be recognized according to the region of the face of the target object in the video frame sequence to be recognized;
a body temperature abnormality eliminating module 305, configured to detect a behavior state of the target object according to a thermal imaging video frame sequence and a visible light video frame sequence that include the target object when the body temperature detecting module detects a body temperature abnormality, and determine whether to eliminate the body temperature abnormality of the target object according to a behavior state detection result and a body temperature detection result of the target object;
and the alarm module 306 is configured to send alarm information of the body temperature abnormality of the target subject when the body temperature abnormality eliminating module does not eliminate the body temperature abnormality of the target subject.
Optionally, the body temperature abnormality eliminating module 305 is specifically configured to: detecting the expression of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the temperature abnormality of the target object is eliminated according to the expression detection result and the temperature detection result of the target object; or detecting the micro-motion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the temperature abnormality of the target object is eliminated according to the micro-motion detection result and the temperature detection result of the target object; or detecting the expression and the micromotion of the target object according to the thermal imaging video frame sequence and the visible light video frame sequence which comprise the target object, and determining whether the abnormal body temperature of the target object is eliminated according to the detection result of the expression and the micromotion and the body temperature detection result of the target object.
Optionally, the body temperature abnormality eliminating module 305 is specifically configured to: if the brightness value of the video frame in the visible light video frame sequence containing the target object is greater than a set threshold value, detecting the expression of the target object according to the video frame sequence formed by fusing the thermal imaging video frame sequence containing the target object and the visible light video frame sequence; and if the brightness value of the video frame in the visible light video frame sequence containing the target object is lower than the set threshold, detecting the expression of the target object according to the thermal imaging video frame sequence containing the target object.
Optionally, the body temperature abnormality eliminating module 305 is specifically configured to: and detecting the micro motion of the target object according to the video frame sequence fused by the thermal imaging video frame sequence containing the target object and the visible light video frame sequence.
Based on the same technical concept, the embodiment of the application also provides a server, and the server executes the method in the embodiment.
Fig. 4 shows a schematic structural diagram of a server 400 provided in an embodiment of the present application. Referring to fig. 4, the server 400 includes a processor 401 and a network interface 402. The processor 401 may also be a controller. The processor 401 is configured to perform the functions referred to in fig. 2. The network interface 402 is configured to support messaging functionality. The server 400 may also include a memory 403, the memory 403 being coupled to the processor 401 and storing program instructions and data necessary for the device. The processor 401, the network interface 402 and the memory 403 are connected, the memory 403 is used for storing instructions, and the processor 401 is used for executing the instructions stored in the memory 403 to control the network interface 402 to send and receive messages, so as to complete the steps of the method for executing corresponding functions.
In the embodiment of the present application, for concepts, explanations, details, and other steps related to the technical solution provided in the embodiment of the present application, reference is made to the description of the foregoing method or the related steps in other embodiments, and details are not described herein.
It should be noted that the processor referred to in the embodiments of the present application may be a Central Processing Unit (CPU), a general purpose processor, a Digital Signal Processor (DSP), an application-specific integrated circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic devices, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. A processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, a DSP and a microprocessor, or the like. Wherein the memory may be integrated in the processor or may be provided separately from the processor.
Embodiments of the present application also provide a computer storage medium for storing instructions that, when executed, may perform the method of the foregoing embodiments.
The embodiments of the present application also provide a computer program product for storing a computer program, where the computer program is used to execute the method of the foregoing embodiments.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A body temperature abnormality identification method is characterized by comprising the following steps:
receiving a thermal imaging video frame sequence and a visible light video frame sequence which are collected and sent by a terminal;
fusing the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified;
identifying the face of a target object in the video frame sequence to be identified;
detecting the body temperature of the target object in the corresponding area in the video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized;
if the body temperature abnormality is detected, detecting the behavior state of the target object according to a thermal imaging video frame sequence and a visible light video frame sequence which contain the target object, and determining whether the body temperature abnormality of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object; wherein the behavioral state of the target object comprises an expression and/or a micro-action of the target object.
2. The method of claim 1, wherein detecting the target object's expression based on a sequence of thermal imaging video frames and a sequence of visible light video frames comprising the target object when the target object's behavioral state comprises the target object's expression comprises:
if the brightness value of the video frame in the visible light video frame sequence containing the target object is greater than a set threshold value, detecting the expression of the target object according to a video frame sequence formed by fusing a thermal imaging video frame sequence containing the target object and the visible light video frame sequence;
and if the brightness value of the video frame in the visible light video frame sequence containing the target object is lower than a set threshold value, detecting the expression of the target object according to the thermal imaging video frame sequence containing the target object.
3. The method of claim 1, wherein detecting the micro-motion of the target object based on a sequence of thermal imaging video frames and a sequence of visible light video frames comprising the target object when the behavioral state of the target object comprises the micro-motion of the target object comprises:
and detecting the micro motion of the target object according to the video frame sequence formed by fusing the thermal imaging video frame sequence containing the target object and the visible light video frame sequence.
4. The method of any one of claims 1-3, further comprising:
and if the body temperature abnormality of the target object is not excluded, sending alarm information of the body temperature abnormality of the target object.
5. A server, comprising:
the receiving module is used for receiving a thermal imaging video frame sequence and a visible light video frame sequence which are collected and sent by a terminal;
the fusion module is used for fusing the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified;
the face recognition module is used for recognizing the face of the target object in the video frame sequence to be recognized;
the body temperature detection module is used for detecting the body temperature of the target object in the corresponding area in the video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized;
the body temperature abnormality elimination module is used for detecting the behavior state of the target object according to a thermal imaging video frame sequence and a visible light video frame sequence which contain the target object when the body temperature detection module detects the body temperature abnormality, and determining whether the body temperature abnormality of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object; wherein the behavioral state of the target object comprises an expression and/or a micro-action of the target object.
6. The server according to claim 5, wherein the body temperature abnormality eliminating module is specifically configured to:
if the brightness value of the video frame in the visible light video frame sequence containing the target object is greater than a set threshold value, detecting the expression of the target object according to a video frame sequence formed by fusing a thermal imaging video frame sequence containing the target object and the visible light video frame sequence;
and if the brightness value of the video frame in the visible light video frame sequence containing the target object is lower than a set threshold value, detecting the expression of the target object according to the thermal imaging video frame sequence containing the target object.
7. The server according to claim 5, wherein the body temperature abnormality eliminating module is specifically configured to:
and detecting the micro motion of the target object according to the video frame sequence formed by fusing the thermal imaging video frame sequence containing the target object and the visible light video frame sequence.
8. The server according to any one of claims 5-7, further comprising:
and the alarm module is used for sending alarm information of the body temperature abnormality of the target object under the condition that the body temperature abnormality eliminating module does not eliminate the body temperature abnormality of the target object.
9. A server, comprising: a processor and a memory;
the memory, coupled to the processor, configured to store computer instructions; the processor, coupled to the memory, configured to execute the computer instructions to cause the server to:
receiving a thermal imaging video frame sequence and a visible light video frame sequence which are collected and sent by a terminal;
fusing the thermal imaging video frame sequence and the visible light video frame sequence to obtain a video frame sequence to be identified;
identifying the face of a target object in the video frame sequence to be identified;
detecting the body temperature of the target object in the corresponding area in the video frame sequence to be recognized according to the area of the face of the target object in the video frame sequence to be recognized;
if the body temperature abnormality is detected, detecting the behavior state of the target object according to a thermal imaging video frame sequence and a visible light video frame sequence which contain the target object, and determining whether the body temperature abnormality of the target object is eliminated or not according to the behavior state detection result and the body temperature detection result of the target object in the corresponding region in the thermal imaging video frame sequence; wherein the behavioral state of the target object comprises an expression and/or a micro-action of the target object.
10. A computer storage medium having computer program instructions stored therein, which when run on a computer, cause the computer to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010099138.7A CN111307289B (en) | 2020-02-18 | 2020-02-18 | Body temperature abnormality identification method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010099138.7A CN111307289B (en) | 2020-02-18 | 2020-02-18 | Body temperature abnormality identification method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111307289A CN111307289A (en) | 2020-06-19 |
| CN111307289B true CN111307289B (en) | 2021-08-27 |
Family
ID=71149112
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010099138.7A Active CN111307289B (en) | 2020-02-18 | 2020-02-18 | Body temperature abnormality identification method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111307289B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101972140A (en) * | 2010-09-07 | 2011-02-16 | 航天海鹰安全技术工程有限公司 | Thermal imaging temperature monitoring device, system and method |
| CN106919806A (en) * | 2017-04-27 | 2017-07-04 | 刘斌 | A kind of human body monitoring method, device and system and computer readable storage devices |
| CN109846463A (en) * | 2019-03-04 | 2019-06-07 | 武汉迅检科技有限公司 | Infrared face temp measuring method, system, equipment and storage medium |
| CN209043461U (en) * | 2018-06-06 | 2019-06-28 | 深圳市凯利博实业有限公司 | Body temperature measuring device |
| CN110471534A (en) * | 2019-08-23 | 2019-11-19 | 靖江市人民医院 | Information processing method and tele-medicine management system based on Emotion identification |
| CN110633682A (en) * | 2019-09-19 | 2019-12-31 | 合肥英睿系统技术有限公司 | Infrared image anomaly monitoring method, device and equipment based on double-light fusion |
-
2020
- 2020-02-18 CN CN202010099138.7A patent/CN111307289B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101972140A (en) * | 2010-09-07 | 2011-02-16 | 航天海鹰安全技术工程有限公司 | Thermal imaging temperature monitoring device, system and method |
| CN106919806A (en) * | 2017-04-27 | 2017-07-04 | 刘斌 | A kind of human body monitoring method, device and system and computer readable storage devices |
| CN209043461U (en) * | 2018-06-06 | 2019-06-28 | 深圳市凯利博实业有限公司 | Body temperature measuring device |
| CN109846463A (en) * | 2019-03-04 | 2019-06-07 | 武汉迅检科技有限公司 | Infrared face temp measuring method, system, equipment and storage medium |
| CN110471534A (en) * | 2019-08-23 | 2019-11-19 | 靖江市人民医院 | Information processing method and tele-medicine management system based on Emotion identification |
| CN110633682A (en) * | 2019-09-19 | 2019-12-31 | 合肥英睿系统技术有限公司 | Infrared image anomaly monitoring method, device and equipment based on double-light fusion |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111307289A (en) | 2020-06-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200205697A1 (en) | Video-based fall risk assessment system | |
| US9763571B2 (en) | Monitoring a person for indications of a brain injury | |
| Xefteris et al. | Performance, challenges, and limitations in multimodal fall detection systems: A review | |
| EP2840557B1 (en) | Image processing system, server device, image pickup device and image evaluation method | |
| JP2019523943A (en) | Control apparatus, system and method for determining perceptual load of visual and dynamic driving scene | |
| CN111666920B (en) | Target article wearing detection method and device, storage medium and electronic device | |
| CN107590953B (en) | Alarm method and system of intelligent wearable device and terminal device | |
| US10667737B2 (en) | Monitoring a person for indications of a brain injury | |
| KR102300049B1 (en) | Fault diagnosis apparatus and method using frequency analysis based on machine-learning | |
| US9968287B2 (en) | Monitoring a person for indications of a brain injury | |
| Ding et al. | Noncontact multiphysiological signals estimation via visible and infrared facial features fusion | |
| CN111307289B (en) | Body temperature abnormality identification method and device | |
| JP2002032872A (en) | Fire detector | |
| CN104754301A (en) | Automatic monitoring system with near-end nursing function and cloud end transmitting function | |
| Nguyen et al. | An Embedded Machine Learning System For Real-time Face Mask Detection And Human Temperature Measurement | |
| CN113017634B (en) | Emotion evaluation method, emotion evaluation device, electronic device, and computer-readable storage medium | |
| CN213274581U (en) | In-car face identification temperature measurement system | |
| Saranya et al. | Human body temperature and face mask audit system for COVID protocol | |
| Cheung et al. | Low cost intelligent computer vision based assistive technology for elderly people | |
| Mirmahboub et al. | View-invariant fall detection system based on silhouette area and orientation | |
| Garimella et al. | Comparison of Fall Risk Prediction of Patients using Tree Algorithms implemented on a wearable belt | |
| CN117723158B (en) | Non-contact body temperature monitoring system and method thereof | |
| CN111528810B (en) | Body temperature detection method and device, wearable equipment and computer storage medium | |
| CN117352151B (en) | Intelligent accompanying management system and method thereof | |
| EP4012638A1 (en) | System and method for providing intelligent infant care service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231017 Address after: Room 201, Building A, Integrated Circuit Design Industrial Park, No. 858, Jianshe 2nd Road, Economic and Technological Development Zone, Xiaoshan District, Hangzhou City, Zhejiang Province, 311215 Patentee after: Zhejiang Huagan Technology Co.,Ltd. Address before: Hangzhou City, Zhejiang province Binjiang District 310053 shore road 1187 Patentee before: ZHEJIANG DAHUA TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |