CN111597923B - Method and device for monitoring personnel temperature and electronic equipment - Google Patents

Method and device for monitoring personnel temperature and electronic equipment Download PDF

Info

Publication number
CN111597923B
CN111597923B CN202010351854.XA CN202010351854A CN111597923B CN 111597923 B CN111597923 B CN 111597923B CN 202010351854 A CN202010351854 A CN 202010351854A CN 111597923 B CN111597923 B CN 111597923B
Authority
CN
China
Prior art keywords
human body
image
temperature
target
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010351854.XA
Other languages
Chinese (zh)
Other versions
CN111597923A (en
Inventor
张浩杰
邢文杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Weishengde Intelligent Technology Co ltd
Original Assignee
Shanghai Weishengde Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Weishengde Intelligent Technology Co ltd filed Critical Shanghai Weishengde Intelligent Technology Co ltd
Priority to CN202010351854.XA priority Critical patent/CN111597923B/en
Publication of CN111597923A publication Critical patent/CN111597923A/en
Application granted granted Critical
Publication of CN111597923B publication Critical patent/CN111597923B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0022Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
    • G01J5/0025Living bodies
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/28Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components

Abstract

The embodiment of the specification provides a method for monitoring the temperature of a person, wherein a client of a terminal acquires infrared image data through a data interface between the client and an infrared camera module, converts the infrared image data into gray image data, extracts target part characteristics belonging to the same human body by using a constructed human body identification model, calculates corresponding temperature data, generates and displays an image with the human body based on the target part characteristics belonging to the same human body, monitors the temperature condition of the human body, and has strong convenience and high accuracy because no visible light image is required to be acquired in the monitoring process or the picture synchronism of the infrared image and the visible light image is not required to be relied on. By identifying and extracting the target part characteristics belonging to the same human body, the generated image can reflect the whole human body, and even if a plurality of monitored personnel exist, the corresponding human bodies in the image can be accurately distinguished, so that the temperature monitoring can be carried out on a plurality of people at the same time, and the monitoring efficiency is high.

Description

Method and device for monitoring personnel temperature and electronic equipment
Technical Field
The present disclosure relates to the field of computers, and in particular, to a method, an apparatus, and an electronic device for monitoring a temperature of a person.
Background
With the increase of people's health consciousness, it is becoming more common to measure the body temperature of people in areas where people are dense. Non-contact temperature measurement is widely practiced because it is possible to monitor the temperature without requiring contact.
The principle of the method is that infrared signals are collected, infrared data are utilized to calculate the temperature, and infrared thermal image is generated by utilizing the infrared data to display the monitored personnel. However, thermal imaging is less accurate because of the blurry infrared thermography.
In order to improve the accuracy of thermal imaging, a mode of combining a visible light display image is generated in the industry, equipment with a display screen is respectively connected with an infrared camera and a visible light camera, the visible light image and the infrared image are respectively collected, the position of a face in the infrared image is positioned, the temperature of the face is calculated, the calculated temperature is marked in the matched face area by matching the area of the face in the visible light image, and therefore support is provided for equipment users (monitoring staff).
However, this way needs to collect infrared signals and visible light signals respectively by using an infrared camera and a visible light camera, so that not only is the collection convenience poor, but also the requirement on the collection positions of the two cameras and the synchronization of the collected pictures is high because the two images are required to be processed, so that the problem of face calibration errors is easy to occur, and the monitoring accuracy is low.
Therefore, a new monitoring method is needed to improve the convenience and accuracy of temperature monitoring for personnel.
Disclosure of Invention
The embodiment of the specification provides a method, a device and electronic equipment for monitoring the temperature of a person, which are used for improving the convenience and accuracy of monitoring the temperature of the person.
The embodiment of the specification provides a method for monitoring temperature of a person, which comprises the following steps:
constructing a human body recognition model, and importing the human body recognition model into a terminal;
the client of the terminal obtains infrared image data acquired by the infrared camera module through a data interface between the client and the infrared camera module, performs human body identification by utilizing the infrared image data, generates and displays an image with a human body, and comprises the following steps:
converting the infrared image data into grayscale image data;
invoking the human body recognition model which is pre-imported, carrying out feature recognition on the gray image data and extracting target part features belonging to the same human body;
calculating temperature data corresponding to the target part by utilizing the infrared image data;
and generating and displaying an image with the human body based on the target part characteristics belonging to the same human body, and monitoring the temperature condition of the human body by utilizing the temperature data.
Optionally, the building the human body recognition model includes:
obtaining a visible light image sample, the visible light image sample comprising: a black sample and a white sample, the white sample having a plurality of target sites belonging to the same human body, the black sample not having a plurality of target sites belonging to the same human body;
calibrating a plurality of target parts belonging to the same human body in the white sample;
and training a human body recognition model by using the visible light image sample in a supervised learning mode.
Optionally, the visible light image sample has a plurality of human bodies therein;
the calibrating the plurality of target parts belonging to the same human body in the white sample further comprises:
and calibrating the target parts of different human bodies respectively.
Optionally, the human body recognition model is a convolutional neural network model.
Optionally, the generating and displaying the image with the human body based on the target site features belonging to the same human body, and monitoring the temperature condition of the human body by using the temperature data includes:
simulating the human body contour by utilizing the characteristics of a plurality of human body target parts belonging to the same human body;
and analyzing and rendering by using the simulated human body outline to generate and display an image with a human body, and monitoring the temperature condition of the human body by using the temperature data.
Optionally, the analyzing, rendering and displaying the image with the human body by using the simulated human body outline, and monitoring the temperature condition of the human body by using the temperature data includes:
and analyzing and rendering by utilizing the temperature data and the simulated human body outline to generate and display an image with human body and temperature prompt information.
Optionally, the monitoring the temperature condition of the human body using the temperature data includes:
and prompting the temperature condition of the human body at the target part if the temperature data corresponding to the target part meets the preset alarm condition.
Optionally, the temperature data corresponding to the target portion meets a preset alarm condition, including:
the temperature corresponding to the target part exceeds a preset temperature range.
Optionally, the temperature data corresponding to the target portion meets a preset alarm condition, and further includes:
the deviation between the temperature data corresponding to a plurality of human body target parts belonging to the same human body exceeds a preset deviation threshold value.
Optionally, the acquiring the infrared image data acquired by the infrared camera module, performing human body identification by using the infrared image data, generating and displaying an image with a human body, and further includes:
Acquiring infrared image data acquired by the infrared camera module in a time interval, and performing human body identification by utilizing the infrared image data acquired by the adjacent time interval, and sequentially generating and displaying a first image and a second image with a human body in a time interval;
if the temperature data corresponding to the target part meets the preset alarm condition, prompting the temperature condition of the human body at the target part, including:
if the temperature data corresponding to the target part of the human body contained in the first image meets the preset alarm condition, determining a target human body with abnormal temperature in the first image, identifying the human body corresponding to the target human body in the second image, and prompting the temperature condition of the target human body to a user through the second image.
The embodiment of the specification also provides a device for monitoring the temperature of a person, which comprises:
the construction module is used for constructing a human body recognition model and importing the human body recognition model into the terminal;
the identification monitoring module, the client of terminal is through the data interface with infrared camera module acquire infrared image data that infrared camera module gathered, utilize infrared image data carries out human discernment, generates and demonstrates the image that has the human body, includes:
Converting the infrared image data into grayscale image data;
invoking the human body recognition model which is pre-imported, carrying out feature recognition on the gray image data and extracting target part features belonging to the same human body;
calculating temperature data corresponding to the target part by utilizing the infrared image data;
and generating and displaying an image with the human body based on the target part characteristics belonging to the same human body, and monitoring the temperature condition of the human body by utilizing the temperature data.
The embodiment of the specification also provides an electronic device, wherein the electronic device comprises:
a processor; the method comprises the steps of,
a memory storing computer executable instructions that, when executed, cause the processor to perform any of the methods described above.
The present description also provides a computer-readable storage medium storing one or more programs that, when executed by a processor, implement any of the methods described above.
According to the various technical schemes provided by the embodiment of the specification, the human body recognition model is constructed and is imported into the terminal, the client of the terminal acquires infrared image data through a data interface between the client and the infrared camera module and converts the infrared image data into gray image data, the constructed human body recognition model is utilized to extract the characteristics of the target parts belonging to the same human body, corresponding temperature data is calculated, the image with the human body is generated and displayed based on the characteristics of the target parts belonging to the same human body, the temperature condition of the human body is monitored, and as the visible light image does not need to be acquired in the monitoring process and the picture synchronism of the infrared image and the visible light image does not need to be relied on, the convenience is high and the accuracy is high. By identifying and extracting the target part characteristics belonging to the same human body, the generated image can reflect the whole human body, and even if a plurality of monitored personnel exist, the corresponding human bodies in the image can be accurately distinguished, so that the temperature monitoring can be carried out on a plurality of people at the same time, and the monitoring efficiency is high.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
FIG. 1 is a schematic diagram of a method for monitoring a person's temperature according to an embodiment of the present disclosure;
FIG. 2 is a schematic structural diagram of a device for monitoring temperature of a person according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a computer readable medium according to an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present invention will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments can be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art. The same reference numerals in the drawings denote the same or similar elements, components or portions, and thus a repetitive description thereof will be omitted.
The features, structures, characteristics or other details described in a particular embodiment do not exclude that may be combined in one or more other embodiments in a suitable manner, without departing from the technical idea of the invention.
In the description of specific embodiments, features, structures, characteristics, or other details described in the present invention are provided to enable one skilled in the art to fully understand the embodiments. However, it is not excluded that one skilled in the art may practice the present invention without one or more of the specific features, structures, characteristics, or other details.
The flow diagrams depicted in the figures are exemplary only, and do not necessarily include all of the elements and operations/steps, nor must they be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the order of actual execution may be changed according to actual situations.
The block diagrams depicted in the figures are merely functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The term "and/or" and/or "includes all combinations of any one or more of the associated listed items.
Fig. 1 is a schematic diagram of a method for monitoring a temperature of a person according to an embodiment of the present disclosure, where the method may include:
s101: and constructing a human body recognition model and importing the human body recognition model into a terminal.
In the embodiment of the present disclosure, since thermal imaging is directly performed by using infrared signals, it is necessary to imagine a human shape in a thermal image by using naked eyes according to the thermal image, and thus, if the infrared image data can be extracted by using a human body recognition model capable of recognizing a human body shape, the extracted features can be used to generate an image, so that the interference can be eliminated and a clearer human body image can be generated.
Thus, the building of the human body recognition model may comprise:
obtaining a visible light image sample, the visible light image sample comprising: a black sample and a white sample, the white sample having a plurality of target sites belonging to the same human body, the black sample not having a plurality of target sites belonging to the same human body;
calibrating a plurality of target parts belonging to the same human body in the white sample;
And training a human body recognition model by using the visible light image sample in a supervised learning mode.
By calibrating a plurality of target sites belonging to the same human body, the human body recognition model can be used to obtain the association of the plurality of target sites belonging to the same human body, and the plurality of target sites of the same human body can be recognized by using the human body recognition model.
In this embodiment of the present disclosure, the visible light image sample is a grayscale image sample.
Wherein training the human body recognition model in a supervised learning manner using the visible light image sample may include:
and converting the calibrated image sample into a gray level image, and training the human body recognition model by using the converted gray level image in a supervised learning mode.
Therefore, by calibrating a plurality of target parts belonging to the same human body before converting the visible light image sample into the gray level image for training, the human body part characteristics under the color characteristics of the visible light image sample can be utilized, the color characteristics are favorable for a calibrator to identify fine characteristics, compared with the calibration performed after converting the visible light image sample into the gray level image, the calibration accuracy is improved, the model identification accuracy obtained by training is high by training through the sample, and the accuracy of the temperature monitoring process is further improved.
In the specific conversion, the visible light image sample can be converted into a gray image according to the brightness of the image.
In which, in order to further improve the accuracy, black samples having a plurality of human body parts, which belong to different human bodies, may be collected.
Thus, the black sample includes: an image having no target portion of a human body and an image having a plurality of target portions not belonging to the same human body.
In the actual scene, when temperature monitoring is performed on a plurality of people, especially when two people are mutually shielded, eyes cannot directly distinguish which human body a certain part belongs to, but in consideration of spatial correlation of a plurality of target parts of the same human body, for example, left hand and right hand can be mirror images sometimes, in order to enable a human body recognition model to accurately recognize each human body, a sample image with a plurality of human bodies can be selected for training.
Therefore, in the embodiment of the present specification, the visible light image sample may have a plurality of human bodies therein;
the calibrating the plurality of target parts belonging to the same human body in the white sample further comprises:
and calibrating the target parts of different human bodies respectively.
In an embodiment of the present disclosure, to enrich the training samples, the method may further include:
a spatial transform process on the visible light image samples, the spatial transform process including at least one of rotation, scaling, and mirroring;
and calibrating target parts of all human bodies in the visible light image sample.
In the embodiment of the present specification, the human body recognition model may be a convolutional neural network model.
In particular, there are many improvements or optimization categories (such as VGG-19 networks) for convolutional neural network models.
In specific training, a Gaussian response can be arranged in the region of the target part in the image to construct a true value of a response diagram, the visible light image sample is processed by the first 10 layers of the VGG-19 network to obtain picture characteristics, the response diagram of each target part expresses space constraint among the target parts, the response diagram and the characteristic diagram are transmitted together as data in the network, and finally, the training of the model can accurately identify the target parts, the identified target parts can meet the space constraint characteristics of the human body, and the space relation (including far-near relation) of each target part of the same human body is considered.
In order to accurately identify the target portion, gaussian responses of various scales (which may refer to sizes) may be set to identify target portions of different scales.
The prior art has many disclosures about the way in which the convolutional neural network model is trained after the training samples are selected and the labels are set, and they are not described in detail herein.
In practical application, the convenience of infrared temperature measurement can be greatly improved by taking into consideration that a training model can be called by using smaller common hardware. Thus, in embodiments of the present description, the method may further comprise:
the method comprises the steps of adjusting the size of a human body recognition model to be trained according to the CPU size of a terminal to be imported into the human body recognition model, and converting the human body recognition model into a model which can be used by a mobile terminal by utilizing TensorFlow Lite converter;
and importing the converted human body recognition model into the mobile terminal. The mobile terminal may be an android phone. Wherein TensorFlow Lite converter is a model converter in an artificial intelligence learning system.
In practice, the simplest approach is to weigh the weights to 8 bits during reasoning and quantize the input/activation "on the fly", which has latency advantages, but prioritizes reducing the model size, setting the optimizations flag to optimize for size during conversion.
S102: the client of the terminal obtains infrared image data acquired by the infrared camera module through a data interface between the client and the infrared camera module, performs human body identification by utilizing the infrared image data, generates and displays an image with a human body, and comprises the following steps:
Converting the infrared image data into grayscale image data;
invoking the human body recognition model which is pre-imported, carrying out feature recognition on the gray image data and extracting target part features belonging to the same human body;
calculating temperature data corresponding to the target part by utilizing the infrared image data;
and generating and displaying an image with the human body based on the target part characteristics belonging to the same human body, and monitoring the temperature condition of the human body by utilizing the temperature data.
The human body recognition model is built and is imported into the terminal, the client of the terminal obtains infrared image data through a data interface between the client and the infrared camera module, the infrared image data are converted into gray image data, the built human body recognition model is utilized to extract target part characteristics of the same human body, corresponding temperature data are calculated, an image with the human body is generated and displayed based on the target part characteristics of the same human body, the temperature condition of the human body is monitored, and as the visible light image is not required to be acquired in the monitoring process, the picture synchronism of the infrared image and the visible light image is not required to be relied on, so that convenience is strong and accuracy is high. By identifying and extracting the target part characteristics belonging to the same human body, the generated image can reflect the whole human body, and even if a plurality of monitored personnel exist, the corresponding human bodies in the image can be accurately distinguished, so that the temperature monitoring can be carried out on a plurality of people at the same time, and the monitoring efficiency is high.
When the infrared camera module is used, the terminal can be connected with the infrared camera module through a data line, and the terminal acquires the infrared image data recalled by the infrared camera module and processes the infrared image data.
The terminal obtains the infrared image data recalled by the infrared camera module, and the method can comprise the following steps:
and acquiring infrared image data recalled by the infrared camera module according to the YUV channel.
Because the mobile terminal is more common, the temperature monitoring can be carried out only by obtaining one infrared camera module, the requirement on hardware is low, the overall cost is low, the assembly is easy, the time required by the combination is short, and the convenience is greatly improved.
After the client of the terminal acquires the infrared image data, the human body recognition model is imported into the client, and the human body recognition model is utilized to extract the characteristics of the infrared image data, so that the infrared image data can be utilized to perform human body recognition, and an image with a human body is generated and displayed.
Specifically, the method for performing human body identification by using the infrared image data, generating and displaying an image with a human body, may include:
converting the infrared image data into grayscale image data;
invoking the human body recognition model which is pre-imported, carrying out feature recognition on the gray image data and extracting target part features belonging to the same human body;
Calculating temperature data corresponding to the target part by utilizing the infrared image data;
and generating and displaying an image with the human body based on the target part characteristics belonging to the same human body, and monitoring the temperature condition of the human body by utilizing the temperature data.
The infrared image data is converted into gray image data, which may be converted into gray coordinates under RGB color coordinates according to a color data channel RGB of a client display image of a terminal, so that a temperature distribution condition represented by the infrared image data may be converted into a gray distribution condition.
For the above embodiments: the client acquires infrared image data acquired by the infrared camera module through a data interface between the client and the infrared camera module, and one specific implementation mode is that the terminal acquires a camera ID, opens the camera and receives brightness data Y of a camera data callback 14 Since the data stream uploaded to the android consists of three channels (y, u, v). Thus, for Y, Y can be directly utilized 14 For u, v, the conversion may be filled in according to the set data, such as y=y 14 *255/16383, u=128, v=128, so that callback is made to the storage space or running memory of the terminal. For the conversion of the infrared image data into gray scale image data in the above embodiment, (y, u, v) is converted into gray scale data in rgb chromaticity coordinates: (r, g, b) specifically may be: r=clip (y), g=clip (y), b=clip (y).
After (r, g and b) are obtained, the gray level image under the rgb coordinates can be obtained according to the rgb data combination corresponding to each pixel point.
Wherein Y is brightness data collected by an infrared camera, the subscript 14 is a description of the storage position thereof,because in one embodiment, the data pixel format bit width is obtained as 14 bits, put in the lower 14 bits of 2 bytes, put in small-end storage, then use Y 14 To represent infrared image data, y=y 14 *255/16383 is to adjust the brightness according to the brightness threshold value of the terminal display, and after the adjustment, the brightness range of the terminal display can be adapted to the change range of the infrared data generated by the display human body.
It should be noted that the image data is only a set of data that can be combined into an image, and when combined, the image data may be combined according to the pixel positions corresponding to the respective data, which is not described in detail herein.
After the gray image data are obtained and combined into a gray image, the feature recognition can be carried out on the gray image data by calling the pre-introduced human body recognition model, and the target part features belonging to the same human body can be extracted.
Calculating temperature data corresponding to the target portion using the infrared image data may include:
The infrared image data calculate temperature data corresponding to each pixel coordinate point;
and determining temperature data corresponding to the target part according to the pixel coordinate points corresponding to the target part.
In this way, the temperature data can be correlated to the target part characteristics belonging to the same human body, so as to monitor.
In an embodiment of the present disclosure, the generating and displaying an image with a human body based on the target site features belonging to the same human body, and monitoring a temperature condition of the human body using the temperature data may include:
simulating the human body contour by utilizing the characteristics of a plurality of human body target parts belonging to the same human body;
and analyzing and rendering by using the simulated human body outline to generate and display an image with a human body, and monitoring the temperature condition of the human body by using the temperature data.
The human body contours are simulated by utilizing the characteristics of a plurality of human body target parts belonging to the same human body, the simulated human body contours are utilized to analyze, render and display images with human bodies, so that a monitor can see picture information taking the human bodies as units from the images.
In the embodiment of the specification, the temperature prompt can be displayed in the displayed image with the human body at the same time, so that the monitoring process is more visual. Therefore, the analyzing, rendering and displaying the image with the human body by using the simulated human body outline, and monitoring the temperature condition of the human body by using the temperature data may include:
and analyzing and rendering by utilizing the temperature data and the simulated human body outline to generate and display an image with human body and temperature prompt information.
In a practical scenario, when monitoring a plurality of people at the same time, a plurality of monitored people often scatter the attention of the monitored people, however, in consideration of the fact that the purpose of monitoring is to identify people with abnormal temperature, an alarm condition can be set, and temperature prompt can be selectively carried out.
Thus, in an embodiment of the present disclosure, the monitoring the temperature condition of the human body using the temperature data may include:
and prompting the temperature condition of the human body at the target part if the temperature data corresponding to the target part meets the preset alarm condition.
In one embodiment, the temperature data corresponding to the target portion meets a preset alarm condition, which may include:
The temperature corresponding to the target part exceeds a preset temperature range.
Considering that the temperature of different people, different seasons and different time periods can fluctuate, however, the temperature relationship of a plurality of parts in the same human body is always a certain rule, for example, when the temperature of a plurality of parts of the human body is high in the sky and the temperature difference is small, so that the temperature difference is small, and the alarm can be given by utilizing the deviation between the temperature data corresponding to a plurality of target parts of the human body of the same human body.
Therefore, in the embodiment of the present disclosure, the temperature data corresponding to the target portion may satisfy a preset alarm condition, and may further include:
the deviation between the temperature data corresponding to a plurality of human body target parts belonging to the same human body exceeds a preset deviation threshold value.
In the practical application scene, the mode can identify the behavior of temperature cheating, for example, the forehead and the ear of the fevers are high in temperature, however, the fevers are likely to use cold water to compress the forehead in a short time so as to avoid temperature monitoring, and the temperature deviation between the forehead and the ear of a person is too high because the ear of the fevers is still high, so that an alarm can be given, the person at high risk is identified by the monitor, and the misjudgment rate caused by cheating of the person to be monitored can be reduced.
In view of the fact that when temperature monitoring is performed on a plurality of persons, due to the change of the posture positions of the persons, a person with abnormal temperature and a target part of the person can possibly appear, but the part is blocked later, so that infrared signals generated by the part cannot be collected later, in this case, infrared image data can be collected in a time-sharing mode, images with the person are generated and displayed by using the infrared image data collected at different moments, and corresponding images of the person in future images are identified according to the person with abnormal temperature identified in the past, therefore, tracking and positioning can be continuously performed on the person with abnormal temperature, and particularly when the abnormal temperature part of the person with abnormal temperature is blocked, the person with abnormal temperature can still be found according to the tracked person in the images.
Based on this concept, in the embodiment of the present disclosure, the acquiring the infrared image data acquired by the infrared camera module, performing human body identification by using the infrared image data, and generating and displaying an image with a human body may further include:
acquiring infrared image data acquired by the infrared camera module in a time interval, and performing human body identification by utilizing the infrared image data acquired by the adjacent time interval, and sequentially generating and displaying a first image and a second image with a human body in a time interval;
If the temperature data corresponding to the target portion meets a preset alarm condition, prompting the temperature condition of the human body at the target portion may include:
if the temperature data corresponding to the target part of the human body contained in the first image meets the preset alarm condition, determining a target human body with abnormal temperature in the first image, identifying the human body corresponding to the target human body in the second image, and prompting the temperature condition of the target human body to a user through the second image.
Fig. 2 is a schematic structural diagram of a device for monitoring a temperature of a person according to an embodiment of the present disclosure, where the device may include:
the construction module 201 constructs a human body recognition model and guides the human body recognition model into a terminal;
the recognition monitoring module 202, the client of the terminal obtains the infrared image data collected by the infrared camera module through the data interface between the client and the infrared camera module, and performs human body recognition by using the infrared image data, so as to generate and display an image with a human body, which comprises:
converting the infrared image data into grayscale image data;
invoking the human body recognition model which is pre-imported, carrying out feature recognition on the gray image data and extracting target part features belonging to the same human body;
Calculating temperature data corresponding to the target part by utilizing the infrared image data;
and generating and displaying an image with the human body based on the target part characteristics belonging to the same human body, and monitoring the temperature condition of the human body by utilizing the temperature data.
Optionally, the building the human body recognition model includes:
obtaining a visible light image sample, the visible light image sample comprising: a black sample and a white sample, the white sample having a plurality of target sites belonging to the same human body, the black sample not having a plurality of target sites belonging to the same human body;
calibrating a plurality of target parts belonging to the same human body in the white sample;
and training a human body recognition model by using the visible light image sample in a supervised learning mode.
Optionally, the visible light image sample has a plurality of human bodies therein;
the calibrating the plurality of target parts belonging to the same human body in the white sample further comprises:
and calibrating the target parts of different human bodies respectively.
Optionally, the human body recognition model is a convolutional neural network model.
Optionally, the generating and displaying the image with the human body based on the target site features belonging to the same human body, and monitoring the temperature condition of the human body by using the temperature data includes:
Simulating the human body contour by utilizing the characteristics of a plurality of human body target parts belonging to the same human body;
and analyzing and rendering by using the simulated human body outline to generate and display an image with a human body, and monitoring the temperature condition of the human body by using the temperature data.
Optionally, the analyzing, rendering and displaying the image with the human body by using the simulated human body outline, and monitoring the temperature condition of the human body by using the temperature data includes:
and analyzing and rendering by utilizing the temperature data and the simulated human body outline to generate and display an image with human body and temperature prompt information.
Optionally, the monitoring the temperature condition of the human body using the temperature data includes:
and prompting the temperature condition of the human body at the target part if the temperature data corresponding to the target part meets the preset alarm condition.
Optionally, the temperature data corresponding to the target portion meets a preset alarm condition, including:
the temperature corresponding to the target part exceeds a preset temperature range.
Optionally, the temperature data corresponding to the target portion meets a preset alarm condition, and further includes:
the deviation between the temperature data corresponding to a plurality of human body target parts belonging to the same human body exceeds a preset deviation threshold value.
Optionally, the acquiring the infrared image data acquired by the infrared camera module, performing human body identification by using the infrared image data, generating and displaying an image with a human body, and further includes:
acquiring infrared image data acquired by the infrared camera module in a time interval, and performing human body identification by utilizing the infrared image data acquired by the adjacent time interval, and sequentially generating and displaying a first image and a second image with a human body in a time interval;
if the temperature data corresponding to the target part meets the preset alarm condition, prompting the temperature condition of the human body at the target part, including:
if the temperature data corresponding to the target part of the human body contained in the first image meets the preset alarm condition, determining a target human body with abnormal temperature in the first image, identifying the human body corresponding to the target human body in the second image, and prompting the temperature condition of the target human body to a user through the second image.
The device is characterized in that a human body recognition model is built and is led into a terminal, a client of the terminal obtains infrared image data through a data interface between the client and an infrared camera module and converts the infrared image data into gray image data, the built human body recognition model is utilized to extract target part characteristics belonging to the same human body, corresponding temperature data are calculated, an image with the human body is generated and displayed based on the target part characteristics belonging to the same human body, the temperature condition of the human body is monitored, and because the visible light image does not need to be acquired in the monitoring process and the picture synchronism of the infrared image and the visible light image does not need to be relied on, the device is high in convenience and high in accuracy. By identifying and extracting the target part features belonging to the same human body, the generated image can reflect the whole human body even if
The system has the advantages that the system can accurately distinguish the corresponding human bodies in the images of the monitored personnel, so that the temperature monitoring can be carried out on the multiple persons at the same time, and the monitoring efficiency is high.
Based on the same inventive concept, the embodiments of the present specification also provide an electronic device.
The following describes an embodiment of an electronic device according to the present invention, which may be regarded as a specific physical implementation of the above-described embodiment of the method and apparatus according to the present invention. Details described in relation to the embodiments of the electronic device of the present invention should be considered as additions to the embodiments of the method or apparatus described above; for details not disclosed in the embodiments of the electronic device of the present invention, reference may be made to the above-described method or apparatus embodiments.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. An electronic device 300 according to this embodiment of the present invention is described below with reference to fig. 3. The electronic device 300 shown in fig. 3 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 3, the electronic device 300 is embodied in the form of a general purpose computing device. Components of electronic device 300 may include, but are not limited to: at least one processing unit 310, at least one memory unit 320, a bus 330 connecting the different system components (including the memory unit 320 and the processing unit 310), a display unit 340, and the like.
Wherein the storage unit stores program code that is executable by the processing unit 310 such that the processing unit 310 performs the steps according to various exemplary embodiments of the invention described in the above processing method section of the present specification. For example, the processing unit 310 may perform the steps shown in fig. 1.
The memory unit 320 may include readable media in the form of volatile memory units, such as Random Access Memory (RAM) 3201 and/or cache memory 3202, and may further include Read Only Memory (ROM) 3203.
The storage unit 320 may also include a program/utility 3204 having a set (at least one) of program modules 3205, such program modules 3205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
Bus 330 may be one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 300 may also communicate with one or more external devices 400 (e.g., keyboard, pointing device, bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 300, and/or any device (e.g., router, modem, etc.) that enables the electronic device 300 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 350. Also, electronic device 300 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 360. The network adapter 360 may communicate with other modules of the electronic device 300 via the bus 330. It should be appreciated that although not shown in fig. 3, other hardware and/or software modules may be used in connection with electronic device 300, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
From the above description of embodiments, those skilled in the art will readily appreciate that the exemplary embodiments described herein may be implemented in software, or may be implemented in software in combination with necessary hardware. Thus, the technical solution according to the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a computer readable storage medium (may be a CD-ROM, a usb disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, or a network device, etc.) to perform the above-mentioned method according to the present invention. The computer program, when executed by a data processing device, enables the computer readable medium to carry out the above-described method of the present invention, namely: such as the method shown in fig. 1.
Fig. 4 is a schematic diagram of a computer readable medium according to an embodiment of the present disclosure.
A computer program implementing the method shown in fig. 1 may be stored on one or more computer readable media. The computer readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).
In summary, the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that some or all of the functionality of some or all of the components in accordance with embodiments of the present invention may be implemented in practice using a general purpose data processing device such as a microprocessor or Digital Signal Processor (DSP). The present invention can also be implemented as an apparatus or device program (e.g., a computer program and a computer program product) for performing a portion or all of the methods described herein. Such a program embodying the present invention may be stored on a computer readable medium, or may have the form of one or more signals. Such signals may be downloaded from an internet website, provided on a carrier signal, or provided in any other form.
The above-described specific embodiments further describe the objects, technical solutions and advantageous effects of the present invention in detail, and it should be understood that the present invention is not inherently related to any particular computer, virtual device or electronic apparatus, and various general-purpose devices may also implement the present invention. The foregoing description of the embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, alternatives, and improvements that fall within the spirit and scope of the invention.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.

Claims (18)

1. A method of monitoring a person's temperature, comprising:
Constructing a human body recognition model, and importing the human body recognition model into a terminal; the construction of the human body recognition model comprises the following steps: obtaining a visible light image sample, the visible light image sample comprising: a black sample and a white sample, the white sample having a plurality of target sites belonging to the same human body, the black sample not having a plurality of target sites belonging to the same human body; calibrating a plurality of target parts belonging to the same human body in the white sample; training a human body recognition model in a supervised learning mode by utilizing the visible light image sample; the visible light image sample is provided with a plurality of human bodies; the calibrating the plurality of target parts belonging to the same human body in the white sample further comprises: calibrating human body target parts of different human bodies respectively;
the client of the terminal obtains infrared image data acquired by the infrared camera module through a data interface between the client and the infrared camera module, performs human body identification by utilizing the infrared image data, generates and displays an image with a human body, and comprises the following steps:
converting the infrared image data into grayscale image data;
invoking the human body recognition model which is pre-imported, carrying out feature recognition on the gray image data and extracting target part features belonging to the same human body;
Calculating temperature data corresponding to the target part by utilizing the infrared image data;
and generating and displaying an image with the human body based on the target part characteristics belonging to the same human body, and monitoring the temperature condition of the human body by utilizing the temperature data.
2. The method of claim 1, wherein the human recognition model is a convolutional neural network model.
3. The method of claim 1, wherein the generating and displaying an image with a human body based on the target site features belonging to the same human body and monitoring a temperature condition of the human body using the temperature data comprises:
simulating the human body contour by utilizing the characteristics of a plurality of human body target parts belonging to the same human body;
and analyzing and rendering by using the simulated human body outline to generate and display an image with a human body, and monitoring the temperature condition of the human body by using the temperature data.
4. A method according to claim 3, wherein said analyzing, rendering and displaying an image with a human body using a simulated human body contour, and monitoring a temperature condition of said human body using said temperature data comprises:
and analyzing and rendering by utilizing the temperature data and the simulated human body outline to generate and display an image with human body and temperature prompt information.
5. The method of claim 4, wherein said monitoring a temperature condition of said human body using said temperature data comprises:
and prompting the temperature condition of the human body at the target part if the temperature data corresponding to the target part meets the preset alarm condition.
6. The method of claim 5, wherein the temperature data corresponding to the target portion satisfies a preset alarm condition, comprising:
the temperature corresponding to the target part exceeds a preset temperature range.
7. The method of claim 5, wherein the temperature data corresponding to the target portion satisfies a preset alarm condition, further comprising:
the deviation between the temperature data corresponding to a plurality of human body target parts belonging to the same human body exceeds a preset deviation threshold value.
8. The method of claim 5, wherein the acquiring the infrared image data acquired by the infrared camera module, using the infrared image data to perform human body recognition, generating and displaying an image with a human body, further comprises:
acquiring infrared image data acquired by the infrared camera module in a time interval, and performing human body identification by utilizing the infrared image data acquired by the adjacent time interval, and sequentially generating and displaying a first image and a second image with a human body in a time interval;
If the temperature data corresponding to the target part meets the preset alarm condition, prompting the temperature condition of the human body at the target part, including:
if the temperature data corresponding to the target part of the human body contained in the first image meets the preset alarm condition, determining a target human body with abnormal temperature in the first image, identifying the human body corresponding to the target human body in the second image, and prompting the temperature condition of the target human body to a user through the second image.
9. An apparatus for monitoring the temperature of a person, comprising:
the construction module is used for constructing a human body recognition model and importing the human body recognition model into the terminal; the construction of the human body recognition model comprises the following steps: obtaining a visible light image sample, the visible light image sample comprising: a black sample and a white sample, the white sample having a plurality of target sites belonging to the same human body, the black sample not having a plurality of target sites belonging to the same human body; calibrating a plurality of target parts belonging to the same human body in the white sample; training a human body recognition model in a supervised learning mode by utilizing the visible light image sample; the visible light image sample is provided with a plurality of human bodies; the calibrating the plurality of target parts belonging to the same human body in the white sample further comprises: calibrating human body target parts of different human bodies respectively;
The identification monitoring module, the client of terminal is through the data interface with infrared camera module acquire infrared image data that infrared camera module gathered, utilize infrared image data carries out human discernment, generates and demonstrates the image that has the human body, includes:
converting the infrared image data into grayscale image data;
invoking the human body recognition model which is pre-imported, carrying out feature recognition on the gray image data and extracting target part features belonging to the same human body;
calculating temperature data corresponding to the target part by utilizing the infrared image data;
and generating and displaying an image with the human body based on the target part characteristics belonging to the same human body, and monitoring the temperature condition of the human body by utilizing the temperature data.
10. The apparatus of claim 9, wherein the human recognition model is a convolutional neural network model.
11. The apparatus of claim 9, wherein the generating and displaying an image having a human body based on the target site features belonging to the same human body and monitoring a temperature condition of the human body using the temperature data comprises:
Simulating the human body contour by utilizing the characteristics of a plurality of human body target parts belonging to the same human body;
and analyzing and rendering by using the simulated human body outline to generate and display an image with a human body, and monitoring the temperature condition of the human body by using the temperature data.
12. The apparatus of claim 11, wherein the analyzing, rendering and displaying the image with the human body using the simulated human body contour, and monitoring the temperature condition of the human body using the temperature data comprises:
and analyzing and rendering by utilizing the temperature data and the simulated human body outline to generate and display an image with human body and temperature prompt information.
13. The apparatus of claim 12, wherein said monitoring the temperature condition of the human body using the temperature data comprises:
and prompting the temperature condition of the human body at the target part if the temperature data corresponding to the target part meets the preset alarm condition.
14. The apparatus of claim 13, wherein the temperature data corresponding to the target location satisfies a preset alarm condition, comprising:
the temperature corresponding to the target part exceeds a preset temperature range.
15. The apparatus of claim 13, wherein the temperature data corresponding to the target location satisfies a preset alarm condition, further comprising:
the deviation between the temperature data corresponding to a plurality of human body target parts belonging to the same human body exceeds a preset deviation threshold value.
16. The apparatus of claim 13, wherein the acquiring the infrared image data acquired by the infrared camera module, using the infrared image data to perform human body recognition, generating and displaying an image with a human body, further comprises:
acquiring infrared image data acquired by the infrared camera module in a time interval, and performing human body identification by utilizing the infrared image data acquired by the adjacent time interval, and sequentially generating and displaying a first image and a second image with a human body in a time interval;
if the temperature data corresponding to the target part meets the preset alarm condition, prompting the temperature condition of the human body at the target part, including:
if the temperature data corresponding to the target part of the human body contained in the first image meets the preset alarm condition, determining a target human body with abnormal temperature in the first image, identifying the human body corresponding to the target human body in the second image, and prompting the temperature condition of the target human body to a user through the second image.
17. An electronic device, wherein the electronic device comprises:
a processor; the method comprises the steps of,
a memory storing computer executable instructions that, when executed, cause the processor to perform the method of any of claims 1-8.
18. A computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the method of any of claims 1-8.
CN202010351854.XA 2020-04-28 2020-04-28 Method and device for monitoring personnel temperature and electronic equipment Active CN111597923B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010351854.XA CN111597923B (en) 2020-04-28 2020-04-28 Method and device for monitoring personnel temperature and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010351854.XA CN111597923B (en) 2020-04-28 2020-04-28 Method and device for monitoring personnel temperature and electronic equipment

Publications (2)

Publication Number Publication Date
CN111597923A CN111597923A (en) 2020-08-28
CN111597923B true CN111597923B (en) 2023-05-12

Family

ID=72190760

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010351854.XA Active CN111597923B (en) 2020-04-28 2020-04-28 Method and device for monitoring personnel temperature and electronic equipment

Country Status (1)

Country Link
CN (1) CN111597923B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106919806A (en) * 2017-04-27 2017-07-04 刘斌 A kind of human body monitoring method, device and system and computer readable storage devices
WO2019120032A1 (en) * 2017-12-21 2019-06-27 Oppo广东移动通信有限公司 Model construction method, photographing method, device, storage medium, and terminal
CN110555819A (en) * 2019-08-20 2019-12-10 中国石油大学(北京) Equipment monitoring method, device and equipment based on infrared and visible light image fusion

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016201654A1 (en) * 2015-06-17 2016-12-22 北京新目科技有限公司 Information intelligent collection method and apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106919806A (en) * 2017-04-27 2017-07-04 刘斌 A kind of human body monitoring method, device and system and computer readable storage devices
WO2019120032A1 (en) * 2017-12-21 2019-06-27 Oppo广东移动通信有限公司 Model construction method, photographing method, device, storage medium, and terminal
CN110555819A (en) * 2019-08-20 2019-12-10 中国石油大学(北京) Equipment monitoring method, device and equipment based on infrared and visible light image fusion

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
邢向华,顾国华,张保民.红外热成像双通道伪彩色测温系统.红外技术.2003,(04),全文. *

Also Published As

Publication number Publication date
CN111597923A (en) 2020-08-28

Similar Documents

Publication Publication Date Title
CN107909065B (en) Method and device for detecting face occlusion
CN107622240B (en) Face detection method and device
CN108038880B (en) Method and apparatus for processing image
US20210248355A1 (en) Face key point detection method and apparatus, storage medium, and electronic device
CN109902659B (en) Method and apparatus for processing human body image
US10719693B2 (en) Method and apparatus for outputting information of object relationship
CN113159147B (en) Image recognition method and device based on neural network and electronic equipment
CN110660484B (en) Bone age prediction method, device, medium, and electronic apparatus
CN111062389A (en) Character recognition method and device, computer readable medium and electronic equipment
CN108509921B (en) Method and apparatus for generating information
CN108510084B (en) Method and apparatus for generating information
KR102347551B1 (en) Method, apparatus and system for providing informations of face condition based on analysis of face image
WO2021068781A1 (en) Fatigue state identification method, apparatus and device
CN113379813A (en) Training method and device of depth estimation model, electronic equipment and storage medium
CN111783626A (en) Image recognition method and device, electronic equipment and storage medium
CN112861885A (en) Image recognition method and device, electronic equipment and storage medium
CN113177468A (en) Human behavior detection method and device, electronic equipment and storage medium
CN114511661A (en) Image rendering method and device, electronic equipment and storage medium
CN112102207A (en) Method and device for determining temperature, electronic equipment and readable storage medium
CN113990500A (en) Vital sign parameter monitoring method and device and storage medium
CN113827240A (en) Emotion classification method and emotion classification model training method, device and equipment
CN111597923B (en) Method and device for monitoring personnel temperature and electronic equipment
CN111784660B (en) Method and system for analyzing frontal face degree of face image
CN111259698A (en) Method and device for acquiring image
CN112153320B (en) Method and device for measuring size of article, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant