CN110987189A - Method, system and device for detecting temperature of target object - Google Patents
Method, system and device for detecting temperature of target object Download PDFInfo
- Publication number
- CN110987189A CN110987189A CN201911150278.6A CN201911150278A CN110987189A CN 110987189 A CN110987189 A CN 110987189A CN 201911150278 A CN201911150278 A CN 201911150278A CN 110987189 A CN110987189 A CN 110987189A
- Authority
- CN
- China
- Prior art keywords
- target object
- visible light
- light image
- position information
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000001514 detection method Methods 0.000 claims abstract description 68
- 238000003384 imaging method Methods 0.000 claims description 22
- 238000003331 infrared imaging Methods 0.000 claims description 19
- 238000006243 chemical reaction Methods 0.000 claims description 15
- 210000001061 forehead Anatomy 0.000 claims description 11
- 210000005069 ears Anatomy 0.000 claims description 3
- 210000001331 nose Anatomy 0.000 claims description 2
- 210000003467 cheek Anatomy 0.000 claims 1
- 238000013473 artificial intelligence Methods 0.000 description 5
- 238000004861 thermometry Methods 0.000 description 5
- 238000009529 body temperature measurement Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 241000700605 Viruses Species 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/002—Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/48—Thermography; Techniques using wholly visual means
- G01J5/485—Temperature profile
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
Abstract
The application discloses a method, a system and a device for detecting temperature of a target object. The method for detecting the temperature of the target object comprises the following steps: acquiring a first visible light image of a specified scene, wherein the specified scene comprises a target object; detecting at least one part of a target object in a first visible light image by using a preset detection model, and determining first position information of the at least one part in the first visible light image; acquiring a thermal infrared image of a specified scene; and determining temperature distribution information of the target object according to the first position information and the thermal infrared image.
Description
Technical Field
The present application relates to the field of artificial intelligence technologies, and in particular, to a method, a system, and an apparatus for detecting a temperature of a target object.
Background
Existing thermometry systems, for example, simply collect a thermal infrared image using an infrared sensor and measure the temperature of a target object in the collected thermal infrared image. However, although the image acquired by the infrared sensor can provide the temperature information of the object in the image, the resolution of the image is not high, and the color information of the object in the image cannot be provided. The target objects identified by the existing thermometry systems are relatively single, and for example, different types of objects and different individuals of the same type cannot be identified. Therefore, the existing temperature measurement system cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference in a measurement scene.
Aiming at the technical problems that the existing temperature measuring system in the prior art can not accurately measure the detail temperature of the target object and can not normally measure the temperature of the target object under the condition of more interference of a measuring scene, an effective solution is not provided at present.
Disclosure of Invention
The present disclosure provides a method and a system for detecting a temperature of a target object, so as to at least solve the technical problems that the existing temperature measurement system in the prior art cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference of a measurement scene.
According to an aspect of the present application, there is provided a method of temperature detection of a target object, including: acquiring a first visible light image of a specified scene, wherein the specified scene comprises a target object; detecting at least one part of a target object in a first visible light image by using a preset detection model, and determining first position information of the at least one part in the first visible light image; acquiring a thermal infrared image of a specified scene; and determining temperature distribution information of the target object according to the first position information and the thermal infrared image.
According to another aspect of the present application, there is provided a system for temperature detection of a target object, comprising: a thermal infrared imaging device, a visible light imaging device, and a computing device connected to the thermal infrared imaging device and the visible light imaging device, wherein the computing device is configured to: acquiring a first visible light image of a specified scene, wherein the specified scene comprises a target object; detecting at least one part of a target object in a first visible light image by using a preset detection model, and determining first position information of the at least one part in the first visible light image; acquiring a thermal infrared image of a specified scene; and determining temperature distribution information of the target object according to the first position information and the thermal infrared image.
According to another aspect of the present application, there is provided an apparatus for temperature detection of a target object, including: the first visible light image acquisition module is used for acquiring a first visible light image of a specified scene; the first position information determining module is used for detecting a target object in the first visible light image by using a preset recognition detection model and determining first position information of each piece of position information of the target object in the first visible light image, wherein the first position information comprises a plurality of pieces of position information corresponding to each piece of position information; the thermal infrared image acquisition module is used for acquiring a thermal infrared image of a specified scene; and the temperature distribution information determining module is used for determining the temperature distribution information of the target object according to the first position information and the thermal infrared image.
According to the technical scheme, the computing device acquires the first visible light image and the thermal infrared image from the visible light imaging device and the thermal infrared imaging device, and detects the position of the target object in the first visible light image and the first position information of at least one part of the target object by using a preset detection model. The computing device then obtains temperature information for various locations in the image from the pixel values of the thermal infrared image. And finally, the computing equipment converts the temperature distribution information in the thermal infrared image into the first visible light image through a coordinate conversion algorithm, and the temperature distribution information corresponds to the first coordinate information of at least one part of the target object, so that the temperature distribution condition of at least one part of the target object can be displayed on the first visible light image. And the technical problems that the existing temperature measuring system in the prior art cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference of a measuring scene are solved.
Drawings
Some specific embodiments of the present application will be described in detail hereinafter by way of illustration and not limitation with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:
fig. 1 is a schematic view of a system for detecting a temperature of a target object according to a second aspect of embodiment 1 of the present application;
fig. 2 is a schematic flow chart of a method for detecting a temperature of a target object according to a first aspect of embodiment 1 of the present application;
fig. 3 is another schematic flow chart of a method for detecting a temperature of a target object according to the first aspect of embodiment 1 of the present application;
fig. 4 is a schematic diagram illustrating a result of temperature detection on a target object according to the first aspect of embodiment 1 of the present application; and
fig. 5 is a schematic diagram of an apparatus for detecting a temperature of a target object according to embodiment 2 of the present application.
Detailed Description
It should be noted that, in the present disclosure, the embodiments and features of the embodiments may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
In order to make the technical solutions of the present disclosure better understood by those skilled in the art, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only some embodiments of the present disclosure, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances for describing the embodiments of the disclosure herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
Fig. 1 shows a schematic diagram of a system 100 for temperature detection of a target object according to an embodiment of the present disclosure. Referring to fig. 1, the temperature detection system 100 includes a visible light imaging device 110, a thermal infrared imaging device 120, and a computing device 130 connected to the visible light imaging device 110 and the thermal infrared imaging device 120.
Where visible light imaging device 110 and thermal infrared imaging device 120 and computing device 130 may be three devices packaged in one apparatus. For example, the visible light imaging device 110 may be a visible light image sensor for capturing visible light images, the thermal infrared imaging device 120 may be a thermal infrared image sensor for capturing thermal infrared images, the computing device 130 may be a processor connected to the visible light image sensor and the thermal infrared image sensor, and the computing device 130 may be an embedded computing device, a conventional computing device (e.g., a computer), a server, and the like. Further, as shown with reference to fig. 1, the visible light imaging device 110 and the thermal infrared imaging device 120 and the computing device 130 may also be separate devices from each other.
Furthermore, fig. 2 shows a schematic flowchart of a method for detecting a temperature of a target object according to a first aspect of an embodiment of the present disclosure. Wherein the method may be implemented, for example, by the computing device 130 of the system 100 for temperature detection of a target object. Referring to fig. 2, the method includes:
s202: acquiring a first visible light image of a specified scene, wherein the specified scene comprises a target object;
s204: detecting at least one part of a target object in a first visible light image by using a preset detection model, and determining first position information of the at least one part in the first visible light image;
s206: acquiring a thermal infrared image of a specified scene; and
s208: and determining the temperature distribution information of the target object according to the first position information and the thermal infrared image.
As described in the background, the existing thermometry systems, for example, simply collect a thermal infrared image using an infrared sensor, and perform thermometry on a target object in the collected thermal infrared image. However, although the image acquired by the infrared sensor can provide the temperature information of the object in the image, the resolution of the image is not high, and the color information of the object in the image cannot be provided. The target objects identified by the existing thermometry systems are relatively single, and for example, different types of objects and different individuals of the same type cannot be identified. Therefore, the existing temperature measurement system cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference in a measurement scene.
In view of this, reference is made to the system 100 for temperature detection of a target object illustrated in fig. 1, wherein the computing device 130 acquires a visible light image and a thermal infrared image from the visible light imaging device 110 and the thermal infrared imaging device 120, and determines temperature distribution information of at least one portion of the target object in a designated scene according to the visible light image and the thermal infrared image.
Specifically, referring to fig. 1 and 2, the computing device 130 acquires a first visible light image of a specified scene from the visible light imaging device 110, wherein the specified scene contains a target object (S202). And wherein the designated scene may be an outdoor location or an indoor location, and the computing device 130 may detect the target object from the first visible light image.
Further, the computing device 130 detects at least one part of the target object in the first visible light image using a preset detection model, and determines first position information of the at least one part in the first visible light image (S204). Here, as shown with reference to fig. 3, in the case where the target object is a human body, the part where the target object is detected may be a nose, a forehead, a cheek, an ear, and the like of the target object, and the first position information may be a plurality of position information such as a position of the nose, a position of the forehead, a position of the cheek, and a position of the ear. Furthermore, the first position information may be labeled with a rectangular box, for example.
In addition, the computing device 130 may use a preset detection model to detect different objects and different individuals of the same category (for example, different categories may be human and animal, and different individuals may be, for example, two human bodies respectively identified), so that the computing device 130 in the present technical solution has a strong anti-interference capability to detect a target object, and is further adapted to a complex scene.
Further, the computing device 130 acquires the thermal infrared image of the designated scene from the thermal infrared imaging device 120 (S206), wherein the computing device 130 may acquire temperature information of each object in the acquired image through pixel information of the thermal infrared image, wherein the object may be a movable human body or animal, or a fixed object.
Further, temperature distribution information of the target object is determined according to the first position information and the thermal infrared image (S208), the computing device 130 may calculate the temperature distribution information of the target object in the image according to a pixel value of the thermal infrared image, and the computing device 130 may calculate the first position information of at least one portion of the target object according to a first visible light image method, and then the computing device 130 may convert the temperature information distribution on the thermal infrared image onto the first visible light image corresponding to the first position information of the at least one portion of the target object. Temperature distribution information of at least one part of the target object is determined, wherein the temperature distribution information can be displayed on the first visible light image, for example, temperature distribution information such as the temperature of the nose, the temperature of the forehead, the temperature of the cheek and the temperature of the ear of the target object can be displayed on the first visible light image, and can be marked by the identification graph.
Thus, according to the technical solution of the present embodiment, the computing device 130 detects the first position information of at least one portion of the target object on the first visible light image by using a preset detection model by acquiring the first visible light image and the thermal infrared image from the visible light imaging device 110 and the thermal infrared imaging device 120. The computing device 130 then obtains temperature distribution information of each portion of each object in the image from the pixel values of the thermal infrared image. Finally, the computing device 130 may display the temperature distribution of the at least one portion of the target object on the first visible light image according to the first position information of the at least one portion of the target object in the first visible light image and the temperature distribution information in the thermal infrared image. And the technical problems that the existing temperature measuring system in the prior art cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference of a measuring scene are solved.
Optionally, the operation of detecting at least one portion of the target object in the first visible light image by using a preset detection model, and determining first position information of the at least one portion in the first visible light image includes: generating a second visible light image suitable for detection of the target object detection model according to the first visible light image; detecting a target object in the second visible light image by using the target object detection model, and determining second position information of the target object in the second visible light image; determining third position information of the target object in the first visible light image according to the second position information of the target object in the second visible light image; according to the third position information, dividing an image area containing the target object in the first visible light image; detecting at least one part of the target object in the segmented image area by using a preset target object part detection model; and determining first position information of at least one part detected by the target object part detection model in the first visible light image.
Specifically, referring to fig. 3, in a case where the computing device 130 needs to detect the first position information of at least one part of the target object from the first visible light image, the computing device 130 may generate a second visible light image suitable for the detection of the target object detection model from the first visible light image. The target object detection model generally adopts an artificial intelligence detection model and is used for detecting the target object of the specified type. However, the image resolution generally suitable for the artificial intelligence detection model is low, and the first visible light image acquired by the visible light imaging device 110 has a higher resolution, and belongs to a high-definition image. The first visible light image acquired by the visible light imaging device 110 may be converted into a second visible light image with a lower resolution, for example, before performing the recognition detection of the target object. For example, the computing device 130 needs to crop the first visible light image according to the aspect ratio of the second visible light image suitable for the target object detection model, and then the computing device 130 down-samples the cropped first visible light image. For example, in the case where the resolution of the first visible-light image is 1920 × 1080, and the resolution of the second visible-light image is 512 × 512(1: 1). The first visible light image may be cropped to a size of 1080 × 1080(1:1) resolution, and then the cropped image may be down-sampled to obtain an image with 512 × 512 resolution (i.e., the second visible light image).
Further, the computing device 130 detects a target object in the second visible light image by using the target object detection model, and determines second position information of the target object in the second visible light image, wherein the target object may be a human body or an object. The computing device 130 may then determine third location information of the target object in the first visible-light image based on the second location information of the target object in the second visible-light image (the first visible-light image and the second visible-light image have different resolutions but the location information of the target object in the first visible-light image and the second visible-light image is the same). The computing device 130 may mark the target object with identifying graphics (which may be, for example, rectangular boxes, callout symbols, and other graphical indicia) in the first visible-light image. The computing device 130 may then segment an image area (the image area is a high definition image) containing the target object according to the third position information of the target object in the first visible light image. The computing device 130 may then detect the target object and at least one portion of the target object in the image region including the target object using a preset target object portion detection model (e.g., in the case where the target object is a human body, the nose, forehead, cheek, ear, etc. of the target object may be detected). Further, the computing device 130 may label the detected position of the at least one portion of the target object in the first visible light image, thereby determining first position information of the at least one portion of the target object in the first visible light image. Thus, in this manner, the computing device 130 may make full use of the image information in the high-definition image for recognition of different portions of the target object. Therefore, even if the part occupies only a small part of the target object, the part can be accurately identified by the information of the high-definition image. Thereby improving the accuracy of image recognition.
Optionally, the resolution of the second visible light image is lower than the resolution of the first visible light image.
Specifically, the target object detection model generally adopts an artificial intelligence detection model, but the image resolution suitable for the artificial intelligence detection model is low, and the first visible light image acquired by the visible light imaging device 110 has a higher resolution and belongs to a high-definition image, so that the resolution of the second visible light image is lower than that of the first visible light image.
Optionally, an identification graphic for identifying the target object is added in the first visible light image.
Specifically, referring to fig. 4, the computing device 130 may detect the target object in the second visible light image according to the target object detection model, and may mark the position of the target object with the identification graphic, wherein the identification graphic may be a rectangular frame, an identification symbol, and other shapes. Thus, the computing device 130 may track the target object by adding the identification graphic, that is, in a case where the target object is a movable target, the target object may be labeled with the identification graphic. Therefore, the image added with the identification graph can be displayed in such a way, so that a worker can conveniently monitor and track the target object through the monitoring video. For example, in an international airport, temperature check is performed on an inbound person to prevent the inbound person from bringing foreign viruses into the country, and therefore, the conventional temperature measuring device needs a person to be measured to stay in front of a device for collecting temperature for a certain period of time to measure the temperature, and cannot measure the temperature of a specific part of a human body, such as the forehead temperature. According to the technical scheme of the embodiment, the human body can be dynamically identified to carry out temperature identification on the human body part.
Optionally, the operation of determining the temperature distribution information of the target object according to the first position information and the thermal infrared image includes: converting the first position information into corresponding fourth position information in the thermal infrared image by using a preset coordinate conversion algorithm; determining temperature information corresponding to at least one part of the target object according to a pixel value corresponding to the fourth position information in the thermal infrared image; and determining temperature distribution information of the target object according to the determined temperature information.
Specifically, reference is made to fig. 3. Computing device 130 has determined positional information for at least one part of the target object (e.g., forehead, nose, and ears). The position information (e.g., position 1 shown in fig. 3) is converted into fourth position information (e.g., position 2 shown in fig. 3) in the thermal infrared image using a coordinate conversion module. And then the computing equipment acquires a corresponding temperature value according to the pixel value corresponding to the fourth position information by using a temperature module, and takes the temperature value as the temperature value corresponding to the first position information. Thereby obtaining a temperature value of the at least one portion of the target object and further determining temperature distribution information of the at least one portion of the target object. In this way, the visible light image and the thermal infrared image of the designated scene are associated, and the temperature distribution information of the target object in the designated scene is determined.
Optionally, the operation of determining the temperature distribution information of the target object according to the first position information and the thermal infrared image includes: converting first coordinate information of the thermal infrared image into second coordinate information corresponding to the first visible light image by using a preset coordinate conversion algorithm; and determining the temperature distribution information of the target object according to the second coordinate information and the first position information.
Specifically, since the size of the thermal infrared image collected by the thermal infrared imaging device 120 is generally different from the size of the image collected by the visible light imaging device 110, the computing device 130 converts the first coordinate information of the thermal infrared image into the second coordinate information corresponding to the first visible light image by using a preset coordinate conversion algorithm, and unifies the coordinate information in order to convert the temperature information on the thermal infrared image onto the first visible light image. The computing device 130 may then determine temperature distribution information of the target object based on the second coordinate information and the first position information, i.e., convert the temperature information on the thermal infrared image onto the first visible light image based on the second coordinate information and corresponding to the first position information of the at least one portion of the target object. Temperature distribution information such as the temperature of the nose, the temperature of the forehead, the temperature of the cheek, and the temperature of the ear of the target subject can be displayed on the first visible light image. Thereby enabling the visible light image collected by the light imaging device 110 and the thermal infrared image collected by the thermal infrared imaging device 120 to be matched, thereby improving the accuracy of the temperature distribution information of the target object.
Optionally, the target object is a human body, and the at least one part of the target object comprises at least one of: the nose, the forehead, the cheek and the ears of the target object can detect at least one part of the target object, and the temperature information of each part can be displayed, so that the technical problems that the existing temperature measuring system in the prior art cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference of a measuring scene are solved.
Further, according to a second aspect of the present embodiment, there is provided a system for temperature detection of a target object, as shown with reference to fig. 1, the system comprising: a thermal infrared imaging device, a visible light imaging device, and a computing device connected to the thermal infrared imaging device and the visible light imaging device, wherein the computing device is configured to: acquiring a first visible light image of a specified scene; detecting a target object in the first visible light image by using a preset recognition detection model, and determining first position information of each part information of the target object in the first visible light image, wherein the first position information comprises a plurality of position information corresponding to each part information; acquiring a thermal infrared image of a specified scene; and determining temperature distribution information of the target object according to the first position information and the thermal infrared image.
Optionally, the operation of detecting at least one portion of the target object in the first visible light image by using a preset detection model, and determining first position information of the at least one portion in the first visible light image includes: generating a second visible light image suitable for detection of the target object detection model according to the first visible light image; detecting a target object in the second visible light image by using the target object detection model, and determining second position information of the target object in the second visible light image; determining third position information of the target object in the first visible light image according to the second position information of the target object in the second visible light image; according to the third position information, dividing an image area containing the target object in the first visible light image; detecting at least one part of the target object in the segmented image area by using a preset target object part detection model; and determining first position information of at least one part detected by the target object part detection model in the first visible light image.
Optionally, the resolution of the second visible light image is lower than the resolution of the first visible light image.
Optionally, an identification graphic for identifying the target object is added in the first visible light image.
Optionally, the operation of determining the temperature distribution information of the target object according to the first position information and the thermal infrared image includes: converting the first position information into corresponding fourth position information in the thermal infrared image by using a preset coordinate conversion algorithm; determining temperature information corresponding to at least one part of the target object according to a pixel value corresponding to the fourth position information in the thermal infrared image; and determining temperature distribution information of the target object according to the determined temperature information.
Optionally, the operation of determining the temperature distribution information of the target object according to the first position information and the thermal infrared image includes: converting first coordinate information of the thermal infrared image into second coordinate information corresponding to the first visible light image by using a preset coordinate conversion algorithm; and determining the temperature distribution information of the target object according to the second coordinate information and the first position information.
Optionally, the target object is a human body, and the at least one part of the target object comprises at least one of: nose, forehead, cheek, and ear of the target subject.
According to the technical solution of the present embodiment, the computing device 130 detects the position of the target object in the first visible light image and the first position information of at least one part of the target object by acquiring the first visible light image and the thermal infrared image from the visible light imaging device 110 and the thermal infrared imaging device 120 using a preset detection model. The computing device 130 then obtains temperature information for various locations in the image from the pixel values of the thermal infrared image. Finally, the computing device 130 converts the temperature distribution information in the thermal infrared image into the first visible light image through a coordinate conversion algorithm, and the temperature distribution information corresponds to the first coordinate information of the at least one part of the target object, so that the temperature distribution of the at least one part of the target object can be displayed on the first visible light image. And the technical problems that the existing temperature measuring system in the prior art cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference of a measuring scene are solved.
Example 2
Fig. 5 shows an apparatus 500 for temperature detection of a target object according to the first aspect of the present embodiment, the apparatus 500 corresponding to the method according to the first aspect of embodiment 1. Referring to fig. 5, the apparatus 500 includes: a first visible light image obtaining module 510, configured to obtain a first visible light image of a specified scene; a first position information determining module 520, configured to detect a target object in the first visible light image by using a preset recognition detection model, and determine first position information of each piece of position information of the target object in the first visible light image, where the first position information includes a plurality of pieces of position information corresponding to each piece of position information; a thermal infrared image obtaining module 530, configured to obtain a thermal infrared image of a specified scene; and a temperature distribution information determining module 540 for determining temperature distribution information of the target object according to the first position information and the thermal infrared image.
Optionally, the first location information determining module 520 includes: the second visible light image generation module is used for generating a second visible light image suitable for the detection of the target object detection model according to the first visible light image; the second position information determining module is used for detecting the target object in the second visible light image by using the target object detection model and determining second position information of the target object in the second visible light image; the third position information determining module is used for determining third position information of the target object in the first visible light image according to the second position information of the target object in the second visible light image; the image area segmentation module is used for segmenting an image area containing the target object in the first visible light image according to the third position information; a part determining module for detecting at least one part of the target object in the segmented image region by using a preset target object part detection model; and a first position information determination module which determines first position information of at least one part detected by the target object part detection model in the first visible light image.
Optionally, the resolution of the second visible light image is lower than the resolution of the first visible light image.
Optionally, the identification pattern adding module is configured to add an identification pattern for identifying the target object in the first visible light image.
Optionally, the temperature distribution information determining module 540 includes: the fourth position information conversion module is used for converting the first position information into corresponding fourth position information in the thermal infrared image by using a preset coordinate conversion algorithm; the part temperature determining module is used for determining temperature information corresponding to at least one part of the target object according to a pixel value corresponding to the fourth position information in the thermal infrared image; and a first temperature distribution information determination submodule for determining temperature distribution information of the target object based on the determined temperature information.
Optionally, the temperature distribution information determining module 540 includes: the coordinate conversion module is used for converting first coordinate information of the thermal infrared image into second coordinate information corresponding to the first visible light image by utilizing a preset coordinate conversion algorithm; and the second temperature distribution information determining submodule is used for determining the temperature distribution information of the target object according to the second coordinate information and the first position information.
Optionally, the target object is a human body, and the at least one part of the target object comprises at least one of: nose, forehead, cheek, and ear of the target subject.
According to the technical solution of the present embodiment, the computing device 130 detects the position of the target object in the first visible light image and the first position information of at least one part of the target object by acquiring the first visible light image and the thermal infrared image from the visible light imaging device 110 and the thermal infrared imaging device 120 using a preset detection model. The computing device 130 then obtains temperature information for various locations in the image from the pixel values of the thermal infrared image. Finally, the computing device 130 converts the temperature distribution information in the thermal infrared image into the first visible light image through a coordinate conversion algorithm, and the temperature distribution information corresponds to the first coordinate information of the at least one part of the target object, so that the temperature distribution of the at least one part of the target object can be displayed on the first visible light image. And the technical problems that the existing temperature measuring system in the prior art cannot accurately measure the detail temperature of the target object and cannot normally measure the temperature of the target object under the condition of more interference of a measuring scene are solved.
The relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise. Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description. Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
Spatially relative terms, such as "above … …," "above … …," "above … …," "above," and the like, may be used herein for ease of description to describe one device or feature's spatial relationship to another device or feature as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if a device in the figures is turned over, devices described as "above" or "on" other devices or configurations would then be oriented "below" or "under" the other devices or configurations. Thus, the exemplary term "above … …" can include both an orientation of "above … …" and "below … …". The device may be otherwise variously oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.
In the description of the present disclosure, it is to be understood that the orientation or positional relationship indicated by the directional terms such as "front, rear, upper, lower, left, right", "lateral, vertical, horizontal" and "top, bottom", etc., are generally based on the orientation or positional relationship shown in the drawings, and are presented only for the convenience of describing and simplifying the disclosure, and in the absence of a contrary indication, these directional terms are not intended to indicate and imply that the device or element being referred to must have a particular orientation or be constructed and operated in a particular orientation, and therefore, should not be taken as limiting the scope of the disclosure; the terms "inner and outer" refer to the inner and outer relative to the profile of the respective component itself.
The above description is only for the preferred embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A method of temperature sensing a target object, comprising:
acquiring a first visible light image of a designated scene, wherein the designated scene contains the target object;
detecting at least one part of the target object in the first visible light image by using a preset detection model, and determining first position information of the at least one part in the first visible light image;
acquiring a thermal infrared image of the appointed scene; and
and determining the temperature distribution information of the target object according to the first position information and the thermal infrared image.
2. The method according to claim 1, wherein the operation of detecting at least one portion of the target object in the first visible light image by using a preset detection model and determining first position information of the at least one portion in the first visible light image comprises:
generating a second visible light image suitable for detection of a target object detection model according to the first visible light image;
detecting the target object in the second visible light image by using the target object detection model, and determining second position information of the target object in the second visible light image;
determining third position information of the target object in the first visible light image according to the second position information of the target object in the second visible light image;
according to the third position information, dividing an image area containing the target object in the first visible light image;
detecting the at least one part of the target object in the segmented image region by using a preset target object part detection model; and
determining the first position information of the at least one part detected by the target object part detection model in the first visible light image.
3. The method of claim 2, wherein the second visible light image has a lower resolution than the first visible light image.
4. The method according to claim 2, characterized in that an identification graphic for identifying the target object is added in the first visible light image.
5. The method of claim 1, wherein determining temperature distribution information of the target object from the first location information and the thermal infrared image comprises:
converting the first position information into corresponding fourth position information in the thermal infrared image by using a preset coordinate conversion algorithm;
determining temperature information corresponding to the at least one part of the target object according to a pixel value corresponding to the fourth position information in the thermal infrared image; and
and determining temperature distribution information of the target object according to the determined temperature information.
6. The method of claim 1, wherein determining temperature distribution information of the target object from the first location information and the thermal infrared image comprises:
converting first coordinate information of the thermal infrared image into second coordinate information corresponding to the first visible light image by using a preset coordinate conversion algorithm; and
and determining the temperature distribution information of the target object according to the second coordinate information and the first position information.
7. The method of claim 1, wherein the target object is a human body and the at least one part of the target object comprises at least one of: the nose, forehead, cheek, and ears of the target subject.
8. A system for temperature sensing a target object, comprising: a thermal infrared imaging device, a visible light imaging device, and a computing device connected to the thermal infrared imaging device and the visible light imaging device, wherein the computing device is configured to:
acquiring a first visible light image of a specified scene;
detecting a target object in the first visible light image by using a preset recognition detection model, and determining first position information of each piece of position information of the target object in the first visible light image, wherein the first position information comprises a plurality of pieces of position information corresponding to each piece of position information;
acquiring a thermal infrared image of a specified scene; and
and determining the temperature distribution information of the target object according to the first position information and the thermal infrared image.
9. The system of claim 8, wherein the operation of detecting at least one portion of the target object in the first visible light image by using a preset detection model and determining first position information of the at least one portion in the first visible light image comprises:
generating a second visible light image suitable for detection of a target object detection model according to the first visible light image;
detecting the target object in the second visible light image by using the target object detection model, and determining second position information of the target object in the second visible light image;
determining third position information of the target object in the first visible light image according to the second position information of the target object in the second visible light image;
according to the third position information, dividing an image area containing the target object in the first visible light image;
detecting the at least one part of the target object in the segmented image region by using a preset target object part detection model; and
determining the first position information of the at least one part detected by the target object part detection model in the first visible light image.
10. An apparatus for temperature sensing a target object, comprising:
the first visible light image acquisition module is used for acquiring a first visible light image of a specified scene;
a first position information determining module, configured to detect a target object in the first visible light image by using a preset recognition detection model, and determine first position information of each piece of position information of the target object in the first visible light image, where the first position information includes a plurality of pieces of position information corresponding to each piece of position information;
the thermal infrared image acquisition module is used for acquiring a thermal infrared image of a specified scene; and
and the temperature distribution information determining module is used for determining the temperature distribution information of the target object according to the first position information and the thermal infrared image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911150278.6A CN110987189B (en) | 2019-11-21 | 2019-11-21 | Method, system and device for detecting temperature of target object |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911150278.6A CN110987189B (en) | 2019-11-21 | 2019-11-21 | Method, system and device for detecting temperature of target object |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110987189A true CN110987189A (en) | 2020-04-10 |
| CN110987189B CN110987189B (en) | 2021-11-02 |
Family
ID=70085604
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911150278.6A Active CN110987189B (en) | 2019-11-21 | 2019-11-21 | Method, system and device for detecting temperature of target object |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110987189B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111486962A (en) * | 2020-04-15 | 2020-08-04 | 易造机器人（深圳）有限公司 | Remote human face temperature measurement system based on infrared imaging and implementation method |
| CN111504509A (en) * | 2020-06-17 | 2020-08-07 | 北京中云微迅信息技术有限公司 | Temperature measurement method based on multilayer neural network |
| CN111522073A (en) * | 2020-04-26 | 2020-08-11 | 北京都是科技有限公司 | Method for detecting mask wearing condition of target object and thermal infrared image processor |
| CN111537075A (en) * | 2020-04-14 | 2020-08-14 | 重庆中科云从科技有限公司 | Temperature extraction method, device, machine readable medium and equipment |
| CN111623878A (en) * | 2020-04-27 | 2020-09-04 | 深圳市国脉科技有限公司 | Body temperature measuring method and device, computer readable medium and electronic equipment |
| CN112818816A (en) * | 2021-01-27 | 2021-05-18 | 杭州海康威视数字技术股份有限公司 | Temperature detection method, device and equipment |
| CN113570574A (en) * | 2021-07-28 | 2021-10-29 | 北京精英系统科技有限公司 | Scene feature detection device, search device and search method |
| WO2021227350A1 (en) * | 2020-05-15 | 2021-11-18 | 北京百度网讯科技有限公司 | Method and apparatus for measuring temperature, electronic device, and computer-readable storage medium |
| CN114153001A (en) * | 2021-12-30 | 2022-03-08 | 同方威视技术股份有限公司 | Inspection system and inspection method for inspecting frozen goods in goods |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102270308A (en) * | 2011-07-21 | 2011-12-07 | 武汉大学 | Facial feature location method based on five sense organs related AAM (Active Appearance Model) |
| CN105551036A (en) * | 2015-12-10 | 2016-05-04 | 中国科学院深圳先进技术研究院 | Training method and device for deep learning network |
| CN107423721A (en) * | 2017-08-08 | 2017-12-01 | 珠海习悦信息技术有限公司 | Interactive action detection method, device, storage medium and processor |
| CN107610140A (en) * | 2017-08-07 | 2018-01-19 | 中国科学院自动化研究所 | Near edge detection method, device based on depth integration corrective networks |
| CN107764402A (en) * | 2017-09-25 | 2018-03-06 | 深圳市朗驰欣创科技股份有限公司 | A kind of visible ray temp measuring method based on Infrared Target Detection |
| CN107801017A (en) * | 2017-10-30 | 2018-03-13 | 北京都是科技有限公司 | A kind of more mesh 3D video cameras and its 3D rendering modeling method |
| CN107909093A (en) * | 2017-10-27 | 2018-04-13 | 浙江大华技术股份有限公司 | A kind of method and apparatus of Articles detecting |
| CN108052976A (en) * | 2017-12-13 | 2018-05-18 | 中国兵器装备集团自动化研究所 | A kind of multi-band image fusion identification method |
| CN108268822A (en) * | 2016-12-30 | 2018-07-10 | 深圳光启合众科技有限公司 | Face identification method, device and robot |
| CN109086806A (en) * | 2018-07-16 | 2018-12-25 | 福州大学 | A kind of IOT portable device visual identity accelerated method based on low resolution, compressed image |
| CN109376712A (en) * | 2018-12-07 | 2019-02-22 | 广州纳丽生物科技有限公司 | A kind of recognition methods of face forehead key point |
| CN109558840A (en) * | 2018-11-29 | 2019-04-02 | 中国科学院重庆绿色智能技术研究院 | A kind of biopsy method of Fusion Features |
| CN109788170A (en) * | 2018-12-25 | 2019-05-21 | 合肥芯福传感器技术有限公司 | It is a kind of based on infrared with video image processing system and method for visible light |
| CN109919048A (en) * | 2019-02-21 | 2019-06-21 | 北京以萨技术股份有限公司 | A method of face critical point detection is realized based on cascade MobileNet-V2 |
| CN110060272A (en) * | 2018-01-18 | 2019-07-26 | 杭州海康威视数字技术股份有限公司 | Determination method, apparatus, electronic equipment and the storage medium of human face region |
-
2019
- 2019-11-21 CN CN201911150278.6A patent/CN110987189B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102270308A (en) * | 2011-07-21 | 2011-12-07 | 武汉大学 | Facial feature location method based on five sense organs related AAM (Active Appearance Model) |
| CN105551036A (en) * | 2015-12-10 | 2016-05-04 | 中国科学院深圳先进技术研究院 | Training method and device for deep learning network |
| CN108268822A (en) * | 2016-12-30 | 2018-07-10 | 深圳光启合众科技有限公司 | Face identification method, device and robot |
| CN107610140A (en) * | 2017-08-07 | 2018-01-19 | 中国科学院自动化研究所 | Near edge detection method, device based on depth integration corrective networks |
| CN107423721A (en) * | 2017-08-08 | 2017-12-01 | 珠海习悦信息技术有限公司 | Interactive action detection method, device, storage medium and processor |
| CN107764402A (en) * | 2017-09-25 | 2018-03-06 | 深圳市朗驰欣创科技股份有限公司 | A kind of visible ray temp measuring method based on Infrared Target Detection |
| CN107909093A (en) * | 2017-10-27 | 2018-04-13 | 浙江大华技术股份有限公司 | A kind of method and apparatus of Articles detecting |
| CN107801017A (en) * | 2017-10-30 | 2018-03-13 | 北京都是科技有限公司 | A kind of more mesh 3D video cameras and its 3D rendering modeling method |
| CN108052976A (en) * | 2017-12-13 | 2018-05-18 | 中国兵器装备集团自动化研究所 | A kind of multi-band image fusion identification method |
| CN110060272A (en) * | 2018-01-18 | 2019-07-26 | 杭州海康威视数字技术股份有限公司 | Determination method, apparatus, electronic equipment and the storage medium of human face region |
| CN109086806A (en) * | 2018-07-16 | 2018-12-25 | 福州大学 | A kind of IOT portable device visual identity accelerated method based on low resolution, compressed image |
| CN109558840A (en) * | 2018-11-29 | 2019-04-02 | 中国科学院重庆绿色智能技术研究院 | A kind of biopsy method of Fusion Features |
| CN109376712A (en) * | 2018-12-07 | 2019-02-22 | 广州纳丽生物科技有限公司 | A kind of recognition methods of face forehead key point |
| CN109788170A (en) * | 2018-12-25 | 2019-05-21 | 合肥芯福传感器技术有限公司 | It is a kind of based on infrared with video image processing system and method for visible light |
| CN109919048A (en) * | 2019-02-21 | 2019-06-21 | 北京以萨技术股份有限公司 | A method of face critical point detection is realized based on cascade MobileNet-V2 |
Non-Patent Citations (4)
| Title |
|---|
| MOULAY AKHLOUFI: "Thermal Faceprint: A New Thermal Face Signature Extraction for Infrared Face Recognition", 《2008 CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION》 * |
| SANG-KI KIM: "Fusion of Visual and Infrared Images for Face Recognition", 《2006 SICE-ICASE INTERNATIONAL JOINT CONFERENCE》 * |
| 曹凤杰: "基于特征校正与提取的热红外人脸识别研究", 《电子科技》 * |
| 杜梅: "基于压缩感知的红外人脸识别", 《软件工程》 * |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111537075A (en) * | 2020-04-14 | 2020-08-14 | 重庆中科云从科技有限公司 | Temperature extraction method, device, machine readable medium and equipment |
| CN111486962A (en) * | 2020-04-15 | 2020-08-04 | 易造机器人（深圳）有限公司 | Remote human face temperature measurement system based on infrared imaging and implementation method |
| CN111522073B (en) * | 2020-04-26 | 2023-05-12 | 北京都是科技有限公司 | Method for detecting condition of wearing mask by target object and thermal infrared image processor |
| CN111522073A (en) * | 2020-04-26 | 2020-08-11 | 北京都是科技有限公司 | Method for detecting mask wearing condition of target object and thermal infrared image processor |
| CN111623878A (en) * | 2020-04-27 | 2020-09-04 | 深圳市国脉科技有限公司 | Body temperature measuring method and device, computer readable medium and electronic equipment |
| WO2021227350A1 (en) * | 2020-05-15 | 2021-11-18 | 北京百度网讯科技有限公司 | Method and apparatus for measuring temperature, electronic device, and computer-readable storage medium |
| CN111504509A (en) * | 2020-06-17 | 2020-08-07 | 北京中云微迅信息技术有限公司 | Temperature measurement method based on multilayer neural network |
| CN112818816A (en) * | 2021-01-27 | 2021-05-18 | 杭州海康威视数字技术股份有限公司 | Temperature detection method, device and equipment |
| CN112818816B (en) * | 2021-01-27 | 2024-03-01 | 杭州海康威视数字技术股份有限公司 | Temperature detection method, device and equipment |
| CN113570574A (en) * | 2021-07-28 | 2021-10-29 | 北京精英系统科技有限公司 | Scene feature detection device, search device and search method |
| CN113570574B (en) * | 2021-07-28 | 2023-12-01 | 北京精英系统科技有限公司 | Scene feature detection device, scene feature search device and scene feature search method |
| CN114153001A (en) * | 2021-12-30 | 2022-03-08 | 同方威视技术股份有限公司 | Inspection system and inspection method for inspecting frozen goods in goods |
| CN114153001B (en) * | 2021-12-30 | 2024-02-06 | 同方威视技术股份有限公司 | Inspection system and inspection method for inspecting frozen products in goods |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110987189B (en) | 2021-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110987189B (en) | Method, system and device for detecting temperature of target object | |
| CN111256833B (en) | Body temperature detection method, system and device and thermal infrared image processor | |
| KR20170091677A (en) | Method and system for identifying an individual with increased body temperature | |
| CN110850723B (en) | Fault diagnosis and positioning method based on transformer substation inspection robot system | |
| US9070023B2 (en) | System and method of alerting a driver that visual perception of pedestrian may be difficult | |
| CN111562016A (en) | Human body temperature detection method, system and device and thermal infrared image processor | |
| US9383262B2 (en) | Imaging inspection device | |
| CN111289110A (en) | Human body temperature detection method, system and device and thermal infrared image processor | |
| CN111487320B (en) | Three-dimensional ultrasonic imaging method and system based on three-dimensional optical imaging sensor | |
| JP2017103602A (en) | Position detection device, and position detection method and program | |
| EP2858037B1 (en) | Moving object detector | |
| CN111738132B (en) | Method and device for measuring human body temperature, electronic equipment and readable storage medium | |
| CN112525352A (en) | Infrared temperature measurement compensation method based on face recognition and terminal | |
| CN105486751A (en) | Equipment defect comprehensive detection system | |
| CN111522073B (en) | Method for detecting condition of wearing mask by target object and thermal infrared image processor | |
| CN112067139A (en) | Thermal imaging temperature measuring device and thermal imaging temperature measuring method | |
| US9160986B2 (en) | Device for monitoring surroundings of a vehicle | |
| CN112434598A (en) | Non-contact body temperature measuring method and system | |
| CN111428600A (en) | Smoking detection method, system and device and thermal infrared image processor | |
| JP2002132341A (en) | Field inspection device | |
| Carretas et al. | Atmospheric visibility and Angström exponent measurements through digital photography | |
| CN111414967A (en) | Method for improving robustness of temperature measurement system and monitoring system | |
| Ke et al. | Individual tree crown detection and delineation from high spatial resolution imagery using active contour and hill-climbing methods | |
| CN211477410U (en) | Temperature measuring device | |
| JP5877725B2 (en) | Image monitoring device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |