CN111458039B - Augmented reality body temperature measurement method and device based on infrared temperature measurement camera - Google Patents
Augmented reality body temperature measurement method and device based on infrared temperature measurement camera Download PDFInfo
- Publication number
- CN111458039B CN111458039B CN202010290876.XA CN202010290876A CN111458039B CN 111458039 B CN111458039 B CN 111458039B CN 202010290876 A CN202010290876 A CN 202010290876A CN 111458039 B CN111458039 B CN 111458039B
- Authority
- CN
- China
- Prior art keywords
- temperature
- infrared
- interval
- pixels
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009529 body temperature measurement Methods 0.000 title claims abstract description 52
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000003190 augmentative effect Effects 0.000 title description 12
- 230000036760 body temperature Effects 0.000 claims abstract description 96
- 238000005259 measurement Methods 0.000 claims abstract description 26
- 238000004364 calculation method Methods 0.000 claims abstract description 9
- 230000002159 abnormal effect Effects 0.000 claims description 26
- 239000011521 glass Substances 0.000 claims description 18
- 238000010586 diagram Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 2
- 238000012216 screening Methods 0.000 abstract description 5
- 238000001514 detection method Methods 0.000 description 6
- 238000004861 thermometry Methods 0.000 description 5
- 230000005855 radiation Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 206010037660 Pyrexia Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000009897 systematic effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- QSHDDOUJBYECFT-UHFFFAOYSA-N mercury Chemical compound [Hg] QSHDDOUJBYECFT-UHFFFAOYSA-N 0.000 description 1
- 229910052753 mercury Inorganic materials 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012887 quadratic function Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/02—Constructional details
- G01J5/0275—Control or determination of height or distance or angle information for sensors or receivers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/80—Calibration
Abstract
The invention relates to a method for measuring body temperature by using an infrared temperature measurement camera, which comprises the steps of obtaining an infrared image and a temperature distribution map corresponding to the infrared image through the infrared temperature measurement camera, determining an interested area on the infrared image according to a preset body temperature interval and a pixel point threshold value, calculating a first temperature of the interested area according to the temperature distribution of the interested area, determining a calibration offset according to one or more of the temperature, the humidity and the measurement distance of the current environment, and adding the calibration offset to the first temperature to obtain a second temperature. The invention improves the precision and the accuracy of body temperature measurement, has simple calculation method and low equipment requirement, and can realize mobile remote body temperature screening.
Description
Technical Field
The invention relates to the field of augmented reality application, in particular to a method and a device for measuring the augmented reality body temperature of an infrared temperature measurement camera.
Background
The traditional body temperature measuring method is a method for measuring temperature at a short distance by using a mercury thermometer or a forehead thermometer and the like, and generally needs long measuring time and short-distance contact. And under the condition of large flow of people, the measurement speed is slow. Therefore, a method for realizing remote rapid body temperature detection is urgently needed.
The existing infrared temperature measurement camera can realize non-contact body temperature detection in a fixed place, but the infrared temperature measurement camera must be fixed on the place, a measured person needs to receive measurement at a fixed position according to an indication station, the measurement speed is low, portable detection cannot be realized, the infrared temperature measurement camera is greatly influenced by the environment, and errors in a changing environment are possibly large.
Disclosure of Invention
The invention aims to provide a novel augmented reality body temperature measuring method and device based on an infrared temperature measuring camera, which can realize non-contact rapid measurement.
According to one aspect of the invention, a method for measuring body temperature by using an infrared temperature measurement camera is provided, which includes acquiring an infrared image and a temperature distribution map corresponding to the infrared image by the infrared temperature measurement camera, determining an interested area on the infrared image according to a preset body temperature interval and a pixel point threshold value, calculating a first temperature of the interested area according to the temperature distribution of the interested area, determining a calibration offset according to one or more of the temperature, the humidity and the measurement distance of the current environment, and adding the calibration offset to the first temperature to obtain a second temperature.
Optionally, the method further includes determining whether the value of the second temperature is abnormal according to a preset rule, and if the value of the second temperature is abnormal, generating an alarm signal.
Optionally, the preset rule is: and setting a body temperature abnormal threshold, and if the second temperature exceeds the body temperature abnormal threshold, determining that the temperature is abnormal.
Optionally, the preset rule is: and setting a difference value abnormal threshold value, storing and calculating the average body temperature value of all the body temperatures measured under the current environment, and if the difference between the second temperature and the average body temperature value is greater than the difference value abnormal threshold value, determining that the body temperature is abnormal.
Optionally, the method further comprises: the infrared temperature measurement camera is manually calibrated, and the manual calibration step comprises the following steps: the method comprises the steps of obtaining the temperature and the humidity of the current environment, placing a human face or a black body with known temperature at different measuring distances, respectively obtaining infrared images at different measuring distances and temperature distribution diagrams corresponding to the infrared images through an infrared temperature measuring camera, calculating the maximum peak temperature in the temperature distribution diagrams, and subtracting the known temperature from the maximum peak temperature to obtain calibration offset at different measuring distances.
Optionally, the calculating the maximum peak temperature in the temperature distribution map includes, in the temperature distribution map, counting the number of pixels at different temperatures in a first temperature interval, obtaining a corresponding relationship between the number of pixels and the temperature, scanning the first temperature interval with a second temperature interval at equal intervals, summing the number of pixels in the second temperature interval to obtain a total number of pixels in the second temperature interval, and setting a central temperature value of the second temperature interval when the total number of pixels is maximum as the maximum peak temperature.
Optionally, the calculating the maximum peak temperature in the temperature distribution map includes, in the temperature distribution map, counting the number of pixels at different temperatures in a first temperature interval, obtaining a correspondence between the number of pixels and the temperature, scanning the first temperature interval in a second temperature interval at equal intervals, summing the number of pixels in the second temperature interval to obtain a total number of pixels in the second temperature interval, performing weighted calculation on the total number of pixels in the second temperature interval, and setting a center temperature of the second temperature interval where the weighted total number of pixels is the maximum as the maximum peak temperature.
Optionally, the calculating the first temperature of the region of interest according to the temperature distribution of the region of interest further includes performing a mean algorithm on the temperature distribution of the region of interest to obtain an average temperature of the region of interest as the first temperature.
Optionally, the method further includes acquiring a depth image by a depth camera, calculating a measurement distance of the region of interest according to the depth image, and calibrating the first temperature according to a calibration offset corresponding to the measurement distance obtained by calculation.
Optionally, the determining the region of interest on the infrared image according to a preset body temperature range and a pixel point threshold further includes that the range of the value of the central point of the preset body temperature range is 36-38 ℃, the range of the size of the range is 8-12 ℃, the range of the pixel point threshold is 5% -20% of the total number of pixel points of the infrared temperature measurement camera, and when the number of the pixel points in the preset body temperature range is greater than the pixel point threshold, the range of the pixel points in the preset body temperature range is determined as the region of interest.
Optionally, the region of interest on the infrared image is determined according to a preset body temperature range and a pixel point threshold, and the method further includes that the value of the central point of the preset body temperature range is the maximum peak temperature, the range of the range size is 4-8 ℃, the range of the pixel point threshold is 5% -20% of the total number of pixel points of the infrared temperature measurement camera, and when the number of the pixel points in the preset body temperature range is larger than the pixel point threshold, the range of the pixel points in the preset body temperature range is determined as the region of interest.
According to another aspect of the present invention, there is also provided infrared thermometry, AR, glasses comprising, AR glasses, an infrared thermometry camera, the AR glasses comprising a processor and a memory, the memory storing computer instructions that, when executed by the processor, cause: the method comprises the steps that an infrared temperature measurement camera acquires an infrared image and a temperature distribution map corresponding to the infrared image, an interested area on the infrared image is determined according to a preset body temperature range and a pixel point threshold value, a first temperature of the interested area is calculated according to the temperature distribution of the interested area, a calibration offset is determined according to one or more parameters of the temperature, the humidity and the measurement distance of the current environment, and the calibration offset is added to the first temperature to obtain a second temperature.
Optionally, the thermometric AR glasses further comprise a depth camera for capturing a depth image to calculate the measured distance.
Compared with the prior art, the invention has obvious advantages and beneficial effects. By means of the technical scheme, the augmented reality body temperature measuring method and device based on the infrared temperature measuring camera can achieve considerable technical progress and practicability, have industrial wide utilization value and at least have the following advantages:
the precision and the accuracy of body temperature measurement are improved, the calculation method is simple, the equipment requirement is low, and the mobile remote body temperature screening can be realized.
The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly understood, the present invention may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present invention more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
FIG. 1 is a flow chart of a method for body temperature measurement based on an infrared thermometric camera according to one embodiment of the present invention;
FIG. 2 is an infrared image and temperature profile taken by an infrared thermometry camera according to one embodiment of the present invention;
FIG. 3 is a flow diagram of manual calibration according to one embodiment of the invention;
fig. 4 is a schematic diagram of an augmented reality body temperature measuring device based on an infrared thermometric camera according to an embodiment of the present invention.
Detailed Description
To further illustrate the technical means and effects of the present invention for achieving the predetermined objects, the following detailed description will be given to specific embodiments, structures, features and effects of the method and device for measuring body temperature based on infrared thermometry camera augmented reality according to the present invention with reference to the accompanying drawings and preferred embodiments.
Fig. 1 shows a flow chart of a body temperature measuring method based on an infrared thermometric camera according to an embodiment of the present invention. The body temperature measuring method comprises the following steps:
s1, acquiring an infrared image and a temperature distribution map corresponding to the infrared image through an infrared temperature measurement camera;
s2, determining an interested area on the infrared image according to a preset body temperature range and a pixel point threshold;
s3, calculating a first temperature of the region of interest according to the temperature distribution of the region of interest;
s4, determining a calibration offset according to one or more of the temperature, the humidity and the measurement distance of the current environment, and adding the calibration offset to the first temperature to obtain a second temperature;
s5 displays a value of the second temperature on the region of interest on the infrared image.
In step S1, the infrared thermometric camera is a commercially available infrared thermometric camera, such as the T3C module sold by the ai ri photoelectric production, which has a parallel digital interface output, can adapt to various intelligent processing platforms, and can realize the infrared image display and temperature statistics display functions. For realizing the functions of the invention, as long as the infrared temperature measurement camera can output infrared images and temperature data, the temperature measurement method and the temperature measurement device of one or more embodiments of the invention can be realized. Therefore, the invention does not limit the type of the infrared temperature measurement camera and the realization mode of temperature measurement.
Fig. 2 shows an infrared image and a temperature distribution chart of an infrared thermometric camera according to an embodiment of the present invention. For ease of illustration, the resolution of the infrared image is reduced to 8X8, i.e., 64 pixels in total. Fig. 2A is an infrared image, in which a face to be detected is present, and since the temperature of the face is significantly higher than the temperature of air, it generates strong infrared radiation, and thus, a bright color appears on the infrared image. Fig. 2B is a temperature distribution diagram corresponding to an infrared image calculated and output by the infrared temperature measurement camera.
In step S2, since the size of the human face can only occupy a small portion of the infrared image in the process of remote temperature measurement (measurement distance >1m), most of the temperature information in the infrared image is interference information, and the interference information may be filtered first in order to improve the accuracy and calculation efficiency of remote temperature measurement. In one embodiment, one body temperature interval can be preset, and only the temperature in the body temperature interval is calculated, so that invalid temperature information can be filtered, and the situation that valid information is filtered by mistake is avoided. In some embodiments, the central point of the preset body temperature interval may have a value ranging from 36 ℃ to 38 ℃, and the size of the interval may have a value ranging from 6 ℃ to 12 ℃. In one embodiment, considering that the average temperature of the human body is about 37 ℃, the central point of the body temperature interval may be set to 37 ℃, the interval size may be set to 10 ℃, and the preset body temperature interval at this time is 32 ℃ to 42 ℃, that is, the pixel points with the temperature >42 ℃ and the temperature <32 ℃ output by the infrared temperature measurement camera are not considered. In addition, in addition to filtering the interference information by using the body temperature range, considering that the portable temperature measurement scene changes along with the movement of the user, more interference factors conforming to the body temperature range exist in the temperature measurement scene, for example, street lamps and faces which are not to be measured may appear in the field of view of the infrared camera, and therefore temperature signals conforming to the body temperature range may also be generated in the infrared image, and besides filtering by using the body temperature range, the total number of pixels in the region can be judged, that is, for the region conforming to the body temperature range, whether the total number of pixels in the region is greater than a pixel threshold value or not can be judged, if the total number of pixels in the region is less than the pixel threshold value, the region can be considered not to conform to the size of the face. If the value of the pixel point threshold is set too low, more interference signals can be generated, accuracy of infrared temperature measurement is affected, and if the value of the pixel point threshold is set too high, effective signals can be filtered out, and accuracy of temperature measurement can also be affected. In some embodiments, the range of the pixel point threshold may be 5% to 20% of the total number of pixel points of the infrared camera, for example, for an infrared camera with a resolution of 400 × 300, the pixel point threshold may be 600 and 2400. Through one or more embodiments of the invention, the region of interest in the infrared image can be simply and quickly determined, and compared with the method of determining the region of interest by adopting a face recognition mode, the method has the advantages of high calculation speed and low calculation cost, thereby realizing quick body temperature measurement. In addition, the method for determining the region of interest according to one or more embodiments of the invention can reduce the influence of wearing clothes such as a mask and a hat by a person to be tested, and improve the accuracy.
Continuing with the example of FIG. 2, a specific embodiment of step S2 is illustratively explained. In one embodiment, the preset body temperature interval is set to be 32-42 ℃, the pixel threshold is 4, as shown in fig. 2B, two areas in the temperature distribution map fall into the preset body temperature interval, and the number of pixels in the interference area at the upper right corner is 2, and if the number is smaller than the pixel threshold, the data area is excluded without being processed. Since the temperatures of 8 points in the middle region fall within the body temperature range, the images corresponding to the 8 points in the middle region are set as the region of interest.
In step S3, a first temperature of the region of interest is calculated according to the temperature distribution within the body temperature zone obtained in step S2. In step S3, a region mean algorithm may be used to average all temperature values in the region of interest to reduce random errors. In practical application, the area of the pixel point of interest of the face is usually much larger than the threshold of the pixel point, so that even if a large error occurs in a few pixel points or the temperature value of the pixel point at the edge of the face is low, the pixel point can be offset by the area mean algorithm. As shown in fig. 2, according to the region mean algorithm, the first temperature of the region of interest in fig. 2 can be found to be 36.3 ℃. The first temperature infrared temperature measurement camera obtains the original temperature of the human body. Although the random error in the body temperature measurement has been removed by step S3, since the infrared thermometric camera may have a systematic error, in order to improve the accuracy, it is necessary to correct the first temperature to obtain a more reliable body temperature value.
In step S4, the first temperature may be calibrated to reduce the systematic error of the infrared thermometric camera, wherein the influence of the temperature, humidity and distance of the measured object of the environment is mainly considered. First, considering the influence of the distance of the object to be measured, since the infrared radiation of the object decreases with increasing distance, the temperature value obtained by the infrared camera decreases with increasing distance of the object to be measured from the infrared camera, and generally speaking, for an infrared camera with a focal distance of 1m, the infrared radiation attenuation value in the range of 0m to 1.5m is small, and the distance calibration may not be performed, but for a measurement distance exceeding 1.5m, it is necessary to perform the distance calibration to improve the accuracy. According to one or more embodiments of the present invention, the distance of the measured object may be obtained in various ways, for example, the depth information of the measured object may be obtained by using a depth camera, or a face recognition method may be used to estimate the measured distance according to the pixel range occupied by the face. For the influence of the temperature and the humidity, the higher the ambient temperature is, the higher the detection result of the infrared camera may be, while the increased ambient humidity may cause the lower the detection result of the infrared camera, and for the influence of the temperature and the humidity, the current ambient temperature and humidity may be manually input into the system, and the correction may be performed according to the preset correction mode of the infrared camera. The computer can automatically acquire the numerical values of the temperature sensor and the humidity sensor and transmit the numerical values to the infrared temperature measurement camera by externally connecting the temperature sensor and the humidity sensor on the measuring device, so that the first temperature is calibrated. By calibrating one or more parameters of the temperature, humidity and distance of the object under test of the environment, the first temperature may be converted into a more reliable second temperature, i.e. the body temperature of the object under test, which is an output according to one or more embodiments of the present invention.
Alternatively, the value of the second temperature may be displayed on a region of interest on the infrared image to show the temperature of the measured object to the user. As shown in fig. 2A, a value of 36.3 is displayed on the region of interest of the infrared image, which is convenient for the user to view. Especially when the user wears augmented reality glasses, can directly show the body temperature value of measuring on the screen of augmented reality glasses to correspond true people face, compare in fixed infrared temperature measuring device, can show improvement user's visual experience and experience.
After the measured human body temperature is obtained, whether the value of the second temperature is abnormal or not can be judged according to a preset rule, and if the value of the second temperature is abnormal, an alarm signal is generated. In one embodiment, the preset rule is: and setting a body temperature abnormal threshold, and if the second temperature exceeds the body temperature abnormal threshold, determining that the temperature is abnormal. Specifically, a plurality of determination modes, for example, a strict mode and a loose mode, may be set in the thermometry system. Under a strict mode, the body temperature abnormal threshold value can be set to 37 ℃ in consideration of the error of the infrared temperature measurement camera, so that the face with possible fever symptoms can be screened out as far as possible. In the loose mode, the body temperature abnormality threshold may be set to 37.3 ℃. In another embodiment, considering the system error existing in the measurement system, another preset rule may be added as follows: and setting a difference value abnormal threshold value, storing and calculating the average body temperature value of all the body temperatures measured under the current environment, and if the difference between the second temperature and the average body temperature value is greater than the difference value abnormal threshold value, determining that the body temperature is abnormal. Specifically, the measurement system performs average value statistics on all effective body temperature measurement results in the current environment, and compares the effective body temperature measurement results with the next measurement result, because in practical application scenarios, for example, in body temperature screening in scenic spots or schools, the body temperature difference between most of normal-body-temperature people is small, for example, less than 0.5 ℃, if the difference between the body temperature of a certain person and the average body temperature of all people reaches 0.8 ℃ or higher, it may be considered that the body temperature of the certain person is possibly abnormal, and an alarm may also be performed, so that a worker may perform re-inspection. The abnormity judgment provided by the embodiment of the invention can effectively avoid the risk of the report missing of the patient with fever, and improve the accuracy of measurement. In one embodiment, the alarm mode can adopt a buzzer alarm or deepen display or highlight display of the abnormal temperature.
In order to avoid that the detection of the infrared temperature measuring camera is influenced by different environments, in some preferred embodiments, the infrared temperature measuring camera can be manually calibrated before or during use. FIG. 3 illustrates a manual calibration method according to one embodiment of the present invention. The manual calibration method comprises the following steps:
s41, acquiring the temperature and the humidity of the current environment;
s42, placing the human face or black body with known temperature at different measuring distances;
s43, acquiring infrared images at different measurement distances and temperature distribution maps corresponding to the infrared images respectively through the infrared temperature measurement cameras;
s44, calculating the maximum peak temperature in the temperature distribution diagram;
and S45, subtracting the maximum peak temperature and the known temperature to obtain calibration offset at different measurement distances.
Specifically, the values of the temperature and humidity of the current environment may be input by a user, or may be automatically provided to the system by a temperature sensor and a humidity sensor. The temperature and the humidity of the current environment are obtained, and the temperature distribution graph output by the built-in calibration system of the infrared temperature measurement camera is calibrated. The temperature of the face can be calibrated by adopting temperature measuring equipment with higher precision, and the body temperature can be measured by placing the face at different measuring distances. More preferably, a black body may be used instead of a human face to improve the accuracy of the calibration. The black body is used as a reference source for calibrating the infrared system, can absorb all external infrared electromagnetic waves, and does not generate any reflection and transmission, but can radiate the infrared electromagnetic waves outwards, namely the radiation rate and the absorption rate of the ideal black body are 1, and the transmission rate is 0. Since an ideal black body does not exist in nature, the black body in one or more embodiments of the present invention is a simulated black body as long as emissivity >0.95 is satisfied. But generally speaking, calibration is performed using a human face of known temperature, and the resulting calibration accuracy is sufficient for preliminary screening.
In step S44, calculating a maximum peak temperature in the temperature profile, further comprising:
s441, counting the number of pixel points at different temperatures in a first temperature interval in the temperature distribution map to obtain the corresponding relation between the number of the pixel points and the temperature,
s442, scanning the first temperature interval in a second temperature interval with equal intervals, summing the number of pixel points in the second temperature interval to obtain the total number of pixels in the second temperature interval,
s443, the central temperature value of the second temperature interval when the total number of pixels is maximum is set as the maximum peak temperature.
Specifically, in one embodiment, the first temperature interval may be 32-42 ℃, which may be a range of valid temperature signals, and the second temperature interval may be a varying temperature interval of 2 ℃, which may be varied in steps of 0.1 ℃. For example, at time T1, the second temperature range is 32 to 34, and the total number of pixels in the temperature range is counted, at time T2, the second temperature range is 32.1 to 34.1, and the total number of pixels in the temperature range is counted, … … performs the class estimation in order, and after the entire first temperature range is traversed, assuming that the second temperature range with the maximum total number of pixels is 35.8 to 37.8, the maximum peak temperature is (35.8+37.8)/2 is 36.8 ℃. In other embodiments, the first temperature range may be 30-44 ℃, or 34-42 ℃. The interval between the temperature change intervals may be 1 ℃ or 3 ℃.
In another embodiment, the total number of pixels in the second temperature interval calculated in step S442 may be weighted, for example, the weight of the temperature interval closest to the reasonable true temperature (e.g., 37 ℃) of the human body may be set to 1 (e.g., the center temperature is 37 ℃, the interval is 2 ℃, and the temperature interval is 36-38 ℃), the weight of the temperature interval farthest from the reasonable true temperature of the human body may be set to 0.1 (e.g., the center temperature is 33 ℃, the interval is 2 ℃, and the temperature interval is 32-34 ℃), and the weight of the interval between the center temperature and 33-37 ℃ may be set to a value varying between 0.1-1. The weight can be changed along with the temperature according to linear change, or according to other rules such as an index, a quadratic function and the like, and only the rule that the weight is larger under the condition that the temperature is closer to the reasonable and formal temperature of the human body needs to be reflected. Therefore, the influence of interference factors close to the face temperature in the environment can be avoided, and the obtained maximum peak temperature is more real and accurate.
Preferably, the maximum peak temperature obtained in step S44 is stored and compared with the known face or black body temperature, and if the known temperature is 37 ℃ and the measured distance is 1m, the calibration offset at the measured distance of 1m is-0.2 ℃. Further, the maximum peak temperature obtained in step S44 may be defined as the center point of the preset body temperature section in step S2. Compare in directly giving the central shop of presetting the body temperature interval a default, with the condition of the central point of the body temperature interval is predetermine to the maximum peak temperature, predetermine the width that the body temperature interval can be set for littleer to reduce the calculated amount of data, and reduce the error. For example, when the value of the central point of the preset body temperature interval is in the range of 36-38 ℃, the interval size is in the range of 8-12 ℃, and when the value of the central point of the preset body temperature interval is the maximum peak temperature, the interval size is in the range of 4-8 ℃.
Fig. 4 is a schematic diagram of an augmented reality body temperature measuring device based on an infrared thermometric camera according to an embodiment of the present invention. The device comprises AR glasses 1 and an infrared temperature measurement camera 2. The AR glasses include a processor and a memory storing computer instructions that, when executed by the processor, cause: the method comprises the steps that an infrared temperature measurement camera acquires an infrared image and a temperature distribution map corresponding to the infrared image, an interested area on the infrared image is determined according to a preset body temperature range and a pixel point threshold value, a first temperature of the interested area is calculated according to the temperature distribution of the interested area, a calibration offset is determined according to one or more parameters of the temperature, the humidity and the measurement distance of the current environment, and the calibration offset is added to the first temperature to obtain a second temperature. Optionally, the body temperature measuring device further comprises a depth camera for capturing a depth image to calculate the measurement distance. And a near-eye display is arranged on one or more lenses of the AR glasses, and the infrared image and the measured second temperature can be displayed on the near-eye display for augmented reality display. Because the integrated configuration of AR glasses 1 and infrared temperature measurement camera 2 can realize portable remote measurement body temperature, conveniently carry out epidemic prevention screening.
In a preferred embodiment, the AR glasses 1 further comprise a depth camera 3 for capturing a depth image to calculate said measured distance. The depth information of the object to be measured can be obtained from the depth image, so that the body temperature of the object to be measured can be conveniently calibrated.
The body temperature measuring device according to the embodiment of the invention can also realize the steps of the temperature measuring method and the body temperature measuring function, and the description is omitted here.
Although the present invention has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (11)
1. A method for measuring body temperature by using an infrared temperature measuring camera comprises,
acquiring an infrared image and a temperature distribution map corresponding to the infrared image through the infrared temperature measurement camera,
determining an interested area on the infrared image according to a preset body temperature interval and a pixel point threshold value,
calculating a first temperature of the region of interest based on the temperature distribution of the region of interest,
determining a calibration offset based on one or more of a temperature, a humidity, and a measured distance of a current environment, adding the calibration offset to a first temperature to obtain a second temperature,
wherein, still include right infrared temperature measurement camera carries out manual calibration, manual calibration step includes:
the temperature and the humidity of the current environment are acquired,
a human face or black body of known temperature is placed at different measurement distances,
respectively acquiring infrared images at different measuring distances and temperature distribution maps corresponding to the infrared images through the infrared temperature measuring cameras,
calculating a maximum peak temperature in the temperature profile,
subtracting the maximum peak temperature and the known temperature to obtain calibration offsets at different measurement distances;
wherein said calculating a maximum peak temperature in said temperature profile comprises,
counting the number of pixels at different temperatures in a first temperature interval in the temperature distribution map to obtain the corresponding relation between the number of pixels and the temperature,
scanning the first temperature interval in an equally spaced second temperature interval, summing the number of pixel points in the second temperature interval to obtain the total number of pixels in the second temperature interval,
and setting the central temperature value of the second temperature interval when the total number of the pixels is maximum as the maximum peak temperature.
2. The method of claim 1, further comprising,
and judging whether the value of the second temperature is abnormal or not according to a preset rule, and if so, generating an alarm signal.
3. The method of claim 2, further comprising,
the preset rule is as follows: and setting a body temperature abnormal threshold, and if the second temperature exceeds the body temperature abnormal threshold, determining that the body temperature is abnormal.
4. The method of claim 2, further comprising,
the preset rule is as follows: and setting a difference value abnormal threshold value, storing and calculating the average body temperature value of all the body temperatures measured under the current environment, and if the difference between the second temperature and the average body temperature value is greater than the difference value abnormal threshold value, determining that the body temperature is abnormal.
5. The method of claim 1, wherein the calculating a maximum in the temperature profile
The large peak temperatures, including,
counting the number of pixels at different temperatures in a first temperature interval in the temperature distribution map to obtain the corresponding relation between the number of pixels and the temperature,
scanning the first temperature interval in an equally spaced second temperature interval, summing the number of pixel points in the second temperature interval to obtain the total number of pixels in the second temperature interval,
and performing weighting calculation on the total number of pixels in the second temperature interval, and setting the central temperature of the second temperature interval with the maximum weighted total number of pixels as the maximum peak temperature.
6. The method of claim 1, wherein the temperature is based on the region of interest
A distribution, calculating a first temperature of the region of interest, further comprising,
and carrying out mean value algorithm processing on the temperature distribution of the region of interest to obtain the average temperature of the region of interest as the first temperature.
7. The method of claim 1, further comprising,
the depth image is acquired by a depth camera,
calculating a measured distance of the region of interest from the depth image,
and calibrating the first temperature according to the calibration offset corresponding to the measurement distance obtained by calculation.
8. The method of claim 1, wherein the determining the region of interest on the infrared image according to the preset body temperature range and the pixel point threshold value further comprises,
the range of the value of the central point of the preset body temperature interval is 36-38 ℃, the range of the interval size is 8-12 ℃, the range of the pixel point threshold value is 5-20% of the total number of the pixel points of the infrared temperature measurement camera,
and when the number of the pixel points in the preset body temperature interval is larger than the pixel point threshold value, determining the range of the pixel points in the preset body temperature interval as the region of interest.
9. The method of claim 1, wherein the determining the region of interest on the infrared image according to the preset body temperature range and the pixel point threshold value further comprises,
the value of the central point of the preset body temperature interval is the maximum peak temperature, the range of the interval size is 4-8 ℃, the range of the pixel point threshold value is 5-20% of the total number of the pixel points of the infrared temperature measurement camera,
and when the number of the pixel points in the preset body temperature interval is larger than the pixel point threshold value, determining the range of the pixel points in the preset body temperature interval as the region of interest.
10. An infrared temperature measurement AR glasses comprises a pair of glasses,
the AR glasses are provided with a plurality of AR glasses,
an infrared temperature-measuring camera is arranged on the base,
the AR glasses include a processor and a memory,
the memory stores computer instructions that, when executed by the processor, cause:
the infrared temperature measurement camera acquires an infrared image and a temperature distribution diagram corresponding to the infrared image,
determining an interested area on the infrared image according to a preset body temperature interval and a pixel point threshold value,
calculating a first temperature of the region of interest based on the temperature distribution of the region of interest,
determining a calibration offset according to one or more parameters of the temperature, the humidity and the measured distance of the current environment, and adding the calibration offset to the first temperature to obtain a second temperature;
wherein the infrared temperature measurement AR glasses are further manually calibrated by a method comprising
The temperature and the humidity of the current environment are acquired,
a human face or black body of known temperature is placed at different measurement distances,
respectively acquiring infrared images at different measuring distances and temperature distribution maps corresponding to the infrared images through the infrared temperature measuring cameras,
calculating a maximum peak temperature in the temperature profile,
subtracting the maximum peak temperature and the known temperature to obtain calibration offsets at different measurement distances;
wherein said calculating a maximum peak temperature in said temperature profile comprises,
counting the number of pixels at different temperatures in a first temperature interval in the temperature distribution map to obtain the corresponding relation between the number of pixels and the temperature,
scanning the first temperature interval in an equally spaced second temperature interval, summing the number of pixel points in the second temperature interval to obtain the total number of pixels in the second temperature interval,
and setting the central temperature value of the second temperature interval when the total number of the pixels is maximum as the maximum peak temperature.
11. The thermometric AR glasses according to claim 10, further comprising,
a depth camera to capture a depth image to calculate the measured distance.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010290876.XA CN111458039B (en) | 2020-04-14 | 2020-04-14 | Augmented reality body temperature measurement method and device based on infrared temperature measurement camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010290876.XA CN111458039B (en) | 2020-04-14 | 2020-04-14 | Augmented reality body temperature measurement method and device based on infrared temperature measurement camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111458039A CN111458039A (en) | 2020-07-28 |
| CN111458039B true CN111458039B (en) | 2021-06-15 |
Family
ID=71684564
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010290876.XA Active CN111458039B (en) | 2020-04-14 | 2020-04-14 | Augmented reality body temperature measurement method and device based on infrared temperature measurement camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111458039B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111579083B (en) * | 2020-05-13 | 2022-06-07 | 芋头科技（杭州）有限公司 | Body temperature measuring method and device based on infrared image face detection |
| CN111896114A (en) * | 2020-07-29 | 2020-11-06 | 天津国电津能滨海热电有限公司 | Intelligent temperature measuring method and system for raw coal bunker |
| US20220061675A1 (en) * | 2020-08-28 | 2022-03-03 | Pixart Imaging Inc. | Forehead temperature measurement system with high accuracy |
| CN112665734B (en) * | 2020-12-04 | 2023-08-04 | 杭州新瀚光电科技有限公司 | Temperature measurement method and device based on reference calibration |
| CN113091920A (en) * | 2021-04-14 | 2021-07-09 | 承德石油高等专科学校 | Infrared electronic simulation target system and control method thereof |
| CN113280926B (en) * | 2021-05-19 | 2023-08-04 | 广东天波信息技术股份有限公司 | Temperature measuring method and temperature measuring equipment |
| CN115615557A (en) * | 2021-06-29 | 2023-01-17 | 新加坡国立大学 | Body temperature measuring method and body temperature measuring system |
| CN113743222A (en) * | 2021-08-04 | 2021-12-03 | 北京澎思科技有限公司 | Body temperature measuring method and device, electronic equipment and readable storage medium |
| CN115393578B (en) * | 2022-10-13 | 2023-04-21 | 北京鹰之眼智能健康科技有限公司 | Composite region data processing system for acquiring metabolic state |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101040288A (en) * | 2004-07-07 | 2007-09-19 | 真实成像有限公司 | 3d thermal breast cancer detector |
| CN206339309U (en) * | 2016-11-16 | 2017-07-18 | 杭州天铂红外光电技术有限公司 | Infrared thermal imagery glasses |
| WO2018054671A1 (en) * | 2016-09-23 | 2018-03-29 | Robert Bosch Gmbh | Method for determining two-dimensional temperature information without contact, and infrared measuring system |
| CN109443547A (en) * | 2018-10-30 | 2019-03-08 | 中国神华能源股份有限公司 | A kind of infrared thermal imaging device |
| CN110196103A (en) * | 2019-06-27 | 2019-09-03 | Oppo广东移动通信有限公司 | Thermometry and relevant device |
-
2020
- 2020-04-14 CN CN202010290876.XA patent/CN111458039B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101040288A (en) * | 2004-07-07 | 2007-09-19 | 真实成像有限公司 | 3d thermal breast cancer detector |
| WO2018054671A1 (en) * | 2016-09-23 | 2018-03-29 | Robert Bosch Gmbh | Method for determining two-dimensional temperature information without contact, and infrared measuring system |
| CN206339309U (en) * | 2016-11-16 | 2017-07-18 | 杭州天铂红外光电技术有限公司 | Infrared thermal imagery glasses |
| CN109443547A (en) * | 2018-10-30 | 2019-03-08 | 中国神华能源股份有限公司 | A kind of infrared thermal imaging device |
| CN110196103A (en) * | 2019-06-27 | 2019-09-03 | Oppo广东移动通信有限公司 | Thermometry and relevant device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111458039A (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111458039B (en) | Augmented reality body temperature measurement method and device based on infrared temperature measurement camera | |
| WO2021196360A1 (en) | Temperature measurement method and system | |
| CN111579083B (en) | Body temperature measuring method and device based on infrared image face detection | |
| CN103782232B (en) | Projector and control method thereof | |
| CN111337142A (en) | Body temperature correction method and device and electronic equipment | |
| KR100939079B1 (en) | System for mesurement of the snowfall and method for mesurement of the snowfall | |
| CN111609939B (en) | Individual body temperature abnormity screening method, device and equipment | |
| CN110095193B (en) | Thermal infrared imager noise equivalent temperature difference testing method and system | |
| CN108335454B (en) | A kind of fire behavior detection method and device | |
| CN108600736B (en) | Terminal light sensation calibration method and device, terminal and storage medium | |
| CN112161711A (en) | Temperature correction method and device, black body and infrared temperature measurement equipment and system | |
| WO2021259365A1 (en) | Target temperature measurement method and apparatus, and temperature measurement system | |
| CN113358231B (en) | Infrared temperature measurement method, device and equipment | |
| TWI468658B (en) | Lens test device and method | |
| CN112504463A (en) | Temperature measurement system and temperature measurement method thereof | |
| CN111707374B (en) | Distance estimation method and system for human body infrared thermometer | |
| CN107580180B (en) | Display method, device and equipment of view frame and computer readable storage medium | |
| CN112418251B (en) | Infrared body temperature detection method and system | |
| KR20170017401A (en) | Apparatus for processing Images | |
| TWI635844B (en) | Vision detecting device and vision detecting method capable of automatically adjusting visual target size | |
| CN112504473B (en) | Fire detection method, device, equipment and computer readable storage medium | |
| JP3888528B2 (en) | Liquid level recognition processing apparatus and liquid level monitoring system | |
| CN111297336B (en) | Body temperature measuring method and device based on infrared and terahertz and security check equipment | |
| JP2015045593A (en) | Method of inspecting numeric value of color of exterior material, and correction tool therefor | |
| CN113701894A (en) | Face temperature measurement method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |