WO2022104816A1 - Temperature compensation method and system for thermal camera - Google Patents

Temperature compensation method and system for thermal camera Download PDF

Info

Publication number
WO2022104816A1
WO2022104816A1 PCT/CN2020/130986 CN2020130986W WO2022104816A1 WO 2022104816 A1 WO2022104816 A1 WO 2022104816A1 CN 2020130986 W CN2020130986 W CN 2020130986W WO 2022104816 A1 WO2022104816 A1 WO 2022104816A1
Authority
WO
WIPO (PCT)
Prior art keywords
temperature
thermal camera
black body
function
thermal
Prior art date
Application number
PCT/CN2020/130986
Other languages
French (fr)
Chinese (zh)
Inventor
王云龙
罗煜
Original Assignee
江苏镭博智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 江苏镭博智能科技有限公司 filed Critical 江苏镭博智能科技有限公司
Publication of WO2022104816A1 publication Critical patent/WO2022104816A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/52Radiation pyrometry, e.g. infrared or optical thermometry using comparison with reference sources, e.g. disappearing-filament pyrometer
    • G01J5/53Reference sources, e.g. standard lamps; Black bodies
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/80Calibration

Definitions

  • the present invention relates to the technical field of thermal cameras, and more particularly, to a temperature compensation method and system for thermal cameras.
  • Thermal cameras are also known as infrared cameras. Any object can radiate infrared rays as long as the temperature is higher than thermodynamic zero, and the infrared rays radiated by different temperatures are also different. Thermal cameras detect the health of the body through temperature based on this principle. Thermal cameras have relatively high requirements for operating temperature. Since thermal cameras can only achieve an accuracy of about ⁇ 2 degrees Celsius or even ⁇ 5 degrees Celsius, and the ambient temperature and the distance between the face and the camera will affect the final reading, so The error is extremely large.
  • a black body with a known temperature is placed in the measurement area, the temperature of the black body is read by a thermal camera, and the temperature of the entire measurement screen is calibrated by comparing it with the actual temperature of the black body.
  • This method requires the use of black body coordination during measurement. Since the unit price of the black body is between several hundred and several thousand dollars, the price is relatively high, and the relative position of the camera and the black body must be fixed using the traditional measurement method. If there is a position offset, it cannot be calibrated. . Moreover, the working environment of the black body has certain requirements, and the traditional measurement method also has high requirements on the ambient temperature.
  • the present invention provides a temperature compensation method and system for thermal cameras. Calibration to improve measurement accuracy.
  • a temperature compensation method for a thermal camera the thermal camera is connected with a temperature sensor coated with black body paint, the temperature sensor is arranged in front of the thermal camera, and a function is fitted according to the temperature of the temperature sensor measured by the thermal camera and the actual temperature of the temperature sensor
  • the offset of the thermal camera is calibrated; the black body is set in front of the thermal camera, and the fitting function is based on the temperature measured by the thermal camera and the black body temperature.
  • the resulting thermal camera measurement errors are calibrated.
  • Step 1 The thermal camera is connected with the temperature sensor coated with black body paint.
  • the temperature sensor is set in front of the thermal camera.
  • the thermal camera measures the temperature corresponds to the actual temperature of the temperature sensor Ty 1i
  • n 1 is the thermal camera drift compensation coefficient, the drift of the thermal camera itself is calibrated by the function f1, resulting in errors;
  • Step 2 Set a black body with uniform heat in front of the thermal camera, the black body covers the entire screen, set different black body temperatures, save the data image corresponding to the thermal camera, and obtain the measured temperature and The function f2 between the black body temperatures, through which the camera inhomogeneity is calibrated by the function f2 causes errors;
  • Step 3 Set different temperatures Ty 3i on the black body reflective surface, and read the temperature Tx 3i0 of the black body reflective surface measured by the thermal camera.
  • the measured temperature Tx 3i0 is first calibrated by the function f1 and the function f2 to obtain the calibrated temperature Tx 3i , and the thermosensitive temperature is obtained.
  • Step 4 Set different ambient temperatures Ty 4i , read the temperature measured by the thermal camera Tx 4i calibrated by the function f3 in the different ambient temperatures Ty 4i , and obtain the measurement of the thermal camera through the difference between the ambient temperature and the temperature measured by the thermal camera
  • Step 5 Read the temperature Ty 5i of the black body at different distances from the thermal camera, and obtain the function f5 between the measured temperature Tx 5i of the thermal camera and the measured distance after calibration by the function f4.
  • the thermal camera in step 1 is connected with the temperature sensor through a bus, and the thermal camera obtains the actual temperature of the temperature sensor through the bus.
  • the temperature sensor and the thermal camera of the present invention are connected by a bus, and the thermal camera can directly read the temperature of the temperature sensor through the I2C bus.
  • step 2 first set the black body temperature T, collect several pictures, take the average temperature of each pixel in the picture, set the black body temperature repeatedly, save the image data of the black body reflection surface at different temperatures, and go through the function f2.
  • Linear correction is used to obtain the temperature after calibration of each coordinate point of the thermal camera.
  • temperature non-uniformity calibration first obtain multiple pictures at the same set temperature, average the temperatures of the multiple pictures, and save them as thermal data images for the calculation of camera non-uniformity compensation.
  • Img T1[x, y] represents the temperature of the pixel of the data image Img T1 at the (x, y) coordinate point
  • Img T2[x, y] represents the temperature of the pixel of the data image Img T2 at the (x, y) coordinate point
  • Temperature, build function f2 by slope gain and offset offset, ie T[x,y] gain[x,y]*Img[x,y]+offset[x,y]
  • Img[x,y] is The temperature of the (x,y) pixel point measured by the thermal camera
  • T[x,y] is the temperature after the unevenness calibration, and the unevenness of the camera is calibrated by the function f2, resulting in errors.
  • the thermal camera simultaneously obtains the temperature of all areas of the captured image during measurement, that is, the temperature of each pixel in the image whose position coordinates are (x, y).
  • the non-uniformity generated by the sensitive camera at different positions of the picture is linearly corrected.
  • the slope gain and offset offset are calculated for the position coordinates (x, y) of each pixel in the image, and the temperature after calibration of each coordinate point is obtained.
  • step 3 first set the temperature of the black body reflective surface, after the temperature is stable, measure the temperature of the black body reflective surface several times and then take the average value, the average value is the temperature measured by the thermal camera; Compute module read.
  • the computing module of the present invention uses the embedded minicomputer TX2 box of NVIDIA, and its serial port is an ordinary USB interface. After connecting with the black body, click the center of the black body, select the black body temperature scanning range, and scan from the low temperature range to the high temperature range.
  • the temperatures are respectively set in a low temperature range and a high temperature range, the low temperature range is 26 to 30°C, and the high temperature range is 40 to 42°C.
  • different temperature ranges need to be set when setting the black body temperature, which is divided into a high temperature range and a low temperature range in the present invention.
  • the distance between the black body and the thermal camera is smaller than a fixed value.
  • the distance between the black body and the thermal camera is set to be less than 10cm, and if the distance is too large, the accuracy of the thermal camera calibration is easily reduced.
  • the present invention performs temperature compensation through a high-precision temperature sensor. Since the temperature sensor can read the temperature of the environment in real time, the thermal camera can be calibrated in real time. According to the statistical comparison of the limited number of experimental data, the absolute value of the actual temperature difference between the thermal camera and the black body after the temperature compensation of the present invention is 0.133°C, the average value of the error is 0.0026, the standard deviation (std) of the error is 0.1718, and the error The proportion of pixels whose absolute value is less than 0.3 degrees Celsius is about 92%, and the proportion of pixels whose absolute value is less than 0.5 degrees Celsius can reach 99.44%, and the accuracy and precision are greatly improved.
  • a thermal camera temperature compensation system using the thermal camera temperature compensation method to calibrate the thermal camera, the system includes a temperature sensor connected with the thermal camera, and also includes a black body. Through the temperature sensor and the black body, the thermal camera is calibrated using the thermal camera calibration method. After the thermal camera leaves the factory, this system is used for calibration. After the calibration is completed, the high-precision temperature sensor connected to the thermal camera can be used. The measurement value of the thermal camera is calibrated in real time to improve the measurement accuracy.
  • the temperature sensor is coated with black body paint. Taking into account the cost issue, a temperature sensor coated with black body paint is used to replace the black body, and it is connected with a thermal camera to achieve real-time temperature calibration.
  • the temperature sensor has an accuracy of ⁇ 0.1°C in the range of -20°C to 50°C.
  • a high-precision temperature sensor is used for temperature compensation, which can provide 16-bit temperature results with a resolution of 0.0078°C, at -20°C to 50°C The accuracy within the range is ⁇ 0.1°C.
  • the invention realizes the temperature compensation of the thermal camera with low cost and high precision, and the corresponding calibration is real-time. After the thermal camera leaves the factory, since the camera itself is connected to the temperature sensor, real-time calibration can be realized through the temperature sensor, and only one calibration is required. It can be used all the time with higher accuracy ( ⁇ 0.3 degrees Celsius).
  • the temperature compensation method of the invention has higher accuracy and precision for the calibration of the thermal camera than the prior art, has high reliability, and is suitable for wide application.
  • the temperature compensation method of the present invention achieves higher precision.
  • the temperature read by a thermal camera in the prior art fluctuates around 2-5 degrees Celsius.
  • the absolute value of the difference between the temperature of a single point read and the actual temperature of the black body is 0.133 degrees Celsius
  • the error is 0.133 degrees Celsius.
  • the average value is 0.0026
  • the standard deviation (std) of the error is 0.1718
  • the proportion of pixels with an absolute value of error less than 0.3 degrees Celsius is about 92%
  • the proportion of pixels with an absolute value of error less than 0.5 degrees Celsius can reach 99.44%. Its measurement accuracy and accuracy degree increased significantly.
  • the temperature compensation method of the invention realizes real-time calibration.
  • a high-precision temperature sensor is used in front of the thermal camera.
  • the high-precision temperature sensor reads the temperature of the environment in real time
  • the thermal camera reads the temperature of the high-precision temperature sensor in real time.
  • the measured temperature is calibrated in real time, combined with the calibration of the inhomogeneity of the thermal camera through the black body, and the fitting between the ambient temperature and the distance of the measured entity obtained through the black body.
  • the curve has lower requirements on the ambient temperature and humidity during measurement, and is suitable for various measurement environments.
  • the implementation of the present invention requires lower cost, and does not need to be equipped with high-cost equipment such as a black body during measurement, and the black body only needs to be used during calibration after leaving the factory.
  • the thermal camera also only needs to be calibrated once after leaving the factory, and then it can be used all the time, and the cost of after-sales maintenance is lower. It can be solved by setting parameters.
  • 1 is a comparison diagram of a temperature curve after calibration of the thermal camera of the present invention and an actual temperature value
  • Fig. 2 is the connection schematic diagram of the temperature sensor and the thermal camera of the present invention
  • FIG. 3 is a schematic diagram of the connection position of the black body and the thermal camera during the non-uniformity calibration of the present invention
  • the accuracy of the thermal camera is determined by factors such as temperature drift, temperature non-uniformity (Non Uniformity), temperature sensor offset, ambient temperature and test distance of the thermal camera 2 itself.
  • the thermal camera calibration system of this embodiment includes a thermal camera 2 and a black body.
  • the thermal camera 2 is connected to a high-precision temperature sensor 1, and the temperature sensor is a temperature sensing chip.
  • the high-precision temperature sensing chip used in this embodiment provides 16-bit temperature results and can reach a resolution of 0.0078°C.
  • the high-precision temperature sensor 1 can achieve up to ⁇ 0.1°C in the range of -20°C to 50°C without calibration. accuracy.
  • the temperature compensation method of the thermal camera 2 in this embodiment will be described below through specific calibration steps.
  • Step 1 Calibrate the drift of the thermal camera 2 itself:
  • the thermal camera 2 is connected with a temperature sensor, the temperature sensor is arranged in front of the thermal camera 2, the temperature sensor is coated with black body paint, and the thermal camera 2 uses the temperature sensor to calibrate the drift of the camera itself.
  • the drift of the thermal camera 2 itself is between ⁇ 2 degrees Celsius to ⁇ 5 degrees Celsius. Since the drift of the camera itself is the drift of the entire image, there will be no error in the measurement temperature of a certain part or point in the image, but the measurement in other places is normal. Therefore, if the exact temperature of a part of the image is known, the temperature of the entire screen can be compensated.
  • the i thermal cameras 2 measure temperatures Tx 1i , where i is a natural number greater than 1.
  • the actual temperature Ty 1i corresponding to the temperature sensor when the temperature measured by the thermal camera 2 is obtained through the bus.
  • Tx 1i and Ty 1i use linear fitting to obtain the function f1 between the temperature measured by the thermal camera and the actual temperature of the temperature sensor.
  • the camera drift compensation coefficient using the function f1 to calibrate the camera itself drifts to cause errors.
  • the thermal camera 2 is calibrated by additionally setting a black body, which is expensive and requires high ambient temperature. In this embodiment, the issue of economy is considered comprehensively.
  • the thermal camera 2 is connected to the high-precision temperature sensor 1, and the temperature sensor is coated with high-reflection black body paint. Through various calibration algorithm experiments, the black body is coated.
  • the temperature sensor of lacquer is equivalent to a black body, which can achieve a similar effect to the black body, and greatly reduce the cost while ensuring the accuracy.
  • the high reflectivity black body paint is oily 95 black body paint with a reflectivity of 0.95 ⁇ 0.02.
  • the thermal camera 2 reads the temperature of the high-precision temperature sensor 1 through the I2C bus, and the thermal camera 2 also measures the temperature sensor. According to the actual temperature of the temperature sensor and the temperature measured by the thermal camera, the parameter n 1 of the function f1 after linear fitting is updated in real time, and the measured temperature of the thermal camera 2 is calibrated in real time through this parameter n 1 , as shown in Figure 2, the high The precision temperature sensor 1 is located at the upper left of the thermal camera 2, about 20cm away from the thermal camera 2. The temperature sensor does not need to maintain a fixed position with the thermal camera 2 during use, even if the temperature sensor position shifts during use, as long as Correcting the reference area of the temperature sensor for the thermal camera 2 will not affect the temperature measurement and data acquisition.
  • Step 2 Calibrate the thermal camera inhomogeneity:
  • the thermal camera 2 is composed of a thermal imaging dot matrix, and the values obtained by objects of the same temperature at different screen positions will be inconsistent.
  • the non-uniformity of the thermal camera 2 refers to the inconsistency of values obtained by objects of the same temperature at different screen positions.
  • a thermally uniform black body is set at a fixed position in front of the thermal camera 2, as shown in FIG. Set different black body temperatures, save the data image corresponding to the thermal camera 2, and obtain the function f2 between the temperature measured by the thermal camera 2 and the black body temperature for the coordinates (x, y) of each pixel at the position of the data image, through the function
  • the f2 calibration camera non-uniformity causes errors.
  • the distance D between the black body reflective surface 3 and the thermal camera 2 is about 10cm during calibration, and the temperature fluctuation of the entire black body image is within 0.3°C.
  • the temperature range of the low temperature interval is 26 to 30 °C, wait for the temperature to stabilize, that is, when the temperature fluctuation of the reflective surface of the black body is less than 0.3 °C, collect several pictures, and take the temperature average for all pixels in the image.
  • the black body temperature is set to the high temperature interval temperature T2, the high temperature interval temperature range is 40 to 42 °C, wait for the temperature to stabilize, that is, when the temperature fluctuation of the black body's reflective surface is less than 0.3 °C, collect several pictures, for all pixels in the image
  • the temperature average was obtained for the data image Img T2.
  • the slope gain and offset offset of the temperature non-uniformity compensation function of the thermal camera are calculated to obtain the compensated temperature.
  • the calculation formulas of gain and offset are as follows:
  • Img T 1 [x, y] represents the temperature of the data image Img T1 at the (x, y) coordinate point
  • Img T 2 [x, y] represents the data image Img T2 at the (x, y) coordinate point
  • the temperature of the pixel gain[x, y] represents the slope gain of the (x, y) coordinate point pixel
  • offset[x, y] represents the offset offset of the (x, y) coordinate point pixel.
  • the temperature of the (x,y) pixel point, T[x,y] is the temperature after non-uniformity calibration.
  • Steps 1 and 2 calibrate the temperature of the thermal camera itself.
  • Step 1 calibrates by reading the temperature at the position of the high-precision temperature sensor 1 in the image and calculating the difference with the actual temperature of the high-precision temperature sensor 1 .
  • the non-uniformity calibration has not taken into account the different reflectivity of the temperature sensor and the reflectivity of the black body, and the temperature sensor is very important in the thermal imaging system of the thermal camera 2. Since the high-precision temperature sensor 1 still has certain errors, After the camera drift calibration in step 1 and the non-uniformity calibration in step 2, the blackbody temperature sweep calibration is used in step 3 to further calibrate the reflectivity of the temperature sensor.
  • the black body temperature scanning calibration process is simply to fit the relationship between the temperature of a certain point read by the thermal camera 2 after the first two steps of calibration and the actual temperature of the point.
  • the actual temperature of the point is obtained by reading the black body temperature. get. Since the temperature has fluctuation and is an interval, the relationship between the temperature of a certain point read by the thermal camera 2 after calibration and the actual temperature of the black body is calculated by dynamically setting the temperature of the black body.
  • the TX2 box is an embedded small computer of NVIDIA, and its serial port is an ordinary USB interface. After the two are connected, the TX2 box can read the black body. temperature.
  • the temperature of the black body reflective surface 3 is set, and the black body reflective surface 3 is the plane of the temperature read by the thermal camera 2 .
  • click the center of the black body with the mouse click the center of the black body with the mouse, and select the black body temperature scanning range.
  • the scanning range starts from the temperature in the low temperature range to the temperature in the high temperature range.
  • the interval temperature is generally 40 to 42°C.
  • the thermal camera 2 After each temperature measurement point is stable, the thermal camera 2 reads the temperature of the selected area, selects the temperature read from multiple pictures, and takes the average temperature, which is the final reading of the thermal camera 2 .
  • the independent variable of the function f3 is the reading of the thermal camera 2 after uniformity calibration and high-precision sensor calibration; the strain variable of the function f3 is the temperature of the black body, which is our target temperature. Fit the temperature measured by the independent variable thermal camera and the actual temperature of the strain variable black body to obtain the function f3.
  • Tx 3i is the temperature measured by the thermal camera 2
  • the function f3 is used to calibrate Camera 2 causes errors due to the reflectivity of the temperature sensor.
  • the thermal camera 2 is not connected to the black body in actual use, and the use of the black body here is only for calculating the fitting function f3.
  • the user reads the temperature after calibrating the drift and non-uniformity of the camera itself, and further corrects it through the linear transformation function f3 calibrated by the temperature sensor, so that the temperature read by the thermal camera 2 is more accurate.
  • thermal imaging system in this embodiment needs to read a high-precision temperature sensor to calibrate the camera drift, so that the system needs to perform more accurate ambient temperature calibration.
  • n 4 (V2-V1)/(T3-T4).
  • the ambient temperature calibration process requires a temperature-controlled, or slowly rising or falling temperature test environment.
  • calibrating first place the black body in front of the thermal camera 2 and set the temperature of the black body. Then run the software, set the relevant parameters, click the center of the black body with the mouse and collect data.
  • the independent variable in the function f4 is the ambient temperature
  • the dependent variable is the temperature of the black body read.
  • the thermal camera 2 measures temperature by reading energy at far infrared wavelengths. In the process of transmission, the energy of infrared light will be absorbed by the air and attenuated, so the farther the distance is, the lower the measured temperature.
  • the temperature of the same black body is measured at different distances, the distance coefficient is calculated according to the temperature range of the object, the compensation formula function f5 is determined by the distance coefficient n5, and the test distance of the thermal camera 2 is calibrated.
  • the calibration process for the test distance is as follows, first place the black body in front of the thermal camera 2, and set the temperature of the black body. Then by moving the distance of the black body, read the temperature of the black body at the corresponding distance. At this time, the independent variable in the function f5 is the distance between the black body and the camera, and the dependent variable is the temperature of the black body read by the camera. By fitting the data, the relationship between the independent variable and the dependent variable, that is, the function f5, is obtained.
  • the temperature after calibration can be obtained through the distance compensation coefficient n 5 and the polynomial order m.
  • the polynomial order m 7.
  • the temperature fluctuation read by the thermal camera 2 in the prior art is about 2-5 degrees Celsius.
  • the absolute value of the difference between the temperature of a single point read and the actual temperature of the black body is 0.133 degrees Celsius on the data set collected by the thermal camera 2 calibrated in the present invention from 0.5 meters to 5 meters.
  • the average value of the error is 0.0026
  • the standard deviation (std) of the error is 0.1718
  • the proportion of pixels with an absolute value of error less than 0.3 degrees Celsius is about 92%
  • the proportion of pixels with an absolute value of error less than 0.5 degrees Celsius can reach 99.44%. Accuracy is greatly improved.
  • Figure 1 shows a comparison between the temperature curve of the thermal camera 2 after calibration and the actual temperature of the black body in this embodiment.
  • the test data of the thermal camera 2 on the black body after calibration is represented by a dotted line
  • the actual temperature of the black body is represented by a solid line. It can be seen from Figure 1 that the dotted line and the solid line almost overlap, that is, the temperature curve tested by the thermal camera after calibration and the actual temperature curve of the black body almost overlap, indicating that the calibrated thermal camera 2 has high measurement accuracy and high precision.
  • the thermal camera 2 does not need to be equipped with a black body, and can achieve high-precision temperature measurement only through the temperature sensor connected to itself, and the cost is reduced under the condition of ensuring the accuracy.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Photometry And Measurement Of Optical Pulse Characteristics (AREA)
  • Radiation Pyrometers (AREA)

Abstract

Disclosed in the present invention are a temperature compensation method and system for a thermal camera, belonging to the technical field of thermal cameras. Aiming at the problems of low precision and low measurement accuracy of thermal cameras in the prior art, the present invention provides a temperature compensation method and system for a thermal camera. A temperature sensor is connected in front of the thermal camera and combined with a black body. The effects caused by factors such as drift of the camera itself, non-uniformity of the thermal camera, refractive index of the temperature sensor, ambient temperature and measurement distance are calibrated by calculating a function of the temperature measured by the thermal camera, the actual temperature of the temperature sensor, the temperature of the block body, the ambient temperature and the distance of a measured entity. The present invention realizes temperature compensation for a thermal camera with low cost and high precision, and the corresponding calibration is real-time. After the thermal camera leaves the factory, the thermal camera only needs to be calibrated once and can be used all the time. The black body does not need to be equipped during measurement, so high measurement precision and good reliability can be obtained with low cost.

Description

一种热敏相机温度补偿方法和系统A kind of thermal camera temperature compensation method and system 技术领域technical field
本发明涉及热敏相机技术领域,更具体地说,涉及一种热敏相机温度补偿方法和系统。The present invention relates to the technical field of thermal cameras, and more particularly, to a temperature compensation method and system for thermal cameras.
背景技术Background technique
热敏相机又称红外相机,任何物体只要温度高于热力学零度就能辐射红外线,且温度不同所辐射的红外线也有差异,热敏相机基于此原理通过温度来检测身体的健康状况。热敏相机对使用温度的要求比较高,由于热敏相机本身只能达到大概±2摄氏度甚至±5摄氏度的精度,再加上环境温度和人脸与摄像机的距离都会影响最终的读数,因此使得误差特别的大。Thermal cameras are also known as infrared cameras. Any object can radiate infrared rays as long as the temperature is higher than thermodynamic zero, and the infrared rays radiated by different temperatures are also different. Thermal cameras detect the health of the body through temperature based on this principle. Thermal cameras have relatively high requirements for operating temperature. Since thermal cameras can only achieve an accuracy of about ±2 degrees Celsius or even ±5 degrees Celsius, and the ambient temperature and the distance between the face and the camera will affect the final reading, so The error is extremely large.
常规的热敏相机均提供自动校准机制(shutter),可以设置间隔一段时间,如1至5分钟后自动校准一次。但是在自动校准机制设置的间隔内产生的测量误差无法及时的进行实时校准,在测量时无法达到测量精度要求。Conventional thermal cameras all provide an automatic calibration mechanism (shutter), which can be set at intervals, such as automatic calibration once after 1 to 5 minutes. However, the measurement error generated within the interval set by the automatic calibration mechanism cannot be calibrated in real time in time, and the measurement accuracy requirements cannot be met during measurement.
现有技术中是在测量区域内放置一个已知温度的黑体,热敏相机对黑体的温度进行读取,通过与黑体实际温度的对比,对整个测量画面的温度进行校准。该方法需要在测量时使用黑体配合,由于黑体的单价在几百到几千美元之间,价格比较昂贵,而且使用传统测量方法相机和黑体的相对位置要固定,如果产生位置偏移就无法校准。并且黑体的工作环境有一定要求,传统测量方法对环境温度的要求也很高。In the prior art, a black body with a known temperature is placed in the measurement area, the temperature of the black body is read by a thermal camera, and the temperature of the entire measurement screen is calibrated by comparing it with the actual temperature of the black body. This method requires the use of black body coordination during measurement. Since the unit price of the black body is between several hundred and several thousand dollars, the price is relatively high, and the relative position of the camera and the black body must be fixed using the traditional measurement method. If there is a position offset, it cannot be calibrated. . Moreover, the working environment of the black body has certain requirements, and the traditional measurement method also has high requirements on the ambient temperature.
发明内容SUMMARY OF THE INVENTION
1.要解决的技术问题1. Technical problems to be solved
针对现有技术中存在的热敏相机精度不高,测量准确度低的问题,本发明提供一种热敏相机温度补偿方法和系统,通过使用高精度的温度感应芯片,实现热敏相机的实时校准,提高测量精度。Aiming at the problems of low precision and low measurement accuracy of thermal cameras in the prior art, the present invention provides a temperature compensation method and system for thermal cameras. Calibration to improve measurement accuracy.
2.技术方案2. Technical solutions
本发明的目的通过以下技术方案实现。The object of the present invention is achieved through the following technical solutions.
一种热敏相机温度补偿方法,热敏相机与涂覆黑体漆的温度传感器连接,温度传感器设置在热敏相机的前方,根据热敏相机测量的温度传感器温度以及温度传感器的实际温度拟合函数对热敏相机的偏移进行校准;在热敏相机前设置黑体,根据热敏相机测量温度和黑体温度拟合函数对由于热敏相机的不均匀性、温度传感器折射率、环境温度和测量距离导致的热敏相机测量误差进行校准。本发明通过在热敏相机面前设置温度传感器和黑体,针对多个因素对热敏相机测量数据的影响进行校准,以获得高精度的测量结果,提高测量的准确性。A temperature compensation method for a thermal camera, the thermal camera is connected with a temperature sensor coated with black body paint, the temperature sensor is arranged in front of the thermal camera, and a function is fitted according to the temperature of the temperature sensor measured by the thermal camera and the actual temperature of the temperature sensor The offset of the thermal camera is calibrated; the black body is set in front of the thermal camera, and the fitting function is based on the temperature measured by the thermal camera and the black body temperature. The resulting thermal camera measurement errors are calibrated. By setting the temperature sensor and the black body in front of the thermal camera, the invention calibrates the influence of multiple factors on the measurement data of the thermal camera, so as to obtain high-precision measurement results and improve the measurement accuracy.
更进一步的,包括以下步骤:Further, include the following steps:
步骤一:热敏相机与涂覆黑体漆的温度传感器连接,温度传感器设置在热敏相机前方,根据热敏相机在不同温度下对温度传感器的多个测量温度Tx 1i,以及热敏相机测量温度时对应温度传感器实际温度Ty 1i,线性拟合得到热敏相机测量温度与温度传感器实际温度之间的函数f1,i为大于1的自然数,函数f1的表达式为Ty 1i=n 1*Tx 1i,n 1为热敏相机漂移补偿系数,通过函数f1校准热敏相机本身漂移导致误差;所涂覆的黑体漆采用95黑体漆,反射率为0.95±0.02; Step 1: The thermal camera is connected with the temperature sensor coated with black body paint. The temperature sensor is set in front of the thermal camera. According to the thermal camera's multiple measured temperatures Tx 1i of the temperature sensor at different temperatures, and the thermal camera measures the temperature corresponds to the actual temperature of the temperature sensor Ty 1i , the function f1 between the temperature measured by the thermal camera and the actual temperature of the temperature sensor is obtained by linear fitting, i is a natural number greater than 1, and the expression of the function f1 is Ty 1i =n 1 *Tx 1i , n 1 is the thermal camera drift compensation coefficient, the drift of the thermal camera itself is calibrated by the function f1, resulting in errors;
步骤二:在热敏相机前设置热均匀的黑体,黑体覆盖整个画面,设置不同的黑体温度,保存热敏相机对应数据图像,针对数据图像中每一个像素的位置,得到热敏相机测量温度和黑体温度之间的函数f2,通过函数f2校准相机不均匀性导致误差;Step 2: Set a black body with uniform heat in front of the thermal camera, the black body covers the entire screen, set different black body temperatures, save the data image corresponding to the thermal camera, and obtain the measured temperature and The function f2 between the black body temperatures, through which the camera inhomogeneity is calibrated by the function f2 causes errors;
步骤三:在黑体反射面设置不同温度Ty 3i,读取热敏相机测量的黑体反射面温度Tx 3i0,该测量温度Tx 3i0先经过函数f1和函数f2校准得到校准后温度Tx 3i,得到热敏相机温度Tx 3i与黑体反射面温度Ty 3i之间的函数f3,函数f3的公式为Ty 3i=n 3*Tx 3i,n 3为温度传感器反射率补偿系数,通过函数f3校准因温度传感器反射率导致误差; Step 3: Set different temperatures Ty 3i on the black body reflective surface, and read the temperature Tx 3i0 of the black body reflective surface measured by the thermal camera. The measured temperature Tx 3i0 is first calibrated by the function f1 and the function f2 to obtain the calibrated temperature Tx 3i , and the thermosensitive temperature is obtained. The function f3 between the camera temperature Tx 3i and the black body reflective surface temperature Ty 3i , the formula of the function f3 is Ty 3i =n 3 *Tx 3i , n 3 is the compensation coefficient of the temperature sensor reflectivity, and the function f3 is used to calibrate the reflectivity of the temperature sensor cause errors;
步骤四:设置不同的环境温度Ty 4i,读取不同环境温度Ty 4i中经函数f3校准后的热敏相机测量温度Tx 4i,通过不同环境温度与热敏相机测量温度差值得到热敏相机测量温度Tx 4i与环境温度Ty 4i之间的环境温度校准系数n 4,得到函数f4,即Ty 4i=Tx 4i*n 4,通过函数f4校准因环境温度导致误差; Step 4: Set different ambient temperatures Ty 4i , read the temperature measured by the thermal camera Tx 4i calibrated by the function f3 in the different ambient temperatures Ty 4i , and obtain the measurement of the thermal camera through the difference between the ambient temperature and the temperature measured by the thermal camera The ambient temperature calibration coefficient n 4 between the temperature Tx 4i and the ambient temperature Ty 4i obtains the function f4, that is, Ty 4i =Tx 4i *n 4 , and the error caused by the ambient temperature is calibrated by the function f4;
步骤五:读取与热敏相机不同距离时黑体的温度Ty 5i,得到经过函数f4校准后的热敏相机测量温度Tx 5i与测量距离的函数f5,函数f5为多项式公式,具体计算公式为Ty 5i=n 51*Tx 5i m-1+n 52*Tx 5i m-2+…+n 5(m-1)*Tx 5i 1+n 5m,距离系数n 5=[n 51,n 52,…,n 5(m-1),n 5m],其中m为大于1的整数,通过函数f5校准因测量距离导致误差。 Step 5: Read the temperature Ty 5i of the black body at different distances from the thermal camera, and obtain the function f5 between the measured temperature Tx 5i of the thermal camera and the measured distance after calibration by the function f4. The function f5 is a polynomial formula, and the specific calculation formula is Ty 5i =n 51 *Tx 5i m-1 +n 52 *Tx 5i m-2 +...+n 5(m-1) *Tx 5i 1 +n 5m , distance coefficient n 5 =[n 51 ,n 52 ,... , n 5(m-1) , n 5m ], where m is an integer greater than 1, and the error caused by the measurement distance is calibrated by the function f5.
更进一步的,步骤一中的热敏相机与温度传感器通过总线连接,热敏相机通过总线获取温度传感器的实际温度。本发明温度传感器和热敏相机使用总线连接,热敏相机可以通过I2C总线直接读取该温度传感器的温度。Further, the thermal camera in step 1 is connected with the temperature sensor through a bus, and the thermal camera obtains the actual temperature of the temperature sensor through the bus. The temperature sensor and the thermal camera of the present invention are connected by a bus, and the thermal camera can directly read the temperature of the temperature sensor through the I2C bus.
更进一步的,步骤二中先设置黑体温度T,采集若干张图片,对图片中每个像素点取温度平均值,重复设置多次黑体温度,保存不同温度的黑体反射面图像数据,经过函数f2线性修正得到热敏相机每一个坐标点校准之后的温度。在进行温度不均匀性校准时,先在同一设置温度时获取多张图片,对多张图片温度取平均值,保存为热敏数据图像,用于相机不均匀性补偿的计算。Further, in step 2, first set the black body temperature T, collect several pictures, take the average temperature of each pixel in the picture, set the black body temperature repeatedly, save the image data of the black body reflection surface at different temperatures, and go through the function f2. Linear correction is used to obtain the temperature after calibration of each coordinate point of the thermal camera. When performing temperature non-uniformity calibration, first obtain multiple pictures at the same set temperature, average the temperatures of the multiple pictures, and save them as thermal data images for the calculation of camera non-uniformity compensation.
更进一步的,设置黑体温度为T 1保存热敏数据图像Img T 1,设置黑体温度T 2,保存热敏 数据图像Img T 2,针对每一个像素在图像的位置为(x,y),计算斜率gain和偏移量offset,公式如下: Further, set the black body temperature as T 1 to save the thermal data image Img T 1 , set the black body temperature T 2 , save the thermal data image Img T 2 , and calculate the position of each pixel in the image as (x, y), Slope gain and offset offset, the formula is as follows:
Figure PCTCN2020130986-appb-000001
Figure PCTCN2020130986-appb-000001
offset[x,y]=T 1-gain[x,y]*ImgT 1[x,y]   (2) offset[x,y]=T 1 -gain[x,y]*ImgT 1 [x,y] (2)
上述公式中,Img T1[x,y]表示数据图像Img T1在(x,y)坐标点像素的温度,Img T2[x,y]表示数据图像Img T2在(x,y)坐标点像素的温度,通过斜率gain和偏移offset构建函数f2,即T[x,y]=gain[x,y]*Img[x,y]+offset[x,y],其中Img[x,y]为热敏相机测量的(x,y)像素点的温度,T[x,y]为不均匀性校准后的温度,通过函数f2校准相机不均匀性导致误差。热敏相机在测量时同时获取拍摄图像所有区域的温度,即图像中位置坐标为(x,y)的每一个像素点的温度,通过热敏相机的测量温度和黑体温度拟合函数,对热敏相机在画面不同位置产生的不均匀性进行线性修正。线性修正时,对每一个像素在图像的位置坐标(x,y)计算斜率gain和偏移offset,得到每一个坐标点校准之后的温度。In the above formula, Img T1[x, y] represents the temperature of the pixel of the data image Img T1 at the (x, y) coordinate point, and Img T2[x, y] represents the temperature of the pixel of the data image Img T2 at the (x, y) coordinate point. Temperature, build function f2 by slope gain and offset offset, ie T[x,y]=gain[x,y]*Img[x,y]+offset[x,y], where Img[x,y] is The temperature of the (x,y) pixel point measured by the thermal camera, T[x,y] is the temperature after the unevenness calibration, and the unevenness of the camera is calibrated by the function f2, resulting in errors. The thermal camera simultaneously obtains the temperature of all areas of the captured image during measurement, that is, the temperature of each pixel in the image whose position coordinates are (x, y). The non-uniformity generated by the sensitive camera at different positions of the picture is linearly corrected. During linear correction, the slope gain and offset offset are calculated for the position coordinates (x, y) of each pixel in the image, and the temperature after calibration of each coordinate point is obtained.
更进一步的,步骤三中先设置黑体反射面温度,温度稳定后,测量多次黑体反射面温度然后取平均值,该平均值即热敏相机测量温度;黑体反射面实际温度通过与黑体连接的计算模块读取。本发明的计算模块使用NVIDIA的嵌入式小型电脑TX2 box,其串口为普通的USB接口,和黑体连接后,点击黑体中心,选择黑体温度扫描范围,从低温度区间扫描至高温度区间。Further, in step 3, first set the temperature of the black body reflective surface, after the temperature is stable, measure the temperature of the black body reflective surface several times and then take the average value, the average value is the temperature measured by the thermal camera; Compute module read. The computing module of the present invention uses the embedded minicomputer TX2 box of NVIDIA, and its serial port is an ordinary USB interface. After connecting with the black body, click the center of the black body, select the black body temperature scanning range, and scan from the low temperature range to the high temperature range.
更进一步的,温度分别在低温度区间和高温度区间设置,所述低温度区间为26至30℃,所述高温度区间为40至42℃。为了保证测量的准确性,在设置黑体温度时需设置不同的温度区间,本发明中分为高温度区间和低温度区间。Further, the temperatures are respectively set in a low temperature range and a high temperature range, the low temperature range is 26 to 30°C, and the high temperature range is 40 to 42°C. In order to ensure the accuracy of the measurement, different temperature ranges need to be set when setting the black body temperature, which is divided into a high temperature range and a low temperature range in the present invention.
更进一步的,黑体与热敏相机之间的距离小于固定值。为了保证测量的准确性,本发明温度补偿时,设置的黑体与热敏相机之间距离小于10cm,距离过大容易降低热敏相机校准的准确性。Furthermore, the distance between the black body and the thermal camera is smaller than a fixed value. In order to ensure the accuracy of the measurement, during the temperature compensation of the present invention, the distance between the black body and the thermal camera is set to be less than 10cm, and if the distance is too large, the accuracy of the thermal camera calibration is easily reduced.
本发明通过高精度的温度传感器进行温度补偿,由于温度传感器可以实时读取到环境的温度,因此可以对热敏相机进行实时的校准。根据有限次的实验数据统计对比,经过本发明温度补偿后的热敏相机与黑体实际温度差值的绝对值为0.133℃,误差的平均值为0.0026,误差的标准差(std)为0.1718,误差绝对值小于0.3摄氏度的像素点比例约92%,误差绝对值小于0.5摄氏度的像素点比例可达99.44%,准确率和精度均大幅提升。The present invention performs temperature compensation through a high-precision temperature sensor. Since the temperature sensor can read the temperature of the environment in real time, the thermal camera can be calibrated in real time. According to the statistical comparison of the limited number of experimental data, the absolute value of the actual temperature difference between the thermal camera and the black body after the temperature compensation of the present invention is 0.133°C, the average value of the error is 0.0026, the standard deviation (std) of the error is 0.1718, and the error The proportion of pixels whose absolute value is less than 0.3 degrees Celsius is about 92%, and the proportion of pixels whose absolute value is less than 0.5 degrees Celsius can reach 99.44%, and the accuracy and precision are greatly improved.
一种热敏相机温度补偿系统,使用所述的一种热敏相机温度补偿方法对热敏相机进行校准,所述系统包括与热敏相机连接的温度传感器,还包括黑体。通过温度传感器和黑体,使 用所述的一种热敏相机校准方法对热敏相机进行校准,在热敏相机出厂后使用本系统校准,校准完毕后即可通过热敏相机连接的高精度温度传感器实时的对热敏相机的测量数值进行校对,提高测量的准确性。A thermal camera temperature compensation system, using the thermal camera temperature compensation method to calibrate the thermal camera, the system includes a temperature sensor connected with the thermal camera, and also includes a black body. Through the temperature sensor and the black body, the thermal camera is calibrated using the thermal camera calibration method. After the thermal camera leaves the factory, this system is used for calibration. After the calibration is completed, the high-precision temperature sensor connected to the thermal camera can be used. The measurement value of the thermal camera is calibrated in real time to improve the measurement accuracy.
更进一步的,所述温度传感器涂覆黑体漆。综合考虑成本问题,使用涂覆黑体漆的温度传感器代替黑体,与热敏相机连接,实现温度的实时校准。所述温度传感器在-20℃到50℃的范围内精度为±0.1℃。为提高热敏相机测量温度的准确性和精确度,使用高精度的温度传感器进行温度补偿,所述温度传感器可提供16位的温度结果,达到0.0078℃的分辨率,在-20℃到50℃的范围内精度为±0.1℃。Further, the temperature sensor is coated with black body paint. Taking into account the cost issue, a temperature sensor coated with black body paint is used to replace the black body, and it is connected with a thermal camera to achieve real-time temperature calibration. The temperature sensor has an accuracy of ±0.1°C in the range of -20°C to 50°C. In order to improve the accuracy and precision of temperature measurement by thermal cameras, a high-precision temperature sensor is used for temperature compensation, which can provide 16-bit temperature results with a resolution of 0.0078°C, at -20°C to 50°C The accuracy within the range is ±0.1°C.
本发明低成本、高精度的实现热敏相机的温度补偿,其对应的校准是实时的,在热敏相机出厂后由于相机本身连接温度传感器,通过温度传感器可实现实时校准,只需要校准一次即可一直使用,且能获得更高精度(±0.3摄氏度)。本发明温度补偿方法对热敏相机校准的准确性和精确度都高于现有技术,可靠性高,适合广泛应用。The invention realizes the temperature compensation of the thermal camera with low cost and high precision, and the corresponding calibration is real-time. After the thermal camera leaves the factory, since the camera itself is connected to the temperature sensor, real-time calibration can be realized through the temperature sensor, and only one calibration is required. It can be used all the time with higher accuracy (±0.3 degrees Celsius). The temperature compensation method of the invention has higher accuracy and precision for the calibration of the thermal camera than the prior art, has high reliability, and is suitable for wide application.
3.有益效果3. Beneficial effects
相比于现有技术,本发明的优点在于:Compared with the prior art, the advantages of the present invention are:
本发明温度补偿方法实现更高的精度。现有技术通过热敏相机读取的温度,波动大约为2-5摄氏度。根据有限次的实验数据,本发明校准后的热敏相机在0.5米到5米采集的数据集上,读取的单个点的温度与黑体的实际温度的差值的绝对值是0.133摄氏度,误差的平均值为0.0026,误差的标准差(std)为0.1718,误差绝对值小于0.3摄氏度的像素点比例约92%,误差绝对值小于0.5摄氏度的像素点比例可达99.44%,其测量精度和准确度均大幅提升。The temperature compensation method of the present invention achieves higher precision. The temperature read by a thermal camera in the prior art fluctuates around 2-5 degrees Celsius. According to the limited number of experimental data, on the data set collected by the calibrated thermal camera of the present invention from 0.5 meters to 5 meters, the absolute value of the difference between the temperature of a single point read and the actual temperature of the black body is 0.133 degrees Celsius, and the error is 0.133 degrees Celsius. The average value is 0.0026, the standard deviation (std) of the error is 0.1718, the proportion of pixels with an absolute value of error less than 0.3 degrees Celsius is about 92%, and the proportion of pixels with an absolute value of error less than 0.5 degrees Celsius can reach 99.44%. Its measurement accuracy and accuracy degree increased significantly.
本发明温度补偿方法实现实时校准。为了提高精度,在热敏相机的前使用高精度温度传感器,高精度温度传感器实时读取环境的温度,热敏相机实时读取到高精度温度传感器的温度。通过高精度温度传感器与热敏相机相应数值的对比,实时校准测量温度,结合通过黑体对热敏相机不均匀性的校准,以及通过黑体获得的与环境温度和被测实体距离之间拟合的曲线,对测量时的环境温度和湿度要求更低,适合各类测量环境。The temperature compensation method of the invention realizes real-time calibration. In order to improve the accuracy, a high-precision temperature sensor is used in front of the thermal camera. The high-precision temperature sensor reads the temperature of the environment in real time, and the thermal camera reads the temperature of the high-precision temperature sensor in real time. Through the comparison of the corresponding values of the high-precision temperature sensor and the thermal camera, the measured temperature is calibrated in real time, combined with the calibration of the inhomogeneity of the thermal camera through the black body, and the fitting between the ambient temperature and the distance of the measured entity obtained through the black body. The curve has lower requirements on the ambient temperature and humidity during measurement, and is suitable for various measurement environments.
本发明实现所需成本更低,不需要在测量时配备如黑体等高成本设备,黑体只需要在出厂后校准时使用。热敏相机也只需在出厂之后校准一次,然后就可以一直使用,售后维护的成本更低,若相机使用的过程中出现了问题,比如温度补偿函数的改变,通过升级热敏相机系统内预设参数即可解决。The implementation of the present invention requires lower cost, and does not need to be equipped with high-cost equipment such as a black body during measurement, and the black body only needs to be used during calibration after leaving the factory. The thermal camera also only needs to be calibrated once after leaving the factory, and then it can be used all the time, and the cost of after-sales maintenance is lower. It can be solved by setting parameters.
附图说明Description of drawings
图1为本发明热敏相机校准后的温度曲线与实际温度值对比图;1 is a comparison diagram of a temperature curve after calibration of the thermal camera of the present invention and an actual temperature value;
图2为本发明温度传感器和热敏相机的连接示意图;Fig. 2 is the connection schematic diagram of the temperature sensor and the thermal camera of the present invention;
图3为本发明不均匀性校准时黑体和热敏相机的连接位置示意图;3 is a schematic diagram of the connection position of the black body and the thermal camera during the non-uniformity calibration of the present invention;
附图中标记为:1、高精度温度传感器;2、热敏相机;3、黑体反射面。The drawings are marked as follows: 1. High-precision temperature sensor; 2. Thermal camera; 3. Black body reflective surface.
具体实施方式Detailed ways
下面结合说明书附图和具体的实施例,对本发明作详细描述。The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.
实施例Example
传统的热敏相机2在人脸测温时,因为温度的影响或测量环境的不同,容易出现误差,影响温度测量精度,本实施例在热敏相机2对人脸测温的同时实时校准,提高测温的准确性。When the traditional thermal camera 2 measures the temperature of a face, due to the influence of temperature or different measurement environments, errors are prone to occur, which affects the temperature measurement accuracy. Improve the accuracy of temperature measurement.
热敏相机的精度由热敏相机2自身的温度漂移、温度不均匀性(Non Uniformity)、温度传感器偏移、环境温度和测试距离等因素决定。本实施例热敏相机校准系统包括热敏相机2和一个黑体,该热敏相机2与高精度温度传感器1连接,所述温度传感器即温度感应芯片。本实施例使用的高精度温度感应芯片提供16位的温度结果,可达到0.0078℃的分辨率,该高精度温度传感器1无需校准即可在-20℃到50℃的范围内实现高达±0.1℃的精度。The accuracy of the thermal camera is determined by factors such as temperature drift, temperature non-uniformity (Non Uniformity), temperature sensor offset, ambient temperature and test distance of the thermal camera 2 itself. The thermal camera calibration system of this embodiment includes a thermal camera 2 and a black body. The thermal camera 2 is connected to a high-precision temperature sensor 1, and the temperature sensor is a temperature sensing chip. The high-precision temperature sensing chip used in this embodiment provides 16-bit temperature results and can reach a resolution of 0.0078°C. The high-precision temperature sensor 1 can achieve up to ±0.1°C in the range of -20°C to 50°C without calibration. accuracy.
下面通过具体校准步骤对本实施例热敏相机2温度补偿方法进行描述。The temperature compensation method of the thermal camera 2 in this embodiment will be described below through specific calibration steps.
步骤一、对热敏相机2本身的漂移进行校准: Step 1. Calibrate the drift of the thermal camera 2 itself:
热敏相机2与温度传感器连接,温度传感器设置在热敏相机2的前方,所述温度传感器涂覆黑体漆,热敏相机2利用温度传感器对相机自身的漂移进行校准。The thermal camera 2 is connected with a temperature sensor, the temperature sensor is arranged in front of the thermal camera 2, the temperature sensor is coated with black body paint, and the thermal camera 2 uses the temperature sensor to calibrate the drift of the camera itself.
热敏相机2本身的漂移在±2摄氏度至±5摄氏度之间,由于相机自身的漂移是整个图像的漂移,不会出现图像中某一部分或一个点的测量温度有误差而其他地方测量正常,因此,如果已知图像中部分区域的准确温度,即可对整个画面的温度进行补偿。The drift of the thermal camera 2 itself is between ±2 degrees Celsius to ±5 degrees Celsius. Since the drift of the camera itself is the drift of the entire image, there will be no error in the measurement temperature of a certain part or point in the image, but the measurement in other places is normal. Therefore, if the exact temperature of a part of the image is known, the temperature of the entire screen can be compensated.
使用热敏相机2在不同时间不同温度下针对温度传感器的某一部分或一个点进行多次测量,得到i个热敏相机2测量温度Tx 1i,i为大于1的自然数。通过总线获取热敏相机2测量温度时对应温度传感器实际温度Ty 1i。对于离散的数据Tx 1i和Ty 1i,使用线性拟合得到热敏相机测量温度与温度传感器实际温度之间的函数f1,f1的表达式为Ty 1i=n 1*Tx 1i,n 1为热敏相机漂移补偿系数,使用函数f1校准相机本身漂移导致误差。 Using the thermal cameras 2 to perform multiple measurements on a certain part or a point of the temperature sensor at different times and at different temperatures, the i thermal cameras 2 measure temperatures Tx 1i , where i is a natural number greater than 1. The actual temperature Ty 1i corresponding to the temperature sensor when the temperature measured by the thermal camera 2 is obtained through the bus. For discrete data Tx 1i and Ty 1i , use linear fitting to obtain the function f1 between the temperature measured by the thermal camera and the actual temperature of the temperature sensor. The expression of f1 is Ty 1i =n 1 *Tx 1i , where n 1 is the thermal The camera drift compensation coefficient, using the function f1 to calibrate the camera itself drifts to cause errors.
现有技术通过额外设置一个黑体对热敏相机2进行校准,黑体价格昂贵且对环境温度要求高。本实施例综合考虑经济性问题,如图2所示,将热敏相机2与高精度温度传感器1连接,在该温度传感器涂覆高反射率黑体漆,通过多种校准算法实验,涂覆黑体漆的温度传感器等价于黑体,可达到与黑体相近的效果,在保证精度的情况下大大降低成本。In the prior art, the thermal camera 2 is calibrated by additionally setting a black body, which is expensive and requires high ambient temperature. In this embodiment, the issue of economy is considered comprehensively. As shown in FIG. 2, the thermal camera 2 is connected to the high-precision temperature sensor 1, and the temperature sensor is coated with high-reflection black body paint. Through various calibration algorithm experiments, the black body is coated. The temperature sensor of lacquer is equivalent to a black body, which can achieve a similar effect to the black body, and greatly reduce the cost while ensuring the accuracy.
高反射率黑体漆采用的是油性95黑体漆,反射率为0.95±0.02,热敏相机2通过I2C总线读取该高精度温度传感器1的温度,同时热敏相机2也对该温度传感器进行测温,根据温度传感器的实际温度和热敏相机测量温度实时更新线性拟合后函数f1的参数n 1,通过该参数 n 1对热敏相机2的测量温度实时校准,如图2所示,高精度温度传感器1位于热敏相机2的左上方,距离热敏相机2大约20cm,使用时温度传感器不需与热敏相机2保持固定的位置,即使在使用过程中温度传感器位置发生偏移,只要修正温度传感器对于热敏相机2的参考区域,就不会影响温度的测量和数据的获取。 The high reflectivity black body paint is oily 95 black body paint with a reflectivity of 0.95±0.02. The thermal camera 2 reads the temperature of the high-precision temperature sensor 1 through the I2C bus, and the thermal camera 2 also measures the temperature sensor. According to the actual temperature of the temperature sensor and the temperature measured by the thermal camera, the parameter n 1 of the function f1 after linear fitting is updated in real time, and the measured temperature of the thermal camera 2 is calibrated in real time through this parameter n 1 , as shown in Figure 2, the high The precision temperature sensor 1 is located at the upper left of the thermal camera 2, about 20cm away from the thermal camera 2. The temperature sensor does not need to maintain a fixed position with the thermal camera 2 during use, even if the temperature sensor position shifts during use, as long as Correcting the reference area of the temperature sensor for the thermal camera 2 will not affect the temperature measurement and data acquisition.
步骤二、对热敏相机不均匀性进行校准: Step 2. Calibrate the thermal camera inhomogeneity:
热敏相机2由热成像点阵组成,同样温度的物体在不同的画面位置得到的数值会不一致。热敏相机2的不均匀性指的就是同样温度的物体在不同的画面位置得到的数值不一致。步骤二通过在热敏相机2前固定位置设置热均匀的黑体,如图3所示,该黑体覆盖热敏相机2整个画面,即热敏相机2拍摄的整个画面都是黑体的反射面。设置不同的黑体温度,保存热敏相机2对应数据图像,针对每一个像素在数据图像的位置的坐标(x,y),得到热敏相机2测量温度和黑体温度之间的函数f2,通过函数f2校准相机不均匀性导致误差。The thermal camera 2 is composed of a thermal imaging dot matrix, and the values obtained by objects of the same temperature at different screen positions will be inconsistent. The non-uniformity of the thermal camera 2 refers to the inconsistency of values obtained by objects of the same temperature at different screen positions. In step 2, a thermally uniform black body is set at a fixed position in front of the thermal camera 2, as shown in FIG. Set different black body temperatures, save the data image corresponding to the thermal camera 2, and obtain the function f2 between the temperature measured by the thermal camera 2 and the black body temperature for the coordinates (x, y) of each pixel at the position of the data image, through the function The f2 calibration camera non-uniformity causes errors.
如图3所示,校准时黑体反射面3与热敏相机2距离间隔D约为10cm,整个黑体画面温度的波动在0.3℃之内,设置黑体温度为T1时保存一幅热敏相机2的数据图像Img T1;再设置黑体温度为T2时保存一幅热敏相机2的数据图像Img T2。As shown in Figure 3, the distance D between the black body reflective surface 3 and the thermal camera 2 is about 10cm during calibration, and the temperature fluctuation of the entire black body image is within 0.3°C. The data image Img T1; when the black body temperature is set to T2, a data image Img T2 of the thermal camera 2 is saved.
先设置低温度区间温度T1,低温度区间温度范围为26至30℃,等待温度稳定,也就是黑体的反射面温度波动小于0.3℃时,采集若干张图片,针对图像中所有像素点取温度平均值获得数据图像Img T1。然后设置黑体温度到高温度区间温度T2,高温度区间温度范围为40至42℃,等待温度稳定,即黑体的反射面温度波动小于0.3℃时,采集若干张图片,针对图像中所有像素点取温度平均值获得数据图像Img T2。通过两次测量图像数据平均值,计算热敏相机温度不均匀性补偿函数的斜率gain和偏移offset,得到补偿后的温度。gain和offset的计算公式如下:First set the temperature T1 in the low temperature interval, the temperature range of the low temperature interval is 26 to 30 °C, wait for the temperature to stabilize, that is, when the temperature fluctuation of the reflective surface of the black body is less than 0.3 °C, collect several pictures, and take the temperature average for all pixels in the image. Value obtained data image Img T1. Then set the black body temperature to the high temperature interval temperature T2, the high temperature interval temperature range is 40 to 42 ℃, wait for the temperature to stabilize, that is, when the temperature fluctuation of the black body's reflective surface is less than 0.3 ℃, collect several pictures, for all pixels in the image The temperature average was obtained for the data image Img T2. By measuring the average value of the image data twice, the slope gain and offset offset of the temperature non-uniformity compensation function of the thermal camera are calculated to obtain the compensated temperature. The calculation formulas of gain and offset are as follows:
Figure PCTCN2020130986-appb-000002
Figure PCTCN2020130986-appb-000002
offset[x,y]=T 1-gain[x,y]*ImgT 1[x,y]   (2) offset[x,y]=T 1 -gain[x,y]*ImgT 1 [x,y] (2)
上述公式中,Img T 1[x,y]表示数据图像Img T1在(x,y)坐标点像素的温度,Img T 2[x,y]表示数据图像Img T2在(x,y)坐标点像素的温度,gain[x,y]表示(x,y)坐标点像素的斜率gain,offset[x,y]表示(x,y)坐标点像素的偏移offset。通过gain和offset构建函数f2,即T[x,y]=gain[x,y]*Img[x,y]+offset[x,y],其中Img[x,y]为热敏相机2测量的(x,y)像素点的温度,T[x,y]为不均匀性校准后的温度。使用函数f2对原始测量温度进行线性修正,从而得到每一个坐标点校准之后的温度,即得到不均匀性校准后的热敏相机测量值。 In the above formula, Img T 1 [x, y] represents the temperature of the data image Img T1 at the (x, y) coordinate point, and Img T 2 [x, y] represents the data image Img T2 at the (x, y) coordinate point The temperature of the pixel, gain[x, y] represents the slope gain of the (x, y) coordinate point pixel, and offset[x, y] represents the offset offset of the (x, y) coordinate point pixel. The function f2 is constructed by gain and offset, that is, T[x,y]=gain[x,y]*Img[x,y]+offset[x,y], where Img[x,y] is measured by thermal camera 2 The temperature of the (x,y) pixel point, T[x,y] is the temperature after non-uniformity calibration. Use the function f2 to linearly correct the original measured temperature, so as to obtain the temperature after calibration of each coordinate point, that is, to obtain the measured value of the thermal camera after the inhomogeneity calibration.
步骤三、针对温度传感器反射率的校准: Step 3. Calibration for the reflectivity of the temperature sensor:
步骤一和步骤二校准的是热敏相机本身的温度,步骤一通过读取图像中高精度温度传感器1位置的温度,和高精度温度传感器1的实际温度做差运算进行校准。步骤二中不均匀性校准尚未考虑到温度传感器的反射率和黑体反射率不同,而温度传感器在热敏相机2的热成像系统中非常关键,由于高精度温度传感器1仍然是有一定误差的,经过步骤一的相机漂移校准和步骤二的不均匀性校准之后,在步骤三中使用黑体温度扫面校准来进一步校准温度传感器的反射率。 Steps 1 and 2 calibrate the temperature of the thermal camera itself. Step 1 calibrates by reading the temperature at the position of the high-precision temperature sensor 1 in the image and calculating the difference with the actual temperature of the high-precision temperature sensor 1 . In step 2, the non-uniformity calibration has not taken into account the different reflectivity of the temperature sensor and the reflectivity of the black body, and the temperature sensor is very important in the thermal imaging system of the thermal camera 2. Since the high-precision temperature sensor 1 still has certain errors, After the camera drift calibration in step 1 and the non-uniformity calibration in step 2, the blackbody temperature sweep calibration is used in step 3 to further calibrate the reflectivity of the temperature sensor.
所述黑体温度扫描校准流程简单来说就是拟合前两步校准之后的热敏相机2读取的某一点温度和该点的实际温度之间的关系,该点的实际温度通过读取黑体温度得到。由于温度具有波动性,是一个区间,因此通过动态的设置黑体的温度来计算校准之后的热敏相机2读取的某一点的温度与黑体实际温度的关系。The black body temperature scanning calibration process is simply to fit the relationship between the temperature of a certain point read by the thermal camera 2 after the first two steps of calibration and the actual temperature of the point. The actual temperature of the point is obtained by reading the black body temperature. get. Since the temperature has fluctuation and is an interval, the relationship between the temperature of a certain point read by the thermal camera 2 after calibration and the actual temperature of the black body is calculated by dynamically setting the temperature of the black body.
校准时把黑体放在热敏相机2前,将黑体与TX2 box的串口连接,TX2 box为NVIDIA的嵌入式小型电脑,其串口为普通的USB接口,两者相连后TX2 box可以读取黑体的温度。设置黑体反射面3的温度,所述黑体反射面3即热敏相机2读取的温度的平面。与TX2 box直连后,通过鼠标点击黑体中心,选择黑体温度扫描范围,扫描范围从低温度区间温度到高温度区间温度开始,这里所说的低温度区间温度一般为26至30℃,高温度区间温度一般为40至42℃。When calibrating, put the black body in front of the thermal camera 2, and connect the black body to the serial port of the TX2 box. The TX2 box is an embedded small computer of NVIDIA, and its serial port is an ordinary USB interface. After the two are connected, the TX2 box can read the black body. temperature. The temperature of the black body reflective surface 3 is set, and the black body reflective surface 3 is the plane of the temperature read by the thermal camera 2 . After connecting directly to the TX2 box, click the center of the black body with the mouse, and select the black body temperature scanning range. The scanning range starts from the temperature in the low temperature range to the temperature in the high temperature range. The interval temperature is generally 40 to 42°C.
在每一个测温点稳定之后,热敏相机2读取选取区域的温度,选择多张图片读取的温度,取温度平均值,该平均值即热敏相机2最终的读数。此时函数f3的自变量是经过均匀性校准和高精度传感器校准之后热敏相机2的读数;函数f3的应变量是黑体的温度,也就是我们的目标温度。将自变量热敏相机测量温度和应变量黑体实际温度拟合,得到函数f3。After each temperature measurement point is stable, the thermal camera 2 reads the temperature of the selected area, selects the temperature read from multiple pictures, and takes the average temperature, which is the final reading of the thermal camera 2 . At this time, the independent variable of the function f3 is the reading of the thermal camera 2 after uniformity calibration and high-precision sensor calibration; the strain variable of the function f3 is the temperature of the black body, which is our target temperature. Fit the temperature measured by the independent variable thermal camera and the actual temperature of the strain variable black body to obtain the function f3.
具体的,在热敏相机2前设置黑体,在黑体反射面3设置不同温度Ty 3i,读取热敏相机2测量的黑体反射面3温度Tx 3i0,该测量温度Tx 3i0先经过函数f1和函数f2校准得到校准后温度Tx 3i,得到热敏相机2测量温度Tx 3i与黑体反射面3温度Ty 3i之间的函数f3,函数f3的公式为Ty 3i=n 3*Tx 3i,其中n 3为温度传感器反射率补偿系数。Tx 3i为热敏相机2测量温度Tx 3i0先依据函数f2再依据函数f1校准后的测量温度,表达公式为Tx 3i=(gain×Tx 3i0+offset)*n 1,函数f3用以校准热敏相机2因温度传感器反射率导致误差。 Specifically, set a black body in front of the thermal camera 2, set different temperatures Ty 3i on the black body reflective surface 3, and read the temperature Tx 3i0 of the black body reflective surface 3 measured by the thermal camera 2. The measured temperature Tx 3i0 first passes through the function f1 and the function The calibrated temperature Tx 3i is obtained by f2 calibration, and the function f3 between the temperature Tx 3i measured by the thermal camera 2 and the temperature Ty 3i of the black body reflective surface 3 is obtained. The formula of the function f3 is Ty 3i =n 3 *Tx 3i , where n 3 is Temperature sensor reflectivity compensation coefficient. Tx 3i is the temperature measured by the thermal camera 2 Tx 3i0 is calibrated according to the function f2 and then according to the measured temperature of the function f1, the expression formula is Tx 3i = (gain×Tx 3i0 +offset)*n 1 , the function f3 is used to calibrate Camera 2 causes errors due to the reflectivity of the temperature sensor.
热敏相机2实际使用中并不与黑体连接,此处黑体的使用只为计算拟合函数f3。用户读取经过对相机本身漂移和不均匀性校准之后的温度,再通过温度传感器校准的线性变换函数f3进一步修正,使热敏相机2读取的温度更加的准确。The thermal camera 2 is not connected to the black body in actual use, and the use of the black body here is only for calculating the fitting function f3. The user reads the temperature after calibrating the drift and non-uniformity of the camera itself, and further corrects it through the linear transformation function f3 calibrated by the temperature sensor, so that the temperature read by the thermal camera 2 is more accurate.
步骤四、针对环境温度的校准:Step 4. Calibration for ambient temperature:
不同的环境温度会对热敏相机2的测量造成影响,由于热辐射会到达镜头对镜头加热, 同时相机本身也发热,容易导致镜头辐射热量到热敏成像芯片,从而影响温度度数。虽然热敏相机2本身也有环境温度校准,但经过实际测量,热敏相机2自身的环境温度校准标准较低。而且本实施例热敏成像系统要读取高精度的温度传感器来校准相机漂移,使得系统需做到更精确的环境温度校准。Different ambient temperatures will affect the measurement of the thermal camera 2. Since thermal radiation will reach the lens to heat the lens, and the camera itself will also heat up, it is easy to cause the lens to radiate heat to the thermal imaging chip, thereby affecting the temperature in degrees. Although the thermal camera 2 itself also has an ambient temperature calibration, after actual measurement, the ambient temperature calibration standard of the thermal camera 2 itself is relatively low. Moreover, the thermal imaging system in this embodiment needs to read a high-precision temperature sensor to calibrate the camera drift, so that the system needs to perform more accurate ambient temperature calibration.
针对环境温度校准时先设置不同的环境温度,如环境温度为T3和T4,读取步骤三校准之后的读数V1和V2,画出读数V1和V2以及环境温度T3和T4的相关性曲线,计算线性环境温度校准系数n 4,n 4=(V2–V1)/(T3–T4)。 For ambient temperature calibration, set different ambient temperatures, such as ambient temperature T3 and T4, read the readings V1 and V2 after calibration in step 3, draw the correlation curve between the readings V1 and V2 and the ambient temperatures T3 and T4, and calculate Linear ambient temperature calibration coefficient n 4 , n 4 =(V2-V1)/(T3-T4).
环境温度校准过程需要一个温度可控,或者是温度缓慢上升或者缓慢下降的测试环境。校准时先把黑体放在热敏相机2前,设置黑体温度。然后运行软件,设置相关的参数,鼠标点击黑体中心并采集数据。此时函数f4中自变量是环境温度,应变量是读取的黑体的温度。观察环境温度对最终读数的影响,拟合计算出两者的函数关系,得到热敏相机2测量温度与环境温度之间的函数f4,即Ty 4i=Tx 4i*n 4,Tx 4i是当前不同环境温度中经过步骤三校准后热敏相机2测量温度,Ty 4i表示对环境温度校准后的温度补偿数,通过函数f4对热敏相机2环境温度补偿。 The ambient temperature calibration process requires a temperature-controlled, or slowly rising or falling temperature test environment. When calibrating, first place the black body in front of the thermal camera 2 and set the temperature of the black body. Then run the software, set the relevant parameters, click the center of the black body with the mouse and collect data. At this time, the independent variable in the function f4 is the ambient temperature, and the dependent variable is the temperature of the black body read. Observe the influence of the ambient temperature on the final reading, fit and calculate the functional relationship between the two, and obtain the function f4 between the temperature measured by the thermal camera 2 and the ambient temperature, that is, Ty 4i =Tx 4i *n 4 , Tx 4i is the current difference In the ambient temperature, the thermal camera 2 measures the temperature after calibration in step 3, and Ty 4i represents the temperature compensation number after the ambient temperature calibration, and the ambient temperature of the thermal camera 2 is compensated by the function f4.
步骤五、针对测试距离的校准:Step 5. Calibration for test distance:
热敏相机2是通过读取远红外波长的能量来测量温度的。红外光的能量在传输过程中,会被空气吸收而有衰减,所以距离越远,测量出来的温度越低。在不同的距离上测量同一个黑体的温度,根据物体的温度范围计算出距离系数,通过距离系数n 5决定补偿公式函数f5,对热敏相机2进行测试距离的校准。 The thermal camera 2 measures temperature by reading energy at far infrared wavelengths. In the process of transmission, the energy of infrared light will be absorbed by the air and attenuated, so the farther the distance is, the lower the measured temperature. The temperature of the same black body is measured at different distances, the distance coefficient is calculated according to the temperature range of the object, the compensation formula function f5 is determined by the distance coefficient n5, and the test distance of the thermal camera 2 is calibrated.
针对测试距离的校准流程如下,先把黑体放在热敏相机2前,设置黑体温度。然后通过移动黑体的距离,读取对应距离的黑体的温度。此时函数f5中自变量是黑体与摄像机的距离,应变量是摄像机读取的黑体的温度。通过拟合数据,得到自变量和应变量之间的关系即函数f5。函数f5为多项式公式,具体计算公式为Ty 5i=n 51*Tx 5i m-1+n 52*Tx 5i m-2+…+n 5(m-1)*Tx 5i 1+n 5m,距离系数n 5=[n 51,n 52,…,n 5(m-1),n 5m],其中m为大于1的整数,Tx 5i为经过热敏相机2经过步骤四校准的测量温度,Ty 5i表示对距离校准后的温度补偿值。当已知物体距离摄像机的距离时,可以通过距离补偿系数n 5以及多项式次数m,得出校准之后的温度,本实施例中多项式次数m=7。 The calibration process for the test distance is as follows, first place the black body in front of the thermal camera 2, and set the temperature of the black body. Then by moving the distance of the black body, read the temperature of the black body at the corresponding distance. At this time, the independent variable in the function f5 is the distance between the black body and the camera, and the dependent variable is the temperature of the black body read by the camera. By fitting the data, the relationship between the independent variable and the dependent variable, that is, the function f5, is obtained. The function f5 is a polynomial formula, and the specific calculation formula is Ty 5i =n 51 *Tx 5i m-1 +n 52 *Tx 5i m-2 +...+n 5(m-1) *Tx 5i 1 +n 5m , the distance coefficient n 5 =[n 51 ,n 52 ,...,n 5(m-1) ,n 5m ], where m is an integer greater than 1, Tx 5i is the measured temperature calibrated by the thermal camera 2 in step 4, and Ty 5i Indicates the temperature compensation value after distance calibration. When the distance between the object and the camera is known, the temperature after calibration can be obtained through the distance compensation coefficient n 5 and the polynomial order m. In this embodiment, the polynomial order m=7.
现有技术中热敏相机2读取的温度波动大约为2-5摄氏度。根据有限次的实验数据,使用本发明校准后的热敏相机2在0.5米到5米采集的数据集上,读取的单个点的温度与黑体的实际温度的差值的绝对值是0.133摄氏度,误差的平均值为0.0026,误差的标准差(std)为0.1718,误差绝对值小于0.3摄氏度的像素点比例约92%,误差绝对值小于0.5摄氏度的像 素点比例可达99.44%,准确率和精度均大幅提升。The temperature fluctuation read by the thermal camera 2 in the prior art is about 2-5 degrees Celsius. According to the limited number of experimental data, the absolute value of the difference between the temperature of a single point read and the actual temperature of the black body is 0.133 degrees Celsius on the data set collected by the thermal camera 2 calibrated in the present invention from 0.5 meters to 5 meters. , the average value of the error is 0.0026, the standard deviation (std) of the error is 0.1718, the proportion of pixels with an absolute value of error less than 0.3 degrees Celsius is about 92%, and the proportion of pixels with an absolute value of error less than 0.5 degrees Celsius can reach 99.44%. Accuracy is greatly improved.
图1所示是本实施例热敏相机2校准之后的温度曲线与黑体实际温度的曲线对比图,校准后热敏相机2对黑体的测试数据使用虚线表示,黑体实际温度使用实线表示。通过图1可以看出虚线和实线几乎重合,即校准之后的热敏相机测试温度曲线与黑体实际温度曲线几乎重合,说明校准后的热敏相机2测量准确率高,精度高。热敏相机2在实际应用中不需要配备黑体,只通过自身连接的温度传感器即可实现高精度的温度测量,在保证精度的情况下成本降低。Figure 1 shows a comparison between the temperature curve of the thermal camera 2 after calibration and the actual temperature of the black body in this embodiment. The test data of the thermal camera 2 on the black body after calibration is represented by a dotted line, and the actual temperature of the black body is represented by a solid line. It can be seen from Figure 1 that the dotted line and the solid line almost overlap, that is, the temperature curve tested by the thermal camera after calibration and the actual temperature curve of the black body almost overlap, indicating that the calibrated thermal camera 2 has high measurement accuracy and high precision. In practical applications, the thermal camera 2 does not need to be equipped with a black body, and can achieve high-precision temperature measurement only through the temperature sensor connected to itself, and the cost is reduced under the condition of ensuring the accuracy.
以上示意性地对本发明创造及其实施方式进行了描述,该描述没有限制性,在不背离本发明的精神或者基本特征的情况下,能够以其他的具体形式实现本发明。附图中所示的也只是本发明创造的实施方式之一,实际的结构并不局限于此,权利要求中的任何附图标记不应限制所涉及的权利要求。所以,如果本领域的普通技术人员受其启示,在不脱离本创造宗旨的情况下,不经创造性的设计出与该技术方案相似的结构方式及实施例,均应属于本专利的保护范围。此外,“包括”一词不排除其他元件或步骤,在元件前的“一个”一词不排除包括“多个”该元件。产品权利要求中陈述的多个元件也可以由一个元件通过软件或者硬件来实现。第一,第二等词语用来表示名称,而并不表示任何特定的顺序。The invention and its embodiments have been described above schematically, and the description is not restrictive. The invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. What is shown in the accompanying drawings is only one of the embodiments of the present invention, and the actual structure is not limited thereto, and any reference signs in the claims shall not limit the related claims. Therefore, if those of ordinary skill in the art are inspired by it, and without departing from the purpose of the present invention, any structure and embodiment similar to this technical solution are designed without creativity, which shall belong to the protection scope of this patent. Furthermore, the word "comprising" does not exclude other elements or steps, and the word "a" preceding an element does not exclude the inclusion of "a plurality" of that element. Several elements recited in a product claim can also be implemented by one element by means of software or hardware. The terms first, second, etc. are used to denote names and do not denote any particular order.

Claims (10)

  1. 一种热敏相机温度补偿方法,其特征在于,热敏相机与涂覆黑体漆的温度传感器连接,温度传感器设置在热敏相机的前方,根据热敏相机测量的温度传感器温度以及温度传感器的实际温度拟合函数对热敏相机的偏移进行校准;在热敏相机前设置黑体,根据热敏相机测量温度和黑体温度拟合函数对由于热敏相机的不均匀性、温度传感器折射率、环境温度和测量距离导致的热敏相机测量误差进行校准。A temperature compensation method for a thermal camera, characterized in that the thermal camera is connected with a temperature sensor coated with black body paint, the temperature sensor is arranged in front of the thermal camera, and the temperature of the thermal camera is measured according to the temperature of the thermal sensor and the actual The temperature fitting function calibrates the offset of the thermal camera; the black body is set in front of the thermal camera, and the fitting function is based on the temperature measured by the thermal camera and the black body temperature. Thermal camera measurement errors due to temperature and measurement distance are calibrated.
  2. 根据权利要求1所述的一种热敏相机温度补偿方法,其特征在于,包括以下步骤:A thermal camera temperature compensation method according to claim 1, characterized in that, comprising the following steps:
    步骤一:热敏相机与涂覆黑体漆的温度传感器连接,温度传感器设置在热敏相机前方,根据热敏相机在不同温度下对温度传感器的多个测量温度Tx 1i,以及热敏相机测量温度时对应温度传感器实际温度Ty 1i,线性拟合得到热敏相机测量温度与温度传感器实际温度之间的函数f1,i为大于1的自然数,函数f1的表达式为Ty 1i=n 1*Tx 1i,n 1为热敏相机漂移补偿系数,通过函数f1校准热敏相机本身漂移导致误差; Step 1: The thermal camera is connected with the temperature sensor coated with black body paint. The temperature sensor is set in front of the thermal camera. According to the thermal camera's multiple measured temperatures Tx 1i of the temperature sensor at different temperatures, and the thermal camera measures the temperature corresponds to the actual temperature of the temperature sensor Ty 1i , the function f1 between the temperature measured by the thermal camera and the actual temperature of the temperature sensor is obtained by linear fitting, i is a natural number greater than 1, and the expression of the function f1 is Ty 1i =n 1 *Tx 1i , n 1 is the drift compensation coefficient of the thermal camera, and the drift of the thermal camera itself is calibrated by the function f1 to cause errors;
    步骤二:在热敏相机前设置热均匀的黑体,黑体覆盖整个画面,设置不同的黑体温度,保存热敏相机对应数据图像,针对数据图像中每一个像素的位置,得到热敏相机测量温度和黑体温度之间的函数f2,通过函数f2校准相机不均匀性导致误差;Step 2: Set a black body with uniform heat in front of the thermal camera, the black body covers the entire screen, set different black body temperatures, save the data image corresponding to the thermal camera, and obtain the measured temperature and The function f2 between the black body temperatures, through which the camera inhomogeneity is calibrated by the function f2 causes errors;
    步骤三:在黑体反射面设置不同温度Ty 3i,读取热敏相机测量的黑体反射面温度Tx 3i0,该测量温度Tx 3i0先经过函数f1和函数f2校准得到校准后温度Tx 3i,得到热敏相机温度Tx 3i与黑体反射面温度Ty 3i之间的函数f3,函数f3的公式为Ty 3i=n 3*Tx 3i,n 3为温度传感器反射率补偿系数,通过函数f3校准因温度传感器反射率导致误差; Step 3: Set different temperatures Ty 3i on the black body reflective surface, and read the temperature Tx 3i0 of the black body reflective surface measured by the thermal camera. The measured temperature Tx 3i0 is first calibrated by the function f1 and the function f2 to obtain the calibrated temperature Tx 3i , and the thermosensitive temperature is obtained. The function f3 between the camera temperature Tx 3i and the black body reflective surface temperature Ty 3i , the formula of the function f3 is Ty 3i =n 3 *Tx 3i , n 3 is the compensation coefficient of the temperature sensor reflectivity, and the function f3 is used to calibrate the reflectivity of the temperature sensor cause errors;
    步骤四:设置不同的环境温度Ty 4i,读取不同环境温度Ty 4i中经函数f3校准后的热敏相机测量温度Tx 4i,通过不同环境温度与热敏相机测量温度差值得到热敏相机测量温度Tx 4i与环境温度Ty 4i之间的环境温度校准系数n 4,得到函数f4,即Ty 4i=Tx 4i*n 4,通过函数f4校准因环境温度导致误差; Step 4: Set different ambient temperatures Ty 4i , read the temperature measured by the thermal camera Tx 4i calibrated by the function f3 in the different ambient temperatures Ty 4i , and obtain the measurement of the thermal camera through the difference between the ambient temperature and the temperature measured by the thermal camera The ambient temperature calibration coefficient n 4 between the temperature Tx 4i and the ambient temperature Ty 4i obtains the function f4, that is, Ty 4i =Tx 4i *n 4 , and the error caused by the ambient temperature is calibrated by the function f4;
    步骤五:读取与热敏相机不同距离时黑体的温度Ty 5i,得到经过函数f4校准后的热敏相机测量温度Tx 5i与测量距离的函数f5,函数f5为多项式公式,具体计算公式为Ty 5i=n 51*Tx 5i m-1+n 52*Tx 5i m-2+…+n 5(m-1)*Tx 5i 1+n 5m,距离系数n 5=[n 51,n 52,…,n 5(m-1),n 5m],其中m为大于1的整数,通过函数f5校准因测量距离导致误差。 Step 5: Read the temperature Ty 5i of the black body at different distances from the thermal camera, and obtain the function f5 between the measured temperature Tx 5i of the thermal camera and the measured distance after calibration by the function f4. The function f5 is a polynomial formula, and the specific calculation formula is Ty 5i =n 51 *Tx 5i m-1 +n 52 *Tx 5i m-2 +...+n 5(m-1) *Tx 5i 1 +n 5m , distance coefficient n 5 =[n 51 ,n 52 ,... , n 5(m-1) , n 5m ], where m is an integer greater than 1, and the error caused by the measurement distance is calibrated by the function f5.
  3. 根据权利要求2所述的一种热敏相机温度补偿方法,其特征在于,步骤一中的热敏相机与温度传感器通过总线连接,热敏相机通过总线获取温度传感器的实际温度。A temperature compensation method for a thermal camera according to claim 2, wherein the thermal camera and the temperature sensor in step 1 are connected through a bus, and the thermal camera obtains the actual temperature of the temperature sensor through the bus.
  4. 根据权利要求2所述的一种热敏相机温度补偿方法,其特征在于,步骤二中先设置黑体温度T,采集若干张图片,对图片中每个像素点取温度平均值,重复设置多次黑体温度,保存不同温度的黑体反射面图像数据,经过函数f2线性修正得到热敏相机每一个坐标点校准 之后的温度。A temperature compensation method for a thermal camera according to claim 2, characterized in that, in step 2, the black body temperature T is set first, a number of pictures are collected, the temperature average value is obtained for each pixel in the picture, and the setting is repeated for many times. Black body temperature, save the image data of the black body reflection surface at different temperatures, and obtain the temperature after calibration of each coordinate point of the thermal camera through the linear correction of the function f2.
  5. 根据权利要求4所述的一种热敏相机温度补偿方法,其特征在于,设置黑体温度为T 1保存热敏数据图像Img T 1,设置黑体温度T 2,保存热敏数据图像Img T 2,针对每一个像素在图像的位置为(x,y),计算斜率gain和偏移量offset,公式如下: The temperature compensation method for a thermal camera according to claim 4, wherein the black body temperature is set to T 1 to save the thermal data image Img T 1 , the black body temperature T 2 is set to save the thermal data image Img T 2 , For each pixel at the position of (x, y) in the image, calculate the slope gain and offset offset, the formula is as follows:
    Figure PCTCN2020130986-appb-100001
    Figure PCTCN2020130986-appb-100001
    offset[x,y]=T 1-gain[x,y]*ImgT 1[x,y]  (2) offset[x,y]=T 1 -gain[x,y]*ImgT 1 [x,y] (2)
    上述公式中,Img T 1[x,y]表示数据图像Img T1在(x,y)坐标点像素的温度,Img T 2[x,y]表示数据图像Img T2在(x,y)坐标点像素的温度,通过斜率gain和偏移offset构建函数f2,即T[x,y]=gain[x,y]*Img[x,y]+offset[x,y],其中Img[x,y]为热敏相机测量的(x,y)像素点的温度,T[x,y]为不均匀性校准后的温度,通过函数f2校准相机不均匀性导致误差。 In the above formula, Img T 1 [x, y] represents the temperature of the data image Img T1 at the (x, y) coordinate point, and Img T 2 [x, y] represents the data image Img T2 at the (x, y) coordinate point The temperature of the pixel, the function f2 is constructed by the slope gain and the offset offset, that is, T[x,y]=gain[x,y]*Img[x,y]+offset[x,y], where Img[x,y ] is the temperature of the (x, y) pixel measured by the thermal camera, T[x, y] is the temperature after non-uniformity calibration, and the non-uniformity of the camera is calibrated by the function f2, resulting in errors.
  6. 根据权利要求2所述的一种热敏相机温度补偿方法,其特征在于,步骤三中先设置黑体反射面温度,温度稳定后,测量多次黑体反射面温度然后取平均值,该平均值即热敏相机测量温度;黑体反射面实际温度通过与黑体连接的计算模块读取。The temperature compensation method for a thermal camera according to claim 2, wherein in step 3, the temperature of the black body reflective surface is set first, and after the temperature is stable, the temperature of the black body reflective surface is measured for several times and an average value is obtained, and the average value is The thermal camera measures the temperature; the actual temperature of the black body reflective surface is read by the calculation module connected with the black body.
  7. 根据权利要求3或4或6所述的一种热敏相机温度补偿方法,其特征在于,温度分别在低温度区间和高温度区间设置,所述低温度区间为26至30℃,所述高温度区间为40至42℃。A temperature compensation method for a thermal camera according to claim 3, 4 or 6, wherein the temperature is set in a low temperature interval and a high temperature interval, wherein the low temperature interval is 26 to 30°C, and the high temperature interval is 26°C to 30°C. The temperature range is 40 to 42°C.
  8. 根据权利要求1所述的一种热敏相机温度补偿方法,其特征在于,黑体与热敏相机之间的距离小于固定值。A temperature compensation method for a thermal camera according to claim 1, wherein the distance between the black body and the thermal camera is less than a fixed value.
  9. 一种热敏相机温度补偿系统,其特征在于,使用如权利要求1-8任意一项所述的一种热敏相机温度补偿方法对热敏相机进行校准,所述系统包括与热敏相机连接的温度传感器,还包括黑体。A thermal camera temperature compensation system, characterized in that a thermal camera temperature compensation method according to any one of claims 1-8 is used to calibrate the thermal camera, and the system includes connecting with the thermal camera The temperature sensor also includes the black body.
  10. 根据权利要求9所述的一种热敏相机温度补偿系统,其特征在于,所述温度传感器涂覆黑体漆。A temperature compensation system for a thermal camera according to claim 9, wherein the temperature sensor is coated with black body paint.
PCT/CN2020/130986 2020-11-23 2020-11-24 Temperature compensation method and system for thermal camera WO2022104816A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011319745.6 2020-11-23
CN202011319745.6A CN112393808B (en) 2020-11-23 2020-11-23 Temperature compensation method and system for thermal camera

Publications (1)

Publication Number Publication Date
WO2022104816A1 true WO2022104816A1 (en) 2022-05-27

Family

ID=74606864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/130986 WO2022104816A1 (en) 2020-11-23 2020-11-24 Temperature compensation method and system for thermal camera

Country Status (2)

Country Link
CN (1) CN112393808B (en)
WO (1) WO2022104816A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113138025A (en) * 2021-03-18 2021-07-20 深圳市科陆精密仪器有限公司 Automatic calibration method and device for infrared temperature measurement equipment
CN113267258B (en) * 2021-05-18 2023-02-17 烟台艾睿光电科技有限公司 Infrared temperature measurement method, device, equipment, intelligent inspection robot and storage medium
CN114235169B (en) * 2021-12-02 2024-08-30 玛瑜科创服务(南京)有限公司 Method and system for calibrating multiple temperature measurement modules in batch
CN114414069B (en) * 2021-12-23 2023-03-24 武汉高德智感科技有限公司 Infrared temperature measurement result correction method and system
PL442191A1 (en) * 2022-09-02 2024-03-04 Politechnika Warszawska Suspension of a photosensitive array and method for repetitively controlling and compensating for temperature drift of the photosensitive array image

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4502793A (en) * 1981-11-25 1985-03-05 Schlumberger Electronics (Uk) Limited Apparatus and method for measuring temperature profile
CN103983361A (en) * 2014-06-06 2014-08-13 昆明北方红外技术股份有限公司 Online network temperature-measuring thermal imager calibration method
CN108254084A (en) * 2018-01-18 2018-07-06 武汉格物优信科技有限公司 Scaling method and calibration system in a kind of thermal infrared imager production
CN110978509A (en) * 2019-11-12 2020-04-10 武汉力派空间智能科技有限公司 Thermal imaging-based 3D printer air duct opening heat dissipation device and method
CN111272289A (en) * 2020-02-27 2020-06-12 江苏弘冉智能科技有限公司 Real-time calibration device for thermal infrared imager
CN111765979A (en) * 2020-06-05 2020-10-13 威图视觉系统(深圳)有限公司 Infrared thermal imaging measurement data analysis combined compensation temperature calibration method
CN112434598A (en) * 2020-11-23 2021-03-02 江苏镭博智能科技有限公司 Non-contact body temperature measuring method and system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108362469B (en) * 2018-01-16 2019-11-01 上海交通大学 Size and surface pressure measurement method and apparatus based on pressure sensitive paint and light-field camera
CN111649827B (en) * 2020-06-10 2023-06-30 成都普朗克科技有限公司 Body temperature detection method based on multipoint infrared thermopile sensor
CN111916219B (en) * 2020-07-17 2024-08-02 深圳中集智能科技有限公司 Intelligent safety early warning method, device and electronic system for inspection and quarantine
CN111761593A (en) * 2020-07-31 2020-10-13 公安部第一研究所 Modular epidemic prevention and control type police robot

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4502793A (en) * 1981-11-25 1985-03-05 Schlumberger Electronics (Uk) Limited Apparatus and method for measuring temperature profile
CN103983361A (en) * 2014-06-06 2014-08-13 昆明北方红外技术股份有限公司 Online network temperature-measuring thermal imager calibration method
CN108254084A (en) * 2018-01-18 2018-07-06 武汉格物优信科技有限公司 Scaling method and calibration system in a kind of thermal infrared imager production
CN110978509A (en) * 2019-11-12 2020-04-10 武汉力派空间智能科技有限公司 Thermal imaging-based 3D printer air duct opening heat dissipation device and method
CN111272289A (en) * 2020-02-27 2020-06-12 江苏弘冉智能科技有限公司 Real-time calibration device for thermal infrared imager
CN111765979A (en) * 2020-06-05 2020-10-13 威图视觉系统(深圳)有限公司 Infrared thermal imaging measurement data analysis combined compensation temperature calibration method
CN112434598A (en) * 2020-11-23 2021-03-02 江苏镭博智能科技有限公司 Non-contact body temperature measuring method and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DING WEIYI: "Research on Key Technologies And Algorithms of Temperature Measurement System of Uncooled Infrared Thermal Imaging", MASTER THESIS, TIANJIN POLYTECHNIC UNIVERSITY, CN, no. 3, 15 March 2016 (2016-03-15), CN , XP055931572, ISSN: 1674-0246 *

Also Published As

Publication number Publication date
CN112393808A (en) 2021-02-23
CN112393808B (en) 2021-12-17

Similar Documents

Publication Publication Date Title
WO2022104816A1 (en) Temperature compensation method and system for thermal camera
CN111351583A (en) Temperature correction method for infrared temperature measurement and infrared thermal imager
CN106989824B (en) A kind of infrared measurement of temperature imaging device and detection method
CN100464167C (en) Method and device for real-time correcting infrared measuring temperature
CN109655162A (en) Thermal infrared imager temperature measurement correction system and method
Zhang et al. An experimental method for improving temperature measurement accuracy of infrared thermal imager
CN103528694A (en) Method for measuring temperature of target object by using thermal infrared imager
CN111751003B (en) Thermal imager temperature correction system and method and thermal imager
CN111595462B (en) Infrared imaging temperature measurement system calibration method and device, computing equipment and storage medium
CN106767933A (en) The measuring system of depth camera error, measuring method, evaluation method and compensation method
CN107588854B (en) High precision measuring temperature method based on built-in reference body
WO2022104817A1 (en) Non-contact body temperature measurement method and system
CN111256835B (en) Temperature measurement thermal infrared imager calibration method and device of hyper-parameter polynomial physical model
CN112798110A (en) Calibration fitting-based temperature detection method for infrared thermal imaging equipment
Zhang et al. A method for improving temperature measurement precision on the uncooled infrared thermal imager
CN111780879A (en) Infrared temperature measurement system and temperature measurement method
CN112504463A (en) Temperature measurement system and temperature measurement method thereof
CN115797998A (en) Dual-waveband intelligent temperature measuring device and intelligent temperature measuring method based on image fusion
CN111024237A (en) Non-contact wide-temperature-difference infrared temperature measuring method
CN114018416A (en) Thermal infrared camera radiation calibration method and system
Thelen et al. A high-resolution optical measurement system for rapid acquisition of radiation flux density maps
CN108181307B (en) Visibility measuring system and method
CN111609937B (en) Thermal infrared imager external field calibration method and device
CN117053928A (en) Calibration method for thermal infrared imager lens distortion correction and imaging non-uniformity
CN114878003A (en) Infrared temperature measurement method based on response rate correction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20962107

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 31/10/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20962107

Country of ref document: EP

Kind code of ref document: A1