CN113503972B - Local dynamic target temperature measurement system based on low-pixel infrared camera - Google Patents
Local dynamic target temperature measurement system based on low-pixel infrared camera Download PDFInfo
- Publication number
- CN113503972B CN113503972B CN202111048146.XA CN202111048146A CN113503972B CN 113503972 B CN113503972 B CN 113503972B CN 202111048146 A CN202111048146 A CN 202111048146A CN 113503972 B CN113503972 B CN 113503972B
- Authority
- CN
- China
- Prior art keywords
- pixel
- temperature measurement
- module
- camera
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009529 body temperature measurement Methods 0.000 title claims abstract description 140
- 238000013507 mapping Methods 0.000 claims abstract description 127
- 238000012544 monitoring process Methods 0.000 claims abstract description 31
- 238000012545 processing Methods 0.000 claims abstract description 20
- 238000001931 thermography Methods 0.000 claims abstract description 16
- 230000005855 radiation Effects 0.000 claims abstract description 4
- 210000001061 forehead Anatomy 0.000 claims description 23
- 238000006073 displacement reaction Methods 0.000 claims description 16
- 210000003128 head Anatomy 0.000 claims description 15
- 238000010438 heat treatment Methods 0.000 claims description 10
- 239000000284 extract Substances 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 6
- 238000001914 filtration Methods 0.000 claims 1
- 238000000034 method Methods 0.000 description 29
- 238000010586 diagram Methods 0.000 description 11
- 238000001514 detection method Methods 0.000 description 10
- 230000000007 visual effect Effects 0.000 description 10
- 230000036760 body temperature Effects 0.000 description 7
- 238000009434 installation Methods 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000004861 thermometry Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Radiation Pyrometers (AREA)
Abstract
The invention provides a local dynamic target temperature measurement system based on a low-pixel infrared camera, which relates to the technical field of electronic information and comprises the following components: the device comprises an infrared temperature measurement module, a high-pixel camera, a mapping table module and a processing unit; the infrared temperature measurement module outputs a thermal imaging image by acquiring thermal radiation energy of a monitoring area of the infrared temperature measurement module; the high-pixel camera acquires an image of a monitoring area of the high-pixel camera and identifies a target in the image; outputting the image and the position area of the target in the image; by using the local dynamic target temperature measuring system based on the low-pixel infrared camera, contour matching comparison is not needed, and the determination of a target area is not interfered by the environment. Based on the mapping table of the pixel position corresponding relation between the infrared temperature measurement module and the high-pixel camera, a relatively accurate and stable mapping relation is established between the image shot by the high-pixel camera and the thermal image of the infrared temperature measurement module.
Description
Technical Field
The invention relates to the technical field of electronic information, relates to an infrared temperature measurement technology and an image processing technology, and particularly relates to a local dynamic target temperature measurement system based on a low-pixel infrared camera.
Background
Body temperature detection requires the location of a target location, typically the forehead. Currently, the infrared temperature measurement module usually used, for example, the infrared camera has few pixels and low resolution, which is usually 32 × 32. Target imaging and target recognition cannot be performed. For the infrared camera with high pixels, the cost is greatly improved, although the recognition degree of the contour is improved to a certain extent, the accurate recognition of a local target in the contour, such as face recognition, is still difficult to realize based on the imaging principle. Therefore, the existing infrared imaging thermometry usually selects a pixel high-temperature point as a thermometry point. There are problems: the ambient temperature rise creates interference; the local high-temperature object appears in the visual field and can influence the output result, so that the high-temperature point can not effectively correspond to the temperature measurement target, and the forehead is the temperature measurement target under the common condition.
In addition, a mode of recognizing the human face contour in the infrared chart based on machine learning also appears at present, but due to the interference of a temperature measurement environment, the accurate recognition of the human face contour is difficult to realize. In the prior art, the method of recognizing a target through a visual camera and mapping a target area to an infrared camera through image matching is generally based on a contour form, so that the problems of insufficient matching precision, poor environmental interference resistance and the like exist. For the currently used designated position in the shooting area where the target is physically designated, a manner in which the infrared camera reads the designated area also starts to appear. However, the method is only suitable for the same-row scene with a small gate opening and has requirements on the installation position of the equipment. Meanwhile, the method cannot realize tracking detection of the dynamic target, only one temperature measurement target result can be output during each detection, the efficiency is low, and the method cannot meet the temperature measurement requirement scene of multiple persons and large flow.
Disclosure of Invention
In order to solve the problems, the invention adopts the technical scheme that:
a local dynamic target temperature measurement system based on a low-pixel infrared camera, comprising: the device comprises an infrared temperature measurement module, a high-pixel camera, a mapping table module and a processing unit;
the infrared temperature measurement module outputs a thermal imaging image by acquiring thermal radiation energy of a monitoring area of the infrared temperature measurement module;
the high-pixel camera acquires an image of a monitoring area of the high-pixel camera and identifies a target in the image; outputting the image and the position area of the target in the image;
the mapping table module is used for storing a mapping table, and the mapping table is used for recording the corresponding relation of pixel positions between the infrared temperature measurement module and the high-pixel camera;
the processing unit is connected with the infrared temperature measurement module, the high-pixel camera and the mapping table module;
the processing unit comprises a temperature extraction module, the temperature extraction module acquires a target position area of the high-pixel camera output by the high-pixel camera, a positioning area corresponding to the infrared temperature measurement module is determined according to the mapping table module, and temperature data of the positioning area is extracted and output.
Preferably, the high-pixel camera includes a face recognition module, and the face recognition module is configured to recognize a face of the target, extract a position of the forehead region, and output a position region of the forehead in the image.
Preferably, the processing unit comprises a mapping management module, a displacement monitoring module and a calibration module;
the displacement monitoring module monitors whether the relative position of the infrared temperature measurement module and the high-pixel camera changes or not;
the calibration module is used for calibrating the corresponding relation of pixel positions between the infrared temperature measurement module and the high-pixel camera, establishing a mapping table and storing the mapping table in the mapping table module;
the mapping management module detects whether a mapping table exists in the mapping table module, if yes, the displacement monitoring module is started to monitor the relative position of the infrared camera and the high-pixel camera, whether the relative position changes is judged, if yes, the mapping table is cleared, and whether the mapping table exists is detected again; if not, the calibration module is started to calibrate to form a mapping table.
Preferably, the mapping management module acquires a thermal imaging image output by the infrared temperature measurement module for a period of time, an image output by the high-pixel camera and a position area of the forehead in the image;
intercepting a forehead track output by a high-pixel camera to obtain a starting point and an end point, and taking the starting point and the end point as diagonal lines to form an image area, wherein the upper side and the lower side of the image area are horizontal;
intercepting one or more high-temperature point moving tracks of the thermal imaging image, and fusing pixels related to the forehead track according to the pixel level of the infrared temperature measurement module; acquiring pixel points covered by the track, and calculating the pixel proportion in the rectangular area; and if the proportion error is within 20%, establishing a mapping table by using each pixel point in the corresponding image area.
Preferably, the mapping management module detects that the image area is not in the monitoring area of the infrared temperature measurement module or the image area occupies the area 2/3-4/5 of the image area of the high pixel camera, and then the mapping management module outputs prompt information.
Preferably, the mapping management module acquires a thermal imaging image output by the infrared temperature measurement module in a 3-5s time period and an image output by the high-pixel camera, and extracts one frame of image at an interval of 0.2 s.
Preferably, the local dynamic target temperature measurement system comprises a mounting frame, the high-pixel camera is fixed on the mounting frame, a portal frame is further arranged on the mounting frame, a sliding groove is formed in the top of the portal frame, a sliding part is arranged in the sliding groove, the sliding part can move in the sliding groove, the sliding part is provided with a rotating assembly, the rotating assembly is hinged to the sliding part through a rotating shaft, the rotating assembly can rotate around the rotating shaft, and the infrared temperature measurement module is connected to the rotating assembly.
Preferably, the calibration module filters the temperature value of the pixel points of the thermal image shot by the infrared camera, retains the pixel points with the temperature value within the range of 30-45 ℃, and fits to form a first track;
the high-pixel camera comprises an image processing unit, the image processing unit acquires a first track, detects whether the track exists in an image of the high-pixel camera in the same period of time, and if the track exists, a mapping table is established according to pixels of the track and stored in a mapping table module.
Preferably, the system further comprises a constant temperature calibration rod, and the constant temperature calibration rod is detachably connected with the infrared temperature measurement module or the high-pixel camera;
the constant-temperature calibration rod comprises a high-emissivity positioning head and a heating assembly, and the heating assembly is connected with the high-emissivity positioning head and used for heating the high-emissivity positioning head; the high-radiance positioning head is arranged on the outer side of the constant-temperature calibration rod.
Preferably, the high-pixel camera comprises a track recognition unit, the track recognition unit is provided with a track template, and the track template is preset with one or more track shapes;
the track recognition unit acquires the track in the image in real time, compares the track with the track shape recorded by the track template, and starts the calibration module to calibrate to form a mapping table if the track is consistent with the track shape recorded by the track template.
The invention has the beneficial effects that:
when the temperature of the environment or other interferent in the environment is close to the temperature of the target object, the local dynamic target temperature measuring system based on the low-pixel infrared camera is difficult to distinguish and identify through the outline. In the temperature measurement system, the contour matching comparison is not needed, and the determination of the target area is not interfered by the environment. Based on the mapping table of the pixel position corresponding relation between the infrared temperature measurement module and the high-pixel camera, a relatively accurate and stable mapping relation is established between the image shot by the high-pixel camera and the thermal image of the infrared temperature measurement module.
After the high-pixel camera identifies the target area, the corresponding pixel coordinate data of the target area in the thermal image shot by the infrared camera can be obtained through the mapping table only based on the coordinate data of the target area in the image shot by the high-pixel camera, and then the corresponding area of the target area in the thermal image is correspondingly obtained, so that quick and accurate mapping is realized.
Drawings
FIG. 1 is a schematic diagram illustrating an imaging effect of a low-pixel infrared camera according to the background art of the present invention;
FIG. 2 is a schematic diagram illustrating the imaging effect of a local high-temperature object according to the background art of the present invention;
FIG. 3 is a schematic diagram of an access control module applied to a temperature measurement system according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a forehead trajectory according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of an infrared temperature measurement module and a high-pixel camera according to an embodiment of the invention;
FIG. 6 is a schematic diagram of a position adjustment structure of an infrared temperature measurement module according to an embodiment of the present invention;
FIG. 7 is a structural diagram of a constant temperature calibration rod according to an embodiment of the present invention;
FIG. 8 is a detachable connection structure diagram of a constant temperature calibration rod according to an embodiment of the present invention;
FIG. 9 is a flowchart of a mapping management module according to an embodiment of the invention;
FIG. 10 is a schematic diagram of an image region of a stationary temperature measurement system according to the prior art;
FIG. 11 is a schematic diagram of an image area of a high pixel camera according to an embodiment of the invention;
in the figure, an infrared temperature measurement module 1, a high pixel camera 2, an installation frame 3, a portal frame 4, a sliding part 5, a rotating assembly 6, a sliding chute 7, a constant temperature calibration rod 8, an installation seat 9 and a high radiance positioning head 10.
Detailed Description
The present invention will be described in further detail below with reference to the accompanying drawings and embodiments thereof.
Example 1
The embodiment of the invention provides a local dynamic target temperature measuring system based on a low-pixel infrared camera, which comprises: the device comprises an infrared temperature measurement module 1, a high-pixel camera 2, a mapping table module and a processing unit;
the infrared temperature measurement module 1 outputs a thermal imaging image by acquiring thermal radiation energy of a monitoring area;
the high-pixel camera 2 acquires an image of a monitored area thereof and recognizes an object in the image; outputting the image and the position area of the target in the image;
the mapping table module is used for storing a mapping table, and the mapping table is used for recording the pixel position corresponding relation between the infrared temperature measurement module 1 and the high pixel camera 2;
the processing unit is connected with the infrared temperature measurement module 1, the high-pixel camera 2 and the mapping table module;
the processing unit comprises a temperature extraction module, the temperature extraction module acquires a target position area of the high-pixel camera 2 output by the high-pixel camera 2, a positioning area corresponding to the infrared temperature measurement module 1 is determined according to the mapping table module, and temperature data of the positioning area is extracted and output.
In the existing infrared temperature measurement module 1, especially in infrared thermal imaging temperature measurement based on a low-pixel infrared camera, when facing a complex temperature measurement environment, when the temperature of the environment or other interferent in the environment is closer to the temperature of a target object, it is difficult to distinguish and identify the temperature by a contour. In the temperature measurement system, the contour matching comparison is not needed, and the determination of the target area is not interfered by the environment. Based on the mapping table of the pixel position corresponding relation between the infrared temperature measurement module 1 and the high pixel camera 2, a relatively accurate and stable mapping relation is established between the image shot by the high pixel camera 2 and the thermal image of the infrared temperature measurement module 1. Therefore, after the high-pixel camera 2 identifies the target area, the corresponding pixel coordinate data of the target area in the thermal image shot by the infrared camera can be obtained through the mapping table only based on the coordinate data of the target area in the image shot by the high-pixel camera 2, and then the corresponding area of the target area in the thermal image is correspondingly obtained, so that quick and accurate mapping is realized.
As shown in fig. 1, the existing thermal imaging camera has low pixel density and low resolution, usually 32 × 32, and cannot well identify the contour of the human body, and the existing solution for monitoring the body temperature by the thermal imaging technology usually uses a high temperature point as the body temperature to further determine whether the target body temperature is normal.
However, in a complex temperature measurement environment, the false recognition rate of the method has a significant trend, as shown in fig. 2, a1, a2 and A3 in the figure are three environment high temperature points, and when other high temperature points exist in the environment, a measurement position error occurs when the high temperature points are taken as the body temperature of the human body, so that the defect that the body temperature monitoring of the human body cannot be performed is caused.
In this embodiment, the high-pixel camera 2 is combined, the target is identified by the high-pixel camera 2, and then the temperature of the corresponding position is obtained by the infrared temperature measurement module 1 through the pixel position corresponding relationship between the infrared temperature measurement module 1 and the high-pixel camera 2 recorded by the mapping table. Because the high-pixel camera 2 can accurately distinguish the human body from the environment, after the region where the human body is located is identified, the interference of other high-temperature regions in the point environment is eliminated. Therefore, the temperature measuring system of the embodiment can eliminate the interference of other high-temperature points in the environment on the body temperature monitoring, and improve the accuracy of the temperature measuring system.
Further, as shown in fig. 5 and 6, in this embodiment, the temperature measurement system includes an installation frame 3, the high-resolution camera 2 is fixed on the installation frame 3, a portal frame 4 is further disposed on the installation frame 3, a sliding groove 7 is disposed at the top of the portal frame 4, a sliding part 5 is disposed in the sliding groove 7, the sliding part 5 can move in the sliding groove 7, the sliding part 5 is provided with a rotating assembly 6, the rotating assembly 6 is hinged to the sliding part 5 through a rotating shaft, the rotating assembly 6 can rotate around the rotating shaft, and the infrared temperature measurement module 1 is connected to the rotating assembly 6.
In this embodiment, the infrared temperature measurement module 1 can be replaced by replacing the assembly.
In specific implementation process, temperature measurement system probably is applied to in the multiple scene, to the use scene of difference, can choose for use the infrared camera of different resolution ratios, for example, temperature measurement system is applied to station safety inspection passageway, because the passageway is narrow, personnel pass through in order, the infrared camera that resolution ratio is low just can satisfy the user demand to the infrared camera of low resolution ratio has lower cost, station safety inspection passageway is many, temperature measurement system demand is in large quantity, uses the infrared camera of low resolution ratio to reduce holistic cost.
However, if the temperature measurement system is applied to an access passage with a large flow of people, the infrared camera can only be installed at the top of the passageway by being sucked and far away from the human body due to the wide passage, and therefore the pixel points of the area where the human body is located can be accurately identified by the camera with high resolution.
In the existing temperature measurement system, the visual camera and the infrared camera are designed integrally, a complete product supply chain exists, if the infrared camera needs to be replaced, a new supply chain needs to be redesigned, and the cost is greatly improved. On the other hand, the existing temperature measurement system encapsulates the vision camera and the infrared camera under an integral product shell, if the camera needs to be replaced, the product needs to be opened again, and the cost of the product can be greatly increased.
Particularly, if different product molds need to be designed in different combination modes of the vision camera and the infrared camera for respective production, each product needs to be customized, shells of different products cannot be exchanged for use, and products with small sales volume can overstock inventory and cause waste.
To this embodiment, the user can change infrared temperature measurement module 1 as required, for example the market flow of people is big, and the regional area of temperature monitoring is big, can select the infrared temperature measurement module 1 that resolution ratio is high, can directly change, need not change the product shell again.
Further, as shown in fig. 5, the pitching degree and the horizontal position of the infrared temperature measurement module 1 can be adjusted in a free rotation manner, in a specific using process, the area of an image collection area of the high-pixel camera 2 is large, the area of an image collection area of the infrared temperature measurement module 1 is small, and for some using scenes, for example, the infrared temperature measurement module is applied to an access control machine, as shown in fig. 3, the access control machine is installed beside a door, and a temperature measurement system needs to shoot a target through a large included angle.
Because the high-pixel camera 2 has a large collection range, a target can be collected, but target pixel points collected by the infrared temperature measurement module 1 are few, and the effective data quantity is small. As shown in fig. 11, the S1 area is the acquisition range of the high pixel camera 2, and the S2 area is the acquisition range of the infrared thermometry module 1.
In the existing product, two cameras are fixedly installed, the S1 area and the S2 area are concentric, as shown in the motion track of fig. 10, the target mainly passes through the lower right corner of the direction of the drawing, and if the S1 area and the S2 area are concentric, the S2 can only collect a little target data.
For this embodiment, the pitch and horizontal positions of the infrared temperature measurement module 1 can be freely adjusted by rotation, and the S2 area collected by the infrared temperature measurement module 1 can be adjusted to a path through which the target mainly passes, as shown in fig. 11, so that as much effective data as possible can be collected.
Further, the high-pixel camera 2 includes a face recognition module, and the face recognition module is configured to recognize a face of the target, extract a position of the forehead area, and output a position area of the forehead in the image.
In this embodiment, through the face recognition module of high pixel camera, can discern the pursuit to a plurality of dynamic targets in the shooting scope simultaneously, but the great-traffic target identification demand scene of many people, the promotion temperature measurement efficiency of being applicable to that can be better.
Further, the processing unit comprises a mapping management module, a displacement monitoring module and a calibration module;
the displacement monitoring module monitors whether the relative position of the infrared temperature measurement module 1 and the high-pixel camera 2 changes or not;
the calibration module is used for calibrating the pixel position corresponding relation between the infrared temperature measurement module 1 and the high pixel camera 2, establishing a mapping table and storing the mapping table in the mapping table module;
the mapping management module detects whether a mapping table exists in the mapping table module, if yes, the displacement monitoring module is started to monitor the relative position of the infrared camera and the high-pixel camera 2, whether the relative position changes is judged, if yes, the mapping table is cleared, and whether the mapping table exists is detected again; if not, the calibration module is started to calibrate to form a mapping table.
In a temperature measurement product in which the high-pixel camera 2 and the infrared temperature measurement camera are combined, a manufacturer usually maps and calibrates images shot by the high-pixel camera 2 and the infrared temperature measurement camera in advance before the products are delivered. The requirement that infrared cameras with different resolutions need to be replaced to match different use scenes exists in the use process, the existing temperature measurement products usually set the high-pixel camera 2 and the infrared cameras to be relatively fixed, the replacement is inconvenient, even if a user replaces the infrared cameras by himself, a mapping table preset by a manufacturer cannot be suitable for the camera combination after replacement, and the user cannot calibrate a new combination by himself, so that the infrared cameras cannot be used. The mapping management module arranged in the scheme can judge the effectiveness of the mapping table stored in advance through the displacement monitoring module, when the relative position of the infrared camera and the high-pixel camera 2 changes, the infrared camera is determined to be invalid and is cleared, and the problem of inaccurate temperature measurement caused by detection of the invalid mapping table is avoided. When the mapping table does not exist, the calibration module can be started to carry out field calibration, an effective mapping table is quickly formed, and factory return calibration is not needed.
In this embodiment, as shown in fig. 9, the mapping management module detects whether the mapping table module has a mapping table, if yes, the displacement monitoring module is started to monitor the relative position of the infrared camera and the high-pixel camera 2, and determines whether the relative position changes, if yes, the mapping table is cleared, and the detection of whether the mapping table exists is performed again; if not, the calibration module is started to calibrate to form a mapping table.
In the specific use process, the calibration process of the high-pixel camera 2 and the infrared temperature measurement module 1 does not need user participation, the existing combination of the separated visual camera and the infrared camera needs to be sent back to a manufacturer after the relative position of the combination is changed, or a special technician needs to recalibrate the two cameras through a specific calibration device, such as a calibration board.
In the prior art, working steps of a user are increased, and the use experience of the user is influenced. In this embodiment, after the user adjusts the position of the infrared temperature measurement module 1 or replaces the infrared temperature measurement module 1, the temperature measurement system can automatically recalibrate the high-pixel camera 2 and the infrared temperature measurement module 1 again.
Further, the mapping management module acquires a thermal imaging image output by the infrared temperature measurement module 1, an image output by the high-pixel camera 2 and a position area of the forehead in the image for a period of time;
intercepting a forehead track output by the high-pixel camera 2 to obtain a starting point and an end point, and taking the starting point and the end point as diagonal lines to form an image area, wherein the upper side and the lower side of the image area are horizontal;
intercepting one or more high-temperature point moving tracks of the thermal imaging image, and fusing pixels related to the forehead track according to the pixel level of the infrared temperature measurement module 1; acquiring pixel points covered by the track, and calculating the pixel proportion in the rectangular area; and if the proportion error is within 20%, establishing a mapping table by using each pixel point in the corresponding image area.
In this embodiment, as shown in fig. 4, fig. 4 shows a forehead trajectory diagram, which includes 4 trajectory points and a connection line fitted between the trajectory points, where the trajectory points at two ends are a start point and an end point respectively.
After the infrared temperature measurement module 1 is replaced or the pitching angle and the horizontal position of the infrared temperature measurement module 1 are adjusted in a component replacement mode, the size or the position of the visual field of the infrared temperature measurement module 1 is changed, the original mapping table is invalid, the mapping management module detects that the original mapping table is deleted actively after the infrared temperature measurement module 1 is replaced or adjusted, and a new mapping table is automatically established.
In the process, because the infrared temperature measurement module 1 cannot accurately identify the outline of the target, if two persons approach and walk side by side, two tracks cannot be clearly identified and distinguished, the two tracks can be identified into one track, and the track point of the track jumps near the real track. In this case, the ratio error inevitably exceeds 20%. The above process can discard the process of this calibration in this case.
In the specific implementation process, the camera is started, whether the mapping table exists or not is automatically detected, if the mapping table does not exist, the mapping table is automatically established, and the forehead track output by the high-pixel camera 2 is collected to form an image area.
And (3) fusing pixels related to the forehead track according to the pixel grade of the infrared temperature measurement module 1.
In an embodiment, the pixel fraction within a rectangular area is calculated; the mapping table established by the method can be foreseen within 20% of the ratio error, the target position identified by the high-pixel camera corresponds to the position of the infrared temperature measurement module and is still in the target contour range, the error of the infrared temperature measurement module 1 and the high-pixel camera 2 mapped by the track is small, the quantity of the obtained effective data can be increased, and therefore the error is reduced.
Further, the mapping management module detects that the image area is not in the monitoring area of the infrared temperature measurement module 1 or the image area occupies the area 2/3-4/5 of the image area of the high pixel camera 2, and then prompt information is output.
In the specific implementation process, the size or position of the visual field of the infrared temperature measurement module 1 is changed, the original mapping table is invalid, the mapping management module actively deletes the original mapping table after detecting that the infrared temperature measurement module 1 is replaced or adjusted, and automatically establishes a new mapping table.
In the process, the visual field of the infrared temperature measurement module 1 is also adjusted at the same time, if the position of the visual field deviates from the region where the target mainly passes, the area of the image region of the high-pixel camera 2 occupied by the monitoring region of the infrared temperature measurement module 1 is inevitably smaller than 2/3, and in this case, the infrared temperature measurement module 1 cannot obtain enough effective data.
In this embodiment, in the process of establishing the mapping table, the mapping management module takes the trajectory as a route through which the target mainly passes after acquiring the trajectory, and the mapping management module determines that if the area of the trajectory region occupies a small image acquisition area of the high pixel camera 2, it indicates that the effective image acquisition area of the high pixel camera 2 is small, and after outputting the prompt information, prompts the user to adjust the direction and position of the camera, so as to obtain a larger effective area.
Further, the mapping management module acquires a thermal imaging image output by the infrared temperature measurement module 1 and an image output by the high-pixel camera 2 in a time period of 3-5s, and extracts one frame of image at an interval of 0.2 s.
After experimental research on multiple groups of parameters, the experimental results show that 2S, 4S and 8S time periods are tested, the target is normal walking speed, the length of the track intercepted by 2S is short, the track intercepted within 8S time periods is too long, and the tracks of multiple targets can be acquired.
Also, time intervals of 0.1S, 0.2S, 0.5S were tested. The data volume generated by the time interval of 0.1S is large, and if two tracks appear in the time interval of 0.5S, the distance between the spaced points is similar, so that the two tracks cannot be distinguished. While a time interval of 0.2S produces a small amount of data and is able to distinguish between the two tracks.
Further, the displacement monitoring module comprises a vibration signal sensor and a displacement signal sensor;
the vibration signal sensor is connected with the infrared temperature measurement module 1 and the high-pixel camera 2 and is used for monitoring whether the infrared temperature measurement module 1 and the high-pixel camera 2 vibrate or not;
the displacement signal sensor is connected with the infrared temperature measurement module 1 and the high-pixel camera 2 and used for monitoring whether the infrared temperature measurement module 1 and the high-pixel camera 2 move or not.
The relative position of the infrared temperature measurement module 1 and the high-pixel camera combination can be changed during product transportation or use, so that the mapping table cannot accurately map images between the changed infrared temperature measurement module 1 and the high-pixel camera 2, and finally the obtained temperature cannot represent the target temperature. According to the scheme, by means of obtaining the vibration signal and the displacement detection signal, whether the relative position of the combination of the infrared temperature measurement module 1 and the high-pixel camera 2 moves relatively or not can be effectively judged, and the fault problem can be found in time.
In a specific using process, if a user adjusts the relative position of the camera, the displacement monitoring module can monitor that the relative positions of the high-pixel camera 2 and the infrared temperature measurement module 1 are changed and the original mapping table is invalid, and the mapping management module actively deletes the original invalid mapping table to wait for establishing a new mapping table.
Further, the calibration module filters the temperature value of pixel points of the thermal image shot by the infrared camera, retains the pixel points with the temperature value within the range of 30-45 ℃, and fits to form a first track;
the high pixel camera 2 comprises an image processing unit, the image processing unit acquires a first track, detects whether the track exists in the image of the high pixel camera in the same period, and if the track exists, a mapping table is established according to the pixels of the track and stored in a mapping table module.
The existing mapping calibration usually needs to use a special calibration board for calibration, however, no professional calibration board is usually available in the use scene, and the user cannot carry out field calibration. According to the scheme, the calibration can be automatically carried out based on the acquired image, a calibration plate is not required to be used, human interference is not required, and real non-inductive calibration is realized.
Further, pixel points with temperature values within the range of 33-38 ℃ are reserved, and a first track is formed through fitting.
In the embodiment, a specific temperature range is adopted to establish a track image so as to establish a mapping table, the specific temperature value is a human forehead temperature value range, in the process of establishing the mapping table, a human body passes through the range of the infrared temperature measurement module 1, a track is generated by a moving path of the human forehead, pixel points within the range of 33-38 ℃ can be found out by 80% of probability, and the track image is used for track establishment so as to establish the mapping table. And realizing the mapping establishment process without inductance.
Furthermore, the calibration module further comprises an island identification module, the island identification module can monitor the number of tracks in the mapping table process, and if two tracks exist, the tracks with small effective point number and short length are excluded.
In a specific implementation process, for example, a gate guard exists at an entrance position of a car parking lot, security personnel are in a visual range of a camera, but the area is not an area through which targets mainly pass, and if in a mapping table establishing process, the security personnel can form a short-length track at the boundary of the visual range.
The island identification module can eliminate the track formed by the targets outside the main area, and the efficiency of establishing the mapping table is improved.
Further, the system also comprises a constant temperature calibration rod 8, and the constant temperature calibration rod 8 is detachably connected with the infrared temperature measurement module 1 or the high-pixel camera 2;
the constant-temperature calibration rod 8 comprises a high-emissivity positioning head 10 and a heating component, wherein the heating component is connected with the high-emissivity positioning head 10 and is used for heating the high-emissivity positioning head 10; the high-emissivity locating head 10 is arranged outside the constant-temperature calibration rod 8.
In this embodiment, as shown in fig. 7 and 8, a relatively clear and stable track is formed by the constant temperature calibration rod 8, so that the track calibration efficiency is improved, the multi-gear temperature rise control is adaptable to different detection environments, and the clear track is obtained in different detection environments.
In the research and development process, experimenters find that the environment is affected by the temperature of an air conditioner, or the summer environment temperature is high, the temperature value of the temperature rise of the calibration rod is approximate to the environment temperature, the outline of the constant-temperature calibration rod cannot be clearly distinguished, at the moment, the temperature of the constant-temperature calibration rod 8 is further raised through multi-gear temperature rise control, so that the obvious difference can be generated between the temperature value and the environment, and then clear tracks can be obtained under different detection environments.
In the specific implementation process, the constant-temperature calibration rod 8 comprises a rechargeable battery, the temperature measurement system comprises a mounting seat 9, the constant-temperature calibration rod 8 is placed on the mounting seat 9 and can be charged, and after the constant-temperature calibration rod 8 is taken down, the heating assembly heats the high-emissivity positioning head 10 to a preset temperature which can be 33-38 ℃.
After the relative position of the infrared temperature measurement module 1 is adjusted by a user, the calibration module enters a mapping table establishing process, the user can hold the constant-temperature calibration rod 8 by hand, and a clear track is actively formed in the monitoring range of the infrared temperature measurement module 1 through the high-radiance positioning head 10 for establishing the mapping table.
Further, the high-pixel camera 2 comprises a track recognition unit, the track recognition unit is provided with a track template, and one or more track shapes are preset in the track template;
the track recognition unit acquires the track in the image in real time, compares the track with the track shape recorded by the track template, and starts the calibration module to calibrate to form a mapping table if the track is consistent with the track shape recorded by the track template.
In the embodiment, the temperature measurement detection scene is complex, the inactive calibration triggering is easy to occur, and a specific triggering mode is set, so that the probability of error calibration can be greatly reduced.
In a specific using process, the track identification unit is provided with a track template, and one or more track shapes are preset in the track template; the track recognition unit acquires the track in the image in real time, compares the track with the track shape recorded by the track template, starts the calibration module to calibrate to form a mapping table if the track shape is consistent with the track shape recorded by the track template, can enter the calibration process in an active triggering mode, and reduces the occurrence of error calibration.
In the description of the embodiments of the present invention, it should be understood that the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "center", "top", "bottom", "inner", "outer", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for the purpose of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus should not be construed as limiting the present invention. Where "inside" refers to an interior or enclosed area or space. "periphery" refers to an area around a particular component or a particular area.
In the description of the embodiments of the present invention, the terms "first", "second", "third", and "fourth" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", "third", "fourth" may explicitly or implicitly include one or more of the features. In the description of the present invention, "a plurality" means two or more unless otherwise specified.
In the description of the embodiments of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "assembled" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
In the description of the embodiments of the invention, the particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
In the description of the embodiments of the present invention, it is to be understood that "-" and "-" denote ranges of two numerical values, and the ranges include endpoints. For example, "A-B" means a range greater than or equal to A and less than or equal to B. "A to B" represents a range of A or more and B or less.
In the description of the embodiments of the present invention, the term "and/or" herein is only one kind of association relationship describing an associated object, and means that there may be three kinds of relationships, for example, a and/or B, and may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (8)
1. Local dynamic target temperature measurement system based on low pixel infrared camera, its characterized in that includes: the device comprises an infrared temperature measurement module, a high-pixel camera, a mapping table module and a processing unit;
the infrared temperature measurement module outputs a thermal imaging image by acquiring thermal radiation energy of a monitoring area of the infrared temperature measurement module;
the high-pixel camera acquires an image of a monitoring area of the high-pixel camera and identifies a target in the image; outputting the image and the position area of the target in the image;
the mapping table module is used for storing a mapping table, and the mapping table is used for recording the corresponding relation of pixel positions between the infrared temperature measurement module and the high-pixel camera;
the processing unit is connected with the infrared temperature measurement module, the high-pixel camera and the mapping table module;
the processing unit comprises a temperature extraction module, the temperature extraction module acquires a target position area of the high-pixel camera output by the high-pixel camera, determines a positioning area corresponding to the infrared temperature measurement module according to the mapping table module, extracts temperature data of the positioning area and outputs the temperature data;
the processing unit comprises a mapping management module, a displacement monitoring module and a calibration module;
the displacement monitoring module monitors whether the relative position of the infrared temperature measurement module and the high-pixel camera changes or not;
the calibration module is used for calibrating the corresponding relation of pixel positions between the infrared temperature measurement module and the high-pixel camera, establishing a mapping table and storing the mapping table in the mapping table module;
the mapping management module detects whether a mapping table exists in the mapping table module, if yes, the displacement monitoring module is started to monitor the relative position of the infrared camera and the high-pixel camera, whether the relative position changes is judged, if yes, the mapping table is cleared, and whether the mapping table exists is detected again; if not, starting a calibration module to calibrate to form a mapping table;
the mapping management module acquires a thermal imaging image output by the infrared temperature measurement module for a period of time, an image output by the high-pixel camera and a position area of the forehead in the image;
intercepting a forehead track output by a high-pixel camera to obtain a starting point and an end point, and taking the starting point and the end point as diagonal lines to form an image area, wherein the upper side and the lower side of the image area are horizontal;
intercepting one or more high-temperature point moving tracks of the thermal imaging image, and fusing pixels related to the forehead track according to the pixel level of the infrared temperature measurement module; acquiring pixel points covered by the track, and calculating the pixel proportion in the rectangular area; and if the proportion error is within 20%, establishing a mapping table by using each pixel point in the corresponding image area.
2. The low-pixel infrared camera-based local dynamic object temperature measurement system of claim 1, wherein: the high-pixel camera comprises a face recognition module, wherein the face recognition module is used for recognizing the face of a target, extracting the position of a forehead area and outputting the position area of the forehead in an image.
3. The low-pixel infrared camera-based local dynamic object temperature measurement system of claim 1, wherein: and the mapping management module detects that the image area is not in the monitoring area of the infrared temperature measurement module or the image area occupies the area outside the range of 2/3-4/5 of the image area of the high pixel camera, and then prompt information is output.
4. The low-pixel infrared camera-based local dynamic target temperature measurement system of claim 3, wherein: the mapping management module acquires a thermal imaging image output by the infrared temperature measurement module in a 3-5s time period and an image output by the high-pixel camera, and extracts a frame of image at an interval of 0.2 s.
5. The low-pixel infrared camera-based local dynamic object temperature measurement system of claim 1, wherein: the local dynamic target temperature measurement system comprises a mounting frame, a high-pixel camera is fixed on the mounting frame, a portal frame is further arranged on the mounting frame, a sliding groove is formed in the top of the portal frame, a sliding part is arranged in the sliding groove, the sliding part can move in the sliding groove, the sliding part is provided with a rotating assembly, the rotating assembly is hinged to the sliding part through a rotating shaft and can rotate around the rotating shaft, and the infrared temperature measurement module is connected to the rotating assembly.
6. The low-pixel infrared camera-based local dynamic object temperature measurement system of claim 1, wherein: the calibration module is used for filtering the temperature value of pixel points of the thermal image shot by the infrared camera, keeping the pixel points with the temperature value within the range of 30-45 ℃ and fitting to form a first track;
the high-pixel camera comprises an image processing unit, the image processing unit acquires a first track, detects whether the track exists in an image of the high-pixel camera in the same period of time, and if the track exists, a mapping table is established according to pixels of the track and stored in a mapping table module.
7. The low-pixel infrared camera-based local dynamic target temperature measurement system of claim 6, wherein: the local dynamic target temperature measurement system further comprises a constant temperature calibration rod, and the constant temperature calibration rod is detachably connected with the infrared temperature measurement module or the high-pixel camera;
the constant-temperature calibration rod comprises a high-emissivity positioning head and a heating assembly, and the heating assembly is connected with the high-emissivity positioning head and used for heating the high-emissivity positioning head; the high-radiance positioning head is arranged on the outer side of the constant-temperature calibration rod.
8. The low-pixel infrared camera-based local dynamic target temperature measurement system of claim 7, wherein: the high-pixel camera comprises a track recognition unit, wherein the track recognition unit is provided with a track template, and one or more track shapes are preset in the track template;
the track recognition unit acquires the track in the image in real time, compares the track with the track shape recorded by the track template, and starts the calibration module to calibrate to form a mapping table if the track is consistent with the track shape recorded by the track template.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111048146.XA CN113503972B (en) | 2021-09-08 | 2021-09-08 | Local dynamic target temperature measurement system based on low-pixel infrared camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111048146.XA CN113503972B (en) | 2021-09-08 | 2021-09-08 | Local dynamic target temperature measurement system based on low-pixel infrared camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113503972A CN113503972A (en) | 2021-10-15 |
| CN113503972B true CN113503972B (en) | 2022-01-18 |
Family
ID=78016443
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111048146.XA Active CN113503972B (en) | 2021-09-08 | 2021-09-08 | Local dynamic target temperature measurement system based on low-pixel infrared camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113503972B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115993189B (en) * | 2023-03-22 | 2023-06-06 | 成都华安视讯科技有限公司 | Wrist temperature measuring equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3134297A (en) * | 1960-12-27 | 1964-05-26 | Ncr Co | Optical information display system having metachromatic means |
| CN106713744A (en) * | 2016-11-28 | 2017-05-24 | 努比亚技术有限公司 | Method and apparatus for realizing light painting photography, and shooting device |
| CN111507200A (en) * | 2020-03-26 | 2020-08-07 | 北京迈格威科技有限公司 | Body temperature detection method, body temperature detection device and dual-optical camera |
| CN111914635A (en) * | 2020-06-23 | 2020-11-10 | 北京迈格威科技有限公司 | Human body temperature measurement method, device and system and electronic equipment |
| CN112001886A (en) * | 2020-07-17 | 2020-11-27 | 深圳市优必选科技股份有限公司 | Temperature detection method, device, terminal and readable storage medium |
| CN112082658A (en) * | 2020-09-21 | 2020-12-15 | 国网辽宁省电力有限公司电力科学研究院 | Transformer infrared temperature measurement online monitoring system and method based on image recognition |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8531562B2 (en) * | 2004-12-03 | 2013-09-10 | Fluke Corporation | Visible light and IR combined image camera with a laser pointer |
| CN102104768A (en) * | 2009-12-22 | 2011-06-22 | 乐金电子(中国)研究开发中心有限公司 | Image monitoring method, main control device and system |
| CN105827987B (en) * | 2016-05-27 | 2019-07-26 | 维沃移动通信有限公司 | A kind of picture shooting method and mobile terminal |
-
2021
- 2021-09-08 CN CN202111048146.XA patent/CN113503972B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3134297A (en) * | 1960-12-27 | 1964-05-26 | Ncr Co | Optical information display system having metachromatic means |
| CN106713744A (en) * | 2016-11-28 | 2017-05-24 | 努比亚技术有限公司 | Method and apparatus for realizing light painting photography, and shooting device |
| CN111507200A (en) * | 2020-03-26 | 2020-08-07 | 北京迈格威科技有限公司 | Body temperature detection method, body temperature detection device and dual-optical camera |
| CN111914635A (en) * | 2020-06-23 | 2020-11-10 | 北京迈格威科技有限公司 | Human body temperature measurement method, device and system and electronic equipment |
| CN112001886A (en) * | 2020-07-17 | 2020-11-27 | 深圳市优必选科技股份有限公司 | Temperature detection method, device, terminal and readable storage medium |
| CN112082658A (en) * | 2020-09-21 | 2020-12-15 | 国网辽宁省电力有限公司电力科学研究院 | Transformer infrared temperature measurement online monitoring system and method based on image recognition |
Non-Patent Citations (3)
| Title |
|---|
| Cross-Calibration between ASTER and MODIS Visible to Near-Infrared Bands for Improvement of ASTER Radiometric Calibration;Kenta Obata等;《Sensors》;20170804;第17卷(第8期);第1793-1至19页 * |
| 基于可见光与红外图像异源双目视觉目标跟踪研究;曾强;《中国优秀硕士学位论文全文数据库 信息科技辑》;20200515(第05期);全文 * |
| 基于可见光和红外视频的在线目标跟踪算法研究;徐宁文;《中国优秀硕士学位论文全文数据库 信息科技辑》;20200115(第01期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113503972A (en) | 2021-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111255636B (en) | Method and device for determining tower clearance of wind generating set | |
| CN110142785A (en) | A kind of crusing robot visual servo method based on target detection | |
| CN108831157A (en) | A kind of garden security protection based on intelligent robot is deployed to ensure effective monitoring and control of illegal activities management system | |
| CN110244314B (en) | Low-slow small target detection and identification system and method | |
| KR102131250B1 (en) | Smart phone, vehicle, camera with thermal imaging sensor and display and monitoring method using the same | |
| CN113877124B (en) | Intelligent control system for jet flow falling point of fire monitor | |
| US8587664B2 (en) | Target identification and location system and a method thereof | |
| CN109389719A (en) | A kind of cell unit door access control system and door opening method | |
| CN113503972B (en) | Local dynamic target temperature measurement system based on low-pixel infrared camera | |
| CN102196240B (en) | Pick-up device and method for dynamically sensing monitored object by utilizing same | |
| CN112084813A (en) | Abnormal target detection method and device and storage medium | |
| CN107256034B (en) | Change distribution room multiple spot environmental data collection system based on unmanned aerial vehicle | |
| JP4056813B2 (en) | Obstacle detection device | |
| JP4056777B2 (en) | Autonomous mobile object traveling system and autonomous mobile object position correction method | |
| CN113392714A (en) | Crowd event detection method and system | |
| Hanna et al. | A System for Non-Intrusive Human Iris Acquisition and Identification. | |
| CN117412161A (en) | Trolley tracking method and device, storage medium and terminal equipment | |
| CN101625506B (en) | Face automatic focusing method of digital image acquirement device | |
| CN116086408A (en) | Intelligent mapping system based on industrial camera | |
| CN114501737B (en) | Railway tunnel illumination system and method | |
| CN212261348U (en) | Remote temperature measurement system based on thermal imaging and face recognition | |
| CN114912755A (en) | All-weather comprehensive early warning and monitoring method, system and device for airport flight area | |
| CN110349157A (en) | A kind of Electronic locomotive label image camera system | |
| CN114827466B (en) | Human eye-like equipment image acquisition device and image acquisition method | |
| CN105787514A (en) | Temperature detection method based on infrared vision matching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |