CN112001871A - Fusion method of infrared double-light image information - Google Patents
Fusion method of infrared double-light image information Download PDFInfo
- Publication number
- CN112001871A CN112001871A CN202010846739.XA CN202010846739A CN112001871A CN 112001871 A CN112001871 A CN 112001871A CN 202010846739 A CN202010846739 A CN 202010846739A CN 112001871 A CN112001871 A CN 112001871A
- Authority
- CN
- China
- Prior art keywords
- image
- infrared
- definition image
- light
- fusing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007500 overflow downdraw method Methods 0.000 title abstract description 8
- 238000000034 method Methods 0.000 claims abstract description 20
- 239000011159 matrix material Substances 0.000 claims description 6
- 150000001875 compounds Chemical class 0.000 claims description 3
- 230000004927 fusion Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000009529 body temperature measurement Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000001931 thermography Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
- G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
- Radiation Pyrometers (AREA)
Abstract
The invention discloses a fusion method of infrared double-light image information, which comprises the steps of firstly, synchronously acquiring an infrared image and a high-definition image of an infrared double-light camera, then calibrating the infrared image and the high-definition image by using a binocular calibration method, calculating a scaling factor K of the images, and carrying out image size matching according to the scaling factor K; and then, calculating the offset of the infrared image relative to the high-definition image, carrying out image registration on the double-light-path image, and finally fusing the infrared image and the high-definition image to obtain the temperature information and the image information of each pixel point. According to the method, the infrared image and the high-definition image are fused, the fused image associates the high-definition image with the temperature information, and the problem that the high-definition image cannot be rapidly matched with infrared temperature data is solved.
Description
Technical Field
The invention relates to information fusion of an infrared image and a high-definition image of an infrared double-spectrum camera, and particularly provides a fusion method of infrared double-light image information.
Background
With the wider application of the infrared thermal imaging technology in human body temperature measurement, the demand of more and more fields on the infrared technology is higher, but at present, the imaging of the infrared image is a pseudo-color image based on temperature back-stepping, the detail display of the image is not enough, and only the data of the highest temperature, the lowest temperature or the average temperature and the like in a picture can be obtained; however, it is difficult to accurately correlate the temperature information in the infrared image with the information in the high-definition image.
Therefore, a new method for fusing the infrared image and the high-definition image information of the infrared dual-spectrum camera is provided, so as to quickly and accurately relate the temperature information in the infrared image and the information of the high-definition image, which is a problem to be solved urgently.
Disclosure of Invention
In view of this, the present invention provides a method for fusing infrared dual-light image information, so as to solve the problem that an infrared image cannot be accurately associated with high-definition image information in the prior art.
The invention provides a fusion method of infrared double-light image information, which comprises the following steps:
s1: at intervals of time T0Synchronously acquiring infrared image S of infrared double-light camera at current momenti0And high definition image Sg0；
S2: using a binocular calibration method to calibrate the infrared image Si0And high definition image Sg0Carrying out binocular calibration to obtain a scaling factor K which can unify the sizes of the space objects on the two images;
s3: by means of infrared images Si0Based on the size of the high-definition image S, according to the scaling factor Kg0Performing scaling processing to obtain an infrared image Si0Size-matched high-definition image Sg1；
S4: calculating an infrared image Si0And high definition image Sg1Offset amount (x) of0，y0)；
S5: according to the offset (x)0，y0) Moving infrared image Si0And high definition image Sg1Obtaining an infrared image S with aligned coordinatesi1And high definition image Sg2；
S6: fusing the infrared image Si1And high definition image Sg2To obtain a fused image SrAnd creating said fused image SrThe pixel matrix T of (a), wherein the pixel matrix T includes temperature value information and pixel value information of a pixel point, and the temperature value information is represented by an infrared image Si1Providing, said pixel value information is provided by a high definition image Sg2Provided is a method.
Preferably, in S1, the time interval T0The value range of (1) is 20-40 ms.
Further preferably, in S1, the time interval T0And counting by a clock timer of the infrared double-light camera.
Further preferably, in S2, the scaling factor K is calculated as follows:
1) presetting a calibration plate;
2) calculating the scaling factor K using equation (1)
In the formula, pnAnd vnIs the x-axis coordinate or the y-axis coordinate, p, of the center of a circle of the calibration plate on the infrared image and the high-definition image respectivelyn-1And vn-1The center of a circle of the calibration plate is respectively the x-axis coordinate or the y-axis coordinate on the previous frame of infrared image and high-definition image, and pn、vn、pn-1、vn-1Simultaneously, the coordinate is an x-axis coordinate or a y-axis coordinate;
more preferably, in S3, the image is scaled by bilinear interpolation.
Further preferably, in S4, the offset amount is calculated by formula (2)
In the formula (I), the compound is shown in the specification,
and
respectively as the center of a circle of the calibration plate in the infrared image Si0The pixel coordinate values of (1) are,
and
respectively as the circle center of the calibration plate in the high definition image Sg1Pixel coordinate values of (2).
The invention provides a fusion method of infrared double-light image information, which comprises the steps of firstly, synchronously acquiring an infrared image and a high-definition image of an infrared double-light camera, then calibrating the infrared image and the high-definition image by using a binocular calibration method, calculating a scaling factor K of the images, and carrying out image size matching according to the scaling factor K; and then, calculating the offset of the infrared image relative to the high-definition image, carrying out image registration on the double-light-path image, and finally fusing the infrared image and the high-definition image to obtain the temperature information and the image information of each pixel point.
The invention provides a fusion method of infrared double-light image information, which fuses an infrared image and a high-definition image, associates the high-definition image with temperature information through the fusion image, and solves the problem that the high-definition image cannot be quickly matched with infrared temperature data.
Detailed Description
The invention will be further explained with reference to specific embodiments, without limiting the invention.
The invention provides a fusion method of infrared double-light image information, which comprises the following steps:
s1: at intervals of time T0Synchronously acquiring infrared image S of infrared double-light camera at current momenti0And high definition image Sg0Wherein the time interval T0Is in the range of 20-40ms, said time interval T0Counting by a clock timer of the infrared double-light camera;
s2: using a binocular calibration method to calibrate the infrared image Si0And high definition image Sg0To carry outPerforming binocular calibration to obtain a scaling factor K which can unify the sizes of the space object on the two images;
the calculation method of the scaling factor K is as follows:
1) presetting a calibration plate;
2) calculating the scaling factor K using equation (1)
In the formula, pnAnd vnIs the x-axis coordinate or the y-axis coordinate, p, of the center of a circle of the calibration plate on the infrared image and the high-definition image respectivelyn-1And vn-1The center of a circle of the calibration plate is respectively the x-axis coordinate or the y-axis coordinate on the previous frame of infrared image and high-definition image, and pn、vn、pn-1、vn-1Simultaneously, the coordinate is an x-axis coordinate or a y-axis coordinate;
s3: by means of infrared images Si0Based on the size of the high-definition image S, according to the scaling factor Kg0Performing scaling processing to obtain an infrared image Si0Size-matched high-definition image Sg1；
In the image matching process, the images are scaled by utilizing bilinear interpolation;
typically, the infrared image size is smaller than the high definition image size, and therefore, in the infrared image Si0Using the dimension of the image as a reference, and using bilinear interpolation to obtain a high-definition image Sg0Performing scaling processing to obtain an infrared image Si0Size-matched high-definition image Sg1；
S4: calculating an infrared image Si0And high definition image Sg1Offset amount (x) of0，y0)；
Wherein the offset is calculated by formula (2)
In the formula (I), the compound is shown in the specification,
and
respectively as the center of a circle of the calibration plate in the infrared image Si0The pixel coordinate values of (1) are,
and
respectively as the circle center of the calibration plate in the high definition image Sg1Pixel coordinate values of (1);
s5: according to the offset (x)0，y0) Moving infrared image Si0And high definition image Sg1Obtaining an infrared image S with aligned coordinatesi1And high definition image Sg2；
S6: fusing the infrared image Si1And high definition image Sg2To obtain a fused image SrAnd creating said fused image SrThe pixel matrix T of (a), wherein the pixel matrix T includes temperature value information and pixel value information of a pixel point, and the temperature value information is represented by an infrared image Si1Providing, said pixel value information is provided by a high definition image Sg2Providing;
thus, by fusing the images SrThe temperature information of the infrared image part and the image information of the high-definition image can be acquired simultaneously, and the problem that the temperature information cannot be acquired directly and rapidly through the high-definition image is solved.
The method for fusing the infrared double-light image information comprises the steps of firstly, synchronously acquiring an infrared image and a high-definition image of an infrared double-light camera, then calibrating the infrared image and the high-definition image by using a binocular calibration method, calculating a scaling factor K of the images, and carrying out image size matching according to the scaling factor K; and then, calculating the offset of the infrared image relative to the high-definition image, carrying out image registration on the double-light-path image, and finally fusing the infrared image and the high-definition image to obtain the temperature information and the image information of each pixel point.
According to the method, the infrared image and the high-definition image are fused, the fused image associates the high-definition image with the temperature information, and the problem that the high-definition image cannot be rapidly matched with infrared temperature data is solved.
The embodiments of the present invention have been written in a progressive manner with emphasis placed on the differences between the various embodiments, and similar elements may be found in relation to each other.
While the embodiments of the present invention have been described in detail, the present invention is not limited to the above embodiments, and various changes can be made without departing from the spirit of the present invention within the knowledge of those skilled in the art.
Claims (6)
1. A method for fusing infrared double-light image information is characterized by comprising the following steps:
s1: at intervals of time T0Synchronously acquiring infrared image S of infrared double-light camera at current momenti0And high definition image Sg0；
S2: using a binocular calibration method to calibrate the infrared image Si0And high definition image Sg0Carrying out binocular calibration to obtain a scaling factor K which can unify the sizes of the space objects on the two images;
s3: by means of infrared images Si0Based on the size of the high-definition image S, according to the scaling factor Kg0Performing scaling processing to obtain an infrared image Si0Size-matched high-definition image Sg1；
S4: calculating an infrared image Si0And high definition image Sg1Offset amount (x) of0，y0)；
S5: according to the offset (x)0，y0) Moving infrared image Si0And high definition image Sg1Obtaining an infrared image S with aligned coordinatesi1And high definition image Sg2；
S6: fusing the infrared image Si1And heightClear image Sg2To obtain a fused image SrAnd creating said fused image SrThe pixel matrix T of (a), wherein the pixel matrix T includes temperature value information and pixel value information of a pixel point, and the temperature value information is represented by an infrared image Si1Providing, said pixel value information is provided by a high definition image Sg2Provided is a method.
2. A method of fusing infrared dual-light image information according to claim 1, wherein: at S1, the time interval T0The value range of (1) is 20-40 ms.
3. A method of fusing infrared dual-light image information according to claim 1, wherein: at S1, the time interval T0And counting by a clock timer of the infrared double-light camera.
4. A method of fusing infrared dual-light image information according to claim 1, wherein: in S2, the scaling factor K is calculated as follows:
1) presetting a calibration plate;
2) calculating the scaling factor K using equation (1)
In the formula, pnAnd vnIs the x-axis coordinate or the y-axis coordinate, p, of the center of a circle of the calibration plate on the infrared image and the high-definition image respectivelyn-1And vn-1The center of a circle of the calibration plate is respectively the x-axis coordinate or the y-axis coordinate on the previous frame of infrared image and high-definition image, and pn、vn、pn-1、vn-1As well as x-axis coordinates or y-axis coordinates.
5. A method of fusing infrared dual-light image information according to claim 1, wherein: in S3, the image is scaled by bilinear interpolation.
6. A method of fusing infrared dual-light image information according to claim 1, wherein: . In S4, the offset amount is calculated by formula (2)
In the formula (I), the compound is shown in the specification,
and
respectively as the center of a circle of the calibration plate in the infrared image Si0The pixel coordinate values of (1) are,
and
respectively as the circle center of the calibration plate in the high definition image Sg1Pixel coordinate values of (2).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010846739.XA CN112001871A (en) | 2020-08-21 | 2020-08-21 | Fusion method of infrared double-light image information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010846739.XA CN112001871A (en) | 2020-08-21 | 2020-08-21 | Fusion method of infrared double-light image information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112001871A true CN112001871A (en) | 2020-11-27 |
Family
ID=73473412
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010846739.XA Pending CN112001871A (en) | 2020-08-21 | 2020-08-21 | Fusion method of infrared double-light image information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112001871A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104574332A (en) * | 2014-12-26 | 2015-04-29 | 北京航天控制仪器研究所 | Image fusion method for airborne optoelectronic pod |
| CN104601953A (en) * | 2015-01-08 | 2015-05-06 | 中国航空无线电电子研究所 | Video image fusion-processing system |
| US20170358067A1 (en) * | 2014-12-02 | 2017-12-14 | University Of Seoul Industry Cooperation Foundation | Method and Device for Fusing Panchromatic Image and Infrared Image |
| CN108364272A (en) * | 2017-12-30 | 2018-08-03 | 广东金泽润技术有限公司 | A kind of high-performance Infrared-Visible fusion detection method |
-
2020
- 2020-08-21 CN CN202010846739.XA patent/CN112001871A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170358067A1 (en) * | 2014-12-02 | 2017-12-14 | University Of Seoul Industry Cooperation Foundation | Method and Device for Fusing Panchromatic Image and Infrared Image |
| CN104574332A (en) * | 2014-12-26 | 2015-04-29 | 北京航天控制仪器研究所 | Image fusion method for airborne optoelectronic pod |
| CN104601953A (en) * | 2015-01-08 | 2015-05-06 | 中国航空无线电电子研究所 | Video image fusion-processing system |
| CN108364272A (en) * | 2017-12-30 | 2018-08-03 | 广东金泽润技术有限公司 | A kind of high-performance Infrared-Visible fusion detection method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3287986B1 (en) | Image correction method of projector and image correction system | |
| US11823363B2 (en) | Infrared and visible light fusion method | |
| US8000559B2 (en) | Method of correcting image distortion and apparatus for processing image using the method | |
| TWI511086B (en) | Lens distortion calibration method | |
| CN109461126A (en) | A kind of image distortion correction method and system | |
| JP2000502447A (en) | Multi-field calibration plate for semiconductor manufacturing | |
| US20110063417A1 (en) | System and method for automatic calibration of stereo images | |
| US9600863B2 (en) | Method for combining images | |
| JP2009042162A (en) | Calibration device and method therefor | |
| CN108053375B (en) | Image data correction method and device and automobile | |
| CN107633489A (en) | The fish eye lens center of circle, which is brought up again, takes reflection method distortion correction method | |
| CN108418997B (en) | Method for removing image moire | |
| CN107492080B (en) | Calibration-free convenient monocular head image radial distortion correction method | |
| US20190019309A1 (en) | Method for calibration of a stereo camera | |
| CN113538587A (en) | Camera coordinate transformation method, terminal and storage medium | |
| EP2648157A1 (en) | Method and device for transforming an image | |
| KR20100007506A (en) | New calibration method of multi-view camera for a optical motion capture system | |
| CN112465915A (en) | Vehicle-mounted panoramic system calibration method | |
| CN105427299B (en) | A kind of camera focal length method for solving based on distortion correction | |
| CN111986267A (en) | Coordinate system calibration method of multi-camera vision system | |
| CN115218822A (en) | Calibration method of laser profile measuring instrument | |
| CN112001871A (en) | Fusion method of infrared double-light image information | |
| CN111179180B (en) | Image correction method and device | |
| WO2011024249A1 (en) | Image processing device, image processing method, and image processing program | |
| CN108010089A (en) | A kind of high-definition picture acquisition methods based on the movable video camera of binocular |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |