CN109903244A - A kind of real-time infrared image restored method - Google Patents
A kind of real-time infrared image restored method Download PDFInfo
- Publication number
- CN109903244A CN109903244A CN201910130007.8A CN201910130007A CN109903244A CN 109903244 A CN109903244 A CN 109903244A CN 201910130007 A CN201910130007 A CN 201910130007A CN 109903244 A CN109903244 A CN 109903244A
- Authority
- CN
- China
- Prior art keywords
- image
- optical system
- computer
- detector
- fourier transform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000003287 optical effect Effects 0.000 claims abstract description 37
- 230000015556 catabolic process Effects 0.000 claims description 32
- 238000006731 degradation reaction Methods 0.000 claims description 32
- 238000001914 filtration Methods 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims description 8
- 230000005855 radiation Effects 0.000 claims description 8
- 230000009466 transformation Effects 0.000 claims description 4
- 230000002194 synthesizing effect Effects 0.000 claims description 3
- 238000003331 infrared imaging Methods 0.000 abstract description 6
- 238000011084 recovery Methods 0.000 abstract 2
- 238000009434 installation Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
Landscapes
- Radiation Pyrometers (AREA)
- Image Processing (AREA)
Abstract
The present invention proposes a kind of real-time infrared image restored method, it is characterised in that: the realization system of real-time infrared image restored method includes: target, knife, optical system, diaphragm, the photosurface of detector, driving circuit, computer；Wherein, the photosurface of the target, optical system and detector is coaxial, and the photosurface of detector is on the focal plane of optical system；Knife is moved along the optical axis direction of vertical optical system；The first step, computer control driving circuit and the acquisition image for receiving the target；Second step calculates degenrate function according to acquired image；Third step calculates liftering according to degenrate function, carries out image restoration.This method is found out the expression formula of infrared image recovery, the real-time recovery of infrared image is realized using the powerful computing capability of computer and the real-time of FPGA according to the basic principle of infrared imaging.
Description
Technical Field
The invention relates to the field of image restoration and reconstruction of image processing, in particular to a real-time infrared image restoration method.
Background
Various systems such as infrared detection, search, and tracking require infrared images to reflect the target and background faithfully. In fact, due to the physical characteristics of infrared wavelengths, the process level of the infrared detector, the low cut-off frequency of the infrared optical system, and the like, the Modulation Transfer Function (MTF) cut-off frequency of the infrared imaging system is very low, and the infrared image with higher transmission cannot clearly and finely reproduce the target and the background as the visible light.
The invention provides a restoration method by utilizing infrared imaging. The method utilizes the transfer function characteristic of the infrared imaging system and the strong processing capacity of the FPGA to realize the real-time restoration of the infrared image.
Disclosure of Invention
The real-time infrared image restoration method comprises the following implementation steps:
first step of establishing real-time infrared image restoration method system
A system for restoring a real-time infrared image comprises the following steps: target, knife edge instrument, optical system, diaphragm, photosensitive surface of detector, drive circuit and computer.
The target, the optical system and the photosensitive surface of the detector are coaxial, and the photosensitive surface of the detector is on the focal plane of the optical system; the knife edge instrument moves along the direction vertical to the optical axis of the optical system. There is no quantitative requirement for the installation of the other components.
The purpose of the target is to provide a scenario where the frequency characteristics are known. The knife edge instrument is mainly used for controlling the quantity and the direction of light rays entering the optical system; the optical system has the main functions of collecting radiation energy of a scene and mapping the energy of the scene and the distribution thereof to a focal plane; the optical system is also capable of determining the size, intensity, etc. of the scene in the focal plane. The diaphragm is used for controlling the quantity and direction of imaging light rays. The detector functions to accumulate infrared radiation to generate electric charge, and output the electric charge in the form of voltage (or current, etc.). The driving circuit is used for receiving computer instructions and controlling the detector to work; and synthesizing the analog signals output by the detector into images and transmitting the images to a computer. The computer functions to send commands, receive, display images and calculate the degradation function.
The second step is electrifying, the computer controls the drive circuit and receives the infrared image output by the drive circuit
A third step of calculating a degradation function from the acquired image
The mathematical basic expression of the degradation function is as follows.
The imaging process of the infrared system can be expressed by the formula (1):
g(x,y)＝h(x,y)*f(x,y)(1)
wherein f is(x,y)Is a mathematical representation of the input image, in the present method a target;
g(x,y)for outputting a mathematical representation of the image, in the method an image acquired by a computer;
h(x,y)is a degradation function.
The expression for converting equation (1) into the frequency domain is:
G(u,v)＝H(u,v)F(u,v)(2)
wherein, F(u,v)Is f(x,y)The Fourier transform expression of (1);
G(u,v)is g(x,y)The Fourier transform expression of (1);
H(u,v)is h(x,y)Fourier transform expression of (a).
In the implementation of the method, the image of the target and the image collected by the computer are respectively subjected to Fourier transform; then, the degradation function is obtained according to the equation (2).
Fourthly, calculating inverse filtering according to the degradation function to restore the image
When the infrared imaging system is actually in operation,according to a degradation function H(u,v)And (3) carrying out inverse filtering:
wherein,a Fourier transform expression of an actual scene;
is a fourier transform expression of the actual image.
Wherein,is a mathematical representation of the actual scene;
ft (-) denotes an inverse fourier transform.
Wherein,is a mathematical representation of the restored image;
lt (-) represents a geometric linear transformation.
Drawings
FIG. 1 is a schematic diagram of a real-time infrared image restoration system;
1. target 2, knife edge instrument 3, optical system 4, diaphragm 5, photosensitive surface 6 of detector, drive circuit 7 and computer
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings.
The real-time infrared image restoration method comprises the following specific implementation steps:
the method comprises the following steps of constructing a real-time infrared image restoration system, wherein the system of the real-time infrared image restoration method comprises the following steps: target, knife edge instrument, optical system, diaphragm, photosensitive surface of detector, drive circuit and computer.
When the system is set up, the photosensitive surfaces of the target, the optical system and the detector are coaxial, the photosensitive surface of the detector is on the focal plane of the optical system, and the knife edge instrument moves along the direction perpendicular to the optical axis of the optical system. There is no quantitative requirement for the installation of other components.
The purpose of the target is to provide a scenario where the frequency characteristics are known. The knife edge instrument is mainly used for controlling the quantity and the direction of light rays entering the optical system; the optical system has the main functions of collecting radiation energy of a scene and mapping the energy of the scene and the distribution thereof to a focal plane; the optical system is also capable of determining the size, intensity, etc. of the scene in the focal plane. The diaphragm is used for controlling the quantity and direction of imaging light rays. The detector functions to accumulate infrared radiation to generate electric charge, and output the electric charge in the form of voltage (or current, etc.). The driving circuit is used for receiving computer instructions and controlling the detector to work; the signals of the detectors are converted, and the images are synthesized and transmitted to a computer. The computer functions to send commands, receive, display images and calculate the degradation function.
First step, electrifying, controlling a driving circuit by a computer and receiving a collected image of a target
A second step of calculating a degradation function from the acquired image
The mathematical basic expression of the degradation function is as follows.
The imaging process of the infrared system can be expressed by the formula (1):
g(x,y)＝h(x,y)*f(x,y)(1)
wherein f is(x,y)Is a mathematical representation of the input image, in the present method a target;
g(x,y) For outputting a mathematical representation of the image, in the method an image acquired by a computer;
h(x,y)is a degradation function.
The expression for converting equation (1) into the frequency domain is:
G(u,v)＝H(u,v)F(u,v)(2)
wherein, F(u,v)Is f(x,y)The Fourier transform expression of (1);
G(u,v)is g(x,y)The Fourier transform expression of (1);
H(u,v)is h(x,y)Fourier transform expression of (a).
In the method, Fourier transform is respectively carried out on an image of a target and an image acquired by a computer; then, the degradation function is obtained according to the equation (2).
And thirdly, calculating inverse filtering according to the degradation function, and restoring the image.
When the infrared imaging system actually works, according to the degradation function H(u,v)And (3) carrying out inverse filtering:
wherein,a Fourier transform expression of an actual scene;
is a fourier transform expression of the actual image.
Wherein,is a mathematical representation of the actual scene;
ft (-) denotes an inverse fourier transform.
Wherein,is a mathematical representation of the restored image;
lt (-) represents a geometric linear transformation.
And fifthly, transplanting the algorithms and coefficients of the formulas (2) to (5) into an FPGA of a driving circuit to ensure real-time performance.
At this point, the restoration of the infrared image is completed.
Claims (6)
1. A real-time infrared image restoration method is characterized by comprising the following steps: the system for realizing the real-time infrared image restoration method comprises the following steps:
the device comprises a target, a knife edge instrument, an optical system, a diaphragm, a photosensitive surface of a detector, a driving circuit and a computer; the target, the optical system and the photosensitive surface of the detector are coaxial, and the photosensitive surface of the detector is on the focal plane of the optical system; the knife edge instrument moves along the direction vertical to the optical axis of the optical system;
wherein the target is used to provide a scene with known frequency characteristics,
the knife edge instrument is used for controlling the quantity and the direction of light rays entering the optical system;
the optical system collects the radiation energy of the scenery and maps the energy of the scenery and the distribution thereof to a focal plane;
the diaphragm is used for controlling the quantity and the direction of imaging light rays;
the detector is used for accumulating infrared radiation to generate electric charge and outputting the electric charge in the form of an electric signal;
the matching circuit is used for receiving a computer instruction and controlling the detector to work; converting the signals of the detector, synthesizing the images and transmitting the images to a computer;
the computer is used for sending instructions, receiving and displaying images and calculating a degradation function;
the method comprises the following steps:
firstly, a computer controls a driving circuit and receives an acquired image of the target;
secondly, calculating a degradation function according to the acquired image;
and thirdly, calculating inverse filtering according to the degradation function, and restoring the image.
2. The method according to claim 1, wherein in the second step, computing a degradation function from the acquired image comprises: respectively carrying out Fourier transform on the image of the target and the image acquired by the computer; then, the degradation function is obtained according to the formulas (1), (2) and (2'):
the imaging process of an infrared system can be expressed by 1) formula:
g(x,y)＝h(x,y)*f(x,y)(1)
wherein f is(x,y)Is a mathematical representation of the input image, in the present method a target;
g(x,y)for outputting a mathematical representation of the image, in the method an image acquired by a computer;
h(x,y)is a degradation function;
the expression for converting equation (1) into the frequency domain is:
G(u,v)＝H(u,v)F(u,v)(2)
wherein, F(u,v)Is f(x,y)The Fourier transform expression of (1);
G(u,v)is g(x,y)The Fourier transform expression of (1);
H(u,v)as a function of degradation h(x,y)Fourier transform expression of (a).
3. The method according to claim 2, wherein in the third step, the inverse filtering is computed on the basis of a degradation function, and the image restoration comprises:
according to a degradation function H(u,v)And (3) carrying out inverse filtering:
wherein,a Fourier transform expression of an actual scene;
a Fourier transform expression of an actual image;
wherein,is a mathematical representation of the actual scene;
ft (-) denotes an inverse fourier transform;
wherein,is a mathematical representation of the restored image;
lt (-) represents a geometric linear transformation.
4. A real-time infrared image restoration system, comprising: the device comprises a target, a knife edge instrument, an optical system, a diaphragm, a photosensitive surface of a detector, a driving circuit and a computer; the target, the optical system and the photosensitive surface of the detector are coaxial, and the photosensitive surface of the detector is on the focal plane of the optical system; the knife edge instrument moves along the direction vertical to the optical axis of the optical system;
wherein the target is used to provide a scene with known frequency characteristics,
the knife edge instrument is used for controlling the quantity and the direction of light rays entering the optical system;
the optical system collects the radiation energy of the scenery and maps the energy of the scenery and the distribution thereof to a focal plane;
the diaphragm is used for controlling the quantity and the direction of imaging light rays;
the detector is used for accumulating infrared radiation to generate electric charge and outputting the electric charge in the form of electric signal voltage or current;
the driving circuit is used for receiving a computer instruction and controlling the detector to work; converting the signals of the detector, synthesizing the images and transmitting the images to a computer;
the computer is used for sending instructions, receiving and displaying images and calculating a degradation function;
the computer controls the driving circuit and receives the collected image; calculating a degradation function from the acquired image; and calculating inverse filtering according to the degradation function to restore the image.
5. The system of claim 4, wherein computing a degradation function from the acquired images comprises: respectively carrying out Fourier transform on the image of the target and the image acquired by the computer; then, solving a degradation function according to the formulas (1), (2) and (2');
the imaging process of an infrared system can be expressed by 1) formula:
g(x,y)＝h(x,y)*f(x,y)(1)
wherein f is(x,y)Is a mathematical representation of the input image, in the present method a target;
g(x,y)for outputting a mathematical representation of the image, in the method an image acquired by a computer;
h(x,y)is a degradation function;
the expression for converting equation (1) into the frequency domain is:
G(u,v)＝H(u,v)F(u,v)(2)
wherein, F(u,v)Is f(x,y)The Fourier transform expression of (1);
G(u,v)is g(x,y)The Fourier transform expression of (1);
H(u,v)as a function of degradation h(x,y)Fourier transform expression of (a).
6. The method of claim 5, wherein computing the inverse filter based on a degradation function, and wherein performing image restoration comprises:
according to a degradation function H(u,v)And (3) carrying out inverse filtering:
wherein,a Fourier transform expression of an actual scene;
a Fourier transform expression of an actual image;
wherein,is a mathematical representation of the actual scene;
ft (-) denotes an inverse fourier transform;
wherein,is a mathematical representation of the restored image;
lt (-) represents a geometric linear transformation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910130007.8A CN109903244A (en) | 2019-02-21 | 2019-02-21 | A kind of real-time infrared image restored method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910130007.8A CN109903244A (en) | 2019-02-21 | 2019-02-21 | A kind of real-time infrared image restored method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109903244A true CN109903244A (en) | 2019-06-18 |
Family
ID=66945200
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910130007.8A Pending CN109903244A (en) | 2019-02-21 | 2019-02-21 | A kind of real-time infrared image restored method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109903244A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103606130A (en) * | 2013-10-22 | 2014-02-26 | 中国电子科技集团公司第二十八研究所 | Infrared degraded image adaptive restoration method |
| CN106127700A (en) * | 2016-06-17 | 2016-11-16 | 中国电子科技集团公司第二十八研究所 | One stares infrared degraded image adaptive restoration method |
| US20180218483A1 (en) * | 2015-08-19 | 2018-08-02 | Canon Kabushiki Kaisha | Image processing apparatus, image capturing apparatus, and storage medium |
| CN108765505A (en) * | 2018-04-28 | 2018-11-06 | 天津大学 | The coding of infrared imaging perceives matrix estimation method |
-
2019
- 2019-02-21 CN CN201910130007.8A patent/CN109903244A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103606130A (en) * | 2013-10-22 | 2014-02-26 | 中国电子科技集团公司第二十八研究所 | Infrared degraded image adaptive restoration method |
| US20180218483A1 (en) * | 2015-08-19 | 2018-08-02 | Canon Kabushiki Kaisha | Image processing apparatus, image capturing apparatus, and storage medium |
| CN106127700A (en) * | 2016-06-17 | 2016-11-16 | 中国电子科技集团公司第二十八研究所 | One stares infrared degraded image adaptive restoration method |
| CN108765505A (en) * | 2018-04-28 | 2018-11-06 | 天津大学 | The coding of infrared imaging perceives matrix estimation method |
Non-Patent Citations (4)
| Title |
|---|
| 吴雪垠 等: ""逆滤波法在图像复原中的应用"", 《信息技术》 * |
| 李铁成: ""基于倾斜刃边法的遥感图像调制传递函数计算及图像复原技术研究"", 《中国博士学位论文全文数据库信息科技辑》 * |
| 胡涛 等: ""基于MTF的红外遥感图像复原"", 《光学与光电技术》 * |
| 郑筱晟 等: ""基于刀口法的视频内窥镜调制传递函数测量"", 《光学与光电技术》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101241173B (en) | Infrared stereoscopic vision thermal image method and its system | |
| CN101320138B (en) | Method and apparatus for simultaneously acquiring stereo and multi-spectral images | |
| Edeler et al. | Time-of-flight depth image denoising using prior noise information | |
| CN102982518A (en) | Fusion method of infrared image and visible light dynamic image and fusion device of infrared image and visible light dynamic image | |
| CN102981347A (en) | Automatic SUSAN focusing method for video monitoring system | |
| CN102607715B (en) | Thermomagnetic imaging method and device | |
| US11967096B2 (en) | Methods and apparatuses of depth estimation from focus information | |
| CN112634380A (en) | Multi-target color scattering imaging method for single-frame hyper-optical memory effect | |
| CN106375675B (en) | A kind of more exposure image fusion methods of aerial camera | |
| CN201278057Y (en) | Imaging device for simultaneously acquiring stereo and multispectral images | |
| CN105446056A (en) | Automatic focusing device and method | |
| CN109903244A (en) | A kind of real-time infrared image restored method | |
| CN103868680A (en) | Method for detecting foundation telescope out-of-focus aberration based on spot interference imaging | |
| Suszynski et al. | 2D image processing for auto-guiding system | |
| CN115761672A (en) | Detection method, detection system and detection device for dirt on vehicle camera | |
| CN109257524B (en) | Full-focus scanning imaging method based on Wigner distribution function | |
| Pan | Uniform full-information image matching using complex conjugate wavelet pyramids | |
| CN109274954B (en) | Foveola monocular stereoscopic imaging system | |
| CN113163112A (en) | Fusion focus control method and system | |
| Agrawal et al. | Digitization of biomimetic vision sensor based on the common housefly (Musca Domestica) | |
| CN101867705A (en) | Large-zoom ratio automatic focusing integrated camera | |
| Yang et al. | Research on computationally adaptive plenoptic imaging | |
| CN104122175A (en) | Imaging method for visualized photoelectric tracking of flocs | |
| CN110460756A (en) | A kind of scene removes rain image processing method and device automatically in real time | |
| EP1522961A2 (en) | Deconvolution of a digital image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190618 |
|
| WD01 | Invention patent application deemed withdrawn after publication |