CN112435181A - Method for filtering vertical stripe noise of uncooled infrared video image - Google Patents
Method for filtering vertical stripe noise of uncooled infrared video image Download PDFInfo
- Publication number
- CN112435181A CN112435181A CN202011265013.3A CN202011265013A CN112435181A CN 112435181 A CN112435181 A CN 112435181A CN 202011265013 A CN202011265013 A CN 202011265013A CN 112435181 A CN112435181 A CN 112435181A
- Authority
- CN
- China
- Prior art keywords
- image
- vertical stripe
- stripe noise
- filtering
- new
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000001914 filtration Methods 0.000 title claims abstract description 50
- 238000000034 method Methods 0.000 title claims abstract description 18
- 238000001228 spectrum Methods 0.000 claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 23
- 238000003379 elimination reaction Methods 0.000 claims abstract description 6
- 230000000737 periodic effect Effects 0.000 claims description 8
- 230000003044 adaptive effect Effects 0.000 claims description 2
- 230000001131 transforming effect Effects 0.000 claims 1
- 230000007547 defect Effects 0.000 abstract description 5
- 230000008030 elimination Effects 0.000 abstract description 4
- 238000003384 imaging method Methods 0.000 abstract description 4
- 238000013461 design Methods 0.000 abstract description 3
- 238000003672 processing method Methods 0.000 abstract description 3
- 230000009466 transformation Effects 0.000 abstract description 3
- 238000005457 optimization Methods 0.000 abstract description 2
- 238000001514 detection method Methods 0.000 description 4
- 238000012937 correction Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005057 refrigeration Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/10—Image enhancement or restoration using non-spatial domain filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration using local operators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
- G06T2207/20032—Median filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a method for filtering vertical stripe noise of an uncooled infrared video image, which mainly comprises a vertical stripe noise judgment step and a vertical stripe noise filtering step, namely, average relative error is calculated by taking polynomial fitting data as a reference, so that vertical stripe noise judgment is carried out, a new amplitude spectrum is obtained by carrying out band elimination filtering processing on an amplitude spectrum value corresponding to vertical stripe noise, two-dimensional Fourier inverse transformation is carried out on the new amplitude spectrum and a phase spectrum to obtain a new image, transverse one-dimensional self-adaptive median filtering processing is carried out on the new image, and then mean filtering and histogram equalization processing are carried out on the image after median filtering to obtain a de-noised image. The invention can eliminate the vertical stripe noise defect in the traditional detector, does not need to carry out circuit optimization and detector replacement, and reduces the cost of the detector and hardware and the design difficulty. The image processing method can accurately and efficiently remove the vertical stripe noise of the image and improve the imaging quality of the infrared video.
Description
Technical Field
The invention relates to a method for filtering vertical stripe noise of an uncooled infrared video image, and belongs to the technical field of high-sensitivity infrared imaging processing.
Background
With the rapid development of computer technology and video graphic image technology, the infrared video processing technology is widely applied to video monitoring systems in the military field, wherein the application cost of a non-refrigeration infrared detector is greatly reduced because no extra environment temperature control equipment is needed, and the application environment is wider compared with a refrigeration type detector.
Due to the hardware design of the uncooled detector and the defects of the detector, non-uniformity correction and two-point correction are required to be carried out on the pixel signal output by the detector. Under the high and low temperature state, because the response characteristics of all detection elements in the detector focal plane array are not completely consistent, different detection photosensitive elements can generate different output signals for the same infrared radiation, so that vertical stripe-shaped non-uniform noise can appear in an infrared image, and the imaging effect of the infrared detector is seriously influenced. Conventional non-uniformity correction algorithms cannot remove this noise. Conventional denoising algorithms such as median filtering, mean filtering, and histogram matching are all processed based on a two-dimensional image space domain, and these conventional infrared image denoising processing methods do not pay attention to a noise generation mechanism, but simply consider and calculate the noise, which results in removing a large amount of image detail information while removing the noise.
Disclosure of Invention
The invention aims to solve the defects of the prior art, and provides a method for filtering the vertical stripe noise of the uncooled infrared video image, aiming at the problems that the image details are lost due to the defect of traditional denoising and the like.
In order to achieve the purpose, the invention provides a method for filtering the vertical stripe noise of the uncooled infrared video image.
Specifically, an infrared video image is transformed into a frequency domain image and a phase image through two-dimensional Fourier transform, the characteristics of vertical stripes of the image are analyzed, and noise is positioned and filtered in the frequency domain image to obtain a new frequency domain image; carrying out two-dimensional inverse Fourier transform on the new frequency domain image and the new phase image so as to obtain a new image; and finally, performing transverse one-dimensional median filtering on the new image to filter most of vertical stripe noise in the image.
The invention provides a method for filtering infrared image vertical stripe noise, which comprises two steps, one is judgment of vertical stripe noise, and the other is filtering of vertical stripe noise, and the method is described in detail as follows:
the judgment of the periodic vertical stripe noise in the image is mainly carried out by calculating the average relative error of image data, and the specific judgment steps are as follows:
randomly extracting n rows of data in the original video image, wherein n is less than the total number of rows of the image;
respectively carrying out polynomial curve fitting on each row of data;
respectively calculating the relative error delta of each line of data in the n lines of data by taking the polynomial fitting data as a reference;
calculating the average relative error of the n rows of data as a whole
When the relative error is averaged
When the image is in the normal state, the non-periodic vertical stripes in the image are explained, and the processing process of the noise of the vertical stripes is skipped;
when the relative error is averaged
In the case of a moving picture, it is described that a periodic vertical streak noise exists in the image, and the next processing is required.
The filtering of the image vertical stripe noise is mainly realized by carrying out Fourier frequency domain conversion on the image,
the effect of filtering the vertical stripe noise is achieved by analyzing and processing the frequency domain data, and the specific steps are as follows:
performing two-dimensional fast Fourier transform (FFT2) on the original image, and respectively extracting a phase spectrum and a magnitude spectrum of the image, wherein the magnitude spectrum reflects texture information of the image, so that the subsequent processing is mainly performed on the magnitude spectrum;
performing band elimination filtering processing on an amplitude spectrum value corresponding to the vertical stripe noise through an average relative error value delta in the image periodic vertical stripe noise judgment module to obtain a new amplitude spectrum;
performing two-dimensional Fourier inverse transformation by using the new magnitude spectrum and the new phase spectrum to obtain a new image;
carrying out transverse one-dimensional self-adaptive median filtering processing on the new image;
and carrying out mean value filtering and histogram equalization on the image subjected to median filtering to obtain an image with vertical stripe noise removed, and well retaining the detail information of the image.
The invention has the following beneficial effects:
1. the vertical stripe noise defect in the traditional detector can be eliminated, circuit optimization and detector replacement are not needed, and the cost and the design difficulty of the detector and hardware are reduced.
2. The image processing method can accurately and efficiently remove the vertical stripe noise of the image and improve the imaging quality of the infrared video.
Drawings
Fig. 1 is a schematic flow chart of a method for filtering vertical stripe noise of an uncooled infrared video image according to the present invention.
Fig. 2 is a diagram of an array of original image landscape in an embodiment of the present invention.
FIG. 3 is a graph of a polynomial fit to sets of discrete points across an original image according to an embodiment of the present invention.
Fig. 4 is an amplitude spectrum of an original image in an embodiment of the present invention.
Fig. 5 is a phase spectrum of an original image in an embodiment of the present invention.
FIG. 6 is a graph of fitting discrete points of the transverse array to a polynomial after noise removal in an embodiment of the present invention.
Fig. 7 is a comparison of an original image (a) and a denoised image (b) according to an embodiment of the invention.
Detailed Description
The invention provides a method for filtering vertical stripe noise of an uncooled infrared video image. The technical solution of the present invention is described in detail below with reference to the accompanying drawings so that it can be more easily understood and appreciated.
The method aims at the filtering method of the vertical stripe noise of the uncooled infrared video image, the infrared video image is transformed into a frequency domain image and a phase image through two-dimensional Fourier transform, the characteristics of the vertical stripe of the image are analyzed, and the noise is positioned and filtered in the frequency domain image to obtain a new frequency domain image; carrying out two-dimensional inverse Fourier transform on the new frequency domain graph and the phase graph to obtain a new image; and then performing transverse one-dimensional median filtering on the new image.
Particularly comprises a step of judging vertical stripe noise and a step of filtering the vertical stripe noise,
the step of judging the vertical stripe noise comprises the following steps:
extracting n rows of data transversely and randomly in the infrared video image, wherein n is smaller than the total number of rows of the image, respectively carrying out polynomial curve fitting on each row of data, respectively calculating the relative error of each row of data in the n rows of data by taking polynomial fitting data as a reference, and calculating the average relative error of the whole n rows of data
When the relative error is averaged
Judging the vertical stripe noise without periodicity in the image, averaging the relative error
And judging that the periodic vertical stripe noise exists in the image.
The step of filtering the vertical stripe noise comprises the following steps: .
Performing two-dimensional fast Fourier transform on the infrared video image, respectively extracting the phase spectrum and the amplitude spectrum of the image, and judging the average relative error in the step by vertical stripe noise
Carrying out band-elimination filtering processing on the amplitude spectrum value corresponding to the vertical stripe noise to obtain a new amplitude spectrum; and performing two-dimensional Fourier inverse transformation on the new amplitude spectrum and the phase spectrum to obtain a new image, performing transverse one-dimensional adaptive median filtering on the new image, and performing mean filtering and histogram equalization on the image subjected to median filtering.
In a specific embodiment, as shown in fig. 1, the flow of the whole algorithm may be divided into two parts, namely, a vertical stripe noise detection part of the image and a vertical stripe noise filtering part.
The following describes the two parts in turn in further detail according to the sequence of the processing flow.
Detection of vertical stripe noise in images
And (3) randomly and transversely extracting N rows of data (N < M) from the original image Img (M multiplied by N, M rows and N columns), and putting the data into N one-dimensional arrays (1 multiplied by N) respectively.
Polynomial fitting is performed on N discrete data in the one-dimensional array (1 × N) to obtain corresponding fitting curves as shown in fig. 2 and 3, and similar calculations are performed on N sets of data, respectively.
In the one-dimensional array, the fitted data is used as a reference, relative error values delta in the array are calculated, and n groups are respectively calculated similarly to obtain corresponding relative error values: delta1+δ2+…+δn。
Calculating average relative error values of n arrays
If the relative error is averaged
The image has no obvious vertical stripe noise, and the filtering processing of the vertical stripe noise is not needed;
if the relative error is averaged
Indicating that the image has more obvious vertical stripe noise and the second part of de-stripe noise processing is needed.
Image vertical stripe noise filtering
As shown in fig. 4 to 6, the original image Img is subjected to a two-dimensional discrete fast fourier transform (FFT 2):
F_Img＝DFT(Img)。
by utilizing the periodic characteristic of the frequency spectrum, half of the output frequency spectrum image F _ Img is translated to the other end, and the operation is respectively carried out once on the upper side, the lower side, the left side and the right side, so that the zero frequency is moved to the middle of the image.
The magnitude spectrum (Fabs) and the phase spectrum (Fangle) of the image are calculated from the spectrum image F _ Img, respectively.
Through the average relative error value calculated by the first step part, the radius value of the amplitude spectrum for band elimination filtering processing can be set:
and (4) performing band elimination filtering processing on the amplitude spectrum by taking the origin of the central point positions at the left end and the right end of the amplitude spectrum Fabs and R as the radius to obtain a new amplitude spectrum Fabs _ new.
And performing two-dimensional discrete inverse Fourier transform on the phase spectrum Fangle and the new amplitude spectrum Fabs _ new to obtain a synthesized image Img _ out.
And performing transverse self-adaptive median filtering processing on the image Img _ out, then performing mean filtering of 3x3, and finally performing histogram equalization processing to obtain the image subjected to denoising processing.
Through the two parts of processing, the vertical stripe noise of the infrared video image can be basically eliminated, and the loss of image detail information is reduced as much as possible. As shown in fig. 7, (a) is an infrared video image with severe vertical stripe noise, and (b) is a processed video image. Therefore, the vertical stripe noise filtering method provided by the invention can effectively eliminate the vertical stripe noise in the image and improve the imaging quality of the infrared video.
The technical solutions of the present invention are fully described above, it should be noted that the specific embodiments of the present invention are not limited by the above description, and all technical solutions formed by equivalent or equivalent changes in structure, method, or function according to the spirit of the present invention by those skilled in the art are within the scope of the present invention.
Claims (2)
1. The method for filtering the vertical stripe noise of the uncooled infrared video image is characterized by comprising the following steps of:
transforming the infrared video image into a frequency domain image and a phase image through two-dimensional Fourier transform, analyzing the characteristics of vertical stripes of the image, and positioning and filtering noise in the frequency domain image to obtain a new frequency domain image;
carrying out two-dimensional inverse Fourier transform on the new frequency domain graph and the phase graph to obtain a new image; and then performing transverse one-dimensional median filtering on the new image.
2. The method for filtering the vertical stripe noise of the uncooled infrared video image according to claim 1, wherein:
comprises a vertical stripe noise judging step and a vertical stripe noise filtering step,
the step of judging the vertical stripe noise comprises the following steps:
randomly extracting n rows of data in the infrared video image transversely, wherein n is less than the total number of rows of the image,
polynomial curve fitting is respectively carried out on each row of data,
respectively calculating the relative error delta of each line of the n lines of data by taking polynomial fitting data as a reference,
calculating the average relative error of the n rows of data as a whole
When the relative error is averaged
Judging the non-periodic vertical stripe noise in the image,
when the relative error is averaged
Judging that periodic vertical stripe noise exists in the image;
the step of filtering the vertical stripe noise comprises the following steps: .
Performing two-dimensional fast Fourier transform on the infrared video image, respectively extracting a phase spectrum and a magnitude spectrum of the image,
determining the average relative error in the step by vertical streak noise
Carrying out band-elimination filtering processing on the amplitude spectrum value corresponding to the vertical stripe noise to obtain a new amplitude spectrum;
the new magnitude spectrum and the phase spectrum are used for carrying out two-dimensional inverse Fourier transform to obtain a new image,
the new image is subjected to a transversal one-dimensional adaptive median filtering process,
and carrying out mean value filtering and histogram equalization processing on the image subjected to median filtering.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011265013.3A CN112435181A (en) | 2020-11-12 | 2020-11-12 | Method for filtering vertical stripe noise of uncooled infrared video image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011265013.3A CN112435181A (en) | 2020-11-12 | 2020-11-12 | Method for filtering vertical stripe noise of uncooled infrared video image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112435181A true CN112435181A (en) | 2021-03-02 |
Family
ID=74701064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011265013.3A Withdrawn CN112435181A (en) | 2020-11-12 | 2020-11-12 | Method for filtering vertical stripe noise of uncooled infrared video image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112435181A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113610733A (en) * | 2021-08-10 | 2021-11-05 | 国网浙江省电力有限公司电力科学研究院 | Image processing method and device |
| CN116659414A (en) * | 2023-07-21 | 2023-08-29 | 南京信息工程大学 | Structure light demodulation method based on improved HiIbert transformation |
| CN117830141A (en) * | 2024-03-04 | 2024-04-05 | 奥谱天成(成都)信息科技有限公司 | Method, medium, equipment and device for removing vertical stripe noise of infrared image |
-
2020
- 2020-11-12 CN CN202011265013.3A patent/CN112435181A/en not_active Withdrawn
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113610733A (en) * | 2021-08-10 | 2021-11-05 | 国网浙江省电力有限公司电力科学研究院 | Image processing method and device |
| CN113610733B (en) * | 2021-08-10 | 2024-04-05 | 国网浙江省电力有限公司电力科学研究院 | Image processing method and device |
| CN116659414A (en) * | 2023-07-21 | 2023-08-29 | 南京信息工程大学 | Structure light demodulation method based on improved HiIbert transformation |
| CN116659414B (en) * | 2023-07-21 | 2023-10-13 | 南京信息工程大学 | Structure light demodulation method based on improved HiIbert transformation |
| CN117830141A (en) * | 2024-03-04 | 2024-04-05 | 奥谱天成(成都)信息科技有限公司 | Method, medium, equipment and device for removing vertical stripe noise of infrared image |
| CN117830141B (en) * | 2024-03-04 | 2024-05-03 | 奥谱天成(成都)信息科技有限公司 | Method, medium, equipment and device for removing vertical stripe noise of infrared image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112435181A (en) | Method for filtering vertical stripe noise of uncooled infrared video image | |
| US7627193B2 (en) | Camera with image enhancement functions | |
| JP5983373B2 (en) | Image processing apparatus, information processing method, and program | |
| JP4824101B2 (en) | Method and apparatus for detecting and correcting tilted image data | |
| CN108230249B (en) | Anisotropic-based L1 norm total variation regularization non-uniformity correction method | |
| WO2007113799A2 (en) | Digital filtering with noise gain limit | |
| CN111968047A (en) | Adaptive optical image blind restoration method based on generating type countermeasure network | |
| CN105894477A (en) | Astronomical image noise removal method | |
| CN112435178B (en) | FPGA-based linear array infrared blind pixel engineering processing method and system | |
| CN105005967A (en) | Method and apparatus for correcting non-uniformity of infrared imaging based on combined space-time filtering | |
| CN116433535A (en) | Point coordinate de-distortion method, system and storage medium for quadratic curve fitting | |
| CN115965552B (en) | Frequency-space-time domain joint denoising and recovering system for low signal-to-noise ratio image sequence | |
| CN116612032A (en) | Sonar image denoising method and device based on self-adaptive wiener filtering and 2D-VMD | |
| CN114372938A (en) | Image self-adaptive restoration method based on calibration | |
| CN114820376A (en) | Fusion correction method and device for stripe noise, electronic equipment and storage medium | |
| Schöberl et al. | Sparsity-based defect pixel compensation for arbitrary camera raw images | |
| Liu et al. | Automatic segment-wise restoration for wide irregular stripe noise in SDGSAT-1 multispectral data using side-slither data | |
| Abang et al. | Application of blind deconvolution and Lucy-Richardson Deconvolution for image deblurring | |
| CN113822823B (en) | Point neighbor restoration method and system for aerodynamic optical effect image space-variant fuzzy core | |
| EP1672912B1 (en) | Method for producing an optical system including an electronic image enhancement processor | |
| CN112488919B (en) | Lorentz fitting fuzzy kernel image super-resolution reconstruction method | |
| Yang et al. | A new infrared turbulent fuzzy image restoration algorithm based on Gaussian function parameter identification | |
| Ren et al. | Stripe noise removal method for MODIS remote sensing imagery | |
| Lin et al. | An iterative enhanced super-resolution system with edge-dominated interpolation and adaptive enhancements | |
| CN117314791B (en) | Infrared image cold reflection noise correction method based on Butterworth function fitting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210302 |