CN111489307B - Image PSF deconvolution method based on difference correction term - Google Patents
Image PSF deconvolution method based on difference correction term Download PDFInfo
- Publication number
- CN111489307B CN111489307B CN202010253099.1A CN202010253099A CN111489307B CN 111489307 B CN111489307 B CN 111489307B CN 202010253099 A CN202010253099 A CN 202010253099A CN 111489307 B CN111489307 B CN 111489307B
- Authority
- CN
- China
- Prior art keywords
- psf
- image
- correction term
- result
- iteration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012937 correction Methods 0.000 title claims abstract description 30
- 238000000034 method Methods 0.000 title claims abstract description 15
- 239000011159 matrix material Substances 0.000 claims abstract description 7
- 230000000694 effects Effects 0.000 abstract description 7
- 241000218691 Cupressaceae Species 0.000 abstract description 6
- 238000007476 Maximum Likelihood Methods 0.000 abstract description 5
- 239000000654 additive Substances 0.000 abstract description 5
- 230000000996 additive effect Effects 0.000 abstract description 5
- 238000004422 calculation algorithm Methods 0.000 abstract description 4
- 230000010355 oscillation Effects 0.000 abstract description 3
- 230000007547 defect Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention discloses an image PSF deconvolution method based on a difference correction term, which is characterized by comprising the additive difference correction term, wherein the correction term is the correlation between the difference of the PSF on the convolution of an observation result and a current result and the PSF, or the transpose matrix of the PSF on the convolution of the observation result and the current result. The method (PSFdeDCT) is an improvement on a Lucy-Richardson algorithm PSFdeLR based on maximum likelihood estimation, and successfully avoids various defects of the PSFdeLR algorithm, including such as 1) the image pixel value cannot be negative, 2) ringing effect caused by image edge oscillation and the like, and in addition, the PSFdeDCT technology is not only suitable for the cypress distribution but also suitable for the non-cypress distribution image, and the speed is slightly faster than that of the existing PSFdeLR algorithm.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to an image PSF deconvolution method based on a difference correction term.
Background
In the field of Point Spread Function (PSF) deconvolution of images, a number of approaches have been developed: such as the Lucy-Richardson image PSF deconvolution technology based on maximum likelihood estimation and regularization means added on the basis of the technology, such as the Winner filter PSF deconvolution technology based on the least mean square error or least square method principle, and further such as the PSF deconvolution technology based on entropy maximization, etc. The Lucy-Richardson image PSF deconvolution technology (LR technology) based on maximum likelihood estimation has great development prospect in the days of more mature computer technology, and the main advantages include: 1) The cypress noise can be treated naturally, which is very suitable for some practical situations; 2) The calculation speed is faster. The main disadvantages are: 1) Where the pixel value is negative, the pixel value cannot be used, and in actual situations, the pixel value of the image tends to be negative after the background is subtracted; 2) Edge ringing is serious; 3) Since the formula of the LR technique is based on maximum likelihood estimation, obtained by assuming a cypress distribution, the technique is theoretically unsuitable for the case of non-cypress distribution.
Disclosure of Invention
Aiming at the problems existing in the prior art, the invention provides an image PSF deconvolution technology based on a difference correction term: PSFdeDCT can overcome the defects of the prior art and realize more effective image PSF deconvolution.
The technical scheme provided by the invention comprises the following two steps:
scheme one:
a method for deconvolution of an image PSF based on a difference correction term, characterized by the addition of the difference correction term, the correction term being a correlation of the difference in PSF over the convolution of the observed result with the current result and the PSF:
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,is a convolution symbol and is a correlation symbol.
When i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y).
Scheme II:
an image PSF deconvolution method based on a difference correction term, characterized by the difference correction term with additivity, the correction term being a transpose matrix of a difference deconvolution PSF of a PSF on a convolution of an observation and a current result:
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,is a convolution symbol, h (x, y) T Is the transposed matrix of h (x, y).
When i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y).
The beneficial effects are that:
the invention is based on the image PSF deconvolution method (PSFdeDCT) of the difference correction term, and does not need to bear the image divergence caused by the fact that the denominator tends to 0 or the pixel negative value, and the additive difference correction term has the balance effect of counteracting negative feedback, so that the image with negative value pixels and the non-cypress distribution image can be processed, the reconstruction effect on the image edge is much better than PSFdeLR, and the processing speed is also faster than PSFdeLR.
Drawings
FIG. 1, top right, is an elliptical Gaussian PSF with a ratio of the major to minor axes of 3:1, top left is a simulated image obtained by convolving Miss Lena real image (pixel range-67-233) of 511pixel in the top PSF, bottom left is the result of PSFdelr after 40 iterations, and bottom right is the result of PSFdeDCT after 40 iterations;
FIG. 2, top left is Miss Lena real image (pixel value range 33-333), top right is a simulated image obtained by convolving the real image with the PSF of the top right of FIG. 1, bottom left is the result of PSFdelR after 800 iterations, and bottom right is the result of PSFdeDCT after 800 iterations.
Detailed Description
In order to clarify the technical scheme and effect of the present invention, the present invention will be further described with reference to specific examples and effect comparison diagrams.
Scheme one:
the Lucy-Richardson method of deconvolution of PSF for a single image (Point spread function deconvolution based on Lucy-Richardson algorithm, PSFdelr) is derived from the derivation of the maximum likelihood estimate, with the iterative formula:
wherein (x, y) represents the pixel coordinate position, typically an integer, f i (x, y) is the result of the ith iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,is a convolution symbol and is a correlation symbol.
It can be seen that the right end of the above iterative formula is a ratio correction term multiplied by the last iteration result, the correction term being multiplicative. The ratio correction term here is why the three drawbacks listed above are that a pixel close to 0 in the denominator in the correction term will cause the surrounding image to fluctuate drastically to diverge, as in fig. 1, and the edge effect of the image is also iteratively amplified (negative feedback) by the multiplicative correction term, causing ringing (ringing) phenomenon, as in fig. 2.
We make a change to LR iteration equation (1) above, obtaining the following equation:
wherein x, y represent the coordinate position of the pixel in the image, typically an integer, f i (x, y) is the result of the ith iteration, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,is a convolution symbol and is a correlation symbol.
In the formula (2), i is an integer, the value is taken from 0, and when i is an initial value 0, the initial value f of iteration is taken 0 (x, y) is g (x, y). The observation image can be chosen as the initial value f of the iteration when we have no more information about the result 0 (x, y), f 0 (x, y) is carried into the formula (2) and calculated to obtain f 1 (x, y), the result of the first iteration, followed by a loop iteration operation using (2) until the desired result is reached.
In this wayThe right end of the iterative formula is a difference correction term plus the last iterative result f i The correction term is additive (x, y), which has the advantage that: there is no concern about image divergence caused by denominator tending to 0 or pixel negative values; the additive difference correction term has a balancing effect that counteracts the negative feedback.
Comparing equations (1) and (2) shows that the PSFdeDCT of the present invention has two more addition operations and one less division and one multiplication operation than the existing PSFdeLR, and thus the PSFdeDCT has a faster speed than the PSFdeLR.
Example 1:
we convolve a 3:1 ratio of major to minor elliptic gaussian PSF (fig. 1, top right) with a Miss Lena real image of size 511×511pixel (pixel range-67-233) to obtain a simulated observation image (fig. 1, top left), it being apparent that the observation image is blurred after convolving the PSF. Because the pixels have negative values, the psfderl has a strong oscillation after several iterations, and as the number of iterations increases, the oscillating pixels drive surrounding pixels to diverge, as shown in fig. 1, bottom left. However, PSFdeDCT well avoids this problem, the pixels in the image are trend converging, and the PSF deconvolution iteration proceeds smoothly, as in fig. 1, bottom right.
Example 2:
we add 100 to the pixel values of the Miss Lena real image of example 1 (FIG. 2, top left, pixel range adjusted to 33-333), then convolve with an elliptical Gaussian PSF with a 3:1 ratio of major to minor axes (FIG. 1, top right) to obtain a simulated observation image (FIG. 2, top right). In this case, the simulated observation image has no negative value, so that the psfderlr can work normally, but the ringing phenomenon of the image edge is serious, particularly along the main axis direction of the PSF, the oscillation is strongest, and after 800 iterations, the upper and lower edges lose half of information (fig. 2, lower left). While the deconvolution capability of the psfdec is excellent even at the edges, efficiently restoring the detail information at the edges (fig. 2, bottom right). After the same number of iterations at the non-edges, the psfderl is as effective as PSFdeDCT.
The method can develop corresponding PSFdeDCT software based on the C language, and the software can carry out PSF deconvolution according to the input observation image, PSF and the iteration times required by a user, and output the deconvoluted image with the same size.
Scheme II:
unlike the first scheme, the additive difference correction term in the first scheme is a transpose matrix of a difference deconvolution PSF of a PSF on convolution of an observation result and a current result, and the specific formula is as follows:
wherein, x and y represent pixel coordinate positions, the value is an integer, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,is a convolution symbol, h (x, y) T Representing the transposed matrix of the PSF.
When i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y).
Experiments prove that compared with the PSFdelr in the prior art, the scheme has excellent image processing capability.
The foregoing has shown and described the basic principles, principal features and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the foregoing embodiments, which have been described in the foregoing embodiments and description merely illustrates the principles of the invention, and various changes and modifications may be made therein without departing from the spirit and scope of the invention, the scope of which is defined in the appended claims, specification and their equivalents.
Claims (2)
1. A method for deconvolution of an image PSF based on a difference correction term, characterized by the addition of the difference correction term, the correction term being a correlation of the difference in PSF over the convolution of the observed result with the current result and the PSF:
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,is a convolution symbol, is a correlation symbol;
when i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y);
and performing PSF deconvolution according to the input observation image, PSF and the iteration number required by the user, and outputting deconvoluted images with the same size.
2. An image PSF deconvolution method based on a difference correction term, characterized by the difference correction term with additivity, the correction term being a transpose matrix of a difference deconvolution PSF of a PSF on a convolution of an observation and a current result:
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,is a convolution symbol, h (x, y) T Is the transposed matrix of h (x, y);
when i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y);
and performing PSF deconvolution according to the input observation image, PSF and the iteration number required by the user, and outputting deconvoluted images with the same size.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2019113586288 | 2019-12-25 | ||
CN201911358628 | 2019-12-25 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111489307A CN111489307A (en) | 2020-08-04 |
CN111489307B true CN111489307B (en) | 2023-07-14 |
Family
ID=71812630
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010253099.1A Active CN111489307B (en) | 2019-12-25 | 2020-04-02 | Image PSF deconvolution method based on difference correction term |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111489307B (en) |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5213896B2 (en) * | 2010-03-03 | 2013-06-19 | 日本電信電話株式会社 | Image processing method, image processing apparatus, and program |
US9589328B2 (en) * | 2012-11-09 | 2017-03-07 | Nikon Corporation | Globally dominant point spread function estimation |
CN108198151B (en) * | 2018-02-06 | 2022-02-11 | 东南大学 | Star map deblurring method based on improved RL deconvolution algorithm |
CN109741252A (en) * | 2018-12-06 | 2019-05-10 | 王蕾 | The PSF deconvolution of multiple exposure image and the anti aliasing technology III:PSFdeFiSA of undersampled image |
CN109741251A (en) * | 2018-12-06 | 2019-05-10 | 王蕾 | The PSF deconvolution of multiple exposure image and the anti aliasing technology II:LSPDAA of undersampled image |
CN109785231A (en) * | 2018-12-06 | 2019-05-21 | 王蕾 | The PSF deconvolution of multiple exposure image and the anti aliasing technology I:PSFdeLRSA of undersampled image |
-
2020
- 2020-04-02 CN CN202010253099.1A patent/CN111489307B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN111489307A (en) | 2020-08-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Xu et al. | Multi-channel weighted nuclear norm minimization for real color image denoising | |
Kotera et al. | Blind deconvolution using alternating maximum a posteriori estimation with heavy-tailed priors | |
EP2291999B1 (en) | Image deconvolution using color priors | |
Zhang et al. | Adaptive bilateral filter for sharpness enhancement and noise removal | |
Elad | On the origin of the bilateral filter and ways to improve it | |
CN109872288B (en) | Network training method, device, terminal and storage medium for image denoising | |
US20030128888A1 (en) | Nonlinear edge-enhancement filter | |
Li et al. | A joint estimation approach for two-tone image deblurring by blind deconvolution | |
Abe et al. | Iterative Edge-Preserving adaptive Wiener filter for image denoising | |
Schuon et al. | Comparison of motion de-blur algorithms and real world deployment | |
Yap et al. | A recursive soft-decision approach to blind image deconvolution | |
US9202265B2 (en) | Point spread function cost function with non-uniform weights | |
CN111489307B (en) | Image PSF deconvolution method based on difference correction term | |
Amini et al. | Outlier-aware dictionary learning for sparse representation | |
Chen et al. | Efficient discrete spatial techniques for blur support identification in blind image deconvolution | |
Dong et al. | On the convergence of bilateral filter for edge-preserving image smoothing | |
Ding et al. | Image deblurring using a pyramid-based Richardson-Lucy algorithm | |
US7720303B2 (en) | Polynomial approximation based image filter methods, systems, and machine-readable media | |
Kawasaki et al. | Parallelized and vectorized implementation of DCT denoising with FMA instructions | |
JP2015041200A (en) | Image processor, image forming apparatus, and program | |
US20060222258A1 (en) | Image restoration with gain control and shoot suppression | |
Wang et al. | Efficient image deblurring via blockwise non-blind deconvolution algorithm | |
Shi | Determination of bilateral filter coefficients based on particle swarm optimization | |
Wang et al. | A new method for motion-blurred image blind restoration based on huber Markov random field | |
Vural et al. | Blind deconvolution of noisy blurred images via dispersion minimization |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 210023 No. 10, Yuanhua Road, Qixia District, Nanjing, Jiangsu Province Applicant after: PURPLE MOUNTAIN OBSERVATORY, CHINESE ACADEMY OF SCIENCES Address before: 210008 No. 2 West Beijing Road, Gulou District, Jiangsu, Nanjing Applicant before: PURPLE MOUNTAIN OBSERVATORY, CHINESE ACADEMY OF SCIENCES |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant |