CN111489307B - Image PSF deconvolution method based on difference correction term - Google Patents

Image PSF deconvolution method based on difference correction term Download PDF

Info

Publication number
CN111489307B
CN111489307B CN202010253099.1A CN202010253099A CN111489307B CN 111489307 B CN111489307 B CN 111489307B CN 202010253099 A CN202010253099 A CN 202010253099A CN 111489307 B CN111489307 B CN 111489307B
Authority
CN
China
Prior art keywords
psf
image
correction term
result
iteration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010253099.1A
Other languages
Chinese (zh)
Other versions
CN111489307A (en
Inventor
王蕾
李国亮
康熙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Purple Mountain Observatory of CAS
Original Assignee
Purple Mountain Observatory of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Purple Mountain Observatory of CAS filed Critical Purple Mountain Observatory of CAS
Publication of CN111489307A publication Critical patent/CN111489307A/en
Application granted granted Critical
Publication of CN111489307B publication Critical patent/CN111489307B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses an image PSF deconvolution method based on a difference correction term, which is characterized by comprising the additive difference correction term, wherein the correction term is the correlation between the difference of the PSF on the convolution of an observation result and a current result and the PSF, or the transpose matrix of the PSF on the convolution of the observation result and the current result. The method (PSFdeDCT) is an improvement on a Lucy-Richardson algorithm PSFdeLR based on maximum likelihood estimation, and successfully avoids various defects of the PSFdeLR algorithm, including such as 1) the image pixel value cannot be negative, 2) ringing effect caused by image edge oscillation and the like, and in addition, the PSFdeDCT technology is not only suitable for the cypress distribution but also suitable for the non-cypress distribution image, and the speed is slightly faster than that of the existing PSFdeLR algorithm.

Description

Image PSF deconvolution method based on difference correction term
Technical Field
The invention relates to the technical field of image processing, in particular to an image PSF deconvolution method based on a difference correction term.
Background
In the field of Point Spread Function (PSF) deconvolution of images, a number of approaches have been developed: such as the Lucy-Richardson image PSF deconvolution technology based on maximum likelihood estimation and regularization means added on the basis of the technology, such as the Winner filter PSF deconvolution technology based on the least mean square error or least square method principle, and further such as the PSF deconvolution technology based on entropy maximization, etc. The Lucy-Richardson image PSF deconvolution technology (LR technology) based on maximum likelihood estimation has great development prospect in the days of more mature computer technology, and the main advantages include: 1) The cypress noise can be treated naturally, which is very suitable for some practical situations; 2) The calculation speed is faster. The main disadvantages are: 1) Where the pixel value is negative, the pixel value cannot be used, and in actual situations, the pixel value of the image tends to be negative after the background is subtracted; 2) Edge ringing is serious; 3) Since the formula of the LR technique is based on maximum likelihood estimation, obtained by assuming a cypress distribution, the technique is theoretically unsuitable for the case of non-cypress distribution.
Disclosure of Invention
Aiming at the problems existing in the prior art, the invention provides an image PSF deconvolution technology based on a difference correction term: PSFdeDCT can overcome the defects of the prior art and realize more effective image PSF deconvolution.
The technical scheme provided by the invention comprises the following two steps:
scheme one:
a method for deconvolution of an image PSF based on a difference correction term, characterized by the addition of the difference correction term, the correction term being a correlation of the difference in PSF over the convolution of the observed result with the current result and the PSF:
Figure BDA0002436201960000021
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,
Figure BDA0002436201960000022
is a convolution symbol and is a correlation symbol.
When i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y).
Scheme II:
an image PSF deconvolution method based on a difference correction term, characterized by the difference correction term with additivity, the correction term being a transpose matrix of a difference deconvolution PSF of a PSF on a convolution of an observation and a current result:
Figure BDA0002436201960000023
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,
Figure BDA0002436201960000024
is a convolution symbol, h (x, y) T Is the transposed matrix of h (x, y).
When i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y).
The beneficial effects are that:
the invention is based on the image PSF deconvolution method (PSFdeDCT) of the difference correction term, and does not need to bear the image divergence caused by the fact that the denominator tends to 0 or the pixel negative value, and the additive difference correction term has the balance effect of counteracting negative feedback, so that the image with negative value pixels and the non-cypress distribution image can be processed, the reconstruction effect on the image edge is much better than PSFdeLR, and the processing speed is also faster than PSFdeLR.
Drawings
FIG. 1, top right, is an elliptical Gaussian PSF with a ratio of the major to minor axes of 3:1, top left is a simulated image obtained by convolving Miss Lena real image (pixel range-67-233) of 511pixel in the top PSF, bottom left is the result of PSFdelr after 40 iterations, and bottom right is the result of PSFdeDCT after 40 iterations;
FIG. 2, top left is Miss Lena real image (pixel value range 33-333), top right is a simulated image obtained by convolving the real image with the PSF of the top right of FIG. 1, bottom left is the result of PSFdelR after 800 iterations, and bottom right is the result of PSFdeDCT after 800 iterations.
Detailed Description
In order to clarify the technical scheme and effect of the present invention, the present invention will be further described with reference to specific examples and effect comparison diagrams.
Scheme one:
the Lucy-Richardson method of deconvolution of PSF for a single image (Point spread function deconvolution based on Lucy-Richardson algorithm, PSFdelr) is derived from the derivation of the maximum likelihood estimate, with the iterative formula:
Figure BDA0002436201960000031
wherein (x, y) represents the pixel coordinate position, typically an integer, f i (x, y) is the result of the ith iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,
Figure BDA0002436201960000032
is a convolution symbol and is a correlation symbol.
It can be seen that the right end of the above iterative formula is a ratio correction term multiplied by the last iteration result, the correction term being multiplicative. The ratio correction term here is why the three drawbacks listed above are that a pixel close to 0 in the denominator in the correction term will cause the surrounding image to fluctuate drastically to diverge, as in fig. 1, and the edge effect of the image is also iteratively amplified (negative feedback) by the multiplicative correction term, causing ringing (ringing) phenomenon, as in fig. 2.
We make a change to LR iteration equation (1) above, obtaining the following equation:
Figure BDA0002436201960000033
wherein x, y represent the coordinate position of the pixel in the image, typically an integer, f i (x, y) is the result of the ith iteration, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,
Figure BDA0002436201960000041
is a convolution symbol and is a correlation symbol.
In the formula (2), i is an integer, the value is taken from 0, and when i is an initial value 0, the initial value f of iteration is taken 0 (x, y) is g (x, y). The observation image can be chosen as the initial value f of the iteration when we have no more information about the result 0 (x, y), f 0 (x, y) is carried into the formula (2) and calculated to obtain f 1 (x, y), the result of the first iteration, followed by a loop iteration operation using (2) until the desired result is reached.
In this wayThe right end of the iterative formula is a difference correction term plus the last iterative result f i The correction term is additive (x, y), which has the advantage that: there is no concern about image divergence caused by denominator tending to 0 or pixel negative values; the additive difference correction term has a balancing effect that counteracts the negative feedback.
Comparing equations (1) and (2) shows that the PSFdeDCT of the present invention has two more addition operations and one less division and one multiplication operation than the existing PSFdeLR, and thus the PSFdeDCT has a faster speed than the PSFdeLR.
Example 1:
we convolve a 3:1 ratio of major to minor elliptic gaussian PSF (fig. 1, top right) with a Miss Lena real image of size 511×511pixel (pixel range-67-233) to obtain a simulated observation image (fig. 1, top left), it being apparent that the observation image is blurred after convolving the PSF. Because the pixels have negative values, the psfderl has a strong oscillation after several iterations, and as the number of iterations increases, the oscillating pixels drive surrounding pixels to diverge, as shown in fig. 1, bottom left. However, PSFdeDCT well avoids this problem, the pixels in the image are trend converging, and the PSF deconvolution iteration proceeds smoothly, as in fig. 1, bottom right.
Example 2:
we add 100 to the pixel values of the Miss Lena real image of example 1 (FIG. 2, top left, pixel range adjusted to 33-333), then convolve with an elliptical Gaussian PSF with a 3:1 ratio of major to minor axes (FIG. 1, top right) to obtain a simulated observation image (FIG. 2, top right). In this case, the simulated observation image has no negative value, so that the psfderlr can work normally, but the ringing phenomenon of the image edge is serious, particularly along the main axis direction of the PSF, the oscillation is strongest, and after 800 iterations, the upper and lower edges lose half of information (fig. 2, lower left). While the deconvolution capability of the psfdec is excellent even at the edges, efficiently restoring the detail information at the edges (fig. 2, bottom right). After the same number of iterations at the non-edges, the psfderl is as effective as PSFdeDCT.
The method can develop corresponding PSFdeDCT software based on the C language, and the software can carry out PSF deconvolution according to the input observation image, PSF and the iteration times required by a user, and output the deconvoluted image with the same size.
Scheme II:
unlike the first scheme, the additive difference correction term in the first scheme is a transpose matrix of a difference deconvolution PSF of a PSF on convolution of an observation result and a current result, and the specific formula is as follows:
Figure BDA0002436201960000051
wherein, x and y represent pixel coordinate positions, the value is an integer, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,
Figure BDA0002436201960000052
is a convolution symbol, h (x, y) T Representing the transposed matrix of the PSF.
When i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y).
Experiments prove that compared with the PSFdelr in the prior art, the scheme has excellent image processing capability.
The foregoing has shown and described the basic principles, principal features and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the foregoing embodiments, which have been described in the foregoing embodiments and description merely illustrates the principles of the invention, and various changes and modifications may be made therein without departing from the spirit and scope of the invention, the scope of which is defined in the appended claims, specification and their equivalents.

Claims (2)

1. A method for deconvolution of an image PSF based on a difference correction term, characterized by the addition of the difference correction term, the correction term being a correlation of the difference in PSF over the convolution of the observed result with the current result and the PSF:
Figure FDA0004160444710000011
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,
Figure FDA0004160444710000012
is a convolution symbol, is a correlation symbol;
when i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y);
and performing PSF deconvolution according to the input observation image, PSF and the iteration number required by the user, and outputting deconvoluted images with the same size.
2. An image PSF deconvolution method based on a difference correction term, characterized by the difference correction term with additivity, the correction term being a transpose matrix of a difference deconvolution PSF of a PSF on a convolution of an observation and a current result:
Figure FDA0004160444710000013
wherein x, y represent pixel coordinate positions, f i (x, y) is the result of the ith iteration, i is an integer, f i+1 (x, y), i.e., the result of the (i+1) th iteration, g (x, y) is the observed image, h (x, y) is the point spread function PSF,
Figure FDA0004160444710000014
is a convolution symbol, h (x, y) T Is the transposed matrix of h (x, y);
when i is an initial value of 0, an initial value f of the iteration 0 (x, y) is g (x, y);
and performing PSF deconvolution according to the input observation image, PSF and the iteration number required by the user, and outputting deconvoluted images with the same size.
CN202010253099.1A 2019-12-25 2020-04-02 Image PSF deconvolution method based on difference correction term Active CN111489307B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2019113586288 2019-12-25
CN201911358628 2019-12-25

Publications (2)

Publication Number Publication Date
CN111489307A CN111489307A (en) 2020-08-04
CN111489307B true CN111489307B (en) 2023-07-14

Family

ID=71812630

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010253099.1A Active CN111489307B (en) 2019-12-25 2020-04-02 Image PSF deconvolution method based on difference correction term

Country Status (1)

Country Link
CN (1) CN111489307B (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5213896B2 (en) * 2010-03-03 2013-06-19 日本電信電話株式会社 Image processing method, image processing apparatus, and program
US9589328B2 (en) * 2012-11-09 2017-03-07 Nikon Corporation Globally dominant point spread function estimation
CN108198151B (en) * 2018-02-06 2022-02-11 东南大学 Star map deblurring method based on improved RL deconvolution algorithm
CN109741252A (en) * 2018-12-06 2019-05-10 王蕾 The PSF deconvolution of multiple exposure image and the anti aliasing technology III:PSFdeFiSA of undersampled image
CN109741251A (en) * 2018-12-06 2019-05-10 王蕾 The PSF deconvolution of multiple exposure image and the anti aliasing technology II:LSPDAA of undersampled image
CN109785231A (en) * 2018-12-06 2019-05-21 王蕾 The PSF deconvolution of multiple exposure image and the anti aliasing technology I:PSFdeLRSA of undersampled image

Also Published As

Publication number Publication date
CN111489307A (en) 2020-08-04

Similar Documents

Publication Publication Date Title
Xu et al. Multi-channel weighted nuclear norm minimization for real color image denoising
Kotera et al. Blind deconvolution using alternating maximum a posteriori estimation with heavy-tailed priors
EP2291999B1 (en) Image deconvolution using color priors
Zhang et al. Adaptive bilateral filter for sharpness enhancement and noise removal
Elad On the origin of the bilateral filter and ways to improve it
CN109872288B (en) Network training method, device, terminal and storage medium for image denoising
US20030128888A1 (en) Nonlinear edge-enhancement filter
Li et al. A joint estimation approach for two-tone image deblurring by blind deconvolution
Abe et al. Iterative Edge-Preserving adaptive Wiener filter for image denoising
Schuon et al. Comparison of motion de-blur algorithms and real world deployment
Yap et al. A recursive soft-decision approach to blind image deconvolution
US9202265B2 (en) Point spread function cost function with non-uniform weights
CN111489307B (en) Image PSF deconvolution method based on difference correction term
Amini et al. Outlier-aware dictionary learning for sparse representation
Chen et al. Efficient discrete spatial techniques for blur support identification in blind image deconvolution
Dong et al. On the convergence of bilateral filter for edge-preserving image smoothing
Ding et al. Image deblurring using a pyramid-based Richardson-Lucy algorithm
US7720303B2 (en) Polynomial approximation based image filter methods, systems, and machine-readable media
Kawasaki et al. Parallelized and vectorized implementation of DCT denoising with FMA instructions
JP2015041200A (en) Image processor, image forming apparatus, and program
US20060222258A1 (en) Image restoration with gain control and shoot suppression
Wang et al. Efficient image deblurring via blockwise non-blind deconvolution algorithm
Shi Determination of bilateral filter coefficients based on particle swarm optimization
Wang et al. A new method for motion-blurred image blind restoration based on huber Markov random field
Vural et al. Blind deconvolution of noisy blurred images via dispersion minimization

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 210023 No. 10, Yuanhua Road, Qixia District, Nanjing, Jiangsu Province

Applicant after: PURPLE MOUNTAIN OBSERVATORY, CHINESE ACADEMY OF SCIENCES

Address before: 210008 No. 2 West Beijing Road, Gulou District, Jiangsu, Nanjing

Applicant before: PURPLE MOUNTAIN OBSERVATORY, CHINESE ACADEMY OF SCIENCES

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant