CN103337058A - Image blind restoration method based on blurred noise image pair joint optimization - Google Patents

Image blind restoration method based on blurred noise image pair joint optimization Download PDF

Info

Publication number
CN103337058A
CN103337058A CN2013102852340A CN201310285234A CN103337058A CN 103337058 A CN103337058 A CN 103337058A CN 2013102852340 A CN2013102852340 A CN 2013102852340A CN 201310285234 A CN201310285234 A CN 201310285234A CN 103337058 A CN103337058 A CN 103337058A
Authority
CN
China
Prior art keywords
formula
image
solution
circletimes
blurred
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013102852340A
Other languages
Chinese (zh)
Other versions
CN103337058B (en
Inventor
李海森
张艳宁
张海超
孙瑾秋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northwestern Polytechnical University
Original Assignee
Northwestern Polytechnical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northwestern Polytechnical University filed Critical Northwestern Polytechnical University
Priority to CN201310285234.0A priority Critical patent/CN103337058B/en
Publication of CN103337058A publication Critical patent/CN103337058A/en
Application granted granted Critical
Publication of CN103337058B publication Critical patent/CN103337058B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)

Abstract

The invention discloses an image blind restoration method based on blurred noise image pair joint optimization, which is used for solving the technical problem that the available image blind restoration method is poor in image restoration effect. The method adopts the technical scheme that a noise image is introduced; effective edge information which is not blurred and contained in the noise image is utilized; a blurred kernel and a clear image are solved by joint objective function optimization of a joint blurred image and the noise image; the problems that the blurred kernel is misestimated and a restoration result is poor due to the fact that a non-blurred image edge is inaccurately estimated from the blurred image are solved; and the image with better effects and more details is obtained. The method improves the image restoration effect.

Description

Based on the method for blindly restoring image of fuzzy noise image to combined optimization
Technical field
The present invention relates to a kind of method for blindly restoring image, particularly relate to a kind of based on the method for blindly restoring image of fuzzy noise image to combined optimization.
Background technology
Document " based on the blind recovery of robust of the motion blur image of marginal information, photoelectron laser, 2011, Vol22 (10), p1982-1989 " discloses a kind ofly sane asks for fuzzy core and to the method for blindly restoring image of image deblurring from the single width blurred picture.This method is at first estimated the non-fuzzy image edge information by two-sided filter and shock wave wave filter, then, ask fuzzy core according to the relation of the edge between blurred picture and the non-fuzzy figure, at last, under multiple dimensioned framework, set auto-adaptive parameter at each subalgorithm, make up a sane method for blindly restoring image.The method has good recovery effect to fuzzy degraded image, has not only removed motion blur and noise effectively, and preserving edge details to a certain extent.The described method fuzzy core of document is found the solution the non-fuzzy image edge information that is based on estimation, because diversity and the complicacy of blurred picture, can cause the marginal information of blurred picture to be difficult to estimate, cause the fuzzy core misjudgment, simultaneously, because the pathosis of deconvolution problem, the fuzzy core of mistake can cause net result to produce ringing effect at strong edge, have a strong impact on final recovery result.
Summary of the invention
In order to overcome the deficiency of conventional images blind restoration method restored image weak effect, the invention provides a kind of based on the method for blindly restoring image of fuzzy noise image to combined optimization.This method comprises not fuzzy efficient frontier information by introducing noise image, utilizing in the noise image, find the solution fuzzy core and picture rich in detail by the joint objective function optimization of associating blurred picture and noise image.Avoided from blurred picture estimating the inaccurate of non-fuzzy image border and causing the fuzzy core misjudgment, caused the problem of difference as a result of restoring, obtained better effects if, have more the image of details.Can improve the effect of restored image.
The technical solution adopted for the present invention to solve the technical problems is: a kind of based on the method for blindly restoring image of fuzzy noise image to combined optimization, be characterized in may further comprise the steps:
Given blurred picture B and noise image N two width of cloth images, unite by target energy function shown in (1) formula and to find the solution picture rich in detail L and fuzzy core K:
{ K , L } = arg min K , L { γ | | B - K ⊗ L | | 2 2 + β | | N - L | | 2 2 + λ | | K | | 2 2 + η | | G ⊗ L | | α } - - - ( 1 )
In the formula, G is gradient extraction filter group,
Figure BDA00003470936700021
Be the two-dimensional convolution operation, γ, β, λ, η are the regularization coefficient, and α is that norm is selected parameter,
Figure BDA00003470936700022
For calculating The α norm.For finding the solution of (1) formula, at first, L is carried out initialization, make L=N, then, circulation is carried out following steps 1,2 up to the iterations T that iterates to setting.
1. fixed L is found the solution image blurring nuclear K.
The objective function of (1) formula is reduced to following formula at this moment:
K = arg min K { γ | | B - K ⊗ L | | 2 2 + λ | | K | | 2 2 } - - - ( 2 )
(2) formula is found the solution to accelerate to find the solution speed by conjugate gradient, and solution formula is converted into:
In the formula, F () and F -1() is respectively two dimension direct transform and the inverse transformation of Fu Li leaf transformation fast,
Figure BDA00003470936700026
Be the conjugation of F ().Be the dot product operation of matrix, I is unit matrix.Find the solution (3) formula, obtain current images fuzzy core K.
2. fixing K finds the solution restored image L.
The objective function of (1) formula is reduced to (4) formula at this moment:
L = arg min L { γ | | B - K ⊗ L | | 2 2 + β | | N - L | | 2 2 + η | | G ⊗ L | | α } - - - ( 4 )
In the formula, gradient filter group G is by C gradient filter [G 1, G 2..., G C] form, comprise the α norm in (4) formula, carry out approximate solution by the iteration weighted least mean square theory of error, its step is as follows:
Below the iterative 1), 2) two steps, up to the iterations M that iterates to setting.
1) calculates C weighting matrix, be respectively ω 1, ω 2..., ω c..., ω C, and the dimension of each weighting matrix is all identical with L, for c weighting matrix ω cIt asks method as follows:
ω i , j c = | ( G c ⊗ L ) i , j | a - 2 - - - ( 5 )
In the formula,
Figure BDA00003470936700029
Expression
Figure BDA000034709367000210
The i of matrix is capable after the convolution, the element of j row.
2) formula (4) is found the solution be approximately
(6) formula is that 2 norm constraint are found the solution problem, utilizes the conjugate gradient descending method to find the solution, and obtains the L that current iteration is asked.
The invention has the beneficial effects as follows: because this method comprises not fuzzy efficient frontier information by introducing noise image, utilizing in the noise image, find the solution fuzzy core and picture rich in detail by the joint objective function optimization of associating blurred picture and noise image.Avoided from blurred picture estimating the inaccurate of non-fuzzy image border and causing the fuzzy core misjudgment, caused the problem of difference as a result of restoring, obtained better effects if, have more the image of details.Improved the effect of restored image.
Below in conjunction with embodiment the present invention is elaborated.
Embodiment
It is as follows to the method for blindly restoring image concrete steps of combined optimization to the present invention is based on the fuzzy noise image:
Given blurred picture B and noise image N two width of cloth images, unite by target energy function shown in (1) formula and to find the solution picture rich in detail L and fuzzy core K:
{ K , L } = arg min K , L { γ | | B - K ⊗ L | | 2 2 + β | | N - L | | 2 2 + λ | | K | | 2 2 + η | | G ⊗ L | | α } - - - ( 1 )
In the formula, G is gradient extraction filter group, γ, and β, λ, η are the regularization coefficient, in the present embodiment, γ=0.1, β=1, λ=0.01, η=2000, α=0.5.α is that norm is selected parameter,
Figure BDA00003470936700032
For calculating
Figure BDA00003470936700033
The α norm.Mainly be by according to adopting alternately the method for iteration to find the solution for finding the solution of (1) formula.At first, L is carried out initialization, make L=N, then, circulation is carried out following steps 1,2 up to the iterations T=10 that iterates to setting.
1. fixed L is found the solution image blurring nuclear K.
The objective function of (1) formula can be reduced to following formula at this moment:
K = arg min K { γ | | B - K ⊗ L | | 2 2 + λ | | K | | 2 2 } - - - ( 2 )
(2) formula can find the solution to accelerate to find the solution speed by conjugate gradient, and solution formula can be converted into:
Figure BDA00003470936700035
In the following formula, F () and F -1() is respectively two dimension direct transform and the inverse transformation of Fu Li leaf transformation fast, Be the conjugation of F (), be the dot product operation of matrix, I is unit matrix.Find the solution (3) formula, just can obtain current images fuzzy core K.
2. fixing K finds the solution restored image L.
The objective function of (1) formula can be reduced to (4) formula at this moment:
L = arg min L { γ | | B - K ⊗ L | | 2 2 + β | | N - L | | 2 2 + η | | G ⊗ L | | α } - - - ( 4 )
Gradient filter group G in the following formula is by five gradient filter [G 1, G 2, G 3, G 4, 5G (] G 1=[1 ,-1], G 2=[1 ,-1] T, G 3=[1 ,-2,1], G 4=[1 ,-2,1] T, G 5=[1 ,-1;-1,1]) form, at this moment, C=5.(4) comprise the α norm in the formula, can carry out approximate solution by the iteration weighted least mean square theory of error, its step is as follows:
Below the iterative 1), 2) two steps, up to the iterations M=20 that iterates to setting.
1) calculates five weighting matrixs, be respectively ω 1, ω 2..., ω c..., ω 5, and the dimension of each weighting matrix is all identical with L, for c weighting matrix ω cIt asks method as follows:
ω i , j c = | ( G c ⊗ L ) i , j | a - 2 - - - ( 5 )
Wherein,
Figure BDA00003470936700042
Expression
Figure BDA00003470936700043
The i of matrix is capable after the convolution, the element of j row.
2) formula (4) is found the solution be approximately
Figure BDA00003470936700044
Following formula is that 2 norm constraint are found the solution problem, can utilize the conjugate gradient descending method to find the solution, and just can obtain the L that current iteration is asked.

Claims (1)

1. one kind based on the method for blindly restoring image of fuzzy noise image to combined optimization, it is characterized in that may further comprise the steps:
Given blurred picture B and noise image N two width of cloth images, unite by target energy function shown in (1) formula and to find the solution picture rich in detail L and fuzzy core K:
{ K , L } = arg min K , L { γ | | B - K ⊗ L | | 2 2 + β | | N - L | | 2 2 + λ | | K | | 2 2 + η | | G ⊗ L | | α } - - - ( 1 )
In the formula, G is gradient extraction filter group,
Figure FDA00003470936600012
Be the two-dimensional convolution operation, γ, β, λ, η are the regularization coefficient, and α is that norm is selected parameter,
Figure FDA00003470936600013
For calculating
Figure FDA00003470936600014
The α norm; For finding the solution of (1) formula, at first, L is carried out initialization, make L=N, then, circulation is carried out following steps 1,2 up to the iterations T that iterates to setting;
1. fixed L is found the solution image blurring nuclear K;
The objective function of (1) formula is reduced to following formula at this moment:
K = arg min K { γ | | B - K ⊗ L | | 2 2 + λ | | K | | 2 2 } - - - ( 2 )
(2) formula is found the solution to accelerate to find the solution speed by conjugate gradient, and solution formula is converted into:
Figure FDA00003470936600016
In the formula, F () and F -1() is respectively two dimension direct transform and the inverse transformation of Fu Li leaf transformation fast,
Figure FDA00003470936600017
Be the conjugation of F (), be the dot product operation of matrix, I is unit matrix; Find the solution (3) formula, obtain current images fuzzy core K;
2. fixing K finds the solution restored image L;
The objective function of (1) formula is reduced to (4) formula at this moment:
L = arg min L { γ | | B - K ⊗ L | | 2 2 + β | | N - L | | 2 2 + η | | G ⊗ L | | α } - - - ( 4 )
In the formula, gradient filter group G is by C gradient filter [G 1, G 2..., G C] form, comprise the α norm in (4) formula, carry out approximate solution by the iteration weighted least mean square theory of error, its step is as follows:
Below the iterative 1), 2) two steps, up to the iterations M that iterates to setting;
1) calculates C weighting matrix, be respectively ω 1, ω 2..., ω c..., ω C, and the dimension of each weighting matrix is all identical with L, for c weighting matrix ω cIt asks method as follows:
ω i , j c = | ( G c ⊗ L ) i , j | a - 2 - - - ( 5 )
In the formula,
Figure FDA000034709366000110
Expression
Figure FDA000034709366000111
The i of matrix is capable after the convolution, the element of j row;
2) formula (4) is found the solution be approximately
Figure FDA00003470936600021
(6) formula is that 2 norm constraint are found the solution problem, utilizes the conjugate gradient descending method to find the solution, and obtains the L that current iteration is asked.
CN201310285234.0A 2013-07-05 2013-07-05 Based on the method for blindly restoring image of fuzzy noise image to combined optimization Active CN103337058B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310285234.0A CN103337058B (en) 2013-07-05 2013-07-05 Based on the method for blindly restoring image of fuzzy noise image to combined optimization

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310285234.0A CN103337058B (en) 2013-07-05 2013-07-05 Based on the method for blindly restoring image of fuzzy noise image to combined optimization

Publications (2)

Publication Number Publication Date
CN103337058A true CN103337058A (en) 2013-10-02
CN103337058B CN103337058B (en) 2015-12-02

Family

ID=49245208

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310285234.0A Active CN103337058B (en) 2013-07-05 2013-07-05 Based on the method for blindly restoring image of fuzzy noise image to combined optimization

Country Status (1)

Country Link
CN (1) CN103337058B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104166961A (en) * 2014-07-28 2014-11-26 西安电子科技大学 Low-rank approximation fuzzy nucleus estimation method for image blind restoration
CN104599254A (en) * 2015-02-03 2015-05-06 中国人民解放军国防科学技术大学 Single lens computational imaging method based on combined fuzzy nuclear structure prior
CN105096261A (en) * 2014-05-13 2015-11-25 北京大学 Image processing device and image processing method
CN105513014A (en) * 2016-01-21 2016-04-20 集美大学 Method and system for reconstruction of multiframe image super resolution
CN105957043A (en) * 2016-06-22 2016-09-21 西北工业大学 Gradient automatic activation-based blurred image blind restoration method
CN106067165A (en) * 2016-05-31 2016-11-02 西北工业大学 High spectrum image denoising method based on clustering sparse random field
CN106251297A (en) * 2016-07-19 2016-12-21 四川大学 A kind of estimation based on multiple image fuzzy core the rebuilding blind super-resolution algorithm of improvement
CN107742278A (en) * 2017-10-25 2018-02-27 重庆邮电大学 With reference to L0The motion blur image blind restoration method of norm and space scale information
CN108648162A (en) * 2018-05-16 2018-10-12 浙江大学 A kind of gradient correlation TV factor graph picture denoising deblurring methods based on noise level
CN109903233A (en) * 2019-01-10 2019-06-18 华中科技大学 A kind of joint image recovery and matching process and system based on linear character
CN110473153A (en) * 2019-07-31 2019-11-19 西北工业大学 The method for blindly restoring image kept based on fuzzy kernel estimates iteration structure

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100246952A1 (en) * 2007-12-04 2010-09-30 Banner Ron Method and system for image restoration in the spatial domain
CN101930601A (en) * 2010-09-01 2010-12-29 浙江大学 Edge information-based multi-scale blurred image blind restoration method
US20120121202A1 (en) * 2010-11-12 2012-05-17 Jue Wang Methods and Apparatus for De-blurring Images Using Lucky Frames
CN102576454A (en) * 2009-10-16 2012-07-11 伊斯曼柯达公司 Image deblurring using a spatial image prior
CN102800053A (en) * 2012-06-18 2012-11-28 西北工业大学 Image deblurring method based on redundant dictionary pair joint optimization

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100246952A1 (en) * 2007-12-04 2010-09-30 Banner Ron Method and system for image restoration in the spatial domain
CN102576454A (en) * 2009-10-16 2012-07-11 伊斯曼柯达公司 Image deblurring using a spatial image prior
CN101930601A (en) * 2010-09-01 2010-12-29 浙江大学 Edge information-based multi-scale blurred image blind restoration method
US20120121202A1 (en) * 2010-11-12 2012-05-17 Jue Wang Methods and Apparatus for De-blurring Images Using Lucky Frames
CN102800053A (en) * 2012-06-18 2012-11-28 西北工业大学 Image deblurring method based on redundant dictionary pair joint optimization

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LU YUAN ET AL.: "Image Deblurring with Blurred/Noisy Image Pairs", 《ACM TRANSACTIONS ON GRAPHICS》 *
戴朝约: "针对运动模糊的图像复原方法研究", 《中国优秀硕士论文全文数据库信息科技辑》 *

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105096261A (en) * 2014-05-13 2015-11-25 北京大学 Image processing device and image processing method
CN105096261B (en) * 2014-05-13 2018-04-17 北京大学 Image processing apparatus and image processing method
CN104166961B (en) * 2014-07-28 2018-03-16 西安电子科技大学 The fuzzy core method of estimation that low-rank for blindly restoring image approaches
CN104166961A (en) * 2014-07-28 2014-11-26 西安电子科技大学 Low-rank approximation fuzzy nucleus estimation method for image blind restoration
CN104599254A (en) * 2015-02-03 2015-05-06 中国人民解放军国防科学技术大学 Single lens computational imaging method based on combined fuzzy nuclear structure prior
CN105513014B (en) * 2016-01-21 2019-02-01 集美大学 A kind of multi-frame image super-resolution reconstruction method and its reconstructing system
CN105513014A (en) * 2016-01-21 2016-04-20 集美大学 Method and system for reconstruction of multiframe image super resolution
CN106067165A (en) * 2016-05-31 2016-11-02 西北工业大学 High spectrum image denoising method based on clustering sparse random field
CN106067165B (en) * 2016-05-31 2018-11-30 西北工业大学 High spectrum image denoising method based on clustering sparse random field
CN105957043A (en) * 2016-06-22 2016-09-21 西北工业大学 Gradient automatic activation-based blurred image blind restoration method
CN106251297A (en) * 2016-07-19 2016-12-21 四川大学 A kind of estimation based on multiple image fuzzy core the rebuilding blind super-resolution algorithm of improvement
CN107742278A (en) * 2017-10-25 2018-02-27 重庆邮电大学 With reference to L0The motion blur image blind restoration method of norm and space scale information
CN107742278B (en) * 2017-10-25 2021-07-13 重庆邮电大学 Binding of L0Motion blurred image blind restoration method based on norm and spatial scale information
CN108648162A (en) * 2018-05-16 2018-10-12 浙江大学 A kind of gradient correlation TV factor graph picture denoising deblurring methods based on noise level
CN108648162B (en) * 2018-05-16 2021-07-09 浙江大学 Gradient-related TV factor image denoising and deblurring method based on noise level
CN109903233A (en) * 2019-01-10 2019-06-18 华中科技大学 A kind of joint image recovery and matching process and system based on linear character
CN110473153A (en) * 2019-07-31 2019-11-19 西北工业大学 The method for blindly restoring image kept based on fuzzy kernel estimates iteration structure
CN110473153B (en) * 2019-07-31 2022-04-26 西北工业大学 Image blind restoration method based on fuzzy kernel estimation iterative structure preservation

Also Published As

Publication number Publication date
CN103337058B (en) 2015-12-02

Similar Documents

Publication Publication Date Title
CN103337058B (en) Based on the method for blindly restoring image of fuzzy noise image to combined optimization
CN103337057B (en) Based on the motion blur image blind restoration method of multiple dimensioned self similarity
CN105493140B (en) Image deblurring method and system
Michaeli et al. Blind deblurring using internal patch recurrence
Arvanitopoulos et al. Single image reflection suppression
Han et al. Reflection removal using low-rank matrix completion
Guo et al. Robust separation of reflection from multiple images
CN101930601B (en) Edge information-based multi-scale blurred image blind restoration method
CN104134196B (en) Split Bregman weight iteration image blind restoration method based on non-convex higher-order total variation model
CN103761710B (en) The blind deblurring method of efficient image based on edge self-adaption
CN104103050B (en) A kind of real video restored method based on local policy
Pan et al. Deep blind video super-resolution
CN104599242B (en) Use the fuzzy core method of estimation of multiple dimensioned non local canonical
EP2775449B1 (en) Deblurring of an image from a sequence of images
Lee et al. High-quality non-blind image deconvolution with adaptive regularization
US20120155785A1 (en) Real-time video deblurring
CN103310430A (en) Method and apparatus for deblurring non-uniform motion blur
Pan et al. Motion blur kernel estimation via salient edges and low rank prior
CN103310486A (en) Reconstruction method of atmospheric turbulence degraded images
Harmeling et al. Online blind deconvolution for astronomical imaging
CN102750679B (en) Blind deblurring method for image quality evaluation
Liu et al. Lo-regularized hybrid gradient sparsity priors for robust single-image blind deblurring
CN104966277A (en) Image restoration method based on long and short exposure image pair
CN102800053B (en) Image deblurring method based on redundant dictionary pair joint optimization
CN101567079B (en) Method for restoring motion blurred image based on Hopfield neural network

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant