CN103093436A - Blurring kernel multi-scale iteration estimation method using directional derivative of image local structure - Google Patents

Blurring kernel multi-scale iteration estimation method using directional derivative of image local structure Download PDF

Info

Publication number
CN103093436A
CN103093436A CN2013100336319A CN201310033631A CN103093436A CN 103093436 A CN103093436 A CN 103093436A CN 2013100336319 A CN2013100336319 A CN 2013100336319A CN 201310033631 A CN201310033631 A CN 201310033631A CN 103093436 A CN103093436 A CN 103093436A
Authority
CN
China
Prior art keywords
yardstick
iteration
image
fuzzy core
scale
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013100336319A
Other languages
Chinese (zh)
Other versions
CN103093436B (en
Inventor
王凯
肖亮
韦志辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Science and Technology
Original Assignee
Nanjing University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Science and Technology filed Critical Nanjing University of Science and Technology
Priority to CN201310033631.9A priority Critical patent/CN103093436B/en
Publication of CN103093436A publication Critical patent/CN103093436A/en
Application granted granted Critical
Publication of CN103093436B publication Critical patent/CN103093436B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a blurring kernel multi-scale iteration estimation method using a directional derivative of an image local structure. The blurring kernel multi-scale iteration estimation method comprises inter-scale updating, intra-scale iteration estimation and inter-scale iteration termination judgment. A blurring kernel and a recovering image are estimated from coarse scale iteration to fine scale iteration. The intra-scale iteration estimation comprises the following steps: calculating an enhanced type direction gradient filed of a current scale; estimating a blurring kernel of the current scale rapidly; calculating a directional derivative approximate spectrum of a current image; and recovering an image of the current scale. Gradient information of image jumping edges is utilized, with a quick Fourier transform technology based on, the blurring kernel is quickly estimated in a small time complexity, and the blurring kernel multi-scale iteration estimation method can be used for conducting blind deblurring on various actual blurring images.

Description

Utilize the multiple dimensioned iterative estimate method of fuzzy core of Local Structure of Image directional derivative
Technical field
The invention belongs to the computer digital image process field, particularly a kind of multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative.
Background technology
Camera shake is a problem that is always perplexing the cameraman, and unsettled camera can cause the fuzzy of photo.Particularly present popular HIGH RESOLUTION digital camera, make them be difficult in use stably hold because fuselage weight is light.What many photographs were caught is some the of short duration precious moments that can't reappear, if at this moment wait, camera shake has occured, and these precious moments just lose fully so.Therefore, be devoted to seek the method for removing camera shake from the single width photograph and just seem particularly important.
Image deblurring mainly can be divided into two large classes: the non-blind deblurring of image and Image Blind deblurring.The non-blind deblurring of image refers to ask under the known fuzzy core condition that causes image degradation the process of original picture rich in detail, and the method for problems is more skillful; Iff known degraded image, and in the situation of fuzzy core the unknown, this class image deblurring problem is called the Image Blind deblurring.The estimation technique of fuzzy core is in fact vital part in Image Blind deblurring technology, namely how to estimate the fuzzy core that causes original image to degenerate from only degraded image, obtain just can utilizing the algorithm of the non-blind deblurring of some maturations to recover original image after fuzzy core.Because utilizable priori is fewer, make the Image Blind deblurring very difficult, therefore blind deblurring is more challenging, also more has practicality simultaneously.
Traditional fuzzy core method of estimation supposes that normally fuzzy core has certain special parametric form, and the shake path of camera Parameter Expression simply in reality.Therefore, fuzzy core for curve shape, the people such as Rob Fergus propose the variational Bayesian method based on the distribution of natural image gradient, referring to article " Removing Camera Shake from a Single Photograph ", 2006, ACM Transactions on Graphics, vol.25, pp.787-794.This methods analyst the gradient of image statistically obey heavy-tailed distribution, and mix with Gauss's yardstick match is carried out in this distribution, first estimate fuzzy core, the classical Lucy-Richardson method of recycling is carried out the non-blind deblurring of image, and the method has been introduced the framework of multiple dimensioned iterative estimate fuzzy core simultaneously.Yet this method is also not accurate enough to the estimation of fuzzy core, causes final deblurring result to have a lot of ringing effects.Afterwards, the people such as Sunghyun Cho had proposed the method based on the fuzzy edge sharpening, referring to article " Fast Motion Deblurring ", and 2009, ACM Transactions on Graphics, vol.28, pp.145:1-145:8.This method is utilized the marginal information of blurred picture, fuzzy edge is carried out impact filtering, more alternately iterative estimate fuzzy core and restored image, the method can be fast and ambiguous estimation core preferably, if but for the more image of texture, this method is unsatisfactory to the recovery effects of image.
Summary of the invention
The object of the invention is to provide a kind of multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative, with ambiguous estimation core more accurately, remove ringing effect, and algorithm takes full advantage of fast Fourier transform techniques, make deblurring can access quick realization.
The technical solution that realizes the object of the invention is: a kind of multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative, comprise iteration system initialization procedure and multiple dimensioned iterative estimate process, and step is as follows:
1.1 described iteration system initialization procedure is:
(1) the blurred picture y of input one width M to be recovered * N size, the initialization fuzzy core k of thick yardstick 0, treat the support set size h of ambiguous estimation core 1* h 2, blurred picture y down-sampling is obtained multiple dimensioned blurred picture sequence { y 1, y 2, L, y S, calculate the out to out number
Figure BDA00002788913800021
Wherein: M, N is line number and the columns of presentation video respectively, h 1, h 2The line number and the columns that represent respectively fuzzy core support set, max (h 1, h 2) expression h 1And h 2In maximal value, Int () is rounding operation, log 10The expression denary logarithm;
(2) need initialized iteration system parameter to comprise: maximum iteration time N in yardstick maxConstant compensating parameter β, difference operator contribution parameters γ, image difference operator contribution parameters α;
(3) calculated level direction difference operator D 1Fourier transform F (the D of=[1 ,-1] 1) and vertical direction difference operator D 2=[1 ,-1] TFourier transform F (D 2);
1.2 described multiple dimensioned iterative process comprise between yardstick upgrade, iteration stops judgement between the iterative estimate in yardstick and yardstick:
1.2.1 upgrade between yardstick, yardstick is s, 1≤s≤S:
(1) utilize blind restored image x under the s-1 yardstick s-1With the fuzzy core k that estimates s-1, they are carried out respectively up-sampling, the initial pictures under current yardstick s is updated to Initial fuzzy core under current yardstick s is updated to
Figure BDA00002788913800031
During for yardstick s=1, the primary iteration solution of image is
Figure BDA00002788913800032
The primary iteration solution of fuzzy core is
Figure BDA00002788913800033
Wherein: the operation of symbol " ↑ " expression up-sampling;
(2) calculate y sStructure tensor, and then obtain position (i, j) perpendicular to the normalization proper vector of partial structurtes direction
Figure BDA000027889138000324
Calculate simultaneously y sNormal gradients vector field (u s, v s), node-by-node algorithm y thus sDirection gradient vector, its normal component
Figure BDA00002788913800034
And tangential component ( ▿ a y s ) i , j = ( - υ s , μ s ) i , j · ( u s , v s ) i , j T ;
(3) calculate blurred picture y under current yardstick s sFrequency spectrum F (y s), and y sThe frequency spectrum of direction gradient vector field
Figure BDA00002788913800036
1.2.2 the estimation of yardstick inner iteration, n is iterations, 1≤n≤N max:
Step 1 generates the enhancement mode direction gradient vector field of iterative image, the image that the n-1 time iteration obtained
Figure BDA00002788913800037
Utilize Meyer cartoon-texture decomposition method to obtain the cartoon composition, and carry out impact filtering, obtain edge enhanced images
Figure BDA00002788913800038
By calculating The structure tensor node-by-node algorithm
Figure BDA000027889138000310
Normal component
Figure BDA000027889138000311
And tangential component The direction gradient vector field that obtains the n time iterative image is
Figure BDA000027889138000313
Step 2, iterative image direction gradient vector field is calculated in the quick estimation of current yardstick fuzzy core the n time Frequency spectrum
Figure BDA000027889138000315
Then obtain the fuzzy core of the n time iteration in frequency domain
Step 3, the approximate frequency spectrum of calculated direction derivative, according to
Figure BDA000027889138000317
Calculate the method directional derivative of the n time iteration and cut the approximate frequency spectrum of directional derivative
Step 4, the Fast Restoration of current scalogram picture, fuzzy core in calculation procedure 2
Figure BDA000027889138000319
Frequency spectrum
Figure BDA000027889138000320
Then try to achieve a rough estimate of the n time iteration restored image
Step 5, the yardstick inner iteration stops judgement: if n 〉=N max, go to iteration termination judgement between yardstick, and will As the final fuzzy core of estimating of current yardstick,
Figure BDA000027889138000323
As the blind restored image of current yardstick, inner iteration count n is set to 1; Otherwise upgrade inner iteration count n=n+1, and go to step 1;
1.2.3 between yardstick, iteration stops judgement: if s 〉=S, between yardstick, iteration stops, and will
Figure BDA00002788913800041
As final fuzzy core,
Figure BDA00002788913800042
As final restored image; Otherwise upgrade yardstick iteration count s=s+1, go between yardstick and upgrade.
The present invention compared with prior art, its remarkable advantage: (1) can realize the accurate estimation of fuzzy core.Compare with solution in the past, the inventive method is by utilizing gradient fields information accurately, can effectively suppress the noise in estimated fuzzy core, make fuzzy core more accurate, on vision, the continuity of fuzzy core curve is stronger, thus the ringing effect that the error that minimizing is estimated because of fuzzy core causes.(2) utilize fast Fourier transform techniques, thereby made computation complexity greatly reduce.The inventive method is at road vehicles monitoring, and digital photograph is processed, and the aspects such as recovery of medical science and astronomic graph picture all have wide practical use, and also provides new thinking for image super-resolution simultaneously.
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Description of drawings
Fig. 1 is the process flow diagram of inventive method Global Iterative Schemes structure.
Fig. 2 is iterative estimate unit step 1 data flow diagram in yardstick.
Fig. 3 is iterative estimate unit step 2 data flow diagram in yardstick.
Fig. 4 is the iterative estimate unit step 3 and step 4 data flow diagram in yardstick.
Fig. 5 is Woman picture rich in detail, the first fuzzy core and the blurred picture thereof that emulation experiment of the present invention is used.
Fig. 6 is Vase picture rich in detail, the second fuzzy core and the blurred picture thereof that emulation experiment of the present invention is used.
Fig. 7 is that the present invention is to the blind deblurring result of Fig. 5 (c) and the fuzzy core of estimation.
Fig. 8 is that the present invention is to the blind deblurring result of Fig. 6 (c) and the fuzzy core of estimation.
Fig. 9 is the actual blurred picture fishes that the present invention uses.
Figure 10 is that the present invention is to the deblurring result of Fig. 9 and the fuzzy core of estimation.
Figure 11 is that existing method based on the fuzzy edge sharpening is to the deblurring result of Fig. 9 and the fuzzy core of estimation.
Figure 12 is that the existing method that distributes based on the natural image gradient is to the deblurring result of Fig. 9 and the fuzzy core of estimation.
Embodiment
The present invention utilizes the multiple dimensioned iterative estimate method of the fuzzy core of Local Structure of Image directional derivative, take picture breakdown, partial structurtes directional derivative as the basis, by multiple dimensioned direction gradient vector field, mode predictive fuzzy core and the restored image to replace of finding the solution iteratively, reach the purpose that fuzzy core is estimated.The present invention utilizes picture breakdown that the blind restored image in iterative process is decomposed into cartoon part and texture part, obtain the direction gradient field of cartoon part after impact filtering, the gradient fields that utilization obtains is detailed predicting fuzzy core and restored image alternately, and iteration obtains final fuzzy core after stopping.
As shown in Figure 1, the present invention utilizes the multiple dimensioned iterative estimate method of the fuzzy core of Local Structure of Image directional derivative, comprises iteration system initialization procedure and multiple dimensioned iterative estimate process.
1, described iteration system initialization procedure comprises 3 parts:
(1) the blurred picture y of input one width M to be recovered * N size, the initialization fuzzy core k of thick yardstick 0, treat the support set size h of ambiguous estimation core 1* h 2, blurred picture y down-sampling is obtained multiple dimensioned blurred picture sequence { y 1, y 2, L, y S, calculate the out to out number
Figure BDA00002788913800051
Wherein: M, N is line number and the columns of presentation video respectively, h 1, h 2The line number and the columns that represent respectively fuzzy core support set, max (h 1, h 2) expression h 1And h 2In maximal value, Int () is rounding operation, log 10The expression denary logarithm.
(2) iteration system parameter initialization needs initialized iteration system parameter to comprise: maximum iteration time N in yardstick maxConstant compensating parameter β, difference operator contribution parameters γ, image difference operator contribution parameters α.Following initial parameter value is set: maximum iteration time N in yardstick max∈ [6, L, 10]; Constant compensating parameter β ∈ [5,10], difference operator contribution parameters γ=2 β; Image difference operator contribution parameters α ∈ [0.1,0.3];
(3) calculated level direction difference operator D 1Fourier transform F (the D of=[1 ,-1] 1) and vertical direction difference operator D 2=[1 ,-1] TFourier transform F (D 2).
2, described multiple dimensioned iterative process comprise between yardstick upgrade, iteration stops judgement between the iterative estimate in yardstick and yardstick:
2.1 upgrade between yardstick (yardstick is s, 1≤s≤S):
(1) utilize blind restored image x under the s-1 yardstick s-1With the fuzzy core k that estimates s-1, they are carried out respectively up-sampling, the initial pictures under current yardstick s is updated to
Figure BDA00002788913800061
Initial fuzzy core under current yardstick s is updated to
Figure BDA00002788913800062
(the primary iteration solution of image is during for yardstick s=1
Figure BDA00002788913800063
The primary iteration solution of fuzzy core is
Figure BDA00002788913800064
Wherein: the operation of symbol " ↑ " expression up-sampling.
(2) calculate y sStructure tensor, and then obtain position (i, j) perpendicular to the normalization proper vector of partial structurtes direction
Figure BDA000027889138000617
Calculate simultaneously y sNormal gradients vector field (u s, v s), direction gradient vector that thus can node-by-node algorithm ys, its normal component
Figure BDA00002788913800065
And tangential component ( ▿ a y s ) i , j = ( - υ s , μ s ) i , j · ( u s , v s ) i , j T .
In the present invention the computing method of structure tensor are referring to the people's such as Stefan Roth paper " Steerable Random Fields ", 2007, ICCV, and parameter arranges same the method.
(3) calculate blurred picture y under current yardstick s sFrequency spectrum F (y s), and y sThe frequency spectrum of direction gradient vector field
2.2 the yardstick inner iteration estimates that (the n time iteration, n is iterations, 1≤n≤N max):
Step 1: the enhancement mode direction gradient vector field that generates iterative image.The detailed process of this step is as follows as shown in Figure 2, the image that the n-1 time iteration obtained
Figure BDA00002788913800068
Utilize Meyer cartoon-texture decomposition method to obtain the cartoon composition, and carry out impact filtering (shock filter), obtain edge enhanced images
Figure BDA00002788913800069
By calculating
Figure BDA000027889138000610
The structure tensor node-by-node algorithm Normal component
Figure BDA000027889138000612
And tangential component
Figure BDA000027889138000613
The direction gradient vector field that obtains the n time iterative image is
Figure BDA000027889138000614
What use in this step of the present invention is a kind of rapid image decomposition method, " the Fast Cartoon+Texture Image Filters " that delivers referring to people such as Antoni Buades, 2010, IEEE Transactions on Image Processing, 19 (8): 1978-1986, parameter arranges same the method.
Step 2: the quick estimation of current yardstick fuzzy core.The detailed process of this step is as follows as shown in Figure 3, calculates iterative image direction gradient vector field the n time
Figure BDA000027889138000615
Frequency spectrum
Figure BDA00002788913800071
Then obtain the fuzzy core of the n time iteration in frequency domain
Figure BDA00002788913800072
Namely
Calculate iterative image direction gradient vector field the n time
Figure BDA00002788913800073
Frequency spectrum
Figure BDA00002788913800074
Figure BDA00002788913800075
Then ambiguous estimation core in frequency domain, can be found the solution by following relational expression and obtain:
k s ( n ) = Shrink ( F - 1 ( F * ( ▿ o S s ( n ) ) oF ( ▿ o y s ) + F * ( ▿ a S s ( n ) ) oF ( ▿ a y s ) F * ( ▿ o S s ( n ) ) oF ( ▿ o S s ( n ) ) + F * ( ▿ a S s ( n ) ) oF ( ▿ a S s ( n ) ) + γ ( F * ( D 1 ) oF ( D 1 ) + F * ( D 2 ) oF ( D 2 ) ) + β ) ) - - - ( 1 )
Wherein: β is that constant compensating parameter, γ are the difference operator contribution parameters, F *The complex conjugate of () expression F (), F -1() expression inverse fourier transform, the pointwise of " o " representing matrix element is multiplied each other, and fraction represents that between two matrixes of molecule denominator, the element pointwise is divided by, shrinkage operation operator Shrink ()=max (, 0.01), s is yardstick.
Step 3: the approximate frequency spectrum of calculated direction derivative.The detailed process of this step is as follows as shown in the part of Fig. 4, according to
Figure BDA00002788913800077
Calculate the method directional derivative of the n time iteration and cut the approximate frequency spectrum of directional derivative
Figure BDA00002788913800078
Namely
According to
Figure BDA00002788913800079
The computation structure tensor, and then obtain the normalization proper vector that position (i, j) is orthogonal to the partial structurtes direction
Figure BDA000027889138000710
Thus can be according to relational expression (2) and (3) the current method directional derivative of node-by-node algorithm and cut the approximate frequency spectrum of directional derivative respectively,
F ( Do s ( n ) ) = μ ^ s ( n - 1 ) oF ( D 1 ) + v ^ s ( n - 1 ) oF ( D 2 ) - - - ( 2 )
F ( Da s ( n ) ) = - v ^ s ( n - 1 ) oF ( D 1 ) + μ ^ s ( n - 1 ) oF ( D 2 ) - - - ( 3 )
Wherein: the pointwise of " o " representing matrix element is multiplied each other.
Step 4: the Fast Restoration of current scalogram picture.The detailed process of this step is as follows as shown in the part of Fig. 4, fuzzy core in calculation procedure 2
Figure BDA000027889138000713
Frequency spectrum
Figure BDA000027889138000714
Then try to achieve a rough estimate of the n time iteration restored image
Figure BDA000027889138000715
Namely
Fuzzy core in calculation procedure 2
Figure BDA000027889138000716
Frequency spectrum
Figure BDA000027889138000717
Then tried to achieve a rough estimate of restored image by following relational expression:
x s ( n ) = F - 1 ( F * ( k s ( n ) ) oF ( y s ) o ( 1 + 0.5 F * ( Do s ( n ) ) + 0.5 F * ( Da s ( n ) ) oF ( Da s ( n ) ) ) F * ( k s ( n ) ) oF ( k s ( n ) ) o ( 1 + 0.5 F * ( Do s ( n ) ) oF ( Do s ( n ) ) + 0.5 F * ( Da s ( n ) ) oF ( Da s ( n ) ) ) + α ( F * ( D 1 ) oF ( D 1 ) + F * ( D 2 ) oF ( D 2 ) ) ) - - - ( 4 )
Wherein: α is image difference operator contribution parameters, F *The complex conjugate of () expression F (), F -1() expression inverse fourier transform, the pointwise of " o " representing matrix element is multiplied each other, and fraction represents that between two matrixes of molecule denominator, the element pointwise is divided by, and s is yardstick.
Step 5: the yardstick inner iteration stops judgement.If n 〉=N max, go to iteration termination judgement between yardstick, and will
Figure BDA00002788913800082
As the final fuzzy core of estimating of current yardstick,
Figure BDA00002788913800083
As the blind restored image of current yardstick, inner iteration count n is set to 1; Otherwise upgrade inner iteration count n=n+1, and go to step 1.
2.3 iteration termination judgement between yardstick (yardstick s, 1≤s≤S):
If s 〉=S, between yardstick, iteration stops, and will
Figure BDA00002788913800084
As final fuzzy core,
Figure BDA00002788913800085
As final restored image; Otherwise upgrade yardstick iteration count s=s+1, go between yardstick and upgrade.
To shown in Figure 12, come specifically technique effect and the practicality of bright the inventive method by two experiments below in conjunction with Fig. 5.
1, experiment condition:
Testing computing environment used is Intel i3-2100CPU 3.1GHz, in save as 4GB1333MHz, programming platform is Matlab R2011a.Test image used and derive from Berkeley Segmentation Benchmark, network address is http://www.eecs.berkeley.edu/Research/Projects/CS/vision/bsds/, the image size is 321 * 481, and natural image fishes, and size is 858 * 558.
2, experiment content:
This experiment specifically is divided into two son experiments: the corresponding respectively simulated experiment that provides in emulation fuzzy core situation, and the True Data experiment that only provides the actual blurred picture that obtains.
Experiment one:
1. to Women image shown in Fig. 5 (a), use the first fuzzy core shown in Fig. 5 (b) to simulate, the fuzzy core size is 19 * 19, obtain the blurred picture as shown in Fig. 5 (c), with the inventive method, blurred picture is carried out core and estimate and deblurring, the fuzzy core that obtains estimating and restoration result such as Fig. 7.
2. to Vase image shown in Fig. 6 (a), use the first fuzzy core shown in Fig. 6 (b) to simulate, the fuzzy core size is 19 * 19, obtain the blurred picture as shown in Fig. 6 (c), with the inventive method, blurred picture is carried out core and estimate and deblurring, the fuzzy core that obtains estimating and restoration result such as Fig. 8.
Experiment two:
To fishes image shown in Figure 9 respectively with the inventive method, existing based on the method for fuzzy edge sharpening with carry out blind deblurring based on the method that the natural image gradient distributes, result such as Figure 10-Figure 12 wherein estimate and deblurring result such as Figure 10 with the image blurring core of fishes that the present invention obtains; Estimate and deblurring result such as Figure 11 with the existing image blurring core of fishes that obtains based on the method for fuzzy edge sharpening; Estimate and deblurring result such as Figure 12 with the image blurring core of fishes that the existing method that distributes based on the natural image gradient obtains.
Can see that from Fig. 7 and Fig. 8 core estimated result that the present invention obtains can keep the continuity of fuzzy core effectively, quite approaching with original real fuzzy core contrast in Fig. 5 (b) and Fig. 6 (b), the result of deblurring is clear undistorted, ringing effect is also less, and fine edge and the details that has kept image proved absolutely validity of the present invention.
For the true blurred picture that directly obtains from reality, from Figure 10 (a) as seen, deblurring result of the present invention meets vision requirement more, and the details of image is comparatively clear, and the edge has also obtained keeping preferably; From Figure 10 (b) as seen, fuzzy core estimated result of the present invention is also more reasonable, and its continuity is fine, and almost noiseless exists.
From Figure 11 (a) as seen, although based on the effective marginal information of Recovery image of the result of the method deblurring of fuzzy edge sharpening, image detail is too level and smooth, and certain distortion phenomenon is arranged; From Figure 11 (b) as seen, the estimated result of the method fuzzy core has more noise, and continuity is also good not.
From Figure 12 (a) as seen, the result of the method deblurring that distributes based on the natural image gradient is clear not, and it is good not that details keeps; From Figure 12 (b) as seen, there is certain noise in the estimated result of the method fuzzy core, and continuity is equally also good not.
In sum, no matter synthesize simulated experiment or True Data experiment, the inventive method has all obtained effect preferably, the result that core is estimated is very accurate, the edge as a result of deblurring and details keep significantly having good application prospect and value, and practicality is also very strong.

Claims (5)

1. the multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative, is characterized in that comprising iteration system initialization procedure and multiple dimensioned iterative estimate process, and step is as follows:
1.1 described iteration system initialization procedure is:
(1) the blurred picture y of input one width M to be recovered * N size, the initialization fuzzy core k of thick yardstick 0, treat the support set size h of ambiguous estimation core 1* h 2, blurred picture y down-sampling is obtained multiple dimensioned blurred picture sequence { y 1, y 2, L, y S, calculate the out to out number
Figure FDA00002788913700011
Wherein: M, N is line number and the columns of presentation video respectively, h 1, h 2The line number and the columns that represent respectively fuzzy core support set, max (h 1, h 2) expression h 1And h 2In maximal value, Int () is rounding operation, log 10The expression denary logarithm;
(2) need initialized iteration system parameter to comprise: maximum iteration time N in yardstick maxConstant compensating parameter β, difference operator contribution parameters γ, image difference operator contribution parameters α;
(3) calculated level direction difference operator D 1Fourier transform F (the D of=[1 ,-1] 1) and vertical direction difference operator D 2=[1 ,-1] TFourier transform F (D 2);
1.2 described multiple dimensioned iterative process comprise between yardstick upgrade, iteration stops judgement between the iterative estimate in yardstick and yardstick:
1.2.1 upgrade between yardstick, yardstick is s, 1≤s≤S:
(1) utilize blind restored image x under the s-1 yardstick s-1With the fuzzy core k that estimates s-1, they are carried out respectively up-sampling, the initial pictures under current yardstick s is updated to Initial fuzzy core under current yardstick s is updated to
Figure FDA00002788913700013
During for yardstick s=1, the primary iteration solution of image is
Figure FDA00002788913700014
The primary iteration solution of fuzzy core is
Figure FDA00002788913700015
Wherein: the operation of symbol " ↑ " expression up-sampling;
(2) calculate y sStructure tensor, and then obtain position (i, j) perpendicular to the normalization proper vector of partial structurtes direction
Figure FDA00002788913700018
Calculate simultaneously y sNormal gradients vector field (u s, v s), node-by-node algorithm y thus sDirection gradient vector, its normal component
Figure FDA00002788913700016
And tangential component ( ▿ a y s ) i , j = ( - υ s , μ s ) i , j · ( u s , v s ) i , j T ;
(3) calculate blurred picture y under current yardstick s sFrequency spectrum F (y s), and y sThe frequency spectrum of direction gradient vector field
Figure FDA00002788913700021
1.2.2 the estimation of yardstick inner iteration, n is iterations, 1≤n≤N max:
Step 1 generates the enhancement mode direction gradient vector field of iterative image, the image that the n-1 time iteration obtained
Figure FDA00002788913700022
Utilize Meyer cartoon-texture decomposition method to obtain the cartoon composition, and carry out impact filtering, obtain edge enhanced images
Figure FDA00002788913700023
By calculating
Figure FDA00002788913700024
The structure tensor node-by-node algorithm
Figure FDA00002788913700025
Normal component And tangential component
Figure FDA00002788913700027
The direction gradient vector field that obtains the n time iterative image is
Figure FDA00002788913700028
Step 2, iterative image direction gradient vector field is calculated in the quick estimation of current yardstick fuzzy core the n time
Figure FDA00002788913700029
Frequency spectrum
Figure FDA000027889137000210
Then obtain the fuzzy core of the n time iteration in frequency domain
Figure FDA000027889137000211
Step 3, the approximate frequency spectrum of calculated direction derivative, according to
Figure FDA000027889137000212
Calculate the method directional derivative of the n time iteration and cut the approximate frequency spectrum of directional derivative
Step 4, the Fast Restoration of current scalogram picture, fuzzy core in calculation procedure 2
Figure FDA000027889137000214
Frequency spectrum
Figure FDA000027889137000215
Then try to achieve a rough estimate of the n time iteration restored image
Step 5, the yardstick inner iteration stops judgement: if n 〉=N max, go to iteration termination judgement between yardstick, and will
Figure FDA000027889137000217
As the final fuzzy core of estimating of current yardstick,
Figure FDA000027889137000218
As the blind restored image of current yardstick, inner iteration count n is set to 1; Otherwise upgrade inner iteration count n=n+1, and go to step 1;
1.2.3 between yardstick, iteration stops judgement: if s 〉=S, between yardstick, iteration stops, and will
Figure FDA000027889137000219
As final fuzzy core,
Figure FDA000027889137000220
As final restored image; Otherwise upgrade yardstick iteration count s=s+1, go between yardstick and upgrade.
2. the multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative according to claim 1, it is characterized in that iteration system parameter initialization in the iteration system initialization procedure, initial parameter value arranges as follows: maximum iteration time N in yardstick max∈ [6, L, 10]; Constant compensating parameter β ∈ [5,10], difference operator contribution parameters γ=2 β; Image difference operator contribution parameters α ∈ [0.1,0.3].
3. the multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative according to claim 1, is characterized in that in the step 2 of yardstick inner iteration estimation the fuzzy core of the n time iteration
Figure FDA00002788913700031
Solution procedure is to obtain fuzzy core in frequency domain, is found the solution by following relational expression to obtain:
k s ( n ) = Shrink ( F - 1 ( F * ( ▿ o S s ( n ) ) oF ( ▿ o y s ) + F * ( ▿ a S s ( n ) ) oF ( ▿ a y s ) F * ( ▿ o S s ( n ) ) oF ( ▿ o S s ( n ) ) + F * ( ▿ a S s ( n ) ) oF ( ▿ a S s ( n ) ) + γ ( F * ( D 1 ) oF ( D 1 ) + F * ( D 2 ) oF ( D 2 ) ) + β ) )
Wherein: β is that constant compensating parameter, γ are the difference operator contribution parameters, F *The complex conjugate of () expression F (), F -1() expression inverse fourier transform, the pointwise of " o " representing matrix element is multiplied each other, and fraction represents that between two matrixes of molecule denominator, the element pointwise is divided by, shrinkage operation operator Shrink ()=max (, 0.01).
4. the multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative according to claim 1 is characterized in that in step 3 that the yardstick inner iteration estimates, the method directional derivative of the n time iteration with cut the approximate frequency spectrum of directional derivative
Figure FDA00002788913700033
Computing formula be:
F ( Do s ( n ) ) = μ ^ s ( n - 1 ) oF ( D 1 ) + v ^ s ( n - 1 ) oF ( D 2 ) - - - ( 2 )
F ( Da s ( n ) ) = - v ^ s ( n - 1 ) oF ( D 1 ) + μ ^ s ( n - 1 ) oF ( D 2 ) - - - ( 3 )
Wherein:
Figure FDA00002788913700036
With
Figure FDA00002788913700037
Represent respectively the n-1 time iteration restored image of current yardstick
Figure FDA00002788913700038
The corresponding normalization proper vector that is orthogonal to partial structurtes of structure tensor, the pointwise of " o " representing matrix element is multiplied each other.
5. the multiple dimensioned iterative estimate method of fuzzy core of utilizing the Local Structure of Image directional derivative according to claim 1, is characterized in that in the step 4 of yardstick inner iteration estimation the restored image rough estimate of the n time iteration
Figure FDA00002788913700039
To find the solution be to be tried to achieve by following relational expression
x s ( n ) = F - 1 ( F * ( k s ( n ) ) oF ( y s ) o ( 1 + 0.5 F * ( Do s ( n ) ) + 0.5 F * ( Da s ( n ) ) oF ( Da s ( n ) ) ) F * ( k s ( n ) ) oF ( k s ( n ) ) o ( 1 + 0.5 F * ( Do s ( n ) ) oF ( Do s ( n ) ) + 0.5 F * ( Da s ( n ) ) oF ( Da s ( n ) ) ) + α ( F * ( D 1 ) oF ( D 1 ) + F * ( D 2 ) oF ( D 2 ) ) )
Wherein: α is image difference operator contribution parameters, F *The complex conjugate of () expression F (), F -1() expression inverse fourier transform, the pointwise of " o " representing matrix element is multiplied each other, and fraction represents that between two matrixes of molecule denominator, the element pointwise is divided by.
CN201310033631.9A 2013-01-29 2013-01-29 Blurring kernel multi-scale iteration estimation method using directional derivative of image local structure Expired - Fee Related CN103093436B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310033631.9A CN103093436B (en) 2013-01-29 2013-01-29 Blurring kernel multi-scale iteration estimation method using directional derivative of image local structure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310033631.9A CN103093436B (en) 2013-01-29 2013-01-29 Blurring kernel multi-scale iteration estimation method using directional derivative of image local structure

Publications (2)

Publication Number Publication Date
CN103093436A true CN103093436A (en) 2013-05-08
CN103093436B CN103093436B (en) 2015-07-01

Family

ID=48205971

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310033631.9A Expired - Fee Related CN103093436B (en) 2013-01-29 2013-01-29 Blurring kernel multi-scale iteration estimation method using directional derivative of image local structure

Country Status (1)

Country Link
CN (1) CN103093436B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103337057A (en) * 2013-07-05 2013-10-02 西北工业大学 Motion blurred image blind restoration method based on multi-scale self-similarity
CN104966274A (en) * 2015-06-12 2015-10-07 杭州电子科技大学 Local fuzzy recovery method employing image detection and area extraction
CN110473153A (en) * 2019-07-31 2019-11-19 西北工业大学 The method for blindly restoring image kept based on fuzzy kernel estimates iteration structure
CN116091367A (en) * 2023-04-10 2023-05-09 中国科学院空天信息创新研究院 Blind deblurring method, device, equipment and medium for optical remote sensing image

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060187308A1 (en) * 2005-02-23 2006-08-24 Lim Suk H Method for deblurring an image
CN1904941A (en) * 2005-07-29 2007-01-31 清华大学 Defuzzy method for image processing
CN101540043A (en) * 2009-04-30 2009-09-23 南京理工大学 Analysis iteration fast frequency spectrum extrapolation method for single image restoration
CN101930601A (en) * 2010-09-01 2010-12-29 浙江大学 Edge information-based multi-scale blurred image blind restoration method
CN101968881A (en) * 2010-10-27 2011-02-09 东南大学 Motion blurring and defocusing composite blurring image restoration method
US20110229044A1 (en) * 2010-03-16 2011-09-22 Novatek Microelectronics Corp. Hierarchical motion deblurring method for single image
CN102867289A (en) * 2012-08-20 2013-01-09 清华大学 Complementary blurred image acquisition system and blurred image recovery method using complementary blurred image acquisition system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060187308A1 (en) * 2005-02-23 2006-08-24 Lim Suk H Method for deblurring an image
CN1904941A (en) * 2005-07-29 2007-01-31 清华大学 Defuzzy method for image processing
CN101540043A (en) * 2009-04-30 2009-09-23 南京理工大学 Analysis iteration fast frequency spectrum extrapolation method for single image restoration
US20110229044A1 (en) * 2010-03-16 2011-09-22 Novatek Microelectronics Corp. Hierarchical motion deblurring method for single image
CN101930601A (en) * 2010-09-01 2010-12-29 浙江大学 Edge information-based multi-scale blurred image blind restoration method
CN101968881A (en) * 2010-10-27 2011-02-09 东南大学 Motion blurring and defocusing composite blurring image restoration method
CN102867289A (en) * 2012-08-20 2013-01-09 清华大学 Complementary blurred image acquisition system and blurred image recovery method using complementary blurred image acquisition system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
RAMESH RASKAR,AMIT AGRAWAL,JACK TUMBLIN: "Coded exposure photography: motion deblurring using fluttered shutter", 《SIGGRAPH"06 ACM SIGGRAPH 2006 PAPERS》, vol. 25, no. 3, 31 July 2006 (2006-07-31), XP002467982, DOI: doi:10.1145/1141911.1141957 *
王璐,胡晰远,彭思龙: "基于分块的空间变化抖动模糊图像的全局模糊去除", 《计算机辅助设计与图形学学报》, vol. 24, no. 6, 30 June 2012 (2012-06-30) *
虞芬,杨勇杰,苗兰芳: "图像抖动核函数估计与图像恢复", 《计算机应用研究》, vol. 29, no. 12, 31 December 2012 (2012-12-31) *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103337057A (en) * 2013-07-05 2013-10-02 西北工业大学 Motion blurred image blind restoration method based on multi-scale self-similarity
CN103337057B (en) * 2013-07-05 2015-12-02 西北工业大学 Based on the motion blur image blind restoration method of multiple dimensioned self similarity
CN104966274A (en) * 2015-06-12 2015-10-07 杭州电子科技大学 Local fuzzy recovery method employing image detection and area extraction
CN104966274B (en) * 2015-06-12 2019-01-29 杭州电子科技大学 A kind of On Local Fuzzy restored method using image detection and extracted region
CN110473153A (en) * 2019-07-31 2019-11-19 西北工业大学 The method for blindly restoring image kept based on fuzzy kernel estimates iteration structure
CN110473153B (en) * 2019-07-31 2022-04-26 西北工业大学 Image blind restoration method based on fuzzy kernel estimation iterative structure preservation
CN116091367A (en) * 2023-04-10 2023-05-09 中国科学院空天信息创新研究院 Blind deblurring method, device, equipment and medium for optical remote sensing image

Also Published As

Publication number Publication date
CN103093436B (en) 2015-07-01

Similar Documents

Publication Publication Date Title
CN105493140B (en) Image deblurring method and system
Chen et al. Blind image deblurring with local maximum gradient prior
Michaeli et al. Blind deblurring using internal patch recurrence
Bahat et al. Non-uniform blind deblurring by reblurring
US8380000B2 (en) Methods of deblurring image and recording mediums having the same recorded thereon
Sun et al. Edge-based blur kernel estimation using patch priors
Sun et al. Gradient profile prior and its applications in image super-resolution and enhancement
Cho et al. Fast motion deblurring
Chen et al. Split Bregmanized anisotropic total variation model for image deblurring
US20140355901A1 (en) Algorithm for minimizing latent sharp image cost function and point spread function cost function with a spatial mask in a regularization term
CN106709877B (en) A kind of image deblurring method based on multi-parameter canonical Optimized model
Chowdhury et al. Non-blind and blind deconvolution under Poisson noise using fractional-order total variation
Yang et al. Non-local means theory based Perona–Malik model for image denosing
Yun et al. Linearized proximal alternating minimization algorithm for motion deblurring by nonlocal regularization
CN106875349A (en) The computational methods and blind image restoring method of fuzzy core in blind image restoring method
Li et al. Blind image motion deblurring with L0-regularized priors
Xiao et al. Adaptive shock filter for image super-resolution and enhancement
Cao et al. New architecture of deep recursive convolution networks for super-resolution
CN103093436B (en) Blurring kernel multi-scale iteration estimation method using directional derivative of image local structure
Yang et al. An adaptive parameter estimation for guided filter based image deconvolution
Li et al. Fractional-order diffusion coupled with integer-order diffusion for multiplicative noise removal
Li et al. Image deblurring for satellite imagery using small-support-regularized deconvolution
Ji et al. Image recovery via geometrically structured approximation
Wang et al. Blind image deblurring using elastic-net based rank prior
Hu et al. Image deblurring based on enhanced salient edge selection

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150701