CN106296606A - A kind of classification rarefaction representation image repair method of edge fitting - Google Patents

A kind of classification rarefaction representation image repair method of edge fitting Download PDF

Info

Publication number
CN106296606A
CN106296606A CN201610639370.9A CN201610639370A CN106296606A CN 106296606 A CN106296606 A CN 106296606A CN 201610639370 A CN201610639370 A CN 201610639370A CN 106296606 A CN106296606 A CN 106296606A
Authority
CN
China
Prior art keywords
edge
image
curve
dictionary
algorithm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610639370.9A
Other languages
Chinese (zh)
Other versions
CN106296606B (en
Inventor
唐向宏
屠雅丽
李齐良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Dianzi University
Original Assignee
Hangzhou Dianzi University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Dianzi University filed Critical Hangzhou Dianzi University
Priority to CN201610639370.9A priority Critical patent/CN106296606B/en
Publication of CN106296606A publication Critical patent/CN106296606A/en
Application granted granted Critical
Publication of CN106296606B publication Critical patent/CN106296606B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/77Retouching; Inpainting; Scratch removal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses the classification rarefaction representation image repair method of a kind of edge fitting.The present invention uses the extracting method that integral edge and local edge combine, the crack edge of area to be repaired is extracted, obtain the marginal information of reflecting edge feature, crack edge line is carried out curve fitting, to ensure that the reparation of image edge structure is strictly retrained by edge wheel profile by certain rule according to these marginal informations;Use and carry out dictionary training by tagsort, to strengthen the adaptivity of study dictionary;Near-hyperbolic tan is used to go to approximate l0Norm, utilizes conjugate gradient method to solve this function, it is achieved the improvement to tradition SL0 algorithm, is applied in the image repair of non-edge damaged area by the SL0 restructing algorithm that need not estimate degree of rarefication.The picture quality that the present invention repairs is high, both can preferably repair the marginal texture of image, can keep again the overall flatness of structure.

Description

A kind of classification rarefaction representation image repair method of edge fitting
Technical field
The invention belongs to Digital Image Inpainting field, the classification rarefaction representation image repair of concrete a kind of edge fitting Method.
Background technology
Traditional image repair method is divided into two classes: a class is methods based on partial differential equation.The method is substantially A kind of diffusion process, but exist the fuzzyyest when repairing large area region.Another kind of is method based on textures synthesis.The party Method match block replaces multiblock to be repaired, will produce erroneous matching when can not find match block and continue mistake.In order to solve to covet The erroneous matching that greedy property causes, people have carried out a lot of improvement, but still have been not fee from coupling and the weighted graph of mistake algorithm As obscuring that block too much brings.Recently, a kind of new image sparse method for expressing is paid attention in image processing field, many Sparse theory is applied in the method for image repair by person.
Summary of the invention
Find in an experiment, image repair algorithm based on rarefaction representation all uses OMP restructing algorithm, to be repaired When image is reconstructed, generally requiring the degree of rarefication estimating signal, no matter degree of rarefication is estimated too small or excessively mostly can not reach Preferably quality reconstruction;Secondly, sparse representation method is not ideal enough to the holding of structure flatness, particularly repaiies curve Time multiple, some distortion can be produced at structure.In order to preferably repair the structural information of image, the present invention is from considering that structure is overall The angle of flatness, the advantage repaired in conjunction with sample rarefaction representation and structural constraint, the classification having invented a kind of edge fitting is dilute Relieving the exterior syndrome shows image repair method.
The present invention takes techniques below scheme:
The extracting method using integral edge and local edge to combine, carries the crack edge of area to be repaired Take, it is thus achieved that the various information of reflecting edge feature, by certain rule, crack edge line carried out curve fitting according to these information, To ensure that the reparation of image edge structure is strictly retrained by edge wheel profile;Use and carry out dictionary training by tagsort, To strengthen the adaptivity of study dictionary;Near-hyperbolic tan is used to go to approximate l0Norm, utilizes conjugate gradient method to solve This function, it is achieved the improvement to tradition SL0 algorithm, is applied to non-edge by the SL0 restructing algorithm that need not to estimate degree of rarefication and breaks Damage in the image repair in region, to improve the reliability of rarefaction representation reparation texture information.Specifically comprise the following steps that
The first step: obtain and repair the marginal information of image.
1-1. passes through Sobel operator extraction integral edge, it is thus achieved that the strong edge of breakage image, provides image for image repair Integral edge structure;
1-2. uses the former of " by there are continuous 4 marginal points and above crack edge line is defined as agent structure edge " Then, use integral edge to extract and extract the method realization combined with damaged neighboring area local edge, effectively obtain damaged week The crack edge structural information of edge regions, finds the intersection point on border to be repaired and marginal information.These broken curves (are set fracture Curve is c1,c2,…,cn, it is designated as gathering Q, wherein broken curve ciStarting point be pi1) connect correspondingly.By broken curve ciIn its starting point pi1On the most contrary two broken curves of direction vector be connected.From there through curve ciDirection vector will Q is divided into two set Q1,Q2.After having classified, calculate the distance between each origin of curve, by two closest for starting point songs Line is attached by the method for quadratic polynomial curve matching.Specifically comprise the following steps that
1-2-1. is for arbitrary broken curve ci, by starting point pi1Set out, obtain ciOn other each point pi2,pi3,pi4,。 IfFor a pi,jCoordinate vector, then curve ciIn starting point pi1On direction vector be defined as:
s → i = 0.5 ( p → i , 1 - p → i , 2 ) + 0.25 ( p → i , 2 - p → i , 3 ) + 0.125 ( p → i , 3 - p → i , 4 ) - - - ( 1 )
Wherein,WillIt is unitization,
1-2-2. circulation step 1-2-1 obtains every broken curve ciDirection vector, by c1Put into set Q1In, then Travel through remaining all curve ci, obtain and Q1In all direction of curve vector angles and minimum curve, be designated as cmin, and put Enter to gather Q1, until Q1In the half that element is master curve quantity, remaining curve put into set Q2
c min ∈ Q 1 , i f f Σ c i ∈ Q 1 θ ( s → i , s → min ) = min c j ∈ Q - Q 1 { Σ c j ∈ Q 1 θ ( s → i , s → j ) } - - - ( 2 )
1-2-3., by after the curve classification in Q, takes Q1In a curve, at Q2Middle searching and Q1In the curve chosen rise These two curves are carried out quadratic polynomial curve matching, i.e. complete the connection of broken curve by the curve that point is closest;When complete After becoming the connection of these two broken curves, by these two curves respectively from set Q1,Q2Middle rejecting, then according to said method pair Remaining curve processes, until the curve of fracture has all connected, obtains the edge contour information repaired.
Second step: to image block by tagsort and K-SVD dictionary training.In order to strengthen the self adaptation of study dictionary Property, use the method combining image block gradient information and local variance that image block is classified.It is known that edge and texture Information is frequently found in the image block containing abundant structural information, otherwise, the smooth region of image contains less structure letter Breath.Graded according to pixel the most violent, image block inner structure information is the abundantest;And the image that structural information is rare Block, the gradient of its interior pixels is smaller.Therefore, gradient information can well reflect that the structural information of image block is enriched Degree (i.e. smoothness).
Make optional position in image (x, pixel value y) be f (x, y), the Grad in its 4 directions up and down is:
g 1 ( x , y ) = | f ( x , y ) - f ( x - 1 , y ) | g 2 ( x , y ) = | f ( x , y ) - f ( x + 1 , y ) | g 3 ( x , y ) = | f ( x , y ) - f ( x , y - 1 ) | g 4 ( x , y ) = | f ( x , y ) - f ( x , y + 1 ) | - - - ( 3 )
Take the weights that greatest gradient value is this pixel on these 4 directions:
G (x, y)=max{g1(x,y),g2(x,y),g3(x,y),g4(x,y)} (4)
Each pixel in each image block (size is n × m) is carried out gradient weighting, and its size is:
u k = Σ x = 1 n Σ y = 1 m g ( x , y ) × f ( x , y ) Σ x = 1 n Σ y = 1 m g ( x , y ) - - - ( 5 )
ukGradient weighted value for kth image block.In order to be classified by image block, set threshold value T1, wherein T1 For empirical, typically take T1=100.Work as uk< T1Time, expression image block is smooth area, otherwise image block is structure-rich district. Although the graded in marginal texture district and irregular grain region is all universal relatively big, but the local variance of image tends to preferably The detailed information embodying image, it comprises a large amount of structural informations of image.Therefore, utilize local variance to said structure Classify again and obtain marginal texture district and irregular grain district in abundant district.
The local variance of kth image block is:
Var k = 1 n × m Σ x = 1 n Σ y = 1 m | f ( x , y ) - f ‾ k | 2 - - - ( 6 )
Wherein,For the average pixel value in image block.Set threshold value T2, wherein T2For empirical, typically take T2 =300.Work as Vark< T2Time, image block is irregular grain district, otherwise image block is marginal texture district.
Image block is being divided into, by architectural feature, the sub-district that marginal texture district, irregular grain district are different with smooth area three Behind territory, the image pattern block of zones of different is carried out dictionary training, obtain the complete dictionary of corresponding mistake.Below with smooth Dictionary DsAs a example by, illustrate that K-SVD algorithm realizes process to dictionary training.
According to sparse representation model:
min D , X | | Y - D X | | 2 s . t | | x i | | 0 < K - - - ( 7 )
Wherein, D=[d1,d2,…,dL] it was complete dictionary, K < < L represents xiMaximum degree of rarefication be K; Represent and treat training signal, the sample image block of the most same feature.Algorithm while solving D also to sparse coefficient xiCarry out sparse Coding.Due to l0The nonconvex property of problem, generally uses OMP algorithm to solve.But dictionary training algorithm is otherwise varied with formula (7) , training signalIt is known that and cross complete dictionary D be unknown, it needs to be obtained by dictionary training algorithm.
Assume Ys={ yi|i∈ΩsRepresent that select from smooth region image block treats training sample set of blocks, ΩsTable Show smooth region image block, can be described as by the process of the characteristics dictionary corresponding to this sample set of K-SVD Algorithm for Training:
min D s , X s | | Y s - D s x s | | 2 s . t | | x i | | 0 < K , i &Element; &Omega; s - - - ( 8 )
In order to solve formula (8), it is necessary to first initialize dictionary Ds.In order to accelerate convergence of algorithm speed, select at this algorithm Select image sorted smoothed image block to DsInitialize.
K-SVD algorithm is the estimation that the step according to sparse coding provides sample block set, thus update in dictionary each Individual atom.Specifically, smooth dictionary D to be updatedsIn kth row dk, then formula (8) can be rewritten as:
| | Y s - D s x s | | 2 = | | Y s - &Sigma; j = 1 K d j x j | | 2 = | | ( Y s - &Sigma; j &NotEqual; k K d j x j ) - d k x k | | 2 = | | E k - d k x k | | 2 - - - ( 9 )
Wherein, DsXsBe broken down into matrix that K order is 1 and, remaining K-1 item is all fixing, and remaining 1 row seek to The row updated, EkRepresent and remove atom dkThe error afterwards all samples caused, and then to EkCarry out SVD decomposition, update dk.With Said method, by { d1,d2,…,dLAll atoms in } are all updated, i.e. to smooth dictionary DsComplete training.
So, according to the training method of above K-SVD, the image block classified just can obtain and cross complete dictionary accordingly: limit Edge dictionary De, irregular grain dictionary DtAnd smooth dictionary Ds
3rd step: l will be approximated0The sparse restructing algorithm SL0 of norm is applied to the image repair of rarefaction representation.Use approximation Hyperbolic tangent function goes to approximate l0Norm, utilizes conjugate gradient method to solve this function.
Owing to the mathematical model of SL0 is:
min||X||0, s.t.Y=DX (10)
Vector X=[x1 x2 … xn]T, its l0Norm represents the number of non-zero element in vector X, if assuming:
f ( x ) = 1 , x &NotEqual; 0 0 , x = 0 - - - ( 11 )
Then:
| | X | | 0 = &Sigma; i = 1 n f ( x i ) - - - ( 12 )
Therefore, as long as finding continuous function f (x) the most smooth, it is possible to well approach | | X | |0Value. There is " abruptness " significantly smooth continuous function to construct, and this continuous function can accurately approach l0Norm.Therefore originally Patent uses the near-hyperbolic tan shown in formula (13) as approximate evaluation l0The function of norm.
f &sigma; ( x ) = 1 8 e x 2 2 &sigma; 2 - e - x 2 2 &sigma; 2 e x 2 2 &sigma; 2 + e - x 2 2 &sigma; 2 + 7 8 ( 1 - e - 8 x 2 &sigma; 2 ) - - - ( 13 )
Knowable to formula (13), variable σ value is the least, and near-hyperbolic tan " abruptness " is the most obvious, more approaches l0Norm, But along with constantly diminishing of σ value, function curve is more and more rough.Therefore, choosing of σ parameter is the most crucial, choosing of it L must approached0Degree and the smoothing of functions degree of norm take compromise between the two.To this end, use one group of σ sequence { σ successively decreased1, σ2,…,σnBe used for approaching object function, carry out the optimum of solved function to utilizing steepest descent method while σ each time value.
The direction of search of steepest descent method is the negative gradient direction of function, and closer to desired value, step-length is the least, advances more Slowly, solution procedure exists sawtooth effect so that l0The accuracy that norm is estimated reduces.And the direction of search of conjugate gradient method For the linear combination in negative gradient direction with the direction of search of last iteration, the sawtooth effect that steepest descent method is brought can be solved Should.
For solving this kind of nothing of minf (x) about fasciculation problem, it is assumed that an initial value x0, obtain x through series of iterationsn。 If current iterative value is xk, then next iterative value i.e. xk+1=xk+u×dk, u represents iteration step length, dkRepresent and ask minimum The direction of search of value, use conjugate gradient method solution formula is:
d k = - g k , k = 1 - g k + &beta; k d k - 1 , k &GreaterEqual; 2 - - - ( 14 )
Wherein, gkThe gradient of representative function f (x), βkCan be solved by different conjugate gradient methods.To βkSolve Method uses mixing conjugate gradient method, i.e. mixes FR (Fletcher-Reeves) conjugate gradient method and PRP (Polak, Ribiere And Polyar) conjugate gradient method:
&beta; k = &beta; k P R P , 0 < &beta; k P R P < &beta; k F R &beta; k F R , e l s e - - - ( 15 )
The conjugate gradient method of this mixing avoids the shortcoming that may produce continuous little step-length;Simultaneously as conjugate gradient The direction of the iteration each time of method is all that last iteration direction forms with negative gradient directional combination, it is possible to overcome steepest descent method The crenellated phenomena brought.
Therefore, utilize the sparse representation method of SL0, classification repair all kinds of characteristic information of image to realize step as follows:
(1) initial value is made to be respectively X=DT(DDT)-1Y, σ1=2max (X), k=1;
(2) j=1,2 ..., L, (L is conjugate gradient method iterations, L=5) utilizes conjugate gradient method to solve gnThe gradient of representative function f (x):
1. direction is searched:
②X←X+μdn, wherein step factor μ=1.5;
③X←X-DT(DDT)-1(DX-Y);
4. n=n+1, j=j+1;If j is < L, then repeat step 1., 2., 3.;
(3) k=k+1, σk=η σk-1, η ∈ [0.51], repeat step (2), until σk< ε, ε=0.01, now obtain X's Optimal solution.
The present invention has the beneficial effect that:
When being reconstructed image to be repaired, generally requiring the degree of rarefication estimating signal, no matter degree of rarefication is estimated too small Or cross and mostly can not reach preferable quality reconstruction;Secondly, sparse representation method is not ideal enough to the holding of structure flatness, When particularly curve being repaired, some distortion can be produced at structure.In order to preferably repair the structural information of image, this Invent from the angle considering structure entirety flatness, the advantage repaired in conjunction with sample rarefaction representation and structural constraint.
The crack edge of area to be repaired is extracted by the present invention, it is thus achieved that the various information of reflecting edge feature, according to Crack edge line is carried out curve fitting, to ensure that the reparation of image edge structure is strictly by limit by these information by certain rule The constraint of edge contour line;Use and carry out dictionary training by tagsort, to strengthen the adaptivity of study dictionary;Use approximate Double Bent tan goes to approximate l0Norm, utilizes conjugate gradient method to solve this function, it is achieved the improvement to tradition SL0 algorithm, will not Need the SL0 restructing algorithm estimating degree of rarefication to be applied in the image repair of non-edge damaged area, repair improving rarefaction representation The reliability of multiple texture information.
Accompanying drawing explanation
Fig. 1 is the flow chart of the present invention.
Fig. 2 is the overall structural edge schematic diagram extracted with local approach, and Fig. 2 (a) is damaged Lena image;Fig. 2 (b) is overall The structural edge that method is extracted;The overall structural edge extracted with local approach of Fig. 2 (c);Fig. 2 (d) edge fitting design sketch, Qi Zhongtu In ' △ ' represent without screening before the starting point at agent structure edge, ' o ' represents rising of the agent structure edge after screening Point.
Fig. 3 (a)-(d) is the matching repairing model of crack edge.
Fig. 4 (a)-(b) is that marginal information repairs schematic diagram.
Fig. 5 (a)-(c) is that image block is by the schematic diagram of tagsort.
Fig. 6 (a)-(f) is for being respectively adopted reparation algorithm [1], repairing algorithm [2], reparation algorithm [3] and inventive algorithm Comparison to damaged Baboon image repair result.
Fig. 7 (a)-(f) is for using the comparison to damaged Barb image repair effect of the above-mentioned algorithm.
Fig. 8 (a)-(f) removes the comparison of result for using above-mentioned algorithm that Baboon image carries out English alphabet.
Fig. 9 (a)-(f) removes the comparison of design sketch for using above-mentioned algorithm to material object.
Figure 10 (a)-(f) is for using the comparison to large area breakage Lena repairing effect of the above-mentioned algorithm.
Figure 11 (a)-(f) removes the comparison of effect for using above-mentioned algorithm to personage.
Illustrate: in order to compare the superiority of inventive algorithm, compare with following associated restoration algorithm.
Reparation algorithm [1]: Criminisi A, Perez P, Toyama K.Region filling and object removal by Eexemplar-based inpainting[J].IEEE Transactions on Image Processing,2004,13(9):1200-1212.
Reparation algorithm [2]: Xu Z, Sun J.Image inpainting by patch propagation using patch sparsity[J].IEEE Transactions on Image Processing,2010,19(5):1153-1165.
Reparation algorithm [3]: Konka's human relations, Tang Xianghong, Zhang Dong, slaughter Artline. the structure sparse propagation image of tagsort study Restorative procedure [J]. computer-aided design and graphics journal, 2015,27 (5): 864-872.
It is embodied as explanation
Below in conjunction with the accompanying drawings the embodiment of the present invention is elaborated.
In the present embodiment, the flow chart of the present invention that Fig. 1 is given.
The first step: first, by Sobel operator extraction integral edge, it is thus achieved that the strong edge of breakage image, for image repair The integral edge structure of image is provided, as shown in Fig. 2 (b), gives the structural edge that damaged Lena image wholeness method is extracted; Then using the principle of " by there are continuous 4 marginal points and above crack edge line is defined as agent structure edge ", using Integral edge is extracted and is extracted the method realization combined with damaged neighboring area local edge, effectively obtains damaged neighboring area Crack edge structural information, finds the intersection point on border to be repaired and marginal information, as shown in Fig. 2 (c).In order to by these points one by one Correspondingly connected, Fig. 3 (a) gives a plurality of crack edge line and is respectively c1,c2,…,cN, it is designated as gathering Q, wherein curve ci's Starting point is pi1.Regulation is by curve ciIn its starting point pi1On the most contrary two broken curves of direction vector be connected.Thus lead to Cross curve ciDirection vector Q is divided into two set Q1,Q2.After having classified, calculate the distance between each origin of curve, will The method of two curve negotiating quadratic polynomial curve matchings that starting point is closest is attached.Specifically comprise the following steps that
(1) for arbitrary broken curve ci, by starting point pi1Set out, obtain ciOn other each point pi2,pi3,pi4,.IfFor a pi,jCoordinate vector, then curve ciIn starting point pi1On direction vector be defined as:
s &RightArrow; i = 0.5 ( p &RightArrow; i , 1 - p &RightArrow; i , 2 ) + 0.25 ( p &RightArrow; i , 2 - p &RightArrow; i , 3 ) + 0.125 ( p &RightArrow; i , 3 - p &RightArrow; i , 4 ) - - - ( 1 )
Wherein,WillIt is unitization,
(2) circulation step (1) obtains every curve ciDirection vector, by c1Put into set Q1In, then travel through remaining All curve ci, obtain and Q1In all direction of curve vector angles and minimum curve, be designated as cmin, and put into set Q1, Until Q1In the half that element is master curve quantity, remaining curve put into set Q2
c min &Element; Q 1 , i f f &Sigma; c i &Element; Q 1 &theta; ( s &RightArrow; i , s &RightArrow; min ) = min c j &Element; Q - Q 1 { &Sigma; c j &Element; Q 1 &theta; ( s &RightArrow; i , s &RightArrow; j ) } - - - ( 2 )
(3) by after the curve classification in Q, Q is taken1In a curve, at Q2The song that middle searching is closest with its starting point These two curves are carried out quadratic polynomial curve matching, i.e. complete the connection of broken curve by line;When completing these two fracture songs After the connection of line, by these two curves respectively from set Q1,Q2Middle rejecting, then according to remaining curve is carried out by said method Process, until the curve of fracture has all connected.Shown in broken curve repairing effect such as Fig. 3 (b):
(4) when broken curve sum N is odd number, n (Q1)≠n(Q2) (as shown in Fig. 3 (c)).In this case, it is achieved Step does following adjustment:
1. in performing step (2), if n is (Q1)=(N-1)/2, the most ensuing curve ciSort out by following rule:
c min &Element; Q 1 , &Sigma; c i &Element; Q 1 &theta; ( S &RightArrow; i , S &RightArrow; min ) &le; &pi; ( N - 1 ) / 2 2 Q 2 , &Sigma; c i &Element; Q 1 &theta; ( S &RightArrow; i , S &RightArrow; min ) > &pi; ( N - 1 ) / 2 2
After completing the classification of (N-1)/2+1 bar curve, remaining curve puts into set Q2In.
2., in step (3), Q is compared1,Q2In element number, choose the set that number is few, it is assumed that n (Q1) < n (Q2), Then take set Q1In a curve, at Q2These two curves are carried out secondary many by the curve that middle searching is closest with its starting point Item formula curve matching.The like, complete to gather Q1In all curves pairing after, Q2In also to remain a curve unpaired, then exist Q1The curve that middle searching is closest with its starting point, completes to connect.All curves in so Q have matched, such as Fig. 3 (d) institute Show.
Shown to fitting effect such as Fig. 2 (d) of the crack edge of damaged Lena figure (Fig. 2 (a)) by above-mentioned matching rule.
After image border curve completes matching, the constraint information that this matched curve just can be repaired as edge so that The reparation of edge epigraph block is carried out by the track at edge.Centered by point on present invention edge line after matching, take reparation Window size is 3 × 3 (for the accuracys repaired, repair window value less), utilizes the error sum of squares (SSD) of pixel to exist ψ123... (the known pixels block on edge line, size is 3 × 3, as shown in Fig. 4 (a)) is found mate most like with ψ Block, then the pixel value of best matching blocks is filled into the unknown pixel point of the image block to be repaired of correspondence.The most successively Complete the reparation of little image block on edge.Repair shown in result such as Fig. 4 (b).
Second step: to image block by tagsort and K-SVD dictionary training.In order to strengthen the self adaptation of study dictionary Property, use the method combining image block gradient information and local variance that image block is classified.It is known that edge and texture Information is frequently found in the image block containing abundant structural information, otherwise, the smooth region of image contains less structure letter Breath.Graded according to pixel the most violent, image block inner structure information is the abundantest;And the image that structural information is rare Block, the gradient of its interior pixels is smaller.Therefore, gradient information can well reflect that the structural information of image block is enriched Degree (i.e. smoothness).
If make optional position in image (x, pixel value y) be f (x, y), the Grad in its 4 directions up and down is:
g 1 ( x , y ) = | f ( x , y ) - f ( x - 1 , y ) | g 2 ( x , y ) = | f ( x , y ) - f ( x + 1 , y ) | g 3 ( x , y ) = | f ( x , y ) - f ( x , y - 1 ) | g 4 ( x , y ) = | f ( x , y ) - f ( x , y + 1 ) | - - - ( 3 )
Take the weights that greatest gradient value is this pixel on these 4 directions:
G (x, y)=max{g1(x,y),g2(x,y),g3(x,y),g4(x,y)} (4)
Each pixel in each image block (size is n × m) is carried out gradient weighting, and its size is:
u k = &Sigma; x = 1 n &Sigma; y = 1 m g ( x , y ) &times; f ( x , y ) &Sigma; x = 1 n &Sigma; y = 1 m g ( x , y ) - - - ( 5 )
ukGradient weighted value for kth image block.In order to be classified by image block, set threshold value T1, wherein T1 For empirical, typically take T1=100.Work as uk< T1Time, expression image block is smooth area, otherwise image block is structure-rich district. Fig. 5 (b) gives the result using gradient weighted value that Fig. 5 (a) carries out image block classification.In Fig. 5 (b), black part represents Smooth region, white portion represents structure-rich region.But due to marginal texture district and the graded in irregular grain region All generally bigger, it is impossible to go to identify marginal texture district and irregular grain district by gradient weighted value.Therefore, local variance pair is utilized Said structure enriches district and classifies and obtain marginal texture district and irregular grain district.
The local variance of kth image block is:
Var k = 1 n &times; m &Sigma; x = 1 n &Sigma; y = 1 m | f ( x , y ) - f &OverBar; k | 2 - - - ( 6 )
Wherein,For the average pixel value in image block.Set threshold value T2, wherein T2For empirical, typically take T2 =300.Work as Vark< T2Time, image block is irregular grain district, otherwise image block is marginal texture district.Fig. 5 (c) is given and finishes Closing gradient weighted value and the image classification results of local variance, wherein black region represents smooth area, and grey parts represents and do not advises Then texture area, white portion represents structural area, edge.It can be seen that the figure that gradient weighted value and local variance combine As tagsort effect is preferable.
Image block is being divided into, by architectural feature, the sub-district that marginal texture district, irregular grain district are different with smooth area three Behind territory, the image pattern block of zones of different is carried out dictionary training, obtain the complete dictionary of corresponding mistake.Below with smooth Dictionary DsAs a example by, illustrate that K-SVD algorithm realizes process to dictionary training.
According to sparse representation model:
min D , X | | Y - D X | | 2 s . t | | x i | | 0 < K - - - ( 7 )
Wherein, D=[d1,d2,…,dL] it was complete dictionary, K < < L represents xiMaximum degree of rarefication be K; Represent and treat training signal, the sample image block of the most same feature.Algorithm while solving D also to sparse coefficient xiCarry out sparse Coding.Due to l0The nonconvex property of problem, generally uses OMP algorithm to solve.But dictionary training algorithm is otherwise varied with formula (7) , training signalIt is known that and cross complete dictionary D be unknown, it needs to be obtained by dictionary training algorithm.
Assume Ys={ yi|i∈ΩsRepresent that select from smooth region image block treats training sample set of blocks, ΩsTable Show smooth region image block, can be described as by the process of the characteristics dictionary corresponding to this sample set of K-SVD Algorithm for Training:
min D s , X s | | Y s - D s x s | | 2 s . t | | x i | | 0 < K , i &Element; &Omega; s - - - ( 8 )
In order to solve formula (8), it is necessary to first initialize dictionary Ds.In order to accelerate convergence of algorithm speed, select in the present invention Select image sorted smoothed image block to DsInitialize.
K-SVD algorithm is the estimation that the step according to sparse coding provides sample block set, thus update in dictionary each Individual atom.Specifically, D to be updatedsIn kth row dk, then formula (8) can be rewritten as:
Wherein, DsXsBe broken down into matrix that K order is 1 and, remaining K-1 item is all fixing, and remaining 1 row seek to The row updated, EkRepresent and remove atom dkThe error afterwards all samples caused, and then to EkCarry out SVD decomposition, update dk.With Said method, by { d1,d2,…,dLAll atoms in } are all updated, i.e. to dictionary DsComplete training.
So, according to the training method of above K-SVD, the image block classified just can obtain and cross complete dictionary accordingly: limit Edge dictionary De, irregular grain dictionary DtAnd smooth dictionary Ds
3rd step: l will be approximated0The sparse restructing algorithm SL0 of norm is applied to the image repair of rarefaction representation.Use approximation Hyperbolic tangent function goes to approximate l0Norm, utilizes conjugate gradient method to solve this function.
Owing to the mathematical model of SL0 is:
min||X||0, s.t.Y=DX (10)
Vector X=[x1 x2 … xn]T, its l0Norm represents the number of non-zero element in vector X, if assuming:
f ( x ) = 1 , x &NotEqual; 0 0 , x = 0 - - - ( 11 )
Then:
| | X | | 0 = &Sigma; i = 1 n f ( x i ) - - - ( 12 )
Therefore, as long as finding continuous function f (x) the most smooth, it is possible to well approach | | X | |0Value. There is " abruptness " significantly smooth continuous function to construct, and this continuous function can accurately approach l0Norm.Therefore originally Near-hyperbolic tan shown in invention employing formula (13) is as approximate evaluation l0The function of norm.
f &sigma; ( x ) = 1 8 e x 2 2 &sigma; 2 - e - x 2 2 &sigma; 2 e x 2 2 &sigma; 2 + e - x 2 2 &sigma; 2 + 7 8 ( 1 - e - 8 x 2 &sigma; 2 ) - - - ( 13 )
Knowable to formula (13), variable σ value is the least, and near-hyperbolic tan " abruptness " is the most obvious, more approaches l0Norm, But along with constantly diminishing of σ value, function curve is more and more rough.Therefore, choosing of σ parameter is the most crucial, choosing of it L must approached0Degree and the smoothing of functions degree of norm take compromise between the two.To this end, use one group of σ sequence { σ successively decreased1, σ2,…,σnBe used for approaching object function, carry out the optimum of solved function to utilizing steepest descent method while σ each time value.
The direction of search of steepest descent method is the negative gradient direction of function, and closer to desired value, step-length is the least, advances more Slowly, solution procedure exists sawtooth effect so that l0The accuracy that norm is estimated reduces.And the direction of search of conjugate gradient method For the linear combination in negative gradient direction with the direction of search of last iteration, the sawtooth effect that steepest descent method is brought can be solved Should.
For solving this kind of nothing of minf (x) about fasciculation problem, it is assumed that an initial value x0, obtain x through series of iterationsn。 If current iterative value is xk, then next iterative value i.e. xk+1=xk+u×dk, u represents iteration step length, dkRepresent and ask minimum The direction of search of value, use conjugate gradient method solution formula is:
d k = - g k , k = 1 - g k + &beta; k d k - 1 , k &GreaterEqual; 2 - - - ( 14 )
Wherein, gkThe gradient of representative function f (x), βkCan be solved by different conjugate gradient methods.To βkSolve Method uses mixing conjugate gradient method, i.e. mixes FR (Fletcher-Reeves) conjugate gradient method and PRP (Polak, Ribiere And Polyar) conjugate gradient method:
&beta; k = &beta; k P R P , 0 < &beta; k P R P < &beta; k F R &beta; k F R , e l s e - - - ( 15 )
The conjugate gradient method of this mixing avoids the shortcoming that may produce continuous little step-length;Simultaneously as conjugate gradient The direction of the iteration each time of method is all that last iteration direction forms with negative gradient directional combination, it is possible to overcome steepest descent method The crenellated phenomena brought.
Therefore, utilize the sparse representation method of SL0, classification repair all kinds of characteristic information of image to realize step as follows:
(1) initial value is made to be respectively X=DT(DDT)-1Y, σ1=2max (X), k=1;
(2) j=1,2 ..., L, (L is conjugate gradient method iterations, L=5) utilizes conjugate gradient method to solve gnThe gradient of representative function f (x):
1. direction is searched:
②X←X+μdn, wherein step factor μ=1.5;
③X←X-DT(DDT)-1(DX-Y);
4. n=n+1, j=j+1;If j is < L, then repeat step 1., 2., 3.;
(3) k=k+1, σk=η σk-1, η ∈ [0.51], repeat step (2), until σk< ε, ε=0.01, now obtain X's Optimal solution.
In order to check the repairing effect of inventive algorithm, image is simulated emulation, and carries out with other algorithms Contrast experiment.Emulation experiment is carried out under MATLAB environment.When image repair effect is commented, in addition to using subjective assessment, It is also adopted by Y-PSNR (PSNR) simultaneously and carries out objective evaluation.
Fig. 6 and Fig. 7 gives reparation algorithm [1], repairs algorithm [2], reparation algorithm [3] and this algorithm to breakage image Baboon and Barb carries out the result of repair process.From Fig. 6 Baboon repairing effect figure it can be seen that at nose mid portion (smooth region), the repairing effect of four kinds of algorithms is the most more satisfactory;In the breakage of nose Yu cheek junction, repair algorithm [1], All there is structural break phenomenon (Fig. 6 (c), Fig. 6 (d) and Fig. 6 (e) shown in) in algorithm [2] and algorithm [3] after repairing, but this algorithm The marginal texture of nose smooths after repair;For the reparation of eye portion, this part-structure and texture information are the most complicated, calculate In the upper right portion of eyes, method [1] and algorithm [2] occur that the factitious white of bulk extends (shown in Fig. 6 (c), Fig. 6 (d)), Eye structure is caused heavy damage, after algorithm [3] reparation, occurs in that certain extension phenomenon (shown in Fig. 6 (e)) at canthus, And this algorithm canthus after repair maintains clear nothing around good architectural feature and eyeball and extends phenomenon, repairing effect compares Natural (shown in Fig. 6 (f)).
From the result of Fig. 7 Barb figure repair process it can be seen that four kinds of algorithms are equal at arm (smooth region) repairing effect Well;Four kinds of algorithms are preferable at table leg marginal portion (smooth area and edge calmodulin binding domain CaM) repairing effect;Repairing scarf part Time (texture with edge calmodulin binding domain CaM), algorithm [1], algorithm [2] and algorithm [3] all occur the incoherent phenomenon of texture (Fig. 7 (c), Shown in Fig. 7 (d) and Fig. 7 (e)), repairing effect is fuzzyyer;And first this algorithm owing to being repaired the edge of scarf, Define certain structural constraint, therefore repair back edge structure and be maintained, and clean mark, the most natural (Fig. 7 of trend Shown in (f)).
Fig. 8 and Fig. 9 sets forth the comparison of object removal treatment effect.Fig. 8 gives and Baboon figure is carried out English The result that letter removal processes.It can be seen that repair Baboon figure nose in the middle part of etc. image smoothing district time, four kinds The repairing effect of algorithm is the best;But algorithm [2] and algorithm [3] are when repairing nose with cheek intersection, and nose border occurs Phenomenon of rupture (Fig. 8 (d) and Fig. 8 (e) draws black circle part), structure is destroyed, and other two kinds of algorithms can keep structure herein Coherent;When repairing the lines of cheek, all there is factitious extension (Fig. 8 (c), Fig. 8 in algorithm [1], algorithm [2] and algorithm [3] Shown in (d) and Fig. 8 (e)), do not meet visual law, and this algorithm repairing effect is more satisfactory;Beard part in Baboon figure belongs to In texture structure complex region, algorithm [1], algorithm [2] and algorithm [3] these three algorithm all occur fuzzy or factitious prolong Stretch phenomenon (Fig. 8 (c), Fig. 8 (d) and Fig. 8 (e) are shown), and this algorithm is at texture part repairing effect natural (shown in Fig. 8 (f)).
Fig. 9 gives the simulation experiment result removing material object.It can be seen that algorithm [1], algorithm [2] and calculation There is edge distortion and discontinuous phenomenon (Fig. 9 (c), Fig. 9 (d) and Fig. 9 (e) are shown) when repairing bank in method [3], and edge is tied Structure cannot keep continuity, and repairing mark is obvious so that repairing effect is unnatural.And this algorithm removes effect very certainly to object So, visual law is met.
Figure 10 and Figure 11 sets forth the comparison that large area breakage is repaiied effect.Figure 10 gives and carries out Lena figure greatly The simulation experiment result that area is repaired, wherein damaged area is 10.1% (every fritter breakage size is 20 × 20 pixels).From figure In it can be seen that the reparation of the left cheek in Lena figure and part background area (smooth) is imitated by algorithm [1] and algorithm [2] Fruit the best (Figure 10 (c), Figure 10 (d) draw black circle part), and other two kinds of algorithms are the best to the repairing effect of this part;Hair The texture structure of part is complicated, and algorithm [1], algorithm [2] and algorithm [3] these three algorithm all occur when repairing hair portion Phenomenon of rupture (Figure 10 (c), Figure 10 (d) and Figure 10 (e) are shown), and the repairing effect of this algorithm is more satisfactory, hair portion after reparation The most there is not factitious phenomenon of rupture (shown in Figure 10 (f)) in proportion by subtraction.In parts such as crown, the brim of a hat and right cheek (drawing black circle part), all there is a certain degree of concavo-convex and factitious extension phenomenon when repairing its edge in first three algorithm, And the crack edge line of area to be repaired is first fitted by this algorithm, ensure the flatness of image border so that repair effect Fruit meets human eye vision effect (shown in Figure 10 (f)).
Figure 11 gives the simulation experiment result removing large area material object.It can be seen that algorithm [2] (Figure 11 Shown in (d)) when repairing sea level at a distance and these two parts of wave, discontinuous phenomenon all occurs, structural information is destroyed, There is obvious repairing mark;And algorithm [1], algorithm [2] and algorithm [3] are when repairing wave part, its edge lines are not Enough smooth, make material object remove effect unnatural (Figure 11 (c), Figure 11 (d) and Figure 11 (e) are shown);And this algorithm repairing effect is certainly So, visual law is met.
Above the preferred embodiments of the present invention and principle are described in detail, to those of ordinary skill in the art Speech, the thought provided according to the present invention, detailed description of the invention will change, and these changes also should be regarded as the present invention Protection domain.

Claims (8)

1. the classification rarefaction representation image repair method of an edge fitting, it is characterised in that: use integral edge and local edge The extracting method that edge combines, extracts the crack edge of area to be repaired, it is thus achieved that the marginal information of reflecting edge feature, Crack edge line is carried out curve fitting by certain rule according to these marginal informations, tight to ensure the reparation of image edge structure Lattice are retrained by edge wheel profile;Use and carry out dictionary training by tagsort, to strengthen the adaptivity of study dictionary;Adopt Go to approximate l with near-hyperbolic tan0Norm, utilizes conjugate gradient method to solve this function, it is achieved change tradition SL0 algorithm Enter, the SL0 restructing algorithm that need not estimate degree of rarefication is applied in the image repair of non-edge damaged area.
The classification rarefaction representation image repair method of a kind of edge fitting the most according to claim 1, it is characterised in that: obtain Take and repair the marginal information of image;
1-1. passes through Sobel operator extraction integral edge, it is thus achieved that the strong edge of breakage image, provides the whole of image for image repair Body marginal texture;
1-2. uses the principle of " by there are continuous 4 marginal points and above crack edge line is defined as agent structure edge ", Use integral edge to extract and extract the method realization combined with damaged neighboring area local edge, effectively obtain damaged surrounding zone The crack edge structural information in territory, finds the intersection point on border to be repaired and marginal information;By these broken curves correspondingly Connect, if broken curve is c1,c2,…,cn, it is designated as gathering Q, wherein broken curve ciStarting point be pi1;By broken curve ci? Its starting point pi1On the most contrary two broken curves of direction vector be connected;From there through curve ciDirection vector Q is divided It is two set Q1,Q2;After having classified, calculate the distance between each origin of curve, two closest for starting point curves are led to The method crossing quadratic polynomial curve matching is attached.
The classification rarefaction representation image repair method of a kind of edge fitting the most according to claim 2, it is characterised in that institute The method by two closest for starting point curve negotiating quadratic polynomial curve matchings stated is attached, and concrete steps are such as Under:
1-2-1. is for arbitrary broken curve ci, by starting point pi1Set out, obtain ciOn other each point pi2,pi3,pi4,;IfFor a pi,jCoordinate vector, then curve ciIn starting point pi1On direction vector be defined as:
s &RightArrow; i = 0.5 ( p &RightArrow; i , 1 - p &RightArrow; i , 2 ) + 0.25 ( p &RightArrow; i , 2 - p &RightArrow; i , 3 ) + 0.125 ( p &RightArrow; i , 3 - p &RightArrow; i , 4 ) - - - ( 1 )
Wherein,WillIt is unitization,
1-2-2. circulation step 1-2-1 obtains every broken curve ciDirection vector, by c1Put into set Q1In, then travel through Remaining all curve ci, obtain and Q1In all direction of curve vector angles and minimum curve, be designated as cmin, and put into collection Close Q1, until Q1In the half that element is master curve quantity, remaining curve put into set Q2
c min &Element; Q 1 , i f f &Sigma; c i &Element; Q 1 &theta; ( s &RightArrow; i , s &RightArrow; min ) = min c j &Element; Q - Q 1 { &Sigma; c j &Element; Q 1 &theta; ( s &RightArrow; i , s &RightArrow; j ) } - - - ( 2 )
1-2-3., by after the curve classification in Q, takes Q1In a curve, at Q2Middle searching and Q1In the origin of curve chosen away from From nearest curve, these two curves are carried out quadratic polynomial curve matching, i.e. completes the connection of broken curve;When completing this Article two, after the connection of broken curve, by these two curves respectively from set Q1,Q2Middle rejecting, then according to said method is to remaining Curve process, until fracture curve all connected, obtain repair edge contour information.
The classification rarefaction representation image repair method of a kind of edge fitting the most according to claim 1, it is characterised in that institute The employing stated carries out dictionary training by tagsort, specific as follows:
Use the method combining image block gradient information and local variance that image block is classified, make optional position in image (x, pixel value y) be f (x, y), the Grad in its 4 directions up and down is:
g 1 ( x , y ) = | f ( x , y ) - f ( x - 1 , y ) | g 2 ( x , y ) = | f ( x , y ) - f ( x + 1 , y ) | g 3 ( x , y ) = | f ( x , y ) - f ( x , y - 1 ) | g 4 ( x , y ) = | f ( x , y ) - f ( x , y + 1 ) | - - - ( 3 )
Take the weights that greatest gradient value is this pixel on these 4 directions:
G (x, y)=max{g1(x,y),g2(x,y),g3(x,y),g4(x, y) } (4) by each image block (size is n × m) Each pixel carry out gradient weighting, its size is:
u k = &Sigma; x = 1 n &Sigma; y = 1 m g ( x , y ) &times; f ( x , y ) &Sigma; x = 1 n &Sigma; y = 1 m g ( x , y ) - - - ( 5 )
ukGradient weighted value for kth image block;In order to be classified by image block, set threshold value T1, wherein T1For warp Test constant, work as uk< T1Time, expression image block is smooth area, otherwise image block is structure-rich district;Although marginal texture district and not The graded in regular veins region is all universal relatively big, but the local variance of image tends to preferably embody the details of image Information, it comprises a large amount of structural informations of image;Therefore, utilize local variance that said structure is enriched district to classify again To marginal texture district and irregular grain district;
The local variance of kth image block is:
Var k = 1 n &times; m &Sigma; x = 1 n &Sigma; y = 1 m | f ( x , y ) - f &OverBar; k | 2 - - - ( 6 )
Wherein,For the average pixel value in image block;Set threshold value T2, wherein T2For empirical, work as Vark< T2Time, Image block is irregular grain district, otherwise image block is marginal texture district;
Image block is being divided into marginal texture district, three the different subregions in irregular grain district and smooth area by architectural feature After, the image pattern block of zones of different is carried out dictionary training, obtains the complete dictionary of corresponding mistake.
The classification rarefaction representation image repair method of a kind of edge fitting the most according to claim 1, it is characterised in that institute The T stated1=100, T2=300.
The classification rarefaction representation image repair method of a kind of edge fitting the most according to claim 4, it is characterised in that make With K-SVD algorithm to dictionary training, by specific as follows for the process that the image pattern block of smooth area carries out dictionary training:
According to sparse representation model:
min D , X | | Y - D X | | 2 s . t | | x i | | 0 < K - - - ( 7 )
Wherein, D=[d1,d2,…,dL] it was complete dictionary, K < < L represents xiMaximum degree of rarefication be K;Represent Treat training signal, the sample image block of the most same feature;Algorithm while solving D also to sparse coefficient xiCarry out sparse volume Code;Due to l0The nonconvex property of problem, generally uses OMP algorithm to solve;But dictionary training algorithm is otherwise varied with formula (7) It is, training signalIt is known that and cross complete dictionary D be unknown, it needs to be obtained by dictionary training algorithm;
Assume Ys={ yi|i∈ΩsRepresent that select from smooth region image block treats training sample set of blocks, ΩsRepresent smooth Area image block, can be described as by the process of the characteristics dictionary corresponding to this sample set of K-SVD Algorithm for Training:
min D s , X s | | Y s - D s x s | | 2 s . t | | x i | | 0 < K , i &Element; &Omega; s - - - ( 8 )
In order to solve formula (8), it is necessary to first initialize dictionary Ds;In order to accelerate convergence of algorithm speed, at this algorithms selection image Sorted smoothed image block is to DsInitialize;
K-SVD algorithm is the estimation that the step according to sparse coding provides sample block set, thus it is former to update each in dictionary Son;Specifically, smooth dictionary D to be updatedsIn kth row dk, then formula (8) can be rewritten as:
| | Y s - D s x s | | 2 = | | Y s - &Sigma; j = 1 K d j x j | | 2 = | | ( Y s - &Sigma; j &NotEqual; k K d j x j ) - d k x k | | 2 = | | E k - d k x k | | 2 - - - ( 9 )
Wherein, DsXsBe broken down into matrix that K order is 1 and, remaining K-1 item is all fixing, and remaining 1 row seek to update Row, EkRepresent and remove atom dkThe error afterwards all samples caused, and then to EkCarry out SVD decomposition, update dk;With above-mentioned Method, by { d1,d2,…,dLAll atoms in } are all updated, i.e. to smooth dictionary DsComplete training.
The classification rarefaction representation image repair method of a kind of edge fitting the most according to claim 6, it is characterised in that root According to the training method of K-SVD, same structural area, edge and irregular grain block are carried out dictionary training, thus by classifying Image block obtained accordingly cross complete dictionary: edge dictionary De, irregular grain dictionary Dt
The classification rarefaction representation image repair method of a kind of edge fitting the most according to claim 1, it is characterised in that adopt Go to approximate l with near-hyperbolic tan0Norm, utilizes conjugate gradient method to solve this function, the improvement tool to tradition SL0 algorithm Body is accomplished by
Owing to the mathematical model of SL0 is:
min||X||0, s.t. Y=DX (10)
Vector X=[x1 x2 … xn]T, its l0Norm represents the number of non-zero element in vector X, if assuming:
f ( x ) = 1 , x &NotEqual; 0 0 , x = 0 - - - ( 11 )
Then:
| | X | | 0 = &Sigma; i = 1 n f ( x i ) - - - ( 12 )
Therefore, as long as finding continuous function f (x) the most smooth, it is possible to well approach | | X | |0Value;In order to Structure has " abruptness " and significantly smooths continuous function, and this continuous function can accurately approach l0Norm;Employing formula (13) Shown near-hyperbolic tan is as approximate evaluation l0The function of norm;
f &sigma; ( x ) = 1 8 e x 2 2 &sigma; 2 - e - x 2 2 &sigma; 2 e x 2 2 &sigma; 2 + e - x 2 2 &sigma; 2 + 7 8 ( 1 - e - 8 x 2 &sigma; 2 ) - - - ( 13 )
Knowable to formula (13), variable σ value is the least, and near-hyperbolic tan " abruptness " is the most obvious, more approaches l0Norm, but with Constantly diminishing of σ value, function curve is more and more rough;Therefore, choosing of σ parameter is the most crucial, and choosing of it is necessary Approaching l0Degree and the smoothing of functions degree of norm take compromise between the two;To this end, use one group of σ sequence { σ successively decreased1, σ2,…,σnBe used for approaching object function, carry out the optimum of solved function to utilizing steepest descent method while σ each time value;
For solving this kind of nothing of minf (x) about fasciculation problem, it is assumed that an initial value x0, obtain x through series of iterationsn;If Current iterative value is xk, then next iterative value i.e. xk+1=xk+u×dk, u represents iteration step length, dkExpression is minimized The direction of search, use conjugate gradient method solution formula is:
d k = - g k k = 1 - g k + &beta; k d k - 1 , k &GreaterEqual; 2 - - - ( 14 )
Wherein, gkThe gradient of representative function f (x), βkCan be solved by different conjugate gradient methods;To βkMethod for solving Use mixing conjugate gradient method, i.e. mix FR (Fletcher-Reeves) conjugate gradient method and PRP conjugate gradient method:
&beta; k = &beta; k P R P , 0 < &beta; k P R P < &beta; k F R &beta; k E R , e l s e - - - ( 15 )
Therefore, utilize the sparse representation method of SL0, classification repair all kinds of characteristic information of image to realize step as follows:
(1) initial value is made to be respectively X=DT(DDT)-1Y, σ1=2max (X), k=1;
(2) j=1,2 ..., L, (L is conjugate gradient method iterations, L=5) utilizes conjugate gradient method to solvegnGeneration The gradient of table function f (x):
1. direction is searched:②X ←X+μdn, wherein step factor μ=1.5;
③X←X-DT(DDT)-1(DX-Y);
4. n=n+1, j=j+1;If j is < L, then repeat step 1., 2., 3.;
(3) k=k+1, σk=η σk-1, η ∈ [0.5 1], repeat step (2), until σk< ε, ε=0.01, now obtain X Excellent solution.
CN201610639370.9A 2016-08-04 2016-08-04 A kind of classification rarefaction representation image repair method of edge fitting Active CN106296606B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610639370.9A CN106296606B (en) 2016-08-04 2016-08-04 A kind of classification rarefaction representation image repair method of edge fitting

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610639370.9A CN106296606B (en) 2016-08-04 2016-08-04 A kind of classification rarefaction representation image repair method of edge fitting

Publications (2)

Publication Number Publication Date
CN106296606A true CN106296606A (en) 2017-01-04
CN106296606B CN106296606B (en) 2019-07-23

Family

ID=57666258

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610639370.9A Active CN106296606B (en) 2016-08-04 2016-08-04 A kind of classification rarefaction representation image repair method of edge fitting

Country Status (1)

Country Link
CN (1) CN106296606B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109146805A (en) * 2018-07-26 2019-01-04 浙江工业大学 The image repair method of frame is extracted based on the double-deck piecemeal
CN109886887A (en) * 2019-01-28 2019-06-14 深圳大学 A kind of mural painting image repair processing method, system, device and storage medium
CN107256538B (en) * 2017-06-08 2019-10-01 大连海事大学 A kind of image repair method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102147915A (en) * 2011-05-06 2011-08-10 重庆大学 Method for restoring weighting sparse edge regularization image
WO2012041861A2 (en) * 2010-09-27 2012-04-05 Qlucore Ab Computer-implemented method for analyzing multivariate data
CN103700065A (en) * 2013-12-03 2014-04-02 杭州电子科技大学 Structure sparsity propagation image repairing method adopting characteristic classified learning
CN103745432A (en) * 2013-12-03 2014-04-23 杭州电子科技大学 Image inpainting method in which structural constraint and sample sparse representation are combined

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012041861A2 (en) * 2010-09-27 2012-04-05 Qlucore Ab Computer-implemented method for analyzing multivariate data
CN102147915A (en) * 2011-05-06 2011-08-10 重庆大学 Method for restoring weighting sparse edge regularization image
CN103700065A (en) * 2013-12-03 2014-04-02 杭州电子科技大学 Structure sparsity propagation image repairing method adopting characteristic classified learning
CN103745432A (en) * 2013-12-03 2014-04-23 杭州电子科技大学 Image inpainting method in which structural constraint and sample sparse representation are combined
CN103700065B (en) * 2013-12-03 2016-07-06 杭州电子科技大学 A kind of structure sparse propagation image repair method of tagsort study

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107256538B (en) * 2017-06-08 2019-10-01 大连海事大学 A kind of image repair method
CN109146805A (en) * 2018-07-26 2019-01-04 浙江工业大学 The image repair method of frame is extracted based on the double-deck piecemeal
CN109146805B (en) * 2018-07-26 2021-02-02 浙江工业大学 Image restoration method based on double-layer block extraction framework
CN109886887A (en) * 2019-01-28 2019-06-14 深圳大学 A kind of mural painting image repair processing method, system, device and storage medium

Also Published As

Publication number Publication date
CN106296606B (en) 2019-07-23

Similar Documents

Publication Publication Date Title
CN105957066B (en) CT image liver segmentation method and system based on automatic context model
CN108053417A (en) A kind of lung segmenting device of the 3DU-Net networks based on mixing coarse segmentation feature
CN103218791B (en) Based on the image de-noising method of sparse self-adapting dictionary
DE10291878B4 (en) Image segmentation detection method in industrial radiation imaging
Alom et al. Skin cancer segmentation and classification with NABLA-N and inception recurrent residual convolutional networks
CN103455991B (en) A kind of multi-focus image fusing method
CN107506761A (en) Brain image dividing method and system based on notable inquiry learning convolutional neural networks
CN107657602A (en) Based on the breast structure disorder recognition methods for migrating convolutional neural networks twice
CN105608690B (en) A kind of image partition method being combined based on graph theory and semi-supervised learning
CN106530247B (en) A kind of multi-scale image restorative procedure based on structural information
CN105574475A (en) Common vector dictionary based sparse representation classification method
CN102354397A (en) Method for reconstructing human facial image super-resolution based on similarity of facial characteristic organs
CN104346617A (en) Cell detection method based on sliding window and depth structure extraction features
CN104217406B (en) SAR image noise reduction method based on shear wave coefficient processing
Tu et al. Automatic measurement algorithm of scoliosis Cobb angle based on deep learning
CN106296606A (en) A kind of classification rarefaction representation image repair method of edge fitting
CN103150712A (en) Image denoising method based on projection sequential data similarity
CN106023098B (en) Image mending method based on the more dictionary learnings of tensor structure and sparse coding
CN103310457A (en) Lung parenchyma segmentation method based on convex hulls correcting by parabolic
CN104036479A (en) Multi-focus image fusion method based on non-negative matrix factorization
CN106056141A (en) Target recognition and angle coarse estimation algorithm using space sparse coding
CN102831614A (en) Sequential medical image quick segmentation method based on interactive dictionary migration
CN109215040A (en) A kind of tumor of breast dividing method based on multiple dimensioned weighting study
CN105138983A (en) Pedestrian detection method based on weighted part model and selective search segmentation
Kekre et al. Color image segmentation using kekre's fast codebook generation algorithm based on energy ordering concept

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant