CN105303530A - Fabric image mole stripe elimination method based on low-rank sparse matrix decomposition - Google Patents

Fabric image mole stripe elimination method based on low-rank sparse matrix decomposition Download PDF

Info

Publication number
CN105303530A
CN105303530A CN201510639274.XA CN201510639274A CN105303530A CN 105303530 A CN105303530 A CN 105303530A CN 201510639274 A CN201510639274 A CN 201510639274A CN 105303530 A CN105303530 A CN 105303530A
Authority
CN
China
Prior art keywords
moire
matrix
image
fabric
low
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510639274.XA
Other languages
Chinese (zh)
Other versions
CN105303530B (en
Inventor
杨敬钰
刘芳蕾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201510639274.XA priority Critical patent/CN105303530B/en
Publication of CN105303530A publication Critical patent/CN105303530A/en
Application granted granted Critical
Publication of CN105303530B publication Critical patent/CN105303530B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Treatment Of Fiber Materials (AREA)
  • Image Processing (AREA)

Abstract

The invention belongs to the digital image processing field and is for eliminating mole stripe patterns in fabric images. The fabric image mole stripe elimination method based on low-rank sparse matrix decomposition is characterized in that, local self-similarity of fabric textures and energy concentration distribution characteristics of the mole stripe in a frequency domain are utilized, a low rank sparse matrix decomposition model is constructed, the fabric textures are separated from the mole stripe pattern, and thereby a problem of mole stripes in the fabric image can be solved. The fabric image mole stripe elimination method based on low-rank sparse matrix decomposition is mainly applied to digital image processing.

Description

Fabric image moire elimination method based on low-rank sparse matrix decomposition
Technical Field
The invention belongs to the field of digital image processing, and particularly relates to a method for eliminating moire of a fabric image based on low-rank sparse matrix decomposition.
Background
Moire phenomena are highly prevalent in modern digital imaging processes, such as: a scanner scans a halftone print, a digital camera takes a picture of a screen or a scene containing a regular pattern (a cloth line on clothing, a window or grid on a building). Moire patterns tend to have large areas and obvious color cast in images, seriously affect image quality and image analysis results, and attract wide attention of people.
So far, image moir é removal algorithms are mainly directed to halftone scanned images. Among the types of moire in the image, the moire in the halftone image is a relatively simple moire pattern, and its shape, distribution, etc. are closely related to the printer apparatus without being affected by the original image. These algorithms are mainly classified into two broad categories, filtering-based methods and dictionary learning-based methods. Another relatively simple image moire is the moire phenomenon caused by interference of rays during the imaging process of a radiation microscope, and nearly parallel moire fringes are distributed throughout the whole image. For such moire, the most common current method of elimination is to select a suitable median gaussian filter, but inevitably produces a slight ringing effect at the local edge locations.
However, since the moire pattern in the fabric image is relatively complex: 1) the stripe distribution has no obvious rule, and the color cast is obvious; 2) moire patterns are similar to fabric textures, thus making it more difficult to eliminate such Moire patterns. To eliminate such moir é, most manufacturers choose to embed an optical low-pass filter in the digital camera to suppress the occurrence of moir é at the expense of image sharpness. The other solution is to design a special CFA (color Filter array) interpolation algorithm, and estimate aliasing information of a red channel and a blue channel and lost high-frequency information by using high-frequency information captured by a green channel to avoid the occurrence of a moire phenomenon; the method is severely limited by the shot image, and the complex interpolation algorithm increases the internal processing load of the camera, so that the method is not a reliable method for eliminating moire fringes. At present, the most effective post-processing method for eliminating moire fringes generated in the imaging process of a digital camera is to use Photoshop software, manually select a moire region, remove the color of the moire fringes in the region, and then repair a brightness layer by using chrominance and saturation information to eliminate gray moire fringes. In a word, no efficient processing algorithm for the moire phenomenon in the fabric image is provided at present, and the moire interference can be eliminated while the image sharpness is kept.
Disclosure of Invention
The invention aims to make up the defects of the prior art, namely, the elimination of the moire pattern in the fabric image is realized. The method adopts the technical scheme that a low-rank sparse matrix decomposition-based fabric image moire elimination method utilizes local self-similarity of fabric textures and energy concentration distribution characteristics of moire patterns in a frequency domain to construct a low-rank sparse matrix decomposition model and separate the fabric textures from moire patterns, so that the problem of eliminating moire in a fabric image is solved. The method comprises the following steps:
1) overlapping images I with u/2 as step intervalMDivided into image blocks of size u × u, then each image block y ' is processed to achieve separation of the fabric texture x ' from the moir pattern m ', i.e.:
y′=x′+m′(1)
2) constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented by a Discrete Cosine Transform (DCT) dictionary, and the formula is as follows:
min||α||1constraint m ═ D α Ω (2)
Wherein min represents solving the corresponding minimum value, | | · |. non-calculation1Representing a matrixThe norm of the number of the first-order-of-arrival,is the constructed DCT dictionary and is,representing a real space, N, p representing the size of the spatial dimension,representing a two-dimensional real number space of size N × p and N ═ u2,p>>N, the symbol ∈ denotes belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of the sparse representation of moire m under the dictionary, Ω is the constraint on the significant positions of the coefficients α, i.e. the values of the coefficients α at the non-significant positions are all set to zero;
3) constructing a low rank constraint term: the fabric texture image block x' is converted into k × k subblocks and converted into corresponding vector forms, the subblock vectors are arranged into a matrix C, and local self-similarity characteristics of the fabric texture in a space domain are utilized to add low-rank constraints as follows:
min||C||*(3)
wherein | · | purple sweet*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n is the number of sub-blocks, k2The size of the dimensions of the space is represented,denotes a size of k2One-dimensional real number space, i.e. vector; the construction equation for matrix C is as follows:
C = S ( I n ⊗ x ) - - - ( 4 )
wherein, the symbolIs the kronecker operator, InIs onen × n diagonal matrix, x fabric texture image block x' vector form, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,n;
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min‖C‖*+λ‖α‖1
constraint conditions y = x + m m = D α , α ∈ Ω C = S ( I n ⊗ x ) - - - ( 5 )
Where λ is a weighting factor, balancing the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min‖C‖*+λ‖α‖1
constraint conditions C = S ( I n ⊗ ( y - D α ) ) , α ∈ Ω - - - ( 6 )
Recent research results on low-rank matrix recovery and sparse representation show that adding weights to the minimization model can improve the low rank and sparsity of the obtained result, so that a re-weighting strategy is introduced into the formula (6) to obtain the following equation:
mintr(WCοΣ)+λ||Wαοα||1
constraint conditions C = S ( I n ⊗ ( y - D α ) ) , α ∈ Ω - - - ( 7 )
Wherein tr (-) denotes the trace of the matrix,Is a diagonal matrix formed by the singular values of the matrix C, diag (·) represents the diagonal matrix,is a singular value of a matrix, WCAnd WαThe weight matrixes corresponding to the low-rank term and the sparse term are respectively, and the symbol o represents the dot product operation of the two matrixes;
5) and finally solving the equation by using an augmented Lagrange method, and after a plurality of iterations, achieving convergence to finally obtain the needed low-rank matrix C and the coefficient vector alpha of the Moire pattern m sparsely represented under the DCT dictionary, thereby obtaining the fabric texture x and the Moire pattern m:
x = ( Σ i = 1 n s i T s i ) - 1 Σ i = 1 n s i T c i - - - ( 19 )
m=Dα(20)
wherein,is a summation formula (·)-1Represents the inverse of the matrix within the brackets;
6) and (3) performing the above processing on all image blocks in the image area of the moire pattern to finally obtain the fabric texture image I without the moire pattern and the separated moire component image M.
Further specifically, the step of constructing the sparse constraint term includes 21) in some cases, the red channel and the blue channel of the color image have moire patterns, and the green channel does not include any moire component, so that a plurality of moire image blocks of the red channel and the blue channel and a plurality of moire-free image blocks at corresponding positions of the green channel are selected, statistical distribution maps of DCT coefficients corresponding to the moire image blocks and the moire-free image blocks are respectively obtained, and a conclusion is obtained: the Moire pattern is concentrated in energy distribution at middle and low frequency positions in a frequency domain, so that all coefficients of alpha corresponding to the high frequency position are set to zero, namely omega is the middle and low frequency position of a DCT domain;
22) to prevent erroneous classification of the position of wrinkles, edges, shadows, etc. in the fabric image as moire components, usingThe norm gradient minimization method smoothes the image block y' to obtain an image block containing wrinkles, edges, shadows, etc. but not containing moire and fabric textures, and further constrains the effective position of the coefficient α, i.e., Ω, according to its energy distribution in the DCT domain.
5) And finally solving the equation by using an augmented Lagrange method, wherein the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFA Flobenius norm representing a matrix;
52) the iterative solution equation of equation (8) is as follows:
C k + 1 , &tau; = argmin C { L ( C , &alpha; k , &tau; , Q k , &tau; ) } &alpha; k + 1 , &tau; = argmin &alpha; { L ( C k + 1 , &tau; , &alpha; , Q k , &tau; ) } Q k + 1 , &tau; = Q k , &tau; + &mu; k , &tau; ( C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; k + 1 , &tau; ) ) ) &mu; k + 1 , &tau; = &rho;&mu; k , &tau; W C , g &tau; + 1 = 1 &sigma; g &tau; + &xi; , W &alpha; , g &tau; + 1 = 1 | &alpha; g &tau; | + &xi; - - - ( 9 )
argmin in the above formulaX{. is the value of variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g represents the position coordinates of the matrix elements;
53) solving for Ck+1,τSolving for C in the equation (9)k+1,τThe C-independent term in the objective function of (1) yields:
the above formula is rewritten using the recipe as:
wherein:
P k , &tau; = S ( I n &CircleTimes; ( y - D&alpha; k , &tau; ) ) - Q k , &tau; &mu; k , &tau;
using singular value threshold decomposition for equation (10) yields:
C k + 1 , &tau; = U k , &tau; s o f t ( &Sigma; k , &tau; , W C &tau; &mu; k , &tau; ) ( V k , &tau; ) T - - - ( 11 )
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices of, soft (,) is a contraction calculationA seed;
54) solving α using an accelerated neighbor gradient algorithmk+1,τThe solution α in equation (9) is removedk+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, construct a second order function to approximate the above equation, and then solve the original equation for the second order function:
order to f ( &alpha; ) = < Q k , &tau; , C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; &tau; ) ) > + &mu; k , &tau; 2 | | C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; &tau; ) ) | | F 2 , Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofUsed for ensuring that F (β) is less than or equal to T (α) for all β;
after the above conversion, the formula (12) is converted into the solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
&beta; j + 1 = &alpha; j + 1 k , &tau; + t j + 1 - 1 t j + 1 ( &alpha; j + 1 k , &tau; - &alpha; j k , &tau; ) t j + 1 = ( 1 + 4 t j 2 + 1 ) / 2 - - - ( 15 )
tjis a set of constant sequences, j and j +1 are the number of iterations, from which it is solved:
&alpha; k + 1 , &tau; = &alpha; j + 1 k , &tau; = s o f t ( U j + 1 , &lambda; L f W &alpha; &tau; ) - - - ( 16 )
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) when k reaches the maximum iteration number, updating the weight factor and the iteration count parameter tau:
W C , g &tau; + 1 = 1 &sigma; g &tau; + &xi; , W &alpha; , g &tau; + 1 = 1 | &alpha; g &tau; | + &xi; , &tau; = &tau; + 1 - - - ( 18 )
57) when τ reaches the maximum iteration number of the reweighting matrix, a coefficient vector α of the low-rank matrix C and the moire pattern m which are expected to be sparsely represented in the DCT dictionary can be obtained, so that a fabric texture x and the moire pattern m are obtained:
x = ( &Sigma; i = 1 n s i T s i ) - 1 &Sigma; i = 1 n s i T c i - - - ( 19 )
m=Dα(20)。
the invention has the technical characteristics and effects that:
the method avoids changing imaging equipment hardware, adopts a post-processing method, and separates the fabric texture from the moire pattern in the image by using a low-rank sparse matrix decomposition model, namely, the elimination of the moire of the fabric image is realized. Has the following characteristics:
1. the program is simple and easy to realize.
2. The elimination of moire in the fabric image is achieved.
3. Removing the moire pattern of the fabric image by adopting a low-rank coefficient matrix decomposition model: the elimination problem of the moire in the fabric image is attributed to the image segmentation problem, a low-rank sparse matrix decomposition model is constructed by utilizing the local self-similarity of the fabric texture and the energy concentration distribution characteristic of the moire in a frequency domain, and the fabric texture is separated from the moire pattern. Therefore, the difference between the fabric texture and the moire texture in the space domain and the frequency domain can be well utilized, and the fabric texture component and the moire texture component can be better distinguished.
4. The separation performance of the fabric texture and the moire pattern is improved by carrying out effective position constraint on the coefficient sparsely represented by the moire pattern under the DCT dictionary. This ensures that the positions of wrinkles, edges, shadows, etc. in the fabric image are not erroneously classified as moir é components.
Drawings
The above advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a comparison graph of the statistical distribution of DCT coefficients for an image block with a Moire and an image block without a Moire: 1) is a statistical distribution map of the DCT coefficients of the image block with Moire fringes; 2) is the DCT coefficient statistical distribution map of the image block without Moire; 3) difference graphs of the two;
FIG. 3 is an image of a moir é textured fabric;
FIG. 4 is a comparison of fabric image moire removal results: 1) is the result of the Photoshop software processing the figure 3; 2) is the result of the processing of figure 3 by the method of the present invention.
Detailed Description
The method for eliminating the moire of the fabric image based on the low-rank sparse matrix decomposition is described in detail below by combining the embodiment and the attached drawings.
The method adopts a low-rank sparse matrix decomposition model to remove the moire patterns of the fabric image: the elimination problem of the moire in the fabric image is attributed to the image segmentation problem, a low-rank sparse matrix decomposition model is constructed by utilizing the local self-similarity of the fabric texture and the energy concentrated distribution characteristic of the moire in a frequency domain, and the fabric texture is separated from the moire pattern; by restricting the distribution of the moire patterns in the frequency domain, the separation performance of the fabric texture and the moire patterns is improved, and the positions of folds, edges, shadows and the like in the fabric image are prevented from being mistaken as the moire patterns. The method comprises the following steps:
1) constructing initial data:
11) taking a fabric image with moire patterns downloaded from Google as experimental data;
12) overlapping images I with u/2 as step intervalMDivided into image blocks of size u × u, then each image block y ' is processed to achieve separation of the fabric texture x ' from the moir pattern m ', i.e.:
y′=x′+m′(1)
13) given the higher resolution of the Discrete Cosine Transform (DCT) domain than the Discrete Fourier Transform (DFT) domain, an N × p sized overcomplete DCT dictionary is constructed to sparsely represent the moir é pattern.
2) Constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented under the DCT dictionary, and the formula is as follows:
min||α||1constraint m ═ D α Ω (2)
Wherein min represents solving the corresponding minimum value, | | · |. non-calculation1Representing a matrixThe norm of the number of the first-order-of-arrival,is the constructed DCT dictionary and is,representing a real space, N, p representing the size of the spatial dimension,two-dimensional real number space of size N × p and N ═ u2,p>>N, the symbol ∈ denotes belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of the sparse representation of moire m under the dictionary, Ω is the constraint on the significant positions of the coefficients α, i.e. the values of the coefficients α at the non-significant positions are all set to zero;
21) in some cases, the red and blue channels of the color image have moire patterns and the green channel does not contain any moire components. Therefore, a plurality of image blocks with moire patterns of the red channel and the blue channel and a plurality of image blocks without moire patterns at corresponding positions of the green channel are selected, a statistical distribution graph of DCT coefficients corresponding to the image blocks with moire patterns and the image blocks without moire patterns is obtained, and a conclusion is obtained: the moire pattern is energy concentrated in the frequency domain at the mid and low frequency locations. Therefore, all the coefficients of the high-frequency position corresponding to the alpha are set to zero, namely omega is the middle-low frequency position of the DCT domain;
22) to prevent erroneous classification of the position of wrinkles, edges, shadows, etc. in the fabric image as moire components, usingThe norm gradient minimization method smoothes the image block y' to obtain an image block containing wrinkles, edges, shadows, etc. but not containing moire and fabric textures, and further constrains the effective position of the coefficient α, i.e., Ω, according to its energy distribution in the DCT domain.
3) Constructing a low rank constraint term: dividing a fabric texture image block x' into k × k subblocks and converting the subblocks into corresponding vector forms, arranging the subblock vectors into a matrix C, and adding low-rank constraint by using the local self-similarity characteristic of the fabric texture in a spatial domain as follows:
min||C||*(3)
wherein | · | purple sweet*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n is the number of sub-blocks, k2The size of the dimensions of the space is represented,denotes a size of k2Is a one-dimensional real number space (i.e., vector). The construction equation for matrix C is as follows:
C = S ( I n &CircleTimes; x ) - - - ( 4 )
wherein, the symbolIs the kronecker operator, InIs a diagonal matrix of n × n, x' vector form of x texture image block, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,n。
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min||C||*+λ||α||1
constraint conditions y = x + m m = D &alpha; , &alpha; &Element; &Omega; C = S ( I n &CircleTimes; x ) - - - ( 5 )
Where λ is a weighting factor, balancing the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min||C||*+λ||α||1
constraint conditions C = S ( I n &CircleTimes; ( y - D &alpha; ) ) , &alpha; &Element; &Omega; - - - ( 6 )
Recent research results on low-rank matrix recovery and sparse representation show that adding weight to the minimization model can improve the low rank and sparsity of the obtained result. Therefore, the present invention introduces a re-weighting strategy in equation (6), and obtains the following equation:
mintr(WCοΣ)+λ||Wαοα||1
constraint conditions C = S ( I n &CircleTimes; ( y - D &alpha; ) ) , &alpha; &Element; &Omega; - - - ( 7 )
Where tr (-) denotes the trace of the matrix,is a diagonal matrix formed by the singular values of the matrix C, diag (·) represents the diagonal matrix,is a singular value of a matrix, WCAnd WαThe weight matrices are respectively corresponding to the low-rank term and the sparse term, and the symbol o represents the dot product operation of the two matrices.
5) And finally solving the equation by using an augmented Lagrange method, wherein the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFA Flobenius norm representing a matrix;
52) the iterative solution equation of equation (8) is as follows:
C k + 1 , &tau; = argmin C { L ( C , &alpha; k , &tau; , Q k , &tau; ) } &alpha; k + 1 , &tau; = argmin &alpha; { L ( C k + 1 , &tau; , &alpha; , Q k , &tau; ) } Q k + 1 , &tau; = Q k , &tau; + &mu; k , &tau; ( C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; k + 1 , &tau; ) ) ) &mu; k + 1 , &tau; = &rho;&mu; k , &tau; W C , g &tau; + 1 = 1 &sigma; g &tau; + &xi; , W &alpha; , g &tau; + 1 = 1 | &alpha; g &tau; | + &xi; - - - ( 9 )
argmin in the above formulaX{. is the value of variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g represents the position coordinates of the matrix elements;
53) solving for Ck+1,τSolving for C in the equation (9)k+1,τThe C-independent term in the objective function of (1) yields:
the above formula is rewritten using the recipe as:
wherein:
P k , &tau; = S ( I n &CircleTimes; ( y - D&alpha; k , &tau; ) ) - Q k , &tau; &mu; k , &tau;
using singular value threshold decomposition for equation (10) yields:
C k + 1 , &tau; = U k , &tau; s o f t ( &Sigma; k , &tau; , W C &tau; &mu; k , &tau; ) ( V k , &tau; ) T - - - ( 11 )
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices, soft (·,) are the shrink operators.
54) Solving α using an accelerated neighbor gradient algorithmk+1,τThe solution α in equation (9) is removedk+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, a second order function is constructed to approximate the above formula, and then the original equation is solved for the second order function.
Order to f ( &alpha; ) = < Q k , &tau; , C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; &tau; ) ) > + &mu; k , &tau; 2 | | C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; &tau; ) ) | | F 2 , Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofIs used to ensure that F (β) is less than or equal to T (α) for all β.
After the above conversion, the formula (12) is converted into the solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
&beta; j + 1 = &alpha; j + 1 k , &tau; + t j + 1 - 1 t j + 1 ( &alpha; j + 1 k , &tau; - &alpha; j k , &tau; ) t j + 1 = ( 1 + 4 t j 2 + 1 ) / 2 - - - ( 15 )
tjis a set of constant sequences, and j +1 are the number of iterations. Thus, the following results are obtained:
&alpha; k + 1 , &tau; = &alpha; j + 1 k , &tau; = s o f t ( U j + 1 , &lambda; L f W &alpha; &tau; ) - - - ( 16 )
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) when k reaches the maximum iteration number, updating the weight factor and the iteration count parameter tau:
W C , g &tau; + 1 = 1 &sigma; g &tau; + &xi; , W &alpha; , g &tau; + 1 = 1 | &alpha; g &tau; | + &xi; , &tau; = &tau; + 1 - - - ( 18 )
57) when tau reaches the maximum iteration number of the re-weighting matrix, the low rank matrix C and the coefficient matrix alpha of sparse representation of the Moire pattern m under the DCT dictionary which are expected by us can be obtained. Thus, the fabric texture x and the molar pattern m can be obtained:
x = ( &Sigma; i = 1 n s i T s i ) - 1 &Sigma; i = 1 n s i T c i - - - ( 19 )
m=Dα(20)
wherein,is a summation formula (·)-1The inverse of the matrix in brackets is shown.
6) And (3) performing the above processing on all image blocks in the image area of the moire pattern to finally obtain the fabric texture image I without the moire pattern and the separated moire component image M.
The invention provides an image moire elimination method for low-rank sparse matrix decomposition (as shown in the flow of fig. 1), which is described in detail in the following with reference to the accompanying drawings and embodiments:
1) constructing initial data:
11) taking a fabric image with moire patterns downloaded from Google as experimental data;
12) overlapping the images I at step intervals of 32M(as shown in fig. 3) is divided into image blocks of size 64 × 64, and each image block y ' is then processed to achieve separation of the fabric texture x ' from the moir pattern m ', i.e.:
y′=x′+m′(1)
13) considering that a Discrete Cosine Transform (DCT) domain has higher resolution than a Discrete Fourier Transform (DFT) domain, constructing an overcomplete DCT dictionary with the size of 4096 x 6400 to sparsely represent Moire patterns;
2) constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented under the DCT dictionary, and the formula is as follows:
min||α||1constraint m ═ D α Ω (2)
Wherein min represents solving the corresponding minimum value, | | · |. non-calculation1Representing a matrixThe norm of the number of the first-order-of-arrival,is the constructed DCT dictionary and is,representing a real space, 4096,6400 is the size of the spatial dimension,a two-dimensional real space of size 4096 × 6400 is represented, symbol ∈ represents belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of sparse representation of moire m under a dictionary, Ω is the constraint on the effective position of the coefficient α, i.e. the values of the coefficient α at the non-effective position are all set to zero;
21) selecting a plurality of image blocks with moire patterns of the red channel and the blue channel and a plurality of image blocks without moire patterns at corresponding positions of the green channel, respectively obtaining a statistical distribution graph (shown in figure 2) of DCT coefficients of the image blocks with moire patterns and the image blocks without moire patterns, and obtaining a conclusion: the moire pattern is energy concentrated in the frequency domain at the mid and low frequency locations. Therefore, all the high-frequency position coefficients corresponding to alpha are set to zero, namely omega is the middle and low frequency position of the DCT domain;
22) to prevent erroneous classification of the position of wrinkles, edges, shadows, etc. in the fabric image as moire components, usingSmoothing the image block y' by a norm gradient minimization method to obtain an image block which contains folds, edges, shadows and the like and does not contain moire fringes and fabric textures, setting all values of a coefficient α at the energy distribution position to zero according to the energy distribution of the image block in a DCT domain, and further constraining the effective position of a coefficient α, namely limiting omega;
3) constructing a low rank constraint term: dividing a fabric texture image block x' into 8 x 8 sub-blocks and converting the sub-blocks into corresponding vector forms, arranging the sub-block vectors into a matrix C, and adding low-rank constraint as follows by utilizing the local self-similarity characteristic of the fabric texture in a spatial domain:
min||C||*(3)
wherein | · | purple sweet*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n-225 is the number of sub-blocks, 64 represents the size of the spatial dimension,representing a one-dimensional real space (i.e., a vector) of size 64. The construction equation for matrix C is as follows:
C = S ( I n &CircleTimes; x ) - - - ( 4 )
wherein, the symbolIs the kronecker operator, InIs a diagonal matrix of 225 × 225, x texture image blocks x' vector form, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,225。
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min||C||*+λ||α||1
constraint conditions y = x + m m = D &alpha; , &alpha; &Element; &Omega; C = S ( I n &CircleTimes; x ) - - - ( 5 )
Where λ is a weighting factor, with a value of 0.015, which is used to balance the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min||C||*+λ||α||1
constraint conditions C = S ( I n &CircleTimes; ( y - D &alpha; ) ) , &alpha; &Element; &Omega; - - - ( 6 )
Recent research results on low-rank matrix recovery and sparse representation show that adding weight to the minimization model can improve the low rank and sparsity of the obtained result. Therefore, the present invention introduces a re-weighting strategy in equation (6), and obtains the following equation:
mintr(WCοΣ)+λ||Wαοα||1
constraint conditions C = S ( I n &CircleTimes; ( y - D &alpha; ) ) , &alpha; &Element; &Omega; - - - ( 7 )
Where tr (·) denotes a trace of the matrix, Σ ═ diag ([ σ ])12,…,σ64]) Is a diagonal matrix formed by the singular values of the matrix C, diag (·) representing the diagonal matrix, σ12,…,σ64Is a singular value of a matrix, WCAnd WαThe weight matrices are respectively corresponding to the low-rank term and the sparse term, and the symbol o represents the dot product operation of the two matrices.
5) And finally solving the equation by using an augmented Lagrange method, wherein the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFThe frobenius norm of the matrix is represented.
52) The iterative solution equation of equation (8) is as follows:
C k + 1 , &tau; = argmin C { L ( C , &alpha; k , &tau; , Q k , &tau; ) } &alpha; k + 1 , &tau; = argmin &alpha; { L ( C k + 1 , &tau; , &alpha; , Q k , &tau; ) } Q k + 1 , &tau; = Q k , &tau; + &mu; k , &tau; ( C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; k + 1 , &tau; ) ) ) &mu; k + 1 , &tau; = &rho;&mu; k , &tau; W C , g &tau; + 1 = 1 &sigma; g &tau; + &xi; , W &alpha; , g &tau; + 1 = 1 | &alpha; g &tau; | + &xi; - - - ( 9 )
argmin in the above formulaX{. is the value of the variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g denotes the matrixThe position coordinates of the elements. Initial values were set in the experiment as: k = 1 , &tau; = 1 , &rho; = 1.2 , &mu; = 1.4 , C 1 = Q 1 = 0 , &alpha; 1 = 0 , W C 1 = 1 , W &alpha; 1 = 1 , &xi; = 10 - 5 .
53) solving for Ck+1,τRemoving C in the formula (9)k+1,τThe C-independent term in the objective function of (1) yields:
the formula is rewritten as follows:
wherein:
P k , &tau; = S ( I n &CircleTimes; ( y - D&alpha; k , &tau; ) ) - Q k , &tau; &mu; k , &tau;
using singular value threshold decomposition for equation (10) yields:
C k + 1 , &tau; = U k , &tau; s o f t ( &Sigma; k , &tau; , W C &tau; &mu; k , &tau; ) ( V k , &tau; ) T - - - ( 11 )
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices, soft (·,) are the shrink operators.
54) Solving α using an accelerated neighbor gradient algorithmk+1,τRemoval of α in formula (9)k+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, a second order function is constructed to approximate the above formula, and then the original equation is solved for the second order function.
Order to f ( &alpha; ) = < Q k , &tau; , C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; &tau; ) ) > + &mu; k , &tau; 2 | | C k + 1 , &tau; - S ( I n &CircleTimes; ( y - D&alpha; &tau; ) ) | | F 2 , Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofIs used to ensure that F (β) is less than or equal to T (α) for all β.
Through the stepsConversion, equation (12) to solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
&beta; j + 1 = &alpha; j + 1 k , &tau; + t j + 1 - 1 t j + 1 ( &alpha; j + 1 k , &tau; - &alpha; j k , &tau; ) t j + 1 = ( 1 + 4 t j 2 + 1 ) / 2 - - - ( 15 )
tjis a set of constant sequences, and j +1 are the number of iterations. Setting initial values as follows: j is 1, t1=1,β1=1。
The convergence can be solved as follows:
&alpha; k + 1 , &tau; = &alpha; j + 1 k , &tau; = s o f t ( U j + 1 , &lambda; L f W &alpha; &tau; ) - - - ( 16 )
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) the iteration number is set to 40, and when the maximum iteration number, namely k is 40, the weight matrix and the iteration count parameter tau are updated:
W C , g &tau; + 1 = 1 &sigma; g &tau; + &xi; , W &alpha; , g &tau; + 1 = 1 | &alpha; g &tau; | + &xi; , &tau; = &tau; + 1 - - - ( 18 )
57) when the iteration number of the re-weighting matrix is set to 4, that is, τ is 4, we can obtain the desired coefficient vector α of the low rank matrix C and the sparse representation of the moire pattern m under the DCT dictionary. Thus, the fabric texture x and the molar pattern m can be obtained:
x = ( &Sigma; i = 1 n s i T s i ) - 1 &Sigma; i = 1 n s i T c i - - - ( 19 )
m=Dα(20)
wherein,is a summation formula (·)-1The inverse of the matrix in brackets is shown.
6) And (3) performing the above processing on all image blocks in the image area with the moire pattern to finally obtain a fabric texture image I (shown in fig. 4) without the moire pattern and a separated moire component image M.

Claims (3)

1. A fabric image moire elimination method based on low-rank sparse matrix decomposition is characterized in that a low-rank sparse matrix decomposition model is constructed by utilizing local self-similarity of fabric textures and the energy concentration distribution characteristics of moire patterns in a frequency domain, and the fabric textures are separated from moire patterns, so that the problem of eliminating moire in a fabric image is solved.
1) Overlapping images I with u/2 as step intervalMDivided into image blocks of u × u size, and then each image block y 'is processed to achieve the division of the fabric texture x' into the Moire pattern mAnd (2) separating, namely:
y′=x′+m′(1)
2) constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented by a Discrete Cosine Transform (DCT) dictionary, and the formula is as follows:
min‖α‖1constraint m ═ D α Ω (2)
Wherein min represents finding the corresponding minimum value, | |)1The/1 norm of the matrix is represented,is the constructed DCT dictionary and is,representing a real space, N, p representing the size of the spatial dimension,representing a two-dimensional real number space of size N × p and N ═ u2P > N, the symbol ∈ denotes belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of the sparse representation of moire m under the dictionary, Ω is the constraint on the significant positions of coefficients α, i.e. the values of coefficients α at the non-significant positions are all set to zero;
3) constructing a low rank constraint term: the fabric texture image block x' is converted into k × k subblocks and converted into corresponding vector forms, the subblock vectors are arranged into a matrix C, and local self-similarity characteristics of the fabric texture in a space domain are utilized to add low-rank constraints as follows:
min‖C‖*(3)
wherein |*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n is the number of sub-blocks, k2The size of the dimensions of the space is represented,denotes a size of k2One-dimensional real number space, i.e. vector; the construction equation for matrix C is as follows:
wherein, the symbolIs the kronecker operator, InIs a diagonal matrix of n × n, x' vector form of x texture image block, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,n;
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min‖C‖*+λ‖α‖1
constraint conditions
Where λ is a weighting factor, balancing the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min‖C‖*+λ‖α‖1
constraint conditions
Recent research results on low-rank matrix recovery and sparse representation show that adding weights to the minimization model can improve the low rank and sparsity of the obtained result, so that a re-weighting strategy is introduced into the formula (6) to obtain the following equation:
mintr(WCоΣ)+λ‖Wαоα‖1
constraint conditions
Where tr (-) denotes the trace of the matrix,is a diagonal matrix formed by the singular values of the matrix C, diag (·) represents the diagonal matrix,is a singular value of a matrix, WCAnd WαThe weight matrixes respectively correspond to the low-rank term and the sparse term, and the symbol o represents the dot multiplication operation of the two matrixes;
5) and finally solving the equation by using an augmented Lagrange method, and after a plurality of iterations, achieving convergence to finally obtain the needed low-rank matrix C and the coefficient vector alpha of the Moire pattern m sparsely represented under the DCT dictionary, thereby obtaining the fabric texture x and the Moire pattern m:
m=Dα(20)
wherein,is a summation formula (·)-1Represents the inverse of the matrix within the brackets;
6) and (3) performing the above processing on all image blocks in the image area of the moire pattern to finally obtain the fabric texture image I without the moire pattern and the separated moire component image M.
2. The method for eliminating the moire of the fabric image based on the low rank sparse matrix decomposition as claimed in claim 1, characterized in that the specific method comprises the following steps:
further specifically, the step of constructing the sparse constraint term includes 21) in some cases, the red channel and the blue channel of the color image have moire patterns, and the green channel does not include any moire component, so that a plurality of moire image blocks of the red channel and the blue channel and a plurality of moire-free image blocks at corresponding positions of the green channel are selected, statistical distribution maps of DCT coefficients corresponding to the moire image blocks and the moire-free image blocks are respectively obtained, and a conclusion is obtained: the Moire pattern is concentrated in energy distribution at middle and low frequency positions in a frequency domain, so that all coefficients of alpha corresponding to the high frequency position are set to zero, namely omega is the middle and low frequency position of a DCT domain;
22) in case of dividing the positions of folds, edges, shadows and the like in the fabric image into moire components by mistake, smoothing the image block y' by using an l0 norm gradient minimization method to obtain an image block which contains the folds, edges, shadows and the like and does not contain moire and fabric textures, and further constraining the effective position of the coefficient alpha, namely limiting omega according to the energy distribution of the image block in the DCT domain.
3. The method for eliminating the moire of the fabric image based on the low-rank sparse matrix decomposition as claimed in claim 1, wherein 5) the equation is finally solved by using an augmented Lagrangian method, and the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFA Flobenius norm representing a matrix;
52) the iterative solution equation of equation (8) is as follows:
argmin in the above formulaX{. is the value of variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g represents the position coordinates of the matrix elements;
53) solving for Ck+1,τSolving for C in the equation (9)k+1,τThe C-independent term in the objective function of (1) yields:
the above formula is rewritten using the recipe as:
wherein:
using singular value threshold decomposition for equation (10) yields:
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices of (1), soft (·,) being a contraction operator;
54) solving α using an accelerated neighbor gradient algorithmk+1,τThe solution α in equation (9) is removedk+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, construct a second order function to approximate the above equation, and then solve the original equation for the second order function:
order to Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofUsed for ensuring that F (β) is less than or equal to T (α) for all β;
after the above conversion, the formula (12) is converted into the solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
tjis a set of constant sequences, j and j +1 are the number of iterations, from which it is solved:
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) when k reaches the maximum iteration number, updating the weight factor and the iteration count parameter tau:
57) when τ reaches the maximum iteration number of the reweighting matrix, a coefficient vector α of the low-rank matrix C and the moire pattern m which are expected to be sparsely represented in the DCT dictionary can be obtained, so that a fabric texture x and the moire pattern m are obtained:
m=Dα(20)。
CN201510639274.XA 2015-09-30 2015-09-30 Textile image moire fringes removing method based on low-rank sparse matrix decomposition Expired - Fee Related CN105303530B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510639274.XA CN105303530B (en) 2015-09-30 2015-09-30 Textile image moire fringes removing method based on low-rank sparse matrix decomposition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510639274.XA CN105303530B (en) 2015-09-30 2015-09-30 Textile image moire fringes removing method based on low-rank sparse matrix decomposition

Publications (2)

Publication Number Publication Date
CN105303530A true CN105303530A (en) 2016-02-03
CN105303530B CN105303530B (en) 2018-05-08

Family

ID=55200754

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510639274.XA Expired - Fee Related CN105303530B (en) 2015-09-30 2015-09-30 Textile image moire fringes removing method based on low-rank sparse matrix decomposition

Country Status (1)

Country Link
CN (1) CN105303530B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105957080A (en) * 2016-04-28 2016-09-21 王超维 Screen-photographed identity card photo identification method based on frequency domain
CN106373105A (en) * 2016-09-12 2017-02-01 广东顺德中山大学卡内基梅隆大学国际联合研究院 Multi-exposure image deghosting integration method based on low-rank matrix recovery
CN106408530A (en) * 2016-09-07 2017-02-15 厦门大学 Sparse and low-rank matrix approximation-based hyperspectral image restoration method
CN106960463A (en) * 2017-03-13 2017-07-18 东华大学 Towards the quick fitting method of three-dimensional virtual garment of real scan human body
CN106971377A (en) * 2016-08-22 2017-07-21 上海海洋大学 A kind of removing rain based on single image method decomposed based on sparse and low-rank matrix
CN107609573A (en) * 2017-08-17 2018-01-19 东华大学 High spectrum image time varying characteristic extracting method based on low-rank decomposition and empty spectrum constraint
CN108154487A (en) * 2017-12-25 2018-06-12 天津大学 Screen based on Multichannel Decomposition takes the photograph image moire fringes removing method
CN108418997A (en) * 2018-01-31 2018-08-17 深圳市商巨视觉技术有限公司 The method for removing image moire fringes
CN108664144A (en) * 2017-04-02 2018-10-16 田雪松 Based on symbol pattern PwPosition calculating method
CN109858471A (en) * 2019-04-03 2019-06-07 深圳市华付信息技术有限公司 Biopsy method, device and computer equipment based on picture quality
CN110517206A (en) * 2019-09-05 2019-11-29 昆山锐芯微电子有限公司 Colored moire fringes removing method and device
CN111353953A (en) * 2020-02-07 2020-06-30 天津大学 Image moire removing method based on direction total variation minimization and guiding filtering
CN111369450A (en) * 2020-02-21 2020-07-03 华为技术有限公司 Method and device for removing Moire pattern

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6661535B1 (en) * 1998-12-15 2003-12-09 Fujitsu Limited Moire fringe eliminating apparatus and a method for eliminating moire fringes
JP2004215141A (en) * 2003-01-08 2004-07-29 Seiko Epson Corp Moire elimination device, moire elimination method and program
CN102081795A (en) * 2011-01-14 2011-06-01 天津大学 Automatic deblocking method based on sparse representation
WO2015025697A1 (en) * 2013-08-20 2015-02-26 オリンパスメディカルシステムズ株式会社 Endoscope system and method for operating endoscope system
CN104717474A (en) * 2013-12-16 2015-06-17 瑞昱半导体股份有限公司 Image processing method and module
CN104835153A (en) * 2015-04-30 2015-08-12 天津大学 Non-rigid surface aligning method based on sparse representation
US20150271409A1 (en) * 2012-09-25 2015-09-24 Iix Inc., Image quality adjustment apparatus, correction data generation method, and image quality adjustment technique using the apparatus and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6661535B1 (en) * 1998-12-15 2003-12-09 Fujitsu Limited Moire fringe eliminating apparatus and a method for eliminating moire fringes
JP2004215141A (en) * 2003-01-08 2004-07-29 Seiko Epson Corp Moire elimination device, moire elimination method and program
CN102081795A (en) * 2011-01-14 2011-06-01 天津大学 Automatic deblocking method based on sparse representation
US20150271409A1 (en) * 2012-09-25 2015-09-24 Iix Inc., Image quality adjustment apparatus, correction data generation method, and image quality adjustment technique using the apparatus and method
WO2015025697A1 (en) * 2013-08-20 2015-02-26 オリンパスメディカルシステムズ株式会社 Endoscope system and method for operating endoscope system
CN104717474A (en) * 2013-12-16 2015-06-17 瑞昱半导体股份有限公司 Image processing method and module
CN104835153A (en) * 2015-04-30 2015-08-12 天津大学 Non-rigid surface aligning method based on sparse representation

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
EMMANUEL J. CANDES 等: "Enhancing Sparsity by Reweighted ℓ1 Minimization", 《JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS》 *
LEONID I. RUDIN 等: "Nonlinear total variation based noise removal algorithms", 《PHYSICA D: NONLINEAR PHENOMENA》 *
YANG JINGYU 等: "Ways to Sparse Representation: A Comparative Study", 《TSINGHUA SCIENCE AND TECHNOLOGY》 *
YIGANG PENG 等: "Reweighted Low-Rank Matrix Recovery and its Application in Image Restoration", 《IEEE TRANSACTIONS ON CYBERNETICS》 *
栗小斌: "LED显示屏摩尔纹的消除方法", 《演艺科技》 *
赵建军: "数字影像中"叠纹"的产生原理与消除方法", 《科教文汇》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105957080A (en) * 2016-04-28 2016-09-21 王超维 Screen-photographed identity card photo identification method based on frequency domain
CN106971377A (en) * 2016-08-22 2017-07-21 上海海洋大学 A kind of removing rain based on single image method decomposed based on sparse and low-rank matrix
CN106408530A (en) * 2016-09-07 2017-02-15 厦门大学 Sparse and low-rank matrix approximation-based hyperspectral image restoration method
CN106373105B (en) * 2016-09-12 2020-03-24 广东顺德中山大学卡内基梅隆大学国际联合研究院 Multi-exposure image artifact removing fusion method based on low-rank matrix recovery
CN106373105A (en) * 2016-09-12 2017-02-01 广东顺德中山大学卡内基梅隆大学国际联合研究院 Multi-exposure image deghosting integration method based on low-rank matrix recovery
CN106960463A (en) * 2017-03-13 2017-07-18 东华大学 Towards the quick fitting method of three-dimensional virtual garment of real scan human body
CN106960463B (en) * 2017-03-13 2020-05-26 东华大学 Three-dimensional virtual garment quick fitting method for real scanning human body
CN108664144A (en) * 2017-04-02 2018-10-16 田雪松 Based on symbol pattern PwPosition calculating method
CN107609573A (en) * 2017-08-17 2018-01-19 东华大学 High spectrum image time varying characteristic extracting method based on low-rank decomposition and empty spectrum constraint
CN108154487A (en) * 2017-12-25 2018-06-12 天津大学 Screen based on Multichannel Decomposition takes the photograph image moire fringes removing method
CN108154487B (en) * 2017-12-25 2021-02-09 天津大学 Screen shot image moire elimination method based on multi-channel decomposition
CN108418997B (en) * 2018-01-31 2020-12-22 深圳市商巨视觉技术有限公司 Method for removing image moire
CN108418997A (en) * 2018-01-31 2018-08-17 深圳市商巨视觉技术有限公司 The method for removing image moire fringes
CN109858471A (en) * 2019-04-03 2019-06-07 深圳市华付信息技术有限公司 Biopsy method, device and computer equipment based on picture quality
CN110517206A (en) * 2019-09-05 2019-11-29 昆山锐芯微电子有限公司 Colored moire fringes removing method and device
CN110517206B (en) * 2019-09-05 2021-10-15 锐芯微电子股份有限公司 Method and device for eliminating color moire
CN111353953A (en) * 2020-02-07 2020-06-30 天津大学 Image moire removing method based on direction total variation minimization and guiding filtering
CN111353953B (en) * 2020-02-07 2022-07-05 天津大学 Image moire removing method based on direction total variation minimization and guiding filtering
CN111369450A (en) * 2020-02-21 2020-07-03 华为技术有限公司 Method and device for removing Moire pattern
CN111369450B (en) * 2020-02-21 2024-02-02 华为技术有限公司 Method and device for removing mole marks

Also Published As

Publication number Publication date
CN105303530B (en) 2018-05-08

Similar Documents

Publication Publication Date Title
CN105303530B (en) Textile image moire fringes removing method based on low-rank sparse matrix decomposition
CN106709881B (en) A kind of high spectrum image denoising method decomposed based on non-convex low-rank matrix
CN108133465B (en) Non-convex low-rank relaxation hyperspectral image recovery method based on spatial spectrum weighted TV
Menon et al. Color image demosaicking: An overview
CN102663719B (en) Bayer-pattern CFA image demosaicking method based on non-local mean
CN103150713B (en) Utilize the image super-resolution method that image block classification rarefaction representation is polymerized with self-adaptation
Liu et al. Moiré pattern removal from texture images via low-rank and sparse matrix decomposition
CN103595981B (en) Based on the color filter array image demosaicing method of non-local low rank
CN108154487B (en) Screen shot image moire elimination method based on multi-channel decomposition
Wen et al. An effective network integrating residual learning and channel attention mechanism for thin cloud removal
CN104159003A (en) Method and system of video denoising based on 3D cooperative filtering and low-rank matrix reconstruction
US20060245666A1 (en) Method and system for digital image enhancement
Hosono et al. Weighted tensor nuclear norm minimization for color image denoising
CN110830043B (en) Image compressed sensing reconstruction method based on mixed weighted total variation and non-local low rank
CN113139914B (en) Image denoising method and device, electronic equipment and storage medium
CN106447632B (en) A kind of RAW image denoising method based on rarefaction representation
CN109767404B (en) Infrared image deblurring method under salt and pepper noise
CN110599402A (en) Image super-resolution reconstruction method based on multi-feature sparse representation
CN102663703B (en) Treelet-based Bayer type CFA image denoising method
CN110852963B (en) Turbulence degradation image restoration method based on correlation maximum
CN110335197B (en) Demosaicing method based on non-local statistical eigen
CN110473153A (en) The method for blindly restoring image kept based on fuzzy kernel estimates iteration structure
Jiang et al. DCT-based residual network for NIR image colorization
Fang et al. Removing moiré patterns from single images
CN110992266B (en) Demosaicing method and demosaicing system based on multi-dimensional non-local statistical eigen

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: Yang Jingyu

Inventor after: Zhang Xue

Inventor after: Liu Fanglei

Inventor before: Yang Jingyu

Inventor before: Liu Fanglei

GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180508