CN105303530A - Fabric image mole stripe elimination method based on low-rank sparse matrix decomposition - Google Patents
Fabric image mole stripe elimination method based on low-rank sparse matrix decomposition Download PDFInfo
- Publication number
- CN105303530A CN105303530A CN201510639274.XA CN201510639274A CN105303530A CN 105303530 A CN105303530 A CN 105303530A CN 201510639274 A CN201510639274 A CN 201510639274A CN 105303530 A CN105303530 A CN 105303530A
- Authority
- CN
- China
- Prior art keywords
- moire
- matrix
- image
- fabric
- low
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000011159 matrix material Substances 0.000 title claims abstract description 106
- 239000004744 fabric Substances 0.000 title claims abstract description 81
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000000354 decomposition reaction Methods 0.000 title claims abstract description 31
- 230000008030 elimination Effects 0.000 title claims abstract description 13
- 238000003379 elimination reaction Methods 0.000 title claims abstract description 13
- 238000012545 processing Methods 0.000 claims abstract description 10
- 239000013598 vector Substances 0.000 claims description 29
- 230000003190 augmentative effect Effects 0.000 claims description 10
- OAICVXFJPJFONN-UHFFFAOYSA-N Phosphorus Chemical compound [P] OAICVXFJPJFONN-UHFFFAOYSA-N 0.000 claims description 4
- 238000010276 construction Methods 0.000 claims description 4
- 238000009472 formulation Methods 0.000 claims description 4
- 239000000203 mixture Substances 0.000 claims description 4
- 238000011084 recovery Methods 0.000 claims description 4
- 238000011160 research Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000008602 contraction Effects 0.000 claims description 2
- 238000009499 grossing Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 21
- 230000037303 wrinkles Effects 0.000 description 6
- 238000000926 separation method Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 235000009508 confectionery Nutrition 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000003709 image segmentation Methods 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
Landscapes
- Treatment Of Fiber Materials (AREA)
- Image Processing (AREA)
Abstract
The invention belongs to the digital image processing field and is for eliminating mole stripe patterns in fabric images. The fabric image mole stripe elimination method based on low-rank sparse matrix decomposition is characterized in that, local self-similarity of fabric textures and energy concentration distribution characteristics of the mole stripe in a frequency domain are utilized, a low rank sparse matrix decomposition model is constructed, the fabric textures are separated from the mole stripe pattern, and thereby a problem of mole stripes in the fabric image can be solved. The fabric image mole stripe elimination method based on low-rank sparse matrix decomposition is mainly applied to digital image processing.
Description
Technical Field
The invention belongs to the field of digital image processing, and particularly relates to a method for eliminating moire of a fabric image based on low-rank sparse matrix decomposition.
Background
Moire phenomena are highly prevalent in modern digital imaging processes, such as: a scanner scans a halftone print, a digital camera takes a picture of a screen or a scene containing a regular pattern (a cloth line on clothing, a window or grid on a building). Moire patterns tend to have large areas and obvious color cast in images, seriously affect image quality and image analysis results, and attract wide attention of people.
So far, image moir é removal algorithms are mainly directed to halftone scanned images. Among the types of moire in the image, the moire in the halftone image is a relatively simple moire pattern, and its shape, distribution, etc. are closely related to the printer apparatus without being affected by the original image. These algorithms are mainly classified into two broad categories, filtering-based methods and dictionary learning-based methods. Another relatively simple image moire is the moire phenomenon caused by interference of rays during the imaging process of a radiation microscope, and nearly parallel moire fringes are distributed throughout the whole image. For such moire, the most common current method of elimination is to select a suitable median gaussian filter, but inevitably produces a slight ringing effect at the local edge locations.
However, since the moire pattern in the fabric image is relatively complex: 1) the stripe distribution has no obvious rule, and the color cast is obvious; 2) moire patterns are similar to fabric textures, thus making it more difficult to eliminate such Moire patterns. To eliminate such moir é, most manufacturers choose to embed an optical low-pass filter in the digital camera to suppress the occurrence of moir é at the expense of image sharpness. The other solution is to design a special CFA (color Filter array) interpolation algorithm, and estimate aliasing information of a red channel and a blue channel and lost high-frequency information by using high-frequency information captured by a green channel to avoid the occurrence of a moire phenomenon; the method is severely limited by the shot image, and the complex interpolation algorithm increases the internal processing load of the camera, so that the method is not a reliable method for eliminating moire fringes. At present, the most effective post-processing method for eliminating moire fringes generated in the imaging process of a digital camera is to use Photoshop software, manually select a moire region, remove the color of the moire fringes in the region, and then repair a brightness layer by using chrominance and saturation information to eliminate gray moire fringes. In a word, no efficient processing algorithm for the moire phenomenon in the fabric image is provided at present, and the moire interference can be eliminated while the image sharpness is kept.
Disclosure of Invention
The invention aims to make up the defects of the prior art, namely, the elimination of the moire pattern in the fabric image is realized. The method adopts the technical scheme that a low-rank sparse matrix decomposition-based fabric image moire elimination method utilizes local self-similarity of fabric textures and energy concentration distribution characteristics of moire patterns in a frequency domain to construct a low-rank sparse matrix decomposition model and separate the fabric textures from moire patterns, so that the problem of eliminating moire in a fabric image is solved. The method comprises the following steps:
1) overlapping images I with u/2 as step intervalMDivided into image blocks of size u × u, then each image block y ' is processed to achieve separation of the fabric texture x ' from the moir pattern m ', i.e.:
y′=x′+m′(1)
2) constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented by a Discrete Cosine Transform (DCT) dictionary, and the formula is as follows:
min||α||1constraint m ═ D α Ω (2)
Wherein min represents solving the corresponding minimum value, | | · |. non-calculation1Representing a matrixThe norm of the number of the first-order-of-arrival,is the constructed DCT dictionary and is,representing a real space, N, p representing the size of the spatial dimension,representing a two-dimensional real number space of size N × p and N ═ u2,p>>N, the symbol ∈ denotes belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of the sparse representation of moire m under the dictionary, Ω is the constraint on the significant positions of the coefficients α, i.e. the values of the coefficients α at the non-significant positions are all set to zero;
3) constructing a low rank constraint term: the fabric texture image block x' is converted into k × k subblocks and converted into corresponding vector forms, the subblock vectors are arranged into a matrix C, and local self-similarity characteristics of the fabric texture in a space domain are utilized to add low-rank constraints as follows:
min||C||*(3)
wherein | · | purple sweet*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n is the number of sub-blocks, k2The size of the dimensions of the space is represented,denotes a size of k2One-dimensional real number space, i.e. vector; the construction equation for matrix C is as follows:
wherein, the symbolIs the kronecker operator, InIs onen × n diagonal matrix, x fabric texture image block x' vector form, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,n;
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min‖C‖*+λ‖α‖1
constraint conditions
Where λ is a weighting factor, balancing the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min‖C‖*+λ‖α‖1
constraint conditions
Recent research results on low-rank matrix recovery and sparse representation show that adding weights to the minimization model can improve the low rank and sparsity of the obtained result, so that a re-weighting strategy is introduced into the formula (6) to obtain the following equation:
mintr(WCοΣ)+λ||Wαοα||1
constraint conditions
Wherein tr (-) denotes the trace of the matrix,Is a diagonal matrix formed by the singular values of the matrix C, diag (·) represents the diagonal matrix,is a singular value of a matrix, WCAnd WαThe weight matrixes corresponding to the low-rank term and the sparse term are respectively, and the symbol o represents the dot product operation of the two matrixes;
5) and finally solving the equation by using an augmented Lagrange method, and after a plurality of iterations, achieving convergence to finally obtain the needed low-rank matrix C and the coefficient vector alpha of the Moire pattern m sparsely represented under the DCT dictionary, thereby obtaining the fabric texture x and the Moire pattern m:
m=Dα(20)
wherein,is a summation formula (·)-1Represents the inverse of the matrix within the brackets;
6) and (3) performing the above processing on all image blocks in the image area of the moire pattern to finally obtain the fabric texture image I without the moire pattern and the separated moire component image M.
Further specifically, the step of constructing the sparse constraint term includes 21) in some cases, the red channel and the blue channel of the color image have moire patterns, and the green channel does not include any moire component, so that a plurality of moire image blocks of the red channel and the blue channel and a plurality of moire-free image blocks at corresponding positions of the green channel are selected, statistical distribution maps of DCT coefficients corresponding to the moire image blocks and the moire-free image blocks are respectively obtained, and a conclusion is obtained: the Moire pattern is concentrated in energy distribution at middle and low frequency positions in a frequency domain, so that all coefficients of alpha corresponding to the high frequency position are set to zero, namely omega is the middle and low frequency position of a DCT domain;
22) to prevent erroneous classification of the position of wrinkles, edges, shadows, etc. in the fabric image as moire components, usingThe norm gradient minimization method smoothes the image block y' to obtain an image block containing wrinkles, edges, shadows, etc. but not containing moire and fabric textures, and further constrains the effective position of the coefficient α, i.e., Ω, according to its energy distribution in the DCT domain.
5) And finally solving the equation by using an augmented Lagrange method, wherein the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFA Flobenius norm representing a matrix;
52) the iterative solution equation of equation (8) is as follows:
argmin in the above formulaX{. is the value of variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g represents the position coordinates of the matrix elements;
53) solving for Ck+1,τSolving for C in the equation (9)k+1,τThe C-independent term in the objective function of (1) yields:
the above formula is rewritten using the recipe as:
wherein:
using singular value threshold decomposition for equation (10) yields:
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices of, soft (,) is a contraction calculationA seed;
54) solving α using an accelerated neighbor gradient algorithmk+1,τThe solution α in equation (9) is removedk+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, construct a second order function to approximate the above equation, and then solve the original equation for the second order function:
order to Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofUsed for ensuring that F (β) is less than or equal to T (α) for all β;
after the above conversion, the formula (12) is converted into the solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
tjis a set of constant sequences, j and j +1 are the number of iterations, from which it is solved:
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) when k reaches the maximum iteration number, updating the weight factor and the iteration count parameter tau:
57) when τ reaches the maximum iteration number of the reweighting matrix, a coefficient vector α of the low-rank matrix C and the moire pattern m which are expected to be sparsely represented in the DCT dictionary can be obtained, so that a fabric texture x and the moire pattern m are obtained:
m=Dα(20)。
the invention has the technical characteristics and effects that:
the method avoids changing imaging equipment hardware, adopts a post-processing method, and separates the fabric texture from the moire pattern in the image by using a low-rank sparse matrix decomposition model, namely, the elimination of the moire of the fabric image is realized. Has the following characteristics:
1. the program is simple and easy to realize.
2. The elimination of moire in the fabric image is achieved.
3. Removing the moire pattern of the fabric image by adopting a low-rank coefficient matrix decomposition model: the elimination problem of the moire in the fabric image is attributed to the image segmentation problem, a low-rank sparse matrix decomposition model is constructed by utilizing the local self-similarity of the fabric texture and the energy concentration distribution characteristic of the moire in a frequency domain, and the fabric texture is separated from the moire pattern. Therefore, the difference between the fabric texture and the moire texture in the space domain and the frequency domain can be well utilized, and the fabric texture component and the moire texture component can be better distinguished.
4. The separation performance of the fabric texture and the moire pattern is improved by carrying out effective position constraint on the coefficient sparsely represented by the moire pattern under the DCT dictionary. This ensures that the positions of wrinkles, edges, shadows, etc. in the fabric image are not erroneously classified as moir é components.
Drawings
The above advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a comparison graph of the statistical distribution of DCT coefficients for an image block with a Moire and an image block without a Moire: 1) is a statistical distribution map of the DCT coefficients of the image block with Moire fringes; 2) is the DCT coefficient statistical distribution map of the image block without Moire; 3) difference graphs of the two;
FIG. 3 is an image of a moir é textured fabric;
FIG. 4 is a comparison of fabric image moire removal results: 1) is the result of the Photoshop software processing the figure 3; 2) is the result of the processing of figure 3 by the method of the present invention.
Detailed Description
The method for eliminating the moire of the fabric image based on the low-rank sparse matrix decomposition is described in detail below by combining the embodiment and the attached drawings.
The method adopts a low-rank sparse matrix decomposition model to remove the moire patterns of the fabric image: the elimination problem of the moire in the fabric image is attributed to the image segmentation problem, a low-rank sparse matrix decomposition model is constructed by utilizing the local self-similarity of the fabric texture and the energy concentrated distribution characteristic of the moire in a frequency domain, and the fabric texture is separated from the moire pattern; by restricting the distribution of the moire patterns in the frequency domain, the separation performance of the fabric texture and the moire patterns is improved, and the positions of folds, edges, shadows and the like in the fabric image are prevented from being mistaken as the moire patterns. The method comprises the following steps:
1) constructing initial data:
11) taking a fabric image with moire patterns downloaded from Google as experimental data;
12) overlapping images I with u/2 as step intervalMDivided into image blocks of size u × u, then each image block y ' is processed to achieve separation of the fabric texture x ' from the moir pattern m ', i.e.:
y′=x′+m′(1)
13) given the higher resolution of the Discrete Cosine Transform (DCT) domain than the Discrete Fourier Transform (DFT) domain, an N × p sized overcomplete DCT dictionary is constructed to sparsely represent the moir é pattern.
2) Constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented under the DCT dictionary, and the formula is as follows:
min||α||1constraint m ═ D α Ω (2)
Wherein min represents solving the corresponding minimum value, | | · |. non-calculation1Representing a matrixThe norm of the number of the first-order-of-arrival,is the constructed DCT dictionary and is,representing a real space, N, p representing the size of the spatial dimension,two-dimensional real number space of size N × p and N ═ u2,p>>N, the symbol ∈ denotes belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of the sparse representation of moire m under the dictionary, Ω is the constraint on the significant positions of the coefficients α, i.e. the values of the coefficients α at the non-significant positions are all set to zero;
21) in some cases, the red and blue channels of the color image have moire patterns and the green channel does not contain any moire components. Therefore, a plurality of image blocks with moire patterns of the red channel and the blue channel and a plurality of image blocks without moire patterns at corresponding positions of the green channel are selected, a statistical distribution graph of DCT coefficients corresponding to the image blocks with moire patterns and the image blocks without moire patterns is obtained, and a conclusion is obtained: the moire pattern is energy concentrated in the frequency domain at the mid and low frequency locations. Therefore, all the coefficients of the high-frequency position corresponding to the alpha are set to zero, namely omega is the middle-low frequency position of the DCT domain;
22) to prevent erroneous classification of the position of wrinkles, edges, shadows, etc. in the fabric image as moire components, usingThe norm gradient minimization method smoothes the image block y' to obtain an image block containing wrinkles, edges, shadows, etc. but not containing moire and fabric textures, and further constrains the effective position of the coefficient α, i.e., Ω, according to its energy distribution in the DCT domain.
3) Constructing a low rank constraint term: dividing a fabric texture image block x' into k × k subblocks and converting the subblocks into corresponding vector forms, arranging the subblock vectors into a matrix C, and adding low-rank constraint by using the local self-similarity characteristic of the fabric texture in a spatial domain as follows:
min||C||*(3)
wherein | · | purple sweet*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n is the number of sub-blocks, k2The size of the dimensions of the space is represented,denotes a size of k2Is a one-dimensional real number space (i.e., vector). The construction equation for matrix C is as follows:
wherein, the symbolIs the kronecker operator, InIs a diagonal matrix of n × n, x' vector form of x texture image block, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,n。
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min||C||*+λ||α||1
constraint conditions
Where λ is a weighting factor, balancing the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min||C||*+λ||α||1
constraint conditions
Recent research results on low-rank matrix recovery and sparse representation show that adding weight to the minimization model can improve the low rank and sparsity of the obtained result. Therefore, the present invention introduces a re-weighting strategy in equation (6), and obtains the following equation:
mintr(WCοΣ)+λ||Wαοα||1
constraint conditions
Where tr (-) denotes the trace of the matrix,is a diagonal matrix formed by the singular values of the matrix C, diag (·) represents the diagonal matrix,is a singular value of a matrix, WCAnd WαThe weight matrices are respectively corresponding to the low-rank term and the sparse term, and the symbol o represents the dot product operation of the two matrices.
5) And finally solving the equation by using an augmented Lagrange method, wherein the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFA Flobenius norm representing a matrix;
52) the iterative solution equation of equation (8) is as follows:
argmin in the above formulaX{. is the value of variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g represents the position coordinates of the matrix elements;
53) solving for Ck+1,τSolving for C in the equation (9)k+1,τThe C-independent term in the objective function of (1) yields:
the above formula is rewritten using the recipe as:
wherein:
using singular value threshold decomposition for equation (10) yields:
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices, soft (·,) are the shrink operators.
54) Solving α using an accelerated neighbor gradient algorithmk+1,τThe solution α in equation (9) is removedk+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, a second order function is constructed to approximate the above formula, and then the original equation is solved for the second order function.
Order to Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofIs used to ensure that F (β) is less than or equal to T (α) for all β.
After the above conversion, the formula (12) is converted into the solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
tjis a set of constant sequences, and j +1 are the number of iterations. Thus, the following results are obtained:
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) when k reaches the maximum iteration number, updating the weight factor and the iteration count parameter tau:
57) when tau reaches the maximum iteration number of the re-weighting matrix, the low rank matrix C and the coefficient matrix alpha of sparse representation of the Moire pattern m under the DCT dictionary which are expected by us can be obtained. Thus, the fabric texture x and the molar pattern m can be obtained:
m=Dα(20)
wherein,is a summation formula (·)-1The inverse of the matrix in brackets is shown.
6) And (3) performing the above processing on all image blocks in the image area of the moire pattern to finally obtain the fabric texture image I without the moire pattern and the separated moire component image M.
The invention provides an image moire elimination method for low-rank sparse matrix decomposition (as shown in the flow of fig. 1), which is described in detail in the following with reference to the accompanying drawings and embodiments:
1) constructing initial data:
11) taking a fabric image with moire patterns downloaded from Google as experimental data;
12) overlapping the images I at step intervals of 32M(as shown in fig. 3) is divided into image blocks of size 64 × 64, and each image block y ' is then processed to achieve separation of the fabric texture x ' from the moir pattern m ', i.e.:
y′=x′+m′(1)
13) considering that a Discrete Cosine Transform (DCT) domain has higher resolution than a Discrete Fourier Transform (DFT) domain, constructing an overcomplete DCT dictionary with the size of 4096 x 6400 to sparsely represent Moire patterns;
2) constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented under the DCT dictionary, and the formula is as follows:
min||α||1constraint m ═ D α Ω (2)
Wherein min represents solving the corresponding minimum value, | | · |. non-calculation1Representing a matrixThe norm of the number of the first-order-of-arrival,is the constructed DCT dictionary and is,representing a real space, 4096,6400 is the size of the spatial dimension,a two-dimensional real space of size 4096 × 6400 is represented, symbol ∈ represents belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of sparse representation of moire m under a dictionary, Ω is the constraint on the effective position of the coefficient α, i.e. the values of the coefficient α at the non-effective position are all set to zero;
21) selecting a plurality of image blocks with moire patterns of the red channel and the blue channel and a plurality of image blocks without moire patterns at corresponding positions of the green channel, respectively obtaining a statistical distribution graph (shown in figure 2) of DCT coefficients of the image blocks with moire patterns and the image blocks without moire patterns, and obtaining a conclusion: the moire pattern is energy concentrated in the frequency domain at the mid and low frequency locations. Therefore, all the high-frequency position coefficients corresponding to alpha are set to zero, namely omega is the middle and low frequency position of the DCT domain;
22) to prevent erroneous classification of the position of wrinkles, edges, shadows, etc. in the fabric image as moire components, usingSmoothing the image block y' by a norm gradient minimization method to obtain an image block which contains folds, edges, shadows and the like and does not contain moire fringes and fabric textures, setting all values of a coefficient α at the energy distribution position to zero according to the energy distribution of the image block in a DCT domain, and further constraining the effective position of a coefficient α, namely limiting omega;
3) constructing a low rank constraint term: dividing a fabric texture image block x' into 8 x 8 sub-blocks and converting the sub-blocks into corresponding vector forms, arranging the sub-block vectors into a matrix C, and adding low-rank constraint as follows by utilizing the local self-similarity characteristic of the fabric texture in a spatial domain:
min||C||*(3)
wherein | · | purple sweet*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n-225 is the number of sub-blocks, 64 represents the size of the spatial dimension,representing a one-dimensional real space (i.e., a vector) of size 64. The construction equation for matrix C is as follows:
wherein, the symbolIs the kronecker operator, InIs a diagonal matrix of 225 × 225, x texture image blocks x' vector form, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,225。
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min||C||*+λ||α||1
constraint conditions
Where λ is a weighting factor, with a value of 0.015, which is used to balance the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min||C||*+λ||α||1
constraint conditions
Recent research results on low-rank matrix recovery and sparse representation show that adding weight to the minimization model can improve the low rank and sparsity of the obtained result. Therefore, the present invention introduces a re-weighting strategy in equation (6), and obtains the following equation:
mintr(WCοΣ)+λ||Wαοα||1
constraint conditions
Where tr (·) denotes a trace of the matrix, Σ ═ diag ([ σ ])1,σ2,…,σ64]) Is a diagonal matrix formed by the singular values of the matrix C, diag (·) representing the diagonal matrix, σ1,σ2,…,σ64Is a singular value of a matrix, WCAnd WαThe weight matrices are respectively corresponding to the low-rank term and the sparse term, and the symbol o represents the dot product operation of the two matrices.
5) And finally solving the equation by using an augmented Lagrange method, wherein the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFThe frobenius norm of the matrix is represented.
52) The iterative solution equation of equation (8) is as follows:
argmin in the above formulaX{. is the value of the variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g denotes the matrixThe position coordinates of the elements. Initial values were set in the experiment as:
53) solving for Ck+1,τRemoving C in the formula (9)k+1,τThe C-independent term in the objective function of (1) yields:
the formula is rewritten as follows:
wherein:
using singular value threshold decomposition for equation (10) yields:
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices, soft (·,) are the shrink operators.
54) Solving α using an accelerated neighbor gradient algorithmk+1,τRemoval of α in formula (9)k+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, a second order function is constructed to approximate the above formula, and then the original equation is solved for the second order function.
Order to Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofIs used to ensure that F (β) is less than or equal to T (α) for all β.
Through the stepsConversion, equation (12) to solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
tjis a set of constant sequences, and j +1 are the number of iterations. Setting initial values as follows: j is 1, t1=1,β1=1。
The convergence can be solved as follows:
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) the iteration number is set to 40, and when the maximum iteration number, namely k is 40, the weight matrix and the iteration count parameter tau are updated:
57) when the iteration number of the re-weighting matrix is set to 4, that is, τ is 4, we can obtain the desired coefficient vector α of the low rank matrix C and the sparse representation of the moire pattern m under the DCT dictionary. Thus, the fabric texture x and the molar pattern m can be obtained:
m=Dα(20)
wherein,is a summation formula (·)-1The inverse of the matrix in brackets is shown.
6) And (3) performing the above processing on all image blocks in the image area with the moire pattern to finally obtain a fabric texture image I (shown in fig. 4) without the moire pattern and a separated moire component image M.
Claims (3)
1. A fabric image moire elimination method based on low-rank sparse matrix decomposition is characterized in that a low-rank sparse matrix decomposition model is constructed by utilizing local self-similarity of fabric textures and the energy concentration distribution characteristics of moire patterns in a frequency domain, and the fabric textures are separated from moire patterns, so that the problem of eliminating moire in a fabric image is solved.
1) Overlapping images I with u/2 as step intervalMDivided into image blocks of u × u size, and then each image block y 'is processed to achieve the division of the fabric texture x' into the Moire pattern mAnd (2) separating, namely:
y′=x′+m′(1)
2) constructing a sparse constraint term: by utilizing the energy concentration distribution characteristic of the moire pattern in the frequency domain, the moire pattern is assumed to be sparsely represented by a Discrete Cosine Transform (DCT) dictionary, and the formula is as follows:
min‖α‖1constraint m ═ D α Ω (2)
Wherein min represents finding the corresponding minimum value, | |)1The/1 norm of the matrix is represented,is the constructed DCT dictionary and is,representing a real space, N, p representing the size of the spatial dimension,representing a two-dimensional real number space of size N × p and N ═ u2P > N, the symbol ∈ denotes belonging, m is the vector form of the moire image block m' to be separated, α is the coefficient matrix of the sparse representation of moire m under the dictionary, Ω is the constraint on the significant positions of coefficients α, i.e. the values of coefficients α at the non-significant positions are all set to zero;
3) constructing a low rank constraint term: the fabric texture image block x' is converted into k × k subblocks and converted into corresponding vector forms, the subblock vectors are arranged into a matrix C, and local self-similarity characteristics of the fabric texture in a space domain are utilized to add low-rank constraints as follows:
min‖C‖*(3)
wherein |*Denotes the kernel norm of the matrix, C ═ C1,c2,…,cn]WhereinIs the vector form of the ith sub-block, n is the number of sub-blocks, k2The size of the dimensions of the space is represented,denotes a size of k2One-dimensional real number space, i.e. vector; the construction equation for matrix C is as follows:
wherein, the symbolIs the kronecker operator, InIs a diagonal matrix of n × n, x' vector form of x texture image block, S ═ S1,s2,…,sn]Is a matrix for extracting sub-blocks of an image block, satisfies ci=six,i=1,2,…,n;
4) Combining the sparse constraint term of the moire pattern and the low-rank constraint term of the fabric texture similar block matrix by using a factor lambda to construct a final low-rank sparse matrix decomposition equation, wherein the specific formula is as follows:
min‖C‖*+λ‖α‖1
constraint conditions
Where λ is a weighting factor, balancing the weight between the two terms. In order to reduce the error of the convergence result caused by a plurality of constraints, the invention combines the constraints in the formula (5) to obtain the following decomposition model:
min‖C‖*+λ‖α‖1
constraint conditions
Recent research results on low-rank matrix recovery and sparse representation show that adding weights to the minimization model can improve the low rank and sparsity of the obtained result, so that a re-weighting strategy is introduced into the formula (6) to obtain the following equation:
mintr(WCоΣ)+λ‖Wαоα‖1
constraint conditions
Where tr (-) denotes the trace of the matrix,is a diagonal matrix formed by the singular values of the matrix C, diag (·) represents the diagonal matrix,is a singular value of a matrix, WCAnd WαThe weight matrixes respectively correspond to the low-rank term and the sparse term, and the symbol o represents the dot multiplication operation of the two matrixes;
5) and finally solving the equation by using an augmented Lagrange method, and after a plurality of iterations, achieving convergence to finally obtain the needed low-rank matrix C and the coefficient vector alpha of the Moire pattern m sparsely represented under the DCT dictionary, thereby obtaining the fabric texture x and the Moire pattern m:
m=Dα(20)
wherein,is a summation formula (·)-1Represents the inverse of the matrix within the brackets;
6) and (3) performing the above processing on all image blocks in the image area of the moire pattern to finally obtain the fabric texture image I without the moire pattern and the separated moire component image M.
2. The method for eliminating the moire of the fabric image based on the low rank sparse matrix decomposition as claimed in claim 1, characterized in that the specific method comprises the following steps:
further specifically, the step of constructing the sparse constraint term includes 21) in some cases, the red channel and the blue channel of the color image have moire patterns, and the green channel does not include any moire component, so that a plurality of moire image blocks of the red channel and the blue channel and a plurality of moire-free image blocks at corresponding positions of the green channel are selected, statistical distribution maps of DCT coefficients corresponding to the moire image blocks and the moire-free image blocks are respectively obtained, and a conclusion is obtained: the Moire pattern is concentrated in energy distribution at middle and low frequency positions in a frequency domain, so that all coefficients of alpha corresponding to the high frequency position are set to zero, namely omega is the middle and low frequency position of a DCT domain;
22) in case of dividing the positions of folds, edges, shadows and the like in the fabric image into moire components by mistake, smoothing the image block y' by using an l0 norm gradient minimization method to obtain an image block which contains the folds, edges, shadows and the like and does not contain moire and fabric textures, and further constraining the effective position of the coefficient alpha, namely limiting omega according to the energy distribution of the image block in the DCT domain.
3. The method for eliminating the moire of the fabric image based on the low-rank sparse matrix decomposition as claimed in claim 1, wherein 5) the equation is finally solved by using an augmented Lagrangian method, and the method comprises the following specific steps:
51) convert equation (7) to lagrangian functional form:
l (C, α, Q) is the augmented Lagrangian function, where μ is the penalty factor, Q is the Lagrangian multiplier matrix,<·,·>representing the inner product of two matrices, | · | > non-woven phosphorFA Flobenius norm representing a matrix;
52) the iterative solution equation of equation (8) is as follows:
argmin in the above formulaX{. is the value of variable X at the time of minimizing the objective function, ρ is a multiple factor, superscripts k, k +1 and τ, τ +1 is the number of iterations, ξ is an arbitrarily small positive real number, and subscript g represents the position coordinates of the matrix elements;
53) solving for Ck+1,τSolving for C in the equation (9)k+1,τThe C-independent term in the objective function of (1) yields:
the above formula is rewritten using the recipe as:
wherein:
using singular value threshold decomposition for equation (10) yields:
wherein U isk,τ,Vk,τAre respectively Pk,τLeft and right singular matrices of (1), soft (·,) being a contraction operator;
54) solving α using an accelerated neighbor gradient algorithmk+1,τThe solution α in equation (9) is removedk+1,τThe α -independent term in the objective function of (a) yields the following equation:
using Taylor expansion method, construct a second order function to approximate the above equation, and then solve the original equation for the second order function:
order to Reintroducing variable β defines the function:
wherein,is a gradient of f (β), LfIs a constant value ofUsed for ensuring that F (β) is less than or equal to T (α) for all β;
after the above conversion, the formula (12) is converted into the solution T (α)j) By formulation, the following form is obtained:
wherein,variable βjThe update rule of (2) is as follows:
tjis a set of constant sequences, j and j +1 are the number of iterations, from which it is solved:
55) updating a penalty factor mu and an iteration count parameter k:
μk+1,τ=ρμk,τ,k=k+1(17)
56) when k reaches the maximum iteration number, updating the weight factor and the iteration count parameter tau:
57) when τ reaches the maximum iteration number of the reweighting matrix, a coefficient vector α of the low-rank matrix C and the moire pattern m which are expected to be sparsely represented in the DCT dictionary can be obtained, so that a fabric texture x and the moire pattern m are obtained:
m=Dα(20)。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510639274.XA CN105303530B (en) | 2015-09-30 | 2015-09-30 | Textile image moire fringes removing method based on low-rank sparse matrix decomposition |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510639274.XA CN105303530B (en) | 2015-09-30 | 2015-09-30 | Textile image moire fringes removing method based on low-rank sparse matrix decomposition |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105303530A true CN105303530A (en) | 2016-02-03 |
CN105303530B CN105303530B (en) | 2018-05-08 |
Family
ID=55200754
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510639274.XA Expired - Fee Related CN105303530B (en) | 2015-09-30 | 2015-09-30 | Textile image moire fringes removing method based on low-rank sparse matrix decomposition |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105303530B (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105957080A (en) * | 2016-04-28 | 2016-09-21 | 王超维 | Screen-photographed identity card photo identification method based on frequency domain |
CN106373105A (en) * | 2016-09-12 | 2017-02-01 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Multi-exposure image deghosting integration method based on low-rank matrix recovery |
CN106408530A (en) * | 2016-09-07 | 2017-02-15 | 厦门大学 | Sparse and low-rank matrix approximation-based hyperspectral image restoration method |
CN106960463A (en) * | 2017-03-13 | 2017-07-18 | 东华大学 | Towards the quick fitting method of three-dimensional virtual garment of real scan human body |
CN106971377A (en) * | 2016-08-22 | 2017-07-21 | 上海海洋大学 | A kind of removing rain based on single image method decomposed based on sparse and low-rank matrix |
CN107609573A (en) * | 2017-08-17 | 2018-01-19 | 东华大学 | High spectrum image time varying characteristic extracting method based on low-rank decomposition and empty spectrum constraint |
CN108154487A (en) * | 2017-12-25 | 2018-06-12 | 天津大学 | Screen based on Multichannel Decomposition takes the photograph image moire fringes removing method |
CN108418997A (en) * | 2018-01-31 | 2018-08-17 | 深圳市商巨视觉技术有限公司 | The method for removing image moire fringes |
CN108664144A (en) * | 2017-04-02 | 2018-10-16 | 田雪松 | Based on symbol pattern PwPosition calculating method |
CN109858471A (en) * | 2019-04-03 | 2019-06-07 | 深圳市华付信息技术有限公司 | Biopsy method, device and computer equipment based on picture quality |
CN110517206A (en) * | 2019-09-05 | 2019-11-29 | 昆山锐芯微电子有限公司 | Colored moire fringes removing method and device |
CN111353953A (en) * | 2020-02-07 | 2020-06-30 | 天津大学 | Image moire removing method based on direction total variation minimization and guiding filtering |
CN111369450A (en) * | 2020-02-21 | 2020-07-03 | 华为技术有限公司 | Method and device for removing Moire pattern |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6661535B1 (en) * | 1998-12-15 | 2003-12-09 | Fujitsu Limited | Moire fringe eliminating apparatus and a method for eliminating moire fringes |
JP2004215141A (en) * | 2003-01-08 | 2004-07-29 | Seiko Epson Corp | Moire elimination device, moire elimination method and program |
CN102081795A (en) * | 2011-01-14 | 2011-06-01 | 天津大学 | Automatic deblocking method based on sparse representation |
WO2015025697A1 (en) * | 2013-08-20 | 2015-02-26 | オリンパスメディカルシステムズ株式会社 | Endoscope system and method for operating endoscope system |
CN104717474A (en) * | 2013-12-16 | 2015-06-17 | 瑞昱半导体股份有限公司 | Image processing method and module |
CN104835153A (en) * | 2015-04-30 | 2015-08-12 | 天津大学 | Non-rigid surface aligning method based on sparse representation |
US20150271409A1 (en) * | 2012-09-25 | 2015-09-24 | Iix Inc., | Image quality adjustment apparatus, correction data generation method, and image quality adjustment technique using the apparatus and method |
-
2015
- 2015-09-30 CN CN201510639274.XA patent/CN105303530B/en not_active Expired - Fee Related
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6661535B1 (en) * | 1998-12-15 | 2003-12-09 | Fujitsu Limited | Moire fringe eliminating apparatus and a method for eliminating moire fringes |
JP2004215141A (en) * | 2003-01-08 | 2004-07-29 | Seiko Epson Corp | Moire elimination device, moire elimination method and program |
CN102081795A (en) * | 2011-01-14 | 2011-06-01 | 天津大学 | Automatic deblocking method based on sparse representation |
US20150271409A1 (en) * | 2012-09-25 | 2015-09-24 | Iix Inc., | Image quality adjustment apparatus, correction data generation method, and image quality adjustment technique using the apparatus and method |
WO2015025697A1 (en) * | 2013-08-20 | 2015-02-26 | オリンパスメディカルシステムズ株式会社 | Endoscope system and method for operating endoscope system |
CN104717474A (en) * | 2013-12-16 | 2015-06-17 | 瑞昱半导体股份有限公司 | Image processing method and module |
CN104835153A (en) * | 2015-04-30 | 2015-08-12 | 天津大学 | Non-rigid surface aligning method based on sparse representation |
Non-Patent Citations (6)
Title |
---|
EMMANUEL J. CANDES 等: "Enhancing Sparsity by Reweighted ℓ1 Minimization", 《JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS》 * |
LEONID I. RUDIN 等: "Nonlinear total variation based noise removal algorithms", 《PHYSICA D: NONLINEAR PHENOMENA》 * |
YANG JINGYU 等: "Ways to Sparse Representation: A Comparative Study", 《TSINGHUA SCIENCE AND TECHNOLOGY》 * |
YIGANG PENG 等: "Reweighted Low-Rank Matrix Recovery and its Application in Image Restoration", 《IEEE TRANSACTIONS ON CYBERNETICS》 * |
栗小斌: "LED显示屏摩尔纹的消除方法", 《演艺科技》 * |
赵建军: "数字影像中"叠纹"的产生原理与消除方法", 《科教文汇》 * |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105957080A (en) * | 2016-04-28 | 2016-09-21 | 王超维 | Screen-photographed identity card photo identification method based on frequency domain |
CN106971377A (en) * | 2016-08-22 | 2017-07-21 | 上海海洋大学 | A kind of removing rain based on single image method decomposed based on sparse and low-rank matrix |
CN106408530A (en) * | 2016-09-07 | 2017-02-15 | 厦门大学 | Sparse and low-rank matrix approximation-based hyperspectral image restoration method |
CN106373105B (en) * | 2016-09-12 | 2020-03-24 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Multi-exposure image artifact removing fusion method based on low-rank matrix recovery |
CN106373105A (en) * | 2016-09-12 | 2017-02-01 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Multi-exposure image deghosting integration method based on low-rank matrix recovery |
CN106960463A (en) * | 2017-03-13 | 2017-07-18 | 东华大学 | Towards the quick fitting method of three-dimensional virtual garment of real scan human body |
CN106960463B (en) * | 2017-03-13 | 2020-05-26 | 东华大学 | Three-dimensional virtual garment quick fitting method for real scanning human body |
CN108664144A (en) * | 2017-04-02 | 2018-10-16 | 田雪松 | Based on symbol pattern PwPosition calculating method |
CN107609573A (en) * | 2017-08-17 | 2018-01-19 | 东华大学 | High spectrum image time varying characteristic extracting method based on low-rank decomposition and empty spectrum constraint |
CN108154487A (en) * | 2017-12-25 | 2018-06-12 | 天津大学 | Screen based on Multichannel Decomposition takes the photograph image moire fringes removing method |
CN108154487B (en) * | 2017-12-25 | 2021-02-09 | 天津大学 | Screen shot image moire elimination method based on multi-channel decomposition |
CN108418997B (en) * | 2018-01-31 | 2020-12-22 | 深圳市商巨视觉技术有限公司 | Method for removing image moire |
CN108418997A (en) * | 2018-01-31 | 2018-08-17 | 深圳市商巨视觉技术有限公司 | The method for removing image moire fringes |
CN109858471A (en) * | 2019-04-03 | 2019-06-07 | 深圳市华付信息技术有限公司 | Biopsy method, device and computer equipment based on picture quality |
CN110517206A (en) * | 2019-09-05 | 2019-11-29 | 昆山锐芯微电子有限公司 | Colored moire fringes removing method and device |
CN110517206B (en) * | 2019-09-05 | 2021-10-15 | 锐芯微电子股份有限公司 | Method and device for eliminating color moire |
CN111353953A (en) * | 2020-02-07 | 2020-06-30 | 天津大学 | Image moire removing method based on direction total variation minimization and guiding filtering |
CN111353953B (en) * | 2020-02-07 | 2022-07-05 | 天津大学 | Image moire removing method based on direction total variation minimization and guiding filtering |
CN111369450A (en) * | 2020-02-21 | 2020-07-03 | 华为技术有限公司 | Method and device for removing Moire pattern |
CN111369450B (en) * | 2020-02-21 | 2024-02-02 | 华为技术有限公司 | Method and device for removing mole marks |
Also Published As
Publication number | Publication date |
---|---|
CN105303530B (en) | 2018-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105303530B (en) | Textile image moire fringes removing method based on low-rank sparse matrix decomposition | |
CN106709881B (en) | A kind of high spectrum image denoising method decomposed based on non-convex low-rank matrix | |
CN108133465B (en) | Non-convex low-rank relaxation hyperspectral image recovery method based on spatial spectrum weighted TV | |
Menon et al. | Color image demosaicking: An overview | |
CN102663719B (en) | Bayer-pattern CFA image demosaicking method based on non-local mean | |
CN103150713B (en) | Utilize the image super-resolution method that image block classification rarefaction representation is polymerized with self-adaptation | |
Liu et al. | Moiré pattern removal from texture images via low-rank and sparse matrix decomposition | |
CN103595981B (en) | Based on the color filter array image demosaicing method of non-local low rank | |
CN108154487B (en) | Screen shot image moire elimination method based on multi-channel decomposition | |
Wen et al. | An effective network integrating residual learning and channel attention mechanism for thin cloud removal | |
CN104159003A (en) | Method and system of video denoising based on 3D cooperative filtering and low-rank matrix reconstruction | |
US20060245666A1 (en) | Method and system for digital image enhancement | |
Hosono et al. | Weighted tensor nuclear norm minimization for color image denoising | |
CN110830043B (en) | Image compressed sensing reconstruction method based on mixed weighted total variation and non-local low rank | |
CN113139914B (en) | Image denoising method and device, electronic equipment and storage medium | |
CN106447632B (en) | A kind of RAW image denoising method based on rarefaction representation | |
CN109767404B (en) | Infrared image deblurring method under salt and pepper noise | |
CN110599402A (en) | Image super-resolution reconstruction method based on multi-feature sparse representation | |
CN102663703B (en) | Treelet-based Bayer type CFA image denoising method | |
CN110852963B (en) | Turbulence degradation image restoration method based on correlation maximum | |
CN110335197B (en) | Demosaicing method based on non-local statistical eigen | |
CN110473153A (en) | The method for blindly restoring image kept based on fuzzy kernel estimates iteration structure | |
Jiang et al. | DCT-based residual network for NIR image colorization | |
Fang et al. | Removing moiré patterns from single images | |
CN110992266B (en) | Demosaicing method and demosaicing system based on multi-dimensional non-local statistical eigen |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information | ||
CB03 | Change of inventor or designer information |
Inventor after: Yang Jingyu Inventor after: Zhang Xue Inventor after: Liu Fanglei Inventor before: Yang Jingyu Inventor before: Liu Fanglei |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180508 |