CN112700389A - Active sludge microorganism color microscopic image denoising method - Google Patents
Active sludge microorganism color microscopic image denoising method Download PDFInfo
- Publication number
- CN112700389A CN112700389A CN202110043199.6A CN202110043199A CN112700389A CN 112700389 A CN112700389 A CN 112700389A CN 202110043199 A CN202110043199 A CN 202110043199A CN 112700389 A CN112700389 A CN 112700389A
- Authority
- CN
- China
- Prior art keywords
- noise
- matrix
- image
- denoising
- norm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 244000005700 microbiome Species 0.000 title claims abstract description 27
- 239000010802 sludge Substances 0.000 title claims abstract description 17
- 230000002146 bilateral effect Effects 0.000 claims abstract description 8
- 239000011159 matrix material Substances 0.000 claims description 68
- 230000006870 function Effects 0.000 claims description 41
- 238000005457 optimization Methods 0.000 claims description 13
- 230000003190 augmentative effect Effects 0.000 claims description 7
- 239000000654 additive Substances 0.000 claims description 5
- 230000000996 additive effect Effects 0.000 claims description 5
- OAICVXFJPJFONN-UHFFFAOYSA-N Phosphorus Chemical compound [P] OAICVXFJPJFONN-UHFFFAOYSA-N 0.000 claims description 4
- 238000000354 decomposition reaction Methods 0.000 claims description 4
- 230000003416 augmentation Effects 0.000 claims description 3
- 230000003247 decreasing effect Effects 0.000 claims description 3
- 238000010801 machine learning Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 14
- 230000008569 process Effects 0.000 abstract description 6
- 239000003086 colorant Substances 0.000 abstract description 3
- 238000012545 processing Methods 0.000 description 5
- 241000243329 Coleps Species 0.000 description 4
- 241000223785 Paramecium Species 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 230000003595 spectral effect Effects 0.000 description 3
- 238000001914 filtration Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 102000002274 Matrix Metalloproteinases Human genes 0.000 description 1
- 108010000684 Matrix Metalloproteinases Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000000813 microbial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000002040 relaxant effect Effects 0.000 description 1
- 230000000452 restraining effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 239000010865 sewage Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02W—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO WASTEWATER TREATMENT OR WASTE MANAGEMENT
- Y02W10/00—Technologies for wastewater treatment
- Y02W10/10—Biological treatment of water, waste water, or sewage
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention relates to the technical field of microimage denoising, in particular to an activated sludge microorganism color microimage denoising method1And W2Finally, optimizing and solving the model; in color image denoising, each channel is independently processed, so that a satisfactory denoising effect cannot be generally achieved, and artifacts are easily generated. Aiming at the multi-channel characteristic of a color image, the text provides a bilateral weighting pseudo-norm denoising method, and two weight matrixes W are introduced1And W2The method respectively represents the noise in three channels with different colors and different image patches, adaptively processes different noises in RGB channels, balances the multiple channels according to different noise standard deviations, and solves the noise difference among different channels, so that the denoising effect is better.
Description
Technical Field
The invention relates to the technical field of microimage denoising, in particular to a color microimage denoising method for activated sludge microorganisms.
Background
The activated sludge microorganisms have an important indicative function on judging the sewage treatment quality. And the characteristics of color, shape, detail texture and the like in the sludge microorganism microscopic image are important for the automatic detection and identification of the microorganism target. In the sludge microorganism microscopic image, the noise is mainly additive noise in the process of collection and imaging. The purpose of image denoising is to recover a clean image x from the noise observation y-x + n, where n is the image noise.
When the input is a noisy RGB color image, there are generally three main strategies for denoising color images. The first is to apply a grayscale image denoising algorithm to each channel. However, such a solution does not fully utilize the spectral correlation between RGB channels, and the denoising performance is not satisfactory. The second strategy is to convert the RGB image into a less relevant color space, such as YCbCr, and perform denoising in each channel of the converted space. One representative work in this regard is the CBM3D algorithm. However, color transformation complicates the noise distribution and the correlation between color channels is not fully exploited. The third strategy is to jointly denoise the RGB channels simultaneously to better exploit spectral correlation. For example, image blocks from the three channels RGB are concatenated into one long vector for processing.
The general natural image has the characteristics of sparsity, non-locality, low rank and the like, and the characteristics can be used as a useful basis for designing an image denoising method. Based on image sparsity, a typical denoising method constructs a denoising variational model by using dictionary-based image sparse representation, fuses non-local similar prior and sparse prior into a regular term of the variational model, and then obtains a denoised image by solving the variational model. Based on image non-local, the representative denoising method applies unsupervised learning clustering to image denoising, greatly improves the operation efficiency of non-local mean values in image denoising, and effectively improves the denoising effect. Based on low-rank denoising, the algorithm searches similar pixel blocks in a search region for the initially denoised reference pixel block, then the similar blocks at the corresponding positions of the original image form a similarity matrix, and the similarity matrix is subjected to low-rank matrix decomposition, so that noise and signals are effectively separated, and a finally denoised image is obtained.
In addition, a clear natural image and a corresponding data matrix of the image are often low-rank or approximately low-rank, because image information has great correlation, but if noise is introduced into the image, the low-rank of original data is damaged. The low rank matrix recovery is formed by treating the degraded image contaminated by noise as a set of low dimensional data plus noise, so that the data to obtain the pre-degraded image can be approximated by the low rank matrix. However, solving the rank function is an NP hard problem, which is often solved by relaxing it to a nuclear norm in an actual problem. The Singular Value Threshold (SVT) method makes the standard nuclear norm have a closed form solution, but the commonly used soft threshold shrinkage is not an optimal denoising method, and the phenomenon of image over-smoothing is easy to occur. On the basis of the standard nuclear norm, a weighted standard nuclear norm minimum (WNNM) method is proposed, original image information can be better kept according to the actual significance of singular values in an image, but a WNNM algorithm needs to set weights manually, so that denoising is not ideal. The non-convex norm-based low-dimensional image denoising algorithm replaces a rank function in a model by using a non-convex function on the basis of a traditional low-rank denoising model, so that a better approximate effect of the rank function is obtained, but the algorithm is only effective for gray level images.
Noise in the standard RGB color space can be modeled approximately as additive white gaussian noise, which, due to the optical sensor characteristics and the on-board processing mechanisms in the microscope digital camera pipeline, can produce different noise variances for different color channels. If these three channels are treated equally during the denoising process, false colors and artifacts will appear, which makes the image denoising problem more complicated. How to solve different noise characteristics in color channels and how to effectively utilize channel correlation are the key points for designing a good color image denoising algorithm.
Based on the method, the invention designs the denoising method of the activated sludge microorganism color microscopic image to solve the problems.
Disclosure of Invention
The invention aims to provide a method for denoising an activated sludge microorganism color microscopic image, which aims to solve the problems in the background technology.
In order to achieve the purpose, the invention provides the following technical scheme: a denoising method for activated sludge microorganism color microscopic images comprises the following steps:
s1: establishing a denoising model: given a color noise image y, assume that N local patches are extractedAnd stretching each local patch into a vector Is shown in whichIs the corresponding patch in channel c, where c ∈ { r, g, b } is the index of the r, g, and b channels, for each local image block yiSearching M local image blocks most similar to the local image blocks by Euclidean distance in a local window, superposing each local patch and the M similar patches column by column, and forming N noise patch matrixesTo estimate a clean plaque matrixAnother expression of the noise plaque matrix Y is, wherein YcIs a sub-matrix of channel c, and image low-rank denoising can be written as the following model:
the low-rank structure of the matrix is the sparsity defined in its singular values, similar to the L0 minimization, the rank function is usually bounded by the convex kernel norm | | X | |*=∑iσi(X) instead of the above-mentioned (A),where ρ isi(X) represents a singular value of X, and on the basis of the existing WNNM method, a pseudo norm is used for replacing a nuclear norm to provide a denoising model:
s2: designing a bilateral weighting pseudo-norm denoising algorithm: (2) w as defined in1And W2For the weight matrix, two weight matrices W are provided1And W2Is set as a diagonal matrix and is,
the pseudo-norm | | X | | non-conducting phosphorθIs defined as:
where θ > 0, m, n represents the height and width of the matrix X, the pseudo-norm | | X | | purple cellsθIs further shown as
The weight isThe pseudo norm can automatically set weight according to the size of a singular value;
s3: setting a weight matrix W1And W2: the noise in local patches can be modeled approximately as additive white gaussian noise, W1For regularizing the difference of the rows of the residual matrix (Y-X), and W2For regularizing the (Y-X) column differences. Noise plaque matrixClean noise patchDetermining a weight matrix W using a maximum a posteriori estimation1And W2:
Where log-likelihood term lnP (X | Y) has the statistical property of noise, assuming that the noise is an independent, identical distribution at each channel and each image block, and each image block is gaussian-distributed:
let P (X) obey the following distribution:
bringing (5) and (6) into (4) yields:
s4: model optimization and solution: the formula (2) is solved by adopting a variable splitting method TSWC, and the formula (2) is converted into a linear equality constraint problem with two variables X and Z by introducing an augmentation variable Z.
Equation (8) can be solved under the framework of the Alternative Direction Multiplier Method (ADMM), and the augmented lagrange function of (8) is:
initial variable X0,Z0,Δ0Set to 0 matrix, respectively with Xk,Zk,ΔkRepresenting the optimization variables and the lagrangian multiplier for the number of iterations k (k ═ 0, 1, 2, …), the variables can be updated alternately by taking the derivative of the lagrangian function L with respect to X and Z and setting the derivative to zero, X being updated by fixing Z and Δ:
its solution satisfies
AXk+1+Xk+1Bk=Ek, (11)
Equation (11) is a standard Sieve's equation, if and only ifHas a unique solution where σ (F) represents the sequence of the matrix F, i.e. the set of eigenvalues, SE (11) can be rewritten as:
by Xk+1=vec-1(vec(Xk+1) To obtain a solution Xk+1,
In the case of the Z sub-problem,
in machine learning, the theta norm is defined by the definition of equation (3)This function is known as a concave function with respect to x. The norm can be linearized according to a concave function superstep definition to obtain an explicit solution to the optimization problem using a singular value thresholding method. By definition of the concave superstep, let σiFor the ith singular value of matrix Z, we can obtain:
from equation (15), the solution of equation (14) can be relaxed to obtain the following optimization solution problem:
by approximating the constant term, a
Since the non-convex theta norm is a continuous, concave, smooth, and derivable monotonically increasing function over [0, + ∞), the gradient is non-negative and monotonically decreasing, due to the non-increasing nature of the singular values, withTherefore, the problem singular value threshold method solves:
wherein, is composed ofThe explicit solution of equation (15) can be obtained by singular value decomposition of (a). Update Δ by fixing X and Z:
Δk+1=Δk+(Xk+1-Zk+1), (19)
updating rho: rhok+1=μρk,μ≥1。
The above replacement updating steps are repeated until a convergence condition is satisfied or the number of iterations exceeds a preset threshold K1. When satisfying | | X at the same timek-Zk||F≤Tol,||Xk+1-Xk||FTol and Z are less than or equal tok+1-Zk||FAt Tol, the ADMM algorithm converges, wherein Tol>0 is a small tolerance number.
Further, W in the formula (2)1Is a block diagonal matrix with three blocks, each block having the same diagonal elements to describe the noise characteristics in the corresponding RGB channel. W2Is used to describe the noise variance, W, in the corresponding image patch matrix1And W2Are determined by the noise standard deviation in the corresponding channel and image patch matrix, respectively.
Further, in step S1Is the corresponding patch in channel c, where c ∈ { r, g, b } is the index of the r, g, and b channels.
Go toStep of, σ in step S2r,σg,σbRespectively representing the noise levels of the three channels of the noise image RGB,to have a dimension p2M is the number of patches in the noise patch matrix.
Further, in the expression of Y in step S3Sub-matrices of similar patches in R, G, B noisy channels, respectively, of the X expressionAre the sub-matrices of similar patches in the R, G, B ideal noise-free channels, respectively.
Further, Δ in equation (9) is an augmented Lagrangian multiplier, and ρ > 0 is a penalty parameter.
Compared with the prior art, the invention has the beneficial effects that:
(1) for a color microorganism microscopic image, the color microorganism microscopic image has the characteristics of low signal-to-noise ratio and low contrast, the noise difference of each channel is obvious, if the three channels are equally processed in the denoising process, a satisfactory denoising effect cannot be generally obtained, and artifacts are easily generated; in addition, the color microorganism microscopic image has low resolution, more internal details and irregular texture distribution, and the de-noised image is easy to blur. Aiming at the characteristics of a color microorganism microscopic image, the method for denoising the bilateral weighted pseudo-norm is provided, wherein two weight matrixes W1 and W2 are introduced, W1 represents noise in three different color channels, different noises in RGB channels are processed in a self-adaptive mode, the multiple channels are balanced according to different noise standard deviations of the multiple channels, and the noise difference among the different channels is solved; w2 represents noise in different image patches, the algorithm firstly carries out image blocking processing, then extracts N local patches and searches similar patches of the N local patches to form N noise patch matrixes, noise in each patch matrix can be better removed through W2, image blurring is reduced, and the overall denoising effect is better;
(2) conventional low rank denoising generally approximates a rank function by using an L1 norm or a kernel norm, and a pseudo norm is proposed herein to approximate the rank function, and the pseudo norm is a concave function and can be conveniently solved according to the characteristics of a super-gradient. The expression of the pseudo-norm is The proportion of different singular values in the rank function minimization model can be automatically corrected according to the size of the singular value of the rank function, so that the signal-to-noise ratio of the de-noised image can be effectively improved;
(3) for the color image denoising model, an Alternating Direction Multiplier Method (ADMM) is proposed based on an augmented Lagrange function to solve, so that each updating step has a closed form solution and convergence can be ensured. Compared with other algorithms, the algorithm has better convergence.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is an approximation of the different norms versus rank of the present invention;
FIG. 2 is a table listing algorithm parameters of the present invention;
FIG. 3 is a PSNR value graph of denoising results of different denoising methods of the present invention;
FIG. 4 is a comparison graph of the denoising results of Paramecium when σ is 25 and σ is 50 for each algorithm;
fig. 5 is a comparison graph of denoising results of Coleps when σ is 25 and σ is 50 for each algorithm;
FIG. 6 is a graph of PSNR variation with respect to the number of iteration steps according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-6, the present invention provides a technical solution: the active sludge microorganism color microscopic image denoising method is characterized by comprising the following steps:
s1: establishing a denoising model: given a color noise image y, assume that N local patches are extractedAnd stretching each local patch into a vector Is shown in whichIs the corresponding patch in channel c, where c ∈ { r, g, b } is the index of the r, g, and b channels, for each local image block yiSearching M local image blocks most similar to the local image blocks by Euclidean distance in a local window, superposing each local patch and the M similar patches column by column, and forming N noise patch matrixesTo estimate a clean plaque matrixAnother expression of the noise plaque matrix Y isWherein Y iscIs a sub-matrix of channel c, and image low-rank denoising can be written as the following model:
the low-rank structure of the matrix is sparsity defined in its singular values, similar to L0 minimization, which is a challenging problem, so the rank function is usually bounded by a convex kernel norm | | X | |*=∑iσi(X) in which σ isi(X) singular values representing X, such as the classical method WNNM based on image low rank prior denoising, can be written as follows:
the first term is a fidelity term and is used for restraining noise, and the second term is a regular term, namely a weighted nuclear norm, and is used for describing the low-rank property of the image. On the basis of the existing WNNM method, a pseudo norm is used for replacing a nuclear norm, and a denoising model is provided:
in this model, two weight matrices W are added1And W2Noise statistics in each channel and each image block can be represented in a self-adaptive manner, and simultaneously, combined denoising is carried out on RGB channels, so that the noise difference among different channels is solved, spectral correlation can be better utilized, and false colors or artifacts are avoided when three channels are equally processed; in addition, the pseudo norm is used for approximating the rank function, the weight is automatically set according to the singular value, the rank function can be better approximated, and therefore the image can be better denoised.
S2: designing a bilateral weighting pseudo-norm denoising algorithm: color images have different noise statistics on the RGB channels, which makes the color image denoising problem more challenging than grayscale image denoising, artifacts may occur if they are extended directly to true color image denoising by connecting image blocks of the RGB channels. The invention utilizes the low rank of the image non-local self-similarity prior image block, introduces two weight matrixes for data items in an RGB channel pseudo-norm minimization model, adaptively processes different noises in the RGB channel, balances multiple channels according to different noise standard deviations, and solves the noise difference between different channels.
W in the formula (3)1And W2For the weight matrix, two weight matrices W are provided1And W2Set as a diagonal matrix, W in said formula (3)1Is a block diagonal matrix with three blocks, each block having the same diagonal elements to describe the noise characteristics in the corresponding RGB channel. W2Each diagonal element of (a) is used to describe the noise variance in the corresponding image patch matrix,
wherein sigmar,σg,σbRespectively representing the noise levels of the three channels of the noise image RGB,to have a dimension p2M is the number of patches in the noise patch matrix, W1And W2Are determined by the noise standard deviation in the corresponding channel and image patch matrix respectively,
the traditional image denoising method uses an L1 norm to replace an L0 norm, because the L0 norm is difficult to be optimally solved, and the L1 norm is a convex approximation of the L0 norm, which is easy to be optimally solved. But since the L1 norm is a loose approximation of the L0 norm, L1 is extremely smallThe solution obtained by the optimization is usually sub-optimal. Therefore, the invention provides a pseudo-norm | | | X | | non-conducting phosphorθDefined as:
where θ > 0, m, n represents the height and width of matrix X, and a conventional rank function is generally non-linear using a convex kernel norm | | X |*=∑iσi(X) indicates that all singular values are treated equally in the conventional rank function minimization model and shrunk by the same threshold. However, this ignores one's often a priori knowledge of the singular values of the actual data matrix. For natural images, with general a priori knowledge, the larger singular values of X are more important than the smaller singular values because they represent the energy of the principal component of X. In denoising applications, singular values are key. An algorithm is adopted to obtain a clean image for the image damaged by the noise, and a larger singular value and a smaller singular value need to be reduced according to different weights. Obviously, the traditional rank function minimization model is not flexible enough to handle these problems.
The invention provides a pseudo norm | | | X | | non-conducting phosphorθFurther expressed as:
the weight isThe pseudo norm can automatically set weight according to the size of a singular value; as can be seen from fig. 1, the pseudo-norm has a better approximation effect on the rank function than the conventional norm. Thus, the present invention utilizes this norm to characterize the low rank nature, σ, of a noiseless imageiIs the i-th singular value of the matrix X
S3: setting a weight matrix W1And W2: the invention relates to W1And W2Set as a diagonal matrix, W1Is a block diagonal matrix composed of three blocks, each having the same diagonal elements to describe the noise characteristics in the corresponding R, G or B channelAnd (4) sex. The noise in the local patches can be modeled approximately as additive white Gaussian noise, with W2Describes the noise variance in the corresponding patch, in general, W1For regularizing the difference of the rows of the residual matrix (Y-X), and W2For regularizing the (Y-X) column differences.
Noise plaque matrixThereinSub-matrices of similar patches in R, G, B noisy channels, clean noise patches, respectivelyThereinSub-matrixes of similar plaques in R, G and B ideal noise-free channels respectively, and a weight matrix W is determined by adopting maximum posterior estimation1And W2:
Where log-likelihood term lnP (X | Y) has the statistical property of noise, assuming that the noise is an independent, identical distribution at each channel and each image block, and each image block is gaussian-distributed:
let P (X) obey the following distribution:
bringing (6) and (7) into (5) yields:
s4: model optimization and solution: the equation (3) is solved by adopting a variable splitting method TSWC, and the equation (3) is converted into a linear equality constraint problem with two variables X and Z by introducing an augmentation variable Z.
Equation (9) can be solved under the framework of the Alternative Direction Multiplier Method (ADMM), and the augmented lagrange function of (9) is:
where Δ is the augmented Lagrange multiplier and ρ > 0 is a penalty parameter, the initial variable X is set to be0,Z0,Δ0Set to 0 matrix, respectively with Xk,Zk,ΔkRepresenting the optimization variables and the lagrangian multiplier for the number of iterations k (k ═ 0, 1, 2, …), the variables can be updated alternately by taking the derivative of the lagrangian function L with respect to X and Z and setting the derivative to zero, X being updated by fixing Z and Δ:
its solution satisfies
AXk+1+Xk+1Bk=Ek (12)
Equation (12) is a standard Sieve's equation, if and only ifHas a unique solution where σ (F) represents the sequence of the matrix F, i.e. the set of eigenvalues, SE (12) can be rewritten as:
by Xk+1=vec-1(vec(Xk+1) To obtain a solution Xk+1,
In the case of the Z sub-problem,
in machine learning, the θ norm is defined by the definition of equation (4)This function is known as a concave function with respect to x. The norm can be linearized according to a concave function superstep definition to obtain an explicit solution to the optimization problem using a singular value thresholding method. By definition of the concave superstep, let σiFor the ith singular value of matrix Z, we can obtain:
from equation (16), the solution of equation (15) can be relaxed to obtain the following optimization solution problem:
by approximating the constant term, a
Since the non-convex theta norm is a continuous, concave, smooth, and derivable monotonically increasing function over [0, + ∞), the gradient is non-negative and monotonically decreasing, due to the non-increasing nature of the singular values, withTherefore, the problem singular value threshold method solves:
wherein, is composed ofThe explicit solution of equation (15) can be obtained by singular value decomposition of (a). Update Δ by fixing X and Z:
Δk+1=Δk+(Xk+1-Zk+1) (20)
updating rho: rhok+1=μρk,μ≥1。
Repeating the replacing and updating steps until a convergence condition is met or the iteration number exceeds a preset threshold value K1. When satisfying | | X at the same timek-Zk||F≤Tol,||Xk+1-Xk||FTol and Z are less than or equal tok+1-Zk||FAt Tol, the ADMM algorithm converges, wherein Tol>0 is a small tolerance number. Pseudo code of the ADMM algorithm is as follows:
ADMM algorithm:
inputting: y, { sigma., (S)r,σg,σb},μ,Tol,K1;
Initialization: x0=Z0=Δ0=0,ρ0>0;
For: k is 1: K1;
1. Updating X through (12);
2. updating Z by (19);
3. updating Δ by (20);
4. through rhok+1=μρkMu is more than or equal to 1 to update rho;
when the convergence condition is satisfied or K is more than or equal to K1Finishing;
and (3) outputting: matrices X and Z.
Given the color noise image y, in view of the low resolution characteristic of the microorganism microscopic image, the image resolution is firstly amplified linearly, and then N local plaques are extractedAnd their similar plaques. In view of the characteristic that the internal details of the microbial image are multiple, the window size of the similar image block search is set to be 30 x 30, the calculated amount is increased due to the overlarge window, the algorithm efficiency is reduced, and the algorithm accuracy is reduced due to the overlarge window, so that the denoising effect is influenced. Then N noise patch matrices are formedTo estimate a clean plaque matrixWill matrixIn the image processing system, patches are gathered to form a denoised imageRepeatedly executing the denoising step K to obtain better denoising effect2Next, the process is carried out. The pseudo code of the denoising algorithm of the invention is as follows:
the color microorganism image denoising algorithm based on bilateral weighting and pseudo norm comprises the following steps:
inputting: noisy image y, { sigma }r,σg,σb},μ,K2;
for: k is 1: K2;
For each yj:
3. Find each yjNon-local similar patch Yj;
End up
Finishing;
the configuration memory of the experimental PC is 4G, the main frequency is 1.7GHz, the operating system is win1064 bits, and the software design platform is MATLAB 2016. Two types of microorganism microscopic image representatives are selected in the experiment, namely a Paramecium Paramecium image with the resolution of 185 x 172 and a Coleps grenade image with the resolution of 223 x 226. These two types of images are rich in color and have more internal details. Selecting a representative denoising algorithm: gaussian filtering, non-local mean denoising (NL-means) and WNNM algorithm are compared with the algorithm of the invention, and denoising results are compared from two aspects of objective index and subjective quality respectively.
Objective index:
the classical peak signal-to-noise ratio (PSNR) parameter that measures the denoising effect is defined as follows:
the Structural Similarity (SSIM) parameter is defined as follows:
where M and N are the number of rows and columns of the image, X is the denoised image, Y is the plaque noise matrix, uX,uYThe average values, σ, of the pixels in X and Y, respectivelyX,σYThe variance of the X and Y pixel values, respectively. SigmaXYIs the covariance of X and Y, C1,C2Is to adjust the parameter, typically take C1=(k1l)2,C2=(k2l)2,k1=0.01,k20.03 and 255. SSIM is always less than 1, with 1 indicating complete similarity. For most image denoising algorithms, the standard deviation of noise should be used as a parameter, and the noise standard σ of a color image can be estimated by some noise estimation method.
The noise criteria for the mth patch of Y may be initialized as:
wherein, ymIs the m-th column, x, in the image block matrix YmIs the m-th image block recovered in the previous iteration. Denoising of color images is performed by processing each channel using a model trained at the same or similar noise level. Parameter definitions and values in the algorithm are shown in fig. 2.
It can be seen from fig. 3 that the method provided by the present invention is superior to other comparison methods under different test images and different noise levels no matter on PSNR indexes or SSIM indexes, in order to better approximate the rank function, the present invention provides a pseudo-norm to approximate the rank function, the method can automatically set the weight according to the singular value, and the signal-to-noise ratio of the de-noised image is greatly improved.
Subjective quality:
and displaying all the denoised images in an experiment, amplifying local details to observe the removal precision of noise points and the retention degree of image details and edge information, and then giving qualitative evaluation of the subjective denoising effect. Fig. 4 is a comparison graph of the denoising results of paramecimum when σ is 25 and σ is 50 for each algorithm, and fig. 5 is a comparison graph of the denoising results of Coleps when σ is 25 and σ is 50 for each algorithm.
Observing the whole images in the figures 4 and 5, the Gaussian filtering algorithm is not ideal for removing noise points, the NL-means denoised image is easy to generate blur, and the WNNM algorithm and the algorithm of the invention realize better denoising effect. As can be seen from the detailed enlarged portions of fig. 4 and 5, the internal structure of the microorganism image is better retained in the present invention compared with other methods. The invention provides a bilateral weighting pseudo-norm denoising algorithm, which utilizes the noise characteristics of different channels and local image blocks to denoise. Specifically, two weight matrixes are introduced into a data fidelity term of the weighted pseudo-norm minimization model to adaptively characterize noise statistics in each image block of each channel, so that the algorithm achieves a good denoising effect.
And (3) convergence analysis:
in order to verify the convergence of the algorithm provided by the invention, a PSNR (Peak signal to noise ratio) change value curve of the algorithm and a WNNM algorithm when denoising Paramecium and Coleps images is drawn, as shown in FIG. 6. It can be seen from the figure that the algorithm provided by the invention is stable in relative change value in 2 steps or so of iteration, and the WNNM algorithm is stable in relative change value in 5 steps or so of iteration, which shows that the convergence of the algorithm is better than that of the WNNM algorithm from numerical experiments.
The invention provides a bilateral weighting pseudo-norm denoising algorithm for a color microorganism image. The color image has the characteristic of multiple channels, so that the invention introduces two weight matrixes to respectively represent the noise in different color channels and different image patch matrixes, and then uses the pseudo norm to approximate a rank function, thereby greatly improving the signal-to-noise ratio of the de-noised image. Compared with other methods, the algorithm has the best denoising effect, can more completely retain the internal details of the image while denoising, and improves the image quality.
The product model provided by the invention is only used according to the structural characteristics of the product, the product can be adjusted and modified after being purchased so as to be more matched and accord with the technical scheme of the invention, the product model is the best application technical scheme of the technical scheme, the product model can be replaced and modified according to the required technical parameters, and the product model is well known by the technical personnel in the field, so that the technical scheme provided by the invention can clearly obtain the corresponding use effect.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (6)
1. The active sludge microorganism color microscopic image denoising method is characterized by comprising the following steps:
s1: establishing a denoising model: given a color noise image y, assume that N local patches are extractedAnd stretching each local patch into a vector Is shown in whichIs the corresponding patch in channel c, where c ∈ { r, g, b } is the index of the r, g, and b channels, for each local image block yiSearching M local image blocks most similar to the local image blocks by Euclidean distance in a local window, superposing each local patch and the M similar patches column by column, and forming N noise patch matrixesTo estimate a clean plaque matrixAnother expression of the noise plaque matrix Y isWherein Y iscIs a sub-matrix of channel c, and image low-rank denoising can be written as the following model:
the low-rank structure of the matrix is the sparsity defined in its singular values, similar to the L0 minimization, the rank function is usually bounded by the convex kernel norm | | X | |*=∑iσi(X) in which σ isi(X) represents a singular value of X, and on the basis of the existing WNNM method, a pseudo norm is used for replacing a nuclear norm to provide a denoising model:
s2: designing a bilateral weighting pseudo-norm denoising algorithm: (2) w as defined in1And W2For the weight matrix, two weight matrices W are provided1And W2Is set as a diagonal matrix and is,
the pseudo-norm | | X | | non-conducting phosphorθIs defined as:
where θ > 0, m, n represents the height and width of the matrix X, the pseudo-norm | | X | | purple cellsθIs further shown as
The weight isThe pseudo norm can automatically set weight according to the size of a singular value;
s3: setting a weight matrix W1And W2: the noise in local patches can be modeled approximately as additive white gaussian noise, W1For regularizing the difference of the rows of the residual matrix (Y-X), and W2For regularizing the (Y-X) column differences. Noise plaque matrixClean noise patchDetermining a weight matrix W using a maximum a posteriori estimation1And W2:
Where log-likelihood term lnP (X | Y) has the statistical property of noise, assuming that the noise is an independent, identical distribution at each channel and each image block, and each image block is gaussian-distributed:
let P (X) obey the following distribution:
bringing (5) and (6) into (4) yields:
s4: model optimization and solution: the formula (2) is solved by adopting a variable splitting method TSWC, and the formula (2) is converted into a linear equality constraint problem with two variables X and Z by introducing an augmentation variable Z.
Equation (8) can be solved under the framework of the Alternative Direction Multiplier Method (ADMM), and the augmented lagrange function of (8) is:
initial variable X0,Z0,Δ0Set to 0 matrix, respectively with Xk,Zk,ΔkRepresenting the optimization variables and the lagrangian multiplier for the number of iterations k (k 0, 1, 2..) the variables can be updated alternately by taking the derivative of the lagrangian function L with respect to X and Z and setting the derivative to zero, X being updated by fixing Z and Δ:
its solution satisfies
AXk+1+Xk+1Bk=Ek (11),
Equation (11) is a standard Sieve's equation, if and only ifHas a unique solution where σ (F) represents the sequence of the matrix F, i.e. the set of eigenvalues, SE (11) can be rewritten as:
by Xk+1=vec-1(vec(Xk+1) To obtain a solution Xk+1,
In the case of the Z sub-problem,
in machine learning, the theta norm is defined by the definition of equation (3)This function is known as a concave function with respect to x. The norm can be linearized according to a concave function superstep definition to obtain an explicit solution to the optimization problem using a singular value thresholding method. By definition of the concave superstep, let σiFor the ith singular value of matrix Z, we can obtain:
from equation (15), the solution of equation (14) can be relaxed to obtain the following optimization solution problem:
by approximating the constant term, a
Since the non-convex theta norm is a continuous, concave, smooth, and derivable monotonically increasing function over [0, + ∞), the gradient is non-negative and monotonically decreasing, due to the non-increasing nature of the singular values, withTherefore, the problem singular value threshold method solves:
wherein, is composed ofThe explicit solution of equation (14) can be obtained by singular value decomposition of (a). Update Δ by fixing X and Z:
Δk+1=Δk+(Xk+1-Zk+1) (19),
updating rho: rhok+1=μρk,μ≥1。
The above replacement updating steps are repeated until a convergence condition is satisfied or the number of iterations exceeds a preset threshold K1. When satisfying | | X at the same timek-Zk||F≤Tol,||Xk+1-Xk||FTol and Z are less than or equal tok+1-Zk||FBelow Tol, the ADMM algorithm converges, where Tol > 0 is a small number of tolerances.
2. The activated sludge microorganism color microscopic image denoising method of claim 1, characterized in that: w in the formula (2)1Is a block diagonal matrix with three blocks, each block having the same diagonal elements to describe the noise characteristics in the corresponding RGB channel. W2Is used to describe the noise variance, W, in the corresponding image patch matrix1And W2Are determined by the noise standard deviation in the corresponding channel and image patch matrix, respectively.
5. The activated sludge microorganism color microscopic image denoising method of claim 1, characterized in that: in Y expression in step S3Sub-matrices of similar patches in R, G, B noisy channels, respectively, of the X expressionAre the sub-matrices of similar patches in the R, G, B ideal noise-free channels, respectively.
6. The activated sludge microorganism color microscopic image denoising method of claim 1, characterized in that: Δ in equation (9) is the augmented Lagrangian multiplier, and ρ > 0 is a penalty parameter.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110043199.6A CN112700389B (en) | 2021-01-13 | 2021-01-13 | Active sludge microorganism color microscopic image denoising method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110043199.6A CN112700389B (en) | 2021-01-13 | 2021-01-13 | Active sludge microorganism color microscopic image denoising method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112700389A true CN112700389A (en) | 2021-04-23 |
CN112700389B CN112700389B (en) | 2022-08-19 |
Family
ID=75514391
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110043199.6A Active CN112700389B (en) | 2021-01-13 | 2021-01-13 | Active sludge microorganism color microscopic image denoising method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112700389B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113723537A (en) * | 2021-09-02 | 2021-11-30 | 安阳师范学院 | Robust-based symmetric nonnegative matrix factorization microbial data clustering method |
CN114581910A (en) * | 2022-05-06 | 2022-06-03 | 天津大学 | Micro-needle hole view noise reduction method combining stereo matching and deep learning |
CN115082360A (en) * | 2022-07-27 | 2022-09-20 | 中国科学技术大学 | Method and system for recovering continuous slice transmission electron microscope image |
CN116185306A (en) * | 2023-04-24 | 2023-05-30 | 山东爱福地生物股份有限公司 | Sewage treatment system data storage method using potamogeton crispus |
CN117314763A (en) * | 2023-08-17 | 2023-12-29 | 贵州医科大学附属口腔医院 | Oral hygiene management method and system based on machine learning |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103871035A (en) * | 2014-03-24 | 2014-06-18 | 华为技术有限公司 | Image denoising method and device |
CN104751417A (en) * | 2013-12-31 | 2015-07-01 | 展讯通信(上海)有限公司 | Color noise reducing method, device and image processing system |
CN107085835A (en) * | 2017-05-10 | 2017-08-22 | 五邑大学 | Color image filtering method based on quaternary number Weighted Kernel Norm minimum |
CN108710150A (en) * | 2018-05-22 | 2018-10-26 | 中国海洋石油集团有限公司 | A kind of earthquake random noise minimizing technology based on steady singular spectrum analysis |
CN109658351A (en) * | 2018-11-26 | 2019-04-19 | 浙江工业大学 | The high spectrum image denoising method that a kind of combination L0 gradient constraint and local low-rank matrix are restored |
CN110060219A (en) * | 2019-04-24 | 2019-07-26 | 北京理工大学 | One kind being based on low-rank approximately true figure noise-reduction method |
CN110458777A (en) * | 2019-08-05 | 2019-11-15 | 湖南大学 | A kind of high spectrum image denoising method, system and medium based on the correction of adaptive order |
CN110490814A (en) * | 2019-07-09 | 2019-11-22 | 珠海城市职业技术学院 | Mixed noise minimizing technology, system and storage medium based on smooth order constraint |
CN110675344A (en) * | 2019-09-24 | 2020-01-10 | 福州大学 | Low-rank denoising method and device based on real color image self-similarity |
CN111260571A (en) * | 2020-01-11 | 2020-06-09 | 浙江工业大学 | Depth image restoration method based on non-convex low-rank low gradient |
CN112084847A (en) * | 2020-07-30 | 2020-12-15 | 浙江工业大学 | Hyperspectral image denoising method based on multi-channel truncation kernel norm and total variation regularization |
-
2021
- 2021-01-13 CN CN202110043199.6A patent/CN112700389B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104751417A (en) * | 2013-12-31 | 2015-07-01 | 展讯通信(上海)有限公司 | Color noise reducing method, device and image processing system |
CN103871035A (en) * | 2014-03-24 | 2014-06-18 | 华为技术有限公司 | Image denoising method and device |
CN107085835A (en) * | 2017-05-10 | 2017-08-22 | 五邑大学 | Color image filtering method based on quaternary number Weighted Kernel Norm minimum |
CN108710150A (en) * | 2018-05-22 | 2018-10-26 | 中国海洋石油集团有限公司 | A kind of earthquake random noise minimizing technology based on steady singular spectrum analysis |
CN109658351A (en) * | 2018-11-26 | 2019-04-19 | 浙江工业大学 | The high spectrum image denoising method that a kind of combination L0 gradient constraint and local low-rank matrix are restored |
CN110060219A (en) * | 2019-04-24 | 2019-07-26 | 北京理工大学 | One kind being based on low-rank approximately true figure noise-reduction method |
CN110490814A (en) * | 2019-07-09 | 2019-11-22 | 珠海城市职业技术学院 | Mixed noise minimizing technology, system and storage medium based on smooth order constraint |
CN110458777A (en) * | 2019-08-05 | 2019-11-15 | 湖南大学 | A kind of high spectrum image denoising method, system and medium based on the correction of adaptive order |
CN110675344A (en) * | 2019-09-24 | 2020-01-10 | 福州大学 | Low-rank denoising method and device based on real color image self-similarity |
CN111260571A (en) * | 2020-01-11 | 2020-06-09 | 浙江工业大学 | Depth image restoration method based on non-convex low-rank low gradient |
CN112084847A (en) * | 2020-07-30 | 2020-12-15 | 浙江工业大学 | Hyperspectral image denoising method based on multi-channel truncation kernel norm and total variation regularization |
Non-Patent Citations (4)
Title |
---|
KAITO HOSONO等: "Weighted tensor nuclear norm minimization for color image denoising", 《2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP)》, 19 August 2016 (2016-08-19), pages 3081 - 3085 * |
YISU ZHOU等: "Double Weighted RPCA Denoising Algorithm for Color Images", 《2018 IEEE 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC)》, 1 August 2019 (2019-08-01), pages 1670 - 1674 * |
付鹏程等: "多通道非凸低秩近似及其在彩色图像去噪上的应用", 《传感器与微系统》, vol. 39, no. 5, 31 December 2020 (2020-12-31), pages 156 - 160 * |
杨晶华: "图像去噪问题的数学模型和快速算法研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》, vol. 2020, no. 1, 15 January 2020 (2020-01-15), pages 138 - 1808 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113723537A (en) * | 2021-09-02 | 2021-11-30 | 安阳师范学院 | Robust-based symmetric nonnegative matrix factorization microbial data clustering method |
CN114581910A (en) * | 2022-05-06 | 2022-06-03 | 天津大学 | Micro-needle hole view noise reduction method combining stereo matching and deep learning |
CN115082360A (en) * | 2022-07-27 | 2022-09-20 | 中国科学技术大学 | Method and system for recovering continuous slice transmission electron microscope image |
CN116185306A (en) * | 2023-04-24 | 2023-05-30 | 山东爱福地生物股份有限公司 | Sewage treatment system data storage method using potamogeton crispus |
CN117314763A (en) * | 2023-08-17 | 2023-12-29 | 贵州医科大学附属口腔医院 | Oral hygiene management method and system based on machine learning |
Also Published As
Publication number | Publication date |
---|---|
CN112700389B (en) | 2022-08-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112700389B (en) | Active sludge microorganism color microscopic image denoising method | |
CN109741256B (en) | Image super-resolution reconstruction method based on sparse representation and deep learning | |
CN109671029B (en) | Image denoising method based on gamma norm minimization | |
CN107590779B (en) | Image denoising and deblurring method based on image block clustering dictionary training | |
CN112132760B (en) | Image recovery method based on matrix inversion and matrix decomposition capable of learning and differentiating | |
Herbreteau et al. | DCT2net: An interpretable shallow CNN for image denoising | |
Tang et al. | Bayesian framework with non-local and low-rank constraint for image reconstruction | |
CN110830043B (en) | Image compressed sensing reconstruction method based on mixed weighted total variation and non-local low rank | |
CN107085835B (en) | Color image filtering method based on quaternary number Weighted Kernel Norm minimum | |
CN110992292A (en) | Enhanced low-rank sparse decomposition model medical CT image denoising method | |
CN111915518B (en) | Hyperspectral image denoising method based on triple low-rank model | |
CN104881847A (en) | Match video image enhancement method based on wavelet analysis and pseudo-color processing | |
CN109636734A (en) | A kind of sparse regular terms of weighting based on group rarefaction representation constrains image de-noising method | |
CN113808036A (en) | Low-illumination image enhancement and denoising method based on Retinex model | |
CN114820352A (en) | Hyperspectral image denoising method and device and storage medium | |
Sheng et al. | Frequency-domain deep guided image denoising | |
CN116109519B (en) | Image denoising method | |
Golla et al. | A novel approach of k-SVD-based algorithm for image denoising | |
CN112508807B (en) | Image denoising method based on multi-direction total variation | |
CN110335225B (en) | Method for fusing infrared light image and visible light image | |
Wang et al. | Image denoising using an improved generative adversarial network with Wasserstein distance | |
CN112767263A (en) | Image mixed noise removing method based on low-rank function and multi-direction total variation | |
CN112819822A (en) | Non-reference image definition evaluation method based on multiple curvature tensor sparse decomposition | |
Ashpreet et al. | Impulse noise suppression in color images using median filter and deep learning | |
Tang et al. | LMENet: A lightweight multiscale efficient convolutional neural network for image denoising |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |