CN114786018A - Image reconstruction method based on greedy random sparse Kaczmarz - Google Patents
Image reconstruction method based on greedy random sparse Kaczmarz Download PDFInfo
- Publication number
- CN114786018A CN114786018A CN202210682958.8A CN202210682958A CN114786018A CN 114786018 A CN114786018 A CN 114786018A CN 202210682958 A CN202210682958 A CN 202210682958A CN 114786018 A CN114786018 A CN 114786018A
- Authority
- CN
- China
- Prior art keywords
- sparse
- kaczmarz
- vector
- iteration
- image reconstruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/3059—Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
- H03M7/3062—Compressive sampling or sensing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Abstract
The invention relates to an image reconstruction method based on greedy random sparse Kaczmarz, which comprises the following steps of 1, carrying out image reconstruction on one image to be compressedUsing random Gaussian matrixAnd sparse basis matricesTo pairSampling to obtain corresponding compression observed valueWherein, in the process,(ii) a 2. For compressed observed valueIs divided into blocks according to columns(ii) a 3. Solving sparse solution vector by greedy random sparse Kaczmarz algorithm(ii) a 4. Inverse sparse transformation of sparse original vectorsObtain the final solution vectorTo is aligned withAre combined into,I.e. the reconstructed image signal. The invention not only provides the Kaczmarz iteration method for image compressed sensing reconstruction without the prior known signal compressed sparsity, but also improves the efficiency of image compressed sensing reconstruction and reduces the times and the calculation amount required by iteration.
Description
Technical Field
The invention relates to a signal compression sampling and reconstruction method in the technical field of signal processing, in particular to an image reconstruction method based on greedy random sparse Kaczmarz.
Background
Compressed Sensing (CS) is an emerging theory of information acquisition and transmission processing, and the CS indicates that sparsity prior information in a signal can be fully utilized, and an original high-dimensional signal is projected to a low-dimensional space by using an uncorrelated measurement matrix under a condition far lower than a Nyquist sampling frequency, so as to obtain a low-dimensional observed value, and the original signal can be reconstructed without distortion. And the signal sampling and the compression coding are completed in one step in the compressed sensing, which has great convenience and advantages for the acquisition and transmission of the signal. The signal reconstruction algorithm is the core of the compressed sensing theory, and refers to the process of reconstructing a sparse signal from a measured value.
The traditional compressed sensing image reconstruction method is mainly based on optimization iteration for reconstruction, inevitably brings higher calculation cost, and has undesirable recovery effect when the measurement rate is very low. The problem of recovering the sparse signal can be regarded as a solution problem of the linear system Ax = b. The iterative projection-based Kaczmarz method is concerned by people because of small storage capacity and high operation speed.
The Kaczmarz algorithm is an important method for solving a linear system Ax = b, the traditional Kaczmarz method is a method for solving a linear compatible system, and initial values are projected on a hyperplane which is determined by each row vector of a matrix and a corresponding observation value in sequence according to the sequence of rows. It is clear that the convergence properties of Kaczmarz depend on the row order, and that the convergence results of Kaczmarz are very slow if the row order of the coefficient matrix is not good, and it is difficult to analyze the convergence results for this method.
The Kaczmarz algorithm solves for a least squares solution, which is usually dense. The sparse solution for solving the linear system has wide application in the fields of image reconstruction, signal processing, machine learning and the like. By introducing the l1 norm, a sparse solution to solve a linear system can be converted to a regularized least squares problem. The subsequent random sparse Kaczmarz algorithm is characterized in that when the row norm of the coefficient matrix is not large, the random Kaczmarz and the random sparse Kaczmarz select the row of the coefficient matrix at equal probability, and the convergence rate of the random Kaczmarz algorithm is slow, so that a new probability criterion is adopted for selecting a working row by the aid of the later greedy random Kaczmarz.
Disclosure of Invention
The invention aims to provide an image reconstruction method based on greedy random sparse Kaczmarz. The invention adopts the following technical scheme:
an image reconstruction method based on greedy random sparse Kaczmarz comprises the following steps:
step 2, compressing the observed valueBlocking into compressed observation value blocks according to columns;
for the computed sparse solution vectorPerforming an anti-sparseness transformationObtain the final solution vector,
Further, in the step 3, calculation is performedCorresponding sparse solution vectorThe method comprises the following steps:
step 3.1, useComputing a quantity for determining a probability criterion in a greedy stochastic Kaczmarz method,Representing sparse solution vectors obtained from the last iteration, at the first iterationFor n-dimensional all-0 vectorsWherein n isThe number of rows ofBThe number of columns;
WhereinShow to obtainThe number of the 2-norm,show to obtain2 modelThe square of the number of the bits is,representing a vectorTo (1)The value of the one or more parameters,representing a matrix of coefficientsTo (1) aA row vector formed by the rows of the image,;
step 3.3, calculating residual error vector,To (1)Each component isAnd according to probabilitySelectingWork line of (1)In whichRepresents the selected coefficient matrix ofThe line is used as the probability of the iterative work line;
step 3.4, calculating by using a soft threshold shrinkage operator to obtain sparse solution vectors of the iteration;
And 3.5, judging whether the iteration termination condition is met, if so, turning to the next step, otherwise, turning to the step 3.1, adding 1 to the iteration times, and adding the iteration times to the number of timesIs updated to;
whereinShows FrobenThe norm of the ius is obtained by calculating the sum of the signals,the square of Frobenius norm is calculated,show to obtainThe number of the 2 norm is the same as the standard,expression solution2 norm square.
Further, in the step 3.2, a positive integer index set is definedBy satisfying the inequalityIndex of (2)Put into an index setIn (1).
further, the detailed steps of step 3.4 are as follows:
Step 3.42, given the hyperparameter in the soft threshold shrink operatorWill solve the vectorIntroducing a soft threshold shrinking operator to obtain a sparse solution vector obtained by the iteration。
Further, in said step 3.41, the vector is solvedWhereinIndicating a to-be-processed line vectorThe translation is a column vector.
Further, in step 3.42, the soft threshold shrinking operator is:
whereinShow to getAnd the maximum value of the sum of 0,representing a symbolic function, i.e. whenWhen the utility model is used, the water is discharged,(ii) a When the temperature is higher than the set temperatureWhen the temperature of the water is higher than the set temperature,(ii) a When in useWhen the temperature of the water is higher than the set temperature,therefore, the soft threshold shrink operator can also be expressed as:
Further, in step 3.5, the iteration termination condition is: the change of the sparse solution vector corresponding to the two iterations is minimized or reaches the maximum iteration number.
After the technical scheme is adopted, compared with the prior art, the invention has the following advantages:
the image reconstruction method based on greedy random sparse Kaczmarz is suitable for signal reconstruction of compressed measurement signals of any known measurement matrix and sparse basis matrix.
The invention is described in detail below with reference to the figures and examples.
Drawings
FIG. 1 is a schematic flow diagram of the process of the present invention;
FIG. 2 is a schematic flow diagram of a greedy stochastic sparse Kaczmarz algorithm;
FIG. 3 is a schematic diagram of the convergence of the greedy stochastic sparse kaczmarz algorithm used by the present invention; wherein the coefficient matrix is m =600, n =200,and = 1. The horizontal axis represents iteration times, and the vertical axis represents reconstruction errors of a solution obtained by each step of iteration of the algorithm and a real solution;
FIG. 4 is a graph of experimental results of compressed sensing image reconstruction for grayscale images in accordance with the present invention; wherein (a) is an original image with a resolution of 256 × 256; (b) the image is an image after low-rank adjustment and is also an image of an input algorithm; (c) the image is an image after being sampled by a sensing matrix; (d) the figure is the result of recovering the image matrix of the (c) figure with the proposed algorithm of the invention (PSNR = 22.4503); (e) the graph is the result of recovering the image matrix of (c) graph with orthogonal matching pursuit algorithm (PSNR = 14.4409); (f) the figure is the result of recovering the image matrix of (c) the figure with the iterative shrinkage thresholding algorithm (PSNR = 20.5339).
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth to illustrate, but are not to be construed to limit the scope of the invention.
As shown in fig. 1-2, fig. 1 is a flowchart of an image reconstruction method based on greedy random sparse Kaczmarz according to the present invention, which specifically includes the following steps:
Compressed sensing is a process of recovering an original signal from a compressed observation value, so that the compressed observation value, and a corresponding measurement matrix and a sparse basis matrix need to be obtained first.
The reconstruction method of the present invention is an image reconstruction method based on one-dimensional signals, and therefore, the image signals need to be restored in blocks according to columns and then merged according to columns.
Determining quantities of probability criterion in greedy stochastic Kaczmarz methodThe rule of (1) is:
whereinThe Frobenius norm is calculated,the square of Frobenius norm is calculated,expression solutionThe number of the 2-norm,show to obtain2 norm square.
and for the case = 0:
the above property can be such that the set of positive integer indices defined in said step 3Is non-empty, so that iteration can be performed, and the efficiency of iteration is improved relative to a method for randomly selecting a working line.
WhereinExpression solutionThe number of the 2 norm is the same as the standard,expression solutionThe square of the 2 norm is calculated,representing right-hand vectorsTo (1)The value of the one or more of the one,representing a matrix of coefficientsTo (1)A row vector formed by the rows of the image,represent iteration proceeds toThe resulting solution vector.
Defining a set of positive integer indices that will satisfy the inequalityIndex of (2)Put into an index setIn (1). The advantage of this is that it is possible to do so,representing the current solutionTo coefficient matrix ofThe distance of the hyperplane formed by the rows is such that the set is madeIn which the current solution is includedIndices having greater distance to respective hyperplane。
is ready forIn an index setIn this case, the residual vector is directly calculated, and is 0 if not.
According to probabilitySelect the line of workTo select the indexIs defined as a set of metrics proportional to the square of each residual componentIndex corresponding to larger residual vectorCan be taken with a greater probability.
Updating solution vector passesIs obtained whereinRepresenting a row vectorThe translation is to be a column vector that,show thatOrthogonal projection toThe solution vector obtained by the constructed hyperplane.
Step 8, defining a soft threshold shrinkage operator, and giving a hyperparameter in the soft threshold shrinkage operator;
The soft threshold shrink operator is
WhereinShow to getAnd the maximum value of the sum of 0,representing a symbolic function, i.e. whenWhen the utility model is used, the water is discharged,(ii) a When in useWhen the utility model is used, the water is discharged,(ii) a When in useWhen the utility model is used, the water is discharged,. The soft threshold shrink operator can therefore also be expressed as:
Step 10, iteratively operating the steps 2-8 until a termination condition is met; and outputting the sparse solution.
The termination conditions were: and when the change quantity of the sparse solution vector corresponding to the two iterations is sufficiently small or reaches the maximum iteration number, the algorithm is terminated. At this time, sparse solution vectors may be output。
Step (ii) of11, for the computed sparse solution vectorNamely, it isPerforming an inverse sparse transformObtain the final solution vector,p∈[1,2,……,n]Will beAre combined into one column,I.e. the reconstructed image signal.
The solution vectors obtained by solving the greedy random sparse kaczmarz algorithm are sparse, real solution vectors are obtained after inverse sparse transformation, and reconstructed signals are obtained after column combination.
Effect verification
To verify the effectiveness of the present invention, we performed experimental verification on a randomly generated gaussian matrix of 600 x 200 and LENA picture matrix with a resolution of 256 x 256.
In experiment 1, we first randomly generated 600 x 200 gaussian matrices as coefficient matricesRegenerating a sparse 200 x 1 random vector as the true solution of the linear systemBy usingObtaining the vector at the right end of the linear system. Curves of convergence speed based on Greedy random Sparse Kaczmarz algorithm (GRSK) and random Sparse Kaczmarz algorithm (RSK), near-end Gradient Descent algorithm (PGD) and cross Direction multiplier Algorithm (ADMM) are compared. Fig. 3 records the convergence curves of the above four algorithms, where the RSK algorithm is a dashed line, the GRSK algorithm is a solid line, and the PGD and ADMM algorithms are a dashed line and a dotted line, respectively. It can be seen that the algorithm provided by the invention has better results.
In experiment 2, the results of reconstructing the LENA image matrix after sub-sampling based on the greedy stochastic sparse Kaczmarz algorithm (corresponding to the d diagram in fig. 4), the iterative algorithm based on the near-end gradient descent (corresponding to the f diagram in fig. 4), and the orthogonal matching pursuit algorithm (corresponding to the e diagram in fig. 4) proposed by the present invention are compared, and the judgment standard uses Peak Signal to Noise Ratio (PSNR), which is an engineering term representing the Ratio of the maximum possible power of a Signal and the destructive Noise power affecting its representation precision, and is used to represent the reconstruction precision in this experiment. The peak signal-to-noise ratios are:
psnr (grsk) =22.45, psnr (ista) =20.53, psnr (omp) = 14.44. It can be seen that the algorithm proposed by the present invention is also better in image reconstruction.
The foregoing is illustrative of the best mode of the invention and details not described herein are within the common general knowledge of a person of ordinary skill in the art. The scope of the present invention is defined by the appended claims, and any equivalent modifications based on the technical teaching of the present invention are also within the scope of the present invention.
Claims (10)
1. The image reconstruction method based on greedy random sparse Kaczmarz is characterized by comprising the following steps of:
step 1, one image to be compressedUsing random Gaussian matrixAnd sparse basis matricesFor is toSampling to obtain corresponding compression observed valueWherein, in the step (A),,for the M-dimensional euclidean space,is composed ofBThe number of rows of (a) to (b),nis composed ofBNumber of columns of (a) andmuch less than;
Step 2, compressing the observed valueBlocking into compressed observation value blocks according to columns;
Step 3, respectively calculating by utilizing greedy random sparse Kaczmarz algorithmCorresponding sparse solution vector;
for the computed sparse solution vectorPerforming an anti-sparseness transformationObtain the final solution vector,
2. The image reconstruction method based on greedy random sparse Kaczmarz as claimed in claim 1, wherein in the step 3, calculation is performedCorresponding sparse solution vectorThe method comprises the following steps:
step 3.1, useComputing quantities for determining probability criterion in greedy stochastic Kaczmarz method,Representing the sparse solution vector obtained from the last iteration, at the first iterationFor n-dimensional all-0 vectorsWherein n isThe number of rows ofBThe number of columns;
In whichShow to obtainThe number of the 2-norm,show to obtainThe square of the 2-norm,representing a vectorTo (1) aThe value of the one or more of the one,representing a matrix of coefficientsTo (1) aA row vector formed by the rows of the image,;
step 3.3, calculating residual error vector,To (1) aEach component isAnd according to probabilitySelectingWork line of (1)In whichRepresents the selected coefficient matrixThe line is used as the probability of the iterative work line;
step 3.4, calculating by using a soft threshold shrinkage operator to obtain a sparse solution vector of the iteration;
And 3.5, judging whether the iteration termination condition is met, if so, turning to the next step, otherwise, turning to the step 3.1, adding 1 to the iteration times, and adding the iteration times to the number of timesIs updated to;
3. Greedy random sparse Kaczmarz-based image reconstruction method according to claim 2, characterized in that, in step 3.1,the determination rule of (2) is:
6. the greedy random sparse Kaczmarz-based image reconstruction method according to claim 2, wherein the detailed steps of step 3.4 are as follows:
8. The image reconstruction method based on greedy random sparse Kaczmarz as claimed in claim 6, wherein in said step 3.42, the soft threshold shrinking operator is:
whereinExpress getAnd the maximum value of the sum of 0,representing a symbolic function, i.e. whenWhen the utility model is used, the water is discharged,(ii) a When in useWhen the utility model is used, the water is discharged,(ii) a When the temperature is higher than the set temperatureWhen the temperature of the water is higher than the set temperature,;
the soft threshold shrink operator can therefore also be expressed as:
10. The image reconstruction method based on greedy random sparse Kaczmarz as claimed in claim 2, wherein in the step 3.5, the iteration termination condition is: the change amount of the sparse solution vector corresponding to the two iterations before and after is minimized or reaches the maximum iteration number.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210682958.8A CN114786018A (en) | 2022-06-16 | 2022-06-16 | Image reconstruction method based on greedy random sparse Kaczmarz |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210682958.8A CN114786018A (en) | 2022-06-16 | 2022-06-16 | Image reconstruction method based on greedy random sparse Kaczmarz |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114786018A true CN114786018A (en) | 2022-07-22 |
Family
ID=82420265
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210682958.8A Pending CN114786018A (en) | 2022-06-16 | 2022-06-16 | Image reconstruction method based on greedy random sparse Kaczmarz |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114786018A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115937351A (en) * | 2023-01-09 | 2023-04-07 | 湖北大学 | Greedy random Kaczmarz image reconstruction method based on precise step length |
CN116563412A (en) * | 2023-06-26 | 2023-08-08 | 中国科学院自动化研究所 | MPI image reconstruction method, system and equipment based on sparse system matrix |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105044897A (en) * | 2015-07-07 | 2015-11-11 | 中国科学院上海高等研究院 | Rapid random optical reconstruction imaging system and method based on sparse constraint |
US20180198992A1 (en) * | 2016-08-30 | 2018-07-12 | Shenzhen University | Infrared image reconstruction method based on block-sparse compressive sensing and system thereof |
CN109309840A (en) * | 2018-09-05 | 2019-02-05 | 开封大学 | Compressed sensing image encoding method based on noise shaping, storage medium |
CN109345473A (en) * | 2018-09-12 | 2019-02-15 | 南京医科大学 | A kind of image processing method based on adaptive iteratively faster collapse threshold algorithm |
CN109919877A (en) * | 2019-03-05 | 2019-06-21 | 太原师范学院 | The compressed sensing based practical image recovery system of one kind and method |
-
2022
- 2022-06-16 CN CN202210682958.8A patent/CN114786018A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105044897A (en) * | 2015-07-07 | 2015-11-11 | 中国科学院上海高等研究院 | Rapid random optical reconstruction imaging system and method based on sparse constraint |
US20180198992A1 (en) * | 2016-08-30 | 2018-07-12 | Shenzhen University | Infrared image reconstruction method based on block-sparse compressive sensing and system thereof |
CN109309840A (en) * | 2018-09-05 | 2019-02-05 | 开封大学 | Compressed sensing image encoding method based on noise shaping, storage medium |
CN109345473A (en) * | 2018-09-12 | 2019-02-15 | 南京医科大学 | A kind of image processing method based on adaptive iteratively faster collapse threshold algorithm |
CN109919877A (en) * | 2019-03-05 | 2019-06-21 | 太原师范学院 | The compressed sensing based practical image recovery system of one kind and method |
Non-Patent Citations (3)
Title |
---|
李晓迪: "基于稀疏与低秩约束的高光谱遥感图像恢复方法研究", 《中国优秀硕士学位论文全文数据库工程科技II辑》 * |
王泽: "求解线性方程组稀疏解的稀疏贪婪随机Kaczmarz算法", 《同济大学学报(自然科学版)》 * |
陈仕长: "基于低秩去噪的近似消息传递图像压缩感知重构", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115937351A (en) * | 2023-01-09 | 2023-04-07 | 湖北大学 | Greedy random Kaczmarz image reconstruction method based on precise step length |
CN115937351B (en) * | 2023-01-09 | 2023-09-19 | 湖北大学 | Greedy random Kaczmarz image reconstruction method based on accurate step length |
CN116563412A (en) * | 2023-06-26 | 2023-08-08 | 中国科学院自动化研究所 | MPI image reconstruction method, system and equipment based on sparse system matrix |
CN116563412B (en) * | 2023-06-26 | 2023-10-20 | 中国科学院自动化研究所 | MPI image reconstruction method, system and equipment based on sparse system matrix |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN114786018A (en) | Image reconstruction method based on greedy random sparse Kaczmarz | |
Cen et al. | Boosting occluded image classification via subspace decomposition-based estimation of deep features | |
CN104199627B (en) | Gradable video encoding system based on multiple dimensioned online dictionary learning | |
Hong et al. | An efficient algorithm for designing projection matrix in compressive sensing based on alternating optimization | |
Cui et al. | Deep neural network based sparse measurement matrix for image compressed sensing | |
CN107705342A (en) | A kind of infrared image reconstructing method based on self-adapting generalized orthogonal matching pursuit | |
Li et al. | Tensor completion from one-bit observations | |
CN109584330A (en) | One kind approaching L based on compressed sensing0The gradient projection image rebuilding method of norm | |
CN110288529B (en) | Single image super-resolution reconstruction method based on recursive local synthesis network | |
Lee et al. | On explicit curvature regularization in deep generative models | |
Chai et al. | CSENMT: A deep image compressed sensing encryption network via multi-color space and texture feature | |
Wang et al. | Image reconstruction from patch compressive sensing measurements | |
Zhang et al. | Robust subspace clustering via joint weighted Schatten-p norm and Lq norm minimization | |
CN110728728A (en) | Compressed sensing network image reconstruction method based on non-local regularization | |
CN115880158A (en) | Blind image super-resolution reconstruction method and system based on variational self-coding | |
CN106899305B (en) | Original signal reconstruction method based on second-generation wavelet | |
CN110266318B (en) | Measurement matrix optimization method based on gradient projection algorithm in compressed sensing signal reconstruction | |
Kasem et al. | DRCS-SR: Deep robust compressed sensing for single image super-resolution | |
CN111475768A (en) | Observation matrix construction method based on low coherence unit norm tight frame | |
Zhao et al. | A high quality image reconstruction method based on nonconvex decoding | |
Zhang et al. | Three-Stages Hyperspectral Image Compression Sensing with Band Selection. | |
Jiang et al. | MSFE: Blind image quality assessment based on multi-stage feature encoding | |
Fang et al. | Image denoising algorithm of compressed sensing based on alternating direction method of multipliers | |
CN115937351B (en) | Greedy random Kaczmarz image reconstruction method based on accurate step length | |
Cao et al. | A Low Complexity CP Bayes Algorithm for Image Restoration |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220722 |
|
RJ01 | Rejection of invention patent application after publication |