CN106408530A - Sparse and low-rank matrix approximation-based hyperspectral image restoration method - Google Patents
Sparse and low-rank matrix approximation-based hyperspectral image restoration method Download PDFInfo
- Publication number
- CN106408530A CN106408530A CN201610805487.XA CN201610805487A CN106408530A CN 106408530 A CN106408530 A CN 106408530A CN 201610805487 A CN201610805487 A CN 201610805487A CN 106408530 A CN106408530 A CN 106408530A
- Authority
- CN
- China
- Prior art keywords
- matrix
- low
- hyperspectral image
- data
- sparse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 81
- 239000011159 matrix material Substances 0.000 title claims abstract description 69
- 238000011084 recovery Methods 0.000 claims description 14
- OAICVXFJPJFONN-UHFFFAOYSA-N Phosphorus Chemical compound [P] OAICVXFJPJFONN-UHFFFAOYSA-N 0.000 claims description 2
- 238000000605 extraction Methods 0.000 claims description 2
- 238000010030 laminating Methods 0.000 claims description 2
- 239000000203 mixture Substances 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 17
- 230000006870 function Effects 0.000 description 9
- 238000002474 experimental method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 2
- 238000000701 chemical imaging Methods 0.000 description 2
- 238000002156 mixing Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
- G06T2207/10036—Multispectral image; Hyperspectral image
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention relates to a sparse and low-rank matrix approximation-based hyperspectral image restoration method and belongs to the image processing field. The method includes the following steps that: a hyperspectral data sequence affected by mixed noises is acquired, or simulated mixed noises are artificially added into a clear hyperspectral image sequence, so that hyperspectral data to be processed can be obtained; the multi-band hyperspectral image data are segmented into a plurality of small data blocks, and each three-dimensional data block is pieced into one two-dimensional data matrix; a weighted Schatten p-normal type low-rank matrix approximation model is constructed for each two-dimensional data matrix; an extended Lagrange multiplier method is adopted to solve the model to obtain mixed noise-removed two-dimensional data matrixes; each two-dimensional data matrix is restored into three-dimensional hyperspectral data, so that a mixed noise-removed multi-band hyperspectral image can be obtained; and the above steps are repeated by using an iteration method to obtain a better restoration effect. The method can be effectively applied to fields such as remote sensing, geography, agriculture and military fields.
Description
Technical Field
The invention relates to image processing, in particular to a hyperspectral image recovery method based on sparse and low-rank matrix approximation.
Background
The hyperspectral imaging technology is an earth observation technology developed from the 20 th century, and has high practical value in the aspects of military affairs, geological survey, agricultural detection and the like. The hyperspectral image data is three-dimensional image data, and besides a two-dimensional image, the hyperspectral image data also has a waveband dimension, and is mainly characterized in that the traditional image space and spectral information are fused into a whole. The hyperspectral image data contains abundant surface feature spectrum information, and the target recognition of the surface features and the like can be realized.
Although with the development of computer technology and spectral imaging technology, the imaging quality of hyperspectral image data is greatly improved. But inevitably, hyperspectral images are affected by mixing noise due to imager physical imperfections, atmospheric pollution, transmission losses and calibration problems. These mixed noises include gaussian noise, impulse noise, stripe noise, and dead lines. Therefore, the denoising problem of the hyperspectral image needs to be solved urgently, and the method is an important preprocessing work of the hyperspectral image data in the subsequent information analysis.
At present, many image denoising techniques are applied to the denoising of hyperspectral images. Inspired by a grayscale Image denoising method, a non-local mean method, an SVD method, a BM3D method proposed by Dabov et al in "Image differentiating by 3-D transform-domain communicating filtering. IEEE Trans. on Image processing", and an SSATV method proposed by Yuan et al in "hyper spectral Image differentiating applying dynamic total variation model. IEEE geographic information. However, these methods are not satisfactory because they ignore the correlation between different bands of the hyperspectral image. In order to utilize the correlation between images in different wave bands, some researchers propose to divide large three-dimensional data into small three-dimensional data, convert the small three-dimensional data into two-dimensional data, and then perform low-rank matrix recovery by using the low-rank property of a noise-free matrix, so as to achieve the denoising effect. For example, Zhang et al, in "Hyperspectral Image retrieval Using Low-Rank Matrix recovery. IEEE Trans. on Geosunce and Remote Sensing" proposed LRMR method.
Disclosure of Invention
The invention aims to provide a hyperspectral image recovery method based on sparse and low-rank matrix approximation, which removes most of noise and also reserves abundant image details.
The invention comprises the following steps:
(1) setting a group of multiband hyperspectral image data d, wherein the size of d is MxNxB, M and N respectively represent the length and width of the hyperspectral image of each waveband, B represents the number of the shared wavebands, and the estimated noise level of d is eta;
(2) initializing variables, denoised dataNoisy dataGaussian noise level η(0)=η;
(3) Initializing iteration, enabling a loop variable K to be 1, and setting the maximum outer loop times K;
(4) iterative regularization
(5) Taking the central coordinate position as (i, j), wherein i and j respectively represent the horizontal and vertical coordinates of the central point, and extracting data with the size of w × h × BWherein w and h represent the width and height of the data block and B is the number of hyperspectral data bands;
(6) combining three-dimensional dataConverting the two-dimensional matrix into a two-dimensional matrix D with the size of wh × B;
(7) constructing a weighted Schatten-p normal form low-rank matrix approximation model for the D;
(8) solving the weighted Schatten-p normal form low-rank matrix approximate model constructed in the step (7) by using an extended Lagrange multiplier method to obtain a matrix A after denoising;
(9) update noise level η(k);
(10) Taking all the center coordinates (i, j) according to a certain step length, repeating the steps (5) to (9) to respectively obtain corresponding A(i,j);
(11) All A with the size of wh × B(i,j)Convert back to three dimensional data of size w × h × B
(12) All will beSplicing complete three-dimensional data with size M × N × B
(13) Taking K > K as a cycle termination condition, if K does not meet the condition of being more than K, returning to the step (4) after increasing the value of K by 1, otherwise, directly executing the step (14);
(14) will be provided withAnd finally removing all noise to obtain the hyperspectral image data.
In step (5), the extraction size is a number of w × h × BAccording toThe method comprises the steps of taking out image blocks with the size of w × h and the center of (i, j) of M × N hyperspectral images of B wave bands respectively, and then laminating the image blocks to obtain a three-dimensional data block with the size of w × h × B.
In step (6), the three-dimensional data is processedThe two-dimensional matrix D converted into wh × B is a rectangle D in which B image blocks of w × h are arranged in sequence into a pixel column of wh × 1, and then, a wh × B is formed.
In step (7), the weighted Schatten-p-norm low rank matrix approximation model is as follows:
s.t D=A+E+N,||N||F≤η
where C and λ are coefficients, A represents clean image data unaffected by noise, E represents a mixture of impulse noise, dead lines, and stripe noise, N represents Gaussian noise with a noise level η set artificially | | · | | Y |1Represents the 1 norm of the matrix, | · | | non-woven phosphorFA Frobenius norm representing a matrix;represents a weighted Schatten-p paradigm, the specific form is as follows:
wherein p is more than 0 and less than or equal to 1, r is min { wh, B }, and sigma isiIs the i-th singular value of a,wherein sigmai(D) Representing the ith singular value of D.
In the step (8), the specific steps of solving the weighted Schatten-p normal form low-rank matrix approximation model constructed in the step (7) by using the extended lagrange multiplier method to obtain the denoised matrix a are as follows:
(8.1) initializing variables:k=D,Ak=Ek=0,βkgreater than 0, rho > 1, k is 0, lagrange multiplier, βkThe penalty coefficient of the constraint term in the kth iteration is, rho is a penalty coefficient iteration factor, and k is the current iteration number;
(8.2) updateWherein
(8.3) update
(8.4) update
(8.5) updatek+1=k-βk(Ak+1+Ek+1+Nk+1-D);
(8.6) order βk+1=ρ*βk;
(8.7) letting k be k + 1;
(8.8) if | purplek-k-1||1< convergence, wherein convergence is convergence parameter, executing step (8.9), otherwise executing step (8.2);
(8.9) adding Ak+1As denoised matrix a.
In step (8.3), the updatingThe method comprises the following steps:
let matrix Ek+1Each element of (a):
(Ek+1)ij=sign(Xij)·max(|Xij|-λ,0)
wherein,(·)ijand (3) representing the element of the ith row and the jth column of the matrix, wherein sign () is a sign function.
In step (8.4), the updateThe method comprises the following specific steps:
(8.4.1) orderCarrying out SVD on Y to obtain Y ═ U ∑ VΤWherein Σ ═ diag (σ)1,...,σr) I.e. sigmaiSingular values for Y;
(8.4.2) initializing iteration, setting a loop variable i to be 1, and setting the maximum outer loop times r;
(8.4.3) use of σi,ωiP, obtaining A by generalized soft threshold methodk+1Is estimated from the ith singular value of the matrixi;
(8.4.4) if i is greater than or equal to r, directly executing the step (8.4.5), otherwise, making i equal to i +1, and executing the step (8.4.3);
(8.4.5) let the variable Δ ═ diag (d:)1,...r) Wherein diag (·) is a matrix diagonal permutation function;
(8.4.6) order Ak+1=UΔVΤ;
In step (8.4.3), the utilization σi,ωiP, obtaining A by generalized soft threshold methodk+1Is estimated from the ith singular value of the matrixiThe method comprises the following specific steps:
(8.4.3.1) let the variable σ be σ ═ σiThe variable ω ═ ωiLet us orderThis is a function of ω and p;
(8.4.3.2) if | < sigma | < taup(ω), let function Sp(σ; ω) is 0, performing step (8.4.3.8); otherwise, executing step (8.4.3.3);
(8.4.3.3) initializing a thresholding variable to(0)=|σ|;
(8.4.3.4) initializing iteration, making a loop variable t equal to 0, and setting the maximum outer loop times J;
(8.4.3.5) let(t+1)=|σ|-ωp((t))p-1;
(8.4.3.6) if t ≧ J, directly executing step (8.4.3.7), otherwise, let t ═ t +1, execute step (8.4.3.5);
(8.4.3.7) setting function Sp(σ;ω)=sgn(σ)(t)Wherein sgn is a sign function;
(8.4.3.8) leti=Sp(σ;ω)。
In step (9), the update noise level η(k)The method comprises the following steps:
where γ is a scaling factor.
In step (12), all ofSplicing complete three-dimensional data with size M × N × BComprises the specific steps ofIs put backWith (i, j) as the center and w × h × B as the size position, respectivelyThe overlapping portions are averaged.
The invention adopts a novel method to remove mixed noise generated in the acquisition and transmission process of the hyperspectral image, wherein the noise is mixed Gaussian noise, impact noise, stripe noise and dead lines, and aiming at the property of the hyperspectral image, the invention realizes a hyperspectral image recovery method by sparse and low-rank matrix approximation, thereby not only removing most of noise, but also reserving abundant image details.
The invention provides an iterative hyperspectral image recovery method based on low-rank matrix decomposition, which is characterized in that a low-rank matrix approximate model is constructed by using the low-rank property of a processed data matrix and a weighted schatten p-paradigm, and a solving method of the low-rank matrix approximate model is provided. The low-rank regular term of the unique weighted schatten-p paradigm has obvious improvement on the effect of a low-rank matrix approximation model, and then the estimation of the noise level is automatically estimated and updated in the solving process, so that different noises can be processed in a self-adaptive mode. Through the novel technical means, the mixed noise can be well removed, the image information with useful value is greatly reserved, and the effect of the method is superior to that of the currently popular hyperspectral image restoration method.
The invention has the following technical effects:
1. according to the method, the low rank property of the processed hyperspectral image is utilized to construct an extended robust principal component analysis model, and the low rank property and the sparsity of the model are well reserved. For the low-rank regularization term of the model, a novel weighted Schatten-p paradigm is used, the paradigm is controlled by giving different weight to rank components, so that the noise is adapted to different degrees, and the low-rank regularization term is better realized, so that the denoising effect is better achieved theoretically and practically.
2. Aiming at the difficult-to-solve non-convex optimization denoising model, the method adopts an expanded Lagrange multiplier method and a generalized soft threshold method to solve the difficult-to-solve non-convex optimization denoising model. Moreover, the invention also uses an iterative regularization frame, and the whole model can adaptively cope with the recovery problem of different hyperspectral data by estimating and adjusting the noise level.
Drawings
FIG. 1 is an image obtained after atmospheric disturbance removal of a real video frame of a chimney using three methods of the present invention and the prior art;
fig. 2 is an image obtained by taking out atmospheric disturbance from a simulated disturbance video of a city by using the method of the present invention and the existing method in the third place.
Detailed Description
The method comprises the following specific implementation steps:
step 1, acquiring hyperspectral image data affected by mixed noise.
A group of multiband hyperspectral image data d is obtained by using a hyperspectral imager and is normalized to [0,1 ]. The size of the hyperspectral image is M multiplied by N multiplied by B, wherein M and N respectively represent the length and width of the hyperspectral image of each wave band, and B represents how many wave bands are in total. The estimated noise level for this set of data is η 20/255.
And step 2, initializing iteration variables.
(2a) Order de-noised dataNoisy dataGaussian noise level η(0)=η。
(2b) And initializing iteration, wherein the loop variable k is 1, the central horizontal and vertical coordinates are i and 10, and j is 10.
Step 3, iterative regularization
And 4, acquiring two-dimensional data of the low-rank model to be established.
(4a) For M × N hyperspectral images of B wave bands, image blocks with the size of 20 × 20 and the size of (i, j) as the center are respectively taken out and then are laminated together to obtain a three-dimensional data block with the size of 20 × 20 × B
(4b) B20 × 20 image blocks are respectively connected in series in sequence to form a 400 × 1 pixel column, and then a 400 × B rectangle D is formed by splicing.
And 5, constructing a weighted Schatten-p normal form low-rank matrix approximation model as follows:
s.t D=A+E+N,||N||F≤η
wherein C is 0.007, λ is 1.2, and p is 0.7.p=0.7,r=min{400,B},σiIs the i-th singular value of a,wherein sigmai(D) Representing the ith singular value of D.
And 6, solving the model by using an expanded Lagrange multiplier method.
(6a) Initializing variables:h=D,Ah=Eh=0,βh> 0, ρ > 1, h ═ 0, lagrange multiplier, βhAnd the penalty coefficient of the constraint term in the h iteration, rho is a penalty coefficient iteration factor, and h is the current iteration number.
(6b) UpdatingWherein
(6c) Update Eh+1Let's matrix Eh+1Each element (E) ofh+1)ij=sign(Xij)·max(|XijL- λ,0), wherein
(6d) Update Ah+1The following were used:
(6d.1) orderCarrying out SVD on Y to obtain Y ═ U ∑ VΤ,Σ=diag(σ1,...,σr)。
(6d.2) initialize the iteration, let loop variable q be 1, set the maximum skin loop number r, as described in step 5.
(6d.3) Using ω defined in step 5qAnd p, σ in step (6d.1)qA is obtained by the following generalized soft threshold methodh+1Of the estimation matrix of (2) q-th singular valueq:
(6d.3a) let variable σ ═ σqThe variable ω ═ ωqOrder function
(6d.3b) if [ sigma ] is less than or equal to taup(ω), let variable Sp(σ; ω) is 0, performing step (8.8); otherwise, step (8.3) is executed.
(6d.3c) order initialization threshold method variable(0)=|σ|。
(6d.3d) initialize the iteration, let the loop variable t be 0, set the maximum skin loop number J50.
(6d.3e) order(t+1)=|σ|-ωp((t))p-1。
(6d.3f) if t is not less than J, directly executing the step (6d.3g), otherwise, making t equal to t +1, and executing the step (6 d.3e).
(6d.3g) setting function Sp(σ;ω)=sgn(σ)(t)。
(6d.3h) orderq=Sp(σ;ω)。
(6d.4) if q ≧ r, directly executing step (6d.5), otherwise, if q ≧ q +1, executing step (6 d.3).
(6d.5) let the matrix variable Δ ═ diag (d: (d.5)1,...r) Where diag (·) is a matrix diagonal permutation function.
(6d.6) order Ah+1=UΔVΤ。
(6e) Updatingh+1=h-βh(Ah+1+Eh+1+Nh+1-D)。
(6f) Let βh+1=ρ*βh。
(6g) Let h be h + 1.
(6h) Hollow if |)h-h-1||1< convergent, wherein the convergent parameter convergent is 10-7Then step (5.9) is performed, otherwise step (5.2) is performed.
(6i) A is to beh+1As denoised matrix A(i,j)。
Step 7, updating the noise level
Step 8, taking all the central coordinates (i, j) according to the step length of 4 for the horizontal and vertical coordinates, repeating the steps (4) to (7) to respectively obtain the corresponding A(i,j)。
And 9, obtaining the denoising hyperspectral data of the iteration of the current round.
(9a) All A with the size of 400 × B(i,j)Conversion back to three-dimensional data of size 20 × 20 × B
(9b) All will beIs put backIn (c) at positions where w × h × B is the size and the center is (i, j) corresponding to eachThe overlapping parts are averaged to obtain a value of M × N × B
And step 10, taking k > 6 as a cycle termination condition, if not, returning to the step 3 after increasing the value of k by 1, otherwise, executing the step 11.
Step 11, mixingAnd finally removing all noise to obtain the hyperspectral image data.
The invention is proved by the following experiments.
1. The experimental conditions are as follows:
laboratory desktop parameters: the CPU is Inter (R) core (TM) i7-2600, the main frequency is 3.40GHz, the memory is 4G, the operating system is a Win 764 bit system, and the experimental platform is Matlab2014 b.
2. Experimental results and analysis of results:
experiment one, the invention and the existing method are used for restoring the real hyperspectral image data.
Downloading a group of real hyperspectral image data Urban influenced by mixed noise from a network, wherein the size of the hyperspectral image data Urban is 307 multiplied by 188, subtracting a minimum pixel from each pixel, and dividing the difference between a maximum pixel value and a minimum pixel value to obtain data normalized to [0,1 ]. Then, the method provided by the invention is used for denoising, and the BM3D, SSATV and LRMR methods mentioned in the background art are used for comparison experiments. The experimental results are shown in fig. 2, wherein fig. 2(a) is one of the original hyperspectral image data, fig. 2(b) is the BM3D method effect, fig. 2(c) is the SSATV method effect, fig. 2(d) is the LRMR method effect, and fig. 2(e) is the invention effect.
The experimental results of fig. 2 illustrate that: from the visual perspective, fig. 2(b) and fig. 2(c) remove most of the noise, but also lose much detail information, and fig. 2(b) also has obvious denoising traces. The result of fig. 2(d) is also much unremoved noise. The denoising effect of the method in fig. 2(e) is obvious, noise is well removed, and rich detail information is reserved to a great extent.
And experiment II, the invention and the existing method are used for recovering the simulated hyperspectral image data.
A set of hyperspectral images unaffected by noise is downloaded from the network, with a size of 256 × 256 × 191. Gaussian noise, impulse noise, banding noise and dead lines are artificially added randomly to all frames. And then, carrying out denoising treatment by using the method provided by the invention, and carrying out a comparison experiment by using three methods, namely BM3D, SSATV and LRMR. The experimental results are shown in fig. 3, where fig. 3(a) is a clear hyperspectral image data, fig. 3(b) is a hyperspectral image after adding a simulation noise, fig. 3(c) is the BM3D method effect, fig. 3(d) is the SSATV method effect, fig. 3(e) is the LRMR method effect, and fig. 3(f) is the effect of the present invention. Table 1 shows the comparison of the mean peak signal-to-noise ratio (MPSNR) and the Mean Structural Similarity (MSSIM) of the present invention with the three methods described above.
The experimental results of fig. 3 and table 1 illustrate that: fig. 3(b) is affected by mixed noise, the visual effect is very poor, and the information interference is much; FIG. 3(c) loses a lot of detail information, with little effect on dead-line noise; all noise removal in FIG. 3(d) is unsatisfactory, fuzzy and dead; the results of fig. 3(e) are all better than the previous figures, but there is still a black imprint remaining in the part of the figure circled by the green dashed line, which is the result of the incomplete processing of dead line noise. In fig. 3(f), the method of the present invention not only removes various noises including dead lines well, but also retains rich detailed information to a great extent, and is closest to and has the best effect compared with the original data image.
TABLE 1
BM3D | SSATV | LRMR | The invention | |
MPSNR | 24.958 | 17.344 | 27.474 | 30.303 |
MSSIM | 0.6177 | 0.2752 | 0.8114 | 0.8711 |
As shown in table 1, the MPSNR and MSSIM values of the present invention are higher than those of the existing three methods.
Claims (10)
1. The hyperspectral image recovery method based on sparse and low-rank matrix approximation is characterized by comprising the following steps of:
(1) setting a group of multiband hyperspectral image data d, wherein the size of d is MxNxB, M and N respectively represent the length and width of the hyperspectral image of each waveband, B represents the number of the shared wavebands, and the estimated noise level of d is eta;
(2) initializing variables, denoised dataNoisy dataGaussian noise level η(0)=η;
(3) Initializing iteration, enabling a loop variable K to be 1, and setting the maximum outer loop times K;
(4) iterative regularization
(5) Taking the central coordinate position as (i, j), wherein i and j respectively represent the horizontal and vertical coordinates of the central point, and extracting data with the size of w × h × BWherein w and h represent the width and height of the data block and B is the number of hyperspectral data bands;
(6) combining three-dimensional dataConverting the two-dimensional matrix into a two-dimensional matrix D with the size of wh × B;
(7) constructing a weighted Schatten-p normal form low-rank matrix approximation model for the D;
(8) solving the weighted Schatten-p normal form low-rank matrix approximate model constructed in the step (7) by using an extended Lagrange multiplier method to obtain a matrix A after denoising;
(9) update noise level η(k);
(10) Taking all the center coordinates (i, j) according to a certain step length, repeating the steps (5) to (9) to respectively obtain corresponding A(i,j);
(11) All A with the size of wh × B(i,j)Convert back to three dimensional data of size w × h × B
(12) All will beSplicing complete three-dimensional data with size M × N × B
(13) Taking K > K as a cycle termination condition, if K does not meet the condition of being more than K, returning to the step (4) after increasing the value of K by 1, otherwise, directly executing the step (14);
(14) will be provided withAnd finally removing all noise to obtain the hyperspectral image data.
2. The sparse-and-low-rank matrix approximation-based hyperspectral image restoration method according to claim 1, wherein in step (5), the extraction of data with the size of w × h × BThe method comprises the steps of taking out image blocks with the size of w × h and the center of (i, j) of M × N hyperspectral images of B wave bands respectively, and then laminating the image blocks to obtain a three-dimensional data block with the size of w × h × B.
3. The sparse-and-low-rank matrix approximation-based hyperspectral image recovery method of claim 1, wherein in step (6), the three-dimensional data is processedThe two-dimensional matrix D converted into wh × B is a rectangle D in which B image blocks of w × h are arranged in sequence into a pixel column of wh × 1, and then, a wh × B is formed.
4. The sparse-and-low-rank matrix approximation-based hyperspectral image restoration method according to claim 1, wherein in step (7), the weighted Schatten-p-norm low-rank matrix approximation model is as follows:
where C and λ are coefficients, A represents clean image data unaffected by noise, E represents a mixture of impulse noise, dead lines, and stripe noise, N represents Gaussian noise with a noise level η set artificially | | · | | Y |1Represents the 1 norm of the matrix, | · | | non-woven phosphorFA Frobenius norm representing a matrix;represents a weighted Schatten-p paradigm, the specific form is as follows:
wherein p is more than 0 and less than or equal to 1, r is min { wh, B }, and sigma isiIs the i-th singular value of a,wherein sigmai(D) Representing the ith singular value of D.
5. The sparse-and-low-rank matrix approximation-based hyperspectral image restoration method according to claim 1 is characterized in that in step (8), the specific steps of solving the weighted Schatten-p-norm low-rank matrix approximation model constructed in step (7) by using the extended Lagrange multiplier method to obtain the denoised matrix A are as follows:
(8.1) initializing variables:k=D,Ak=Ek=0,βkgreater than 0, rho > 1, k is 0, lagrange multiplier, βkThe penalty coefficient of the constraint term in the kth iteration is, rho is a penalty coefficient iteration factor, and k is the current iteration number;
(8.2) updateWherein
(8.3) update
(8.4) update
(8.5) updatek+1=k-βk(Ak+1+Ek+1+Nk+1-D);
(8.6) order βk+1=ρ*βk;
(8.7) letting k be k + 1;
(8.8) if | purplek-k-1||1< convergence, wherein convergence is convergence parameter, executing step (8.9), otherwise executing step (8.2);
(8.9) adding Ak+1As denoised matrix a.
6. The sparse-and-low-rank matrix approximation-based hyperspectral image recovery method according to claim 5, wherein in step (8.3), the updatingThe method comprises the following steps:
let matrix Ek+1Each element of (a):
(Ek+1)ij=sign(Xij)·max(|Xij|-λ,0)
wherein,(·)ijand (3) representing the element of the ith row and the jth column of the matrix, wherein sign () is a sign function.
7. As claimed in claimThe hyperspectral image recovery method based on sparse and low-rank matrix approximation is characterized in that in step (8.4), the hyperspectral image is updatedThe method comprises the following specific steps:
(8.4.1) orderCarrying out SVD on Y to obtain Y ═ U ∑ VΤWherein Σ ═ diag (σ)1,...,σr) I.e. sigmaiSingular values for Y;
(8.4.2) initializing iteration, setting a loop variable i to be 1, and setting the maximum outer loop times r;
(8.4.3) use of σi,ωiP, obtaining A by generalized soft threshold methodk+1Is estimated from the ith singular value of the matrixi;
(8.4.4) if i is greater than or equal to r, directly executing the step (8.4.5), otherwise, making i equal to i +1, and executing the step (8.4.3);
(8.4.5) let the variable Δ ═ diag (d:)1,...r) Wherein diag (·) is a matrix diagonal permutation function;
(8.4.6) order Ak+1=UΔVΤ。
8. The sparse-and-low-rank matrix approximation-based hyperspectral image recovery method of claim 7, wherein in step (8.4.3), the utilizing σ isi,ωiP, obtaining A by generalized soft threshold methodk+1Is estimated from the ith singular value of the matrixiThe method comprises the following specific steps:
(8.4.3.1) let the variable σ be σ ═ σiThe variable ω ═ ωiLet us orderThis is a function of ω and p;
(8.4.3.2) if | < sigma | < taup(ω), let function Sp(σ; ω) is 0, performing step (8.4.3.8);otherwise, executing step (8.4.3.3);
(8.4.3.3) initializing a thresholding variable to(0)=|σ|;
(8.4.3.4) initializing iteration, making a loop variable t equal to 0, and setting the maximum outer loop times J;
(8.4.3.5) let(t+1)=|σ|-ωp((t))p-1;
(8.4.3.6) if t ≧ J, directly executing step (8.4.3.7), otherwise, let t ═ t +1, execute step (8.4.3.5);
(8.4.3.7) setting function Sp(σ;ω)=sgn(σ)(t)Wherein sgn is a sign function;
(8.4.3.8) leti=Sp(σ;ω)。
9. The sparse-and-low-rank matrix approximation-based hyperspectral image restoration method according to claim 1, wherein in step (9), the update noise level η(k)The method comprises the following steps:
where γ is a scaling factor.
10. The sparse-and-low-rank matrix approximation-based hyperspectral image recovery method of claim 1, wherein in step (12), the method applies all the sparse-and-low-rank matrix approximationsSplicing complete three-dimensional data with size M × N × BComprises the specific steps ofIs put backWith (i, j) as the center and w × h × B as the size position, respectivelyThe overlapping portions are averaged.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610805487.XA CN106408530A (en) | 2016-09-07 | 2016-09-07 | Sparse and low-rank matrix approximation-based hyperspectral image restoration method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610805487.XA CN106408530A (en) | 2016-09-07 | 2016-09-07 | Sparse and low-rank matrix approximation-based hyperspectral image restoration method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106408530A true CN106408530A (en) | 2017-02-15 |
Family
ID=57998666
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610805487.XA Pending CN106408530A (en) | 2016-09-07 | 2016-09-07 | Sparse and low-rank matrix approximation-based hyperspectral image restoration method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106408530A (en) |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107451951A (en) * | 2017-07-13 | 2017-12-08 | 南京师范大学 | A kind of high-spectrum image dimensionality reduction method of combination low-rank representation and image co-registration |
CN108169204A (en) * | 2017-12-14 | 2018-06-15 | 天津大学 | A kind of Raman spectra pretreatment method based on database |
CN108805816A (en) * | 2017-05-02 | 2018-11-13 | 上海荆虹电子科技有限公司 | A kind of high spectrum image denoising method and device |
CN108828482A (en) * | 2018-08-03 | 2018-11-16 | 厦门大学 | In conjunction with the method for reconstructing of sparse and low-rank characteristic lack sampling magnetic resonance diffusion spectrum |
CN108876884A (en) * | 2018-06-21 | 2018-11-23 | 汕头大学 | A kind of high spectrum image method for reconstructing based on non local tensor low-rank regularization |
CN109102477A (en) * | 2018-08-31 | 2018-12-28 | 哈尔滨工业大学 | A kind of high-spectrum remote sensing restoration methods based on the constraint of non-convex low-rank sparse |
CN109919857A (en) * | 2019-01-21 | 2019-06-21 | 北京航空航天大学 | A kind of noise image complementing method based on weighting Si Laiteen norm minimum |
CN110070004A (en) * | 2019-04-02 | 2019-07-30 | 杭州电子科技大学 | A kind of field hyperspectrum Data expansion method applied to deep learning |
CN110335201A (en) * | 2019-03-27 | 2019-10-15 | 浙江工业大学 | The high spectrum image denoising method restored in conjunction with Moreau enhancing TV and local low-rank matrix |
CN110638433A (en) * | 2019-09-08 | 2020-01-03 | 智能制造研究院(肇庆高要)有限公司 | Three-dimensional pulse wave image denoising method and system based on channel weighted robustness principal component analysis |
CN111028172A (en) * | 2019-12-10 | 2020-04-17 | 浙江工业大学 | Hyperspectral image denoising method based on non-convex low-rank matrix approximation without parameters |
CN111310813A (en) * | 2020-02-07 | 2020-06-19 | 广东工业大学 | Subspace clustering method and device for potential low-rank representation |
CN114255182A (en) * | 2021-12-13 | 2022-03-29 | 郑州轻工业大学 | CS iteration threshold image denoising and reconstructing method based on space self-adaptive total variation |
CN115564688A (en) * | 2022-11-18 | 2023-01-03 | 长沙超创电子科技有限公司 | Method for extracting turbulence by combining matrix low-rank decomposition and dynamic target |
CN117893766A (en) * | 2024-03-11 | 2024-04-16 | 鹏城实验室 | Object detection segmentation scheme |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103473740A (en) * | 2013-08-31 | 2013-12-25 | 西安电子科技大学 | Sparse representation and low-rank double restraints-based nonlocal denoising method |
CN104463223A (en) * | 2014-12-22 | 2015-03-25 | 西安电子科技大学 | Hyperspectral image group sparse demixing method based on empty spectral information abundance restraint |
CN105303530A (en) * | 2015-09-30 | 2016-02-03 | 天津大学 | Fabric image mole stripe elimination method based on low-rank sparse matrix decomposition |
CN105574548A (en) * | 2015-12-23 | 2016-05-11 | 北京化工大学 | Hyperspectral data dimensionality-reduction method based on sparse and low-rank representation graph |
CN105825227A (en) * | 2016-03-11 | 2016-08-03 | 南京航空航天大学 | Hyperspectral image sparseness demixing method based on MFOCUSS and low-rank expression |
-
2016
- 2016-09-07 CN CN201610805487.XA patent/CN106408530A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103473740A (en) * | 2013-08-31 | 2013-12-25 | 西安电子科技大学 | Sparse representation and low-rank double restraints-based nonlocal denoising method |
CN104463223A (en) * | 2014-12-22 | 2015-03-25 | 西安电子科技大学 | Hyperspectral image group sparse demixing method based on empty spectral information abundance restraint |
CN105303530A (en) * | 2015-09-30 | 2016-02-03 | 天津大学 | Fabric image mole stripe elimination method based on low-rank sparse matrix decomposition |
CN105574548A (en) * | 2015-12-23 | 2016-05-11 | 北京化工大学 | Hyperspectral data dimensionality-reduction method based on sparse and low-rank representation graph |
CN105825227A (en) * | 2016-03-11 | 2016-08-03 | 南京航空航天大学 | Hyperspectral image sparseness demixing method based on MFOCUSS and low-rank expression |
Non-Patent Citations (1)
Title |
---|
YUAN XIE 等: "Hyperspectral Image Restoration via Iteratively Regularized Weighted Schatten p-Norm Minimization", 《IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING》 * |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108805816B (en) * | 2017-05-02 | 2020-09-22 | 深圳荆虹科技有限公司 | Hyperspectral image denoising method and device |
CN108805816A (en) * | 2017-05-02 | 2018-11-13 | 上海荆虹电子科技有限公司 | A kind of high spectrum image denoising method and device |
CN107451951A (en) * | 2017-07-13 | 2017-12-08 | 南京师范大学 | A kind of high-spectrum image dimensionality reduction method of combination low-rank representation and image co-registration |
CN108169204A (en) * | 2017-12-14 | 2018-06-15 | 天津大学 | A kind of Raman spectra pretreatment method based on database |
CN108876884A (en) * | 2018-06-21 | 2018-11-23 | 汕头大学 | A kind of high spectrum image method for reconstructing based on non local tensor low-rank regularization |
CN108876884B (en) * | 2018-06-21 | 2022-06-14 | 汕头大学 | Hyperspectral image reconstruction method based on non-local tensor low-rank regularization |
CN108828482A (en) * | 2018-08-03 | 2018-11-16 | 厦门大学 | In conjunction with the method for reconstructing of sparse and low-rank characteristic lack sampling magnetic resonance diffusion spectrum |
CN109102477B (en) * | 2018-08-31 | 2021-08-24 | 哈尔滨工业大学 | Hyperspectral remote sensing image recovery method based on non-convex low-rank sparse constraint |
CN109102477A (en) * | 2018-08-31 | 2018-12-28 | 哈尔滨工业大学 | A kind of high-spectrum remote sensing restoration methods based on the constraint of non-convex low-rank sparse |
CN109919857B (en) * | 2019-01-21 | 2020-11-13 | 北京航空航天大学 | Noise image completion method based on weighted Schleiden norm minimization |
CN109919857A (en) * | 2019-01-21 | 2019-06-21 | 北京航空航天大学 | A kind of noise image complementing method based on weighting Si Laiteen norm minimum |
CN110335201A (en) * | 2019-03-27 | 2019-10-15 | 浙江工业大学 | The high spectrum image denoising method restored in conjunction with Moreau enhancing TV and local low-rank matrix |
CN110070004A (en) * | 2019-04-02 | 2019-07-30 | 杭州电子科技大学 | A kind of field hyperspectrum Data expansion method applied to deep learning |
CN110070004B (en) * | 2019-04-02 | 2021-07-20 | 杭州电子科技大学 | Near-earth hyperspectral data expansion method applied to deep learning |
CN110638433A (en) * | 2019-09-08 | 2020-01-03 | 智能制造研究院(肇庆高要)有限公司 | Three-dimensional pulse wave image denoising method and system based on channel weighted robustness principal component analysis |
CN111028172A (en) * | 2019-12-10 | 2020-04-17 | 浙江工业大学 | Hyperspectral image denoising method based on non-convex low-rank matrix approximation without parameters |
CN111310813A (en) * | 2020-02-07 | 2020-06-19 | 广东工业大学 | Subspace clustering method and device for potential low-rank representation |
CN114255182A (en) * | 2021-12-13 | 2022-03-29 | 郑州轻工业大学 | CS iteration threshold image denoising and reconstructing method based on space self-adaptive total variation |
CN115564688A (en) * | 2022-11-18 | 2023-01-03 | 长沙超创电子科技有限公司 | Method for extracting turbulence by combining matrix low-rank decomposition and dynamic target |
CN117893766A (en) * | 2024-03-11 | 2024-04-16 | 鹏城实验室 | Object detection segmentation scheme |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106408530A (en) | Sparse and low-rank matrix approximation-based hyperspectral image restoration method | |
Chen et al. | Denoising hyperspectral image with non-iid noise structure | |
CN110119780B (en) | Hyper-spectral image super-resolution reconstruction method based on generation countermeasure network | |
Lin et al. | Hyperspectral image denoising via matrix factorization and deep prior regularization | |
Zhong et al. | Multiple-spectral-band CRFs for denoising junk bands of hyperspectral imagery | |
CN112233026A (en) | SAR image denoising method based on multi-scale residual attention network | |
CN111325165B (en) | Urban remote sensing image scene classification method considering spatial relationship information | |
CN109658351B (en) | Hyperspectral image denoising method combining L0 gradient constraint and local low-rank matrix recovery | |
US20130336540A1 (en) | Decomposition apparatus and method for refining composition of mixed pixels in remote sensing images | |
CN103971346B (en) | SAR (Synthetic Aperture Radar) image spot-inhibiting method based on spare domain noise distribution constraint | |
Du et al. | Joint weighted nuclear norm and total variation regularization for hyperspectral image denoising | |
CN103093434B (en) | Non-local wiener filtering image denoising method based on singular value decomposition | |
CN103049892A (en) | Non-local image denoising method based on similar block matrix rank minimization | |
CN104680491A (en) | Non-uniform image motion blur removing method based on deep neural network | |
CN103208097B (en) | Filtering method is worked in coordination with in the principal component analysis of the multi-direction morphosis grouping of image | |
CN110503613A (en) | Based on the empty convolutional neural networks of cascade towards removing rain based on single image method | |
CN104463223B (en) | Hyperspectral image group sparse unmixing method based on space spectrum information abundance constraint | |
CN106952317A (en) | Based on the high spectrum image method for reconstructing that structure is sparse | |
CN112381144B (en) | Heterogeneous deep network method for non-European and Euclidean domain space spectrum feature learning | |
CN112967210B (en) | Unmanned aerial vehicle image denoising method based on full convolution twin network | |
CN106780450A (en) | A kind of image significance detection method based on low-rank Multiscale Fusion | |
CN111598786A (en) | Hyperspectral image unmixing method based on deep denoising self-coding network | |
CN112052758B (en) | Hyperspectral image classification method based on attention mechanism and cyclic neural network | |
CN104376533A (en) | Image denoising method based on regularization principal component tracking | |
CN115861076A (en) | Unsupervised hyperspectral image super-resolution method based on matrix decomposition network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170215 |
|
RJ01 | Rejection of invention patent application after publication |