CN106651778A - Spectral imaging method based on self-adaptive coupling observation and non-linear compressed learning - Google Patents
Spectral imaging method based on self-adaptive coupling observation and non-linear compressed learning Download PDFInfo
- Publication number
- CN106651778A CN106651778A CN201610349594.6A CN201610349594A CN106651778A CN 106651778 A CN106651778 A CN 106651778A CN 201610349594 A CN201610349594 A CN 201610349594A CN 106651778 A CN106651778 A CN 106651778A
- Authority
- CN
- China
- Prior art keywords
- matrix
- observation
- dictionary
- image
- lambda
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
- G06T2207/10036—Multispectral image; Hyperspectral image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
本发明公开了一种基于自适应耦合观测与非线性压缩学习的光谱成像方法,主要解决现有技术无法保证观测矩阵与学习得到的字典不相关的问题。其实现步骤为:1.把原始空间中的信号投影到特征空间上;2.利用KPCA的方法,在特征空间中进行字典学习,求得稀疏字典;3.随机初始化观测矩阵,对由稀疏字典和初始观测矩阵的乘积组成的感知矩阵进行迭代训练,得到经过耦合优化的观测矩阵;4.通过核压缩感知的方法实现非线性压缩感知光谱成像;5.利用pre‑image方法恢复出原信号。实验结果表明:在不同的采样率下,本发明与现有以高斯随机矩阵作为观测矩阵的方法相比,其重构效果较好,可用于高光谱图像的低成本与高质量获取。
The invention discloses a spectral imaging method based on adaptive coupling observation and nonlinear compression learning, which mainly solves the problem that the prior art cannot ensure that the observation matrix is not correlated with the learned dictionary. The implementation steps are as follows: 1. Project the signal in the original space onto the feature space; 2. Use the KPCA method to learn the dictionary in the feature space to obtain a sparse dictionary; 3. Randomly initialize the observation matrix, and use the sparse dictionary The perception matrix formed by the product of the initial observation matrix is iteratively trained to obtain a coupling-optimized observation matrix; 4. Realize nonlinear compressed sensing spectral imaging through the method of nuclear compressed sensing; 5. Use the pre-image method to restore the original signal. Experimental results show that: under different sampling rates, the present invention has better reconstruction effect than the existing method using Gaussian random matrix as the observation matrix, and can be used for low-cost and high-quality acquisition of hyperspectral images.
Description
技术领域technical field
本发明属于图像处理技术领域,特别涉及一种压缩光谱成像方法,可用于高光谱图像的低成本与高质量获取。The invention belongs to the technical field of image processing, and in particular relates to a compressed spectral imaging method, which can be used for low-cost and high-quality acquisition of hyperspectral images.
背景技术Background technique
压缩感知是近年来信号处理技术领域中发展起来的一种新的采样理论,利用信号的稀疏特性,可在远小于传统奈奎斯特采样率的条件下,实现信息的精确恢复。目前现存的压缩感知的方法均是基于显式的线性稀疏表示模型的。线性稀疏表示模型具有简单直观,容易理解,容易操作等优势。但是,实际场景信息比较复杂,很难在线性稀疏表示模型下获得足够稀疏的表示。如果使用线性稀疏表示模型,则获得稀疏系数的稀疏度较低,这就使得恢复出原信号所需要的测量值更多。另一方面,对于压缩感知技术在压缩成像中的应用,设计一个较好的观测系统能够提高成像质量。目前现有压缩成像方法大都是基于随机观测,观测矩阵被选为高斯随机矩阵,或者贝努利随机矩阵。然而,这类随机观测矩阵能够与大多数的正交字典不相关,满足有限等距特性条件,但该随机观测矩阵仍属于非自适应观测矩阵,其虽具有普适性,但对于不同的信号,由于没有充分挖掘信号的信息,且不具备自适应性和最优性,无法在少量传感器下获得高质量的压缩成像结果。Compressed sensing is a new sampling theory developed in the field of signal processing technology in recent years. Using the sparse characteristics of the signal, it can realize the accurate recovery of information under the condition of much smaller than the traditional Nyquist sampling rate. Existing compressed sensing methods are all based on explicit linear sparse representation models. The linear sparse representation model has the advantages of being simple, intuitive, easy to understand, and easy to operate. However, the actual scene information is more complicated, and it is difficult to obtain a sufficiently sparse representation under the linear sparse representation model. If a linear sparse representation model is used, the sparseness of the sparse coefficients obtained is lower, which makes more measurements required to restore the original signal. On the other hand, for the application of compressed sensing technology in compressed imaging, designing a better observation system can improve the imaging quality. Most of the existing compression imaging methods are based on random observations, and the observation matrix is selected as a Gaussian random matrix or a Bernoulli random matrix. However, this kind of random observation matrix can be uncorrelated with most orthogonal dictionaries and satisfy the condition of finite equidistant properties. However, the random observation matrix is still a non-adaptive observation matrix. Although it is universal, it is not suitable for different signals , because the information of the signal is not fully mined, and it is not adaptive and optimal, it is impossible to obtain high-quality compressed imaging results with a small number of sensors.
发明内容Contents of the invention
本发明的目的在于针对上述已有技术的不足,提出了一种基于自适应耦合观测与非线性压缩学习的光谱成像方法,以使观测矩阵与学习到的字典具有更好的非相关性,在少量观测下提高压缩成像的质量。The purpose of the present invention is to address the deficiencies of the above-mentioned prior art, and propose a spectral imaging method based on adaptive coupling observation and nonlinear compression learning, so that the observation matrix and the learned dictionary have better non-correlation. Improve the quality of compressed imaging with a small number of observations.
本发明的技术方案是,通过非线性核函数,把原始空间中的信号投影到特征空间上,并在特征空间中进行字典学习;通过类似K-SVD的方法,对由稀疏字典和初始观测矩阵的乘积所组成的感知矩阵进行迭代训练,得到一个经过耦合优化的观测矩阵;通过核压缩感知的方法实现非线性压缩感知光谱成像。其实现步骤包括如下:The technical scheme of the present invention is to project the signal in the original space onto the feature space through the nonlinear kernel function, and perform dictionary learning in the feature space; through a method similar to K-SVD, the sparse dictionary and the initial observation matrix The perceptual matrix composed of the product of , is iteratively trained to obtain a coupling-optimized observation matrix; the nonlinear compressive sensing spectral imaging is realized through the method of kernel compressive sensing. Its implementation steps include the following:
(1)选取三组n1×n2×n3的高光谱图像,除第10谱段外随机选择n个谱段构造训练样本矩阵Y=[y1,y2,…,yj,…,yn],其中,n1×n2为高光谱图像的大小,n3表示总谱带的数目,yj表示第j个谱段拉成的列向量,j=1,2,…,n,n为训练样本的个数;(1) Select three groups of n 1 ×n 2 ×n 3 hyperspectral images, randomly select n spectral segments except the 10th spectral segment to construct the training sample matrix Y=[y 1 ,y 2 ,…,y j ,… ,y n ], where n 1 ×n 2 is the size of the hyperspectral image, n 3 is the number of total bands, y j is the column vector drawn from the jth spectral segment, j=1,2,…, n, n is the number of training samples;
(2)利用训练样本矩阵Y训练字典,采用核主成份分析KPCA的方法求出训练样本的稀疏字典,记为n为样本个数,K为得到的稀疏字典的原子个数;(2) Use the training sample matrix Y to train the dictionary, and use the method of kernel principal component analysis (KPCA) to obtain the sparse dictionary of the training sample, which is denoted as n is the number of samples, and K is the number of atoms in the obtained sparse dictionary;
(3)设测量值的点数为m,并随机生成高斯随机矩阵作为初始观测矩阵i=1,2,…,m,φi是初始化观测矩阵Φ0的行向量;(3) Set the number of measured points as m, and randomly generate a Gaussian random matrix as the initial observation matrix i=1,2,...,m, φ i is the row vector of initialization observation matrix Φ 0 ;
(4)根据稀疏字典A,结合训练样本矩阵Y和初始观测矩阵Φ0,得到感知矩阵G=f(Φ0 T)Tf(Y)A,对感知矩阵G进行训练,得到最终观测矩阵Φ,其中f为非线性映射函数,T表示转置;(4) According to the sparse dictionary A, combined with the training sample matrix Y and the initial observation matrix Φ 0 , the perception matrix G=f(Φ 0 T ) T f(Y)A is obtained, and the perception matrix G is trained to obtain the final observation matrix Φ , where f is a nonlinear mapping function, and T represents transposition;
(5)将三组第10谱段图像拉成列向量作为测试样本,分别记为e1,e2,e3;(5) Three groups of images of the 10th spectral segment are pulled into column vectors as test samples, which are recorded as e 1 , e 2 , e 3 respectively;
(6)根据上述(4)所求的观测矩阵Φ,对(5)中的三幅测试样本e1,e2,e3进行非线性压缩成像,得到测量值m=fk(<Φ,ei>),其中ei表示第i组测试样本,i从1到3,fk为选择的核函数;(6) According to the observation matrix Φ obtained in (4) above, perform nonlinear compression imaging on the three test samples e 1 , e 2 , and e 3 in (5), and obtain the measured value m=f k (<Φ, e i >), where e i represents the i-th group of test samples, i is from 1 to 3, and f k is the selected kernel function;
(7)利用最小二乘法计算稀疏系数其中表示伪逆;(7) Calculating the sparse coefficients using the least squares method in represents the pseudo-inverse;
(8)根据稀疏系数β以及稀疏字典A,利用pre-image方法重构出原图像其中为第i组恢复的图像。(8) According to the sparse coefficient β and the sparse dictionary A, use the pre-image method to reconstruct the original image in The recovered image for group i.
本发明与现有的技术相比有以下优点:Compared with the prior art, the present invention has the following advantages:
1.本发明提出的核空间中的自适应耦合优化算法,使得观测矩阵与经过字典学习得到的稀疏字典具有更高的非相关性,能够更好的满足压缩感知理论的限制等距特性条件。1. The adaptive coupling optimization algorithm in the kernel space proposed by the present invention makes the observation matrix and the sparse dictionary obtained through dictionary learning have higher non-correlation, and can better meet the restricted equidistant characteristic conditions of the compressed sensing theory.
2.本发明根据字典学习所得到的稀疏字典来进行耦合优化得出观测矩阵,可以充分挖掘信号的信息,更具有自适应性,从而获得更好的重构效果。2. The present invention performs coupling optimization based on the sparse dictionary obtained by dictionary learning to obtain an observation matrix, which can fully mine signal information and is more adaptive, thereby obtaining a better reconstruction effect.
附图说明Description of drawings
图1是本发明的实现流程图;Fig. 1 is the realization flowchart of the present invention;
图2是用本发明方法和以高斯随机矩阵作为观测矩阵的方法在采样率为10%时对测试图像IndianPines的重构效果对比图;Fig. 2 is to use the method of the present invention and with Gaussian random matrix as the method for observation matrix when the sampling rate is 10% to the reconstruction effect contrast figure of test image IndianPines;
图3是用本发明方法和以高斯随机矩阵作为观测矩阵的方法在采样率为10%时对测试图像IndianPines进行重构所恢复图像的均方误差曲线图;Fig. 3 is the mean square error curve figure of reconstructing the restored image to the test image IndianPines when the sampling rate is 10% with the method of the present invention and with the Gaussian random matrix as the observation matrix;
图4是用本发明方法和以高斯随机矩阵作为观测矩阵的方法在采样率为10%时对测试图像Moffet的重构效果对比图;Fig. 4 is to use the method of the present invention and take Gaussian random matrix as the method for observation matrix when the sampling rate is 10% to the reconstruction effect contrast figure of test image Moffet;
图5是用本发明方法和以高斯随机矩阵作为观测矩阵的方法在采样率为10%时对测试图像Moffet进行重构所恢复图像的均方误差曲线图;Fig. 5 is to use the method of the present invention and the method with Gaussian random matrix as the observation matrix when sampling rate is 10% to carry out the mean square error curve figure of reconstructing the restored image to test image Moffet;
图6是用本发明方法和以高斯随机矩阵作为观测矩阵的方法在采样率为10%时对测试图像WashtonDC的重构效果对比图;Fig. 6 is to use the method of the present invention and take Gaussian random matrix as the method for observation matrix when the sampling rate is 10% to the reconstruction effect contrast figure of test image WashtonDC;
图7是用本发明方法和以高斯随机矩阵作为观测矩阵的方法在采样率为10%时对测试图像WashtonDC进行重构所恢复图像的均方误差曲线图。Fig. 7 is a curve diagram of the mean square error of the reconstructed test image WashtonDC using the method of the present invention and the method of using a Gaussian random matrix as the observation matrix when the sampling rate is 10%.
具体实施方法Specific implementation method
参照图1,本发明的具体实现步骤如下:With reference to Fig. 1, the concrete realization steps of the present invention are as follows:
步骤1.构建训练样本矩阵。Step 1. Build the training sample matrix.
从图像库获取三组n1×n2×n3的高光谱图像,将每组高光谱图像的第10谱段的图像作为测试样本,其它的n个谱段作为训练样本,并把训练样本的每个谱段图像拉成列向量,组成大小为w×n的训练样本矩阵:Y=[y1,y2,…,yj,…,yn],其中,w=n1×n2yj表示每个谱段拉成的列向量,j=1,2,…,n。Get three sets of n 1 ×n 2 ×n 3 hyperspectral images from the image library, use the image of the 10th spectral segment of each group of hyperspectral images as a test sample, and the other n spectral segments as training samples, and use the training samples Each spectral segment image of is pulled into a column vector to form a training sample matrix of size w×n: Y=[y 1 ,y 2 ,…,y j ,…,y n ], where w=n 1 ×n 2 y j represents the column vector drawn by each spectral segment, j=1,2,...,n.
步骤2.利用训练样本Y训练字典。Step 2. Use the training sample Y to train the dictionary.
在非线性压缩成像中,训练字典的方法有核主成份分析、核K-SVD和核独立成分分析等方法,核主成份分析方法训练字典的时间相对较短,因此本发明采用核主成份分析KPCA的方法对训练样本进行训练,求出稀疏字典,其步骤如下:。In nonlinear compression imaging, the method of training dictionary has methods such as nuclear principal component analysis, nuclear K-SVD and nuclear independent component analysis, and the time of nuclear principal component analysis method training dictionary is relatively short, so the present invention adopts nuclear principal component analysis The KPCA method trains the training samples and finds the sparse dictionary, the steps are as follows:.
2a)选定核函数为多项式核函数k(x,y)=fk(<x,y>)=(<x,y>+c)d,其中x,y为核函数的输入变量,c为核函数的截距参数,其值为c=0.5,d为指数参数,其值为d=5;2a) The selected kernel function is a polynomial kernel function k(x, y) = f k (<x, y>) = (<x, y>+c) d , where x, y are the input variables of the kernel function, c Be the intercept parameter of kernel function, its value is c=0.5, and d is the exponent parameter, and its value is d=5;
2b)利用2a)选定的核函数求样本矩阵Y的核矩阵:2b) Use the kernel function selected in 2a) to find the kernel matrix of the sample matrix Y:
C=k(Y,Y)=(<Y,Y>+c)d C=k(Y,Y)=(<Y,Y>+c) d
其中n为样本个数;in n is the number of samples;
2c)对核矩阵C进行特征值分解,即C=VΣVT,其中Σ是对角矩阵,V是特征值所对应的特征向量矩阵,T表示转置;2c) Decompose the eigenvalue of the kernel matrix C, that is, C=VΣV T , where Σ is a diagonal matrix, V is the eigenvector matrix corresponding to the eigenvalue, and T represents transposition;
2d)设贡献度Z=0.9,计算对角矩阵Σ中每一个正的特征值在所有正的特征值总和中的贡献率,根据降序排列的特征值的顺序,依次累加正的特征值的贡献率,当累加后的总和大于贡献率Z时停止,把所累加的特征值的数量记为p;2d) Set the contribution degree Z=0.9, calculate the contribution rate of each positive eigenvalue in the sum of all positive eigenvalues in the diagonal matrix Σ, and accumulate the contribution of the positive eigenvalues according to the order of the eigenvalues in descending order rate, stop when the accumulated sum is greater than the contribution rate Z, and record the number of accumulated eigenvalues as p;
2e)根据前p个最大的特征值的特征向量,得出相对应的特征向量矩阵Vp,则稀疏字典A=Vp。2e) Obtain the corresponding eigenvector matrix V p according to the eigenvectors of the first p largest eigenvalues, then the sparse dictionary A=V p .
步骤3.生成初始观测矩阵Φ0。Step 3. Generate an initial observation matrix Φ 0 .
设测量值的点数为m,随机生成大小为m×w的高斯随机矩阵,作为初始观测矩阵:φi是初始化观测矩阵Φ0的第i个行向量,i=1,2,…,m。Assuming that the number of measurement points is m, a Gaussian random matrix of size m×w is randomly generated as the initial observation matrix: φ i is the i-th row vector of the initialization observation matrix Φ 0 , i=1,2,...,m.
步骤4.根据稀疏字典A,结合训练样本矩阵Y和初始观测矩阵Φ0,得到感知矩阵G。Step 4. According to the sparse dictionary A, the perception matrix G is obtained by combining the training sample matrix Y and the initial observation matrix Φ 0 .
将稀疏字典A、训练样本矩阵Y、初始观测矩阵Φ0三者相乘,得到感知矩阵:G=f(Φ0 T)Tf(Y)A,其中f表示非线性映射函数,T表示转置。Multiply the sparse dictionary A, the training sample matrix Y, and the initial observation matrix Φ 0 to obtain the perception matrix: G=f(Φ 0 T ) T f(Y)A, where f represents the nonlinear mapping function, and T represents the transformation place.
步骤5.对感知矩阵G进行训练,得到最终观测矩阵Φ。Step 5. Train the perception matrix G to obtain the final observation matrix Φ.
5a)选定核函数为多项式核函数k(x,y)=fk(<x,y>)=(<x,y>+c)d,c为核函数的截距参数,其值为c=0.5,d为指数参数,其值为d=5;5a) The selected kernel function is a polynomial kernel function k(x,y)=f k (<x,y>)=(<x,y>+c) d , c is the intercept parameter of the kernel function, and its value is c=0.5, d is an index parameter, and its value is d=5;
5b)计算感知矩阵G的格兰姆矩阵GTG,求解下列优化问题得到与特征空间中稀疏字典相关性最小的观测矩阵:5b) Calculate the Gram matrix G T G of the perception matrix G, and solve the following optimization problem to obtain the observation matrix with the least correlation with the sparse dictionary in the feature space:
其中IK是大小为K×K的单位矩阵,F表示矩阵的Frobenius范数;where I K is an identity matrix with a size of K×K, and F represents the Frobenius norm of the matrix;
5c)将上述优化问题转化为GTG≈IK,把感知矩阵G=f(Φ0 T)Tf(Y)A代入GTG≈IK,并对其两边分别左乘稀疏字典A,右乘其转置AT,得到如下关系式:5c) Transform the above optimization problem into G T G≈I K , substitute the perceptual matrix G=f(Φ 0 T ) T f(Y)A into G T G≈I K , and multiply the sparse dictionary A to the left on both sides , multiplied right by its transpose A T , to get the following relationship:
AATf(Y)Tf(Φ0 T)f(Φ0 T)Tf(Y)AAT≈AAT;AA T f(Y) T f(Φ 0 T )f(Φ 0 T ) T f(Y)AA T ≈AA T ;
5d)对上述AAT进行奇异值分解,即AAT=VΛVT,其中,是奇异值分解后所求得的正交矩阵,是对角矩阵,n为训练样本的数量;5d ) Singular value decomposition is performed on the above AAT, that is, AAT = VΛV T , where , is the orthogonal matrix obtained after singular value decomposition, Is a diagonal matrix, n is the number of training samples;
5e)将AAT=VΛVT代入5c)中的公式,得到如下关系式:5e) Substituting AAT = VΛV T into the formula in 5c), the following relationship is obtained:
VΛVTf(Y)Tf(Φ0 T)f(Φ0 T)Tf(Y)VΛVT≈VΛVT VΛV T f(Y) T f(Φ 0 T )f(Φ 0 T ) T f(Y)VΛV T ≈VΛV T
5f)根据样本矩阵Y以及初始化观测矩阵Φ0,结合核函数,计算过渡核矩阵Knm:5f) According to the sample matrix Y and the initialization observation matrix Φ 0 , combined with the kernel function, calculate the transition kernel matrix K nm :
5g)把5e)的公式化简为:5g) simplify the formula of 5e) to:
其中,中间变量 Among them, the intermediate variable
5h)把对角矩阵Λ写成diag(λ1,…,λn),将中间变量Γmn写成行向量形式Γmn=[τ1,…,τm]T,并把目标函数转化为其中,vi=[λ1τi,1,…,λnτi,n];5h) Write the diagonal matrix Λ as diag(λ 1 ,…,λ n ), write the intermediate variable Γ mn as the row vector form Γ mn =[τ 1 ,…,τ m ] T , and write the objective function transform into Among them, v i =[λ 1 τ i,1 ,…,λ n τ i,n ];
5i)将展开为:5i) will expands to:
同时,定义误差矩阵为: At the same time, define the error matrix as:
5j)根据过渡核矩阵Knm以及正交矩阵V,利用下式初始化Γmn:5j) According to the transition kernel matrix K nm and the orthogonal matrix V, use the following formula to initialize Γ mn :
5k)设置循环次数t的最大值为m,t从1开始循环;5k) The maximum value of the number of cycles t is set to be m, and t starts to cycle from 1;
5l)在第t次循环中,计算误差矩阵Et,并对其进行特征值分解,得到最大的特征值ξt以及与其对应的特征向量ut;5l) In the tth cycle, calculate the error matrix E t , and perform eigenvalue decomposition on it to obtain the largest eigenvalue ξ t and its corresponding eigenvector u t ;
5m)根据下式,更新的每一个行向量:5m) According to the following formula, update For each row vector of :
5n)循环m次,就能得到具有最小相关性的中间变量 5n) By looping m times, the intermediate variable with the minimum correlation can be obtained
5o)计算过渡核矩阵 5o) Calculate transition kernel matrix
5p)求解下式得到经过耦合优化的观测矩阵Φ:5p) Solve the following formula to obtain the observation matrix Φ after coupling optimization:
其中,k(x,y)=fk(<x,y>)。where k(x,y)=f k (<x,y>).
步骤6.获取测试图像。Step 6. Acquire a test image.
把三组高光谱图像的第10个谱段的图像作为测试图像,并把其拉成列向量,分别记为e1,e2,e3。Take the image of the 10th spectral segment of the three sets of hyperspectral images as the test image, and pull it into a column vector, denoted as e 1 , e 2 , e 3 respectively.
步骤7.根据上述步骤2所求的字典A和步骤4所求的观测矩阵Φ,利用核压缩感知的方法对步骤5中的三幅测试图像e1,e2,e3进行非线性压缩成像。Step 7. According to the dictionary A obtained in the above step 2 and the observation matrix Φ obtained in the step 4, the three test images e 1 , e 2 , and e 3 in the step 5 are subjected to nonlinear compression imaging using the method of nuclear compressed sensing .
7a)根据压缩观测方程M=Gβ的形式,计算测量值向量M和感知矩阵G:7a) According to the form of the compressed observation equation M=Gβ, calculate the measured value vector M and the perception matrix G:
7b)根据计算得到的测量值向量M和感知矩阵G,采用最小二乘算法得出稀疏系数 7b) According to the calculated measured value vector M and perception matrix G, use the least squares algorithm to obtain the sparse coefficient
步骤8.根据稀疏系数β以及稀疏字典A,重构出原图像 Step 8. Reconstruct the original image according to the sparse coefficient β and the sparse dictionary A
利用pre-image方法,通过如下公式重构出原图像i=1,2,3:Using the pre-image method, the original image is reconstructed by the following formula i=1,2,3:
其中,up表示单位正交基的第p列,p=1,2,…,w,w是高光谱图像的像素点的个数,Aβ=[c1,c2,…,cj,…,cn]T,cj表示Aβ的第j个元素,fk为先前选定的多项式核函数,是fk的逆函数。Among them, u p represents the p-th column of the unit orthogonal basis, p=1,2,…,w, w is the number of pixels in the hyperspectral image, Aβ=[c 1 ,c 2 ,…,c j , …,c n ] T , c j represents the jth element of Aβ, f k is the previously selected polynomial kernel function, is the inverse function of f k .
本发明的效果可以通过以下实验进一步说明:Effect of the present invention can be further illustrated by following experiments:
1)实验条件1) Experimental conditions
本实验所用的三组高光谱图像为典型的AVIRIS高光谱数据:IndianPines、Moffet和WashtonDC。IndianPines数据是1992年由AVIRIS传感器对印第安那州西北农业区成像所得,Moffet图像是由1992年8月由AVIRIS传感器对加利福尼亚州的Moffett地区成像所得;两组图像波长范围为0.4um~2.5um,共224个光谱段,去掉所有像素为0和不透明的波段后有200个谱段,空间分辨率为20m。WashtonDC图像由HYDICE光谱仪对Washtington DC Mall地区成像而来,波长范围为0.4um~2.5um,共210个谱段,预处理后选191个波段,空间分辨率为2.8m。IndianPines图像的大小为145×145×200,Moffet图像的大小为145×145×200,WashtonDC图像的大小为145×145×191。The three sets of hyperspectral images used in this experiment are typical AVIRIS hyperspectral data: IndianPines, Moffet and WashingtonDC. The IndianPines data was obtained by imaging the agricultural area of northwest Indiana with the AVIRIS sensor in 1992, and the Moffet image was obtained by imaging the Moffett area in California with the AVIRIS sensor in August 1992; the wavelength range of the two sets of images is 0.4um~2.5um, There are 224 spectral segments in total, and there are 200 spectral segments after removing all bands whose pixels are 0 and opaque, and the spatial resolution is 20m. The WashtonDC image is imaged by the HYDICE spectrometer in the Washington DC Mall area. The wavelength range is 0.4um to 2.5um, with a total of 210 spectral bands. After preprocessing, 191 bands are selected, and the spatial resolution is 2.8m. The IndianPines image has a size of 145×145×200, the Moffet image has a size of 145×145×200, and the WashtonDC image has a size of 145×145×191.
实验仿真环境:采用软件MATLAB 2012R作为仿真工具,CPU是AMD A8-5550M,主频为2.10GHz,内存16G,操作系统为Windows 7旗舰版。Experimental simulation environment: the software MATLAB 2012R is used as the simulation tool, the CPU is AMD A8-5550M, the main frequency is 2.10GHz, the memory is 16G, and the operating system is Windows 7 Ultimate Edition.
从每组高光谱图像中随机抽取第10个谱段作为测试图像,取每组高光谱图像其他谱段的图像作为训练样本。Randomly select the 10th spectral segment from each group of hyperspectral images as a test image, and take images of other spectral segments of each group of hyperspectral images as training samples.
2)仿真内容2) Simulation content
仿真1:在0.1%~20%的不同采样率下,分别采用本发明方法与现有以高斯随机矩阵作为观测矩阵的方法对测试图像进行非线性压缩感知仿真实验,实验结果如表1所示。Simulation 1: Under different sampling rates of 0.1% to 20%, respectively adopt the method of the present invention and the existing method using Gaussian random matrix as the observation matrix to carry out nonlinear compressed sensing simulation experiments on the test image, and the experimental results are shown in Table 1 .
表1 不同采样率下两种方法的实验对比Table 1 Experimental comparison of the two methods at different sampling rates
从表1可以看出,随着采样率的不断提高,两种方法的PSNR不断上升,说明重构效果都在稳步提升,但是本发明方法提升幅度最大。在相同的采样率下,本发明方法的PSNR最高,重构效果最好。It can be seen from Table 1 that as the sampling rate continues to increase, the PSNR of the two methods continues to rise, indicating that the reconstruction effect is steadily improving, but the method of the present invention has the largest improvement. Under the same sampling rate, the method of the present invention has the highest PSNR and the best reconstruction effect.
仿真2:在10%的采样率下,分别采用本发明方法与现有以高斯随机矩阵作为观测矩阵的方法对测试图像IndianPines进行压缩感知仿真实验,实验结果如图2和图3所示,其中:Simulation 2: Under the sampling rate of 10%, the method of the present invention and the existing method using Gaussian random matrix as the observation matrix are respectively used to carry out the compressed sensing simulation experiment on the test image IndianPines, and the experimental results are shown in Figure 2 and Figure 3, where :
图2(a)是测试图像IndianPines第10谱段的原始图像;Figure 2(a) is the original image of the 10th band of the test image IndianPines;
图2(b)是采用现有以高斯随机矩阵作为观测矩阵的方法的重构图像,其PSNR为34.8322dB;Figure 2(b) is a reconstructed image using the existing Gaussian random matrix as the observation matrix method, and its PSNR is 34.8322dB;
图2(c)是采用本发明方法的重构图像,其PSNR为37.3694dB;Fig. 2 (c) is the reconstructed image adopting the method of the present invention, and its PSNR is 37.3694dB;
图3是不同采样率下两种方法的均方误差曲线。Figure 3 is the mean square error curves of the two methods at different sampling rates.
仿真3:在10%的采样率下,分别采用本发明方法与现有以高斯随机矩阵作为观测矩阵的方法对测试图像Moffet进行压缩感知仿真实验,实验结果如图4和图5所示,其中:Simulation 3: Under the sampling rate of 10%, the method of the present invention and the existing method using Gaussian random matrix as the observation matrix are respectively used to carry out the compressed sensing simulation experiment on the test image Moffet, and the experimental results are shown in Figure 4 and Figure 5, where :
图4(a)是测试图像Moffet第10谱段的原始图像;Figure 4(a) is the original image of the 10th spectral segment of the test image Moffet;
图4(b)是采用现有以高斯随机矩阵作为观测矩阵的方法的重构图像,其PSNR为47.2954dB;Figure 4(b) is the reconstructed image using the existing Gaussian random matrix as the observation matrix method, and its PSNR is 47.2954dB;
图4(c)是采用本发明方法的重构图像,其PSNR为49.9599dB;Fig. 4 (c) is the reconstructed image adopting the method of the present invention, and its PSNR is 49.9599dB;
图5是不同采样率下两种方法的均方误差曲线。Figure 5 is the mean square error curves of the two methods at different sampling rates.
仿真4:在10%的采样率下,分别采用本发明方法与现有以高斯随机矩阵作为观测矩阵的方法对测试图像WashtonDC进行压缩感知仿真实验,实验结果如图6和图7所示,其中:Simulation 4: Under the sampling rate of 10%, respectively adopt the method of the present invention and the existing method using Gaussian random matrix as the observation matrix to carry out the compressed sensing simulation experiment on the test image WashtonDC, the experimental results are shown in Figure 6 and Figure 7, where :
图6(a)是测试图像WashtonDC第10谱段的原始图像;Figure 6(a) is the original image of the 10th band of the test image WashingtonDC;
图6(b)是采用现有以高斯随机矩阵作为观测矩阵的方法的重构图像,其PSNR为44.1374dB;Figure 6(b) is the reconstructed image using the existing Gaussian random matrix as the observation matrix method, and its PSNR is 44.1374dB;
图6(c)是采用本发明方法的重构图像,其PSNR为46.4503dB;Fig. 6 (c) is the reconstructed image adopting the method of the present invention, and its PSNR is 46.4503dB;
图7是不同采样率下两种方法的均方误差曲线。Figure 7 is the mean square error curves of the two methods at different sampling rates.
从图2、图4和图6的实验结果可以看出,在相同的采样率下,本发明与现有以高斯随机矩阵作为观测矩阵的方法相比,其PSNR更高,重构效果最好。From the experimental results in Fig. 2, Fig. 4 and Fig. 6, it can be seen that at the same sampling rate, compared with the existing method using Gaussian random matrix as the observation matrix, the present invention has higher PSNR and the best reconstruction effect .
从图3、图5和图7的曲线图可以看出,随着采样率的提高,两种方法的均方误差均呈现下降趋势;但在相同采样率下,本发明的方法的所恢复的图像的均方误差更小,说明本发明方法的优越性。As can be seen from the graphs of Fig. 3, Fig. 5 and Fig. 7, as the sampling rate increases, the mean square error of the two methods all presents a downward trend; The mean square error of the image is smaller, which illustrates the superiority of the method of the present invention.
Claims (3)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610349594.6A CN106651778A (en) | 2016-05-25 | 2016-05-25 | Spectral imaging method based on self-adaptive coupling observation and non-linear compressed learning |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610349594.6A CN106651778A (en) | 2016-05-25 | 2016-05-25 | Spectral imaging method based on self-adaptive coupling observation and non-linear compressed learning |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106651778A true CN106651778A (en) | 2017-05-10 |
Family
ID=58848660
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610349594.6A Pending CN106651778A (en) | 2016-05-25 | 2016-05-25 | Spectral imaging method based on self-adaptive coupling observation and non-linear compressed learning |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106651778A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108492239A (en) * | 2018-03-19 | 2018-09-04 | 北京工业大学 | A kind of cooperative optimization method of structuring observation and rarefaction representation towards light-field camera |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103400402A (en) * | 2013-07-12 | 2013-11-20 | 西安电子科技大学 | Low-rank structure-based sparse compressive sensing MRI (Magnetic Resonance Imaging) image reconstruction method |
CN104112286A (en) * | 2014-08-01 | 2014-10-22 | 桂林电子科技大学 | Geometric structural characteristic and self-similarity based image compressed sensing reconstruction method |
CN104915935A (en) * | 2015-06-16 | 2015-09-16 | 西安电子科技大学 | Compressed spectral imaging method based on nonlinear compressed sensing and dictionary learning |
CN104933685A (en) * | 2015-06-16 | 2015-09-23 | 西安电子科技大学 | Hyper-spectral compressive imaging method based on three-dimensional tensor compressed sensing |
-
2016
- 2016-05-25 CN CN201610349594.6A patent/CN106651778A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103400402A (en) * | 2013-07-12 | 2013-11-20 | 西安电子科技大学 | Low-rank structure-based sparse compressive sensing MRI (Magnetic Resonance Imaging) image reconstruction method |
CN104112286A (en) * | 2014-08-01 | 2014-10-22 | 桂林电子科技大学 | Geometric structural characteristic and self-similarity based image compressed sensing reconstruction method |
CN104915935A (en) * | 2015-06-16 | 2015-09-16 | 西安电子科技大学 | Compressed spectral imaging method based on nonlinear compressed sensing and dictionary learning |
CN104933685A (en) * | 2015-06-16 | 2015-09-23 | 西安电子科技大学 | Hyper-spectral compressive imaging method based on three-dimensional tensor compressed sensing |
Non-Patent Citations (1)
Title |
---|
李斌: ""基于张量和非线性稀疏的多维信号压缩感知理论与应用"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108492239A (en) * | 2018-03-19 | 2018-09-04 | 北京工业大学 | A kind of cooperative optimization method of structuring observation and rarefaction representation towards light-field camera |
CN108492239B (en) * | 2018-03-19 | 2022-05-03 | 北京工业大学 | Structured observation and sparse representation collaborative optimization method for light field camera |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109490957B (en) | Seismic data reconstruction method based on space constraint compressed sensing | |
CN105825200B (en) | EO-1 hyperion Anomaly target detection method based on dictionary learning and structure rarefaction representation | |
CN104156994B (en) | Compressed sensing magnetic resonance imaging reconstruction method | |
WO2018099321A1 (en) | Generalized tree sparse-based weighted nuclear norm magnetic resonance imaging reconstruction method | |
CN103810755B (en) | Compressed sensing spectrum picture method for reconstructing based on documents structured Cluster rarefaction representation | |
CN106919952A (en) | EO-1 hyperion Anomaly target detection method based on structure rarefaction representation and internal cluster filter | |
CN103279932B (en) | A kind of two dimension synthesis sparse model and dictionary training method based on this model | |
CN103440500B (en) | Classification of hyperspectral remote sensing image and recognition methods | |
Wan et al. | An improved complex multi-task Bayesian compressive sensing approach for compression and reconstruction of SHM data | |
CN104915935B (en) | Compressed Spectral Imaging Method Based on Nonlinear Compressed Sensing and Dictionary Learning | |
CN103049923B (en) | The method of magnetic resonance fast imaging | |
CN103218795B (en) | Based on the part K spatial sequence image reconstructing method of self-adaptation doubledictionary study | |
CN106934778A (en) | A kind of MR image rebuilding methods based on small echo domain structure and non local grouping sparsity | |
CN109087262B (en) | Reconstruction method and storage medium of multi-view spectral image | |
CN107730482A (en) | A kind of sparse blending algorithm based on region energy and variance | |
CN106097278A (en) | The sparse model of a kind of multidimensional signal, method for reconstructing and dictionary training method | |
CN103646256A (en) | Image characteristic sparse reconstruction based image classification method | |
CN104933685A (en) | Hyper-spectral compressive imaging method based on three-dimensional tensor compressed sensing | |
CN107730479A (en) | High dynamic range images based on compressed sensing go artifact fusion method | |
CN107301630A (en) | A kind of CS MRI image reconstructing methods constrained based on ordering structure group non-convex | |
CN108257093B (en) | Single-frame image super-resolution method based on controllable kernel and Gaussian process regression | |
CN103279959A (en) | Two-dimension analysis thinning model and dictionary training method and image denoising method thereof | |
CN115423739A (en) | SimpleBaseline-based method for detecting key points of teleoperation mechanical arm | |
CN106056554A (en) | Magnetic-resonance fast imaging method based on gradient-domain convolution sparse coding | |
CN106651778A (en) | Spectral imaging method based on self-adaptive coupling observation and non-linear compressed learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |
|
RJ01 | Rejection of invention patent application after publication |