CN103793883A - Principal component analysis-based imaging spectral image super resolution restoration method - Google Patents

Principal component analysis-based imaging spectral image super resolution restoration method Download PDF

Info

Publication number
CN103793883A
CN103793883A CN201310676634.4A CN201310676634A CN103793883A CN 103793883 A CN103793883 A CN 103793883A CN 201310676634 A CN201310676634 A CN 201310676634A CN 103793883 A CN103793883 A CN 103793883A
Authority
CN
China
Prior art keywords
image
resolution
major component
super
pca
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310676634.4A
Other languages
Chinese (zh)
Other versions
CN103793883B (en
Inventor
王素玉
侯义斌
王博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Technology
Original Assignee
Beijing University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Technology filed Critical Beijing University of Technology
Priority to CN201310676634.4A priority Critical patent/CN103793883B/en
Publication of CN103793883A publication Critical patent/CN103793883A/en
Application granted granted Critical
Publication of CN103793883B publication Critical patent/CN103793883B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a principal component analysis-based imaging spectral image super resolution restoration method. The method includes the steps of principal component analysis, gray mapping and MAP-based first principal component super resolution restoration and all-band super resolution restoration of an imaging spectral image. According to the principal component analysis-based imaging spectral image super resolution restoration method, the effective information of the imaging spectral image is concentrated on a first principal component through PCA transform, with the super resolution restoration of the first principal component simply realized, the spatial resolution of all bands can be improved, and therefore, the amount of computation is small; mapping from panchromatic image high-frequency information to a first principal component image can be realized through establishing a gray mapping model and based on the correlation between the first principal component and a panchromatic image after the PCA transform, and the quality of a reconstructed high-frequency information can be further improved through MAP constrained optimization; and therefore, high-frequency information of the panchromatic image can be fully utilized, and the introduction of wrong information can be avoided, and the quality of a reconstructed high-resolution image can be ensured, and the problem of spectrum distortion caused by independent operation of each band can be effectively solved.

Description

A kind of imaging spectrum Super-Resolution method based on principal component analysis (PCA)
Technical field
The present invention relates to a kind of Super-Resolution method of imaging spectrum, particularly a kind of imaging spectrum Super-Resolution method based on principal component analysis (PCA) (Principal Component Analysis, PCA).
Background technology
Imaging spectral technology is a kind of new remote sensing technology developing rapidly the eighties in 20th century, it obtains atural object radiation information with nano level superelevation spectral resolution at dozens or even hundreds of wave band simultaneously, thereby can, in obtaining ground object target spatial information, its internal physical feature and formation be surveyed.Imaging spectral technology is all widely used in fields such as resource exploration, geologic prospect, disaster assistances.
Spatial resolution and spectral resolution are to weigh two important parameters of imaging spectrum image quality, be subject to the restriction of image-forming principle, the raising of spectral resolution, often with the cost that is reduced to of spatial resolution, makes the spatial resolution of imaging spectrum conventionally far below panchromatic image.And in practical application, remote-sensing flatform carries the panchromatic of different resolution and multispectral imaging equipment conventionally simultaneously, the high-frequency information of panchromatic image has important reference for the raising of multispectral image spatial resolution.
Imaging spectrum mainly contains following feature: spatial resolution is lower than panchromatic image; Spectral resolution is high, and spectral coverage is many, and data volume is large; Spectral correlation is strong, spatial coherence relatively a little less than; Similar atural object has the similar curve of spectrum.For these features, the method that improves at present imaging spectrum spatial resolution mainly contains following several:
Panchromatic image integration technology: extract the high-frequency information with scene high resolution spatial panchromatic image, incorporate the imaging spectrum of low resolution by image fusion technology, reach the effect that improves its spatial resolution.The method is mainly applicable to the less multispectral image of wave band, not too applicable for high spectrum image; And merge after image often there is certain spectrum distortion.
Super-Resolution Restoration from Image Sequences: the Super-Resolution Restoration from Image Sequences of normal image, successively for each wave band of imaging spectrum, is reached to the effect that improves spatial resolution.Because imaging spectrum has the correlativity between spectrum very by force, be between each wave band, to have a large amount of redundant informations, if use conventional methods successively each wave band carried out to Super-Resolution, correlativity between wave band can make to influence each other between the reconstructed results of each wave band, destroys original spectral signature; And also very large by the super-resolution rebuilding process operand of wave band.
Spectrum solution is mixed technology: regard low resolution picture dot as mixed pixel that the imaging simultaneously of multiple atural object forms, by the mixed technology of spectrum solution, be decomposed into the mixed form of multiple atural object, reached decomposition mixed pixel by solving the different proportion of each atural object, and then improved the effect of spatial resolution.Application number is that 201210051365.8 patent discloses a kind of high spectrum image super resolution ratio reconstruction method based on sub-pixel mapping, by the mixed Abundances of the every kind of atural object that forms mixed pixel in each picture dot that solve of spectrum solution, then be a certain atural object by each sub-pixel Random assignment, obtain initialized atural object distributed image; Finally, by iteration optimization, rebuild a high-resolution image.This is a kind of method that improves spatial resolution by excavating high spectrum image internal information, but fails to utilize the information of the high resolution spatial panchromatic image that Same Scene obtains, thereby the ability that its resolution improves is difficult to reach very high level.In the time there is high resolution spatial panchromatic image in Same Scene, by the inventive method, make full use of the high-frequency information of high resolution spatial panchromatic image, can reach better Super-Resolution effect.
Prior art does not take into full account the hold facility of spectrum dimension information in Super-Resolution process to the Super-Resolution of imaging spectrum, cause the high-definition picture of reconstruction often to have certain spectrum distortion.In addition, high spectrum image wave band is numerous, and all wave bands are carried out respectively to Super-Resolution, and its huge operand is also difficult to bear often.
Summary of the invention
For the above-mentioned problems in the prior art, the invention provides a kind of imaging spectrum Super-Resolution method based on principal component analysis (PCA), realize high-quality Super-Resolution, reduce the overall operand of algorithm.
For achieving the above object, the present invention adopts following technological means:
Completed the collection of imaging spectrometer data by imaging spectrometer, and the optical signalling of pending image is converted into data image signal, be stored in collecting device storer; Read in image by USB, infrared interface, in processor, carry out the imaging spectrum Super-Resolution based on principal component analysis (PCA).It is characterized in that: by principal component analysis (PCA), the main information of imaging spectrum is concentrated on to its 1st major component, by the Super-Resolution to the 1st major component, realize the full wave Super-Resolution of imaging spectrum.
1. principal component analysis (PCA)
Principal component analysis (PCA) (PCA) is the multi-dimensional orthogonal linear transformation on statistical nature basis, is also conventional a kind of converter technique during multiband, Multitemporal Remote Sensing Images application are processed.It has the data dependence of removal and assembles the effect of main information, thereby is being widely used aspect the dimensionality reduction of high dimensional signal and feature extraction.Imaging spectrum similarly is typical high dimensional signal, and has very strong Spectral correlation.In the present invention, the object of PCA conversion is exactly the useful information in original multiple band images will be focused in the 1st major component image, makes by the Super-Resolution of the 1st major component, reaches the effect that strengthens all band image spatial resolutions.Not only reduce by the huge operand of wave band Super-Resolution process, also avoid relevant information to repeat to restore the phenomenon of introducing spectrum distortion.
2. the 1st major component Super-Resolution based on grey scale mapping and MAP
The 1st major component image of imaging spectrum, has merged the important information of all wave bands of imaging spectrum, and its spectral wavelength coverage and panchromatic image have certain overlapping, and corresponding image detail has very strong similarity.The present invention utilizes this feature, extracts the high-frequency information of high resolution spatial panchromatic image, after certain grey scale mapping, incorporates the 1st major component image of imaging spectrum, realizes the Super-Resolution of major component image.
From the angle of frequency domain, imaging system is equivalent to a low-pass filter, has certain cutoff frequency.On the basis that the image low-frequency information that the Super-Resolution of image can be thought to obtain in to imaging system passband is restored, recover the process of the above high-frequency information of its cutoff frequency, the present invention is just as starting point, utilize the high-frequency information of high resolution spatial panchromatic image, the high-frequency information of reestablishment imaging spectrum picture major component.
No matter be panchromatic image or imaging spectrum, its record be all the reflection characteristic of atural object to respective wavelength light, different reflection characteristics is presented as the variation of gray-scale value on image.Imaging spectrum is after PCA conversion, often there is certain difference in the tonal range of its 1st major component and panchromatic image, for this reason, the present invention proposes a kind of method of high-frequency information grey scale mapping, only extract the high-frequency information of panchromatic image, after certain grey scale mapping, incorporate the 1st major component image of low resolution imaging spectrum, to utilize better the detailed information of panchromatic image, and reduce the impact of low frequency component.
In order further to improve the fidelity of rebuilding high resolving power major component image, the image quality decrease of avoiding mapping error to cause, further retrains and optimizes the high-definition picture of initial estimation.The high resolving power estimated image that the present invention rebuilds grey scale mapping method, as initial value, is introduced maximum a posteriori probability (Maximum a Posteriori, MAP) framework and is is further optimized and revised, and obtains the Super-Resolution image of the 1st major component image.
3. all band Super-Resolution of imaging spectrum
The 1st major component image after Super-Resolution, comprise the high-frequency information about each wave band of this imaging spectrum, the equal interpolation amplification of other each wave bands of imaging spectrum is arrived after identical resolution, through PCA inverse transformation, the high-frequency information that Super-Resolution process can be rebuild returns in all wave bands, realizes the full wave Super-Resolution of imaging spectrum.Experimental result shows, the Super-Resolution algorithm that the present invention proposes, not only can make the resolution of imaging spectrum be significantly improved, and keep the spectral signature of original image that distortion does not occur.
An imaging spectrum Super-Resolution method based on principal component analysis (PCA), comprises the steps:
Step 1, computing machine reads in imaging spectrum from memory device, and whole image represents by the form of a three-dimensional array X.
Step 2, carries out principal component analysis (PCA) to original image, extracts the 1st major component after its conversion, retains all the other compositions for subsequent use simultaneously.The method of original image being carried out to principal component analysis (PCA) is as follows:
Step 2.1, reads in imaging spectrum data X;
Step 2.2, calculates the related coefficient between the each wave band of imaging spectrum X, composition covariance matrix Σ x;
Step 2.3, calculates covariance matrix Σ xeigenwert, and its eigenwert is arranged by order from big to small;
Step 2.4, obtains each eigenwert characteristic of correspondence vector u i;
Step 2.5, asks for PCA transformation matrix U according to proper vector;
Step 2.6, by imaging spectrometer data X and the transformation matrix U major component image Y after conversion that multiplies each other to obtain.
Step 3, carries out Super-Resolution to the 1st major component after PCA conversion, and method is as follows:
Step 3.1, estimates the grey scale mapping parameter of high resolution spatial panchromatic image to imaging spectrum;
(1) by down-sampled high resolution spatial panchromatic image z be z l(representing that with subscript l it is the low-resolution image after down-sampled), makes itself and image the 1st major component image y 1there is identical spatial resolution;
(2) adopt Laplace operator to extract respectively z lhigh frequency details with y image, obtains corresponding detail pictures
Figure BDA0000435359760000041
with
Figure BDA0000435359760000042
(3) calculate average and the variance of each detail pictures, computing formula is:
μ = 1 MN Σ i = 0 M - 1 Σ j = 0 N - 1 E ( i , j ) - - - ( 1 )
σ = 1 MN Σ i = 0 M - 1 Σ j = 0 N - 1 ( E ( i , j ) - μ ) 2 - - - ( 2 )
In formula, E (i, j) expression high frequency detail pictures (i, j) is located the gray-scale value of pixel; μ and σ are corresponding average and variance; M, N be the length and width pixel count of presentation video respectively.
Step 3.2, the high resolving power initial estimate of generation the 1st major component image;
(1) adopt bilinear interpolation method that the 1st major component image is amplified to required size;
(2) high-frequency information of high resolution spatial panchromatic image is carried out to grey scale mapping, and in the 1st major component image being added to after interpolation amplification, obtain the high resolving power estimated image of the 1st major component image, formula is as follows:
y ^ 1 H = y 1 B + [ ( E ( z ) - μ E ( 2 ) ) × σ Ey 1 σ Ez l + μ Ez μ Ey 1 μ Ez l ] 1 / 2 - - - ( 3 )
In formula,
Figure BDA0000435359760000046
for the estimated value of high resolving power major component image; y 1 bfor low resolution major component image y 1image through bilinear interpolation to high resolving power size gained, it provides the low-frequency information of estimating high-definition picture; μ e (z)for the average of extracted panchromatic image high-frequency information E (z).
Figure BDA0000435359760000047
be respectively and utilize formula (1) and (2) to estimate the down-sampled rear panchromatic image of gained and average and the variance of the 1st major component image;
Step 3.3, the MAP that carries out the 1st major component image optimizes estimation;
(1) set up the maximum a posteriori probability estimation model of the 1st major component image:
y ^ 1 = arg max y 1 H log Pr ( y 1 H | y 1 ) = arg max y 1 H { log Pr ( y 1 H ) + log Pr ( y 1 | y 1 H ) } - - - ( 4 )
In formula,
Figure BDA0000435359760000049
be illustrated in known low-resolution image y 1time, high-definition picture
Figure BDA00004353597600000410
posterior probability.
Figure BDA00004353597600000411
for the prior distribution of high-definition picture, adopt Huber-Markov model description.Conditional probability
Figure BDA00004353597600000412
reflect
Figure BDA00004353597600000413
the low resolution estimated image of down-sampled rear gained and actual low-resolution image y 1between error distribute, can think Gaussian distributed, that is:
Pr ( y 1 | y 1 H ) = 1 2 π N 1 N 2 2 σ MN exp { - 1 2 σ 2 | | y 1 - Dy 1 H | | } - - - ( 5 )
In formula, M, N represent respectively low-resolution image y 1ranks number of pixels.σ is the variance that error distributes.D is down-sampled matrix, and it has described ccd sensor averaging process on certain area in image acquisition procedures.That is:
y ^ 1 = 1 q 2 ( Σ r = qi - q + 1 qi Σ s = qj - q + 1 qj y 1 H ) - - - ( 6 )
In formula, q is down-sampled coefficient.
(2) by the high resolving power estimated value of the 1st major component image
Figure BDA0000435359760000052
substitution formula (4), adopts method of Lagrange multipliers iterative, obtains the Super-Resolution result of the 1st major component image after the satisfied appointment condition of convergence
Figure BDA0000435359760000053
Step 4, carries out all band super-resolution rebuilding of imaging spectrum, and method is as follows:
Step 4.1, carries out bilinear interpolation successively to other the each wave band after PCA conversion;
Step 4.2 is carried out PCA inverse transformation together with other composition of the 1st major component after Super-Resolution and interpolation amplification, obtains all band image after Super-Resolution.
Step 5, the imaging spectrum after Super-Resolution outputs to buffer, for follow-up analysis and application;
Step 6, after above EO, closes imaging spectrum file.
Compared with prior art, the present invention has the following advantages:
The inventive method converts by PCA, and the effective information of imaging spectrum is concentrated on to the 1st major component, has only reached by the Super-Resolution of the 1st major component the effect that improves all wave band spatial resolutions, and operand is lower; Utilize the correlativity between rear the 1st major component of PCA conversion and panchromatic image, by setting up grey scale mapping model, realize the mapping of panchromatic image high-frequency information to the 1 major component image, and further improve the quality of rebuilding high-frequency information by MAP constrained optimization, both taken full advantage of the high-frequency information of panchromatic image, avoid again the introducing of error message, guaranteed to rebuild the quality of high-definition picture; The reconstruction of all band high-frequency information is deduced by the 1st major component image, the spectrum problem of dtmf distortion DTMF of effectively having avoided each wave band independently to produce.Experimental result shows, the high-resolution imaging spectrum picture that adopts the inventive method to obtain, and with compared with band dual linear interpolation method, its PSNR value improves 1~2dB; Compared with traditional HIS image interfusion method, each wave band PNSR value improves 5~7dB; Compared with PCA major component replacement method, PSNR value improves 3~4dB.From subjective quality, the spatial resolution of image has not only obtained significant lifting, and spectrum hold facility also is significantly better than contrasting algorithm.
Accompanying drawing explanation
Fig. 1 is the imaging spectrum Super-Resolution method structured flowchart based on principal component analysis (PCA);
Fig. 2 is algorithm of the present invention and the PSNR value comparison diagram that contrasts algorithm;
Fig. 3 is that algorithm of the present invention contrasts with the subjective quality of contrast algorithm: be (a) high resolution spatial panchromatic image of reference, (b) be the pseudo-color image of original high resolving power multiband, (c)~(f) be respectively the experimental result of bilinear interpolation, HIS method, PCA major component Shift Method and the method for the invention.
Embodiment
Below in conjunction with Figure of description, embodiments of the invention are described in detail.
First completed the collection of imaging spectrometer data by imaging spectrometer, the optical signalling of target image is converted into data image signal, be stored in collecting device storer; Computing machine reads in image by existing USB, the interface such as infrared, in processor, carry out the imaging spectrum Super-Resolution based on principal component analysis (PCA), acquired results is directly stored in local hard drive, for further analysis and processing to imaging spectrum.
Fig. 1 is shown in by general structure block diagram of the present invention, mainly comprises the steps:
Step 1, computing machine reads in imaging spectrum from memory device, and whole image represents with a three-dimensional array X;
Step 2, carries out PCA conversion to imaging spectrum, and method is as follows:
Step 2.1, reads in imaging spectrum data X;
Step 2.2, calculates the related coefficient between the each wave band of imaging spectrum X, composition covariance matrix Σ x;
Step 2.3, separate secular equation:
(λI-Σ x)u=0 (7)
Obtain matrix Σ xeigenvalue λ i(i=0,1...n), in formula, λ is eigenwert, and I is unit matrix, and u is proper vector.And its eigenwert is arranged by order from big to small;
Step 2.4, obtains each eigenwert characteristic of correspondence vector u i
u i=[u 1i,u 2i...u ni] T (8)
Step 2.5, get transformation matrix:
A = U T = u 11 u 12 . . . u 1 n u 21 u 22 . . . u 2 n . . . . . . . . . . . . u n 1 u n 2 . . . u nn - - - ( 9 )
Step 2.6, by imaging spectrometer data X and the transformation matrix U major component image Y after conversion that multiplies each other to obtain.
Obtain the expression of PCA conversion:
Y = u 11 u 12 . . . u 1 n u 21 u 22 . . . u 2 n . . . . . . . . . . . . u n 1 u n 2 . . . u nn X = U T X - - - ( 10 )
In formula, Y represents the result after conversion.
After PCA, obtain one group of new image, they are called as the 1st major component successively, the 2nd major component ..., n major component.According to the principle of PCA conversion, each component of the image Y obtaining after conversion is actually the linear combination of each component information of original image X, it combines the information of original each feature rather than simply accepts or rejects, thereby makes new n n dimensional vector n can better react the feature of original image.
Step 3, carries out Super-Resolution to the 1st major component after PCA conversion, and method is as follows:
Step 3.1, estimates the grey scale mapping parameter of high resolution spatial panchromatic image to imaging spectrum;
(1) by down-sampled high resolution spatial panchromatic image z be z l, make itself and image the 1st major component image y 1there is identical spatial resolution;
(2) adopt Laplace operator to extract respectively the high frequency details of each two field picture, obtain corresponding detail pictures
Figure BDA0000435359760000071
with
Figure BDA0000435359760000072
(3) utilize formula (1), (2) to calculate respectively average and the variance of each detail pictures.
Step 3.2, the high resolving power initial estimate of generation the 1st major component image;
(1) adopt bilinear interpolation method that the 1st major component image is amplified to required size;
(2) according to formula (3), the high-frequency information of high resolution spatial panchromatic image is carried out to grey scale mapping, and in the 1st major component image being added to after interpolation amplification, obtain the high resolving power estimated image of the 1st major component image.
Step 3.3, the MAP that carries out the 1st major component image optimizes estimation;
In order further to improve the fidelity of rebuilding high resolving power major component image, the image quality decrease of avoiding mapping error to cause, needs further the high-definition picture of initial estimation is retrained and optimized.The high resolving power estimated image that the present invention rebuilds said method, as initial value, is introduced maximum a posteriori probability framework and is is further optimized and revised, and concrete steps are as follows:
(1) set up the maximum a posteriori probability estimation model of the 1st major component image, as formula (4);
(2) by the high resolving power estimated value of the 1st major component image
Figure BDA0000435359760000073
substitution formula (4), adopts method of Lagrange multipliers iterative, obtains the Super-Resolution result of the 1st major component image after the satisfied appointment condition of convergence
Figure BDA0000435359760000074
Step 4, all band super-resolution rebuilding of imaging spectrum, method is as follows:
Step 4.1, carries out bilinear interpolation successively to other the each wave band after PCA conversion;
Step 4.2 is carried out PCA inverse transformation together with other composition of the 1st major component after Super-Resolution and interpolation amplification, obtains all band image after Super-Resolution.
Step 5, outputs to buffer by compressed bit stream, is directly stored in local hard drive, for follow-up imaging spectrum analysis and processing.
Step 6, closes original imaging spectrum file, closes Super-Resolution program.
Provide an application example of the present invention below.
Test pattern is one group of remote sensing image Brest that SPOT satellite high resolving power multiband scanner (HRV) obtains, and intercepts wherein three width subimage Brest1-Brest3 and is used for test.This image comprises two kinds of panchromatic and multibands.Wherein the spectral response range of panchromatic wave-band is 0.51~0.73 micron, and spatial resolution is 10 meters; Multiband responding range is respectively 0.50~0.59 micron (green), 0.61~0.68 micron (red) and 0.79~0.89 micron (near infrared), and spatial resolution is 20 meters.It is mainly to read in by existing USB interface or the network storage equipment image collecting that computing machine is processed, and is deposited into hard disk, and the Super-Resolution of multispectral image is realized by software.
For the objective reconstruction effect of verification algorithm, in experiment, first two groups of images are carried out respectively 2 times down-sampled, and then the high-frequency information that utilizes high resolving power panchromatic wave-band rebuilds high-resolution multi-band image, and Y-PSNR PSNR by image is as the objective indicator of measure algorithm performance.
Table 1 has provided the result that adopts the method for the invention and bilinear interpolation, PCA major component Shift Method, method based on IHS to test above-mentioned three width subimages, and its PSNR value correlation curve is shown in accompanying drawing 2.Experimental result shows, the PSNR value that the present invention rebuilds image is all rebuild the PSNR value of image higher than other several method, illustrate that the high-definition picture that the present invention rebuilds is more close with original down-sampled image before, there is better Super-Resolution performance, can rebuild better original high-definition picture.
Table 1 algorithms of different PSNR (dB) is worth relatively
Fig. 3 has provided subjective experiment result, the high resolution spatial panchromatic image that wherein Fig. 3 (a) is reference, Fig. 3 (b) is the pseudo-color image of original high resolving power multiband, and Fig. 3 (c)~(f) is respectively that bilinear interpolation, IHS, PCA major component are replaced and the experimental result of the method for the invention.From figure, can clearly be seen that, it is very fuzzy that two-wire interpolation amplification image is compared former figure, do not increase the details of image, and amplification effect is undesirable; Fig. 3 (d) is the result that the amplification based on HIS obtains, and can find out, although image detail has obtained increase, its color has significant variation, and change has occurred its spectral characteristic.Fig. 3 (e) is major component Shift Method, and panchromatic image is directly replaced the 1st major component after simple grey scale mapping, rebuilds image when details increases, and variation has also occurred color.And scheme the result that the inventive method shown in (f) obtains, and not only effectively increasing the detail of the high frequency of image, and retained well the spectral characteristic of original image, the color of pcolor does not change.

Claims (4)

1. the imaging spectrum Super-Resolution method based on principal component analysis (PCA), is completed the collection of imaging spectrometer data, and the optical signalling of pending image is converted into data image signal by imaging spectrometer, is stored in collecting device storer; Read in image by USB, infrared interface, in processor, carry out the imaging spectrum Super-Resolution based on principal component analysis (PCA); It is characterized in that: by principal component analysis (PCA), the main information of imaging spectrum is concentrated on to its 1st major component, by the Super-Resolution to the 1st major component, realize the full wave Super-Resolution of imaging spectrum; Comprise the following steps:
Step 1, computing machine reads in imaging spectrum from memory device, and whole image represents by the form of a three-dimensional array X;
Step 2, carries out principal component analysis (PCA) PCA to original image, extracts the 1st major component after its conversion, retains all the other compositions for subsequent use simultaneously; The method of original image being carried out to PCA conversion is as follows:
(1) read in imaging spectrum data X;
(2) calculate the related coefficient between the each wave band of imaging spectrum X, composition covariance matrix Σ x;
(3) calculate covariance matrix Σ xeigenwert, and its eigenwert is arranged by order from big to small;
(4) obtain each eigenwert characteristic of correspondence vector u i;
(5) ask for PCA transformation matrix U according to proper vector;
(6) the major component image Y after conversion that imaging spectrometer data X and transformation matrix U multiplied each other to obtain;
Step 3, carries out Super-Resolution to the 1st major component after PCA conversion;
Step 3.1, estimates the grey scale mapping parameter of high resolution spatial panchromatic image to imaging spectrum;
Step 3.2, the high resolving power initial estimate of generation the 1st major component image;
Step 3.3, carries out the maximum a posteriori probability optimization of the 1st major component image and estimates;
Step 4, carries out all band super-resolution rebuilding of imaging spectrum;
Step 4.1, carries out bilinear interpolation successively to other the each composition after PCA conversion;
Step 4.2 is carried out PCA inverse transformation together with other composition of the 1st major component after Super-Resolution and interpolation amplification, obtains all band image after Super-Resolution;
Step 5, the imaging spectrum after Super-Resolution outputs to buffer, for follow-up analysis and application;
Step 6, after above EO, closes imaging spectrum file.
2. a kind of imaging spectrum Super-Resolution method based on principal component analysis (PCA) according to claim 1, is characterized in that, described step 3 high resolution spatial panchromatic image is as follows to the method for estimation of the grey scale mapping parameter of imaging spectrum:
(1) by down-sampled high resolution spatial panchromatic image z be z l, make itself and image the 1st major component image y 1there is identical spatial resolution, z lsubscript l represent that it is the low-resolution image after down-sampled;
(2) adopt Laplace operator to extract respectively z lhigh frequency details with y image, obtains corresponding detail pictures
Figure FDA0000435359750000011
with
Figure FDA0000435359750000012
(3) calculate average and the variance of each detail pictures, computing formula is:
μ = 1 MN Σ i = 0 M - 1 Σ j = 0 N - 1 E ( i , j ) - - - ( 1 )
σ = 1 MN Σ i = 0 M - 1 Σ j = 0 N - 1 ( E ( i , j ) - μ ) 2 - - - ( 2 )
In formula, E (i, j) expression high frequency detail pictures (i, j) is located the gray-scale value of pixel; μ and σ are corresponding average and variance; M, N be the length and width pixel count of presentation video respectively.
3. a kind of imaging spectrum Super-Resolution method based on principal component analysis (PCA) according to claim 1, is characterized in that, the method for high resolving power initial estimate that described step 3 generates the 1st major component image is as follows:
(1) adopt bilinear interpolation method that the 1st major component image is amplified to required size;
(2) high-frequency information of high resolution spatial panchromatic image is carried out to grey scale mapping, and in the 1st major component image being added to after interpolation amplification, obtain the high resolving power estimated image of the 1st major component image, formula is as follows:
y ^ 1 H = y 1 B + [ ( E ( z ) - μ E ( 2 ) ) × σ Ey 1 σ Ez l + μ Ez μ Ey 1 μ Ez l ] 1 / 2 - - - ( 3 )
In formula, for the estimated value of high resolving power the 1st major component image; y 1 bfor low resolution the 1st major component image y 1image through bilinear interpolation to high resolving power size gained, it provides the low-frequency information of estimating high-definition picture; μ e (z)for the average of extracted panchromatic image high-frequency information E (z);
Figure FDA0000435359750000026
be respectively and utilize formula (1) and (2) to estimate the down-sampled rear panchromatic image of gained and average and the variance of the 1st major component image.
4. a kind of imaging spectrum Super-Resolution method based on principal component analysis (PCA) according to claim 1, is characterized in that, described step 3 carry out the 1st major component image maximum a posteriori probability optimization estimate method as follows:
(1) set up the maximum a posteriori probability estimation model of the 1st major component image:
y ^ 1 = arg max y 1 H log Pr ( y 1 H | y 1 ) = arg max y 1 H { log Pr ( y 1 H ) + log Pr ( y 1 | y 1 H ) } - - - ( 4 )
In formula,
Figure FDA0000435359750000028
be illustrated in known low-resolution image y 1time, high-definition picture
Figure FDA0000435359750000029
posterior probability;
Figure FDA00004353597500000210
for the prior distribution of high-definition picture, adopt Huber-Markov model description; Conditional probability
Figure FDA00004353597500000211
reflect
Figure FDA00004353597500000212
the low resolution estimated image of down-sampled rear gained and actual low-resolution image y 1between error distribute, can think Gaussian distributed, that is:
Pr ( y 1 | y 1 H ) = 1 2 π N 1 N 2 2 σ MN exp { - 1 2 σ 2 | | y 1 - Dy 1 H | | } - - - ( 5 )
In formula, M, N represent respectively low-resolution image y 1ranks number of pixels; σ is the variance that error distributes; D is down-sampled matrix, and it has described ccd sensor averaging process on certain area in image acquisition procedures; That is:
y ^ 1 = 1 q 2 ( Σ r = qi - q + 1 qi Σ s = qj - q + 1 qj y 1 H ) - - - ( 6 )
In formula, q is down-sampled coefficient;
(2) by the high resolving power estimated value of the 1st major component image
Figure FDA0000435359750000032
substitution formula (4), adopts method of Lagrange multipliers iterative, obtains the Super-Resolution result of the 1st major component image after the satisfied appointment condition of convergence
Figure FDA0000435359750000033
CN201310676634.4A 2013-12-11 2013-12-11 A kind of imaging spectrum Super-Resolution method based on principal component analysis Active CN103793883B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310676634.4A CN103793883B (en) 2013-12-11 2013-12-11 A kind of imaging spectrum Super-Resolution method based on principal component analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310676634.4A CN103793883B (en) 2013-12-11 2013-12-11 A kind of imaging spectrum Super-Resolution method based on principal component analysis

Publications (2)

Publication Number Publication Date
CN103793883A true CN103793883A (en) 2014-05-14
CN103793883B CN103793883B (en) 2016-11-09

Family

ID=50669509

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310676634.4A Active CN103793883B (en) 2013-12-11 2013-12-11 A kind of imaging spectrum Super-Resolution method based on principal component analysis

Country Status (1)

Country Link
CN (1) CN103793883B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105354802A (en) * 2015-10-23 2016-02-24 哈尔滨工业大学 Hyperspectral image continuous spectrum section recovery method based on bidirectional gradient prediction
CN107871307A (en) * 2017-07-19 2018-04-03 苏州闻捷传感技术有限公司 full-colour image sharpening method based on spatial probability PCA and NSCT
CN108090872A (en) * 2017-12-18 2018-05-29 武汉大学 Single frames multispectral image super resolution ratio reconstruction method and system based on gradient extraction
CN108288256A (en) * 2018-01-31 2018-07-17 中国科学院西安光学精密机械研究所 A kind of multispectral mosaic image restored method
CN108491869A (en) * 2018-03-14 2018-09-04 北京师范大学 A kind of principal component transform remote sensing image fusion method that panchromatic wave-band gray value adaptively inverts
CN109213753A (en) * 2018-08-14 2019-01-15 西安理工大学 A kind of industrial system monitoring data restoration methods based on online PCA
CN109379532A (en) * 2018-10-08 2019-02-22 长春理工大学 A kind of calculating imaging system and method
CN114266957A (en) * 2021-11-12 2022-04-01 北京工业大学 Hyperspectral image super-resolution restoration method based on multi-degradation mode data augmentation

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4638371A (en) * 1985-03-11 1987-01-20 Eastman Kodak Company Multiple exposure of area image sensor having a sparse array of elements
CN1877636A (en) * 2006-07-03 2006-12-13 中国科学院遥感应用研究所 Method for fusion generation of high-resolution multi-spectral image
CN101930604A (en) * 2010-09-08 2010-12-29 中国科学院自动化研究所 Infusion method of full-color image and multi-spectral image based on low-frequency correlation analysis
CN103049898A (en) * 2013-01-27 2013-04-17 西安电子科技大学 Method for fusing multispectral and full-color images with light cloud

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4638371A (en) * 1985-03-11 1987-01-20 Eastman Kodak Company Multiple exposure of area image sensor having a sparse array of elements
CN1877636A (en) * 2006-07-03 2006-12-13 中国科学院遥感应用研究所 Method for fusion generation of high-resolution multi-spectral image
CN101930604A (en) * 2010-09-08 2010-12-29 中国科学院自动化研究所 Infusion method of full-color image and multi-spectral image based on low-frequency correlation analysis
CN103049898A (en) * 2013-01-27 2013-04-17 西安电子科技大学 Method for fusing multispectral and full-color images with light cloud

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
胡冰等: "遥感图像 PCA融合的并行算法研究与实现", 《微电子学与计算机》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105354802A (en) * 2015-10-23 2016-02-24 哈尔滨工业大学 Hyperspectral image continuous spectrum section recovery method based on bidirectional gradient prediction
CN107871307A (en) * 2017-07-19 2018-04-03 苏州闻捷传感技术有限公司 full-colour image sharpening method based on spatial probability PCA and NSCT
CN108090872A (en) * 2017-12-18 2018-05-29 武汉大学 Single frames multispectral image super resolution ratio reconstruction method and system based on gradient extraction
CN108288256A (en) * 2018-01-31 2018-07-17 中国科学院西安光学精密机械研究所 A kind of multispectral mosaic image restored method
CN108288256B (en) * 2018-01-31 2020-07-31 中国科学院西安光学精密机械研究所 Multispectral mosaic image restoration method
CN108491869A (en) * 2018-03-14 2018-09-04 北京师范大学 A kind of principal component transform remote sensing image fusion method that panchromatic wave-band gray value adaptively inverts
CN109213753A (en) * 2018-08-14 2019-01-15 西安理工大学 A kind of industrial system monitoring data restoration methods based on online PCA
CN109213753B (en) * 2018-08-14 2022-01-07 西安理工大学 Industrial system monitoring data recovery method based on online PCA
CN109379532A (en) * 2018-10-08 2019-02-22 长春理工大学 A kind of calculating imaging system and method
CN109379532B (en) * 2018-10-08 2020-10-16 长春理工大学 Computational imaging system and method
CN114266957A (en) * 2021-11-12 2022-04-01 北京工业大学 Hyperspectral image super-resolution restoration method based on multi-degradation mode data augmentation

Also Published As

Publication number Publication date
CN103793883B (en) 2016-11-09

Similar Documents

Publication Publication Date Title
CN103793883A (en) Principal component analysis-based imaging spectral image super resolution restoration method
CN110119780B (en) Hyper-spectral image super-resolution reconstruction method based on generation countermeasure network
Han et al. SSF-CNN: Spatial and spectral fusion with CNN for hyperspectral image super-resolution
Zhou et al. Pan-sharpening with customized transformer and invertible neural network
RU2626184C2 (en) Method, device and system for reconstructing magnetic resonance image
CN109727207B (en) Hyperspectral image sharpening method based on spectrum prediction residual convolution neural network
CN111127374A (en) Pan-sharing method based on multi-scale dense network
CN104123705B (en) A kind of super-resolution rebuilding picture quality Contourlet territory evaluation methodology
CN105139339A (en) Polarization image super-resolution reconstruction method based on multi-level filtering and sample matching
CN103886559B (en) Spectrum image processing method
CN112767243B (en) Method and system for realizing super-resolution of hyperspectral image
US20030016877A1 (en) System and method for demosaicing raw data images with compression considerations
CN101216557B (en) Residual hypercomplex number dual decomposition multi-light spectrum and full-color image fusion method
CN105513033A (en) Super-resolution reconstruction method based on non-local simultaneous sparse representation
CN102436655A (en) Super-resolution reconstruction image quality evaluation method based on SVD (singular value decomposition)
CN105488759A (en) Image super-resolution reconstruction method based on local regression model
CN113139902A (en) Hyperspectral image super-resolution reconstruction method and device and electronic equipment
CN100465661C (en) Multispectral and panchromatic image fusion method of supercomplex principal element weighting
CN104123740A (en) Image reconstruction method based on compressive sensing
Wu et al. Real-world DEM super-resolution based on generative adversarial networks for improving InSAR topographic phase simulation
CN108460723A (en) Bilateral full variation image super-resolution rebuilding method based on neighborhood similarity
CN109615584B (en) SAR image sequence MAP super-resolution reconstruction method based on homography constraint
CN116883799A (en) Hyperspectral image depth space spectrum fusion method guided by component replacement model
CN103186891A (en) Hexagon image reconstruction method based on compressed sensing
CN112989593B (en) High-spectrum low-rank tensor fusion calculation imaging method based on double cameras

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant