CN106157317A - The high-resolution remote sensing image fusion rules method guided based on dispersion tensor - Google Patents
The high-resolution remote sensing image fusion rules method guided based on dispersion tensor Download PDFInfo
- Publication number
- CN106157317A CN106157317A CN201610578249.XA CN201610578249A CN106157317A CN 106157317 A CN106157317 A CN 106157317A CN 201610578249 A CN201610578249 A CN 201610578249A CN 106157317 A CN106157317 A CN 106157317A
- Authority
- CN
- China
- Prior art keywords
- image
- remote sensing
- fusion
- sampling
- tensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000004927 fusion Effects 0.000 title claims abstract description 45
- 239000006185 dispersion Substances 0.000 title claims abstract description 19
- 230000008569 process Effects 0.000 claims abstract description 34
- 238000005070 sampling Methods 0.000 claims abstract description 34
- 238000011156 evaluation Methods 0.000 claims abstract description 27
- 238000010219 correlation analysis Methods 0.000 claims abstract description 6
- 230000006870 function Effects 0.000 claims description 12
- 238000004422 calculation algorithm Methods 0.000 claims description 11
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000001228 spectrum Methods 0.000 claims description 8
- 238000005457 optimization Methods 0.000 claims description 7
- 238000002156 mixing Methods 0.000 claims description 6
- 238000007621 cluster analysis Methods 0.000 claims description 5
- 238000009792 diffusion process Methods 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 4
- 238000012549 training Methods 0.000 claims description 3
- 241000208340 Araliaceae Species 0.000 claims 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 1
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 1
- 235000008434 ginseng Nutrition 0.000 claims 1
- 230000008901 benefit Effects 0.000 abstract description 6
- 230000009471 action Effects 0.000 abstract description 2
- 230000000875 corresponding effect Effects 0.000 description 9
- 238000007500 overflow downdraw method Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 3
- 230000003595 spectral effect Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000013178 mathematical model Methods 0.000 description 2
- 238000013441 quality evaluation Methods 0.000 description 2
- VMXUWOKSQNHOCA-UKTHLTGXSA-N ranitidine Chemical compound [O-][N+](=O)\C=C(/NC)NCCSCC1=CC=C(CN(C)C)O1 VMXUWOKSQNHOCA-UKTHLTGXSA-N 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 108010038083 amyloid fibril protein AS-SAM Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000556 factor analysis Methods 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 229910052500 inorganic mineral Inorganic materials 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 239000011707 mineral Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/60—Memory management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/14—Transformations for image registration, e.g. adjusting or mapping for alignment of images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
- G06T2207/10036—Multispectral image; Hyperspectral image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
- G06T2207/10041—Panchromatic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20021—Dividing image into blocks, subimages or windows
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30181—Earth observation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
The present invention provides a kind of high-resolution remote sensing image fusion rules method guided based on scattered tensor, including by multispectral image and the panchromatic image piecemeal through Image registration, anisotropic model is taked to carry out the up-sampling of dispersion tensor guiding, select Remote Sensing Image Fusion, GPU parallel computation is used to accelerate, Remote Sensing Image Fusion evaluation index correlation analysis.The present invention can regulate the dispersion tensor model action intensity to image pixel by parameter in upsampling process so that edge-protected and removal noise reaches balance according to the actual requirements;Up-sampling is not affected by image quality such as the bright contrasts of raw video, makes superimposed image the most corresponding, it is to avoid in the false structure phenomenon of adjacent edges pixel.Further, propose universal model and summarize convergence strategy, by correlation analysis overall merit gained fusion evaluation quality;Give full play to existing equipment performance, utilize the calculating advantage multiple threads that GPU intensity is big.
Description
Technical field
The invention belongs to Remote Sensing Image Fusion technical field, particularly relate to a kind of high-resolution based on dispersion tensor guiding distant
Sense image up-sampling fusion method.
Background technology
Multi-spectrum remote sensing image plays an important role, yet with radiation in fields such as agricultural, forest, mineral reserve, environment
Transmitting procedure and the restriction of sensor process, its spatial resolution is relatively low, it is impossible to preferably obtain ground object detail.On the other hand,
High Resolution Remote Sensing Satellites can obtain the earth observation of sub-meter grade, and its image but can only provide the information of panchromatic wave-band.Therefore,
Satellite platform carries multispectral and panchromatic high sub sensor the most simultaneously, by the means of the visual fusion multispectral letter to ground
Breath and detailed information carry out the most comprehensive, provide more valuable data for subsequent applications.
Visual fusion general flow includes that multispectral image up-sampling, image conversion, Gray-scale Matching, composition are replaced and image
Inverse transformation.Existing research shows, the most most visual fusion algorithms are keeping fusion evaluation multispectral with original as far as possible
While image spectral signature is consistent, the representability of its spatial detail has and to a certain degree declines.Reason is, most methods
Need multispectral image is upsampled in pre-treatment step the resolution consistent with panchromatic image, but conventional up-sampling
Method does not accounts for multispectral image and panchromatic image in concordance geometrically, causes superimposed image not have the most right
Should, near atural object edge and tiny atural object, false structure often occurs.
Existing remote sensing image obtains platform towards many stars, multisensor, high spatial resolution, high spectral resolution and short time
Visiting the periodic development, causing the remotely-sensed data obtained is geometric growth, and traditional CPU multiple programming cannot meet application system
The efficiency that data are processed and the requirement of precision.
Therefore this area urgently can practical related art scheme occur.
Summary of the invention
The problem existed for prior art, the present invention proposes a kind of high-resolution remote sensing image guided based on scattered tensor
Fusion rules method.
Technical solution of the present invention provides a kind of high-resolution remote sensing image fusion rules method guided based on scattered tensor, bag
Include following steps:
Step 1, by multispectral image and panchromatic image piecemeal through Image registration;
Step 2, up-sampling, including following sub-step,
Step 2.1, selects a pair image blocks to be fused, for training parameter from step 1 acquired results;According to presetting
Parameter alpha, β and γ initial value, take anisotropic model to carry out the up-sampling of dispersion tensor guiding, self-adapting detecting is to be fused
Image edge also uses least square fitting;
When taking the up-sampling that anisotropic model carries out dispersion tensor guiding, below equation is utilized to describe multispectral remote sensing
The point diffusion of image and upsampling process,
M (k)=X (k) D A (k)
K=1 ..., K
Wherein, variable k is the band number of multispectral image, and K is the wave band number participating in merging, and M is original multispectral
Image, X is the high-resolution estimated value of multispectral image, and A is the conversion that two-dimensional points spread function is corresponding, and D is two dimension up-sampling
The conversion that process is corresponding;
Use Gaussian filter to smooth original panchromatic image, be calculated gradient direction n=d/ | | d | | of each pixel
And gradient intensity | | d | |, wherein d is the gradient vector calculated;When gradient is zero, it is stipulated that n=[1,0]T, it is to avoid ladder
Spend the not qualitative of direction;
The dispersion tensor t defining each pixel is as follows,
Wherein, d⊥It is defined as vertical with gradient vector d, i.e. the vector in grey scale change minimum direction, dT、It is respectively vector
d、d⊥Turn order, edge-protected function w is
W=exp (-β | | d | |γ)
Tensor model is used for energy function optimization, obtains
K=1 ..., K
Wherein, S=D A, G are the matrixing that gradient operator is corresponding, and T is the dispersion tensor t diagonal angle arrangement group of each pixel
The gray scale tensor matrix become, α is the weights of anisotropy canonical constraint, and X is for treating that solution seeks image, and M is original multispectral image;
X*For gained fusion evaluation, K is the wave band number participating in merging;
Based on linear least square formula, it is calculated as follows,
X*=(STS+αGTTG)-1STM
By solving double optimization problem by wave band, obtain the multispectral image of up-sampling;
Step 2.2, carries out objective indicator evaluation, if precision optimum then enters step 3, otherwise enters step 2.3;
Step 2.3, regulates parameter alpha, the current value of β and γ, returns step 2.1;
Step 3, selects Remote Sensing Image Fusion;
Step 4, uses GPU parallel computation to accelerate, with Form generation and the holding fusion results of block, including reading and process
The same number of data block is to internal memory, and each process processes a pair graph block to be fused respectively;
Step 5, Remote Sensing Image Fusion evaluation index correlation analysis, it is correlated with including factor-cluster analysis objective evaluation index
Property, choose independent evaluation index overall merit fusion results precision from many aspects.
And, in step 3,
If the multispectral image M up-sampling after registration is expressed as follows to the process that resolution is identical with panchromatic image,
ML=usp (M)
Wherein, usp () represents up-sampling algorithm, MLFor the result of up-sampling, useWithRepresent fusion respectively
Multispectral image front and back, uses pan(i,j)Represent the panchromatic image participating in merging, represent the wave band participating in merging, (i, j) table with k
Show image pixel position;
The universal model proposing remote sensing image Pixel-level blending algorithm is as follows,
Wherein, convergence strategy F(k,i,j)Represent, panchromatic image pan(i,j)Each pixel is (i, j) high frequency spatial of position is thin
Joint information S(i,j)Represent.
Compared to the prior art, the invention have the advantages that and beneficial effect:
(1) upsampling process can regulate dispersion tensor model pair by regulating the value of tri-independent parameters of β, γ, α
The action intensity of image pixel so that edge-protected and removal noise reaches balance according to the actual requirements.Up-sampling is not by original
The impact of the image quality such as the bright contrast of image, can save remote sensing image preprocessing process.The up-sampling result of gained is taken into account many
Spectrum image and panchromatic image, in concordance geometrically, make superimposed image the most corresponding, it is to avoid in adjacent edges pixel
False structure phenomenon.
(2) convergence strategy that universal model is summarized can reflect that spectrum is kept by each blending algorithm and spatial detail increases clearly
Strong difference lays particular stress on.The evaluation index chosen by correlation analysis is separate, can melt from different dimensions overall merit gained
Close the quality of image.
(3) give full play to existing equipment performance, be different from traditional method, the present embodiment by the up-sampling of multispectral image and
Fusion process distributes to GPU, utilizes the calculating advantage multiple threads that GPU intensity is big, operation time can be greatly decreased.And image
Piecemeal can avoid large format image cannot read in memory problem.
Accompanying drawing explanation
Fig. 1 is the flow chart of the embodiment of the present invention.
Detailed description of the invention
Below by embodiment, and combine accompanying drawing, technical scheme is described in further detail.
Seeing Fig. 1, the embodiment of the present invention provides a kind of high-resolution remote sensing image fusion rules method that scattered tensor guides,
Comprise the following steps:
Step 1, by multispectral image and panchromatic image piecemeal through Image registration, the image blocks size of multispectral image
It is 512 × 512 pixels, the image blocks of panchromatic image a size of 2048 × 2048 pixel.The image blocks of multispectral image and panchromatic
The image blocks one_to_one corresponding of image.Input data rigid registrations in embodiment, can create storage file to be fused, will
Multispectral and each wave band data of panchromatic image is stored in file by piecemeal result, it is simple to follow-up convergence strategy modularity multiplexing.
Step 2, up-sampling, including following sub-step:
Step 2.1, selects a pair image blocks to be fused, in order to training parameter from step 1 acquired results;According to presetting
Parameter alpha, β and γ initial value, use dispersion tensor guide top sampling method (disffusion tensor driven,
DTD), use anisotropy it is assumed that self-adapting detecting image edge to be fused use least square fitting, keep how light
The edge concordance of spectrum image and panchromatic image simultaneously, improves quality and the details representability of follow-up fusion evaluation.
When being embodied as, can split the image blocks of multispectral image and the image blocks of panchromatic image of gained from step 1,
Specified or randomly select a pair corresponding image blocks in position by user.Initial parameter value α=0.5 that the present embodiment is recommended, β=
50, γ=1.5.
Step 2.2, carries out objective indicator evaluation, if precision optimum then enters step 3, otherwise enters step 2.3;
The objective evaluation indexs such as SAM, RMSE, UIQI, PSNR, SD can be used according to the actual requirements when being embodied as.
Step 2.3, regulates parameter alpha, the current value of β and γ, returns step 2.1.When being embodied as, people in the art
Member the regulation step-length of sets itself regulative mode, such as α, β and γ can be respectively 0.1,1,0.1, can increase according to practical situation
Or reduce.
The DTD top sampling method that embodiment provides, it is achieved be described as follows:
When taking the up-sampling that anisotropic model carries out dispersion tensor guiding, below equation is utilized to describe multispectral remote sensing
The point diffusion of image and upsampling process.
M (k)=X (k) D A (k)
K=1 ..., K
Wherein, variable k is the band number of multispectral image, K be participate in merge wave band number, M be registration after original
Multispectral image, X is the high-resolution estimated value of multispectral image, and A is the conversion that two-dimensional points spread function is corresponding, and D is two dimension
The conversion that upsampling process is corresponding.Two conversion are all linear, and this linear equation system is used for describing high-resolution scene and exists
The process of multispectral image is obtained after sensor occurring some diffusion and sampling with low resolution.
A Gaussian filter is used to smooth original panchromatic image, to weaken the noise impact on gradient calculation.Calculate
To gradient direction n=d/ | | d | | and gradient intensity | | d | | of each pixel, wherein d is the gradient vector calculated.For gradient
It is the situation of zero (perfectly homogenous), it is stipulated that n=[1,0]T, it is to avoid gradient direction not qualitative.
For the region of clear-cut margin, adaptive smooth can correspondingly reduce constraint strength.Anisotropy parameter tensor
The key concept processed as partial differential equation remote sensing image, has the strongest suitability for this problem.Define each pixel
Dispersion tensor t:
Wherein, d⊥It is defined as vertical with gradient vector d, i.e. the vector in grey scale change minimum direction, dT It is respectively vector d
d⊥Turn order, edge-protected function w is
W=exp (-β | | d | |γ)
When both sides of edges gray scale difference is the biggest, and the value of w is the least, i.e. smoothness constraint is the most weak.By arranging taking of parameter beta and γ
Value can make bound term that the edge exceeding prescribed strength is just occurred significant response.
Tensor model is used for energy function optimization, obtains:
K=1 ..., K
Wherein S=D A, D, A point the most above spreads and up-sampling function, and G is the matrix that gradient operator is corresponding
Conversion, T is the gray scale tensor matrix that the dispersion tensor t diagonal angle of each pixel rearranges, and α is the power of anisotropy canonical constraint
Value, X is for treating that solution seeks image, and M is original multispectral image.X*For gained fusion evaluation, K is the wave band number participating in merging.
Above formula is classical quadratic programming problem, has globally optimal solution, makes the residual error tried to achieve minimum, i.e. linear least-squares
Problem, calculating process is given by:
X*=(STS+αGTTG)-1STM
The gray scale tensor matrix T full rank of definition, therefore inverse matrix exists.By solving double optimization problem by wave band,
Multispectral image to up-sampling.This fusion evaluation result both account for the blurring effect of a diffusion process, also maintains with high
The edge concordance of resolution panchromatic wave band.The false structure phenomenon of edge can be reduced largely, it is to avoid follow-up fusion is grasped
The high frequency panchromatic image information caused owing to edge is unjustified in work injects mistake phenomenon.
The disperse process of embodiment anisotropic describes multi-spectrum remote sensing image pixel and high resolution spatial panchromatic image
Many-one relationship between pixel.Detect edge by calculating multi-spectrum remote sensing image pixel grey scale gradient, build dispersion tensor,
For the detection of high-resolution remote sensing image edge details, for taking different up-sampling strategies to provide judgement to depend at subsequent edges
According to.Tensor model is used for energy function optimization, it is thus achieved that the solution that all band residual error is minimum, improves the precision of image edge matching.
Step 3, choosing of Remote Sensing Image Fusion: analyze the mathematical model of conventional blending algorithm, and every objective
Dependency between evaluation index, constitutes a set of OO Remote Sensing Image Fusion system, can be by actual demand to spectrum
Keep the difference strengthened with space to lay particular stress on and select fusion method flexibly.
Use universal model to summarize convergence strategy, select spectral information holding and spatial detail to strengthen according to practical situation
Difference lays particular stress on.
If through step 2 will after registration original multispectral image M up-sampling to the resolution process identical with panchromatic image,
Can be expressed as:
ML=usp (M)
Usp () represents up-sampling algorithm, MLFor the result of up-sampling, useWithRepresent respectively before and after merging
Multispectral image, uses pan(i,j)Representing the panchromatic image participating in merging, represent the wave band participating in merging with k, (i j) represents image
Location of pixels.It is proposed that the universal model of remote sensing image Pixel-level blending algorithm:
In above formula, convergence strategy F(k,i,j)Represent, panchromatic image pan(i,j)Each pixel is in (i, j) high frequency spatial of position
Detailed information S(i,j)Represent.
The foundation of universal model can compare advantage and the limitation of various convergence strategy clearly, when choosing integration program
Thought is clear.Final fusion results is by the convergence strategy coefficient F used(k,i,j)With the high frequency spatial detailed information parameter extracted
S(i,j)Both together decide on.
Analyze fusion parameters F(k,i,j)And S(i,j)During may need use information have: participate in merge multispectral
The each band class information of remote sensing image;Panchromatic image (i, j) positional information of pixel;And (i, j) the neighborhood territory pixel letter that may use
Breath and statistical information based on the overall situation.
Remote Sensing Image Fusion universal model is following 2 points at the Heterosis of application aspect: one is advantageous for summarizing difference
The mathematical thought of blending algorithm, it is simple to for respective advantage on-demand selection convergence strategy in follow-up fusion;Two is at algorithm
Execution aspect be conducive to the integrated of module and multiplexing.
Such as following three kinds of fusion methods:
A. fusion method based on variable replacement
In fusion method based on variable replacement, S(i,j)Can be summarized as the high frequency detail letter of the high score panchromatic wave-band extracted
Breath, generally by panchromatic wave-band rectangular histogram change strengthen or after orthogonal transformation certain component of multispectral image at data space
Difference is constituted, therefore S in convergence strategy(i,j)Play Main Function, bigger to the image of follow-up fusion results;F(k,i,j)Generally by
Matrixing is constituted.
B. fusion method based on modulation intelligence
S(i,j)After generally being filtered with it by high-resolution panchromatic wave-band image, image asks mathematic interpolation to draw, another kind of situation
Time can by the synthesis wave band that panchromatic wave-band is similar to it ask difference calculate;F(k,i,j)Can be summarized as panchromatic image to synthesize with some
The ratio of wave band;The fusion results of this type of mode can be according to S(i,j)、F(k,i,j)Difference lay particular stress on meet obtain multispectral or high-altitude
Between the different needs of resolution.
C. fusion method based on multiscale analysis
Use F(k,i,j)Representing the difference of high score panchromatic image and its classification approximation component after down-sampled, progression is the biggest,
F(k,i,j)Relative to S(i,j)Weights are the least, show as spatial detail and keep more preferably, but the increase of decomposed class can cause multispectral
The loss of information.
Step 4, GPU parallel computation is accelerated: use GPU parallel computation to accelerate, and Form generation and holding with block merge knot
Really.Whole flow process only reads the data block identical with number of processes to internal memory, each process process respectively a pair to be fused
Graph block.Import and export with single compared with full width image, greatly reduce memory consumption.
Unified calculation framework CUDA (Compute Unified Device Architecture) is the exploitation of Nvidia company
GPU multiple programming platform, the process thread far more than CPU can be enabled under CUDA environment simultaneously, improve greatly and calculate effect
Rate.Under CUDA environment, utilize the calculating advantage multiple threads that GPU intensity is big, operation time can be greatly decreased.
Multinuclear calculates under platform, and a process calculated in core correspondence parallel environment, each process passes through process
Number 0 identifies from k-1.Output fusion evaluation divides according to row major order and numbers, and line number is m, and columns is n, by 0 to m × n-1
Numbering, then during parallel computation, the process number of i-th piece of image distribution is i% (k-1)+1, the image blocks number that each process processes
For (m × n)/(k-1).
Step 5, Remote Sensing Image Fusion evaluation index correlation analysis: factor-cluster analysis objective evaluation is index related,
Choose independent evaluation index overall merit fusion results precision from many aspects.
Set up correlation matrix by calculating the correlation coefficient between each index, calculate each other by factor analysis
Independent factor carries out cluster analysis, finally can be in the most representative independence of quality evaluation by acquired results classification
Objective indicator, remote sensing image quality evaluation after follow-up fusion.Typical objectives index independent of each other is obtained according to this system,
Set up based on comprehensive score objective evaluation system, for the most comprehensive qualitative overall merit fusion results quality.
5.1 calculate Pearson correlation coefficients
Use the linear correlation degree of Pearson correlation coefficients response variable conventional in multi-variate statistical analysis
Wherein x, y are variable, cov (x, y) represents the covariance of variable x, y, and σ x σ y represents the long-pending of variable x, y standard deviation,
From Cauchy-Schwarz inequality, when the linear relationship of two variablees strengthens, correlation coefficient levels off to 1 or-1.
5.2 build correlation matrix
The mathematical model of factorial analysis can be summarized as
X=AF+ ε
Wherein X is original variable vector, and A is common factor load factor matrix, by factor loading aijConstitute, aijFor i-th
Variable and the correlation coefficient of jth common factor.F is because of subvector, and ε is residual vector, and each variable can be with common factor
Linear function represents with residual vector sum.
5.3 factor-cluster analysis obtain evaluation index
Obtaining, by factorial analysis, the factor that independence is stronger, the index that comprises when the factor is more is to cluster the factor
Analyze, obtained the typical index of each classification by classification.The present embodiment uses and averagely ties connection, obtains with Euclidean distance
Cluster result independent between compact, class in class.Average knot connection is prior art, and it will not go into details for the present invention.
The separate evaluation index of above step gained is quantitatively commented for the follow-up each dimension of Remote Sensing Image Fusion result
Valency.When being embodied as, those skilled in the art can use computer software mode to realize the automatic operation of above flow process.
Specific embodiment described in the present invention is only to present invention spirit explanation for example.Technology belonging to the present invention
Described specific embodiment can be made various amendment or supplements or use similar mode by the technical staff in field
Substitute, but without departing from the spirit of the present invention or surmount scope defined in appended claims.
Claims (2)
1. the high-resolution remote sensing image fusion rules method guided based on scattered tensor, it is characterised in that include following step
Rapid:
Step 1, by multispectral image and panchromatic image piecemeal through Image registration;
Step 2, up-sampling, including following sub-step,
Step 2.1, selects a pair image blocks to be fused, for training parameter from step 1 acquired results;According to default ginseng
Number α, β and γ initial value, takes anisotropic model to carry out the up-sampling of dispersion tensor guiding, self-adapting detecting image to be fused
Edge also uses least square fitting;
When taking the up-sampling that anisotropic model carries out dispersion tensor guiding, below equation is utilized to describe multi-spectrum remote sensing image
Some diffusion and upsampling process,
M (k)=X (k) D A (k)
K=1 ..., K
Wherein, variable k is the band number of multispectral image, and K is the wave band number participating in merging, and M is original multispectral image,
X is the high-resolution estimated value of multispectral image, and A is the conversion that two-dimensional points spread function is corresponding, and D is two dimension upsampling process pair
The conversion answered;
Use Gaussian filter to smooth original panchromatic image, be calculated gradient direction n=d/ | | d | | and the ladder of each pixel
Degree intensity | | d | |, wherein d is the gradient vector calculated;When gradient is zero, it is stipulated that n=[1,0]T, it is to avoid gradient side
To not qualitative;
The dispersion tensor t defining each pixel is as follows,
Wherein, d⊥It is defined as vertical with gradient vector d, i.e. the vector in grey scale change minimum direction, dT、It is respectively vector d, d⊥
Turn order, edge-protected function w is
W=exp (-β | | d | |γ)
Tensor model is used for energy function optimization, obtains
Wherein, S=D A, G are the matrixing that gradient operator is corresponding, and T is that the dispersion tensor t diagonal angle of each pixel rearranges
Gray scale tensor matrix, α is the weights of anisotropy canonical constraint, and X is for treating that solution seeks image, and M is original multispectral image;X*For
Gained fusion evaluation, K is the wave band number participating in merging;
Based on linear least square formula, it is calculated as follows,
X*=(STS+αGTTG)-1STM
By solving double optimization problem by wave band, obtain the multispectral image of up-sampling;
Step 2.2, carries out objective indicator evaluation, if precision optimum then enters step 3, otherwise enters step 2.3;
Step 2.3, regulates parameter alpha, the current value of β and γ, returns step 2.1;
Step 3, selects Remote Sensing Image Fusion;
Step 4, uses GPU parallel computation to accelerate, with Form generation and the holding fusion results of block, including reading and number of processes
Identical data block is to internal memory, and each process processes a pair graph block to be fused respectively;
Step 5, Remote Sensing Image Fusion evaluation index correlation analysis, index related including factor-cluster analysis objective evaluation,
Choose independent evaluation index overall merit fusion results precision from many aspects.
The most according to claim 1, the high-resolution remote sensing image fusion rules method guided based on scattered tensor, its feature exists
In: in step 3,
If the multispectral image M up-sampling after registration is expressed as follows to the process that resolution is identical with panchromatic image,
ML=usp (M)
Wherein, usp () represents up-sampling algorithm, MLFor the result of up-sampling, useWithRepresent respectively before and after merging
Multispectral image, use pan(i,j)Representing the panchromatic image participating in merging, represent the wave band participating in merging with k, (i j) represents shadow
As location of pixels;
The universal model proposing remote sensing image Pixel-level blending algorithm is as follows,
Wherein, convergence strategy F(k, i, j)Represent, panchromatic image pan(i,j)Each pixel is at (i, j) the high frequency spatial details letter of position
Breath S(i,j)Represent.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610578249.XA CN106157317B (en) | 2016-07-21 | 2016-07-21 | High-resolution remote sensing image fusion rules method based on dispersion tensor guidance |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610578249.XA CN106157317B (en) | 2016-07-21 | 2016-07-21 | High-resolution remote sensing image fusion rules method based on dispersion tensor guidance |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106157317A true CN106157317A (en) | 2016-11-23 |
CN106157317B CN106157317B (en) | 2019-08-02 |
Family
ID=58059396
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610578249.XA Expired - Fee Related CN106157317B (en) | 2016-07-21 | 2016-07-21 | High-resolution remote sensing image fusion rules method based on dispersion tensor guidance |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106157317B (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106778837A (en) * | 2016-11-29 | 2017-05-31 | 浙江工业大学 | SAR image target recognition method based on polyteny principal component analysis and tensor analysis |
CN108986063A (en) * | 2018-07-25 | 2018-12-11 | 浪潮(北京)电子信息产业有限公司 | The method, apparatus and computer readable storage medium of gradient fusion |
CN109118461A (en) * | 2018-07-06 | 2019-01-01 | 航天星图科技(北京)有限公司 | A kind of HIS fusion method based on Distributed Architecture |
CN109829874A (en) * | 2019-01-30 | 2019-05-31 | 西安电子科技大学 | SAR image fusion method based on Frame Theory |
CN109949270A (en) * | 2019-01-28 | 2019-06-28 | 西北工业大学 | Multispectral and full-colour image based on region convolutional network merges space quality evaluation method |
CN110942451A (en) * | 2019-11-20 | 2020-03-31 | 东南大学 | Method for evaluating fusion performance of remote sensing image without reference image |
CN111681207A (en) * | 2020-05-09 | 2020-09-18 | 宁波大学 | Remote sensing image fusion quality evaluation method |
CN116245779A (en) * | 2023-05-11 | 2023-06-09 | 四川工程职业技术学院 | Image fusion method and device, storage medium and electronic equipment |
CN117115679A (en) * | 2023-10-25 | 2023-11-24 | 北京佳格天地科技有限公司 | Screening method for space-time fusion remote sensing image pairs |
CN117744035A (en) * | 2024-02-20 | 2024-03-22 | 上海诺睿科半导体设备有限公司 | Multispectral optical key dimension acquisition method, multispectral optical key dimension acquisition equipment and multispectral optical key dimension acquisition medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8761506B1 (en) * | 2011-04-22 | 2014-06-24 | DigitalGlobe, Incorporated | Pan sharpening digital imagery |
CN103942769A (en) * | 2013-12-10 | 2014-07-23 | 珠江水利委员会珠江水利科学研究院 | Satellite remote sensing image fusion method |
CN104933690A (en) * | 2015-06-04 | 2015-09-23 | 中国科学院遥感与数字地球研究所 | Remote sensing multi-spectral and panchromatic image fusion method based on mixed sub-pixel un-mixing |
-
2016
- 2016-07-21 CN CN201610578249.XA patent/CN106157317B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8761506B1 (en) * | 2011-04-22 | 2014-06-24 | DigitalGlobe, Incorporated | Pan sharpening digital imagery |
CN103942769A (en) * | 2013-12-10 | 2014-07-23 | 珠江水利委员会珠江水利科学研究院 | Satellite remote sensing image fusion method |
CN104933690A (en) * | 2015-06-04 | 2015-09-23 | 中国科学院遥感与数字地球研究所 | Remote sensing multi-spectral and panchromatic image fusion method based on mixed sub-pixel un-mixing |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106778837A (en) * | 2016-11-29 | 2017-05-31 | 浙江工业大学 | SAR image target recognition method based on polyteny principal component analysis and tensor analysis |
CN109118461A (en) * | 2018-07-06 | 2019-01-01 | 航天星图科技(北京)有限公司 | A kind of HIS fusion method based on Distributed Architecture |
CN108986063A (en) * | 2018-07-25 | 2018-12-11 | 浪潮(北京)电子信息产业有限公司 | The method, apparatus and computer readable storage medium of gradient fusion |
CN109949270A (en) * | 2019-01-28 | 2019-06-28 | 西北工业大学 | Multispectral and full-colour image based on region convolutional network merges space quality evaluation method |
CN109829874A (en) * | 2019-01-30 | 2019-05-31 | 西安电子科技大学 | SAR image fusion method based on Frame Theory |
CN109829874B (en) * | 2019-01-30 | 2023-06-30 | 西安电子科技大学 | SAR image fusion method based on frame theory |
CN110942451A (en) * | 2019-11-20 | 2020-03-31 | 东南大学 | Method for evaluating fusion performance of remote sensing image without reference image |
CN110942451B (en) * | 2019-11-20 | 2022-11-18 | 东南大学 | Method for evaluating fusion performance of remote sensing image without reference image |
CN111681207B (en) * | 2020-05-09 | 2023-10-27 | 四维高景卫星遥感有限公司 | Remote sensing image fusion quality evaluation method |
CN111681207A (en) * | 2020-05-09 | 2020-09-18 | 宁波大学 | Remote sensing image fusion quality evaluation method |
CN116245779A (en) * | 2023-05-11 | 2023-06-09 | 四川工程职业技术学院 | Image fusion method and device, storage medium and electronic equipment |
CN116245779B (en) * | 2023-05-11 | 2023-08-22 | 四川工程职业技术学院 | Image fusion method and device, storage medium and electronic equipment |
CN117115679A (en) * | 2023-10-25 | 2023-11-24 | 北京佳格天地科技有限公司 | Screening method for space-time fusion remote sensing image pairs |
CN117115679B (en) * | 2023-10-25 | 2024-06-25 | 北京佳格天地科技有限公司 | Screening method for space-time fusion remote sensing image pairs |
CN117744035A (en) * | 2024-02-20 | 2024-03-22 | 上海诺睿科半导体设备有限公司 | Multispectral optical key dimension acquisition method, multispectral optical key dimension acquisition equipment and multispectral optical key dimension acquisition medium |
CN117744035B (en) * | 2024-02-20 | 2024-04-26 | 上海诺睿科半导体设备有限公司 | Multispectral optical key dimension acquisition method, multispectral optical key dimension acquisition equipment and multispectral optical key dimension acquisition medium |
Also Published As
Publication number | Publication date |
---|---|
CN106157317B (en) | 2019-08-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106157317A (en) | The high-resolution remote sensing image fusion rules method guided based on dispersion tensor | |
CN108734659B (en) | Sub-pixel convolution image super-resolution reconstruction method based on multi-scale label | |
CN106683048A (en) | Image super-resolution method and image super-resolution equipment | |
CN105069746A (en) | Video real-time human face substitution method and system based on partial affine and color transfer technology | |
CN102651124B (en) | Image fusion method based on redundant dictionary sparse representation and evaluation index | |
CN109657081A (en) | Distributed approach, system and the medium of EO-1 hyperion satellite remote sensing date | |
CN113744136A (en) | Image super-resolution reconstruction method and system based on channel constraint multi-feature fusion | |
CN110298883A (en) | A kind of remote sensing images sub-pixed mapping localization method based on extension Random Walk Algorithm | |
CN115034959A (en) | High-definition image translation method based on cross-channel fusion space attention mechanism | |
CN108897616A (en) | Non-down sampling contourlet transform optimization method based on concurrent operation | |
Li et al. | A multi-cooperative deep convolutional neural network for spatiotemporal satellite image fusion | |
Chakraverti et al. | De-noising the image using DBST-LCM-CLAHE: A deep learning approach | |
CN109559278B (en) | Super resolution image reconstruction method and system based on multiple features study | |
Shen et al. | Multi-dimensional, multi-functional and multi-level attention in YOLO for underwater object detection | |
Sun et al. | Attention-enhanced multi-scale residual network for single image super-resolution | |
Kumar et al. | Underwater image enhancement using deep learning | |
Han et al. | SSMU-Net: A style separation and mode unification network for multimodal remote sensing image classification | |
Zheng et al. | Overwater image dehazing via cycle-consistent generative adversarial network | |
Ma et al. | Intra-and Inter-source Interactive Representation Learning Network for Remote Sensing Images Classification | |
Gao et al. | TEGAN: Transformer embedded generative adversarial network for underwater image enhancement | |
Jin et al. | Fusion of remote sensing images based on pyramid decomposition with Baldwinian Clonal Selection Optimization | |
Zhuo et al. | ISP-GAN: inception sub-pixel deconvolution-based lightweight GANs for colorization | |
CN113139899A (en) | Design method of high-quality light-weight super-resolution reconstruction network model | |
Khalid et al. | Blind image quality assessment using multi-stream architecture with spatial and channel attention | |
Kuang | Single image super resolution reconstruction algorithm based on deep learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190802 Termination date: 20200721 |
|
CF01 | Termination of patent right due to non-payment of annual fee |