Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, below in conjunction with specific embodiment, and, with reference to accompanying drawing, the present invention is described in more detail.
It should be noted that, in accompanying drawing or instructions description, similar or identical part is all used identical figure number.And in the accompanying drawings, embodiment is to simplify or convenient the sign.Moreover the implementation that does not illustrate in accompanying drawing or describe, be form known to a person of ordinary skill in the art in affiliated technical field.In addition, although this paper can provide the demonstration of the parameter that comprises particular value, should be appreciated that, parameter is without definitely equaling corresponding value, but can in acceptable error margin or design constraint, be similar to corresponding value.
In the phase method for detecting change of remote sensing image, the Gaussian process sorter is combined with Markov random field model during the present invention two, strengthen the effective utilization to image space information, improve and change accuracy of detection.
In one exemplary embodiment of the present invention, a kind of 2 o'clock phase method for detecting change of remote sensing image are provided.The schematic flow sheet of phase method for detecting change of remote sensing image when Fig. 1 is the embodiment of the present invention two.As shown in Figure 1, the present embodiment comprises the following steps:
Step S102, carry out over-segmentation to the remote sensing images of 2 o'clock phases respectively, obtains a plurality of overdivided regions after dividing processing;
Wherein, the remote sensing images of 2 o'clock above-mentioned phases are preferably the remote sensing image that original input picture obtains for the same sensor of two width the same area different times after registration process, its image spatial resolution is higher than 2 meters/pixel, and image comprises tri-wave bands of RGB.
In this step, utilize watershed segmentation method (J.Roerdink and A.Meijster, " The Watershed Transform:Definitions, Algorithms, and Parallellization Strategies; " Fundamenta Informaticae, vol.41, pp.187-228,2000.), while take each, the CIELab color characteristic of phase images is basis, and during respectively to each, the remote sensing images of phase carry out the over-segmentation processing.Each overdivided region possesses certain regional homogeneity consistance, is homogeneous region.In the over-segmentation process, in order to guarantee regional most homogeneous and to change the actual decipher detected, the chosen area area is as constraint condition, and when total number of pixels of certain cut zone is less than 200, this zone stops cutting apart;
Step S104, adjusted 2 o'clock each overdivided region corresponding to phase remote sensing images, makes the overdivided region of correspondence of 2 o'clock phase remote sensing images consistent;
In this step, for an overdivided region A in the first phase image, its corresponding region in second o'clock phase images is overdivided region B, and the adjustment criterion of overdivided region A and overdivided region B is:
If A=B, overdivided region A and overdivided region B all remain unchanged, as shown in Figure 2;
If A ≠ B, and A ∩ B=A, overdivided region A remains unchanged, and overdivided region B is divided into to B=B1 ∪ B2, wherein, the corresponding overdivided region that B1 is overdivided region A on second o'clock phase images, B2 is B-B1, as shown in Figure 2;
If A ∪ is B>A, and A ∪ B>B, overdivided region A being divided into to A-(A ∩ B) and A ∩ B two parts, overdivided region B is divided into B-(A ∩ B) and A ∩ B two parts, as shown in Figure 2.
Step S106, respectively to per a period of time the phase remote sensing images take pending overdivided region and extract color characteristic, textural characteristics as unit, and entropy feature;
This step can be divided into again step by step following:
S106a step by step, the pixel in the overdivided region target of take is unit, extracts CIELab color characteristic, Gabor textural characteristics and the entropy feature of each pixel;
Wherein, CIELab color characteristic extraction step is: original input picture is carried out to smothing filtering, each pixel p (i in image, j), centered by coordinate (i, j), get the image-region of 3*3 size, in zoning the spectrum average of pixel as the filtering of current pixel p (i, j) after spectral value, 2 o'clock phase remote sensing images after obtaining filtering and processing; By image RGB color space projection CIELab color space, obtain the color feature value of each pixel in the CIELab color space in image; The over-segmentation image that the back of take obtains is basis, and the average of the Lab color characteristic of all pixels CIELab feature regional as this in each overdivided region obtains the 3 Vc IELab color characteristics in each zone; Wherein, the RGB color space to the conversion computing formula of CIELab color space is:
XT=X>th,YT=Y>th,ZT=Z>th,th=0.008856
fX=XT.*X
1/3+(~XT).*(7.787.*X+16/116)
fY=YT.*Y
1/3+(~YT).*(7.787.*Y+16/116)
fZ=ZT.*Z
1/3+(~ZT).*(7.787.*Z+16/116)
L=YT.*(116*Y
1/3-16.0)+(~YT).*(903.3.*Y)
a=500*(fX-fY)
b=200*(fY-fZ) (1)
Wherein, X, Y, Z, fX, fY, fZ its only for calculating intermediate value, there is no concrete physical meaning.R, G and B are respectively the R/G/B component value of the RGB colour system of respective pixel.L, a and b are respectively L, a of CIELab colour system of the respective pixel after conversion and the value of each component of b.Th is judgment threshold.XT, YT, ZT mean that respectively X, Y, Z are greater than the part of judgment threshold th.
Gabor texture feature extraction step is: original input remote sensing images are converted into to gray level image, and method for transformation is for directly to average the spectral value addition of each pixel on image R, G, tri-passages of B, as the spectral value of gray level image; Structure Gabor wave filter is as follows:
x′=xcosθ+ysinθ
y′=-xsinθ+ycosθ (2)
Wherein, λ is wavelength, the strip direction that θ is the Gabor wave filter,
For the phase parameter of Gabor wave filter, γ is length breadth ratio, controls the index ellipsoid of Gabor wave filter.The Gabor energy function is defined as follows form:
Wherein,
With
Be respectively g
λ, θ, 0(x, y) and
Result with the gray level image convolution; The scale parameter λ that sets the Gabor wave filter in the present invention gets respectively [12345], direction parameter θ gets respectively [0 π/4 (2* π)/4 (3* π)/4 (4* π)/4 (5* π)/4 (6* π)/4 (7* π)/4], can construct Gabor wave filter in 40, use each wave filter to gray level image filtering, be about to each Gabor wave filter and gray level image and carry out convolution; Take the image overdivided region as unit, and the average of the Gabor textural characteristics of all pixels Gabor feature regional as this in zone, obtain 40 of each zone and tie up the Gabor textural characteristics;
The entropy characteristic extraction step is: original input remote sensing images are converted into to gray level image, and method for transformation is for directly to average the spectral value addition of each pixel on image R, G, tri-passages of B, as the spectral value of gray level image; Take each zone in the over-segmentation image is unit, and the entropy in computed image zone obtains the 1 dimension entropy feature in each zone.The computing formula of entropy feature is as follows:
Wherein, p
iThe number of pixels that in the presentation video zone, gray-scale value is i accounts for the ratio of number of pixels in whole image-region.
S106a, calculate the feature of interior each characteristic mean of pixel of overdivided region as this pending overdivided region step by step.
Step S108, ask poor by color, textural characteristics, the entropy feature in corresponding pending zone in 2 o'clock phase remote sensing images, and required difference is as the proper vector of corresponding pending overdivided region in the error image of 2 o'clock phase remote sensing images;
This step can be divided into again step by step following:
S108a, carry out normalized to CIELab color characteristic, Gabor textural characteristics, entropy feature respectively step by step, obtains normalization CIELab color characteristic, Gabor textural characteristics and entropy feature afterwards.Wherein, the normalized formula is expressed as follows:
f′=(f-min(min(f)))/(max(max(f))-min(min(f))). (5)
Wherein, f is above-mentioned CIELab color characteristic, Gabor textural characteristics, entropy feature.
S108b step by step, according to the over-segmentation image after adjusting, on overdivided region, feature is subtracted each other one by one, and a plurality of features of obtaining pending overdivided region in 2 o'clock phase remote sensing images are poor, the proper vector of corresponding pending overdivided region in the poor formation error image of the plurality of feature.
Step S110, utilize housebroken Gaussian process sorter, according to proper vector, overdivided region in error image is changed class and do not changed two classes classification of class, obtain the class probability of each overdivided region, and by this classification probability assignment to all pixels in this pending overdivided region on error image;
This step can be divided into following steps again:
Step S110a, obtain training sample set
Wherein, X
iFor some training samples, mean the remote sensing image (image spatial resolution is higher than 2 meters/pixel, and image comprises tri-wave bands of RGB) that two width obtain through the same sensor of areal different time of registration process;
For training sample X
iCorresponding two-value classification, indication training sample X
iIn each zone belong to and change class or belong to the probability that does not change class; According to S102-S106 to each training sample X
iExtract feature, obtain about training sample X
iTake the characteristic set that zone is unit, combine each training sample data class mark Y
iComposing training sample characteristics collection
Test data set
Wherein, X
i *For some test sample books, the remote sensing image (image spatial resolution is higher than 2 meters/pixel, and image comprises tri-wave bands of RGB) that each test sample book is obtained through the same sensor of the same area different time of registration process by two width forms.According to S102-S106, each test sample book is extracted to feature, obtain the feature set that zone is unit of take about test sample book
Step S110b, utilize the proper vector x of the concentrated training sample of training sample
iWith class mark y
iThe Gaussian process sorter is trained, obtained the gaussian kernel parameter;
Suppose that Gauss's priori average is 0, by training sample, calculate Gauss's prior variance matrix.The present invention uses gaussian radial basis function kernel function (Gaussian Radial Basis Function, RBF), and expression formula is as follows:
Wherein, θ
0Control parameter for the amplitude of gaussian radial basis function kernel function, the yardstick that σ is the gaussian radial basis function kernel function is controlled parameter; x
i, x
iMean the characteristics of image obtained in S108a, θ
0Be with σ two gaussian kernel parameters that need.
Step S110c, utilize Gaussian process sorter corresponding to gaussian kernel parameter, to the test feature collection that pending overdivided region proper vector forms in described error image
Classified, obtained the class probability that test feature is concentrated each pending overdivided region;
For test sample book x
i *(i=l+1 ... n), the present invention's acceptance of the bid remembers that an output probability value corresponding to each test sample book is y
i *(i=l+1 ... l+u), this probable value means the class probability of the corresponding overdivided region of this test sample book.Concrete steps are as follows:
1,, by Gauss's priori average and variance matrix, obtain implicit function f (x
i) expression formula.Suppose implicit function f (x
i) the obedience Gaussian process: f (x
i, θ)~GP (0, K), make f:x
i→ y
i(i=1,2 ..., l), wherein, y
iMean each regional corresponding class mark in training set.Therefore, can utilize the training sample feature set
Mapping relationship f by supposition: x
i→ y
i(i=1,2 ..., l), training obtains implicit function f (x
i) expression-form.
2, utilize the implicit function f (x obtained
i) expression formula, calculate the test sample book feature set
Correspondence prediction output probability y
i *.Wherein, prediction output probability calculation expression:
In formula
Mean noise model,
For process model, mean sample
Hidden variable f
*Probability distribution.
3, to noise model
Due to sample in Gauss's sorter
Belong to the class mark
Probability be and implicit function f
*Be directly proportional, so noise model
Can it be defined as:
In formula, the Φ function is S type (sigmoid) function class.
4, for process model
By marginalisation f=[f
1, f
2..., f
l], we can obtain:
In formula, p (f|x, y) is the posterior probability of hidden variable.In conjunction with Gaussian process priori p (f) and likelihood function p (y|f) thereof, we can obtain posteriority and distribute:
p(f|x,y)=p(y|f)p(f|X)/p(y|X) (5)
Due to when the given latent function f, observation data is separate, and likelihood function p (y|f) can be described as:
Marginal probability p (y|X) can be described as:
5, approximate solution: due to noise model p (y in formula (6)
i| f
i) what adopt is S type (sigmoid) class function, although prior distribution p is (f
i) be Gaussian function, but posteriority distributes
And prediction distribution
Be non-Gaussian distribution form, cause Gauss's expression formula (formula (2)) of classifying to be solved by the mode of resolving.In the present invention, adopt Laplce's method of approximation to noise model
Carry out approximate solution, and the Approximate prediction distribution that distributes and provide test sample book by this approximate posteriority.
Step S110d, give all pixels in this overdivided region by the class probability assignment of each overdivided region, as changing the initial result detected.
Step S112, build Markov random field model on error image, initial value using each pixel class probability value of each overdivided region as Markov random field model, calculate the Markov random field model energy function, by energy function optimization, obtain the result of 2 o'clock phase Remote Sensing Imagery Change Detection.
This step can be divided into again step by step following:
S112a step by step, a Markov random field model G (V of structure on error image, E), in error image, each pixel is expressed as a node V in Markov random field model, the pixel of its peripheral region of each node V forms the neighborhood set N of this node V, the poor E of the limit as Markov random field model of eigenvector between neighborhood, the initial value using the class probability value of each pixel on error image as Markov random field model;
S112b, according to maximum a posteriori probability estimation theory and Markov random field theory, construct the markov energy function by described Markov random field model G (V, E) step by step;
According to triumphant Lay Hamiltonian theory, the Markov random field model energy function can be equivalent to characteristic model energy and two part sums of prior model energy.The concrete building method of characteristic model energy and prior model energy is as follows:
1, by the class probability value y of each pixel of Gaussian process sorter output
i *As the input feature vector of Markov random field model, suppose that the unique point Output rusults of each node in Markov random field model is labeled as z
iCalculate its characteristic model
Suppose input feature vector
Equal Gaussian distributed, for any one input feature vector y
i *, utilize gauss of distribution function, calculate its characteristic model.The gauss of distribution function computing formula that this overdivided region belongs to the k class is as follows:
Wherein, μ
k, ∑
kThe average and the variance that mean respectively k category feature vector.
2, utilize single order Ising model, calculate the prior model p (z of Markov random field model G (V, E)
i), p (z
i) mean z
iNeighborhood
In pixel between correlativity punishment;
Prior model is taked single order Ising model, only thinks that the mark Output rusults of current certain pixel only is adjacent existence interaction between the element marking Output rusults connect, and and do not have mutual relationship between other element marking Output rusults.Markov single order Ising model formulation is:
Wherein, δ (z
i, z
j) be defined as the Cadillac function, if z
i=z
j, δ (z
i, z
j)=1, otherwise δ (z
i, z
j)=0; β
1For level and smooth weighting coefficient, control the effect size between the neighborhood overdivided region; C is the Regularization constant.
3, by the characteristic model p (z of each pixel on error image
i| y
i *) and prior model p (z
i) summation, the markov energy function of acquisition view picture error image, its function representation form is:
Through the simplification to formula (10), its optimized energy function representation form is equivalent to:
S112c step by step, adopt iterated conditional model (iterative conditional mode, be called for short ICM) markov energy function (as shown in Equation 11) is optimized and solves, the general layout of resulting final energy function mark is the result of 2 o'clock phase Remote Sensing Imagery Change Detection.Method is as follows:
1, individual element in error image is carried out to iteration, calculate least energy corresponding to every pixel;
2, in error image the minimum of all pixels can add and, as the energy when time iteration;
3, record the output class mark of the Markov random field model that current least energy is corresponding, be when the suboptimum Output rusults, such mark means that regular rear each pixel of Markov random field model belongs to variation or indeclinable classification logotype;
4,, when the least energy of this iterative computation gained is less than the previous iteration least energy, by general layout corresponding to this associating energy function, i.e. current Markov random field model output class mark set detects Output rusults as changing; Otherwise the output class mark set that last iteration is corresponding detects Output rusults as changing;
5, meet a prior given maximal value when iterations, or, when the iteration Output rusults of continuous 5 times remains unchanged, stop iteration, otherwise, re-execute step 1.In the present invention, the iterations higher limit is set to 200.
Method provided by the invention has proposed a kind of Gaussian process method relevant based on spatial context for Remote Sensing Imagery Change Detection.At first the method utilizes the Gaussian process sorter to obtain initial variation testing result, then utilizes Markov random field model to carry out regular to initial testing result.Characteristics of the present invention are both to have inherited the powerful classification capacity of Gaussian process sorter, can alleviate again the problem that Markov random field relies on initial value, can also utilize the regular item of markov effectively to remove Gauss's sorter and change the noise spot in detecting, improve and change the precision detected.In addition, because the present invention is that to carry out Markov random field model on the initial change testing result basis obtained at the Gaussian process sorter regular, Markov random field model energy function converges faster in actual operation, calculated amount is less, so change and detect with respect to Gaussian process, increase very little computing time.
Below further illustrate application example of the present invention: example has provided one group of typical urban scene QuickBird multispectral image, and the image taking area is the subregion of Beijing, and shooting time is respectively 2002 and 2003, as shown in Figure 3 a and Figure 3 b shows.Image is by (2.4 meters/pixel of full-colour image (0.6 meter/pixel) and multispectral images, red, green, blue, four wave bands of near infrared) form, in order to possess high spatial resolution and spectral resolution simultaneously, full-colour image and multispectral image have been carried out to Ehlers fusion (M.Ehlers.Spectral characteristics preserving image fusion based on Fourier Domain filtering, In Proc.SPIE, 5574:1-4, Bellingham, 2004.), the size of fused image is 1024 * 1024 pixels.Main change in image is: part is waste has built up large stretch of house on the ground, and original construction area has become greenery patches.
The manual detection result of usining as shown in Fig. 4 e, as the reference result, is contrasted method of the present invention and other three kinds of change detecting methods.Wherein, first method is Pixel-level change detecting method based on the Gaussian process sorter (utilize the Gaussian process sorter of describing in the present invention's the 3rd step, the image pixel of take changes detection as unit), and its testing result is as shown in Fig. 4 a.Second method is based on Pixel-level change detecting method (the L. Bruzzone and D.F.Prieto of Markov random field, " Automatic analysis of the difference image for unsupervised change detection; " IEEE Trans.Geosci.Remote Sens.vol.38, no.3, pp.1171-1182, May 2000), its testing result is as shown in Figure 4 b.The third method is based on regional multi-layer change detecting method (F.Bovolo, " A Multilevel Parcel-Based Approach to Change Detection in Very High Resolution " .IEEE Trans.Geosci.Remote Sens.Letters, vol.6, no.1, pp.33-37,2009), its testing result is as shown in Fig. 4 c.The result of utilizing method of the present invention to be detected is as shown in Fig. 4 d.
Estimated (in Table one) from four aspects to changing testing result: 1) false drop rate; 2) loss; 3) error rate; 4) kappa coefficient.
Table one changes testing result and quantizes comparative result
|
False drop rate |
Loss |
Error rate |
Kappa |
The first comparative approach |
5.27 |
7.11 |
12.38 |
0.68 |
The second comparative approach |
4.44 |
10.69 |
15.13 |
0.59 |
The third comparative approach |
2.62 |
8.02 |
10.65 |
0.71 |
Case method of the present invention |
7.29 |
2.55 |
10.02 |
0.76 |
The variation testing result that quantification comparative result explanation the present invention obtains improves a lot than the accuracy of detection of other three kinds of methods.It should be noted that, the above-mentioned definition to each element is not limited in various concrete structures or the shape of mentioning in embodiment, and those of ordinary skill in the art can replace simply to it with knowing, for example:
(1) in the S102 step, watershed segmentation method image over-segmentation method can also be by other image over-segmentation methods, as meanshift method, Ncut method replace, because meanshift method, Ncut method are method well known in the art, be not described in detail herein;
(2) in the S110c step, iterated conditional model (iterative conditional mode is called for short ICM) energy function method for solving can also use figure (Graphcut) method of cutting replace.
Above-described specific embodiment; purpose of the present invention, technical scheme and beneficial effect are further described; institute is understood that; the foregoing is only specific embodiments of the invention; be not limited to the present invention; within the spirit and principles in the present invention all, any modification of making, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.