CN102254323A - Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation - Google Patents

Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation Download PDF

Info

Publication number
CN102254323A
CN102254323A CN2011101556529A CN201110155652A CN102254323A CN 102254323 A CN102254323 A CN 102254323A CN 2011101556529 A CN2011101556529 A CN 2011101556529A CN 201110155652 A CN201110155652 A CN 201110155652A CN 102254323 A CN102254323 A CN 102254323A
Authority
CN
China
Prior art keywords
matrix
wavelet coefficient
image
coefficient difference
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011101556529A
Other languages
Chinese (zh)
Other versions
CN102254323B (en
Inventor
王桂婷
焦李成
张敏
钟桦
张小华
田小林
公茂果
王爽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN 201110155652 priority Critical patent/CN102254323B/en
Publication of CN102254323A publication Critical patent/CN102254323A/en
Application granted granted Critical
Publication of CN102254323B publication Critical patent/CN102254323B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)

Abstract

The invention discloses a method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation, and mainly solves the problem that much pseudo-change information exists in the existing change detection methods. The method is implemented through the following steps: inputting two time-phase remote sensing images, then respectively carrying out mean shift filtering on each image so as to obtain two time-phase filtered images; respectively carrying out two-dimensional stationary wavelet decomposition on the two time-phase filtered images three times under different level numbers; carrying out subtraction on wavelet coefficient matrixes of corresponding directional son-bands of the filtered images with the same decomposition level number; carrying out enhancement and two-dimensional wavelet inverse transformation reconstruction on wavelet coefficient difference matrixes in horizontal and vertical directions by using a sobel operator; and fusing the reconstruction images with different decomposition level numbers so as to obtain a final difference map by using a treelet algorithm, then carrying out level set segmentation on the difference map so as to obtain a change detection result. By using the method disclosed by the invention, the accuracy of the change detection result can be improved effectively, and the edge feature of a change area can be maintained better, therefore, the method can be applied to the fields of natural disaster analysis, land resource monitoring, and the like.

Description

Based on the Remote Sensing Imagery Change Detection that treelet merges and level set is cut apart
Technical field
The invention belongs to technical field of image processing, be a kind ofly to merge and level set is cut apart method for detecting change of remote sensing image specifically, can be used for the remote Sensing Image Analysis of numerous areas such as land resource monitoring, disaster analysis, urban development planning based on treelet.
Background technology
The Remote Sensing Imagery Change Detection technology is the important component part of remote sensing images research, and it compares analysis to the image of same place different times, obtains the atural object change information of people's needs according to the difference between the image.
In the change detecting method of remote sensing images, the simplest common method is directly the gradation of image value to be carried out difference to obtain difference image, utilizes threshold value to distinguish and changes class and non-variation class.Yet the remote sensing images between the different moment are because factors such as illumination, radiation cause the gradation of image value to have deviation, simply the gray scale of image is done to differ among the change detecting method result who obtains disparity map and can have more pseudo-change information, simultaneously, how to estimate accurately that threshold value is a bottleneck problem always.
In order to improve change-detection result's precision, relevant scholar has proposed many improved methods: the change detecting method that scholars such as Yakoub Bazi proposed in meeting article " A Variational Level-Set Method for Unsupervised Change Detection in Remote Sensing Images " based on the CV model in 2009, the author further improved theory part and increased experimental data on the basis of above-mentioned meeting article in 2010, had delivered journal of writings " Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods " again.This method does not need to estimate change threshold, but thereby the CV model is subjected to the accuracy that The noise influences the result easily.Scholars such as Turgay Celik propose a kind of change detecting method based on the dual-tree complex wavelet conversion in article " A Bayesian approach to unsupervised multiscale change detection in synthetic aperture radar image ".Because the down-sampling characteristic of dual-tree complex wavelet conversion, this method at first will be carried out interpolation to original image, the selection of interpolation method has certain influence to the result, in addition, respectively low frequency coefficient matrix and high frequency coefficient matrix are cut apart and tired easily integration class error, influence change-detection result's precision equally.
Summary of the invention
The objective of the invention is to overcome the deficiency of above-mentioned existing Remote Sensing Imagery Change Detection technology, proposed a kind of based on treelet merges and level set is cut apart method for detecting change of remote sensing image, to keep the edge of region of variation preferably, reduce pseudo-change information, improve the precision of change-detection.
For achieving the above object, detection method of the present invention comprises the steps:
(1) two width of cloth of the input size of registration is the multi-temporal remote sensing image I of m * n 1And I 2Carry out average drifting filtering respectively, obtain image X after the filtering 1And X 2
(2) to image X after the filtering 1And X 2Carrying out 3 two-dimentional stationary wavelets respectively decomposes, and the highest decomposition number of plies that image decomposes for 3 times after each width of cloth filtering is respectively s (s=1, ... 3), once two-dimentional stationary wavelet decomposes and obtains four wavelet coefficient matrixes, promptly low frequency coefficient matrix with three represent respectively level, vertical, to the high frequency wavelet matrix of coefficients of angular direction;
(3) to image X after the filtering 1And X 2Under the identical decomposition number of plies counterparty do to the wavelet coefficient matrix of subband poor, the low frequency wavelet coefficient difference matrix that obtains each decomposition layer s and three expression levels respectively, vertical, to the high frequency wavelet coefficient difference matrix of angular direction;
(4) utilize the sobel operator to strengthen to horizontal direction wavelet coefficient difference matrix in the step (3) and vertical direction wavelet coefficient difference matrix, keep low frequency wavelet coefficient difference matrix and constant angular direction wavelet coefficient difference matrix;
(5) use (3) medium and low frequency wavelet coefficient difference matrix, to level, vertical direction wavelet coefficient difference matrix after strengthening in angular direction wavelet coefficient difference matrix and (4), each decomposition layer s is carried out the contrary stationary wavelet conversion of two dimension, obtain the reconstructed image RIs of each decomposition layer s;
(6) the reconstructed image RIs to each decomposition layer s uses the treelet conversion to merge the disparity map D after obtaining merging;
(7) the disparity map D after merging is carried out level set and cut apart, obtain change-detection figure Z as a result.
The present invention has the following advantages compared with prior art:
(1) the present invention is owing to do difference and poor matrix reconstruct is come structural differences figure by the wavelet coefficient matrix that picture breakdown after two width of cloth filtering is obtained, thereby can alleviate the influence that the remote sensing images between the different moment cause the gradation of image value to exist deviation that the result is caused owing to factors such as illumination, radiation, thereby can reduce the pseudo-change information among the result, improve change-detection result's precision;
(2) the present invention is owing to adopt level, the vertical direction template of sobel operator that the wavelet coefficient difference matrix of level, vertical direction is strengthened, and makes that the edge feature of geometric configuration is more outstanding in the image;
(3) the present invention adopts three disparity map that obtain against stationary wavelet conversion reconstruct of treelet transfer pair to merge, this conversion can obtain level clustering tree and one group of multiple dimensioned orthogonal basis of a reflection data inner structure, the present invention utilizes this group orthogonal basis that the disparity map that reconstruct under three different decomposition numbers of plies obtains is merged, than directly the disparity map before merging being cut apart the result who obtains, it is higher that the disparity map after merging is cut apart the precision as a result that obtains;
(4) the present invention is owing to adopt the average drifting method that original image is carried out filtering, and the noise information in not only can the filtering image also has good edge retention performance;
(5) the present invention is owing to adopt two-dimentional stationary wavelet to decompose, and stationary wavelet has redundancy and translation invariance, therefore needn't carry out interpolation to original image, the error of having avoided interpolation algorithm to bring.
Description of drawings
Fig. 1 is realization flow figure of the present invention;
Fig. 2 is 2 o'clock phase remote sensing images and the corresponding reference diagram that the present invention uses;
Fig. 3 is that the disparity map that obtains is merged in the present invention by treelet;
Fig. 4 is with the present invention and the control methods change-detection that experiment obtains to simulation remotely-sensed data collection figure as a result;
Fig. 5 is the change-detection that true remotely-sensed data collection experiment obtained with the present invention and control methods figure as a result.
Embodiment
With reference to Fig. 1, enforcement of the present invention is as follows:
Step 1 is to two of the input registration of phase and the size remote sensing images I that are m * n simultaneously not 1And I 2, shown in 2 (a) and Fig. 2 (b), carry out average drifting filtering respectively, obtain image X after the filtering 1And X 2
(1a) to each pixel of input picture, according to following formula computation of mean values drift vector m h(x) value:
m h ( x ) = Σ i = 1 n K ( x - x i h ) x i Σ i = 1 n K ( x - x i h )
In the formula, K (x) is a gaussian kernel function, and h is the bandwidth vector of gaussian kernel function K (x), and the present invention gets h={5, and 5}, x are the gray-scale value of current pixel point, x iBe the gray-scale value of current pixel point bandwidth h scope interior pixel point, n is the total number that falls into current pixel point bandwidth h scope interior pixel point;
(1b) with the m that calculates h(x) value is upgraded the gray-scale value of current pixel point;
If (1c) satisfy condition || m h(x)-x||≤ε s, ε sBe given permissible error, then stop iteration, m h(x) value is as the gray-scale value output of current pixel point, m at this moment h(x) value is through this gray values of pixel points after the average drifting filtering, otherwise returns step (1a);
(1d) all pixels in the input picture are all carried out the operation of step (1a)-(1c), image after the output filtering.
Step 2 is to image X after the filtering 1And X 2Carrying out 3 two-dimentional stationary wavelets respectively decomposes, and the highest decomposition number of plies that image decomposes for 3 times after each width of cloth filtering is respectively s (s=1, ... 3), once two-dimentional stationary wavelet decomposition obtains 4 wavelet coefficient matrixes, promptly 1 low frequency coefficient matrix with 3 represent respectively level, vertical, to the high frequency wavelet matrix of coefficients of angular direction, then 3 of each width of cloth image decomposition all can obtain 12 wavelet coefficient matrixes, comprise 3 low frequency coefficient matrixes and 9 high frequency coefficient matrixes.
Step 3 is to image X after the filtering 1And X 2Under the identical decomposition number of plies counterparty do to the wavelet coefficient matrix of subband poor, the low frequency wavelet coefficient difference matrix that obtains each decomposition layer s and three expression levels respectively, vertical, to the high frequency wavelet coefficient difference matrix of angular direction, to image X after the filtering 1And X 2Under the identical decomposition number of plies counterparty do to the wavelet coefficient matrix of subband poor, comprise to the low frequency wavelet matrix of coefficients do the difference and the high frequency wavelet matrix of coefficients is done poor, promptly
D s L = | L s 1 - L s 2 |
D θ , s H = | H θ , s 1 - H θ , s 2 |
In the formula
Figure BDA0000067343930000043
With
Figure BDA0000067343930000044
Represent image X after the filtering respectively 1And X 2The low frequency wavelet matrix of coefficients that the s decomposition layer obtains, For
Figure BDA0000067343930000046
With
Figure BDA0000067343930000047
Low frequency wavelet coefficient difference matrix;
Figure BDA0000067343930000048
With
Figure BDA0000067343930000049
Represent image X after the filtering respectively 1And X 2The high frequency wavelet matrix of coefficients that the s decomposition layer obtains, θ value are 0 °, 45 ° and 90 °, represent level, diagonal sum vertical direction respectively,
Figure BDA00000673439300000410
For
Figure BDA00000673439300000411
With
Figure BDA00000673439300000412
High frequency wavelet coefficient difference matrix.
Step 4 utilizes the sobel operator to strengthen to horizontal direction wavelet coefficient difference matrix and vertical direction wavelet coefficient difference matrix, keeps low frequency wavelet coefficient difference matrix and constant to angular direction wavelet coefficient difference matrix.
(4a) adopt the horizontal direction template of sobel operator and the high frequency wavelet coefficient difference matrix of horizontal direction
Figure BDA00000673439300000413
Carry out convolution, the horizontal direction wavelet coefficient difference matrix after being enhanced
(4b) adopt the vertical direction template of sobel operator and the high frequency wavelet coefficient difference matrix of vertical direction
Figure BDA00000673439300000415
Carry out convolution, the vertical direction wavelet coefficient difference matrix after being enhanced
Figure BDA00000673439300000416
Step 5 to each decomposition layer s, adopts step (3) medium and low frequency wavelet coefficient difference matrix
Figure BDA00000673439300000417
To angular direction wavelet coefficient difference matrix
Figure BDA00000673439300000418
And level, vertical direction wavelet coefficient difference matrix after strengthening in the step (4)
Figure BDA00000673439300000419
With
Figure BDA00000673439300000420
These four wavelet coefficient matrixes carry out the contrary stationary wavelet conversion of two dimension, obtain three image RIs after the reconstruct;
Step 6 merges the reconstructed image RIs use treelet conversion of each decomposition layer s, and the disparity map D after obtaining merging specifically carries out as follows;
(6a) the image RIs after the reconstruct all is transformed to the column vector RI1 ' of m * n size, RI2 ', RI3 ' forms initial sample X=[RI1 ', RI2 ', RI3 '];
(6b) number of plies of the cluster successively l=0 of definition treelet conversion, 1 ... L-1, L are the number of column vector among the initial sample X, L=3, and at the 0th layer, each variable adopts the column vector among the initial sample X to represent, initialization basis matrix B 0For the unit matrix of L * L and and variable indexed set Ω=1,2 ... L}, calculate the initial covariance matrix C of sample X 0With initial correlation matrix M 0, computing formula is as follows:
C ij=E[(s p-Es p)(s q-Es q)]
M ij = C ij C ii C jj
C in the formula IjRepresent initial covariance matrix C 0The calculated value of the capable j row of i, s p, s qTwo different column vectors among the expression sample X, E represents to ask mathematical expectation, M IjRepresent initial correlation matrix M 0The calculated value of the capable j row of i;
(6c) when cluster number of plies l successively ≠ 0, seek correlation matrix M lIn two maximum values, the correspondence position sequence number of maximal value and second largest value is designated as α and β respectively:
( α , β ) = arg max i , j ∈ Ω M ij l - 1
Here i<j represents correlation matrix M respectively lIn the row and column of arbitrary value, and only with variable indexed set Ω in carry out;
(6d) calculate Jacobi rotation matrix J:
J = 1 L 0 L 0 L 0 M O M M M 0 L c n L s n L 0 M M O M M 0 L - s n L c n L 0 M M M O M 0 L 0 L 0 L 1
C wherein n=cos (θ l), s n=sin (θ l); Rotation angle θ lBy C l=J TC L-1J reaches
Figure BDA0000067343930000054
Calculate J TThe transposition of expression rotation matrix J:
θ l = tan - 1 [ C αα l - C ββ l ± ( C αβ l - C ββ l ) 2 + 4 ( C αβ l ) 2 2 C αβ l ] And | θ l | ≤ π 4 ;
In the formula,
Figure BDA0000067343930000063
Expression covariance matrix C lMiddle row, column position number is the element value of α,
Figure BDA0000067343930000064
Expression covariance matrix C lMiddle row, column position number is the element value of β,
Figure BDA0000067343930000065
Expression covariance matrix C lMiddle line position sequence number is the element value that α, column position sequence number are β;
(6e) by the orthogonal basis B after the matrix J renewal decorrelation l=B L-1J, covariance matrix C l=J TC L-1J, wherein B L-1Be the orthogonal basis before upgrading, B lBe the orthogonal basis after upgrading, C L-1Be the covariance matrix before upgrading, C lBe the covariance matrix after upgrading, and utilize C lUpgrade correlation matrix M L-1Be M l, M L-1Be the correlation matrix before upgrading, M lBe the correlation matrix after upgrading:
M ij l = C ij l C ii l C jj l
Wherein For upgrading back correlation matrix M lIn the updating value of the capable j of i row,
Figure BDA0000067343930000068
For upgrading back covariance matrix C lIn the value of the capable j of i row,
Figure BDA0000067343930000069
For upgrading back covariance matrix C lIn the value of the capable i of i row, For upgrading back covariance matrix C lIn the value of the capable j of j row;
(6f) back orthogonal basis matrix B is upgraded in definition lIn position number be that α and position number are that two column vectors of β are respectively scaling function φ lWith Detailfunction ψ l, the scaling vector that defines current l layer is gathered { φ lBe scaling function φ lScaling vector set { φ with last layer L-1Intersection, with the position number β of difference variable from the indexed set Ω of variable remove, promptly Ω=Ω { β };
(6g) repeating step (6c) to (6f) can get orthogonal basis matrix B=[φ finally until the top l=L-1 of cluster L-1, ψ 1... ψ L-1], φ wherein L-1∈ { φ L-1, ψ 1Be the Detailfunction that ground floor treelet conversion obtains, ψ L-1The Detailfunction that obtains for top treelet conversion;
(6h) initial sample X is carried out projection, i.e. P=X * B along the direction of orthogonal basis matrix B transposition T, and become projection vector P the image of m * n size again, the disparity map D after obtaining merging, as shown in Figure 3.
Step 7 is carried out level set to disparity map D after merging and is cut apart, and obtains change-detection Z as a result, specifically carries out as follows:
(7a) the initialization level set function is ξ 0:
ξ 0 ( x , y ) = - ρ ( x a , y a ) ∈ Λ 0 - ∂ Λ 0 0 ( x a , y a ) ∈ ∂ Λ 0 ρ Λ - Λ 0
Λ represents the entire image territory of disparity map D to be split, Λ in the formula 0Be any one subregion among the Λ,
Figure BDA0000067343930000072
Be all borderline points of this subregion, ρ is a constant, gets ρ=6 among the present invention, (x a, y a) coordinate of pixel arbitrarily in the presentation video;
(7b) to initial level set function ξ 0Develop, make total energy function ε (ξ) constantly reduce when reaching the iterations 15 of regulation, to stop, this moment, the zero level collection of level set function ξ correspondence was exactly the border of region of variation, grey scale pixel value assignment 1 with region of variation, the grey scale pixel value assignment 0 of non-region of variation, the binary map that obtains is exactly final change-detection figure Z as a result, and shown in Fig. 4 (c), the evolution formula is as follows:
∂ ξ ∂ t = μ [ Δξ - div ( ▿ ξ | ▿ ξ | ) ] + λδ ( ξ ) div ( g ▿ ξ | ▿ ξ | ) + vgδ ( ξ )
λ, μ, v are constant in the formula, get λ=5 among the present invention, μ=0.2, and v=3, δ are Dirac function, Δ is represented the Laplace's operation symbol,
Figure BDA0000067343930000074
Expression asks gradient, div to represent to ask divergence, and g is the Boundary Detection function,
g = 1 1 + | ▿ G σ * D | 2
G in the formula σThe expression standard deviation is the σ gaussian kernel, and D is for merging the back disparity map;
Total energy function ε (ξ) is expressed as internal energy function and external energy function sum, is shown below:
ε(ξ)=μP(ξ)+ε g,λ,v(ξ)
P in the formula (ξ) is the internal energy function, ε G, λ, v(ξ) be the external energy function,
P ( ξ ) = ∫ Λ 1 2 ( | ▿ ξ | - 1 ) 2 d x a d y a
ε g,λ,v(ξ)=λL g(ξ)+vA g(ξ)
Here L g(ξ) be the zero level collection length of curve calculating function of level set function ξ correspondence, A g(ξ) quicken function for curve evolvement:
L g ( ξ ) = ∫ Λ gδ ( ξ ) | ▿ ξ | d x a d y a
A g(ξ)=∫ ΛgH(-ξ)dx ady a
H represents step function in the formula.
Effect of the present invention can further specify by following experimental result and analysis:
1. experimental data
Experimental data of the present invention is one group of simulated data collection and one group of true multi-temporal remote sensing data set, wherein the original image of simulated data collection is ATM (Airborne Thematic Mapper) the 3rd band image that is positioned at Britain Feltwell village farming district of 470 * 335 pixel sizes, registration error is about 1.5 pixels, the analog variation image is to obtain by also artificial some region of variation of embedding of factor affecting such as the Changes in weather of the simulation earth and irradiation of electromagnetic waves characteristics, true remotely-sensed data collection is 2 o'clock phase Landsat5 TM+5 band images of Italian Sardinia, size is 412 * 300,256 gray levels.
2. experimental technique
The change detecting method that scholars such as method 1:Turgay Celik propose in article " A Bayesian approach to unsupervised multiscale change detection in synthetic aperture radar image " based on the dual-tree complex wavelet conversion;
The change detecting method that scholars such as method 2:Yakoub Bazi proposed in article " A Variational Level-Set Method for Unsupervised Change Detection in Remote Sensing Images " in 2010 based on the CV model;
Method 3: the inventive method.
3. experiment content and interpretation of result
Experiment 1, with distinct methods to as Fig. 2 (a) and two width of cloth shown in Fig. 2 (b) not simultaneously mutually simulated data collection carry out change-detection, the change-detection reference diagram is shown in Fig. 2 (c), the simulation remotely-sensed data collection of Fig. 2 (a) and Fig. 2 (b) is carried out result that change-detection obtains as shown in Figure 4, the change-detection that obtains for existing method 1 of Fig. 4 (a) figure as a result wherein, the change-detection that Fig. 4 (b) obtains for existing method 2 is figure as a result, the change-detection that Fig. 4 (c) obtains for the inventive method is figure as a result, as can be seen from Figure 4, there is more pseudo-change information in existing method 1 among the figure as a result, there is tangible omission in existing method 2 among the figure as a result, and the inventive method is then relatively more approaching with reference to figure 2 (c).
Experiment 2, with distinct methods to as Fig. 2 (d) and two width of cloth shown in Fig. 2 (e) not simultaneously mutually true remotely-sensed data collection carry out change-detection, the change-detection reference diagram is shown in Fig. 2 (f), the simulation remotely-sensed data collection of Fig. 2 (d) and Fig. 2 (e) is carried out result that change-detection obtains as shown in Figure 5, the change-detection that Fig. 5 (a) obtains for existing method 1 is figure as a result, the change-detection that Fig. 5 (b) obtains for existing method 2 is figure as a result, the change-detection that Fig. 5 (c) obtains for the inventive method is figure as a result, as can be seen from Figure 5, all there is many obvious noise zone, the figure as a result of the inventive method and the most approaching among the figure as a result of existing method 1 and existing method 2 with reference to figure 2 (f).
The result carries out quantitative test to the experiment change-detection, promptly compares change-detection figure and canonical reference figure as a result, calculates performance index such as total wrong number, empty scape number, omission number, and the result is as shown in table 1.
Table 1. liang group remote sensing image data change-detection evaluation of result index
From table 1, can find out more intuitively, the region of variation of the acquisition remote sensing images that the inventive method can be effectively stably, the change-detection result's that compares with other two kinds of existing methods precision is the highest.

Claims (4)

1. one kind merges based on treelet and method for detecting change of remote sensing image that level set is cut apart, comprises the steps:
(1) two width of cloth of the input size of registration is the multi-temporal remote sensing image I of m * n 1And I 2Carry out average drifting filtering respectively, obtain image X after the filtering 1And X 2
(2) to image X after the filtering 1And X 2Carrying out 3 two-dimentional stationary wavelets respectively decomposes, and the highest decomposition number of plies that image decomposes for 3 times after each width of cloth filtering is respectively s (s=1, ... 3), once two-dimentional stationary wavelet decomposes and obtains four wavelet coefficient matrixes, promptly low frequency coefficient matrix with three represent respectively level, vertical, to the high frequency wavelet matrix of coefficients of angular direction;
(3) to image X after the filtering 1And X 2Under the identical decomposition number of plies counterparty do to the wavelet coefficient matrix of subband poor, the low frequency wavelet coefficient difference matrix that obtains each decomposition layer s and three expression levels respectively, vertical, to the high frequency wavelet coefficient difference matrix of angular direction;
(4) utilize the sobel operator to strengthen to horizontal direction wavelet coefficient difference matrix in the step (3) and vertical direction wavelet coefficient difference matrix, keep low frequency wavelet coefficient difference matrix and constant angular direction wavelet coefficient difference matrix;
(5) use (3) medium and low frequency wavelet coefficient difference matrix, to level, vertical direction wavelet coefficient difference matrix after strengthening in angular direction wavelet coefficient difference matrix and (4), each decomposition layer s is carried out the contrary stationary wavelet conversion of two dimension, obtain the reconstructed image RIs of each decomposition layer s;
(6) the reconstructed image RIs to each decomposition layer s uses the treelet conversion to merge the disparity map D after obtaining merging;
(7) the disparity map D after merging is carried out level set and cut apart, obtain change-detection figure Z as a result.
2. method for detecting change of remote sensing image according to claim 1, wherein step (3) is described to image X after the filtering 1And X 2Under the identical decomposition number of plies counterparty do to the wavelet coefficient matrix of subband poor, comprise to the low frequency wavelet matrix of coefficients do the difference and the high frequency wavelet matrix of coefficients is done poor, promptly
D s L = | L s 1 - L s 2 |
D θ , s H = | H θ , s 1 - H θ , s 2 |
In the formula
Figure FDA0000067343920000013
With
Figure FDA0000067343920000014
Represent image X after the filtering respectively 1And X 2The low frequency wavelet matrix of coefficients that the s decomposition layer obtains,
Figure FDA0000067343920000015
For With
Figure FDA0000067343920000017
Low frequency wavelet coefficient difference matrix;
Figure FDA0000067343920000018
With
Figure FDA0000067343920000019
Represent image X after the filtering respectively 1And X 2The high frequency wavelet matrix of coefficients that the s decomposition layer obtains, θ value are 0 °, 45 ° and 90 °, represent level, diagonal sum vertical direction respectively,
Figure FDA0000067343920000021
For
Figure FDA0000067343920000022
With
Figure FDA0000067343920000023
High frequency wavelet coefficient difference matrix.
3. method for detecting change of remote sensing image according to claim 1, wherein step (4) is described utilizes the sobel operator to strengthen to horizontal direction wavelet coefficient difference matrix and vertical direction wavelet coefficient difference matrix, specifically carries out as follows:
Adopt the horizontal direction template of sobel operator and the high frequency wavelet coefficient difference matrix of horizontal direction
Figure FDA0000067343920000024
Carry out convolution, the horizontal direction wavelet coefficient difference matrix after being enhanced
Figure FDA0000067343920000025
Adopt the vertical direction template of sobel operator and the high frequency wavelet coefficient difference matrix of vertical direction
Figure FDA0000067343920000026
Carry out convolution, the vertical direction wavelet coefficient difference matrix after being enhanced
Figure FDA0000067343920000027
4. method for detecting change of remote sensing image according to claim 1, wherein the image RIs of the described employing of step (6) treelet algorithm after to reconstruct merges, and carries out as follows:
(6a) the image RIs after the reconstruct all is transformed to the column vector RI1 ' of m * n size, RI2 ', RI3 ' forms initial sample X=[RI1 ', RI2 ', RI3 '];
(6b) number of plies of the cluster successively l=0 of definition treelet conversion, 1 ... L-1, L are the number of column vector among the initial sample X, L=3, and at the 0th layer, each variable adopts the column vector among the initial sample X to represent, initialization basis matrix B 0For the unit matrix of L * L and and variable indexed set Ω=1,2 ... L}, calculate the initial covariance matrix C of sample X 0With initial correlation matrix M 0, computing formula is as follows:
C ij=E[(s p-Es p)(s q-Es q)]
M ij = C ij C ii C jj
C in the formula IjRepresent initial covariance matrix C 0The calculated value of the capable j row of i, s p, s qTwo different column vectors among the expression sample X, E represents to ask mathematical expectation, M IjRepresent initial correlation matrix M 0The calculated value of the capable j row of i;
(6c) when cluster number of plies l successively ≠ 0, seek correlation matrix M lIn two maximum values, the correspondence position sequence number of maximal value and second largest value is designated as α and β respectively:
( α , β ) = arg max i , j ∈ Ω M ij l - 1
Here i<j represents correlation matrix M respectively lIn the row and column of arbitrary value, and only with variable indexed set Ω in carry out;
(6d) calculate Jacobi rotation matrix J:
J = 1 L 0 L 0 L 0 M O M M M 0 L c n L s n L 0 M M O M M 0 L - s n L c n L 0 M M M O M 0 L 0 L 0 L 1
C wherein n=cos (θ l), s n=sin (θ l); Rotation angle θ lBy C l=J TC L-1J reaches
Figure FDA0000067343920000032
Calculate J TThe transposition of expression rotation matrix J:
θ l = tan - 1 [ C αα l - C ββ l ± ( C αβ l - C ββ l ) 2 + 4 ( C αβ l ) 2 2 C αβ l ] And | θ l | ≤ π 4 ;
In the formula,
Figure FDA0000067343920000035
Expression covariance matrix C lMiddle row, column position number is the element value of α,
Figure FDA0000067343920000036
Expression covariance matrix C lMiddle row, column position number is the element value of β,
Figure FDA0000067343920000037
Expression covariance matrix C lMiddle line position sequence number is the element value that α, column position sequence number are β;
(6e) by the orthogonal basis B after the matrix J renewal decorrelation l=B L-1J, covariance matrix C l=J TC L-1J, wherein B L-1Be the orthogonal basis before upgrading, B lBe the orthogonal basis after upgrading, C L-1Be the covariance matrix before upgrading, C lBe the covariance matrix after upgrading, and utilize C lUpgrade correlation matrix M L-1Be M l, M L-1Be the correlation matrix before upgrading, M lBe the correlation matrix after upgrading:
M ij l = C ij l C ii l C jj l
Wherein
Figure FDA0000067343920000039
For upgrading back correlation matrix M lIn the updating value of the capable j of i row,
Figure FDA00000673439200000310
For upgrading back covariance matrix C lIn the value of the capable j of i row,
Figure FDA00000673439200000311
For upgrading back covariance matrix C lIn the value of the capable i of i row,
Figure FDA00000673439200000312
For upgrading back covariance matrix C lIn the value of the capable j of j row;
(6f) back orthogonal basis matrix B is upgraded in definition lIn position number be that α and position number are that two column vectors of β are respectively scaling function φ lWith Detailfunction ψ l, the scaling vector that defines current l layer is gathered { φ lBe scaling function φ lScaling vector set { φ with last layer L-1Intersection, with the position number β of difference variable from the indexed set Ω of variable remove, promptly Ω=Ω { β };
(6g) repeating step (6c) to (6f) can get orthogonal basis matrix B=[φ finally until the top l=L-1 of cluster L-1, ψ 1... ψ L-1], φ wherein L-1∈ { φ L-1, ψ 1The Detailfunction that obtains for ground floor treelet conversion,
ψ L-1The Detailfunction that obtains for top treelet conversion;
(6h) initial sample X is carried out projection, i.e. P=X * B along the direction of orthogonal basis matrix B transposition T, and become projection vector P again the image of m * n size, the disparity map D after obtaining merging.
CN 201110155652 2011-06-10 2011-06-10 Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation Expired - Fee Related CN102254323B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110155652 CN102254323B (en) 2011-06-10 2011-06-10 Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110155652 CN102254323B (en) 2011-06-10 2011-06-10 Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation

Publications (2)

Publication Number Publication Date
CN102254323A true CN102254323A (en) 2011-11-23
CN102254323B CN102254323B (en) 2013-02-27

Family

ID=44981564

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110155652 Expired - Fee Related CN102254323B (en) 2011-06-10 2011-06-10 Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation

Country Status (1)

Country Link
CN (1) CN102254323B (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102663724A (en) * 2012-03-03 2012-09-12 西安电子科技大学 Method for detecting remote sensing image change based on adaptive difference images
CN102831598A (en) * 2012-07-04 2012-12-19 西安电子科技大学 Remote sensing image change detecting method with combination of multi-resolution NMF (non-negative matrix factorization) and Treelet
CN103077525A (en) * 2013-01-27 2013-05-01 西安电子科技大学 Treelet image fusion-based remote sensing image change detection method
CN103824302A (en) * 2014-03-12 2014-05-28 西安电子科技大学 SAR (synthetic aperture radar) image change detecting method based on direction wave domain image fusion
CN103955943A (en) * 2014-05-21 2014-07-30 西安电子科技大学 Non-supervision change detection method based on fuse change detection operators and dimension driving
CN104851090A (en) * 2015-04-28 2015-08-19 四川九洲电器集团有限责任公司 Image change detection method and image change detection device
CN105160355A (en) * 2015-08-28 2015-12-16 北京理工大学 Remote sensing image change detection method based on region correlation and visual words
CN106971392A (en) * 2017-03-17 2017-07-21 国家测绘地理信息局卫星测绘应用中心 A kind of combination DT CWT and MRF method for detecting change of remote sensing image and device
CN107610095A (en) * 2017-08-04 2018-01-19 南京邮电大学 Heart CT coronary artery full-automatic partition methods based on image co-registration
CN109345475A (en) * 2018-09-19 2019-02-15 长安大学 A kind of unmanned aerial vehicle remote sensing mountain highway Image Fusion Filtering method
CN110503631A (en) * 2019-07-24 2019-11-26 山东师范大学 A kind of method for detecting change of remote sensing image
WO2021135702A1 (en) * 2019-12-31 2021-07-08 百果园技术(新加坡)有限公司 Video denoising method and electronic device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7505894B2 (en) * 2004-11-04 2009-03-17 Microsoft Corporation Order model for dependency structure
CN101950364A (en) * 2010-08-30 2011-01-19 西安电子科技大学 Remote sensing image change detection method based on neighbourhood similarity and threshold segmentation
CN101976443A (en) * 2010-11-09 2011-02-16 西安电子科技大学 Road extraction method using non-subsampled contourlet direction field
CN102063708A (en) * 2011-01-06 2011-05-18 西安电子科技大学 Image denoising method based on Treelet and non-local means
CN102063720A (en) * 2011-01-06 2011-05-18 西安电子科技大学 Treelets-based method for detecting remote sensing image changes

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7505894B2 (en) * 2004-11-04 2009-03-17 Microsoft Corporation Order model for dependency structure
CN101950364A (en) * 2010-08-30 2011-01-19 西安电子科技大学 Remote sensing image change detection method based on neighbourhood similarity and threshold segmentation
CN101976443A (en) * 2010-11-09 2011-02-16 西安电子科技大学 Road extraction method using non-subsampled contourlet direction field
CN102063708A (en) * 2011-01-06 2011-05-18 西安电子科技大学 Image denoising method based on Treelet and non-local means
CN102063720A (en) * 2011-01-06 2011-05-18 西安电子科技大学 Treelets-based method for detecting remote sensing image changes

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
《The Annals of Applied Statistics》 20081231 ANN B. LEE et al TREELETS-AN ADAPTIVE MULTI-SCALE BASIS FOR SPARSE UNORDERED DATA 435-471 1-3 第2卷, 第2期 *
ANN B. LEE ET AL: "TREELETS—AN ADAPTIVE MULTI-SCALE BASIS FOR SPARSE UNORDERED DATA", 《THE ANNALS OF APPLIED STATISTICS》, vol. 2, no. 2, 31 December 2008 (2008-12-31), pages 435 - 471 *
GUITING WANG ET AL: "Unsupervised change detection for remote sensing images using multiscale decomposition and treelet fusion: A level set approach", 《2011 IEEE CIE INTERNATIONAL CONFERENCE ONRADAR (RADAR)》, vol. 2, 1 January 2011 (2011-01-01), pages 1558 - 1561 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102663724A (en) * 2012-03-03 2012-09-12 西安电子科技大学 Method for detecting remote sensing image change based on adaptive difference images
CN102663724B (en) * 2012-03-03 2014-08-06 西安电子科技大学 Method for detecting remote sensing image change based on adaptive difference images
CN102831598B (en) * 2012-07-04 2014-10-01 西安电子科技大学 Remote sensing image change detecting method with combination of multi-resolution NMF (non-negative matrix factorization) and Treelet
CN102831598A (en) * 2012-07-04 2012-12-19 西安电子科技大学 Remote sensing image change detecting method with combination of multi-resolution NMF (non-negative matrix factorization) and Treelet
CN103077525A (en) * 2013-01-27 2013-05-01 西安电子科技大学 Treelet image fusion-based remote sensing image change detection method
CN103077525B (en) * 2013-01-27 2016-03-02 西安电子科技大学 Based on the method for detecting change of remote sensing image of Treelet image co-registration
CN103824302B (en) * 2014-03-12 2016-08-17 西安电子科技大学 The SAR image change detection merged based on direction wave area image
CN103824302A (en) * 2014-03-12 2014-05-28 西安电子科技大学 SAR (synthetic aperture radar) image change detecting method based on direction wave domain image fusion
CN103955943A (en) * 2014-05-21 2014-07-30 西安电子科技大学 Non-supervision change detection method based on fuse change detection operators and dimension driving
CN104851090A (en) * 2015-04-28 2015-08-19 四川九洲电器集团有限责任公司 Image change detection method and image change detection device
CN104851090B (en) * 2015-04-28 2017-12-26 四川九洲电器集团有限责任公司 Image change detection method and device
CN105160355B (en) * 2015-08-28 2018-05-15 北京理工大学 A kind of method for detecting change of remote sensing image based on region correlation and vision word
CN105160355A (en) * 2015-08-28 2015-12-16 北京理工大学 Remote sensing image change detection method based on region correlation and visual words
CN106971392B (en) * 2017-03-17 2019-09-20 自然资源部国土卫星遥感应用中心 A kind of method for detecting change of remote sensing image and device of combination DT-CWT and MRF
CN106971392A (en) * 2017-03-17 2017-07-21 国家测绘地理信息局卫星测绘应用中心 A kind of combination DT CWT and MRF method for detecting change of remote sensing image and device
CN107610095A (en) * 2017-08-04 2018-01-19 南京邮电大学 Heart CT coronary artery full-automatic partition methods based on image co-registration
CN109345475A (en) * 2018-09-19 2019-02-15 长安大学 A kind of unmanned aerial vehicle remote sensing mountain highway Image Fusion Filtering method
CN109345475B (en) * 2018-09-19 2021-07-23 长安大学 Unmanned aerial vehicle remote sensing mountain road image fusion filtering method
CN110503631A (en) * 2019-07-24 2019-11-26 山东师范大学 A kind of method for detecting change of remote sensing image
WO2021135702A1 (en) * 2019-12-31 2021-07-08 百果园技术(新加坡)有限公司 Video denoising method and electronic device

Also Published As

Publication number Publication date
CN102254323B (en) 2013-02-27

Similar Documents

Publication Publication Date Title
CN102254323B (en) Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation
Huang et al. Deep point embedding for urban classification using ALS point clouds: A new perspective from local to global
Mukhopadhyay et al. A survey of Hough Transform
Wang et al. A review of road extraction from remote sensing images
CN101673345B (en) Method for extracting target closed contour based on shape prior
Li et al. Object-oriented classification of high-resolution remote sensing imagery based on an improved colour structure code and a support vector machine
Yuan et al. Particle filter re-detection for visual tracking via correlation filters
Bhowmick et al. Divide and conquer: Efficient large-scale structure from motion using graph partitioning
Cascianelli et al. Robust visual semi-semantic loop closure detection by a covisibility graph and CNN features
CN102831598B (en) Remote sensing image change detecting method with combination of multi-resolution NMF (non-negative matrix factorization) and Treelet
CN102629380B (en) Remote sensing image change detection method based on multi-group filtering and dimension reduction
US11587249B2 (en) Artificial intelligence (AI) system and methods for generating estimated height maps from electro-optic imagery
Huang et al. Automatic building change image quality assessment in high resolution remote sensing based on deep learning
Strisciuglio et al. Detection of curved lines with b-cosfire filters: A case study on crack delineation
US11636649B2 (en) Geospatial modeling system providing 3D geospatial model update based upon predictively registered image and related methods
Miao et al. Information fusion for urban road extraction from VHR optical satellite images
CN102663724A (en) Method for detecting remote sensing image change based on adaptive difference images
Fu et al. Road detection from optical remote sensing imagery using circular projection matching and tracking strategy
Wang et al. A novel sparse boosting method for crater detection in the high resolution planetary image
Ouma et al. Multiscale remote sensing data segmentation and post-segmentation change detection based on logical modeling: Theoretical exposition and experimental results for forestland cover change analysis
Jiao et al. Extracting wetlands from swiss historical maps with convolutional neural networks
Xiaolan et al. Texture Feature Extraction Method Combining Nonsubsampled Contour Transformation with Gray Level Co-occurrence Matrix.
Kustra et al. Computing refined skeletal features from medial point clouds
Wang et al. Complex shearlets and rotary phase congruence tensor for corner detection
Soni et al. Road centerline extraction from VHR images using SVM and multi-scale maximum response filter

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130227

Termination date: 20180610

CF01 Termination of patent right due to non-payment of annual fee