CN105787943A - SAR image registration method based on multi-scale image block characteristics and sparse expression - Google Patents

SAR image registration method based on multi-scale image block characteristics and sparse expression Download PDF

Info

Publication number
CN105787943A
CN105787943A CN201610118533.9A CN201610118533A CN105787943A CN 105787943 A CN105787943 A CN 105787943A CN 201610118533 A CN201610118533 A CN 201610118533A CN 105787943 A CN105787943 A CN 105787943A
Authority
CN
China
Prior art keywords
characteristic point
reference picture
point
image
registration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610118533.9A
Other languages
Chinese (zh)
Other versions
CN105787943B (en
Inventor
吴艳
樊建伟
梁文楷
于丰
张磊
李明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN201610118533.9A priority Critical patent/CN105787943B/en
Publication of CN105787943A publication Critical patent/CN105787943A/en
Application granted granted Critical
Publication of CN105787943B publication Critical patent/CN105787943B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G06T3/147
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10032Satellite or aerial image; Remote sensing
    • G06T2207/10044Radar image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20048Transform domain processing
    • G06T2207/20064Wavelet transform [DWT]

Abstract

The invention discloses an SAR image registration method based on multi-scale image block characteristics and sparse expression, and mainly solves the problem that an existing registration method is poor in effect when applied to SAR image registration. The SAR image registration method comprises the steps of: 1) inputting two SAR images, selecting any one as a reference image, and using the other one as an image to be registered; 2) selecting characteristic points of the reference image; 3) utilizing the multi-scale image block characteristics to construct characteristic point descriptors of the reference image and the image to be registered; 4) establishing matching point pairs between the reference image and the image to be registered; 5) removing abnormal points in the matching point pairs; 6) establishing an affine transformation model according to the finally obtained matching point pairs, adopting a least square method to obtain geometric deformation parameters, and obtaining a registration result. Compared with the prior art, the robustness to spot noise is improved, the accuracy and the matching precision of the matching point pairs are improved, and the SAR image registration method can be applied to image fusion and change detection.

Description

SAR image registration method based on multi-scale image block feature and rarefaction representation
Technical field
The invention belongs to technical field of image processing, be specifically related to the method for registering images during radar image processes, can be used for image co-registration and change-detection.
Background technology
Synthetic aperture radar SAR system is because of its round-the-clock, round-the-clock, has the features such as penetrance and is widely used in military and civilian neighborhood.SAR image registration apply as SAR image in key link, it is two width to the same scenery taking from different time, different visual angles or several SAR image are mated, the process of superposition.
For image registration problem, the method proposed at present substantially can be divided into two classes: based on the method for registering of gray scale and feature based.The half-tone information of image is directly utilized, the registration parameter such as translation corresponding when searching out Optimum Matching by setting up certain similarity measure between image pixel, rotation based on the method for registering of gray scale.The most frequently used method for registering based on gray scale is based on the method for registering of mutual information.Although this method comparison is directly perceived, it is easy to realize, but computation complexity is high, it is easy to be absorbed in locally optimal solution, and easily affected by noise.The method for registering of feature based is owing to being not directly placed on image intensity value, but acts on the feature of image itself, thus grey scale change has stronger adaptive capacity, and amount of calculation is little, it is possible to process the registration problems between image.The method for registering of the most frequently used feature based is based on the method for registering of Scale invariant features transform SIFT feature.Yet with there is speckle noise in SAR image, the method for registering of feature based is when processing SAR image registration, it is more likely that being detected by speckle noise is characteristic point, thus substantial amounts of error matching points can be brought, and the registration result led to errors.
Summary of the invention
It is an object of the invention to propose a kind of SAR image registration method based on multi-scale image block feature and rarefaction representation, during to solve prior art carries out SAR image registration, a large amount of error matching points occurs, cause the problem that registration accuracy is not high.
The technical thought realizing the object of the invention is: utilize the characteristic point that space correlation Sexual behavior mode is highly reliable, multi-scale image block feature is adopted to form feature descriptor, best matching double points is obtained according to the minimum difference criterion that rarefaction representation technology calculates, effectively strengthening the robustness to speckle noise, implementation step includes as follows:
(1) inputting two width images, an optional width is as reference picture I1, using another width as image I subject to registration2
(2) reference picture characteristic point is chosen:
(2a) SIFT algorithm is adopted to extract reference picture I1Characteristic point, and by I1All characteristic points leave in the first set R;
(2b) from reference picture characteristic point set R, a characteristic point r is arbitrarily choseni, utilize Stationary Wavelet Transform method to calculate the spatial coherence ρ (r of each Feature point correspondencei);
(2c) threshold value E=0.05 is set, if the ρ (r obtainedi) meet ρ (ri) >=E, then by reference picture characteristic point riRetain, otherwise, delete this characteristic point;
(2d) travel through all characteristic points of reference picture, repeat step (2b)-(2c), the reference picture characteristic point after being screened;
(2e) the Euclidean distance E between any two characteristic point in reference picture characteristic point set is calculated after above-mentioned screening respectivelydIf, Ed>=15, then retain the two characteristic point, otherwise remove;
(2f) front 10 characteristic points in characteristic point set step (2e) obtained are as final reference picture characteristic point;
(3) multiscale image block feature construction reference picture characteristic point descriptor is utilized:
(3a) arbitrarily choose a reference picture characteristic point a, take image block P (a) of this characteristic point surrounding neighbors 15 × 15;
(3b) adopt Stationary Wavelet Transform that image block P (a) is carried out multi-resolution decomposition, obtain the image block P of three different decomposition yardstickss(a), s=3,4,5;
(3c) the grey level histogram vector H of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the gray feature of feature descriptor;
(3d) the gradient orientation histogram vector G of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the Gradient Features of feature descriptor;
(3e) gray feature corresponding for different decomposition yardstick image block and Gradient Features are together in series, obtain reference picture characteristic point a characteristic of correspondence descriptor F (a)={ H3(a),H4(a),H5(a),G3(a),G4(a),G5(a)};
(4) for any one image characteristic point b subject to registration, its characteristic point descriptor F (b) is obtained according to the operation that step (3) is same, utilize the similarity between reference picture characteristic point descriptor F (a) and image characteristic point descriptor F (b) subject to registration, set up the matching double points between reference picture and image subject to registration;
(5) abnormity point in the matching double points that removal step (4) obtains:
(5a) from the matching double points that step (4) obtains, a reference picture characteristic point r is arbitrarily chosenc, the reference picture characteristic point mated takes 3 neighborhood points of this characteristic point arest neighbors, and these 3 the neighborhood points taken is mapped to and reference picture characteristic point rcBecome the image characteristic point t subject to registration of match pointcNeighborhood in, calculate this reference picture characteristic point rcAnd the geometry cost between its neighborhood point
O ( r c , r c k , t c , t m ( k ) ) = Σ k = 1 3 | | r c - r c k | | - | | t c - t m ( k ) | | | | r c - r c k | | + | | t c - t m ( k ) | | ,
Wherein,Represent reference picture characteristic point rcKth nearest neighbor point, tcRepresent and reference picture characteristic point rcThe image characteristic point subject to registration matched, m () represents adaptation function, | | | | represent Euclidean distance, c represents the index of matching double points, its span is 1 to 10, and k represents the index of the nearest neighbor point that the c reference picture characteristic point take, and its span is 1 to 3;
(5b) travel through and all mated reference picture characteristic point, repeat step (5a), mated the geometry cost between reference picture characteristic point and its respective neighborhood point, using all characteristic points corresponding for geometry Least-cost value as datum mark set, be expressed as:
m b a s e = { ( r c , t c ) , ( r c 1 , t m ( 1 ) ) , ... , ( r c k , t m ( k ) ) , ... , ( r c 3 , t m ( 3 ) ) } ,
Wherein, (rc,tc) represent matching double points, tm(k)Represent and neighborhood pointCorresponding match point;
(5c) following formula is adopted to calculate residue match point to the geometry cost between datum mark:
O ( r c ′ , r b a s e o , t c ′ , t m ( o ) ) = Σ o = 1 4 | | r c ′ - r b a s e o | | - | | t c ′ - t m ( o ) | | | | r c ′ - r b a s e o | | + | | t c ′ - t m ( o ) | | , ( r c ′ , t c ′ ) ∉ m b a s e
Wherein, rc′And tc′Represent remaining reference picture characteristic point and image characteristic point subject to registration in matching double points respectively,Represent the o reference picture characteristic point in datum mark set, tm(o)Representing and the match point of the o reference picture Feature point correspondence in collection on schedule set, c ' represents the index of residue matching double points, and its span is 1 to 6, and o represents the index of datum mark, and its span is 1 to 4;
(5d) threshold value E is seto=0.03, if the geometry cost obtainedMeetThen by (rc′,tc′) as correct match point, otherwise, this matching double points is deleted;
(5e) repeat step (5c)-(5d), obtain reference picture and the final matching double points of image subject to registration;
(6) according to final matching double points obtained above, set up affine Transform Model, calculate the geometric deformation parameter of image subject to registration, and utilize this geometric deformation parameter, image subject to registration is carried out geometric transformation, obtains registration result.
The present invention compared with prior art has the advantage that
First, owing to the present invention is in the process to SAR image registration, adopt space correlation Sexual behavior mode characteristic point, utilize multiscale image block feature construction feature descriptor simultaneously, overcoming prior art cannot the deficiency of accurate description characteristic point attribute as block message only with single scalogram, make the present invention improve the significance of characteristic point, enhance the robustness to speckle noise.
Second, owing to the present invention utilizes the minimum difference criterion based on rarefaction representation technology to set up matching double points, adopt the geometrical-restriction relation between match point and its neighborhood point to filter feature abnormalities point simultaneously, overcoming prior art adopts Euclidean distance ratio method easily to occur the deficiency of error matching points in the process set up matching double points so that the present invention improves the accuracy of match point.
Accompanying drawing explanation
Fig. 1 is the flowchart of the present invention;
Fig. 2 is first group of the simulation experiment result figure of the present invention;
Fig. 3 is second group of the simulation experiment result figure of the present invention.
Detailed description of the invention
Below in conjunction with accompanying drawing, the present invention is described further:
With reference to Fig. 1, the enforcement step of the present invention is as follows:
Step 1, inputs two width images, and an optional width is as reference picture I1, using another width as image I subject to registration2
Two width images of input are to intercept respectively in the different polarization modes obtained at certain airborne radar or different phase two width SAR image.
Step 2, chooses reference picture characteristic point.
2.1) SIFT algorithm is adopted to extract reference picture I1Characteristic point, by I1All characteristic points leave in the first set R;
2.2) from reference picture characteristic point set R, a characteristic point r is arbitrarily choseni, utilize Stationary Wavelet Transform method to calculate the spatial coherence ρ (r of each Feature point correspondencei);
2.2a) utilize Stationary Wavelet Transform that input picture is carried out s Scale Decomposition, obtain the detail pictures that input picture is 3 kinds different on different scale;
2.2b) define arbitrary image pixel x amplitude M under s yardsticksX () is expressed as:
M s ( x ) = | W s h | 2 + | W s v | 2 + | W s d | 2
Wherein,It is illustrated respectively in s yardstick hypograph in the horizontal direction, vertical direction and diagonally adjacent detailed information, | | represent absolute value operation computing;
Following formula 2.2c) is adopted to calculate spatial coherence ρ (x) of pixel x:
ρ ( x ) = Π s = 3 5 M s ( x )
Wherein, ∏ () represents multiplication operations;
2.3) threshold value E=0.05 is set, if the ρ (r obtainedi) meet ρ (ri) >=E, then by reference picture characteristic point riRetain, otherwise, delete this characteristic point;
2.4) the traversal all characteristic points of reference picture, repeat step 2.2)-2.3), the reference picture characteristic point after being screened;
2.5) the Euclidean distance E between any two characteristic point in reference picture characteristic point set is calculated after above-mentioned screening respectivelydIf, Ed>=15, then retain the two characteristic point, otherwise remove;
2.6) using step 2.5) front 10 characteristic points in the characteristic point set that obtains are as final reference picture characteristic point.
Step 3: utilize multiscale image block feature construction reference picture characteristic point descriptor.
3.1) arbitrarily choose a reference picture characteristic point a, take image block P (a) of this characteristic point surrounding neighbors 15 × 15;
3.2) adopt Stationary Wavelet Transform that image block P (a) is carried out multi-resolution decomposition, obtain the image block P of three different decomposition yardstickss(a), s=3,4,5;
3.3) the grey level histogram vector H of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the gray feature of characteristic point descriptor;
3.4) the gradient orientation histogram vector G of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the Gradient Features of characteristic point descriptor;
3.5) gray feature corresponding for different decomposition yardstick image block and Gradient Features are together in series, obtain reference picture characteristic point a characteristic of correspondence descriptor F (a)={ H3(a),H4(a),H5(a),G3(a),G4(a),G5(a)}。
Step 4: for any one image characteristic point b subject to registration, its characteristic point descriptor F (b) is obtained according to the operation that step (3) is same, utilize the similarity between reference picture characteristic point descriptor F (a) and image characteristic point descriptor F (b) subject to registration, set up the matching double points between reference picture and image subject to registration.
The method forming matching double points has a variety of, common are arest neighbors method, Euclidean distance ratio etc., adopts but be not limited to set up based on the minimum difference criterion of rarefaction representation technology matching double points in this example, and it is as follows that it is embodied as step:
4.1) from the reference picture characteristic point that step (2) obtains, a characteristic point r is arbitrarily choseni, calculate its characteristic of correspondence descriptor F (ri);
4.2) set maximum side-play amount between reference picture and image subject to registration as l=100, image subject to registration is chosen the window W of L × L sizeiAs characteristic point riRegion of search, and by pixel { V all in this regionq: q=1,2 ..., Q, Q=L × L} is all as characteristic point riCandidate matches point, wherein L=2 × l+1;
4.3) for above-mentioned each candidate matches point Vq, take the window of this pixel surrounding neighbors 20 × 20, and by all pixel u in this windownCharacteristic of correspondence descriptor F (un) as VqCorresponding sparse dictionary Dq={ F (un), n=1,2 ..., J, J=20 × 20};
4.4) utilize orthogonal matching pursuit algorithm to solve following formula, obtain characteristic point riAt sparse dictionary DqUnder sparse vector αq
α q = argmin α q | | F ( r i ) - D q α q | | s . t . | | α q | | 0 ≤ C
Wherein, argmin () representative function reaches the value of independent variable during minima, | | | | represent Euclidean distance, | | | |0Representing zero norm, C represents degree of rarefication;
4.5) cycling among windows WiInterior all pixels, repeat step 4.3)-4.4), obtain characteristic point riSparse vector α under Q different sparse dictionaryq
4.6) it is calculated as follows characteristic point riWith any candidate matches point VqBetween reconstructed error, and using the pixel with minimal reconstruction error as characteristic point riMatch point m (ri)
m ( r i ) = argmin q | | F ( r i ) - D q α q | | ;
4.7) travel through all reference picture characteristic points, repeat step 4.1)-4.6), obtain the match point that all reference picture characteristic points are corresponding in image subject to registration, all characteristic points of image subject to registration left in the second set T.
Step 5: the abnormity point in the matching double points that removal step (4) obtains.
5.1) from the matching double points that step (4) obtains, a reference picture characteristic point r is arbitrarily chosenc, the reference picture characteristic point mated takes 3 neighborhood points of this characteristic point arest neighbors, and these 3 the neighborhood points taken is mapped to and reference picture characteristic point rcBecome the image characteristic point t subject to registration of match pointcNeighborhood in, calculate this reference picture characteristic point rcAnd the geometry cost between its neighborhood point
O ( r c , r c k , t c , t m ( k ) ) = Σ k = 1 3 | | r c - r c k | | - | | t c - t m ( k ) | | | | r c - r c k | | + | | t c - t m ( k ) | | ,
Wherein,Represent reference picture characteristic point rcKth nearest neighbor point, tcRepresent and reference picture characteristic point rcThe image characteristic point subject to registration matched, m () represents adaptation function, | | | | represent Euclidean distance, c represents the index of matching double points, its span is 1 to 10, and k represents the index of the nearest neighbor point that the c reference picture characteristic point take, and its span is 1 to 3;
5.2) travel through and all mated reference picture characteristic point, repeat step 5.1), mated the geometry cost between reference picture characteristic point and its respective neighborhood point, using all characteristic points corresponding for geometry Least-cost value as datum mark set, be expressed as:
m b a s e = { ( r c , t c ) , ( r c 1 , t m ( 1 ) ) , ... , ( r c k , t m ( k ) ) , ... , ( r c 3 , t m ( 3 ) ) } ,
Wherein, (rc,tc) represent matching double points, tm(k)Represent and neighborhood pointCorresponding match point;
5.3) following formula is adopted to calculate residue match point to the geometry cost between datum mark:
O ( r c ′ , r b a s e o , t m ( o ) ) = Σ o = 1 4 | | r c ′ - r b a s e o | | - | | t c ′ - t m ( o ) | | | | r c ′ - r b a s e o | | + | | t c ′ - t m ( o ) | | , ( r c ′ , t c ′ ) ∉ m b a s e
Wherein, rc′And tc′Represent remaining reference picture characteristic point and image characteristic point subject to registration in matching double points respectively,Represent the o reference picture characteristic point in datum mark set, tm(o)Representing and the match point of the o reference picture Feature point correspondence in collection on schedule set, c ' represents the index of residue matching double points, and its span is 1 to 6, and o represents the index of datum mark, and its span is 1 to 4;
5.4) threshold value E is seto=0.03, if the geometry cost obtainedMeetThen by (rc′,tc′) as correct match point, otherwise, this matching double points is deleted;
5.5) step 5.3 is repeated)-5.4), obtain reference picture and the final matching double points of image subject to registration.
Step 6: according to final matching double points, obtain registration result.
Affine Transform Model is set up according to final matching double points obtained above, calculating the geometric deformation parameter of image subject to registration, this example specifically adopts method of least square computational geometry deformation parameter, and utilizes this geometric deformation parameter, image subject to registration is carried out geometric transformation, obtains registration result.
Below in conjunction with experiment simulation, effect of the present invention is described further.
1. simulated conditions:
The Simulation Experimental Platform of the present invention adopts Intel (R) Pentium (R) CPUG32403.10GHz, inside saves as 4GB, runs the PC of Windows7, and programming language is Matlab2011b.
2. emulation content and interpretation of result:
Emulation 1, apply the method for registering images based on SIFT-OCT, method for registering images based on BFSIFT respectively, SAR image is carried out registration by method for registering images and the present invention based on NDSS-SIFT, result is as shown in Figure 2, wherein Fig. 2 (a) is based on the match point line graph of SIFT-OCT method, Fig. 2 (b) is based on the match point line graph of BFSIFT method, Fig. 2 (c) is based on the match point line graph of NDSS-SIFT method, and Fig. 2 (d) is the match point line graph of the present invention.In Fig. 2, yellow solid line represents correct matching double points, and red line represents error matching points pair.
Emulation 2, apply the method for registering images based on SIFT-OCT, method for registering images based on BFSIFT respectively, SAR image is carried out registration by method for registering images and the present invention based on NDSS-SIFT, result is as shown in Figure 3, wherein Fig. 3 (a) is based on the match point line graph of SIFT-OCT method, Fig. 3 (b) is based on the match point line graph of BFSIFT method, Fig. 3 (c) is based on the match point line graph of NDSS-SIFT method, and Fig. 3 (d) is the match point line graph of the present invention.In Fig. 3, yellow solid line represents correct matching double points, and red line represents error matching points pair.
Can be seen that from Fig. 2 (a)-2 (c) and Fig. 3 (a)-3 (c), SAR image pair is surveyed for 2 groups, all there is relatively more error matching points in SIFT-OCT method, BFSIFT method and 3 kinds of algorithms of NDSS-SIFT method.Wherein, SIFT-OCT method effect is worst, and the error matching points comprised is maximum.Error matching points in BFSIFT method and NDSS-SIFT method is to relatively fewer.
From Fig. 2 (d) and Fig. 3 (d) it can be seen that survey SAR image pair for 2 groups, the registration result that the present invention obtains is more accurate, does not comprise error matching points.This comes from the present invention and utilizes spatial coherence to choose reliable characteristic point, utilizes multiscale image block feature construction feature descriptor simultaneously, enhances the significance of feature descriptor and the robustness to speckle noise.Additionally, utilize the minimum difference criterion based on rarefaction representation technology to set up matching double points, improve the accuracy of matching double points, thus solving problem when prior art is applied to SAR image registration, a large amount of error matching points pair occurring.

Claims (3)

1., based on a SAR image registration method for multi-scale image block feature and rarefaction representation, comprise the steps:
(1) inputting two width images, an optional width is as reference picture I1, using another width as image I subject to registration2
(2) reference picture characteristic point is chosen:
(2a) SIFT algorithm is adopted to extract reference picture I1Characteristic point, and by I1All characteristic points leave in the first set R;
(2b) from reference picture characteristic point set R, a characteristic point r is arbitrarily choseni, utilize Stationary Wavelet Transform method to calculate the spatial coherence ρ (r of each Feature point correspondencei);
(2c) threshold value E=0.05 is set, if the ρ (r obtainedi) meet ρ (ri) >=E, then by reference picture characteristic point riRetain, otherwise, delete this characteristic point;
(2d) travel through all characteristic points of reference picture, repeat step (2b)-(2c), the reference picture characteristic point after being screened;
(2e) the Euclidean distance E between any two characteristic point in reference picture characteristic point set is calculated after above-mentioned screening respectivelydIf, Ed>=15, then retain the two characteristic point, otherwise remove;
(2f) front 10 characteristic points in characteristic point set step (2e) obtained are as final reference picture characteristic point;
(3) multiscale image block feature construction reference picture characteristic point descriptor is utilized:
(3a) arbitrarily choose a reference picture characteristic point a, take image block P (a) of this characteristic point surrounding neighbors 15 × 15;
(3b) adopt Stationary Wavelet Transform that image block P (a) is carried out multi-resolution decomposition, obtain the image block P of three different decomposition yardstickss(a), s=3,4,5;
(3c) the grey level histogram vector H of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the gray feature of feature descriptor;
(3d) the gradient orientation histogram vector G of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the Gradient Features of feature descriptor;
(3e) gray feature corresponding for different decomposition yardstick image block and Gradient Features are together in series, obtain reference picture characteristic point a characteristic of correspondence descriptor F (a)={ H3(a),H4(a),H5(a),G3(a),G4(a),G5(a)};
(4) for any one image characteristic point b subject to registration, its characteristic point descriptor F (b) is obtained according to the operation that step (3) is same, utilize the similarity between reference picture characteristic point descriptor F (a) and image characteristic point descriptor F (b) subject to registration, set up the matching double points between reference picture and image subject to registration;
(5) abnormity point in the matching double points that removal step (4) obtains:
(5a) from the matching double points that step (4) obtains, a reference picture characteristic point r is arbitrarily chosenc, the reference picture characteristic point mated takes 3 neighborhood points of this characteristic point arest neighbors, and these 3 the neighborhood points taken is mapped to and reference picture characteristic point rcBecome the image characteristic point t subject to registration of match pointcNeighborhood in, calculate this reference picture characteristic point rcAnd the geometry cost between its neighborhood point
O ( r c , r c k , t c , t m ( k ) ) = Σ k = 1 3 | | r c - r c k | | - | | t c - t m ( k ) | | | | r c - r c k | | + | | t c - t m ( k ) | | ,
Wherein,Represent reference picture characteristic point rcKth nearest neighbor point, tcRepresent and reference picture characteristic point rcThe image characteristic point subject to registration matched, m () represents adaptation function, | | | | represent Euclidean distance, c represents the index of matching double points, its span is 1 to 10, and k represents the index of the nearest neighbor point that the c reference picture characteristic point take, and its span is 1 to 3;
(5b) travel through and all mated reference picture characteristic point, repeat step (5a), mated the geometry cost between reference picture characteristic point and its respective neighborhood point, using all characteristic points corresponding for geometry Least-cost value as datum mark set, be expressed as:
m b a s e = { ( r c , t c ) , ( r c 1 , t m ( 1 ) ) , ... , ( r c k , t m ( k ) ) , ... , ( r c 3 , t m ( 3 ) ) } ,
Wherein, (rc,tc) represent matching double points, tm(k)Represent and neighborhood pointCorresponding match point;
(5c) following formula is adopted to calculate residue match point to the geometry cost between datum mark:
O ( r c ′ , r b a s e o , t c ′ , t m ( o ) ) = Σ o = 1 4 | | r c ′ - r b a s e o | | - | | t c ′ - t m ( o ) | | | | r c ′ - r b a s e o | | + | | t c ′ - t m ( o ) | | , ( r c ′ , t c ′ ) ∉ m b a s e
Wherein, rc′And tc′Represent remaining reference picture characteristic point and image characteristic point subject to registration in matching double points respectively,Represent the o reference picture characteristic point in datum mark set, tm(o)Representing and the match point of the o reference picture Feature point correspondence in collection on schedule set, c ' represents the index of residue matching double points, and its span is 1 to 6, and o represents the index of datum mark, and its span is 1 to 4.
(5d) threshold value E is seto=0.03, if the geometry cost obtainedMeetThen by (rc′,tc′) as correct match point, otherwise, this matching double points is deleted;
(5e) repeat step (5c)-(5d), obtain reference picture and the final matching double points of image subject to registration;
(6) according to final matching double points obtained above, set up affine Transform Model, calculate the geometric deformation parameter of image subject to registration, and utilize this geometric deformation parameter, image subject to registration is carried out geometric transformation, obtains registration result.
2. SAR image registration method according to claim 1, it is characterised in that utilize Stationary Wavelet Transform method to calculate the spatial coherence of each Feature point correspondence in step (2b), carry out as follows:
2b1) utilize Stationary Wavelet Transform that input picture is carried out s Scale Decomposition, obtain the detail pictures that input picture is 3 kinds different on different scale;
2b2) define arbitrary image pixel x amplitude M under s yardsticksX () is expressed as:
M s ( x ) = | W s h | 2 + | W s v | 2 + | W s d | 2
Wherein,It is illustrated respectively in s yardstick hypograph in the horizontal direction, vertical direction and diagonally adjacent detailed information, | | represent absolute value operation computing;
Following formula 2b3) is adopted to calculate spatial coherence ρ (x) of pixel x:
ρ ( x ) = Π s = 3 5 M s ( x )
Wherein, ∏ () represents multiplication operations.
3. the SAR image registration method based on multi-scale image block feature and rarefaction representation according to claim 1, it is characterised in that set up the matching double points between reference picture and image subject to registration in described step (4), carry out as follows:
4a) from the reference picture characteristic point that step (2) obtains, arbitrarily choose a characteristic point ri, calculate its characteristic of correspondence descriptor F (ri);
4b) set maximum side-play amount between reference picture and image subject to registration as l=100, image subject to registration is chosen the window W of L × L sizeiAs characteristic point riRegion of search, by pixel { V all in this regionq: q=1,2 ..., Q, Q=L × L} is all as characteristic point riCandidate matches point, wherein L=2 × l+1;
4c) for above-mentioned each candidate matches point Vq, take the window of this pixel surrounding neighbors 20 × 20, and by all pixel u in this windownCharacteristic of correspondence descriptor F (un) as VqCorresponding sparse dictionary Dq={ F (un), n=1,2 ..., J, J=20 × 20};
4d) utilize orthogonal matching pursuit algorithm to solve following formula, obtain characteristic point riAt sparse dictionary DqUnder sparse vector αq
α q = arg min α q | | F ( r i ) - D q α q | | s . t . | | α q | | 0 ≤ C
Wherein, argmin () representative function reaches the value of independent variable during minima, | | | | represent Euclidean distance, | | | |0Representing zero norm, C represents degree of rarefication;
4e) cycling among windows WiInterior all pixels, repeat step 4c)-4d), obtain characteristic point riSparse vector α under Q different sparse dictionaryq
4f) it is calculated as follows characteristic point riWith any candidate matches point VqBetween reconstructed error, and using the pixel with minimal reconstruction error as characteristic point riMatch point m (ri)
m ( r i ) = arg min q | | F ( r i ) - D q α q | | ;
4g) travel through all reference picture characteristic points, repeat step (4a)-(4f), obtain the match point that all reference picture characteristic points are corresponding in image subject to registration, all characteristic points of image subject to registration are left in the second set T.
CN201610118533.9A 2016-03-03 2016-03-03 SAR image registration method based on multi-scale image block feature and rarefaction representation Active CN105787943B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610118533.9A CN105787943B (en) 2016-03-03 2016-03-03 SAR image registration method based on multi-scale image block feature and rarefaction representation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610118533.9A CN105787943B (en) 2016-03-03 2016-03-03 SAR image registration method based on multi-scale image block feature and rarefaction representation

Publications (2)

Publication Number Publication Date
CN105787943A true CN105787943A (en) 2016-07-20
CN105787943B CN105787943B (en) 2018-08-31

Family

ID=56386825

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610118533.9A Active CN105787943B (en) 2016-03-03 2016-03-03 SAR image registration method based on multi-scale image block feature and rarefaction representation

Country Status (1)

Country Link
CN (1) CN105787943B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108627835A (en) * 2018-06-29 2018-10-09 中国科学院电子学研究所 The object reconstruction method of complete polarization difference SAR chromatographies
CN109166336A (en) * 2018-10-19 2019-01-08 福建工程学院 A kind of real-time road condition information acquisition method for pushing based on block chain technology
CN109741275A (en) * 2018-12-28 2019-05-10 济南大学 A kind of Enhancement Method and system of MVCT image
CN109816619A (en) * 2019-01-28 2019-05-28 努比亚技术有限公司 Image interfusion method, device, terminal and computer readable storage medium
CN110033422A (en) * 2019-04-10 2019-07-19 北京科技大学 A kind of eyeground OCT image fusion method and device
CN112184785A (en) * 2020-09-30 2021-01-05 西安电子科技大学 Multi-mode remote sensing image registration method based on MCD measurement and VTM
CN116008911A (en) * 2022-12-02 2023-04-25 南昌工程学院 Orthogonal matching pursuit sound source identification method based on novel atomic matching criteria

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177444A (en) * 2013-03-08 2013-06-26 中国电子科技集团公司第十四研究所 Automatic SAR (synthetic-aperture radar) image rectification method
CN103839265A (en) * 2014-02-26 2014-06-04 西安电子科技大学 SAR image registration method based on SIFT and normalized mutual information

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177444A (en) * 2013-03-08 2013-06-26 中国电子科技集团公司第十四研究所 Automatic SAR (synthetic-aperture radar) image rectification method
CN103839265A (en) * 2014-02-26 2014-06-04 西安电子科技大学 SAR image registration method based on SIFT and normalized mutual information

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
GUITING WANG等: "Change detection based on image segment and fusion in multitemporal SAR images", 《SYNTHETIC APERTURE RADAR, 2009. APSAR 2009. 2ND ASIAN-PACIFIC CONFERENCE ON》 *
刘爱平等: "基于MAR-MRF的SAR图像分割方法", 《电子与信息学报》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108627835A (en) * 2018-06-29 2018-10-09 中国科学院电子学研究所 The object reconstruction method of complete polarization difference SAR chromatographies
CN108627835B (en) * 2018-06-29 2021-07-27 中国科学院电子学研究所 Target reconstruction method of fully-polarized differential SAR (synthetic aperture radar) chromatography
CN109166336B (en) * 2018-10-19 2020-08-07 福建工程学院 Real-time road condition information acquisition and pushing method based on block chain technology
CN109166336A (en) * 2018-10-19 2019-01-08 福建工程学院 A kind of real-time road condition information acquisition method for pushing based on block chain technology
CN109741275B (en) * 2018-12-28 2020-06-12 济南大学 MVCT image enhancement method and system
CN109741275A (en) * 2018-12-28 2019-05-10 济南大学 A kind of Enhancement Method and system of MVCT image
CN109816619A (en) * 2019-01-28 2019-05-28 努比亚技术有限公司 Image interfusion method, device, terminal and computer readable storage medium
CN110033422A (en) * 2019-04-10 2019-07-19 北京科技大学 A kind of eyeground OCT image fusion method and device
CN110033422B (en) * 2019-04-10 2021-03-23 北京科技大学 Fundus OCT image fusion method and device
CN112184785A (en) * 2020-09-30 2021-01-05 西安电子科技大学 Multi-mode remote sensing image registration method based on MCD measurement and VTM
CN112184785B (en) * 2020-09-30 2023-03-24 西安电子科技大学 Multi-mode remote sensing image registration method based on MCD measurement and VTM
CN116008911A (en) * 2022-12-02 2023-04-25 南昌工程学院 Orthogonal matching pursuit sound source identification method based on novel atomic matching criteria
CN116008911B (en) * 2022-12-02 2023-08-22 南昌工程学院 Orthogonal matching pursuit sound source identification method based on novel atomic matching criteria

Also Published As

Publication number Publication date
CN105787943B (en) 2018-08-31

Similar Documents

Publication Publication Date Title
CN105787943A (en) SAR image registration method based on multi-scale image block characteristics and sparse expression
Wang et al. Fusing bird’s eye view lidar point cloud and front view camera image for 3d object detection
Ma et al. Robust feature matching for remote sensing image registration via locally linear transforming
Venugopal Automatic semantic segmentation with DeepLab dilated learning network for change detection in remote sensing images
CN103822616A (en) Remote-sensing image matching method with combination of characteristic segmentation with topographic inequality constraint
CN105404886A (en) Feature model generating method and feature model generating device
CN103279955B (en) Image matching method and system
Chen et al. Dr-tanet: Dynamic receptive temporal attention network for street scene change detection
CN104504723A (en) Image registration method based on remarkable visual features
Wang et al. MCF3D: Multi-stage complementary fusion for multi-sensor 3D object detection
CN104732546A (en) Non-rigid SAR image registration method based on region similarity and local spatial constraint
Shao et al. Faster R-CNN learning-based semantic filter for geometry estimation and its application in vSLAM systems
Tanathong et al. Using GPS/INS data to enhance image matching for real-time aerial triangulation
CN116664856A (en) Three-dimensional target detection method, system and storage medium based on point cloud-image multi-cross mixing
CN116703996A (en) Monocular three-dimensional target detection algorithm based on instance-level self-adaptive depth estimation
Phogat et al. Different image registration methods—an overview
CN114998630A (en) Ground-to-air image registration method from coarse to fine
Li et al. A new framework of hyperspectral image classification based on spatial spectral interest point
Haryono et al. Oriented object detection in satellite images using convolutional neural network based on ResNeXt
US20230120433A1 (en) Methods and apparatuses for detecting a change in an area of interest
Yuan et al. Graph neural network based multi-feature fusion for building change detection
Zhou et al. Design identification of curve patterns on cultural heritage objects: combining template matching and CNN-based re-ranking
Basaru et al. HandyDepth: Example-based stereoscopic hand depth estimation using Eigen Leaf Node Features
CN111127311A (en) Image registration method based on micro-coincidence region
Bughin et al. Planar patch detection for disparity maps

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant