CN105787943A - SAR image registration method based on multi-scale image block characteristics and sparse expression - Google Patents
SAR image registration method based on multi-scale image block characteristics and sparse expression Download PDFInfo
- Publication number
- CN105787943A CN105787943A CN201610118533.9A CN201610118533A CN105787943A CN 105787943 A CN105787943 A CN 105787943A CN 201610118533 A CN201610118533 A CN 201610118533A CN 105787943 A CN105787943 A CN 105787943A
- Authority
- CN
- China
- Prior art keywords
- characteristic point
- reference picture
- point
- image
- registration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims abstract description 4
- 230000009466 transformation Effects 0.000 claims abstract description 4
- 238000000354 decomposition reaction Methods 0.000 claims description 17
- 238000004422 calculation algorithm Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 5
- HUTDUHSNJYTCAR-UHFFFAOYSA-N ancymidol Chemical compound C1=CC(OC)=CC=C1C(O)(C=1C=NC=NC=1)C1CC1 HUTDUHSNJYTCAR-UHFFFAOYSA-N 0.000 claims description 4
- 230000006978 adaptation Effects 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 230000001351 cycling effect Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 3
- 230000008859 change Effects 0.000 abstract description 2
- 238000001514 detection method Methods 0.000 abstract description 2
- 230000002159 abnormal effect Effects 0.000 abstract 1
- 230000004927 fusion Effects 0.000 abstract 1
- 238000005516 engineering process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004088 simulation Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000007812 deficiency Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009329 sexual behaviour Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 238000011524 similarity measure Methods 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G06T3/147—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
- G06T2207/10044—Radar image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20064—Wavelet transform [DWT]
Abstract
The invention discloses an SAR image registration method based on multi-scale image block characteristics and sparse expression, and mainly solves the problem that an existing registration method is poor in effect when applied to SAR image registration. The SAR image registration method comprises the steps of: 1) inputting two SAR images, selecting any one as a reference image, and using the other one as an image to be registered; 2) selecting characteristic points of the reference image; 3) utilizing the multi-scale image block characteristics to construct characteristic point descriptors of the reference image and the image to be registered; 4) establishing matching point pairs between the reference image and the image to be registered; 5) removing abnormal points in the matching point pairs; 6) establishing an affine transformation model according to the finally obtained matching point pairs, adopting a least square method to obtain geometric deformation parameters, and obtaining a registration result. Compared with the prior art, the robustness to spot noise is improved, the accuracy and the matching precision of the matching point pairs are improved, and the SAR image registration method can be applied to image fusion and change detection.
Description
Technical field
The invention belongs to technical field of image processing, be specifically related to the method for registering images during radar image processes, can be used for image co-registration and change-detection.
Background technology
Synthetic aperture radar SAR system is because of its round-the-clock, round-the-clock, has the features such as penetrance and is widely used in military and civilian neighborhood.SAR image registration apply as SAR image in key link, it is two width to the same scenery taking from different time, different visual angles or several SAR image are mated, the process of superposition.
For image registration problem, the method proposed at present substantially can be divided into two classes: based on the method for registering of gray scale and feature based.The half-tone information of image is directly utilized, the registration parameter such as translation corresponding when searching out Optimum Matching by setting up certain similarity measure between image pixel, rotation based on the method for registering of gray scale.The most frequently used method for registering based on gray scale is based on the method for registering of mutual information.Although this method comparison is directly perceived, it is easy to realize, but computation complexity is high, it is easy to be absorbed in locally optimal solution, and easily affected by noise.The method for registering of feature based is owing to being not directly placed on image intensity value, but acts on the feature of image itself, thus grey scale change has stronger adaptive capacity, and amount of calculation is little, it is possible to process the registration problems between image.The method for registering of the most frequently used feature based is based on the method for registering of Scale invariant features transform SIFT feature.Yet with there is speckle noise in SAR image, the method for registering of feature based is when processing SAR image registration, it is more likely that being detected by speckle noise is characteristic point, thus substantial amounts of error matching points can be brought, and the registration result led to errors.
Summary of the invention
It is an object of the invention to propose a kind of SAR image registration method based on multi-scale image block feature and rarefaction representation, during to solve prior art carries out SAR image registration, a large amount of error matching points occurs, cause the problem that registration accuracy is not high.
The technical thought realizing the object of the invention is: utilize the characteristic point that space correlation Sexual behavior mode is highly reliable, multi-scale image block feature is adopted to form feature descriptor, best matching double points is obtained according to the minimum difference criterion that rarefaction representation technology calculates, effectively strengthening the robustness to speckle noise, implementation step includes as follows:
(1) inputting two width images, an optional width is as reference picture I1, using another width as image I subject to registration2;
(2) reference picture characteristic point is chosen:
(2a) SIFT algorithm is adopted to extract reference picture I1Characteristic point, and by I1All characteristic points leave in the first set R;
(2b) from reference picture characteristic point set R, a characteristic point r is arbitrarily choseni, utilize Stationary Wavelet Transform method to calculate the spatial coherence ρ (r of each Feature point correspondencei);
(2c) threshold value E=0.05 is set, if the ρ (r obtainedi) meet ρ (ri) >=E, then by reference picture characteristic point riRetain, otherwise, delete this characteristic point;
(2d) travel through all characteristic points of reference picture, repeat step (2b)-(2c), the reference picture characteristic point after being screened;
(2e) the Euclidean distance E between any two characteristic point in reference picture characteristic point set is calculated after above-mentioned screening respectivelydIf, Ed>=15, then retain the two characteristic point, otherwise remove;
(2f) front 10 characteristic points in characteristic point set step (2e) obtained are as final reference picture characteristic point;
(3) multiscale image block feature construction reference picture characteristic point descriptor is utilized:
(3a) arbitrarily choose a reference picture characteristic point a, take image block P (a) of this characteristic point surrounding neighbors 15 × 15;
(3b) adopt Stationary Wavelet Transform that image block P (a) is carried out multi-resolution decomposition, obtain the image block P of three different decomposition yardstickss(a), s=3,4,5;
(3c) the grey level histogram vector H of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the gray feature of feature descriptor;
(3d) the gradient orientation histogram vector G of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the Gradient Features of feature descriptor;
(3e) gray feature corresponding for different decomposition yardstick image block and Gradient Features are together in series, obtain reference picture characteristic point a characteristic of correspondence descriptor F (a)={ H3(a),H4(a),H5(a),G3(a),G4(a),G5(a)};
(4) for any one image characteristic point b subject to registration, its characteristic point descriptor F (b) is obtained according to the operation that step (3) is same, utilize the similarity between reference picture characteristic point descriptor F (a) and image characteristic point descriptor F (b) subject to registration, set up the matching double points between reference picture and image subject to registration;
(5) abnormity point in the matching double points that removal step (4) obtains:
(5a) from the matching double points that step (4) obtains, a reference picture characteristic point r is arbitrarily chosenc, the reference picture characteristic point mated takes 3 neighborhood points of this characteristic point arest neighbors, and these 3 the neighborhood points taken is mapped to and reference picture characteristic point rcBecome the image characteristic point t subject to registration of match pointcNeighborhood in, calculate this reference picture characteristic point rcAnd the geometry cost between its neighborhood point
Wherein,Represent reference picture characteristic point rcKth nearest neighbor point, tcRepresent and reference picture characteristic point rcThe image characteristic point subject to registration matched, m () represents adaptation function, | | | | represent Euclidean distance, c represents the index of matching double points, its span is 1 to 10, and k represents the index of the nearest neighbor point that the c reference picture characteristic point take, and its span is 1 to 3;
(5b) travel through and all mated reference picture characteristic point, repeat step (5a), mated the geometry cost between reference picture characteristic point and its respective neighborhood point, using all characteristic points corresponding for geometry Least-cost value as datum mark set, be expressed as:
Wherein, (rc,tc) represent matching double points, tm(k)Represent and neighborhood pointCorresponding match point;
(5c) following formula is adopted to calculate residue match point to the geometry cost between datum mark:
Wherein, rc′And tc′Represent remaining reference picture characteristic point and image characteristic point subject to registration in matching double points respectively,Represent the o reference picture characteristic point in datum mark set, tm(o)Representing and the match point of the o reference picture Feature point correspondence in collection on schedule set, c ' represents the index of residue matching double points, and its span is 1 to 6, and o represents the index of datum mark, and its span is 1 to 4;
(5d) threshold value E is seto=0.03, if the geometry cost obtainedMeetThen by (rc′,tc′) as correct match point, otherwise, this matching double points is deleted;
(5e) repeat step (5c)-(5d), obtain reference picture and the final matching double points of image subject to registration;
(6) according to final matching double points obtained above, set up affine Transform Model, calculate the geometric deformation parameter of image subject to registration, and utilize this geometric deformation parameter, image subject to registration is carried out geometric transformation, obtains registration result.
The present invention compared with prior art has the advantage that
First, owing to the present invention is in the process to SAR image registration, adopt space correlation Sexual behavior mode characteristic point, utilize multiscale image block feature construction feature descriptor simultaneously, overcoming prior art cannot the deficiency of accurate description characteristic point attribute as block message only with single scalogram, make the present invention improve the significance of characteristic point, enhance the robustness to speckle noise.
Second, owing to the present invention utilizes the minimum difference criterion based on rarefaction representation technology to set up matching double points, adopt the geometrical-restriction relation between match point and its neighborhood point to filter feature abnormalities point simultaneously, overcoming prior art adopts Euclidean distance ratio method easily to occur the deficiency of error matching points in the process set up matching double points so that the present invention improves the accuracy of match point.
Accompanying drawing explanation
Fig. 1 is the flowchart of the present invention;
Fig. 2 is first group of the simulation experiment result figure of the present invention;
Fig. 3 is second group of the simulation experiment result figure of the present invention.
Detailed description of the invention
Below in conjunction with accompanying drawing, the present invention is described further:
With reference to Fig. 1, the enforcement step of the present invention is as follows:
Step 1, inputs two width images, and an optional width is as reference picture I1, using another width as image I subject to registration2。
Two width images of input are to intercept respectively in the different polarization modes obtained at certain airborne radar or different phase two width SAR image.
Step 2, chooses reference picture characteristic point.
2.1) SIFT algorithm is adopted to extract reference picture I1Characteristic point, by I1All characteristic points leave in the first set R;
2.2) from reference picture characteristic point set R, a characteristic point r is arbitrarily choseni, utilize Stationary Wavelet Transform method to calculate the spatial coherence ρ (r of each Feature point correspondencei);
2.2a) utilize Stationary Wavelet Transform that input picture is carried out s Scale Decomposition, obtain the detail pictures that input picture is 3 kinds different on different scale;
2.2b) define arbitrary image pixel x amplitude M under s yardsticksX () is expressed as:
Wherein,It is illustrated respectively in s yardstick hypograph in the horizontal direction, vertical direction and diagonally adjacent detailed information, | | represent absolute value operation computing;
Following formula 2.2c) is adopted to calculate spatial coherence ρ (x) of pixel x:
Wherein, ∏ () represents multiplication operations;
2.3) threshold value E=0.05 is set, if the ρ (r obtainedi) meet ρ (ri) >=E, then by reference picture characteristic point riRetain, otherwise, delete this characteristic point;
2.4) the traversal all characteristic points of reference picture, repeat step 2.2)-2.3), the reference picture characteristic point after being screened;
2.5) the Euclidean distance E between any two characteristic point in reference picture characteristic point set is calculated after above-mentioned screening respectivelydIf, Ed>=15, then retain the two characteristic point, otherwise remove;
2.6) using step 2.5) front 10 characteristic points in the characteristic point set that obtains are as final reference picture characteristic point.
Step 3: utilize multiscale image block feature construction reference picture characteristic point descriptor.
3.1) arbitrarily choose a reference picture characteristic point a, take image block P (a) of this characteristic point surrounding neighbors 15 × 15;
3.2) adopt Stationary Wavelet Transform that image block P (a) is carried out multi-resolution decomposition, obtain the image block P of three different decomposition yardstickss(a), s=3,4,5;
3.3) the grey level histogram vector H of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the gray feature of characteristic point descriptor;
3.4) the gradient orientation histogram vector G of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the Gradient Features of characteristic point descriptor;
3.5) gray feature corresponding for different decomposition yardstick image block and Gradient Features are together in series, obtain reference picture characteristic point a characteristic of correspondence descriptor F (a)={ H3(a),H4(a),H5(a),G3(a),G4(a),G5(a)}。
Step 4: for any one image characteristic point b subject to registration, its characteristic point descriptor F (b) is obtained according to the operation that step (3) is same, utilize the similarity between reference picture characteristic point descriptor F (a) and image characteristic point descriptor F (b) subject to registration, set up the matching double points between reference picture and image subject to registration.
The method forming matching double points has a variety of, common are arest neighbors method, Euclidean distance ratio etc., adopts but be not limited to set up based on the minimum difference criterion of rarefaction representation technology matching double points in this example, and it is as follows that it is embodied as step:
4.1) from the reference picture characteristic point that step (2) obtains, a characteristic point r is arbitrarily choseni, calculate its characteristic of correspondence descriptor F (ri);
4.2) set maximum side-play amount between reference picture and image subject to registration as l=100, image subject to registration is chosen the window W of L × L sizeiAs characteristic point riRegion of search, and by pixel { V all in this regionq: q=1,2 ..., Q, Q=L × L} is all as characteristic point riCandidate matches point, wherein L=2 × l+1;
4.3) for above-mentioned each candidate matches point Vq, take the window of this pixel surrounding neighbors 20 × 20, and by all pixel u in this windownCharacteristic of correspondence descriptor F (un) as VqCorresponding sparse dictionary Dq={ F (un), n=1,2 ..., J, J=20 × 20};
4.4) utilize orthogonal matching pursuit algorithm to solve following formula, obtain characteristic point riAt sparse dictionary DqUnder sparse vector αq
Wherein, argmin () representative function reaches the value of independent variable during minima, | | | | represent Euclidean distance, | | | |0Representing zero norm, C represents degree of rarefication;
4.5) cycling among windows WiInterior all pixels, repeat step 4.3)-4.4), obtain characteristic point riSparse vector α under Q different sparse dictionaryq;
4.6) it is calculated as follows characteristic point riWith any candidate matches point VqBetween reconstructed error, and using the pixel with minimal reconstruction error as characteristic point riMatch point m (ri)
4.7) travel through all reference picture characteristic points, repeat step 4.1)-4.6), obtain the match point that all reference picture characteristic points are corresponding in image subject to registration, all characteristic points of image subject to registration left in the second set T.
Step 5: the abnormity point in the matching double points that removal step (4) obtains.
5.1) from the matching double points that step (4) obtains, a reference picture characteristic point r is arbitrarily chosenc, the reference picture characteristic point mated takes 3 neighborhood points of this characteristic point arest neighbors, and these 3 the neighborhood points taken is mapped to and reference picture characteristic point rcBecome the image characteristic point t subject to registration of match pointcNeighborhood in, calculate this reference picture characteristic point rcAnd the geometry cost between its neighborhood point
Wherein,Represent reference picture characteristic point rcKth nearest neighbor point, tcRepresent and reference picture characteristic point rcThe image characteristic point subject to registration matched, m () represents adaptation function, | | | | represent Euclidean distance, c represents the index of matching double points, its span is 1 to 10, and k represents the index of the nearest neighbor point that the c reference picture characteristic point take, and its span is 1 to 3;
5.2) travel through and all mated reference picture characteristic point, repeat step 5.1), mated the geometry cost between reference picture characteristic point and its respective neighborhood point, using all characteristic points corresponding for geometry Least-cost value as datum mark set, be expressed as:
Wherein, (rc,tc) represent matching double points, tm(k)Represent and neighborhood pointCorresponding match point;
5.3) following formula is adopted to calculate residue match point to the geometry cost between datum mark:
Wherein, rc′And tc′Represent remaining reference picture characteristic point and image characteristic point subject to registration in matching double points respectively,Represent the o reference picture characteristic point in datum mark set, tm(o)Representing and the match point of the o reference picture Feature point correspondence in collection on schedule set, c ' represents the index of residue matching double points, and its span is 1 to 6, and o represents the index of datum mark, and its span is 1 to 4;
5.4) threshold value E is seto=0.03, if the geometry cost obtainedMeetThen by (rc′,tc′) as correct match point, otherwise, this matching double points is deleted;
5.5) step 5.3 is repeated)-5.4), obtain reference picture and the final matching double points of image subject to registration.
Step 6: according to final matching double points, obtain registration result.
Affine Transform Model is set up according to final matching double points obtained above, calculating the geometric deformation parameter of image subject to registration, this example specifically adopts method of least square computational geometry deformation parameter, and utilizes this geometric deformation parameter, image subject to registration is carried out geometric transformation, obtains registration result.
Below in conjunction with experiment simulation, effect of the present invention is described further.
1. simulated conditions:
The Simulation Experimental Platform of the present invention adopts Intel (R) Pentium (R) CPUG32403.10GHz, inside saves as 4GB, runs the PC of Windows7, and programming language is Matlab2011b.
2. emulation content and interpretation of result:
Emulation 1, apply the method for registering images based on SIFT-OCT, method for registering images based on BFSIFT respectively, SAR image is carried out registration by method for registering images and the present invention based on NDSS-SIFT, result is as shown in Figure 2, wherein Fig. 2 (a) is based on the match point line graph of SIFT-OCT method, Fig. 2 (b) is based on the match point line graph of BFSIFT method, Fig. 2 (c) is based on the match point line graph of NDSS-SIFT method, and Fig. 2 (d) is the match point line graph of the present invention.In Fig. 2, yellow solid line represents correct matching double points, and red line represents error matching points pair.
Emulation 2, apply the method for registering images based on SIFT-OCT, method for registering images based on BFSIFT respectively, SAR image is carried out registration by method for registering images and the present invention based on NDSS-SIFT, result is as shown in Figure 3, wherein Fig. 3 (a) is based on the match point line graph of SIFT-OCT method, Fig. 3 (b) is based on the match point line graph of BFSIFT method, Fig. 3 (c) is based on the match point line graph of NDSS-SIFT method, and Fig. 3 (d) is the match point line graph of the present invention.In Fig. 3, yellow solid line represents correct matching double points, and red line represents error matching points pair.
Can be seen that from Fig. 2 (a)-2 (c) and Fig. 3 (a)-3 (c), SAR image pair is surveyed for 2 groups, all there is relatively more error matching points in SIFT-OCT method, BFSIFT method and 3 kinds of algorithms of NDSS-SIFT method.Wherein, SIFT-OCT method effect is worst, and the error matching points comprised is maximum.Error matching points in BFSIFT method and NDSS-SIFT method is to relatively fewer.
From Fig. 2 (d) and Fig. 3 (d) it can be seen that survey SAR image pair for 2 groups, the registration result that the present invention obtains is more accurate, does not comprise error matching points.This comes from the present invention and utilizes spatial coherence to choose reliable characteristic point, utilizes multiscale image block feature construction feature descriptor simultaneously, enhances the significance of feature descriptor and the robustness to speckle noise.Additionally, utilize the minimum difference criterion based on rarefaction representation technology to set up matching double points, improve the accuracy of matching double points, thus solving problem when prior art is applied to SAR image registration, a large amount of error matching points pair occurring.
Claims (3)
1., based on a SAR image registration method for multi-scale image block feature and rarefaction representation, comprise the steps:
(1) inputting two width images, an optional width is as reference picture I1, using another width as image I subject to registration2;
(2) reference picture characteristic point is chosen:
(2a) SIFT algorithm is adopted to extract reference picture I1Characteristic point, and by I1All characteristic points leave in the first set R;
(2b) from reference picture characteristic point set R, a characteristic point r is arbitrarily choseni, utilize Stationary Wavelet Transform method to calculate the spatial coherence ρ (r of each Feature point correspondencei);
(2c) threshold value E=0.05 is set, if the ρ (r obtainedi) meet ρ (ri) >=E, then by reference picture characteristic point riRetain, otherwise, delete this characteristic point;
(2d) travel through all characteristic points of reference picture, repeat step (2b)-(2c), the reference picture characteristic point after being screened;
(2e) the Euclidean distance E between any two characteristic point in reference picture characteristic point set is calculated after above-mentioned screening respectivelydIf, Ed>=15, then retain the two characteristic point, otherwise remove;
(2f) front 10 characteristic points in characteristic point set step (2e) obtained are as final reference picture characteristic point;
(3) multiscale image block feature construction reference picture characteristic point descriptor is utilized:
(3a) arbitrarily choose a reference picture characteristic point a, take image block P (a) of this characteristic point surrounding neighbors 15 × 15;
(3b) adopt Stationary Wavelet Transform that image block P (a) is carried out multi-resolution decomposition, obtain the image block P of three different decomposition yardstickss(a), s=3,4,5;
(3c) the grey level histogram vector H of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the gray feature of feature descriptor;
(3d) the gradient orientation histogram vector G of above three different decomposition yardstick image block is calculated respectivelysA (), it can be used as the Gradient Features of feature descriptor;
(3e) gray feature corresponding for different decomposition yardstick image block and Gradient Features are together in series, obtain reference picture characteristic point a characteristic of correspondence descriptor F (a)={ H3(a),H4(a),H5(a),G3(a),G4(a),G5(a)};
(4) for any one image characteristic point b subject to registration, its characteristic point descriptor F (b) is obtained according to the operation that step (3) is same, utilize the similarity between reference picture characteristic point descriptor F (a) and image characteristic point descriptor F (b) subject to registration, set up the matching double points between reference picture and image subject to registration;
(5) abnormity point in the matching double points that removal step (4) obtains:
(5a) from the matching double points that step (4) obtains, a reference picture characteristic point r is arbitrarily chosenc, the reference picture characteristic point mated takes 3 neighborhood points of this characteristic point arest neighbors, and these 3 the neighborhood points taken is mapped to and reference picture characteristic point rcBecome the image characteristic point t subject to registration of match pointcNeighborhood in, calculate this reference picture characteristic point rcAnd the geometry cost between its neighborhood point
Wherein,Represent reference picture characteristic point rcKth nearest neighbor point, tcRepresent and reference picture characteristic point rcThe image characteristic point subject to registration matched, m () represents adaptation function, | | | | represent Euclidean distance, c represents the index of matching double points, its span is 1 to 10, and k represents the index of the nearest neighbor point that the c reference picture characteristic point take, and its span is 1 to 3;
(5b) travel through and all mated reference picture characteristic point, repeat step (5a), mated the geometry cost between reference picture characteristic point and its respective neighborhood point, using all characteristic points corresponding for geometry Least-cost value as datum mark set, be expressed as:
Wherein, (rc,tc) represent matching double points, tm(k)Represent and neighborhood pointCorresponding match point;
(5c) following formula is adopted to calculate residue match point to the geometry cost between datum mark:
Wherein, rc′And tc′Represent remaining reference picture characteristic point and image characteristic point subject to registration in matching double points respectively,Represent the o reference picture characteristic point in datum mark set, tm(o)Representing and the match point of the o reference picture Feature point correspondence in collection on schedule set, c ' represents the index of residue matching double points, and its span is 1 to 6, and o represents the index of datum mark, and its span is 1 to 4.
(5d) threshold value E is seto=0.03, if the geometry cost obtainedMeetThen by (rc′,tc′) as correct match point, otherwise, this matching double points is deleted;
(5e) repeat step (5c)-(5d), obtain reference picture and the final matching double points of image subject to registration;
(6) according to final matching double points obtained above, set up affine Transform Model, calculate the geometric deformation parameter of image subject to registration, and utilize this geometric deformation parameter, image subject to registration is carried out geometric transformation, obtains registration result.
2. SAR image registration method according to claim 1, it is characterised in that utilize Stationary Wavelet Transform method to calculate the spatial coherence of each Feature point correspondence in step (2b), carry out as follows:
2b1) utilize Stationary Wavelet Transform that input picture is carried out s Scale Decomposition, obtain the detail pictures that input picture is 3 kinds different on different scale;
2b2) define arbitrary image pixel x amplitude M under s yardsticksX () is expressed as:
Wherein,It is illustrated respectively in s yardstick hypograph in the horizontal direction, vertical direction and diagonally adjacent detailed information, | | represent absolute value operation computing;
Following formula 2b3) is adopted to calculate spatial coherence ρ (x) of pixel x:
Wherein, ∏ () represents multiplication operations.
3. the SAR image registration method based on multi-scale image block feature and rarefaction representation according to claim 1, it is characterised in that set up the matching double points between reference picture and image subject to registration in described step (4), carry out as follows:
4a) from the reference picture characteristic point that step (2) obtains, arbitrarily choose a characteristic point ri, calculate its characteristic of correspondence descriptor F (ri);
4b) set maximum side-play amount between reference picture and image subject to registration as l=100, image subject to registration is chosen the window W of L × L sizeiAs characteristic point riRegion of search, by pixel { V all in this regionq: q=1,2 ..., Q, Q=L × L} is all as characteristic point riCandidate matches point, wherein L=2 × l+1;
4c) for above-mentioned each candidate matches point Vq, take the window of this pixel surrounding neighbors 20 × 20, and by all pixel u in this windownCharacteristic of correspondence descriptor F (un) as VqCorresponding sparse dictionary Dq={ F (un), n=1,2 ..., J, J=20 × 20};
4d) utilize orthogonal matching pursuit algorithm to solve following formula, obtain characteristic point riAt sparse dictionary DqUnder sparse vector αq
Wherein, argmin () representative function reaches the value of independent variable during minima, | | | | represent Euclidean distance, | | | |0Representing zero norm, C represents degree of rarefication;
4e) cycling among windows WiInterior all pixels, repeat step 4c)-4d), obtain characteristic point riSparse vector α under Q different sparse dictionaryq。
4f) it is calculated as follows characteristic point riWith any candidate matches point VqBetween reconstructed error, and using the pixel with minimal reconstruction error as characteristic point riMatch point m (ri)
4g) travel through all reference picture characteristic points, repeat step (4a)-(4f), obtain the match point that all reference picture characteristic points are corresponding in image subject to registration, all characteristic points of image subject to registration are left in the second set T.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610118533.9A CN105787943B (en) | 2016-03-03 | 2016-03-03 | SAR image registration method based on multi-scale image block feature and rarefaction representation |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610118533.9A CN105787943B (en) | 2016-03-03 | 2016-03-03 | SAR image registration method based on multi-scale image block feature and rarefaction representation |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105787943A true CN105787943A (en) | 2016-07-20 |
CN105787943B CN105787943B (en) | 2018-08-31 |
Family
ID=56386825
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610118533.9A Active CN105787943B (en) | 2016-03-03 | 2016-03-03 | SAR image registration method based on multi-scale image block feature and rarefaction representation |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105787943B (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108627835A (en) * | 2018-06-29 | 2018-10-09 | 中国科学院电子学研究所 | The object reconstruction method of complete polarization difference SAR chromatographies |
CN109166336A (en) * | 2018-10-19 | 2019-01-08 | 福建工程学院 | A kind of real-time road condition information acquisition method for pushing based on block chain technology |
CN109741275A (en) * | 2018-12-28 | 2019-05-10 | 济南大学 | A kind of Enhancement Method and system of MVCT image |
CN109816619A (en) * | 2019-01-28 | 2019-05-28 | 努比亚技术有限公司 | Image interfusion method, device, terminal and computer readable storage medium |
CN110033422A (en) * | 2019-04-10 | 2019-07-19 | 北京科技大学 | A kind of eyeground OCT image fusion method and device |
CN112184785A (en) * | 2020-09-30 | 2021-01-05 | 西安电子科技大学 | Multi-mode remote sensing image registration method based on MCD measurement and VTM |
CN116008911A (en) * | 2022-12-02 | 2023-04-25 | 南昌工程学院 | Orthogonal matching pursuit sound source identification method based on novel atomic matching criteria |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103177444A (en) * | 2013-03-08 | 2013-06-26 | 中国电子科技集团公司第十四研究所 | Automatic SAR (synthetic-aperture radar) image rectification method |
CN103839265A (en) * | 2014-02-26 | 2014-06-04 | 西安电子科技大学 | SAR image registration method based on SIFT and normalized mutual information |
-
2016
- 2016-03-03 CN CN201610118533.9A patent/CN105787943B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103177444A (en) * | 2013-03-08 | 2013-06-26 | 中国电子科技集团公司第十四研究所 | Automatic SAR (synthetic-aperture radar) image rectification method |
CN103839265A (en) * | 2014-02-26 | 2014-06-04 | 西安电子科技大学 | SAR image registration method based on SIFT and normalized mutual information |
Non-Patent Citations (2)
Title |
---|
GUITING WANG等: "Change detection based on image segment and fusion in multitemporal SAR images", 《SYNTHETIC APERTURE RADAR, 2009. APSAR 2009. 2ND ASIAN-PACIFIC CONFERENCE ON》 * |
刘爱平等: "基于MAR-MRF的SAR图像分割方法", 《电子与信息学报》 * |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108627835A (en) * | 2018-06-29 | 2018-10-09 | 中国科学院电子学研究所 | The object reconstruction method of complete polarization difference SAR chromatographies |
CN108627835B (en) * | 2018-06-29 | 2021-07-27 | 中国科学院电子学研究所 | Target reconstruction method of fully-polarized differential SAR (synthetic aperture radar) chromatography |
CN109166336B (en) * | 2018-10-19 | 2020-08-07 | 福建工程学院 | Real-time road condition information acquisition and pushing method based on block chain technology |
CN109166336A (en) * | 2018-10-19 | 2019-01-08 | 福建工程学院 | A kind of real-time road condition information acquisition method for pushing based on block chain technology |
CN109741275B (en) * | 2018-12-28 | 2020-06-12 | 济南大学 | MVCT image enhancement method and system |
CN109741275A (en) * | 2018-12-28 | 2019-05-10 | 济南大学 | A kind of Enhancement Method and system of MVCT image |
CN109816619A (en) * | 2019-01-28 | 2019-05-28 | 努比亚技术有限公司 | Image interfusion method, device, terminal and computer readable storage medium |
CN110033422A (en) * | 2019-04-10 | 2019-07-19 | 北京科技大学 | A kind of eyeground OCT image fusion method and device |
CN110033422B (en) * | 2019-04-10 | 2021-03-23 | 北京科技大学 | Fundus OCT image fusion method and device |
CN112184785A (en) * | 2020-09-30 | 2021-01-05 | 西安电子科技大学 | Multi-mode remote sensing image registration method based on MCD measurement and VTM |
CN112184785B (en) * | 2020-09-30 | 2023-03-24 | 西安电子科技大学 | Multi-mode remote sensing image registration method based on MCD measurement and VTM |
CN116008911A (en) * | 2022-12-02 | 2023-04-25 | 南昌工程学院 | Orthogonal matching pursuit sound source identification method based on novel atomic matching criteria |
CN116008911B (en) * | 2022-12-02 | 2023-08-22 | 南昌工程学院 | Orthogonal matching pursuit sound source identification method based on novel atomic matching criteria |
Also Published As
Publication number | Publication date |
---|---|
CN105787943B (en) | 2018-08-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105787943A (en) | SAR image registration method based on multi-scale image block characteristics and sparse expression | |
Wang et al. | Fusing bird’s eye view lidar point cloud and front view camera image for 3d object detection | |
Ma et al. | Robust feature matching for remote sensing image registration via locally linear transforming | |
Venugopal | Automatic semantic segmentation with DeepLab dilated learning network for change detection in remote sensing images | |
CN103822616A (en) | Remote-sensing image matching method with combination of characteristic segmentation with topographic inequality constraint | |
CN105404886A (en) | Feature model generating method and feature model generating device | |
CN103279955B (en) | Image matching method and system | |
Chen et al. | Dr-tanet: Dynamic receptive temporal attention network for street scene change detection | |
CN104504723A (en) | Image registration method based on remarkable visual features | |
Wang et al. | MCF3D: Multi-stage complementary fusion for multi-sensor 3D object detection | |
CN104732546A (en) | Non-rigid SAR image registration method based on region similarity and local spatial constraint | |
Shao et al. | Faster R-CNN learning-based semantic filter for geometry estimation and its application in vSLAM systems | |
Tanathong et al. | Using GPS/INS data to enhance image matching for real-time aerial triangulation | |
CN116664856A (en) | Three-dimensional target detection method, system and storage medium based on point cloud-image multi-cross mixing | |
CN116703996A (en) | Monocular three-dimensional target detection algorithm based on instance-level self-adaptive depth estimation | |
Phogat et al. | Different image registration methods—an overview | |
CN114998630A (en) | Ground-to-air image registration method from coarse to fine | |
Li et al. | A new framework of hyperspectral image classification based on spatial spectral interest point | |
Haryono et al. | Oriented object detection in satellite images using convolutional neural network based on ResNeXt | |
US20230120433A1 (en) | Methods and apparatuses for detecting a change in an area of interest | |
Yuan et al. | Graph neural network based multi-feature fusion for building change detection | |
Zhou et al. | Design identification of curve patterns on cultural heritage objects: combining template matching and CNN-based re-ranking | |
Basaru et al. | HandyDepth: Example-based stereoscopic hand depth estimation using Eigen Leaf Node Features | |
CN111127311A (en) | Image registration method based on micro-coincidence region | |
Bughin et al. | Planar patch detection for disparity maps |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |