CN1987896A - High resolution SAR image registration processing method and system - Google Patents

High resolution SAR image registration processing method and system Download PDF

Info

Publication number
CN1987896A
CN1987896A CN 200510132200 CN200510132200A CN1987896A CN 1987896 A CN1987896 A CN 1987896A CN 200510132200 CN200510132200 CN 200510132200 CN 200510132200 A CN200510132200 A CN 200510132200A CN 1987896 A CN1987896 A CN 1987896A
Authority
CN
China
Prior art keywords
image
partiald
same place
high resolution
main
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200510132200
Other languages
Chinese (zh)
Other versions
CN100435167C (en
Inventor
张红
陈富龙
王超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHINA REMOTE SATELLITE EARTH STATION CAS
Original Assignee
CHINA REMOTE SATELLITE EARTH STATION CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CHINA REMOTE SATELLITE EARTH STATION CAS filed Critical CHINA REMOTE SATELLITE EARTH STATION CAS
Priority to CNB2005101322003A priority Critical patent/CN100435167C/en
Publication of CN1987896A publication Critical patent/CN1987896A/en
Application granted granted Critical
Publication of CN100435167C publication Critical patent/CN100435167C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

This invention has provided a kind of processing method and system for the image registration of the synthetic aperture radar with high resolution. The method includes the following steps: (a) To build pyramid image and extract the mixture characteristics of the image, and then get the edge information and take it as matching input data. (b) To match the entire image rudely basing on the characteristics extracted. (c) To extract the feature corner of both the major and minor images after the rude match, and carry on the cross search for homonymic point to get the homonymic point pairs. (d) To divide the adaptive region according to the homonym point pairs. The system provided includes: the extraction cell for image data, the preprocessing cell for image and the matching cell for image. The matching precision at global sub-pixel level can be perfectly realized by this method and system. And so, it provide the base technology sustains for the further generalization of SAR data in the application fields such as map drawing, change detection, and the rebuilding of the three dimensional terrain.

Description

High resolution SAR image registration processing method and system
Technical field
The present invention relates to the image processing technique field, be specifically related to Remote Sensing Image Matching disposal route and system, especially the autoegistration method of synthetic aperture radar (SAR) image and system.
Background technology
In the remote sensing image integrated analysis, Image registration is the basis of remotely-sensed data analysis and processing, is the key link that visual fusion, dynamic change detection, three dimensional terrain reconstruction, remote sensing image such as inlay at application technology.Looked back nearly ten years, the technical development of remote sensing image autoregistration is rapid, but relevant synthetic aperture radar (SAR) image, the especially research work of high resolution SAR image autoregistration but are in the starting stage.So far, the autoregistration algorithm of more existing relevant SAR images is proposed in succession; 2000, Thepaut etc. are from the visual fusion angle, a kind of autoregistration algorithm about ERS and SPOT image has been proposed, yet this algorithm is based on the figure of the earth, earth rotation, a large amount of prioris such as how much imaging modes of satellite orbit parameter and sensor, condition is difficult to be met under many circumstances; Calendar year 2001, Dare etc. have proposed a kind of about SAR and SPOT image autoregistration model, use image edge to carry out characteristic matching, yet its processing procedure need human intervention, and are not good to the image support of big map sheet; 2003, Chen etc. proposed a kind of matching algorithm based on image MI (Mutual Information), yet this algorithm exists the processing map sheet little, the not high deficiency of registration accuracy.
Summary of the invention
Given this, for solving airborne, the automatic/semi-automatic registration problems of satellite-borne SAR image of high resolving power.The invention provides a kind of high resolution SAR image registration processing method, comprehensively adopt the method for characteristic matching and gray scale coupling, implement by thick to smart matching strategy; In the smart coupling,, not only make coupling reach the precision of overall sub-pixel-level, and increased the dirigibility and the robustness of algorithm based on the proposition of least square imagery zone self-adaptation block algorithm.This just further promotes the use of the technical support that provides the foundation for the SAR data in applications such as map making, change-detection, three dimensional terrain reconstructions.High resolution SAR image registration processing method provided by the present invention comprises step:
(a) extract the image texture feature, obtain marginal information and import data as coupling;
(b) carry out the thick coupling of the image overall situation based on the image texture feature of being extracted, obtain the main and auxiliary image behind the registration;
(c) the feature angle point of main and auxiliary image behind the thick registration of extraction, and carry out the same place intersection search, it is right to obtain same place;
(d) handle carrying out the adaptive region piecemeal according to same place.
Described same place is the unique point of corresponding same atural object on the main and auxiliary image; The same characters of ground object point of main and auxiliary image is right to constituting same place, and same place is to also can be described as reference mark (Control Points or Tie-Points) sometimes.
Wherein step (a) comprising: create pyramid image; Adopt the Canny algorithm, main and auxiliary image is carried out edge extracting; Edge image is removed noise processed; According to edge length described edge image is further handled.
Wherein adopt quick Hausdorff distance algorithm slightly to mate in the step (b).
Wherein adopt even Distribution Strategy to extract the feature angle point in the step (c);
Wherein adopting main and auxiliary image intersection search method in the step (c), is reference with main and auxiliary image feature angle point respectively, according to the transformation relation of the thick coupling of feature, seeks same place in the image field of search; Then the gained same place to giving corresponding call number; With the gained same place to merging processing.
Wherein adopt in the step (d) based on least square region adaptivity block algorithm, described adaptive region piecemeal is handled, and comprises step:
(d1) prime area piecemeal obtains initial piecemeal subimage same place to error equation (IV) according to formula (III),
x 2=a 0+a 1x+a 2y
(III)
y 2=b 0+b 1x+b 2y
V x i = ∂ x ∂ a 0 i da 0 i + ∂ x ∂ a 1 i da 1 i + ∂ x ∂ a 2 i da 2 i - l x i
V y i = ∂ y ∂ b 0 i db 0 i + ∂ y ∂ b 1 i db 1 i + ∂ y ∂ b 2 i db 2 i - l y i - - - ( IV )
l x i = x 2 i - ( a 0 i + a 1 i x + a 2 i y )
l y i = y 2 i - ( b 0 i + b 1 i x + b 2 i y )
(d2) iterative computation deformation parameter corrected value da 0 i, da 1 i, da 2 i, db 0 i, db 1 i, db 2 iAnd corresponding deformation parameter a 0 i, a 1 i, a 2 i, b 0 i, b 1 i, b 2 i
(d3) subimage block division, rollback increases the reference mark and handles;
(d4) revise the right image coordinate value of same place;
(d5) use corresponding deformation parameter to carry out geometric transformation to the subimage block that comprises in the auxilliary image successively, obtain the image behind the registration.
According to a scheme of the present invention, a kind of high resolution SAR image registration disposal system also is provided, comprising:
The image data extraction unit is used to extract the image texture characteristic, obtains marginal information, and this information is sent to the image pretreatment unit as thick coupling input data;
The image pretreatment unit carries out the thick coupling of the overall situation to the image that extracts the image texture feature; Obtain the main and auxiliary image information behind the thick registration, and relevant information is offered the Image registration processing unit processes;
The Image registration processing unit is used to extract the feature angle point of the main and auxiliary image that obtains after the thick coupling, and carries out the same place intersection search, and it is right to obtain same place, and handles carrying out the adaptive region piecemeal according to same place.
Wherein said image data extraction unit is handled the step of image, comprising: create pyramid image; Adopt the Canny algorithm, main and auxiliary image is carried out edge extracting; Edge image is removed noise processed; According to edge length described edge image is further handled.
Wherein in the image pretreatment unit, adopt quick Hausdorff distance algorithm slightly to mate.
Wherein adopt even Distribution Strategy to extract the feature angle point in the Image registration processing unit;
Wherein adopting main and auxiliary image intersection search method in the Image registration processing unit, is reference with main and auxiliary image feature angle point respectively, according to the transformation relation of the thick coupling of feature, seeks same place in the image field of search; Then the gained same place to giving corresponding call number; With the gained same place to merging processing.
Wherein adopt in the Image registration processing unit based on least square region adaptivity block algorithm, described adaptive region piecemeal is handled, and comprises step:
(d1) prime area piecemeal obtains initial piecemeal subimage same place to error equation (IV) according to formula (III),
x 2=a 0+a 1x+a 2y
(III)
y 2=b 0+b 1x+b 2y
V x i = ∂ x ∂ a 0 i da 0 i + ∂ x ∂ a 1 i da 1 i + ∂ x ∂ a 2 i da 2 i - l x i
V y i = ∂ y ∂ b 0 i db 0 i + ∂ y ∂ b 1 i db 1 i + ∂ y ∂ b 2 i db 2 i - l y i - - - ( IV )
l x i = x 2 i - ( a 0 i + a 1 i x + a 2 i y )
l y i = y 2 i - ( b 0 i + b 1 i x + b 2 i y )
(d2) iterative computation deformation parameter corrected value da 0 i, da 1 i, da 2 i, db 0 i, db 1 i, db 2 iAnd corresponding deformation parameter a 0 i, a 1 i, a 2 i, b 0 i, b 1 i, b 2 i
(d3) subimage block division, rollback increases the reference mark and handles;
(d4) revise the right image coordinate value of same place;
(d5) use corresponding deformation parameter to carry out geometric transformation to the subimage block that comprises in the auxilliary image successively, obtain the image behind the registration.
Description of drawings
Fig. 1 is the process flow diagram of high resolution SAR image registration processing method of the present invention;
Fig. 2 is a processing procedure synoptic diagram according to a particular embodiment of the invention;
The quick Hausdorff distance thick flow chart that mate of Fig. 3 for being adopted in the method for the present invention;
Fig. 4 is the flow chart of the same place intersection search that adopted in the method for the present invention;
Fig. 5 is the flow chart of the LS-MMSE algorithm flow that adopted in the method for the present invention.
Embodiment
Now the specific implementation of high resolution SAR image registration processing method of the present invention is described in detail.
Fig. 2 is a processing procedure synoptic diagram according to a particular embodiment of the invention, with reference to Fig. 2.
Texture feature extraction is for providing image texture information based on the thick coupling of Hausdorff Distance global characteristics, and as the input data of matching process.In order to obtain main marginal information, suppress noise spot, adopt following method, it comprises:
Step 1: the step of creating pyramid image;
Step 2: adopt the Canny algorithm, main and auxiliary image is carried out the step of edge extracting.It should be noted that creating the pyramid image step has reached certain image smoothing effect, therefore, in the Canny algorithm is carried out, does not need to comprise in addition Gaussian Filtering Processing process; Then use the Hysteresis method, the input edge image is carried out following processing remove noise, concrete steps are:
1. scan all marginal points, range value is greater than T 1Obtain keeping, and be designated as correct point;
2. the marginal point range value is less than T 2Directly remove;
3. the sweep amplitude value is between T 1, T 2All marginal points, if there has been correct point in eight neighborhoods of this point, then also be designated as correct point; Otherwise, directly remove.Repeat edge image is carried out this computing, end until stablizing.
Step 3: the edge image of handling via Hysteresis is carried out edge length detect step.Setting threshold T, edge length obtains keeping greater than the edge of T, otherwise, directly remove.
The quick Hausdorff distance thick flow chart that mate of Fig. 3 for being adopted in the method for the present invention is with reference to Fig. 3.
Given bidimensional characteristic sequence group A and B, the Hausdorff distance h f(B A) is defined as follows:
h f ( B , A ) = def fth min | | b - a | | - - - ( I )
In the formula, The fractile of expression g (x) in sequence X, f ∈ (0,1).For example, the 1th representative is worth most, and 1/2th represents intermediate value.‖ b-a ‖ represents an a, the Euclidean distance between the b.
What the present invention adopted is briefly described below based on the Hausdorff distance algorithm:
Use fast algorithm, calculate main image E 1Range conversion.E 1Range conversion is defined as follows: Δ ( x , y ) = min i ∈ E 1 | | ( xy ) - i | |
The storehouse (Stack) of structure storage unit R.The purpose of the thick coupling of global characteristics is the best translation transformation t[T that seeks between main and auxiliary image x, T y], promptly satisfy relational expression:
h f(t(E 2),E 1)≤τ+ε (II)
In the formula, E 1, E 2The pyramid edge image of expression after via feature extraction; τ is a pre-set threshold, t (E 2) represent E 2Carry out the t conversion, ε=.R represents the two-dimensional space of translation transformation.For given R, t lExpression T x, T yMinimalization T all x l, T y lThe time, i.e. t l(T x l, T y l) situation; In like manner, t hExpression T x, T yAll get maximum value T x h, T y hThe time, i.e. t h(T x h, T y h) situation.For marginal point P ∈ E arbitrarily 2, t ∈ R, conversion t (P) must fall within E 1In corresponding certain rectangular area.This zone is defined as the indefinite zone of P.Therefore, for P ∈ E 2, the just corresponding indefinite zone of each point.Initialization storehouse (Stack) makes storehouse (Stack) comprise an initial cell R, makes that the R initial grade is a zero level.It should be noted that the corresponding indefinite zone of initial cell R should select enough greatly, make it can comprise Target Transformation function t, satisfy relational expression (II).
Seek best translation transformation amount t.
A) the translation transformation difference and the maximum indefinite zone of calculating unit R correspondence to be selected
Translation transformation difference: Δ t=t h-t l
Indefinite zone: max ( x i , y i ) ∈ E 2 ( T x i , T y i )
B) the division unit R is quartern subelement R i(i=1,2,3,4), R iCorresponding grade adds one for his father's cell level number, R iBe designated as respectively: { (T x l, T y l), (T x m, T y m), { (T x m, T y l), (T x h, T y m), { (T x l, T y m), (T x m, T y h), { (T x m, T y m), (T x h, T y h);
C) judge whether R comprises target translation transfer function.Judgment task carries out in two steps: at first calculate in unit R to be selected each marginal point P ∈ E 2Pairing indefinite zone; If the zone comprises at least one point of interest (satisfying the marginal point of relational expression (2)), then this zone is decided to be qualified zone; Secondly, verify in unit R, qualified number of regions accounts for the ratio of total edge point; If this ratio value is greater than predefined fth value, unit R then to be selected is designated as effectively.
D) to the effective subelement R of each layer i, implement ordering according to the fth value, choose maximum and inferior big person and be pressed into storehouse, as the unit to be selected of further division.
E) iterative step a)-d), the length until indefinite zone converges on predefined τ value.The iterative processing of step a)-d) is equivalent in essence and makes up a binary search tree.
Below the extraction of characteristic angle point is described.
Character such as the feature angle point is an image representative point feature, and it has in image relative orientation obviously, the geometric position is accurate.Can select for use classical Forstner operator that main and auxiliary image is carried out the feature angle point extracts, this operator is by calculating Robert ' the s gradient and the pixel (c of each pixel, r) be the gray scale covariance matrix of a window (as 5 * 5) at center, in image, seek have as far as possible little and near the point of the error ellipse of circle as unique point, its step comprises:
(1) calculates Robert ' the s gradient of each pixel
g u = ∂ g ∂ u = g i + 1 , j + 1 - g i , j g v = ∂ g ∂ v = g i , j + 1 - g i + 1 , j
(2) covariance matrix of gray scale in calculating l * l (as 5 * 5 or bigger) window
Q = N - 1 = Σ g u 2 Σ g u g v Σ g v g u Σ g v 2 - 1
Wherein
Σ g u 2 = Σ i = c - k c + k - 1 Σ j = r - k r + k - 1 ( g i + 1 , j + 1 - g i , j ) 2
Σ g v 2 = Σ i = c - k c + k - 1 Σ j = r - k r + k - 1 ( g i , j + 1 - g i + 1 , j ) 2
Σ g u g v = Σ g v g u = Σ i = c - k c + k - 1 Σ j = r - k r + k - 1 ( g i + 1 , j + 1 - g i , j ) ( g i , j + 1 - g i + 1 , j )
k=INT(l/2)
(3) calculate interest value q and w:
q = 4 DetN ( trN ) 2
w = 1 trQ = DetN trN
Wherein DetN represents the determinant of matrix N; TrN represents the mark of matrix N.
(4) determine to treat reconnaissance.If point of interest is greater than given threshold value, then this pixel point is for treating reconnaissance.Threshold value is an empirical value, can be with reference to as follows:
T q = 0.5 - 0.75 T w = f w ‾ ( f = 0.5 - 1.5 ) cw c ( c = 5 )
Wherein Be the weight average value; w cIntermediate value for power.As q>T qWhile w>T wThe time, this pixel is for treating reconnaissance.
(5) with the weight w be foundation, select extreme point, promptly in certain suitably window, select the reconnaissance for the treatment of of w maximum.
Fig. 4 is for the flow chart of the same place intersection search that adopted in the method for the present invention, with reference to Fig. 4.
Image feature is meant the point of discontinuity of image greyscale curved surface.Point feature and line feature are the common characteristic informations of image.The point feature mainly indicates apparent point, as angle point, round dot etc.The line feature is meant image " edge ".So-called feature angle point promptly is image two " edge " point of crossing; On remote sensing image, the general corresponding road junction of feature angle point, building angle point, point of crossing, river or the like.
Selecting for use classical Forstner operator that main and auxiliary image is carried out the feature angle point extracts, this operator is by Robert ' the s gradient of each pixel of calculating with pixel (c, r) be the gray scale covariance matrix of a window (as 5 * 5) at center, in image, seek have as far as possible little and near the point of the error ellipse of circle as unique point, detailed algorithm is referring to pertinent literature.In order to raise the efficiency, only the feature angle point to be carried out in the pairing main and auxiliary overlapping region of the thick coupling of feature and extract; In the leaching process, adopted even Distribution Strategy, and given corresponding overlay area call number for simultaneously each feature angle point, the equalization that even distribution can make the feature angle point reach on the global sense distributes.Evenly Distribution Strategy comprises: at first, and to the even layout rules graticule mesh of main and auxiliary image overlap area; Secondly, use characteristic point extracts operator, extracts a feature angle point in each regular subnet.The overlay area call number numerically is equivalent to regular sublattice net numbering.
So-called same place promptly is the unique point of corresponding same atural object on the main and auxiliary image; The same characters of ground object point of main and auxiliary image is right to constituting same place, and in based on image coupling document, same place is to also can be described as the reference mark sometimes to (Control Points or Tie-Points).The sequential similarity measure method of provincial characteristics coupling is adopted in the same place search.Because slightly mate having carried out global characteristics before, the same place hunting zone dwindles greatly, and then bring descending significantly and mating the raising of correctness of computation complexity.In order to enrich same place information, adopt main and auxiliary image intersection search method, may further comprise the steps:
With main image feature angle point is reference, according to the transformation relation of the thick coupling of feature, seeks same place in the auxilliary image field of search; Then the gained same place to giving corresponding call number, i.e. same place image coordinate residing overlay area call number in main and auxiliary image.
With auxilliary image feature angle point is reference, a same step cross processing.
The gained same place is combined processing.In the merging process, two groups of same places are identical to call number, then only get one; Otherwise both all are selected in, and include final same place in in the tabulation.
The employing of intersection search method has been considered main and auxiliary image character information comprehensively with waiting power, and it is right further to have enriched same place, for the enforcement based on the adaptive region block algorithm of least square is got ready.
For the high resolution SAR data, shade is a big key character of image.Classical feature angle point extraction algorithm can not well be removed shadow character point (shadow character is put non-rigid ground object target, does not satisfy the requirement as same place), and this obviously can influence the right accuracy of overall same place to a certain extent.Therefore, remove high resolution SAR image same place centering shadow effect and will seem especially important.In addition, this method also adopts the thought of probability statistics, to same place to having carried out the elimination of rough difference processing, thereby further guaranteed finally to obtain the right accuracy of same place.
Fig. 5 is the flow chart of the LS-MMSE algorithm flow that adopted in the method for the present invention.
Based on least square region adaptivity block algorithm is the gordian technique of guaranteeing the sub-pixel level precision index.High resolution SAR image map sheet coverage is big, and SAR image low coverage contraction that local different incidence angles is introduced and sensing system error etc. all are to cause that the direct error source of local deformation takes place image.Therefore, auxilliary image integral body is carried out single geometric transformation and will become unrealistic.
Auxilliary image geometry rectification of distortion method adopts the affined transformation method, sees formula (III):
x 2=a 0+a 1x+a 2y
(III)
y 2=b 0+b 1x+b 2y
Why select affined transformation, this has its characteristic decision.At first, this conversion simple, intuitive; Secondly, affined transformation can not only be used for handling airborne image, and is applicable to spaceborne image (polynomial expression of high-order is corrected and generally only is applicable to spaceborne data); At last, the comprehensive stack of piecemeal subimage local affine transformations on image overall situation yardstick, is equivalent to a high-order geometric transformation function of match formula.
Concrete steps based on least square region adaptivity block algorithm are as follows:
1) prime area piecemeal uses formula (III), obtains initial piecemeal subimage same place to error equation (IV):
V x i = ∂ x ∂ a 0 i da 0 i + ∂ x ∂ a 1 i da 1 i + ∂ x ∂ a 2 i da 2 i - l x i
V y i = ∂ y ∂ b 0 i db 0 i + ∂ y ∂ b 1 i + ∂ y ∂ b 2 i db 2 i - l y i - - - ( IV )
l x i = x 2 i - ( a 0 i + a 1 i x + a 2 i y )
l y i = y 2 i - ( b 0 i + b 1 i x + b 2 i y )
Formula (IV) is expressed as matrix form, obtains formula (V):
V=AX-L
In the formula V = V x i V y i , A = 1 x y 0 0 0 0 0 0 1 x y , X = da 0 i da 1 i da 2 i db 0 i db 1 i db 2 i , L = l x i l y i .
(V)
2) method error equation (V):
(A TA)X=A TL
X=(A TA) -1A TL
Iterative computation deformation parameter corrected value da 0 i, da 1 i, da 2 i, db 0 i, db 1 i, db 2 iAnd corresponding deformation parameter a 0 i, a 1 i, a 2 i, b 0 i, b 1 i, b 2 iThrough deriving current deformation parameter a 0 i, a 1 i, a 2 i, b 0 i, b 1 i, b 2 iCan be by a preceding deformation parameter a 0 I-1, a 1 I-1, a 2 I-1, b 0 I-1, b 1 I-1, b 2 I-2Calculate acquisition via relational expression (VI):
a 0 i = a 0 i - 1 + da 0 i + a 0 i - 1 da 1 i + b 0 i - 1 da 2 i
a 1 i = a 1 i - 1 + a 1 i - 1 da 1 i + b 1 i - 1 da 2 i
a 2 i = a 2 i - 1 + a 2 i - 1 da 1 i + b 2 i - 1 da 2 i
b 0 i = b 0 i - 1 + db 0 i - 1 + a 0 i - 1 db 1 i + b 0 i - 1 db 2 i - - - ( VI )
b 1 i = b 1 i - 1 + a 1 i - 1 db 1 i + b 1 i - 1 db 2 i
b 2 i = b 2 i - 1 + a 2 i - 1 db 1 i + b 2 i - 1 db 2 i
3) subimage block division, rollback increases the reference mark and handles.
Division: when step 2) deformation parameter is separated when being tending towards restraining in, calculates the l of this subimage block correspondence x i, l y i, if when calculating institute's value greater than assign thresholds (sub-pixel level precision, this threshold value are 1), be the dad image piece with this image block then, one is divided into four, division generates four littler number of sub images pieces of overlay area.
Rollback: behind the dad image block splitting, newly obtain same place that subimage block comprises and during less than necessity observation number, give the deformation parameter value of dad image piece correspondence then directly for this new subimage block to (reference mark) number.Level and smooth for the image subimage block edge transition that guarantees to resample, the Algorithm Error precision reaches MMSE (Minimum Mean Square Error), often needs the excess observation of some." rollback " process is harmful to final matching precision.Its essence is hinting that predetermined matching precision is high more, and then the number of control points of demand is also many more.Therefore, to count be the most direct, the effective means of avoiding " rollback " effect in Chong Zu control.
Increase the reference mark: in order to avoid the rollback effect as far as possible, when same place in the subimage block is observed number to (reference mark) number less than necessity, again extract the feature angle point and encrypt same place, and then can continue the whole iterative processing in subimage block division, rollback and increase reference mark (reference mark).It should be noted that to comprise quantity of information limited in view of subimage block, increase the reference mark and handle and often only need iteration 1~2 time; This means that also for the poor relatively zone of image information, the rollback effect is inevitable.
4) revise the right image coordinate value of same place.When the corresponding subimage block division of auxilliary image, rollback and increase reference mark process are ended, interative computation step 1) again, 2); But, this moment need be to x 2 i, y 2 iDo following correcting process, until all same places to disposing:
x 2 i = x 2 i - 1 + V x i - 1
y 2 i = y 2 i - 1 + V y i - 1
5) adopt indirect method, use corresponding deformation parameter to carry out geometric transformation to the subimage block that comprises in the auxilliary image successively, finally obtain the image (resample and select bilinear interpolation) behind the registration.
Method synthesis of the present invention has been considered the robustness of characteristic matching and the accuracy of zone coupling, the overall employing: based on the thick matching algorithm of Hausdorff distance measure global characteristics of binary tree search by slightly implementing autoregistration image to smart matching strategy, solved the counting yield bottleneck problem of Hausdorff distance measure well, algorithm is sane, reached the matching precision of sub-pixel-level, thereby dwindled the indefinite zone of same place search, improved treatment effeciency.The same place coupling has adopted sequential similarity to detect; The introducing of intersection search method waits power to consider the characteristic information of main and auxiliary image, and it is right to have enriched same place; The same place coupling has obtained the matching precision of Pixel-level between image.At the same place that obtains the Pixel-level precision under the prerequisite, proposition based on least square region adaptivity block algorithm, be to guarantee to reach sub-pixel-level on the image global sense (to adopt the 3 meters carried SAR images in 9 air strips, area, Xinghua, Jiangsu in July, 2003 as experimental data, registration accuracy is (0.810076,0.833336) pixel) key link of matching precision; The enforcement of adaptive region partition strategy has further increased the dirigibility and the robustness of algorithm.
High resolution SAR image registration processing method of the present invention is specifically used
Application example one:
Data constitute: area, Xinghua, Jiangsu in July, 2,003 9 air strips carried SAR images (CAS Electronics Research Institute's carried SAR data, resolution 3m).
Processing platform: China Remote Satellite Earth Station, CAS's microwave group is ground the CAESAR-RegSAR system software voluntarily.
Effect: realized 9 the automatic/semi-automatic registrations of air strips Airborne High-resolution SAR image in area, Xinghua, Jiangsu, generated big map sheet and inlay image.
Effect: reached overall sub-pixel-level registration accuracy, registration accuracy is (0.810076,0.833336) pixel.
Application example two:
Data constitute: area, Sanya, Hainan in January, 2005 Ku, X, L, 5 band carried SARs of P four wave bands image (China Electronic Science and Technology Corporation's the 38th research institute's carried SAR data, resolution 1m).
Processing platform: the CAESAR-RegSAR system software that China Remote Satellite Earth Station, CAS's microwave group is researched and developed voluntarily.
Effect: realized Hainan three subregion Ku, X, L, the automatic/semi-automatic registration of P four wave bands 5 band carried SARs image respectively, generated big map sheet and inlay image.
Effect: reached overall sub-pixel-level registration accuracy, registration accuracy is (0.730816,0.582958) pixel.

Claims (7)

1, a kind of high resolution SAR image registration processing method is characterized in that, comprises step:
(a) create pyramid image, extract the image texture feature, obtain marginal information as coupling input data;
(b) carry out the thick coupling of the image overall situation based on the image texture feature of being extracted, obtain the main and auxiliary image behind the thick registration;
(c) the feature angle point of main and auxiliary image behind the thick registration of extraction, and carry out the same place intersection search, it is right to obtain same place;
(d) handle carrying out the adaptive region piecemeal according to same place.
2, high resolution SAR image registration processing method as claimed in claim 1 is characterized in that, wherein step (a) comprising: create pyramid image; Adopt the Canny algorithm, main and auxiliary image is carried out edge extracting; Edge image is removed noise processed; According to edge length described edge image is further handled.
3, high resolution SAR image registration processing method as claimed in claim 1 is characterized in that, wherein adopts quick Hausdorff distance algorithm slightly to mate in the step (b).
4, high resolution SAR image registration processing method as claimed in claim 1 is characterized in that, wherein adopts even Distribution Strategy to extract the feature angle point in the step (c), comprising: to the even layout rules graticule mesh of main and auxiliary image overlap area; Use characteristic point extracts operator, extracts a feature angle point in each regular subnet.
5, high resolution SAR image registration processing method as claimed in claim 1, it is characterized in that, wherein adopt main and auxiliary image intersection search method in the step (c), be reference with main and auxiliary image feature angle point respectively, according to the transformation relation of the thick coupling of feature, in the image field of search, seek same place; Then the gained same place to giving corresponding call number; With the gained same place to merging processing.
6, high resolution SAR image registration processing method as claimed in claim 1 is characterized in that, wherein comprises step in step (d):
(d1) prime area piecemeal obtains initial piecemeal subimage same place to error equation (IV) according to formula (III),
x 2=a 0+a 1x+a 2y (III)
y 2=b 0+b 1x+b 2y
V x i = ∂ x ∂ a 0 i da 0 i + ∂ x ∂ a 1 i da 1 i + ∂ x ∂ a 2 i da 2 i - l x i
V y i = ∂ y ∂ b 0 i db 0 i + ∂ y ∂ b 1 i db 1 i + ∂ y ∂ b 2 i db 2 i - l y i - - - ( IV )
l x i = x 2 i - ( a 0 i + a 1 i x + a 2 i y )
l y i = y 2 i - ( b 0 i + b 1 i x + b 2 i y )
(d2) iterative computation deformation parameter corrected value da 0 i, da 1 i, da 2 i, db 0 i, db 1 i, db 2 iAnd corresponding deformation parameter a 0 i, a 1 i, a 2 i, b 1 i, b 1 i, b 2 i
(d3) subimage block division, rollback increases the reference mark and handles;
(d4) revise the right image coordinate value of same place;
(d5) use corresponding deformation parameter to carry out geometric transformation to the subimage block that comprises in the auxilliary image successively, obtain the image behind the registration.
7, a kind of high resolution SAR image registration disposal system is characterized in that, comprising:
The image data extraction unit is used to extract the image texture characteristic, obtains marginal information and this information is sent to the image pretreatment unit as thick coupling input data;
The image pretreatment unit carries out the thick coupling of the overall situation to the image that extracts the image texture feature, obtains the main and auxiliary image information behind the registration, and relevant information is offered the Image registration processing unit processes;
The Image registration processing unit is used to extract the feature angle point of the main and auxiliary image that obtains after the thick coupling, and carries out the same place intersection search, and it is right to obtain same place; Handle carrying out the adaptive region piecemeal according to same place.
CNB2005101322003A 2005-12-23 2005-12-23 High resolution SAR image registration processing method and system Expired - Fee Related CN100435167C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005101322003A CN100435167C (en) 2005-12-23 2005-12-23 High resolution SAR image registration processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005101322003A CN100435167C (en) 2005-12-23 2005-12-23 High resolution SAR image registration processing method and system

Publications (2)

Publication Number Publication Date
CN1987896A true CN1987896A (en) 2007-06-27
CN100435167C CN100435167C (en) 2008-11-19

Family

ID=38184686

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005101322003A Expired - Fee Related CN100435167C (en) 2005-12-23 2005-12-23 High resolution SAR image registration processing method and system

Country Status (1)

Country Link
CN (1) CN100435167C (en)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101840517A (en) * 2010-04-27 2010-09-22 武汉大学 Control point image database matching method based on image registration and device thereof
CN101964060A (en) * 2010-06-24 2011-02-02 西安电子科技大学 SAR variant target identification method based on local textural feature
CN102116638A (en) * 2009-12-31 2011-07-06 北京四维图新科技股份有限公司 Method and device for acquiring diversion information of road junction
CN102194225A (en) * 2010-03-17 2011-09-21 中国科学院电子学研究所 Automatic registering method for coarse-to-fine space-borne synthetic aperture radar image
CN101957987B (en) * 2009-07-17 2012-12-05 同济大学 Method for automatically registering raster image and vector electronic map
CN102842134A (en) * 2012-07-16 2012-12-26 西安电子科技大学 Rapid scene matching method based on SAR (Synthetic Aperture Radar) image
CN103279941A (en) * 2012-02-24 2013-09-04 苏州蓝海彤翔系统科技有限公司 Parallel synchronous registering method for multi-view-field depth images based on greedy algorithm
CN103295232A (en) * 2013-05-15 2013-09-11 西安电子科技大学 SAR (specific absorption rate) image registration method based on straight lines and area
CN103489176A (en) * 2012-06-13 2014-01-01 中国科学院电子学研究所 Method for extracting TPs from SAR image of serious geometric distortion
CN103513247A (en) * 2012-06-21 2014-01-15 中国科学院电子学研究所 Method for matching synthetic aperture radar image and optical image same-name point
CN103575267A (en) * 2012-07-19 2014-02-12 霍尼韦尔国际公司 Method of correlating images with terrain elevation maps for navigation
CN104021556A (en) * 2014-06-13 2014-09-03 西南交通大学 Heterological remote-sensing image registration method based on geometric structure similarity
CN104166977A (en) * 2013-05-17 2014-11-26 中国航空工业集团公司洛阳电光设备研究所 Image matching similarity measuring method and image matching method thereof
CN104297751A (en) * 2014-10-20 2015-01-21 西安电子科技大学 Main and auxiliary SAR image fusion method of distributed satellite SAR system
CN104392462A (en) * 2014-12-16 2015-03-04 西安电子科技大学 SAR image registration method based on salient division sub-region pair
CN105205801A (en) * 2014-12-24 2015-12-30 天津航天中为数据系统科技有限公司 Method and device for extracting sea reclamation information based on change detection
CN107705329A (en) * 2017-10-24 2018-02-16 武汉大学 High-resolution optical satellite based on geometrical constraint stares Image registration method
CN107945218A (en) * 2017-11-22 2018-04-20 中国资源卫星应用中心 The big distorted image matching process in edge
CN108305320A (en) * 2018-02-09 2018-07-20 重庆大学 Adaptive windowing method for reconstructing for improving big visual field holographic imaging quality
CN108492711A (en) * 2018-04-08 2018-09-04 黑龙江工业学院 A kind of drawing electronic map method and device
CN109741381A (en) * 2019-01-23 2019-05-10 张过 Spaceborne push-broom type optical sensor high frequency error removing method based on parallel observation
CN109903318A (en) * 2019-04-17 2019-06-18 中国科学院电子学研究所 Registration and variety detection integration processing method based on high-resolution remote sensing image

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2114986A1 (en) * 1993-02-08 1994-08-09 Robert T. Frankot Automatic subarea selection for image registration
CN1168047C (en) * 2002-12-19 2004-09-22 上海交通大学 Non-linear registration method for remote sensing image

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101957987B (en) * 2009-07-17 2012-12-05 同济大学 Method for automatically registering raster image and vector electronic map
CN102116638A (en) * 2009-12-31 2011-07-06 北京四维图新科技股份有限公司 Method and device for acquiring diversion information of road junction
CN102116638B (en) * 2009-12-31 2015-03-11 北京四维图新科技股份有限公司 Method and device for acquiring diversion information of road junction
CN102194225A (en) * 2010-03-17 2011-09-21 中国科学院电子学研究所 Automatic registering method for coarse-to-fine space-borne synthetic aperture radar image
CN101840517A (en) * 2010-04-27 2010-09-22 武汉大学 Control point image database matching method based on image registration and device thereof
CN101840517B (en) * 2010-04-27 2014-04-30 武汉大学 Control point image database matching method based on image registration
CN101964060A (en) * 2010-06-24 2011-02-02 西安电子科技大学 SAR variant target identification method based on local textural feature
CN101964060B (en) * 2010-06-24 2012-07-04 西安电子科技大学 SAR variant target identification method based on local textural feature
CN103279941A (en) * 2012-02-24 2013-09-04 苏州蓝海彤翔系统科技有限公司 Parallel synchronous registering method for multi-view-field depth images based on greedy algorithm
CN103489176B (en) * 2012-06-13 2016-02-03 中国科学院电子学研究所 A kind of SAR image for serious geometric distortion carries out the method for same place extraction
CN103489176A (en) * 2012-06-13 2014-01-01 中国科学院电子学研究所 Method for extracting TPs from SAR image of serious geometric distortion
CN103513247A (en) * 2012-06-21 2014-01-15 中国科学院电子学研究所 Method for matching synthetic aperture radar image and optical image same-name point
CN103513247B (en) * 2012-06-21 2015-07-15 中国科学院电子学研究所 Method for matching synthetic aperture radar image and optical image same-name point
CN102842134B (en) * 2012-07-16 2015-04-22 西安电子科技大学 Rapid scene matching method based on SAR (Synthetic Aperture Radar) image
CN102842134A (en) * 2012-07-16 2012-12-26 西安电子科技大学 Rapid scene matching method based on SAR (Synthetic Aperture Radar) image
CN103575267A (en) * 2012-07-19 2014-02-12 霍尼韦尔国际公司 Method of correlating images with terrain elevation maps for navigation
CN103295232A (en) * 2013-05-15 2013-09-11 西安电子科技大学 SAR (specific absorption rate) image registration method based on straight lines and area
CN103295232B (en) * 2013-05-15 2016-01-13 西安电子科技大学 Based on the SAR image registration method in straight line and region
CN104166977B (en) * 2013-05-17 2017-10-10 中国航空工业集团公司洛阳电光设备研究所 A kind of Image Matching Similarity Measurement Method and its image matching method
CN104166977A (en) * 2013-05-17 2014-11-26 中国航空工业集团公司洛阳电光设备研究所 Image matching similarity measuring method and image matching method thereof
CN104021556A (en) * 2014-06-13 2014-09-03 西南交通大学 Heterological remote-sensing image registration method based on geometric structure similarity
CN104297751B (en) * 2014-10-20 2017-03-08 西安电子科技大学 A kind of major-minor SAR image fusion method of Distributed Spaceborne SAR System
CN104297751A (en) * 2014-10-20 2015-01-21 西安电子科技大学 Main and auxiliary SAR image fusion method of distributed satellite SAR system
CN104392462B (en) * 2014-12-16 2017-06-16 西安电子科技大学 A kind of SAR image registration method based on significantly segmentation subregion pair
CN104392462A (en) * 2014-12-16 2015-03-04 西安电子科技大学 SAR image registration method based on salient division sub-region pair
CN105205801A (en) * 2014-12-24 2015-12-30 天津航天中为数据系统科技有限公司 Method and device for extracting sea reclamation information based on change detection
CN105205801B (en) * 2014-12-24 2018-05-22 天津航天中为数据系统科技有限公司 Perioperative cardiac events information extracting method and device based on variation detection
CN107705329A (en) * 2017-10-24 2018-02-16 武汉大学 High-resolution optical satellite based on geometrical constraint stares Image registration method
CN107705329B (en) * 2017-10-24 2021-03-16 武汉大学 High-resolution optical satellite staring image registration method based on geometric constraint
CN107945218B (en) * 2017-11-22 2020-05-22 中国资源卫星应用中心 Edge large distortion image matching method
CN107945218A (en) * 2017-11-22 2018-04-20 中国资源卫星应用中心 The big distorted image matching process in edge
CN108305320A (en) * 2018-02-09 2018-07-20 重庆大学 Adaptive windowing method for reconstructing for improving big visual field holographic imaging quality
CN108305320B (en) * 2018-02-09 2021-06-04 重庆大学 Self-adaptive sliding window reconstruction method for improving large-field holographic imaging quality
CN108492711A (en) * 2018-04-08 2018-09-04 黑龙江工业学院 A kind of drawing electronic map method and device
CN109741381A (en) * 2019-01-23 2019-05-10 张过 Spaceborne push-broom type optical sensor high frequency error removing method based on parallel observation
CN109741381B (en) * 2019-01-23 2020-07-03 张过 Satellite-borne push-broom optical sensor high-frequency error elimination method based on parallel observation
CN109903318A (en) * 2019-04-17 2019-06-18 中国科学院电子学研究所 Registration and variety detection integration processing method based on high-resolution remote sensing image

Also Published As

Publication number Publication date
CN100435167C (en) 2008-11-19

Similar Documents

Publication Publication Date Title
CN100435167C (en) High resolution SAR image registration processing method and system
CN104200463B (en) Based on the method for registering images that Fourier-mellin transform and maximum mutual information are theoretical
CN108428220B (en) Automatic geometric correction method for ocean island reef area of remote sensing image of geostationary orbit satellite sequence
CN103761739B (en) A kind of Image registration method optimized based on half global energy
CN102800098B (en) Multi-characteristic multi-level visible light full-color and multi-spectrum high-precision registering method
CN102800099B (en) Multi-feature multi-level visible light and high-spectrum image high-precision registering method
CN104268841A (en) Infrared image preprocessing method based on compressed sensing algorithm
CN102819839B (en) High-precision registration method for multi-characteristic and multilevel infrared and hyperspectral images
CN102800097A (en) Multi-feature multi-level visible light and infrared image high-precision registering method
CN112419350B (en) Remote sensing image automatic geometric registration method and system based on ground object boundary information
CN103295239A (en) Laser-point cloud data automatic registration method based on plane base images
CN104200461A (en) Mutual information image selected block and sift (scale-invariant feature transform) characteristic based remote sensing image registration method
CN113223068A (en) Multi-modal image registration method and system based on depth global features
Zhu et al. Robust registration of aerial images and LiDAR data using spatial constraints and Gabor structural features
CN107958443A (en) A kind of fingerprint image joining method based on crestal line feature and TPS deformation models
CN102521597A (en) Hierarchical strategy-based linear feature matching method for images
CN110084743B (en) Image splicing and positioning method based on multi-flight-zone initial flight path constraint
CN105913435A (en) Multidimensional remote sensing image matching method and multidirectional remote sensing image matching system suitable for large area
CN109727279A (en) A kind of autoegistration method of vector data and remote sensing image
CN114022459A (en) Multi-temporal satellite image-based super-pixel change detection method and system
CN103646395A (en) A high-precision image registering method based on a grid method
CN108562900B (en) SAR image geometric registration method based on elevation correction
CN103700110B (en) Full-automatic image matching method
CN103049921B (en) Method for determining image centroid of small irregular celestial body for deep space autonomous navigation
CN115331029A (en) Heterogeneous image matching method based on cross-mode conversion network and optimal transmission theory

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20081119

Termination date: 20141223

EXPY Termination of patent right or utility model