CN105488754A - Local linear migration and affine transformation based image feature matching method and system - Google Patents
Local linear migration and affine transformation based image feature matching method and system Download PDFInfo
- Publication number
- CN105488754A CN105488754A CN201510799813.6A CN201510799813A CN105488754A CN 105488754 A CN105488754 A CN 105488754A CN 201510799813 A CN201510799813 A CN 201510799813A CN 105488754 A CN105488754 A CN 105488754A
- Authority
- CN
- China
- Prior art keywords
- parameter
- image
- sigma
- matrix
- matching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 230000009466 transformation Effects 0.000 title claims abstract description 33
- 230000005012 migration Effects 0.000 title claims abstract description 12
- 238000013508 migration Methods 0.000 title claims abstract description 12
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 title abstract description 12
- 238000005457 optimization Methods 0.000 claims abstract description 13
- 239000011159 matrix material Substances 0.000 claims description 80
- 230000008878 coupling Effects 0.000 claims description 40
- 238000010168 coupling process Methods 0.000 claims description 40
- 238000005859 coupling reaction Methods 0.000 claims description 40
- 238000013178 mathematical model Methods 0.000 claims description 26
- 238000004364 calculation method Methods 0.000 claims description 11
- 238000010276 construction Methods 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000009414 blockwork Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 10
- 230000000694 effects Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 101000666658 Homo sapiens Rho-related GTP-binding protein RhoV Proteins 0.000 description 1
- 238000007476 Maximum Likelihood Methods 0.000 description 1
- 102100038400 Rho-related GTP-binding protein RhoV Human genes 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- G06T3/14—
Abstract
The invention proposes a local linear migration and affine transformation based image feature matching method and system used for establishing correct matching by removing error matching in an initial matching point pair. The method comprises: establishing a model corresponding to geometric transformation of to-be-matched images for affine transformation of the to-be-matched images, establishing a model corresponding to a posterior probability of correct matching of the matching point pair, and solving model parameters based on nearest neighbor matching points, a least square method and an optimization method; and calculating the posterior probability of the correct matching of the initial matching point pair, and judging the correctness of the initial matching point pair according to a threshold. According to the method, the modeling is carried out for the affine transformation of the to-be-matched images, so that the error rate of matching is greatly reduced and good robustness is still kept even if large amounts of error matching exists in initial matching.
Description
Technical field
The present invention relates to Image Feature Matching technical field, specifically, the present invention relates to the Image Feature Matching technical scheme based on local linear migration and affined transformation.
Background technology
The elementary object of images match is that the same area of two width images of the same scene using different sensors to obtain under different time and visual angle is carried out correspondence.
In the past few decades, scholars have studied a lot of method and solve remote sensing images matching problem.These methods roughly can be divided into two classes: based on matching process and the feature-based matching method in region.The former finds match information by the similarity degree searching for original gray value in certain area in two width images; Latter utilizes the descriptor similarity of local feature or space geometry constraint to find matching double points.When having a small amount of significantly details, the information that gray-scale value provides than local shape and structure many, thus better based on the matching effect of the method in region.But large based on the method calculated amount in region, and inapplicable when image fault and luminosity change.On the contrary, characterization method has better robustness, can process the image of babble, be widely used.
How to find match point corresponding in two width images, form matching double points, and guarantee that the correctness of matching double points is the key of image matching method.
Matching process based on region mainly contains correlation method, fourier methods and mutual information method three kinds.The main thought of correlation method is the similarity of corresponding window in calculating two width image, then will have a pair of maximum similarity degree as matching double points.But correlation method cannot be suitable for without texture region similarity is inapparent, and calculation of complex.Fourier methods make use of the Fourier Representations of image in frequency field.Compared with traditional correlation technique, this method is higher and have good robustness to frequency noise like in counting yield.But the image that this method has different spectrum structure in process has necessarily restricted.Although its matching effect of mutual information method is good, it cannot obtain the global maximum in whole search volume, therefore inevitably lowers its robustness.
In feature-based matching method, usually adopt a kind of strategy being divided into two steps.The first step, determine one group of initial matching double points by the similarity degree of Feature Descriptor, wherein the overwhelming majority is correct coupling, but inevitably containing a large amount of erroneous matching.Second step, by being removed the coupling of mistake by geometrical constraint, finally just can obtain the geometric parameter converted between correct matching double points and two width images.The exemplary of this strategy comprises RANSAC method (M.A.FischlerandR.C.Bolles, " Randomsampleconsensus:Aparadigmformodelfittingwithapplic ationtoimageanalysisandautomatedcartog-raphy, " Commun.ACM, vol.24, no.6, pp.381 – 395, Jun.1981), ARHV method (P.H.S.TorrandA.Zisserman, " MLESAC:Anewrobustestimatorwithapplicationtoestimatingima gegeometry, " Comput.Vis.ImageUnder-stand., vol.78, no.1, pp.138 – 156, etc. Apr.2000) method and the VFC method (J.Ma of parameter model is depended on, J.Zhao, J.Tian, A.L.Yuille, andZ.Tu, " Robustpointmatchingviavectorfieldconsensus, " IEEETrans.ImageProcess., vol.23, no.4, pp.1706 – 1721, Apr.2014.), GS method (H.LiuandS.Yan, " Commonvisualpatterndiscoveryviaspatiallycoher-entcorresp ondence, " inProc.IEEEConf.Comput.Vis.PatternRecog., Jun.2010, pp.1609 – 1616.) and ICF method (X.LiandZ.Hu, " Rejectingmismatchesbycorrespondencefunction, " Int.J.Comput.Vis., vol.89, no.1, pp.1 – 17, Aug.2010). wait the method based on nonparametric model.
Although these methods obtain successfully in a lot of fields, but in the picture containing the localized distortion caused because of visual angle change in a large number and picture material more complicated time, the initial matching point pair of a lot of mistake can be obtained after preliminary matches, when error rate exceedes certain proportion, these methods just effectively can not remove mistake.Therefore need badly and a kind ofly to initial matching error rate, there is matching process compared with strong robustness.
Summary of the invention
For prior art defect, the present invention proposes a kind of based on local linear migration and the Image Feature Matching technical scheme of affined transformation.
For achieving the above object, the technical solution used in the present invention is a kind ofly to comprise the following steps based on local linear migration and the Image Feature Matching method of affined transformation,
Step 1, sets up the corresponding model of posterior probability that the corresponding model of geometric transformation and matching double points between image to be matched are correct coupling, realizes as follows,
For the affined transformation between image to be matched, set up conversion mathematical model as follows,
y=t(x)=Ax+o
Wherein, if two images to be matched are image a and image b, x and y is the coordinate vector of pixel on image a and image b respectively, t (x) represents affine transformation relationship, A is the affine matrix of 2 × 2, and o is the matrix of 2 × 1, represents the translation between image to be matched;
If known one group of initial matching point centering, on image a, point set is X={x
1..., x
n}
t, on image b, corresponding point set is Y={y
1..., y
n}
t, calculating wherein n-th pair of match point is the correct posterior probability p mated
nthere is following posterior probability mathematical model,
Wherein, γ and σ is model parameter, and e is mathematics constant, and b is default coefficient;
Step 2, according to point set X={x
1..., x
n}
tand Y={y
1..., y
n}
tsolving model parameter, comprises following sub-step,
Step 2.1 is each match point x
n, n=1 ..., N, search for nearest K neighbours' match point respectively, K gets preset value;
Step 2.2, according to the Search Results of step 2.1, adopts least square method to solve the weight matrix W that dimension is N × N;
Step 2.3, by optimization method solving model parameter s, R, o, γ, σ, comprises following sub-step,
Step 2.3.1, initialization, comprises and makes γ=γ
0, A=I
2 × 2, o=0, P=I
n × N, γ
0for the preset initial value of γ, make current iteration number of times k=1, adopt following model parameter formulae discovery σ,
Wherein, matrix T=(t (x
1) ..., t (x
n))
t, matrix trace is asked in tr () expression;
Step 2.3.2, upgrades matrix P, comprises and adopts gained posterior probability mathematical model in step 1, calculates N is respectively correct coupling posterior probability p to matching double points
1..., p
n, make P=diag (p
1..., p
n), diag represents diagonal matrix;
Step 2.3.3, calculating parameter A, o are as follows,
Adopt following formulae discovery parameter A,
Wherein, matrix
by I
n × Nomission is designated as I, matrix Q=(I-W)
tp (I-W), λ are default parameter;
Adopt following formulae discovery parameter o,
o=μ
y-Aμ
x
Step 2.3.4, according to parameter A, o that step 2.3.3 calculates, recalculates parameter γ, σ is as follows,
Adopt following formulae discovery parameter γ,
Adopt model parameter formulae discovery σ in step 2.3.1;
Step 2.3.5, differentiates the condition of convergence, comprises and calculates current parameter L, when meeting k=k
maxor (L-L
old)/L
old≤ ε, finishing iteration, k
maxfor maximum iteration time, ε is convergence threshold; Otherwise k=k+1, returns step 2.3.2; The computing formula of described parameter L is as follows,
Wherein, L
oldrepresent the last L calculated;
Step 3, calculates initial matching point to the posterior probability for correct coupling, and according to right the correcting errors of threshold decision initial matching point, realizes as follows,
The model parameter solved in described step 2.3 is substituted into posterior probability mathematical model described in step 1, calculates the posterior probability that n-th pair of matching double points is correct coupling; Work as p
nduring>=threshold, then think that n-th pair of match point is correct coupling; Work as p
nduring <threshold, then think that n-th pair of match point is the coupling of mistake, wherein threshold is default judgment threshold.
And step 2.2 comprises following sub-step,
Step 2.2.1, as match point x
jnot the match point x searched in described step 2.1
ik neighbours' match point for the moment, then by W
ijbe set to 0, wherein match point x
jwith match point x
ifor the match point in point set X, and i, j=1 ..., N, W
ijrepresent the element of weight matrix W i-th row jth row;
Step 2.2.2,
constraint condition under, adopt least square method to solve and obtain making following cost function E (W) get the weight matrix W of minimum value, cost function E (W) is as follows,
The present invention is also corresponding to be provided a kind of and comprises with lower module based on local linear migration and the Image Feature Matching system of affined transformation,
Model construction module, for setting up the corresponding model of posterior probability that the corresponding model of geometric transformation and matching double points between image to be matched are correct coupling, realizes as follows,
For the affined transformation between image to be matched, set up conversion mathematical model as follows,
y=t(x)=Ax+o
Wherein, if two images to be matched are image a and image b, x and y is the coordinate vector of pixel on image a and image b respectively, t (x) represents affine transformation relationship, A is the affine matrix of 2 × 2, and o is the matrix of 2 × 1, represents the translation between image to be matched;
If known one group of initial matching point centering, on image a, point set is X={x
1..., x
n}
t, on image b, corresponding point set is Y={y
1..., y
n}
t, calculating wherein n-th pair of match point is the correct posterior probability p mated
nthere is following posterior probability mathematical model,
Wherein, γ and σ is model parameter, and e is mathematics constant, and b is default coefficient;
Parametric solution module, for according to point set X={x
1..., x
n}
tand Y={y
1..., y
n}
tsolving model parameter, comprises following submodule,
Neighbours' match point submodule, for being each match point x
n, n=1 ..., N, search for nearest K neighbours' match point respectively, K gets preset value;
Weight matrix submodule, for the Search Results according to neighbours' match point submodule, adopts least square method to solve the weight matrix W that dimension is N × N;
Optimization submodule, for by optimization method solving model parameter s, R, o, γ, σ, comprises with lower unit,
Initialization unit, for making γ=γ
0, A=I
2 × 2, o=0, P=I
n × N, γ
0for the preset initial value of γ, make current iteration number of times k=1, adopt following model parameter formulae discovery σ,
Wherein, matrix T=(t (x
1) ..., t (x
n))
t, matrix trace is asked in tr () expression;
Updating block, for upgrading matrix P, comprising and adopting gained posterior probability mathematical model in model construction module, calculates N is respectively correct coupling posterior probability p to matching double points
1..., p
n, make P=diag (p
1..., p
n), diag represents diagonal matrix;
First parameter calculation unit, as follows for calculating parameter A, o,
Adopt following formulae discovery parameter A,
Wherein, matrix
by I
n × Nomission is designated as I, matrix Q=(I-W)
tp (I-W), λ are default parameter;
Adopt following formulae discovery parameter o,
o=μ
y-Aμ
x
Second parameter calculation unit, for the parameter A, the o that calculate according to the first parameter calculation unit, recalculates parameter γ, σ is as follows,
Adopt following formulae discovery parameter γ,
Adopt model parameter formulae discovery σ in initialization unit;
Iteration judging unit, for differentiating the condition of convergence, comprising and calculating current parameter L, when meeting k=k
maxor (L-L
old)/L
old≤ ε, finishing iteration, k
maxfor maximum iteration time, ε is convergence threshold; Otherwise, k=k+1, order updating block works; The computing formula of described parameter L is as follows,
Wherein, L
oldrepresent the last L calculated;
Judged result module, for calculating initial matching point to the posterior probability for correct coupling, and according to right the correcting errors of threshold decision initial matching point, realizes as follows,
The model parameter solved in described optimization submodule is substituted into posterior probability mathematical model described in model construction module, calculates the posterior probability that n-th pair of matching double points is correct coupling; Work as p
nduring>=threshold, then think that n-th pair of match point is correct coupling; Work as p
nduring <threshold, then think that n-th pair of match point is the coupling of mistake, wherein threshold is default judgment threshold.
And weight matrix submodule comprises with lower unit,
Initial assignment unit, for working as match point x
jnot the match point x searched in described neighbours' match point submodule
ik neighbours' match point for the moment, then by W
ijbe set to 0, wherein match point x
jwith match point x
ifor the match point in point set X, and i, j=1 ..., N, W
ijrepresent the element of weight matrix W i-th row jth row;
Solve unit, for
constraint condition under, adopt least square method to solve and obtain making following cost function E (W) get the weight matrix W of minimum value, cost function E (W) is as follows,
The present invention has the following advantages:
1, the present invention is directed to Image Feature Matching and propose a kind of unified maximum likelihood framework.Compared with the parameter model generally used, this framework can process nonparametric model situation, and range of application is wider.
2, the present invention construct a kind of local geometric constraint transformation model is optimized.This constraint saves the partial structurtes between adjacent feature point, therefore can be used to process the situation containing a large amount of erroneous matching, has stronger robustness.
Embodiment
First this method is treated matching image affined transformation and is carried out mathematical modeling, and the coupling of the mistake then tentatively set up in a series of matching double points by removal degree sets up correct coupling.This method utilizes Bayes's maximal possibility estimation of band hidden variable to carry out mathematical modeling.Meanwhile, have also been constructed a kind of geometrical constraint retaining partial structurtes between adjacent feature point, even if when there is a large amount of erroneous matching in preliminary matches, still keep good robustness.
Below by embodiment, technical solution of the present invention is further described.
The flow process of embodiment of the present invention institute supplying method mainly comprises 3 steps:
Step 1, sets up the corresponding model of posterior probability that the corresponding model of geometric transformation and matching double points between image to be matched are correct coupling;
For the affined transformation between image to be matched, set up conversion mathematical model as follows:
y=t(x)=Ax+o
Wherein, x and y is the coordinate vector of pixel, namely set two images to be matched to comprising as image a and image b, x and y is the coordinate vector of pixel on image a and image b respectively, t (x) represents affine transformation relationship, A is the affine matrix of 2 × 2, and o is the matrix of 2 × 1, represents the translation between image to be matched;
Wrong unavoidably owing to adopting images match of the prior art to carry out initial matching gained matching double points, the object of the invention is removing wherein mistake, is then X={x for point set on known one group of initial matching point centering image a
1..., x
n}
t, on image b, corresponding point set is Y={y
1..., y
n}
t, its mid point x
1corresponding matching point y
1, by that analogy, some x
ncorresponding matching point y
n, comprise N to initial matching point pair, wherein n-th pair of matching double points is the correct posterior probability p mated
ncan be obtained by following posterior probability calculated with mathematical model:
Wherein, γ and σ is model parameter, and e is mathematics constant, and coefficient b can be specified in advance by those skilled in the art, or adopts variable element, and embodiment adopts 2/5, namely
Step 2, according to known initial matching point pair, i.e. point set X={x
1..., x
n}
t, Y={y
1..., y
n}
t, solve the parameter of two models in described step 1; Comprise following sub-step:
Step 2.1 is each match point x
n, n=1 ..., N, adopt k-d to set association search method search K the neighbours match point nearest with it respectively, when specifically implementing, those skilled in the art can preset the value of K voluntarily, and in the present embodiment, K gets 15;
Step 2.2, according to the Search Results of described step 2.1, adopts least square method to solve the weight matrix W that dimension is N × N;
In embodiment, weight matrix W solves as follows,
Step 2.2.1, as match point x
jnot the match point x searched in described step 2.1
ik neighbours' match point for the moment, then by W
ijbe set to 0, wherein match point x
jwith match point x
ifor the match point in point set X, and i, j=1 ..., N, W
ijrepresent the element of weight matrix W i-th row jth row;
Step 2.2.2,
constraint condition under, adopt least square method to solve and obtain making following cost function E (W) get the weight matrix W of minimum value, cost function E (W) is as follows:
Step 2.3, solves unknown mathematical model parameter by optimization method: A, o, γ, σ;
The solution procedure of mathematical model parameter A, o, γ, σ unknown in embodiment is as follows:
Step 2.3.1, initiation parameter; Make parameter γ=γ
0(when specifically implementing, those skilled in the art can the initial value γ of sets itself γ
0, embodiment gets γ
0=0.9), matrix A=I
2 × 2(namely dimension be 2 × 2, element be all 1 unit matrix), parameter o=0, matrix P=I
n × N(namely dimension to be N × N, element be all 1 unit matrix), current iteration number of times k=1, adopts following model parameter formulae discovery σ:
Wherein, matrix T=(t (x
1) ..., t (x
n))
t, matrix trace is asked in tr () expression;
Step 2.3.2, upgrades matrix P:
Adopt posterior probability mathematical model described in step 1, calculate the 1st ..., N is respectively the posterior probability p of correct coupling to matching double points
1..., p
n, make P=diag (p
1..., p
n), diag represents diagonal matrix;
Step 2.3.3, calculating parameter A, o;
Adopt following formulae discovery parameter A:
Wherein, each matrix
i
n × 1namely dimension to be N × 1, element be all 1 unit matrix, by I
n × Nomission is designated as I, matrix Q=(I-W)
tp (I-W), λ are a default parameter, and during concrete enforcement, the predeterminable value of those skilled in the art, gets 100 in the present embodiment;
Adopt following formulae discovery parameter o:
o=μ
y-Aμ
x
Step 2.3.4, according to parameter A, o that step 2.3.3 calculates, can recalculate parameter γ, σ based on current t (x);
Adopt following formulae discovery parameter γ:
Adopt model parameter formulae discovery σ described in step 2.3.1;
Step 2.3.5, differentiates the condition of convergence:
Calculate current parameter L, when meeting k=k
maxor
(l-L
old)/L
old≤ ε, finishing iteration; Otherwise, namely work as k<k
maxand (L-L
old)/L
old> ε, k=k+1, get back to step 2.3.2, and when specifically implementing, those skilled in the art can free default maximum iteration time k
maxvalue, the value of the present embodiment is 50;
Wherein, ε is convergence threshold, and during concrete enforcement, the predeterminable value of those skilled in the art, such as, get 0.0001, L
oldrepresent the last L performing step 2.3.5 and calculate, when performing step 2.3.5 first, can L be made
oldbe a larger initial value, 6 powers of such as 10, perform the result of calculation that can adopt performed step 2.3.5 last time afterwards.The computing formula of L is as follows:
Step 3, calculates initial matching point to the posterior probability for correct coupling, and according to right the correcting errors of threshold decision initial matching point;
The parameter solved in described step 2.3 is substituted into posterior probability mathematical model described in step 1, calculates the posterior probability that n-th pair of matching double points is correct coupling; Work as p
nduring>=threshold, then think that n-th pair of match point is correct coupling; Work as p
nduring <threshold, then think that n-th pair of match point is the coupling of mistake, wherein threshold is judgment threshold, and when specifically implementing, those skilled in the art can the value of free default judgment threshold, gets 0.5 in the present embodiment.
During concrete enforcement, above flow process can adopt software mode to realize automatically running.Modular mode can also be adopted to provide corresponding system, and the embodiment of the present invention is also corresponding to be provided a kind of and comprises with lower module based on local linear migration and the Image Feature Matching system of affined transformation,
Model construction module, for setting up the corresponding model of posterior probability that the corresponding model of geometric transformation and matching double points between image to be matched are correct coupling, realizes as follows,
For the affined transformation between image to be matched, set up conversion mathematical model as follows,
y=t(x)=Ax+o
Wherein, if two images to be matched are image a and image b, x and y is the coordinate vector of pixel on image a and image b respectively, t (x) represents affine transformation relationship, A is the affine matrix of 2 × 2, and o is the matrix of 2 × 1, represents the translation between image to be matched;
If known one group of initial matching point centering, on image a, point set is X={x
1..., x
n}
t, on image b, corresponding point set is Y={y
1..., y
n}
t, calculating wherein n-th pair of match point is the correct posterior probability p mated
nthere is following posterior probability mathematical model,
Wherein, γ and σ is model parameter, and e is mathematics constant, and b is default coefficient;
Parametric solution module, for according to point set X={x
1..., x
n}
tand Y={y
1..., y
n}
tsolving model parameter, comprises following submodule,
Neighbours' match point submodule, for being each match point x
n, n=1 ..., N, search for nearest K neighbours' match point respectively, K gets preset value;
Weight matrix submodule, for the Search Results according to neighbours' match point submodule, adopts least square method to solve the weight matrix W that dimension is N × N;
Optimization submodule, for by optimization method solving model parameter s, R, o, γ, σ, comprises with lower unit,
Initialization unit, for making γ=γ
0, A=I
2 × 2, o=0, P=I
n × N, γ
0for the preset initial value of γ, make current iteration number of times k=1, adopt following model parameter formulae discovery σ,
Wherein, matrix T=(t (x
1) ..., t (x
n))
t, matrix trace is asked in tr () expression;
Updating block, for upgrading matrix P, comprising and adopting gained posterior probability mathematical model in model construction module, calculates N is respectively correct coupling posterior probability p to matching double points
1..., p
n, make P=diag (p
1..., p
n), diag represents diagonal matrix;
First parameter calculation unit, as follows for calculating parameter A, o,
Adopt following formulae discovery parameter A,
Wherein, matrix
by I
n × Nomission is designated as I, matrix Q=(I-W)
tp (I-W), λ are default parameter;
Adopt following formulae discovery parameter o,
o=μ
y-Aμ
x
Second parameter calculation unit, for the parameter A, the o that calculate according to the first parameter calculation unit, recalculates parameter γ, σ is as follows,
Adopt following formulae discovery parameter γ,
Adopt model parameter formulae discovery σ in initialization unit;
Iteration judging unit, for differentiating the condition of convergence, comprising and calculating current parameter L, when meeting k=k
maxor (L-L
old)/L
old≤ ε, finishing iteration, k
maxfor maximum iteration time, ε is convergence threshold; Otherwise, k=k+1, order updating block works; The computing formula of described parameter L is as follows,
Wherein, L
oldrepresent the last L calculated;
Judged result module, for calculating initial matching point to the posterior probability for correct coupling, and according to right the correcting errors of threshold decision initial matching point, realizes as follows,
The model parameter solved in described optimization submodule is substituted into posterior probability mathematical model described in model construction module, calculates the posterior probability that n-th pair of matching double points is correct coupling; Work as p
nduring>=threshold, then think that n-th pair of match point is correct coupling; Work as p
nduring <threshold, then think that n-th pair of match point is the coupling of mistake, wherein threshold is default judgment threshold.
Further, weight matrix submodule comprises with lower unit,
Initial assignment unit, for working as match point x
jnot the match point x searched in described neighbours' match point submodule
ik neighbours' match point for the moment, then by W
ijbe set to 0, wherein match point x
jwith match point x
ifor the match point in point set X, and i, j=1 ..., N, W
ijrepresent the element of weight matrix W i-th row jth row;
Solve unit, for
constraint condition under, adopt least square method to solve and obtain making following cost function E (W) get the weight matrix W of minimum value, cost function E (W) is as follows,
Choose the contrast that RANSAC, ICF, GS method and the present invention carry out images match.Comparing result is as following table, and wherein accuracy refers in the matching double points that method finally provides it is the ratio of correct matching double points; Missing rate refers to that method is judged as correct matching double points the ratio that error matching points is right in screening process.Can see that this method used time is the shortest, accuracy rate is the highest, and missing rate is minimum.
Method Contrast on effect table
Method | Time | Accuracy | Missing rate |
RANSAC | 15.36 | 75.32% | 19.54% |
ICF | 1.66 | 46.34% | 8.66% |
GS | 0.64 | 86.87% | 33.29% |
The present invention | 0.34 | 99.11% | 2.92% |
Specific embodiment described herein is only to the explanation for example of the present invention's spirit.Those skilled in the art can make various amendment or supplement or adopt similar fashion to substitute to described specific embodiment, but can't depart from spirit of the present invention or surmount the scope that appended claims defines.
Claims (4)
1., based on local linear migration and the Image Feature Matching method of affined transformation, it is characterized in that: comprise the following steps,
Step 1, sets up the corresponding model of posterior probability that the corresponding model of geometric transformation and matching double points between image to be matched are correct coupling, realizes as follows,
For the rigidity geometric transformation between image to be matched, set up conversion mathematical model as follows,
y=t(x)=sRx+o
Wherein, if two images to be matched are image a and image b, x and y is the coordinate vector of pixel on image a and image b respectively, t (x) represents rigidity geometric transform relation, s represents the dimension scale between image to be matched, and R is the matrix of 2 × 2, represents the rotation between image to be matched, o is the matrix of 2 × 1, represents the translation between image to be matched;
If known one group of initial matching point centering, on image a, point set is X={x
1..., x
n}
t, on image b, corresponding point set is Y={y
1..., y
n}
t, calculating wherein n-th pair of match point is the correct posterior probability p mated
nthere is following posterior probability mathematical model,
Wherein, γ and σ is model parameter, and e is mathematics constant, and b is default coefficient;
Step 2, according to point set X={x
1..., x
n}
tand Y={y
1..., y
n}
tsolving model parameter, comprises following sub-step,
Step 2.1 is each match point x
n, n=1 ..., N, search for nearest K neighbours' match point respectively, K gets preset value;
Step 2.2, according to the Search Results of step 2.1, adopts least square method to solve the weight matrix W that dimension is N × N;
Step 2.3, by optimization method solving model parameter s, R, o, γ, σ, comprises following sub-step,
Step 2.3.1, initialization, comprises and makes γ=γ
0, R=I
2 × 2, o=0, P=I
n × N, γ
0for the preset initial value of γ, make current iteration number of times k=1, adopt following model parameter formulae discovery σ,
Wherein, T=(t (x
1) ..., t (x
n))
t, matrix trace is asked in tr () expression;
Step 2.3.2, upgrades matrix P, comprises and adopts gained posterior probability mathematical model in step 1, calculates N is respectively correct coupling posterior probability p to matching double points
1..., p
n, make P=diag (p
1..., p
n), diag represents diagonal matrix;
Step 2.3.3, calculating parameter s, R, o are as follows,
Adopt following formulae discovery parameter s,
Wherein, matrix
By I
n × Nomission is designated as I, matrix Q=(I-W)
tp (I-W), λ are default parameter;
Adopt following formulae discovery parameter R,
R=UDV
T
Wherein, D=diag (1, det (UV
t)), the determinant of det () representing matrix, matrix U and V are obtained by svd;
Adopt following formulae discovery parameter o,
o=μ
y-sRμ
x
Step 2.3.4, the parameter s calculated according to step 2.3.3, R, o, recalculate parameter γ, σ be as follows,
Adopt following formulae discovery parameter γ,
Adopt model parameter formulae discovery σ in step 2.3.1;
Step 2.3.5, differentiates the condition of convergence, comprises and calculates current parameter L, when meeting k=k
maxor (L-L
old)/L
old≤ ε, finishing iteration, k
maxfor maximum iteration time, ε is convergence threshold; Otherwise k=k+1, returns step 2.3.2; The computing formula of described parameter L is as follows,
Wherein, L
oldrepresent the last L calculated;
Step 3, calculates initial matching point to the posterior probability for correct coupling, and according to right the correcting errors of threshold decision initial matching point, realizes as follows,
The model parameter solved in described step 2.3 is substituted into posterior probability mathematical model described in step 1, calculates the posterior probability that n-th pair of matching double points is correct coupling; Work as p
nduring>=threshold, then think that n-th pair of match point is correct coupling; Work as p
nduring <threshold, then think that n-th pair of match point is the coupling of mistake, wherein threshold is default judgment threshold.
2., according to claim 1 based on local linear migration and the Image Feature Matching method of affined transformation, it is characterized in that: step 2.2 comprises following sub-step,
Step 2.2.1, as match point x
jnot the match point x searched in described step 2.1
ik neighbours' match point for the moment, then by W
ijbe set to 0, wherein match point x
jwith match point x
ifor the match point in point set X, and i, j=1 ..., N, W
ijrepresent the element of weight matrix W i-th row jth row;
Step 2.2.2,
constraint condition under, adopt least square method to solve and obtain making following cost function E (W) get the weight matrix W of minimum value, cost function E (W) is as follows,
3., based on local linear migration and the Image Feature Matching system of affined transformation, it is characterized in that: comprise with lower module,
Model construction module, for setting up the corresponding model of posterior probability that the corresponding model of geometric transformation and matching double points between image to be matched are correct coupling, realizes as follows,
For the rigidity geometric transformation between image to be matched, set up conversion mathematical model as follows,
y=t(x)=sRx+o
Wherein, if two images to be matched are image a and image b, x and y is the coordinate vector of pixel on image a and image b respectively, t (x) represents rigidity geometric transform relation, s represents the dimension scale between image to be matched, and R is the matrix of 2 × 2, represents the rotation between image to be matched, o is the matrix of 2 × 1, represents the translation between image to be matched;
If known one group of initial matching point centering, on image a, point set is X={x
1..., x
n}
t, on image b, corresponding point set is Y={y
1..., y
n}
t, calculating wherein n-th pair of match point is the correct posterior probability p mated
nthere is following posterior probability mathematical model,
Wherein, γ and σ is model parameter, and e is mathematics constant, and b is default coefficient;
Parametric solution module, for according to point set X={x
1..., x
n}
tand Y={y
1..., y
n}
tsolving model parameter, comprises following submodule,
Neighbours' match point submodule, for being each match point x
n, n=1 ..., N, search for nearest K neighbours' match point respectively, K gets preset value;
Weight matrix submodule, for the Search Results according to neighbours' match point submodule, adopts least square method to solve the weight matrix W that dimension is N × N;
Optimization submodule, for by optimization method solving model parameter s, R, o, γ, σ, comprises with lower unit,
Initialization unit, for making γ=γ
0, R=I
2 × 2, o=0, P=I
n × N, γ
0for the preset initial value of γ, make current iteration number of times k=1, adopt following model parameter formulae discovery σ,
Wherein, T=(t (x
1) ..., t (x
n))
t, matrix trace is asked in tr () expression;
Updating block, for upgrading matrix P, comprising and adopting gained posterior probability mathematical model in model construction module, calculates N is respectively correct coupling posterior probability p to matching double points
1..., p
n, make P=diag (p
1..., p
n), diag represents diagonal matrix;
First parameter calculation unit, as follows for calculating parameter s, R, o,
Adopt following formulae discovery parameter s,
Wherein, matrix
By I
n × Nomission is designated as I, matrix Q=(I-W)
tp (I-W), λ are default parameter;
Adopt following formulae discovery parameter R,
R=UDV
T
Wherein, D=diag (1, det (UV
t)), the determinant of det () representing matrix, matrix U and V are obtained by svd; Adopt following formulae discovery parameter o,
o=μ
y-sRμ
x
Second parameter calculation unit, for calculate according to the first parameter calculation unit parameter s, R, o, recalculate parameter γ, σ be as follows,
Adopt following formulae discovery parameter γ,
Adopt model parameter formulae discovery σ in initialization unit;
Iteration judging unit, for differentiating the condition of convergence, comprising and calculating current parameter L, when meeting k=k
maxor (L-L
old)/L
old≤ ε, finishing iteration, k
maxfor maximum iteration time, ε is convergence threshold; Otherwise, k=k+1, order updating block works; The computing formula of described parameter L is as follows,
Wherein, L
oldrepresent the last L calculated;
Judged result module, for calculating initial matching point to the posterior probability for correct coupling, and according to right the correcting errors of threshold decision initial matching point, realizes as follows,
The model parameter solved in described optimization submodule is substituted into posterior probability mathematical model described in model construction module, calculates the posterior probability that n-th pair of matching double points is correct coupling; Work as p
nduring>=threshold, then think that n-th pair of match point is correct coupling; Work as p
nduring <threshold, then think that n-th pair of match point is the coupling of mistake, wherein threshold is default judgment threshold.
4., according to claim 3 based on local linear migration and the Image Feature Matching system of affined transformation, it is characterized in that: weight matrix submodule comprises with lower unit,
Initial assignment unit, for working as match point x
jnot the match point x searched in described neighbours' match point submodule
ik neighbours' match point for the moment, then by W
ijbe set to 0, wherein match point x
jwith match point x
ifor the match point in point set X, and i, j=1 ..., N, W
ijrepresent the element of weight matrix W i-th row jth row;
Solve unit, for
constraint condition under, adopt least square method to solve and obtain making following cost function E (W) get the weight matrix W of minimum value, cost function E (W) is as follows,
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510799813.6A CN105488754B (en) | 2015-11-19 | 2015-11-19 | Image Feature Matching method and system based on local linear migration and affine transformation |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510799813.6A CN105488754B (en) | 2015-11-19 | 2015-11-19 | Image Feature Matching method and system based on local linear migration and affine transformation |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105488754A true CN105488754A (en) | 2016-04-13 |
CN105488754B CN105488754B (en) | 2018-09-21 |
Family
ID=55675719
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510799813.6A Active CN105488754B (en) | 2015-11-19 | 2015-11-19 | Image Feature Matching method and system based on local linear migration and affine transformation |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105488754B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109242892A (en) * | 2018-09-12 | 2019-01-18 | 北京字节跳动网络技术有限公司 | Method and apparatus for determining the geometric transform relation between image |
CN109285110A (en) * | 2018-09-13 | 2019-01-29 | 武汉大学 | The infrared visible light image registration method and system with transformation are matched based on robust |
CN110148161A (en) * | 2019-04-12 | 2019-08-20 | 中国地质大学(武汉) | A kind of remote sensing images error hiding elimination method and system |
CN110175255A (en) * | 2019-05-29 | 2019-08-27 | 腾讯科技(深圳)有限公司 | The method of image labeling, mark methods of exhibiting and device based on pathological image |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103839253A (en) * | 2013-11-21 | 2014-06-04 | 苏州盛景空间信息技术有限公司 | Arbitrary point matching method based on partial affine transformation |
CN103700080B (en) * | 2013-12-06 | 2016-08-03 | 北京工业大学 | Image mismatch based on Skinner probabilistic automaton is to minimizing technology |
CN103778433B (en) * | 2014-01-15 | 2017-02-22 | 广东华中科技大学工业技术研究院 | Generalized-point-set matching method based on distances from points to lines |
CN105469112B (en) * | 2015-11-19 | 2018-12-14 | 武汉大学 | Image Feature Matching method and system based on local linear migration and rigid model |
-
2015
- 2015-11-19 CN CN201510799813.6A patent/CN105488754B/en active Active
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109242892A (en) * | 2018-09-12 | 2019-01-18 | 北京字节跳动网络技术有限公司 | Method and apparatus for determining the geometric transform relation between image |
CN109242892B (en) * | 2018-09-12 | 2019-11-12 | 北京字节跳动网络技术有限公司 | Method and apparatus for determining the geometric transform relation between image |
US10984542B2 (en) | 2018-09-12 | 2021-04-20 | Beijing Bytedance Network Technology Co., Ltd. | Method and device for determining geometric transformation relation for images |
CN109285110A (en) * | 2018-09-13 | 2019-01-29 | 武汉大学 | The infrared visible light image registration method and system with transformation are matched based on robust |
CN109285110B (en) * | 2018-09-13 | 2023-04-21 | 武汉大学 | Infrared visible light image registration method and system based on robust matching and transformation |
CN110148161A (en) * | 2019-04-12 | 2019-08-20 | 中国地质大学(武汉) | A kind of remote sensing images error hiding elimination method and system |
CN110175255A (en) * | 2019-05-29 | 2019-08-27 | 腾讯科技(深圳)有限公司 | The method of image labeling, mark methods of exhibiting and device based on pathological image |
CN110175255B (en) * | 2019-05-29 | 2022-04-05 | 腾讯医疗健康(深圳)有限公司 | Image annotation method, and annotation display method and device based on pathological image |
Also Published As
Publication number | Publication date |
---|---|
CN105488754B (en) | 2018-09-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105469110A (en) | Non-rigid transformation image characteristic matching method based on local linear transfer and system | |
CN108388896B (en) | License plate identification method based on dynamic time sequence convolution neural network | |
Ranftl et al. | Deep fundamental matrix estimation | |
Min et al. | A two-stream mutual attention network for semi-supervised biomedical segmentation with noisy labels | |
CN109285110B (en) | Infrared visible light image registration method and system based on robust matching and transformation | |
CN104573665B (en) | A kind of continuous action recognition methods based on improvement viterbi algorithm | |
CN105488754A (en) | Local linear migration and affine transformation based image feature matching method and system | |
CN103310453A (en) | Rapid image registration method based on sub-image corner features | |
CN105761233A (en) | FPGA-based real-time panoramic image mosaic method | |
CN104268841A (en) | Infrared image preprocessing method based on compressed sensing algorithm | |
CN103700101A (en) | Non-rigid brain image registration method | |
CN111275192B (en) | Auxiliary training method for improving accuracy and robustness of neural network simultaneously | |
CN104966279A (en) | Image synthesis restoration method based on local structure features | |
CN107038432B (en) | Fingerprint image direction field extraction method based on frequency information | |
CN103729882B (en) | A kind of some cloud relative pose estimation method based on three-dimensional curve coupling | |
CN108416753A (en) | A kind of Image denoising algorithm based on imparametrization alternating direction multipliers method | |
CN102135606A (en) | KNN (K-Nearest Neighbor) sorting algorithm based method for correcting and segmenting grayscale nonuniformity of MR (Magnetic Resonance) image | |
CN112102384B (en) | Non-rigid medical image registration method and system | |
CN105469408A (en) | Building group segmentation method for SAR image | |
CN104732546A (en) | Non-rigid SAR image registration method based on region similarity and local spatial constraint | |
CN114565594A (en) | Image anomaly detection method based on soft mask contrast loss | |
CN103400158A (en) | Dynamic shape codebook learning-based level set tracking method | |
CN105469112A (en) | Image feature matching method and system based on local linear migration and rigid model | |
CN109191503B (en) | Remote sensing image change detection method and system based on conditional random field | |
CN103793891A (en) | Low-complexity panorama image joint method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |