CN102385750A - Line matching method and line matching system on basis of geometrical relationship - Google Patents

Abstract

The invention discloses a line matching method and a line matching system on the basis of a geometrical relationship. The line matching method comprises the following steps of: a step 1 of carrying out line detection on a plurality of images; a step 2 of carrying out projection transformation on lines detected from the same image; a step 3 of obtaining an intersection point of circular arcs formed by the lines detected from the same image on a projection plane; a step 4 of generating a matching feature of the lines detected from the same image; and a step 5 of carrying out line matching by the matching features corresponding to the lines detected from each image. In the method, a fundamental matrix does not need to be obtained in advanced, the influence of the point matching precision on the precision of the line matching is avoided, and the efficiency of a matching algorithm is improved.

Description

Straight line matching process and system based on geometric relationship

Technical field

The present invention relates to image processing field, relate in particular to straight line matching process and system based on geometric relationship.

Background technology

Straight line is to constitute important geometric element in the object in the three-dimensional world.The linear feature of object still keeps in the two dimensional image that from three-dimensional scenic, obtains.In the image of under the different visual angles Same Scene being taken a part of straight line remain unchanged or straight line between have certain correlativity; Find the straight line of the correspondence in the different images, utilize the corresponding relation between the straight line to confirm that coupling and transformation relation between two width of cloth images have important meaning.The recovery of three-dimensional scenic mainly utilizes a little and line comes out the reproductions such as object target of three-dimensional, and the straight line in the coupling different images is the important foundation of three-dimensional reconstruction.

The method of straight line coupling mainly adopts utmost point geometrical constraint to carry out coupling just, utilizes correlation method to carry out the essence coupling again.Utmost point geometrical constraint method is to utilize the geometric relationship of the image that obtains under two visual angles; Set up the corresponding geometric transformation relation between picture point; The geometrical constraint of point in the image at another visual angle in piece image can be represented through fundamental matrix; The fundamental matrix that obtains between image utilizes two end points of straight line can obtain the zone of meeting geometric constraint in another visual angle image, and the regional straight line that belongs to geometrical constraint is accomplished slightly coupling as candidate's straight line.Smart coupling adopts relevant method, and the grey scale change of choosing straight line neighborhood interior pixel realizes coupling as similarity.

Adopt the method for utmost point geometrical constraint need ask for fundamental matrix in advance; Asking for of fundamental matrix is to adopt match point that the method for asking linear equation is realized; Before the straight line coupling, need carry out a coupling, the precision receptor site matching precision influence of straight line coupling, matching algorithm efficiency is not high.

Summary of the invention

To the problems referred to above that exist in the prior art, the invention provides straight line matching process and system based on geometric relationship.

The invention provides straight line matching process, comprising based on geometric relationship:

Step 1 is carried out straight-line detection to several images;

Step 2, to from same image detection to straight line carry out projective transformation;

Step 3, ask for same image detection to the intersection point of the circular arc that on the projecting plane, forms of straight line;

Step 4 generates the matching characteristic of the straight line that same image detection arrives;

Step 5, utilize from each image detection to the corresponding matching characteristic of straight line carry out the straight line coupling.

In one example, in the step 1, thereby edge of image detected the straight line that detects in the image.

In one example, in the step 2, with image

Geometric center as the central point of coordinate transform, projection centre is the central point of unit sphere, wherein L ₁, L ₂, L ₃, L L, L _nBe detected straight line in the same image.

In one example, in the step 2, establishing the coordinate of coordinate transform central point in image is (q _X0q _Y0), in the same image on the detected straight line coordinate of any point be (q _xq _y), then The Transformation Relation of Projection is:

$\frac{\left(\begin{array}{ccc}{q}_x-q_{x0}& q_y-q_{y0}& -1\end{array}\right)}{\left|\right|\left(\begin{array}{ccc}{q}_x-q_{x0}& q_y-q_{y0}& -1\end{array}\right)\left|\right|}.$

In one example; In the step 3, establish on first circular arc that detected two straight lines are corresponding in the same image with second circular arc on 2 coordinate vector be respectively

then the intersection point of circular arc be

with

In one example, step 4 comprises:

Step 41 is chosen the pairing distance between two points on straight line of the intersection point coordinate points p farthest of camber line _Max1, p _Max2, and with

Mid point as new coordinate transform central point, and detected straight line in the same image carried out new projective transformation;

Be coordinate points p _Max1, p _Max2At the mid point of X axle,

Be coordinate points p _Max1, p _Max2Mid point at the Y axle;

Step 42 is asked for coordinate points p _Max1, p _Max2The unit normal vector of place circular arc under new projection, and this unit normal vector is set to reference vector;

Step 43 is calculated coordinate vector and the angle of reference vector under new projection of detected straight line in the same image;

Step 44 sorts the back as the matching characteristic of straight line with angle.

In one example, in the step 5, utilize nearest criterion that the matching characteristic of straight line is mated.

The invention provides a kind of system that realizes based on the straight line matching process of geometric relationship.

The present invention need not to ask in advance fundamental matrix, has avoided the influence of some matching precision to the precision of straight line coupling, has improved the efficient of matching algorithm.

Description of drawings

Come the present invention is done further explain below in conjunction with accompanying drawing, wherein:

Fig. 1 is the straight line matching process process flow diagram based on geometric relationship of the present invention;

Fig. 2 is the projective transformation illustraton of model;

Fig. 3 is that the circular arc intersection point is asked for schematic diagram.

Embodiment

The present invention proposes a kind of new straight line matching process, utilize the geometric relationship between the image cathetus to carry out matching judgment.Have parallel and overlapping relation between straight line in the image and the straight line; Crossing or parallel relation between the image straight line that obtains under the different visual angles is constant under certain condition; Determine the geometric relationship of straight line and other straight lines from straight line, utilize whether a straightforward differentiation of geometric relationship is same straight line.After linear projection is to the sphere; There are two intersection points in per two straight lines on sphere; This two intersection point is two limits of sphere great circle; Choose the expression amount of limit,, utilize vector correlation property to mate as matching criterior with of the geometric relationship employing vector representation of each bar straight line with other straight lines as geometric relationship.

Method provided by the invention is as shown in Figure 1, and it has used 2 images (being not limited to 2 images), i.e. image 1 and image 2, but identical to each treatment of picture flow process.Method provided by the invention comprises:

Step 101, image 1 and image 2 are carried out straight-line detection.When carrying out straight-line detection, through to Image Edge-Detection, and then from the image border, detect straight line.Former two width of cloth images are designated as respectively: f ¹(x y) and f ²(x y) detects image f ¹Straight line n bar in (x y) is designated as respectively

Image f ²Straight line m bar in (x y) is designated as respectively

Belong on the straight line

On j the point be expressed as

Only there is the image of rectilinear point to be designated as ∏ ₁, ∏ ₂, be expressed as

Step 102, projective transformation.Point through on the same straight line on the projective transformation image is being on the projecting plane on the same orthodrome.Certainly exist two intersection points between different circular arcs, and the line of two intersection points passes through the centre of sphere.The position of the intersection point that the geometry of image cathetus and relation are different corresponding is just different, for example in the image two straight line parallels then the circular arc intersection point on the sphere is near the equator of projection model, the circular arc intersection point that two straight lines intersect in image on the sphere then departs from the equator.Position of intersecting point information response between spherical arc the geometric relationship between straight line.The projective transformation model is as shown in Figure 2, with image f ¹Straight line in (x y)

The geometric relationship proper vector is asked for the process into example explanation projective transformation.

Be image ∏ ₁In straight line, choose ∏ ₁Geometric center

Be the central point of coordinate transform, projection centre C elects the center of sphere as, chooses unit sphere, connects point on the straight line C gets projection line with projection centre, the intersection point of projection line and sphere

For

Subpoint on sphere is with ∏ ₁On point adopt The Transformation Relation of Projection to project on the sphere.Note: image ∏ ₁In

Value is at 1,

The coordinate of coordinate transform central point in image does

Subpoint cp then ¹Coordinate is:

$\frac{\left(\begin{array}{ccc}{q}_x^1-q_{x0}^1& q_y^1-q_{y0}^1& -1\end{array}\right)}{\left|\right|\left(\begin{array}{ccc}{q}_x^1-q_{x0}^1& q_y^1-q_{y0}^1& -1\end{array}\right)\left|\right|}$

Step 103, ask for how much intersection points.Same orthodrome and projection centre can be confirmed unique plane, and the line that intersects the intersection point of circular arc in twos was the intersection of two Plane intersects of circular arc and projection centre.Can obtain the direction vector of intersection through the normal vector of two intersecting planes.Cross the centre of sphere like intersection shown in preceding, intersection point is positioned on the sphere, and the coordinate of intersection point can be obtained through the direction vector of intersection.With straight line

And straight line

Be example, image ∏ ₁Cathetus Last 2 subpoints on sphere

With

Coordinate vector do

Straight line

Last 2 subpoints on sphere

With

Coordinate vector

Then

The projection circular arc with

The intersection point of projection circular arc is:

Two intersection points are about centre of sphere symmetry, and amount of orientation first component is not less than zero value and is designated as Obtain other circular arcs together

The intersection point of projection circular arc, At ∏ ₁On corresponding point

In like manner ask for the intersection point between each circular arc successively, i.e. image ∏ ₁Cathetus

With

The intersection point of projection circular arc does

Corresponding point in original image do

Step 104, generation matching characteristic.In this step, utilize the inverse transformation of projective transformation to obtain the corresponding picture point of circular arc intersection point, these points are the straight-line intersection in the image.Choose the straight-line intersection middle distance farthest 2 mid point as new transform center all intersection points are projected on the sphere with new transform center again, the unit normal vector of the circular arc at 2 places of furthest is vector as a reference.The angle (or inner product absolute value) of the coordinate vector of intersection point and reference vector is as the expression amount of intersection point under new projection, and this expression amount is as an element of linear feature.The expression amount that will belong to intersection point on the same straight line is by arranging the generating feature vector from small to large.

As an example; Select straight-line intersection middle distance 2 points farthest,

2 mid points:

$p_{\mathrm{Mid}}^1:\left(\begin{array}{cc}{p}_{{\mathrm{Mid}}_x}^1& q_{{\mathrm{Mid}}_y}^1\end{array}\right)=\left(\begin{array}{cc}\frac{p_{{\mathrm{Max}1}_x}^1+p_{{\mathrm{Max}2}_x}^1}{2}& \frac{p_{{\mathrm{Max}1}_y}^1+p_{\mathrm{Ma}x2y}^1}{2}\end{array}\right).$ With

For transform center with intersection point

Project to the projection coordinate that looks for novelty on the sphere.

Straight-line intersection

projection coordinate's vector under new projection is:

The point

Coordinate vector at the subpoint of newly casting:

The unit normal vector of crossing these 2 circular arcs is: $\stackrel{\‾}{C}{V}_{\mathrm{Max}}^1=\frac{\stackrel{\‾}{C}{p}_{\mathrm{Max}1}^1\×\stackrel{\‾}{C}{P}_{\mathrm{Max}1}^1}{\left|\right|\stackrel{\‾}{C}{p}_{\mathrm{Max}1}^1\×\stackrel{\‾}{C}{p}_{\mathrm{Max}1}^1\left|\right|},$ Note Be reference vector

Intersection projection coordinates vector

and the reference vector

inner product:

Linear

feature vector generation:

on the intersection of the projection coordinate vector

Each intersection point projection coordinate vector is with the angle of reference vector: $\mathrm{Ar}\mathrm{Cos}(\stackrel{\‾}{C}{V}_{\mathrm{Max}}^1\·{[\stackrel{\‾}{C}{P}_{12}^1;\stackrel{\‾}{C}{P}_{13}^1;\mathrm{\Λ\; \Λ};\stackrel{\‾}{C}{P}_{1n-1}^1]}^T).$

Right $\mathrm{Ar}\mathrm{Cos}(\stackrel{\‾}{C}{V}_{\mathrm{Max}}^1\·{[\stackrel{\‾}{C}{P}_{12}^1;\stackrel{\‾}{C}{P}_{13}^1;\mathrm{\Λ\; \Λ};\stackrel{\‾}{C}{P}_{1n-1}^1]}^T)$ Sort by size the result

$\mathrm{sort}\left(\mathrm{ar}\cos (\stackrel{\‾}{C}{V}_{\max }^1\·{[\stackrel{\‾}{C}{P}_{12}^1;\stackrel{\‾}{C}{P}_{13}^1;\mathrm{\Λ\Λ};\stackrel{\‾}{C}{P}_{1n-1}^1]}^T)\right)$

Then matching characteristic is expressed as:

${\mathrm{MG}}_{1=}^1\mathrm{sort}\left(\mathrm{ar}\cos (\stackrel{\‾}{C}{V}_{\max }^1\·{[\stackrel{\‾}{C}{P}_{12}^1;\stackrel{\‾}{C}{P}_{13}^1;\mathrm{\Λ\Λ};\stackrel{\‾}{C}{P}_{1n-1}^1]}^T)\right).$

Generate the geometric relationship matching characteristic of all straight lines,

Adopt same step to generate image ∏ ₂Characteristic

Step 105, straight line coupling.Utilize the proper vector of nearest criteria match straight line.The above is merely preferred implementation of the present invention, but protection domain of the present invention is not limited thereto.Any those skilled in the art all can carry out suitable change or variation to it in technical scope disclosed by the invention, and this change or variation all should be encompassed within protection scope of the present invention.

Claims (8)

1. based on the straight line matching process of geometric relationship, it is characterized in that, comprising:

Step 1 is carried out straight-line detection to several images;

Step 2, to from same image detection to straight line carry out projective transformation;

Step 3, ask for same image detection to the intersection point of the circular arc that on the projecting plane, forms of straight line;

Step 4 generates the matching characteristic of the straight line that same image detection arrives;

Step 5, utilize from each image detection to the corresponding matching characteristic of straight line carry out the straight line coupling.

2. the straight line matching process based on geometric relationship as claimed in claim 1 is characterized in that, in the step 1, thereby edge of image is detected the straight line that detects in the image.

3. according to claim 1 or claim 2 the straight line matching process based on geometric relationship is characterized in that, in the step 2, with image

Geometric center as the central point of coordinate transform, projection centre is the central point of unit sphere, wherein L ₁, L ₂, L ₃, L L, L _nBe detected straight line in the same image.

4. the straight line matching process based on geometric relationship as claimed in claim 3 is characterized in that, in the step 2, establishing the coordinate of coordinate transform central point in image is (q _X0q _Y0), in the same image on the detected straight line coordinate of any point be (q _xq _y), then The Transformation Relation of Projection is:

$\frac{\left(\begin{array}{ccc}{q}_x-q_{x0}& q_y-q_{y0}& -1\end{array}\right)}{\left|\right|\left(\begin{array}{ccc}{q}_x-q_{x0}& q_y-q_{y0}& -1\end{array}\right)\left|\right|}.$

5. the straight line matching process based on geometric relationship as claimed in claim 4; It is characterized in that; In the step 3, establish on first circular arc that detected two straight lines are corresponding in the same image with second circular arc on 2 coordinate vector be respectively

and

then circular arc intersection point is

6. the straight line matching process based on geometric relationship as claimed in claim 5 is characterized in that step 4 comprises:

Step 41 is chosen the pairing distance between two points on straight line of the intersection point coordinate points p farthest of camber line _Max1, p _Max2, and with

Mid point as new coordinate transform central point, and detected straight line in the same image carried out new projective transformation;

Be coordinate points p _Max1, p _Max2At the mid point of X axle,

Be coordinate points p _Max1, p _Max2Mid point at the Y axle;

Step 42 is asked for coordinate points p _Max1, p _Max2The unit normal vector of place circular arc under new projection, and this unit normal vector is set to reference vector;

Step 43 is calculated coordinate vector and the angle of reference vector under new projection of detected straight line in the same image;

Step 44 sorts the back as the matching characteristic of straight line with angle.

7. the straight line matching process based on geometric relationship as claimed in claim 6 is characterized in that, in the step 5, utilizes nearest criterion that the matching characteristic of straight line is mated.

8. the system of any described straight line matching process based on geometric relationship of realization such as claim 1-7.

Images