CN103927785B - A kind of characteristic point matching method towards up short stereoscopic image data - Google Patents
A kind of characteristic point matching method towards up short stereoscopic image data Download PDFInfo
- Publication number
- CN103927785B CN103927785B CN201410162951.9A CN201410162951A CN103927785B CN 103927785 B CN103927785 B CN 103927785B CN 201410162951 A CN201410162951 A CN 201410162951A CN 103927785 B CN103927785 B CN 103927785B
- Authority
- CN
- China
- Prior art keywords
- triangle
- matched
- region
- characteristic point
- matching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000004422 calculation algorithm Methods 0.000 claims description 58
- 230000011218 segmentation Effects 0.000 claims description 4
- 230000008878 coupling Effects 0.000 claims 10
- 238000010168 coupling process Methods 0.000 claims 10
- 238000005859 coupling reaction Methods 0.000 claims 10
- 238000001514 detection method Methods 0.000 abstract description 9
- 125000004122 cyclic group Chemical group 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000001556 precipitation Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000002689 soil Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- Image Analysis (AREA)
Abstract
本发明提供一种面向近景摄影立体影像数据的特征点匹配方法,包括如下步骤:将同名影像对先后以子区域和三角形为约束条件进行特征点正向匹配并得到正向同名像点群,将同名影像先后对以子区域和三角形为约束条件进行特征点逆向匹配并得到逆向同名像点群,保留正向同名像点群和逆向同名像点群中相匹配的同名像点结果,得到最终匹配的同名像点结果;本发明依次采用子区域和三角形作为约束条件进行特征点检测,大大提高了特征点检测的时间效率并且提高了正确匹配点数目,在近景摄影立体影像匹配中具有重要的应用价值。
The present invention provides a feature point matching method for close-range photographic stereoscopic image data, which comprises the following steps: performing forward matching of feature points on image pairs with the same name using sub-regions and triangles as constraints to obtain a forward image point group with the same name, and The image of the same name performs reverse matching on the feature points with sub-regions and triangles as constraints, and obtains the reverse image point group of the same name, retains the matching results of the same-named image points in the forward image point group and the reverse image point group of the same name, and obtains the final match The result of the image point with the same name; the present invention adopts sub-regions and triangles as constraint conditions to carry out feature point detection, which greatly improves the time efficiency of feature point detection and improves the number of correct matching points, and has important applications in close-range photography stereoscopic image matching value.
Description
技术领域technical field
本发明属于数字近景摄影领域,涉及一种特征点匹配方法。The invention belongs to the field of digital close-range photography and relates to a feature point matching method.
背景技术Background technique
随着现代测绘技术的发展,数字摄影测量可以为数字地球、城市三维建模等提供数据和支持。对于数字摄影测量所获得的原始数据,比较重要的是数字影像的特征,包括点状特征、线状特征和面状特征。对这些特征的提取方法是影像分析和影像匹配的基础,可利用各种算子来进行,例如:Moravec算子、Forstner算子和Harris算子均可以用来提取特征点。对数字影像中的明显目标,不仅需要识别它们,还需要确定它们的位置。摄影测量中立体像对的量测是提取物体三维信息的基础。数字摄影测量中以影像匹配代替传统的人工观测,来达到自动确定同名像点的目的。影像匹配实质上是在两幅或多幅影像之间识别同名像点,它是数字摄影测量及计算机视觉的核心问题。基于灰度的匹配方法是一种较成熟的匹配方法,主要包括基于灰度相似度检测和最小二乘影像匹配的方法,它们都是以同名影像相似度为基础。With the development of modern surveying and mapping technology, digital photogrammetry can provide data and support for digital earth, three-dimensional modeling of cities, etc. For the original data obtained by digital photogrammetry, the features of digital images are more important, including point features, line features and surface features. The method of extracting these features is the basis of image analysis and image matching, and various operators can be used. For example, Moravec operator, Forstner operator and Harris operator can all be used to extract feature points. For obvious objects in digital images, it is not only necessary to identify them, but also to determine their positions. The measurement of stereo pairs in photogrammetry is the basis for extracting three-dimensional information of objects. In digital photogrammetry, image matching is used to replace traditional manual observation to achieve the purpose of automatically determining the same-named image point. Image matching is essentially to identify image points with the same name between two or more images, which is the core problem of digital photogrammetry and computer vision. The matching method based on gray level is a relatively mature matching method, mainly including methods based on gray level similarity detection and least squares image matching, which are all based on the similarity of images with the same name.
尺度不变特征转换(Scale-invariant feature transform,SIFT)是David Lowe提出的局部特征描述子,其将斑点检测、特征矢量生成和特征匹配搜索等步骤完整地结合在一起进行优化,达到了接近实时的运算速度。SIFT特征匹配算法可以处理两幅图像之间发生平移、旋转、仿射变换情况下的匹配问题,具有很强的匹配能力。然而,在获取影像数据时,由于可能会受到降水反射、土体运动、高速相机焦距设置和检校精度、拍摄角度以及场景布置等因素的影响,影像数据容易出现模糊、特征不明显、纹理不清晰等质量问题,此时,若采用常规的影像匹配方法,会出现正确匹配点少、误匹配点多的情况。Scale-invariant feature transform (Scale-invariant feature transform, SIFT) is a local feature descriptor proposed by David Lowe, which combines the steps of spot detection, feature vector generation, and feature matching search to achieve near real-time operating speed. The SIFT feature matching algorithm can deal with the matching problem in the case of translation, rotation, and affine transformation between two images, and has a strong matching ability. However, when acquiring image data, due to the influence of factors such as precipitation reflection, soil movement, high-speed camera focal length setting and calibration accuracy, shooting angle, and scene layout, the image data is prone to blurring, inconspicuous features, and blurred textures. At this time, if the conventional image matching method is used, there will be fewer correct matching points and more wrong matching points.
发明内容Contents of the invention
本发明针对现有技术的不足,目的在于提供一种能够提高正确匹配点数目、降低误匹配点数目并且提高了特征点检测的时间效率的面向近景摄影立体影像数据的特征点匹配方法。The purpose of the present invention is to provide a feature point matching method for close-range photography stereo image data that can increase the number of correct matching points, reduce the number of wrong matching points, and improve the time efficiency of feature point detection.
为达到上述目的,本发明的解决方案是:To achieve the above object, the solution of the present invention is:
一种面向近景摄影立体影像数据特征点的匹配方法,包括如下步骤:A method for matching feature points of close-range photographic stereoscopic image data, comprising the following steps:
(1)、采用平行摄影的方式对待匹配场景进行拍摄,选择同一时刻两个相机分别拍摄的两幅图像作为第一幅图像和的第二幅图像,在第一幅图像中选取第一待匹配区域,在第二幅图像中并选取与第一待匹配区域对应的第二待匹配区域;(1) Use parallel photography to shoot the scene to be matched, select two images taken by two cameras at the same time as the first image and the second image, and select the first image to be matched in the first image Region, in the second image and select the second region to be matched corresponding to the first region to be matched;
(2)、利用SIFT算法分别检测第一待匹配区域的特征点和第二待匹配区域的特征点,以第一待匹配区域内的特征点为基准分别将第一待匹配区域和第二待匹配区域分割为多个一一对应的子区域;(2), utilize the SIFT algorithm to detect respectively the feature point of the first area to be matched and the feature point of the second area to be matched, and take the feature points in the first area to be matched as a benchmark to separate the first area to be matched and the second area to be matched The matching area is divided into multiple one-to-one sub-areas;
(3)、分别以第一待匹配区域的各个子区域为约束条件,利用最近邻距离算法进行由第一待匹配区域的子区域向第二待匹配区域的对应子区域的特征点正向匹配,最终匹配出各个子区域的同名像点;(3), each sub-area of the first area to be matched is used as a constraint condition, and the nearest neighbor distance algorithm is used to carry out the forward matching of the feature points from the sub-area of the first area to be matched to the corresponding sub-area of the second area to be matched , and finally match the image points with the same name in each sub-region;
(4)、以第一待匹配区域的各个子区域的同名像点和位于子区域边缘上的特征点作为三角形的三个顶点分割子区域并构建三角网络;(4), with the image point of the same name of each sub-area of the first region to be matched and the feature point positioned on the edge of the sub-area as three vertices of the triangle to divide the sub-area and build a triangular network;
(5)、以步骤(4)所得三角网络中的各个三角形为约束条件,利用最近邻距离算法进行由第一待匹配区域的三角形向第二待匹配区域的对应三角形的特征点循环正向匹配,得到正向同名像点群;(5), with each triangle in the triangle network of step (4) gained as constraint condition, utilize the nearest neighbor distance algorithm to carry out by the triangle of the first area to be matched to the feature point circular forward matching of the corresponding triangle of the second area to be matched , to get the positive image point group of the same name;
(6)、分别以第二待匹配区域的各个子区域为约束条件,利用最近邻距离算法进行由第二待匹配区域的子区域向第一待匹配区域的对应子区域的特征点逆向匹配,最终匹配出各个子区域的同名像点;(6), each sub-area of the second area to be matched is used as a constraint condition, and the nearest neighbor distance algorithm is used to carry out reverse matching of feature points from the sub-area of the second area to be matched to the corresponding sub-area of the first area to be matched, Finally, the image points with the same name in each sub-region are matched;
(7)、以第二待匹配区域的各个子区域的同名像点和位于子区域边缘上的特征点作为三角形的三个顶点分割子区域并构建三角网络;(7), with the image point of the same name of each sub-area of the second region to be matched and the feature point positioned on the edge of the sub-area as three vertices of the triangle to divide the sub-area and build a triangular network;
(8)、以步骤(7)所得三角网络中的各个三角形为约束条件,利用最近邻距离算法进行由第二待匹配区域的三角形向第一待匹配区域的对应三角形的特征点循环逆向匹配,得到逆向同名像点群;(8), with each triangle in the triangle network of step (7) gained as constraint condition, utilize the nearest neighbor distance algorithm to carry out by the triangle of the second area to be matched to the feature point circular reverse matching of the corresponding triangle of the first area to be matched, Obtain the reverse image point group of the same name;
(9)、根据正向同名像点群和逆向同名像点群得到正确匹配的同名像点结果。(9). According to the forward image point group with the same name and the reverse image point group with the same name, a correctly matched image point result with the same name is obtained.
在步骤(2)中,根据第一待匹配区域和第二待匹配区域各自的坡度和坡向并把第一待匹配区域和第二待匹配区域目视相同的特征点作为子区域的分割点,把第一待匹配区域和第二待匹配区域完整地分割成数个对应的子区域。进一步地,第一待匹配区域或者第二待匹配区域各自的相邻子区域间有部分重叠。In step (2), according to the respective slopes and slopes of the first area to be matched and the second area to be matched, the feature points that are visually identical in the first area to be matched and the second area to be matched are used as the segmentation points of the sub-areas , completely divide the first to-be-matched region and the second to-be-matched region into several corresponding sub-regions. Further, adjacent sub-regions of the first to-be-matched region or the second to-be-matched region partially overlap each other.
步骤(5)中的特征点循环正向匹配具体包括:The feature point circular forward matching in the step (5) specifically includes:
第一步、设定预设循环次数和三角形大小阈值,;The first step is to set the preset number of cycles and the triangle size threshold;
第二步、将步骤(4)所得三角网络中的各个三角形作为第一级三角形,以第一级三角形为约束条件,利用最近邻距离算法进行由第一待匹配区域的第一级三角形向第二待匹配区域的对应三角形的特征点正向匹配,得到各个第一级三角形的同名像点,n设定为1,m设定为0;Second step, each triangle in step (4) gained triangular network is used as the first-order triangle, takes the first-order triangle as constraint condition, utilizes nearest neighbor distance algorithm to carry out by the first-order triangle of the first area to be matched to the first-order triangle 2. The feature points of the corresponding triangles in the area to be matched are forward matched to obtain the same-named image points of each first-level triangle, n is set to 1, and m is set to 0;
第三步、n=n+1,利用第n-1级三角形中正确匹配的同名像点与子区域的分割点作为三角形的三个顶点构建第n级三角形;The 3rd step, n=n+1, utilize the homonym image point of correct matching in the n-1th grade triangle and the division point of the subregion as three vertices of the triangle to construct the nth grade triangle;
第四步、以第n级三角形为约束条件,利用最近邻距离算法进行由第一待匹配区域的第n级三角形向第二待匹配区域的对应三角形的特征点正向匹配,并通过多次循环RANSAC算法剔除误匹配特征点,得出正确匹配的同名像点,m=m+1;The fourth step is to use the nth level triangle as a constraint condition, and use the nearest neighbor distance algorithm to carry out forward matching from the nth level triangle of the first to-be-matched area to the feature point of the corresponding triangle in the second to-be-matched area, and through multiple The cyclic RANSAC algorithm eliminates the incorrectly matched feature points, and obtains the correctly matched image points with the same name, m=m+1;
第五步、判断m是否不小于预设循环次数并且第n级三角形的大小是否均小于三角形大小阈值,当m不小于预设循环次数并且第n级三角形的大小均小于三角形大小阈值时,得到正向同名像点群,否则返回执行第三步,The fifth step is to determine whether m is not less than the preset number of cycles and whether the size of the nth-level triangles is smaller than the triangle size threshold. When m is not less than the preset number of cycles and the size of the n-th-level triangles is smaller than the triangle size threshold, get Forward the point group of the same name, otherwise return to the third step,
其中,n为三角形的级别,m为循环次数。Among them, n is the level of the triangle, and m is the number of cycles.
步骤(8)中的特征点循环逆向匹配具体包括:The feature point circular reverse matching in the step (8) specifically includes:
第一步、设定预设循环次数和三角形大小阈值;The first step is to set the preset number of cycles and the triangle size threshold;
第二步、将步骤(7)所得三角网络中的各个三角形作为第一级三角形,以第一级三角形为约束条件,利用最近邻距离算法进行由第二待匹配区域的第一级三角形向第一待匹配区域的对应三角形的特征点逆向匹配,得到各个第一级三角形的同名像点,n'设定为1,m'设定为0;Second step, each triangle in step (7) gained triangular network is used as the first-order triangle, takes the first-order triangle as constraint condition, utilizes nearest neighbor distance algorithm to carry out by the first-order triangle of the second area to be matched to the first-order triangle The feature points of the corresponding triangles in the area to be matched are reversely matched to obtain the same-named image points of each first-level triangle, n' is set to 1, and m' is set to 0;
第三步、n'=n'+1',利用第n'-1级三角形中正确匹配的同名像点与子区域的分割点作为三角形的三个顶点构建第n'级三角形;The 3rd step, n'=n'+1', utilize the homonym image point of correct match in the n'-1th grade triangle and the dividing point of the subregion as the three vertices of the triangle to construct the n'th grade triangle;
第四步、以第n'级三角形为约束条件,利用最近邻距离算法进行由第二待匹配区域的第n'级三角形向第一待匹配区域的对应三角形的特征点逆向匹配,并通过多次循环RANSAC算法剔除误匹配特征点,得出正确匹配的同名像点,m'=m'+1;The fourth step is to use the n'th level triangle as a constraint condition, and use the nearest neighbor distance algorithm to carry out reverse matching of the feature points from the n'th level triangle in the second to-be-matched area to the corresponding triangle in the first to-be-matched area, and through multiple The sub-cycle RANSAC algorithm eliminates the mismatched feature points, and obtains the correctly matched image points with the same name, m'=m'+1;
第五步、判断m'是否不小于预设循环次数并且第n'级三角形的大小是否均小于三角形大小阈值,当m'不小于预设循环次数并且第n'级三角形的大小均小于三角形大小阈值时,得到逆向同名像点群,否则返回执行第三步,The fifth step is to judge whether m' is not less than the preset number of cycles and whether the size of the n'th level triangle is smaller than the triangle size threshold, when m' is not less than the preset number of cycles and the size of the n'th level triangle is smaller than the triangle size When the threshold is reached, get the reverse image point group with the same name, otherwise return to the third step,
其中,n'为三角形的级别,m'为循环次数。Among them, n' is the level of the triangle, and m' is the number of cycles.
由于采用上述方案,本发明的有益效果是:Owing to adopting said scheme, the beneficial effect of the present invention is:
首先,本方法依次采用子区域和Delaunay三角形作为约束条件进行特征点检测,大大提高了特征点检测的时间效率;其次,本方法多次采用循环RANSAC算法剔除误匹配的特征点,从而降低了剔除正确同名像点的概率;另外,本方法利用SIFT算子基于特征进行匹配,不涉及影像的内外方位元素,避免了相机参数未知或相机检校参数误差较大对匹配结果精度的影响;最后,本方法采取逐级约束特征点区域进行匹配,避免了因特征相似导致的误匹配。First of all, this method sequentially uses sub-regions and Delaunay triangles as constraints to detect feature points, which greatly improves the time efficiency of feature point detection; secondly, this method repeatedly uses the cyclic RANSAC algorithm to eliminate incorrectly matched feature points, thereby reducing the number of culling points. The probability of the correct image point with the same name; in addition, this method uses the SIFT operator to perform matching based on features, which does not involve the internal and external orientation elements of the image, and avoids the impact of unknown camera parameters or large errors in camera calibration parameters on the accuracy of the matching results; finally, This method uses level-by-level constraint feature point regions for matching, which avoids mismatching caused by similar features.
附图说明Description of drawings
图1为本发明实施例中的面向近景摄影立体影像数据的特征点匹配方法的流程图。FIG. 1 is a flow chart of a feature point matching method for close-range photography stereo image data in an embodiment of the present invention.
图2为本发明实施例中的循环进行的特征点正向匹配的流程图。FIG. 2 is a flow chart of forward matching of feature points performed in a loop in an embodiment of the present invention.
图3为本发明实施例中的循环进行的特征点逆向匹配的流程图。Fig. 3 is a flow chart of the reverse matching of feature points performed in a loop in the embodiment of the present invention.
具体实施方式detailed description
以下结合附图所示实施例对本发明作进一步的说明。The present invention will be further described below in conjunction with the embodiments shown in the accompanying drawings.
实施例Example
本实施例提供了一种面向近景摄影立体影像数据的特征点匹配方法,其主要利用子区域和Delaunay三角形作为约束条件,采用SIFT算子进行特征点检测和匹配,并伴随着多次循环RANSAC算子(Random Sample Consensus)删除误匹配的同名像点,从而提高了正确匹配点数并且降低了误匹配点数。This embodiment provides a feature point matching method for close-range photographic stereoscopic image data, which mainly uses sub-regions and Delaunay triangles as constraint conditions, uses SIFT operator to detect and match feature points, and is accompanied by multiple rounds of RANSAC calculations. Random Sample Consensus (Random Sample Consensus) deletes wrongly matched pixels with the same name, thereby increasing the number of correct matching points and reducing the number of wrong matching points.
如图1所示,本实施例中的面向近景摄影立体影像数据的特征点匹配方法包括如下步骤:As shown in Figure 1, the feature point matching method for close-range photography stereoscopic image data in the present embodiment includes the following steps:
第一步、获取同名影像对并选取待匹配区域,具体包括:The first step is to obtain the image pair with the same name and select the area to be matched, including:
使用高速相机采用平行摄影的方式对同一待匹配场景进行拍摄,获得多幅数字图像,从中选择同一时刻两个高速相机分别拍摄的两幅图像分别作为第一幅图像和第二幅图像(也即组成了同名影像对)。为了提高特征点检测的时间效率,根据具体需要从第一幅图像选择待匹配的区域作为第一待匹配区域,从第二幅图像中选择与第一待匹配区域对应的区域作为第二待匹配区域。Use a high-speed camera to shoot the same scene to be matched in parallel photography to obtain multiple digital images, and select two images taken by two high-speed cameras at the same time as the first image and the second image respectively (that is, form the image pair with the same name). In order to improve the time efficiency of feature point detection, select the area to be matched from the first image as the first area to be matched according to specific needs, and select the area corresponding to the first area to be matched from the second image as the second area to be matched area.
第二步、利用SIFT算法分别检测出第一待匹配区域的特征点和第二待匹配区域的特征点。SIFT算法包括特征点检测和同名像点匹配,其中,特征点检测是在图像的尺度空间中搜索出图像的局部极值点,然后去除对比度低的极值点和不稳定的边缘响应点,从而确定图像的特征点,之后对特征点周围区域进行图像分块,计算各块内的梯度直方图,生成独特性的向量描述符,即128维的特征描述子,来描述每个特征点的位置、尺度和方向信息。In the second step, the feature points of the first region to be matched and the feature points of the second region to be matched are respectively detected by using the SIFT algorithm. The SIFT algorithm includes feature point detection and image point matching of the same name. Feature point detection is to search out the local extreme points of the image in the scale space of the image, and then remove the low-contrast extreme points and unstable edge response points, so that Determine the feature points of the image, then divide the image into blocks around the feature points, calculate the gradient histogram in each block, and generate a unique vector descriptor, that is, a 128-dimensional feature descriptor, to describe the position of each feature point , scale and orientation information.
第三步、以第一待匹配区域内的特征点为基准,分别将第一待匹配区域和第二待匹配区域分割为多个子区域,使得第一待匹配区域的子区域和第二待匹配区域的子区域呈一一对应关系。在分割时,要综合考虑第一待匹配区域和第二待匹配区域各自的坡度和坡向等特征,并将第一待匹配区域和第二待匹配区域中目视明显相同的特征点作为子区域的分割点,把第一待匹配区域和第二待匹配区域完整地分割成数个对应的子区域。分割时要保证第一待匹配区域或者第二待匹配区域各自的相邻子区域间有部分重叠,以保证在子区域交界处特征点的成功匹配。In the third step, based on the feature points in the first region to be matched, the first region to be matched and the second region to be matched are divided into a plurality of subregions, so that the subregions of the first region to be matched and the second region to be matched There is a one-to-one correspondence between subregions of regions. When segmenting, it is necessary to comprehensively consider the characteristics of the slope and aspect of the first to-be-matched area and the second to-be-matched area, and use the feature points that are visually identical in the first to-be-matched area and the second to-be-matched area as sub-groups. The segmentation point of the area completely divides the first to-be-matched area and the second to-be-matched area into several corresponding sub-areas. During segmentation, it is necessary to ensure that the adjacent sub-regions of the first to-be-matched region or the second to-be-matched region partially overlap each other, so as to ensure successful matching of feature points at the junction of the sub-regions.
第四步、分别以第一待匹配区域的各个子区域为约束条件,利用最近邻距离算法进行由第一待匹配区域的子区域向第二待匹配区域的对应子区域的特征点单向匹配(正向匹配),并通过多次循环RANSAC算法剔除误匹配的特征点,从而匹配出第一待匹配区域和第二待匹配区域的各个子区域的同名像点。The fourth step is to use each sub-area of the first area to be matched as a constraint condition, and use the nearest neighbor distance algorithm to perform one-way matching of feature points from the sub-area of the first area to be matched to the corresponding sub-area of the second area to be matched (forward matching), and remove the incorrectly matched feature points through the multiple-cycle RANSAC algorithm, thereby matching the image points with the same name in each sub-region of the first to-be-matched region and the second to-be-matched region.
本步骤中,SIFT算法中的同名像点匹配采用最近邻距离算法,该最近邻距离算法以子区域作为约束条件,能够限定同名像点的搜索范围,不仅提高了同名像点匹配的时间效率,而且还显著降低了误匹配率。在该约束条件下,按照各个子区域内的已检测出来的特征点,分别对各个子区域的特征点采用最近邻距离算法进行特征点匹配,即采用和样本特征点最近邻的特征点的欧式距离与次近邻特征点的欧氏距离的比值与设定的阈值比较,若比值小于阈值,则认为是特征点。然而,对各个子区域内匹配的特征点,会存在误匹配结果,可以通过多次循环RANSAC算法剔除误匹配的特征点。In this step, the matching of the same-named image points in the SIFT algorithm adopts the nearest neighbor distance algorithm. The nearest-neighbor distance algorithm uses sub-regions as constraints, which can limit the search range of the same-named image points, which not only improves the time efficiency of the same-named image point matching, It also significantly reduces the false match rate. Under this constraint, according to the detected feature points in each sub-area, the feature points of each sub-area are matched using the nearest neighbor distance algorithm, that is, the Euclidean method of the feature point nearest to the sample feature point is used. The ratio of the distance to the Euclidean distance of the second nearest neighbor feature point is compared with the set threshold, and if the ratio is smaller than the threshold, it is considered as a feature point. However, for the matched feature points in each sub-region, there will be mis-matched results, and the mis-matched feature points can be eliminated through the multiple-cycle RANSAC algorithm.
RANSAC算法是根据一组包含异常数据的样本数据集,计算出数据的数学模型参数,得到有效样本数据的算法。该算法的基本假设是样本中包含正确数据,也包含异常数据,当给定一组正确的数据,存在可以计算出符合这些数据的模型参数的方法。RANSAC算法首先是在样本数据集中随机抽取一个子集并初始化为模型,判断数据集中的其他数据是否满足该模型,若满足则构成一致集并计算新的模型,直至算法结束。根据该算法的原理,可以得出:由于随机抽取的数据子集不一样,其构建的初始模型也会不同,部分正确的数据由于不满足该模型被误认为错误的数据而剔除,所以构成的一致集中包含的样本数据和经过该算法得到的结果也会有所区别。The RANSAC algorithm is an algorithm that calculates the mathematical model parameters of the data based on a set of sample data sets containing abnormal data, and obtains effective sample data. The basic assumption of the algorithm is that the sample contains both correct data and abnormal data. When a set of correct data is given, there is a method that can calculate the model parameters that conform to these data. The RANSAC algorithm first randomly selects a subset in the sample data set and initializes it as a model, judges whether other data in the data set satisfy the model, and if so, forms a consistent set and calculates a new model until the end of the algorithm. According to the principle of the algorithm, it can be concluded that due to the different subsets of randomly selected data, the initial model constructed will be different, and some correct data are eliminated because they do not satisfy the model and are mistaken for wrong data. The sample data contained in the consistent set and the results obtained by the algorithm will also be different.
若是仅利用SIFT算子对整个待匹配区域进行特征点检测和同名像点匹配,则匹配结果中存在很多的误匹配点,这就需要利用RANSAC算子进行误匹配点剔除。如果仅对结果运行一次RANSAC算子,结果中虽然只有正确的同名像点,但是大量的正确匹配点也同样被认为是误匹配点被剔除,因此需要循环RANSAC算法;当循环RANSAC算法至数百次时,由于每次循环初始的模型有可能不同,故可以降低剔除正确同名像点的概率。If only the SIFT operator is used to detect the feature points and match the same-named image points on the entire area to be matched, there will be many mismatching points in the matching result, which requires the use of the RANSAC operator to eliminate the mismatching points. If you run the RANSAC operator only once on the result, although there are only correct pixels with the same name in the result, a large number of correct matching points are also considered as mismatching points and are eliminated, so you need to cycle the RANSAC algorithm; when the cycle RANSAC algorithm reaches hundreds times, since the initial model of each cycle may be different, it can reduce the probability of eliminating the correct pixel with the same name.
第五步、以各个子区域内已匹配出来的同名像点和子区域的分割点作为三角形的三个顶点,分别在第一待匹配区域的各个子区域和第二待匹配区域的各个子区域内构建Delaunay三角形,并将Delaunay三角形作为第一级三角形,多个第一级三角形共同形成第一级三角网络。The 5th step, with the same name image point that has been matched in each sub-area and the division point of sub-area as three apexes of triangle, respectively in each sub-area of the first area to be matched and each sub-area of the second area to be matched Construct the Delaunay triangle, and use the Delaunay triangle as the first-level triangle, and multiple first-level triangles together form the first-level triangular network.
第六步、以第五步所得第一级三角网络中的各个第一级三角形为初始约束条件,利用最近邻距离算法进行由第一待匹配区域的三角形向第二待匹配区域的对应三角形的特征点循环单向匹配(正向匹配)和第n级三角形的构建,最终得到正向同名像点群。The sixth step, with each first-level triangle in the first-level triangular network obtained in the fifth step as the initial constraint condition, use the nearest neighbor distance algorithm to carry out the corresponding triangle from the triangle in the first area to be matched to the corresponding triangle in the second area to be matched The feature point circular one-way matching (forward matching) and the construction of the nth level triangle finally get the forward homonymous image point group.
其中,如图2所示,第六步具体包括如下分步骤:Wherein, as shown in Figure 2, the sixth step specifically includes the following sub-steps:
步骤1-1、设定预设循环次数和三角形大小阈值;Step 1-1, set the preset number of cycles and triangle size threshold;
步骤1-2、以第五步所得第一级三角形为约束条件,利用最近邻距离算法进行由第一待匹配区域的第一级三角形向第二待匹配区域的对应三角形的特征点单向匹配(正向匹配),并通过多次循环RANSAC算法剔除误匹配特征点,得出正确匹配的各个第一级三角形的同名像点,三角形的级别n设定为1,循环次数m的值设定为0;Step 1-2, with the first-level triangle obtained in the fifth step as the constraint condition, use the nearest neighbor distance algorithm to perform one-way matching from the first-level triangle in the first to-be-matched area to the feature point of the corresponding triangle in the second to-be-matched area (forward matching), and through multiple cycles of RANSAC algorithm to eliminate the mismatched feature points, to obtain the correct matching image points of the same name of each first-level triangle, the level n of the triangle is set to 1, and the value of the number of cycles m is set is 0;
步骤1-3、使得三角形的级别n=n+1,利用第n-1级三角形中正确匹配的同名像点与子区域的分割点作为三角形的三个顶点构建第n级三角形;Step 1-3, making the level of the triangle n=n+1, using the correctly matched image point of the same name in the n-1th level triangle and the division point of the sub-region as the three vertices of the triangle to construct the nth level triangle;
步骤1-4、以第n级三角形为约束条件,利用最近邻距离算法进行由第一待匹配区域的第n级三角形向第二待匹配区域的对应三角形的特征点单向匹配(正向匹配),并通过多次循环RANSAC算法剔除误匹配特征点,得出正确匹配的同名像点,循环次数m=m+1;Step 1-4, with the nth level triangle as the constraint condition, the nearest neighbor distance algorithm is used to carry out the one-way matching (forward matching) of the feature points of the corresponding triangle of the second area to be matched from the nth level triangle of the first area to be matched ), and get rid of the mismatched feature points by multiple cycles of RANSAC algorithm, to obtain the correctly matched image point of the same name, the number of cycles m=m+1;
步骤1-5、判断循环次数m是否不小于预设循环次数m0并且第n级三角形的大小Tn是否均小于三角形大小阈值T0,当循环次数m不小于预设循环次数并且第n级三角形的大小均小于三角形大小阈值时,得到正向同名像点群,然后结束第六步,否则返回执行步骤1-3。Step 1-5, judge whether the number of cycles m is not less than the preset number of cycles m 0 and whether the size Tn of the nth-level triangles is smaller than the triangle size threshold T 0 , when the number of cycles m is not less than the preset number of cycles and the n-th level triangle When the sizes of are smaller than the triangle size threshold, get the positive image point group with the same name, and then end the sixth step, otherwise return to step 1-3.
第七步、分别以第二待匹配区域的各个子区域为约束条件,利用最近邻距离算法进行由第二待匹配区域的子区域向第一待匹配区域的对应子区域的特征点单向匹配(逆向匹配),并通过多次循环RANSAC算法剔除误匹配的特征点,从而匹配出第一待匹配区域和第二待匹配区域的各个子区域的同名像点。The seventh step is to use each sub-area of the second area to be matched as a constraint condition, and use the nearest neighbor distance algorithm to perform one-way matching of feature points from the sub-area of the second area to be matched to the corresponding sub-area of the first area to be matched (reverse matching), and remove the incorrectly matched feature points through multiple cycles of the RANSAC algorithm, thereby matching the image points with the same name in each sub-region of the first to-be-matched region and the second to-be-matched region.
第八步、以各个子区域内已匹配出来的同名像点和子区域的分割点作为三角形的三个顶点,分别在第一待匹配区域的各个子区域和第二待匹配区域的各个子区域内构建Delaunay三角形,并将该Delaunay三角形作为第一级三角形,多个第一级三角形共同形成第一级三角网络。The 8th step, with the same name picture point that has been matched in each sub-area and the dividing point of sub-area as three apexes of triangle, respectively in each sub-area of the first area to be matched and each sub-area of the second area to be matched A Delaunay triangle is constructed, and the Delaunay triangle is used as a first-level triangle, and a plurality of first-level triangles together form a first-level triangular network.
第九步、以第八步所得第一级三角网络中的各个第一级三角形为初始约束条件,利用最近邻距离算法进行由第二待匹配区域的三角形向第一待匹配区域的对应三角形的特征点循环单向匹配(逆向匹配)和第n'级三角形的构建,最终得到逆向同名像点群。The ninth step, with each first-level triangle in the first-level triangular network obtained in the eighth step as the initial constraint condition, use the nearest neighbor distance algorithm to carry out the corresponding triangle from the triangle in the second area to be matched to the corresponding triangle in the first area to be matched The feature point cyclic one-way matching (reverse matching) and the construction of the n'th level triangle finally get the reverse image point group with the same name.
其中,如图3所示,第九步具体包括如下分步骤:Wherein, as shown in Figure 3, the ninth step specifically includes the following sub-steps:
步骤2-1、设定预设循环次数和三角形大小阈值;Step 2-1, setting the preset number of cycles and the triangle size threshold;
步骤2-2、以第八步所得第一级三角形为约束条件,利用最近邻距离算法进行由第二待匹配区域的第一级三角形向第一待匹配区域的对应三角形的特征点单向匹配(逆向匹配),并通过多次循环RANSAC算法剔除误匹配特征点,得出正确匹配的各个第一级三角形的同名像点,三角形的级别n'设定1,循环次数m'的值设定为0;Step 2-2, with the first-level triangle obtained in the eighth step as a constraint condition, use the nearest neighbor distance algorithm to perform one-way matching from the first-level triangle in the second to-be-matched area to the feature point of the corresponding triangle in the first to-be-matched area (reverse matching), and eliminate the mis-matched feature points through the multiple-cycle RANSAC algorithm to obtain the correct matching image points of the same name of each first-level triangle, the level n' of the triangle is set to 1, and the value of the number of cycles m' is set is 0;
步骤2-3、使得三角形的级别n'=n'+1,利用第n-1级三角形中正确匹配的同名像点与子区域的分割点作为三角形的三个顶点构建第n'级三角形;Step 2-3, making the level n'=n'+1 of the triangle, using the correctly matched image points of the same name in the n-1th level triangle and the division points of the sub-regions as the three vertices of the triangle to construct the n'th level triangle;
步骤2-4、以第n'级三角形为约束条件,利用最近邻距离算法进行由第二待匹配区域的第n级三角形向第一待匹配区域的对应三角形的特征点单向匹配(逆向匹配),并通过多次循环RANSAC算法剔除误匹配特征点,得出正确匹配的同名像点,使循环次数m'=m'+1;Step 2-4, with the n 'th level triangle as the constraint condition, utilize the nearest neighbor distance algorithm to carry out the one-way matching (reverse matching) of the feature points of the corresponding triangle of the first area to be matched from the nth level triangle of the second area to be matched ), and remove the mismatched feature points by multiple cycles of the RANSAC algorithm to obtain correctly matched image points of the same name, so that the number of cycles m'=m'+1;
步骤2-5、判断循环次数m'是否不小于预设循环次数m'0并且第n'级三角形的大小T'n是否均小于三角形大小阈值T'0,当循环次数m'不小于预设循环次数并且第n'级三角形的大小均小于三角形大小阈值时,得到逆向同名像点群,然后结束第九步,否则返回执行步骤2-3。Step 2-5. Determine whether the number of cycles m' is not less than the preset number of cycles m' 0 and whether the size T' n of the n'th level triangle is smaller than the triangle size threshold T' 0 , when the number of cycles m' is not less than the preset When the number of cycles is repeated and the size of the n'th level triangles is smaller than the triangle size threshold, the reverse image point group with the same name is obtained, and then the ninth step is ended, otherwise, return to step 2-3.
因为同名影像对通过SIFT算子可以检测非常密集的特征点,目视观察发现会有大量的同名像点,经过子区域和三角网约束匹配的同名像点并通过RANSAC算子剔除误匹配点之后,仍然有很多同名像点没有匹配成功。因此,可以通过逆向匹配,即以同名影像对中的另外一副图像为基准进行特征点的逆向匹配。Because image pairs with the same name can detect very dense feature points through the SIFT operator, visual observation reveals that there will be a large number of image points with the same name, after matching the same-named image points through the sub-region and triangular network constraints, and eliminating the mismatched points through the RANSAC operator , there are still many pixels with the same name that have not been successfully matched. Therefore, reverse matching can be used, that is, the reverse matching of feature points can be performed based on another image in the image pair with the same name.
第十步、保留正向同名像点群和逆向同名像点群中相匹配的同名像点结果,即得到最终匹配的同名像点结果。In the tenth step, retain the matching result of the same-named pixel in the forward homonymous pixel group and the reverse homonymous pixel group, that is, obtain the final matching homonymous pixel result.
按照本实施例提到的方法,采用滑坡模拟平台下高速相机拍摄的立体影像数据验证其可行性。当不采用本实施例的方法时而采用基于灰度相似度匹配方法,整个滑坡体仅正确匹配出422对同名像点,并且滑坡体的下部仅匹配出12个同名像点。使用本实施例的方法,以子区域和循环构建的三角网为约束条件,先后利用同名影像对作为基准影像,按照SIFT算法进行匹配并多次循环RANSAC算法剔除误匹配点。经过测试该数据,结果显示,同名影像对中可较均匀地匹配出同名像点4552个,匹配数目是以前的10倍,大大提高了正确匹配点数。According to the method mentioned in this embodiment, use the stereo image data captured by the high-speed camera under the landslide simulation platform to verify its feasibility. When the matching method based on gray similarity is used instead of the method of this embodiment, only 422 pairs of image points with the same name are correctly matched for the entire landslide body, and only 12 image points with the same name are matched for the lower part of the landslide body. Using the method of this embodiment, with sub-regions and circularly constructed triangular networks as constraints, image pairs with the same name are used as reference images successively, matching is performed according to the SIFT algorithm, and incorrectly matched points are eliminated by the RANSAC algorithm for multiple cycles. After testing the data, the results show that 4,552 image points with the same name can be matched evenly in the image pair with the same name, and the matching number is 10 times that of the previous one, which greatly increases the number of correct matching points.
综上所述,在成像模型、外界环境等因素的影响下,高速相机所获取的影像数据质量较差,若直接采用SIFT和RANSAC算法,出现成功匹配出的同名像点少、分布不均等结果;而本实施例采用按子区域和三角网为约束条件多次循环RANSAC算法并且进行同名影像对的双向匹配,得到同名像点数据多且分布均匀,并且降低了误匹配点,在近景摄影立体影像匹配及三维立体模型重建等方面具有重要的应用价值。To sum up, under the influence of imaging model, external environment and other factors, the quality of image data acquired by high-speed cameras is poor. If SIFT and RANSAC algorithms are directly used, there will be few and uneven distribution of successfully matched pixels with the same name. ; And the present embodiment adopts subregion and triangular network as the constraint condition multiple cycles RANSAC algorithm and carries out the two-way matching of image pair of the same name, obtains image point data of the same name is many and evenly distributed, and reduces the wrong match point, in close-range photography three-dimensional It has important application value in image matching and three-dimensional model reconstruction.
上述的对实施例的描述是为便于该技术领域的普通技术人员能理解和使用本发明。熟悉本领域技术的人员显然可以容易地对这些实施例做出各种修改,并把在此说明的一般原理应用到其他实施例中而不必经过创造性的劳动。因此,本发明不限于上述实施例,本领域技术人员根据本发明的揭示,不脱离本发明范畴所做出的改进和修改都应该在本发明的保护范围之内。The above description of the embodiments is for those of ordinary skill in the art to understand and use the present invention. It is obvious that those skilled in the art can easily make various modifications to these embodiments, and apply the general principles described here to other embodiments without creative efforts. Therefore, the present invention is not limited to the above-mentioned embodiments. Improvements and modifications made by those skilled in the art according to the disclosure of the present invention without departing from the scope of the present invention should fall within the protection scope of the present invention.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410162951.9A CN103927785B (en) | 2014-04-22 | 2014-04-22 | A kind of characteristic point matching method towards up short stereoscopic image data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410162951.9A CN103927785B (en) | 2014-04-22 | 2014-04-22 | A kind of characteristic point matching method towards up short stereoscopic image data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103927785A CN103927785A (en) | 2014-07-16 |
CN103927785B true CN103927785B (en) | 2016-08-24 |
Family
ID=51145996
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410162951.9A Expired - Fee Related CN103927785B (en) | 2014-04-22 | 2014-04-22 | A kind of characteristic point matching method towards up short stereoscopic image data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103927785B (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104574519B (en) * | 2015-01-31 | 2017-05-31 | 华北水利水电大学 | Multi-source resident's terrain feature exempts from the automatic sane matching process of threshold value |
WO2017091927A1 (en) * | 2015-11-30 | 2017-06-08 | 华为技术有限公司 | Image processing method and dual-camera system |
CN108108700B (en) * | 2017-12-27 | 2020-02-21 | 江苏大学 | A method for identifying characteristic regions of pigs based on peg transformation |
CN108364343B (en) * | 2018-01-11 | 2021-07-09 | 东南大学 | A fast control method for close-up photography |
CN108765532B (en) * | 2018-05-04 | 2023-08-22 | 卢卡(北京)智能科技有限公司 | Child drawing model building method, reading robot and storage device |
CN109615646A (en) * | 2018-12-17 | 2019-04-12 | 石家庄爱赛科技有限公司 | Stereo matching system and solid matching method |
CN110111375B (en) * | 2019-03-29 | 2021-05-04 | 中国地质大学(武汉) | A method and device for image matching gross error elimination under the constraint of Delaunay triangulation |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101350101A (en) * | 2008-09-09 | 2009-01-21 | 北京航空航天大学 | Automatic Registration Method of Multiple Depth Images |
CN101833765A (en) * | 2010-04-30 | 2010-09-15 | 天津大学 | Feature Matching Method Based on Bidirectional Matching and Triangle Constraint |
CN103177444A (en) * | 2013-03-08 | 2013-06-26 | 中国电子科技集团公司第十四研究所 | Automatic SAR (synthetic-aperture radar) image rectification method |
-
2014
- 2014-04-22 CN CN201410162951.9A patent/CN103927785B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101350101A (en) * | 2008-09-09 | 2009-01-21 | 北京航空航天大学 | Automatic Registration Method of Multiple Depth Images |
CN101833765A (en) * | 2010-04-30 | 2010-09-15 | 天津大学 | Feature Matching Method Based on Bidirectional Matching and Triangle Constraint |
CN103177444A (en) * | 2013-03-08 | 2013-06-26 | 中国电子科技集团公司第十四研究所 | Automatic SAR (synthetic-aperture radar) image rectification method |
Non-Patent Citations (3)
Title |
---|
《A New Remote Sensing Image Registration Approach Based on Retrofitted SIFT Algorithm And a Novel Similarity Measure》;ZhiLi Song;《International Conference on Computational Intelligence & Software Engineering》;20091231;全文 * |
《基于控制点约束及区域相关的立体匹配算法》;赵聪等;《山东理工大学学报》;20081130;第22卷(第6期);全文 * |
《多重约束下由粗到精的多源图像自适应配准算法》;邢帅等;《光电工程》;20070630;第34卷(第6期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN103927785A (en) | 2014-07-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103927785B (en) | A kind of characteristic point matching method towards up short stereoscopic image data | |
CN103247045B (en) | A kind of method obtaining artificial scene principal direction and image border from multi views | |
US8406510B2 (en) | Methods for evaluating distances in a scene and apparatus and machine readable medium using the same | |
JP2018028899A5 (en) | ||
CN114119751A (en) | Method and system for large scale determination of RGBD camera poses | |
CN107274483A (en) | A kind of object dimensional model building method | |
CN110110793B (en) | Binocular image rapid target detection method based on double-current convolutional neural network | |
CN115082617A (en) | Pipeline three-dimensional reconstruction method and device based on multi-view optimization and storage medium | |
CN107025647B (en) | Image tampering forensics method and device | |
Ji et al. | An evaluation of conventional and deep learning‐based image‐matching methods on diverse datasets | |
US11475629B2 (en) | Method for 3D reconstruction of an object | |
CN110443228B (en) | Pedestrian matching method and device, electronic equipment and storage medium | |
Liu et al. | Match selection and refinement for highly accurate two-view structure from motion | |
CN113920433A (en) | Method and apparatus for analyzing surface material of object | |
Ji et al. | 3d reconstruction of dynamic textures in crowd sourced data | |
CN104346614A (en) | Watermelon image processing and positioning method under real scene | |
Martinec et al. | 3d reconstruction by gluing pair-wise euclidean reconstructions, or" how to achieve a good reconstruction from bad images" | |
CN103955929B (en) | Image local edge pattern and non-edge mode judging method and judgment means | |
Dong et al. | Learning stratified 3D reconstruction | |
Skuratovskyi et al. | Outdoor mapping framework: from images to 3d model | |
CN104392453B (en) | The ransac characteristic matching optimization methods of image are inserted based on polar curve | |
da Cunha et al. | A study on the impact of domain randomization for monocular deep 6DoF pose estimation | |
CN113284230A (en) | Three-dimensional reconstruction method for image sequence | |
CN101661621B (en) | Method for determining the direction of the altitude from a sequence of images relating to a building scene | |
Wang et al. | A combined approach on RBC image segmentation through shape feature extraction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160824 Termination date: 20190422 |
|
CF01 | Termination of patent right due to non-payment of annual fee |