CN117351052A - Point cloud fine registration method based on feature consistency and spatial consistency - Google Patents

Point cloud fine registration method based on feature consistency and spatial consistency Download PDF

Info

Publication number
CN117351052A
CN117351052A CN202311335751.4A CN202311335751A CN117351052A CN 117351052 A CN117351052 A CN 117351052A CN 202311335751 A CN202311335751 A CN 202311335751A CN 117351052 A CN117351052 A CN 117351052A
Authority
CN
China
Prior art keywords
feature
consistency
point
point cloud
spatial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202311335751.4A
Other languages
Chinese (zh)
Other versions
CN117351052B (en
Inventor
曾慧
王瑄
江左
杨清港
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aerospace Science And Industry Group Intelligent Technology Research Institute Co ltd
University of Science and Technology Beijing USTB
Original Assignee
Aerospace Science And Industry Group Intelligent Technology Research Institute Co ltd
University of Science and Technology Beijing USTB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aerospace Science And Industry Group Intelligent Technology Research Institute Co ltd, University of Science and Technology Beijing USTB filed Critical Aerospace Science And Industry Group Intelligent Technology Research Institute Co ltd
Priority to CN202311335751.4A priority Critical patent/CN117351052B/en
Publication of CN117351052A publication Critical patent/CN117351052A/en
Application granted granted Critical
Publication of CN117351052B publication Critical patent/CN117351052B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)

Abstract

本发明提供一种基于特征一致性和空间一致性的点云精配准方法,属于计算机视觉技术领域。所述方法包括:对点云粗配准之后的点对进行处理,得到特征一致性和空间一致性;在特征一致性和空间一致性的基础上,利用置信度进行种子点选取;定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,构成簇,将特征一致性和空间一致性与非局部注意力融合,得到点云特征更新公式,以获得簇内点更新后的包含长距离信息的点云特征;通过更新后的点云特征生成概率匹配矩阵,基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准。采用本发明,能够提高点云配准的准确率和速度。

The invention provides a point cloud precise registration method based on feature consistency and spatial consistency, and belongs to the field of computer vision technology. The method includes: processing point pairs after coarse registration of point clouds to obtain feature consistency and spatial consistency; using confidence to select seed points based on feature consistency and spatial consistency; defining k nearest neighbors. In the feature space, with the seed point as the center, its nearest neighbor points are found in the k-nearest neighbor feature space to form a cluster. The feature consistency and spatial consistency are combined with non-local attention to obtain the point cloud feature update formula to obtain the points in the cluster. Updated point cloud features containing long-distance information; generate a probability matching matrix through the updated point cloud features. Based on the probability matching matrix, the rotation vector and translation matrix are calculated through singular value decomposition to achieve point cloud registration. By adopting the present invention, the accuracy and speed of point cloud registration can be improved.

Description

一种基于特征一致性和空间一致性的点云精配准方法A point cloud precision registration method based on feature consistency and spatial consistency

技术领域Technical field

本发明涉及计算机视觉技术领域,特别是指一种基于特征一致性和空间一致性的点云精配准方法。The invention relates to the field of computer vision technology, and in particular refers to a point cloud precision registration method based on feature consistency and spatial consistency.

背景技术Background technique

有源点云目标点云/>其中,源点云和目标点云的点数不同,即Nx≠Ny。点云配准就是找到源点云和目标点云的重合点,即内点,计算内点间的旋转矩阵和平移向量。近年来,点云精配准方法可以分为传统方法和基于深度学习的方法。Active point cloud Target point cloud/> Among them, the number of points of the source point cloud and the target point cloud is different, that is, N x ≠ N y . Point cloud registration is to find the coincident points of the source point cloud and the target point cloud, that is, the interior points, and calculate the rotation matrix and translation vector between the interior points. In recent years, point cloud precision registration methods can be divided into traditional methods and deep learning-based methods.

传统方法以ICP和RANSAC为代表,不断有ICP变体算法和RANSAC变体算法出现,但是传统方法存在的共性问题是:仅能得到局部最优解和计算效率低。Traditional methods are represented by ICP and RANSAC, and ICP variant algorithms and RANSAC variant algorithms continue to appear. However, the common problems of traditional methods are: they can only obtain local optimal solutions and have low computational efficiency.

随着近年来,深度学习技术的进步,越来越多的学者将目光放在深度学习方法上。2019年,Wang提出DCP算法,通过DGCNN网络和注意力机制实现快速点云配准,但是无法解决点云配准中的离群点剔除问题。2021年,Bai提出PointDSC方法,将空间一致性融入到特征提取中,可以实现离群点剔除,但是忽略了点云间的几何特征,导致点云配准的准确率低。With the advancement of deep learning technology in recent years, more and more scholars are focusing on deep learning methods. In 2019, Wang proposed the DCP algorithm to achieve fast point cloud registration through the DGCNN network and attention mechanism, but it could not solve the problem of outlier elimination in point cloud registration. In 2021, Bai proposed the PointDSC method, which integrates spatial consistency into feature extraction and can achieve outlier elimination. However, it ignores the geometric features between point clouds, resulting in low accuracy of point cloud registration.

发明内容Contents of the invention

本发明实施例提供了基于特征一致性和空间一致性的点云精配准方法,能够提高点云配准的准确率和速度。所述技术方案如下:Embodiments of the present invention provide a point cloud precise registration method based on feature consistency and spatial consistency, which can improve the accuracy and speed of point cloud registration. The technical solutions are as follows:

一方面,提供了一种基于特征一致性和空间一致性的点云精配准方法,该方法应用于电子设备,该方法包括:On the one hand, a point cloud precision registration method based on feature consistency and spatial consistency is provided. The method is applied to electronic devices. The method includes:

对点云粗配准之后的点对进行处理,得到特征一致性和空间一致性;Process the point pairs after coarse registration of the point cloud to obtain feature consistency and spatial consistency;

在特征一致性和空间一致性的基础上,利用置信度进行种子点选取;Based on feature consistency and spatial consistency, confidence is used to select seed points;

定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,构成簇,将特征一致性和空间一致性与非局部注意力融合,得到点云特征更新公式,以获得簇内点更新后的包含长距离信息的点云特征;Define the k-nearest neighbor feature space, take the seed point as the center, find its nearest neighbor points in the k-nearest neighbor feature space, form a cluster, fuse feature consistency and spatial consistency with non-local attention, and obtain the point cloud feature update formula to obtain The updated point cloud features containing long-distance information of the points in the cluster;

通过更新后的点云特征生成概率匹配矩阵,基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准。A probability matching matrix is generated through the updated point cloud features. Based on the probability matching matrix, the rotation vector and translation matrix are calculated through singular value decomposition to achieve point cloud registration.

进一步地,所述对点云粗配准之后的点对进行处理,得到特征一致性和空间一致性包括:Further, processing the point pairs after coarse registration of the point cloud to obtain feature consistency and spatial consistency includes:

定义点对的特征差经过归一化后的值为α,α值反应了点对的特征一致性,α值越小,则特征越趋于一致,具体公式如下:The normalized value of the feature difference of a point pair is defined as α. The α value reflects the feature consistency of the point pair. The smaller the α value, the more consistent the features are. The specific formula is as follows:

Δfn=||g(xn)-g(yn)||Δf n =||g(x n )-g(y n )||

αn∈α,n=1,2,...,Nα n ∈α, n=1, 2,...,N

其中,g(·)表示动态图卷积神经网络;xn和yn由sn分解而来,xn、yn和cn分别表示第n个源点云、第n个目标点云和第n个初始点对,初始点对由点云粗配准得到,N表示点对的总数目,即: 表示6维实数空间,/>表示3维实数空间;Δfn表示第n个点对的特征差;αn表示第n个点对的特征一致性;||·||表示欧几里得距离;[·]+是非负操作,表示αn值大于等于0;Among them , g(· ) represents the dynamic graph convolutional neural network ; The nth initial point pair, the initial point pair is obtained by coarse registration of the point cloud, N represents the total number of point pairs, that is: Represents a 6-dimensional real number space,/> represents a 3-dimensional real number space; Δf n represents the feature difference of the n-th point pair; α n represents the feature consistency of the n-th point pair; ||·|| represents the Euclidean distance; [·] + is a non-negative operation , indicating that α n value is greater than or equal to 0;

定义每两组点对之间的点对空间距离差为β,β值反应了空间一致性,β值越小,则点对与点对间的空间位置特征越匹配,设第i组点对间的欧式距离为di,则第i组点对和第j组点对间的欧式距离差值dij为:Define the point-pair spatial distance difference between each two sets of point pairs as β. The β value reflects the spatial consistency. The smaller the β value, the closer the spatial position characteristics between the point pair and the point pair match. Suppose the i-th group of point pairs The Euclidean distance between is d i , then the Euclidean distance difference d ij between the i-th group of point pairs and the j-th group of point pairs is:

dij=||di-dj||d ij =||d i -d j ||

第i组点对和第j组点对间的空间一致性βij为:The spatial consistency β ij between the i-th group of point pairs and the j-th group of point pairs is:

βij∈β,i=1,2,...,N,j==1,2,...,N。β ij ∈ β, i=1, 2,...,N, j==1, 2,...,N.

进一步地,所述在特征一致性和空间一致性的基础上,利用置信度进行种子点选取包括:Further, on the basis of feature consistency and spatial consistency, using confidence to select seed points includes:

定义种子置信度C为:Define seed confidence C as:

C=α+βC=α+β

其中,α值反应了点对的特征一致性,β值反应了空间一致性;Among them, the α value reflects the feature consistency of the point pair, and the β value reflects the spatial consistency;

将点对按照置信度C值由大到小排序,选择置信度排名前p%的点对作为种子点,其中,p为常数。The point pairs are sorted from large to small according to the confidence C value, and the point pairs with the top p% ranking of confidence are selected as seed points, where p is a constant.

进一步地,所述定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,构成簇,将特征一致性和空间一致性与非局部注意力融合,得到点云特征更新公式,以获得簇内点更新后的包含长距离信息的点云特征包括:Further, the k-nearest neighbor feature space is defined, with the seed point as the center, and its nearest neighbor points are found in the k-nearest neighbor feature space to form a cluster. The feature consistency and spatial consistency are combined with non-local attention to obtain point cloud features. The update formula to obtain the updated point cloud features containing long-distance information for the points in the cluster includes:

定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,将种子点及其近邻点的索引记作index,其中,index是二维矩阵,其大小为[nseed,nk],nseed是种子点数量,nk是以种子点为中心的近邻点数量;种子点及其近邻点构成簇,若点在簇内,则认为其是内点,若点在簇外,则认为其是离群点;Define the k nearest neighbor feature space, with the seed point as the center, find its nearest neighbor points in the k nearest neighbor feature space, and record the index of the seed point and its nearest neighbor points as index, where index is a two-dimensional matrix with a size of [n seed , n k ], n seed is the number of seed points, and n k is the number of neighboring points centered on the seed point; the seed point and its neighboring points form a cluster. If the point is within the cluster, it is considered an interior point. If the point is within If it is outside the cluster, it is considered to be an outlier;

将特征一致性和空间一致性与非局部注意力融合,得到k近邻特征空间中的点云特征更新公式为:By fusing feature consistency and spatial consistency with non-local attention, the point cloud feature update formula in the k-nearest neighbor feature space is obtained:

其中,等号右侧的f为粗配准得到的初始点对坐标经过一层卷积后得到的点对特征;等号左侧的f为更新后的特征,MLP(·)为多层感知机模型,softmax(·)是激活函数,χ代表特征相似度,代表向量叉乘,h(·)为线性映射函数,α′是将α展开,即:Among them, f on the right side of the equal sign is the point pair feature obtained after one layer of convolution of the initial point pair coordinates obtained by rough registration; f on the left side of the equal sign is the updated feature, and MLP(·) is multi-layer perception machine model, softmax(·) is the activation function, χ represents feature similarity, Represents vector cross product, h(·) is a linear mapping function, α′ expands α, that is:

其中,Nc表示特征空间中的特征维度;Among them, N c represents the feature dimension in the feature space;

通过得到的点云特征更新公式,获得簇内点更新后的包含长距离信息的点云特征。Through the obtained point cloud feature update formula, the updated point cloud features containing long-distance information of the points in the cluster are obtained.

进一步地,所述通过更新后的点云特征生成概率匹配矩阵,基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准包括:Further, the probability matching matrix is generated by the updated point cloud features. Based on the probability matching matrix, the rotation vector and the translation matrix are calculated through singular value decomposition. The realization of point cloud registration includes:

将更新后的点云特征进行L2归一化和非负操作,并计算其主特征值,得到概率匹配矩阵;Perform L2 normalization and non-negative operations on the updated point cloud features, and calculate their main eigenvalues to obtain a probability matching matrix;

基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准。Based on the probability matching matrix, the rotation vector and translation matrix are calculated through singular value decomposition to achieve point cloud registration.

进一步地,所述将更新后的特征进行L2归一化和非负操作,并计算其主特征值,得到概率匹配矩阵包括:Further, the updated features are subjected to L2 normalization and non-negative operations, and their main eigenvalues are calculated to obtain a probability matching matrix including:

通过更新后的特征信息,生成概率匹配矩阵e:Through the updated feature information, the probability matching matrix e is generated:

e=L{m}e=L{m}

其中,m由k近邻特征空间输出的更新后的点云特征f归一化得到,L{·}表示用幂迭代方法计算主特征向量,[·]+是非负操作,表示m值非负。Among them, m is normalized by the updated point cloud feature f output from the k-nearest neighbor feature space. L{·} represents the calculation of the main feature vector using the power iteration method. [·] + is a non-negative operation, indicating that the m value is non-negative.

进一步地,通过奇异值分解计算得到的旋转向量R和平移矩阵t表示为:Further, the rotation vector R and translation matrix t calculated through singular value decomposition are expressed as:

一方面,提供了一种电子设备,所述电子设备包括处理器和存储器,所述存储器中存储有至少一条指令,所述至少一条指令由所述处理器加载并执行以实现上述基于特征一致性和空间一致性的点云精配准方法。In one aspect, an electronic device is provided. The electronic device includes a processor and a memory. At least one instruction is stored in the memory. The at least one instruction is loaded and executed by the processor to achieve the above feature-based consistency. and spatially consistent point cloud precision registration method.

一方面,提供了一种计算机可读存储介质,所述存储介质中存储有至少一条指令,所述至少一条指令由处理器加载并执行以实现上述基于特征一致性和空间一致性的点云精配准方法。On the one hand, a computer-readable storage medium is provided. At least one instruction is stored in the storage medium. The at least one instruction is loaded and executed by a processor to implement the above-mentioned point cloud precision based on feature consistency and spatial consistency. Registration method.

本发明实施例提供的技术方案带来的有益效果至少包括:The beneficial effects brought by the technical solutions provided by the embodiments of the present invention include at least:

(1)在点云配准方面,针对传统方法容易陷入局部最优解的问题,本发明实施例提出了一种基于特征一致性和空间一致性的点云精配准方法,该方法能够快速、精准的给出旋转向量和平移矩阵,获得全局最优解。(1) In terms of point cloud registration, in order to solve the problem that traditional methods easily fall into local optimal solutions, embodiments of the present invention propose a point cloud precise registration method based on feature consistency and spatial consistency. This method can quickly , accurately give the rotation vector and translation matrix, and obtain the global optimal solution.

(2)针对点云配准中,源点云和目标点云数量不同的低重叠率情况,以往算法很难处理离群点的问题,本发明实施例通过特征一致性和空间一致性,剔除离群点,并通过基于置信度的种子选取机制,筛选可以匹配的内点;这样,通过对点云粗配准之后的点对的处理,可以以较高准确率和较快的速度完成低重叠率情况下的点云配准。(2) In point cloud registration, when the number of source point clouds and target point clouds is different and the number of low overlap rates is low, it is difficult for previous algorithms to deal with the problem of outliers. The embodiment of the present invention eliminates outliers through feature consistency and spatial consistency. outlier points, and filter out matching interior points through a confidence-based seed selection mechanism; in this way, by processing point pairs after coarse point cloud registration, low-level points can be completed with higher accuracy and faster speed. Point cloud registration under overlap ratio.

(3)针对点云配准中,以往算法忽略点云间的拓扑信息问题,本发明实施例通过引入动态图卷积神经网络,获取点云间的几何信息;通过融合非局部注意力,获取包含长距离信息的点云特征,大大提高了点云配准的准确率。(3) In view of the problem that previous algorithms ignore topological information between point clouds in point cloud registration, the embodiment of the present invention obtains geometric information between point clouds by introducing a dynamic graph convolutional neural network; by fusing non-local attention, obtains Point cloud features containing long-distance information greatly improve the accuracy of point cloud registration.

附图说明Description of drawings

为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

图1为本发明实施例提供的基于特征一致性和空间一致性的点云精配准方法的流程示意图;Figure 1 is a schematic flow chart of a point cloud precise registration method based on feature consistency and spatial consistency provided by an embodiment of the present invention;

图2为本发明实施例提供的点云配准网络结构示意图;Figure 2 is a schematic structural diagram of a point cloud registration network provided by an embodiment of the present invention;

图3(a)为本发明实施例提供的特征一致性示意图;Figure 3(a) is a schematic diagram of feature consistency provided by an embodiment of the present invention;

图3(b)为本发明实施例提供的空间一致性示意图;Figure 3(b) is a schematic diagram of spatial consistency provided by an embodiment of the present invention;

图4为本发明实施例提供的特征一致性网络结构示意图;Figure 4 is a schematic structural diagram of a feature consistency network provided by an embodiment of the present invention;

图5为本发明实施例提供的k近邻特征空间结构示意图;Figure 5 is a schematic diagram of the k-nearest neighbor feature space structure provided by the embodiment of the present invention;

图6为本发明实施例提供的在3DMatch公开数据集上的配准结果示意图;Figure 6 is a schematic diagram of the registration results on the 3DMatch public data set provided by the embodiment of the present invention;

图7是本发明实施例提供的一种电子设备的结构示意图。FIG. 7 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

具体实施方式Detailed ways

为使本发明的目的、技术方案和优点更加清楚,下面将结合附图对本发明实施方式作进一步地详细描述。In order to make the purpose, technical solutions and advantages of the present invention clearer, the embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.

如图1和图2所示,本发明实施例提供了一种基于特征一致性和空间一致性的点云精配准方法,该方法用于点云粗配准之后,粗配准得到的点对通常包含错误匹配点和离群点,并且容易陷入局部最优解;通过该方法,可以剔除离群点,提高配准精度,获得全局最优解。该方法可以由电子设备实现,该电子设备可以是终端或服务器,该方法包括:As shown in Figures 1 and 2, embodiments of the present invention provide a point cloud precise registration method based on feature consistency and spatial consistency. This method is used for point cloud coarse registration. Pairs usually contain wrong matching points and outliers, and are easy to fall into local optimal solutions; through this method, outliers can be eliminated, registration accuracy improved, and the global optimal solution obtained. The method can be implemented by an electronic device, which can be a terminal or a server. The method includes:

S101,对点云粗配准之后的点对进行处理,得到特征一致性和空间一致性;具体可以包括以下步骤:S101, process the point pairs after coarse registration of the point cloud to obtain feature consistency and spatial consistency; specifically, the following steps may be included:

A1,定义点对的特征差经过归一化后的值为α,α值反应了点对的特征一致性,α值越小,则特征越趋于一致,具体公式如下:A1, define the normalized value of the feature difference of a point pair as α. The α value reflects the feature consistency of the point pair. The smaller the α value, the more consistent the features are. The specific formula is as follows:

Δfn=||g(xn)-g(yn)||Δf n =||g(x n )-g(y n )||

αn∈α,n=1,2,...,Nα n ∈α, n=1, 2,...,N

其中,g(·)表示动态图卷积神经网络(Dynamic Graph Convolutional NeuralNetwork,DGCNN);xn和yn由cn分解而来,xn、yn和cn分别表示第n个源点云、第n个目标点云和第n个初始点对,N表示点对的总数目,即: 表示6维实数空间,/>表示3维实数空间,初始点对由点云粗配准得到;Δfn表示第n个点对的特征差;αn表示第n个点对的特征一致性;||·||表示欧几里得距离;[·]+是非负操作,表示αn值大于等于0;Among them, g(·) represents the Dynamic Graph Convolutional Neural Network (DGCNN); x n and y n are decomposed from c n , and x n , y n and c n respectively represent the nth source point cloud , the nth target point cloud and the nth initial point pair, N represents the total number of point pairs, that is: Represents a 6-dimensional real number space,/> Represents a 3-dimensional real number space, and the initial point pair is obtained by rough registration of the point cloud; Δf n represents the feature difference of the nth point pair; α n represents the feature consistency of the nth point pair; ||·|| represents Euclidean Rider distance; [·] + is a non-negative operation, indicating that the α n value is greater than or equal to 0;

A2,定义每两组点对之间的点对空间距离差为β,β值反应了空间一致性,β值越小,则点对与点对间的空间位置特征越匹配,设第i组点对间的欧式距离为di,则第i组点对和第j组点对间的欧式距离差值dij为:A2, define the point-pair spatial distance difference between each two sets of point pairs as β. The β value reflects the spatial consistency. The smaller the β value, the closer the spatial position characteristics between the point pair and the point pair match. Suppose the i-th group The Euclidean distance between point pairs is d i , then the Euclidean distance difference d ij between the i-th group of point pairs and the j-th group of point pairs is:

dij=||di-dj||d ij =||d i -d j ||

第i组点对和第j组点对间的空间一致性βij为:The spatial consistency β ij between the i-th group of point pairs and the j-th group of point pairs is:

βij∈β,i=1,2,...,N,j==1,2,...,N。β ij ∈ β, i=1, 2,...,N, j==1, 2,...,N.

如图3所示,图3(a)是特征一致性示意图,c1和c2是正确点对,c3是错误点对,Δf1、Δf2和Δf3表示点对间的特征差值则有|Δf1-Δf2|<|Δf2-Δf3|;图3(b)是空间一致性示意图,c1和c2是正确点对,c3是错误点对,d1、d2、d3和d4表示点与点之间的欧式距离,则有|d1-d2|<|d3-d4|。As shown in Figure 3, Figure 3(a) is a schematic diagram of feature consistency. c1 and c2 are correct point pairs, c3 is an incorrect point pair, and Δf 1 , Δf 2 and Δf 3 represent the feature differences between point pairs: | Δf 1 -Δf 2 |<|Δf 2 -Δf 3 |; Figure 3(b) is a schematic diagram of spatial consistency, c1 and c2 are correct point pairs, c3 is an incorrect point pair, d1, d2, d3 and d4 represent points and The Euclidean distance between points is |d1-d2|<|d3-d4|.

图4是特征一致性计算中,DGCNN网络示意图,具体来讲,网络输入源点云xn和目标点云yn,对源点云和目标点云分别进行边卷积操作,经过四层边卷积提取,四层卷积输出通道数依次为[16,16,32,64],每层卷积核大小为1×1,将每层卷积输出相加,并经过多层感知机和最大池化层,得到最终的特征值。将源点云特征值和目标点云特征值做差,得到特征差值Δfn,Δfn归一化后,得到特征一致性α。Figure 4 is a schematic diagram of the DGCNN network in feature consistency calculation. Specifically, the network inputs the source point cloud x n and the target point cloud y n , performs edge convolution operations on the source point cloud and the target point cloud respectively, and passes through four layers of edges. Convolution extraction, the number of output channels of the four layers of convolution is [16, 16, 32, 64], the size of the convolution kernel of each layer is 1×1, the convolution output of each layer is added, and passed through the multi-layer perceptron and Maximum pooling layer to obtain the final feature value. Difference the source point cloud feature value and the target point cloud feature value to obtain the feature difference value Δf n . After normalizing Δf n , the feature consistency α is obtained.

S102,在特征一致性和空间一致性的基础上,利用置信度进行种子点选取;具体可以包括以下步骤:S102, based on feature consistency and spatial consistency, use confidence to select seed points; specifically, the following steps may be included:

B1,定义种子置信度C为:B1, define the seed confidence C as:

C=α+βC=α+β

其中,α值反应了点对的特征一致性,β值反应了空间一致性,点对的置信度C值越大,则表示该点对越满足特征一致性和空间一致性,则其为正确匹配点的可能性越大;Among them, the α value reflects the feature consistency of the point pair, and the β value reflects the spatial consistency. The greater the confidence C value of the point pair, the more the point pair satisfies the feature consistency and spatial consistency, and it is correct. The greater the likelihood of matching points;

B2,将点对按照置信度C值由大到小排序,选择置信度排名前p%(例如,10%)的点对作为种子点,其中,p为常数。B2, sort the point pairs according to the confidence C value from large to small, and select the point pairs with the top p% (for example, 10%) confidence level as the seed points, where p is a constant.

S103,定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,构成簇,将特征一致性和空间一致性与非局部注意力融合,得到点云特征更新公式,以获得簇内点更新后的包含长距离信息的点云特征;具体可以包括以下步骤:S103, define the k-nearest neighbor feature space, take the seed point as the center, find its nearest neighbor points in the k-nearest neighbor feature space, form a cluster, fuse feature consistency and spatial consistency with non-local attention, and obtain the point cloud feature update formula. To obtain updated point cloud features containing long-distance information for points in the cluster; the specific steps may include the following:

C1,定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,将种子点及其近邻点的索引记作index,index是二维矩阵,其大小为[nseed,nk],其中,nseed是种子点数量,nk是以种子点为中心的近邻点数量;种子点及其近邻点构成簇,若点在簇内,则认为其是内点,若点在簇外,则认为其是离群点;C1, define the k nearest neighbor feature space, take the seed point as the center, find its nearest neighbor points in the k nearest neighbor feature space, record the index of the seed point and its neighbor points as index, index is a two-dimensional matrix, its size is [n seed , n k ], where n seed is the number of seed points, and n k is the number of neighboring points centered on the seed point; the seed point and its neighboring points form a cluster. If a point is within the cluster, it is considered an interior point. If If a point is outside the cluster, it is considered an outlier;

C2,将特征一致性和空间一致性与非局部注意力融合,得到k近邻特征空间中的点云特征更新公式为:C2, fuse feature consistency and spatial consistency with non-local attention, and obtain the point cloud feature update formula in k-nearest neighbor feature space as:

其中,等号右侧的f为粗配准得到的初始点对坐标经过一层卷积后得到的点云位置特征(简称:点云特征);等号左侧的f为更新后的特征,MLP(·)为多层感知机模型,softmax(·)是激活函数,χ代表特征相似度,代表向量叉乘,h(·)为线性映射函数,α′是将α展开,即:Among them, f on the right side of the equal sign is the point cloud position feature (abbreviation: point cloud feature) obtained after one layer of convolution of the initial point pair coordinates obtained by rough registration; f on the left side of the equal sign is the updated feature. MLP(·) is the multi-layer perceptron model, softmax(·) is the activation function, χ represents feature similarity, Represents vector cross product, h(·) is a linear mapping function, α′ expands α, that is:

其中,Nc表示特征空间中的特征维度;Among them, N c represents the feature dimension in the feature space;

为了更好地理解本实施例所述的点云特征更新公式,需对经典的非局部注意力模型进行说明,经典的非局部注意力模型可以表示为:In order to better understand the point cloud feature update formula described in this embodiment, it is necessary to explain the classic non-local attention model. The classic non-local attention model can be expressed as:

非局部注意力模型具有联系上下文信息的能力。Non-local attention models have the ability to relate contextual information.

本实施例中的特征更新公式将特征一致性和空间一致性与非局部注意力融合,以此获取特征空间中,结合上下文信息的长距离特征,并将其与原特征融合,完成特征的更新。The feature update formula in this embodiment integrates feature consistency and spatial consistency with non-local attention to obtain long-distance features combined with contextual information in the feature space, and fuses them with the original features to complete the feature update. .

如图5所示,k近邻特征空间网络输入点云特征f,f经过一层卷积,得到特征φ和/>经过转置后,得到θ,/>φ和θ进行矩阵乘法,得到特征相似度χ;将χ与空间一致性β融合后,整体作为权重,加于特征一致性α′上,经过多层感知机MLP得到更新后的特征f,新特征融合了特征信息和空间信息,并且增大感受野。As shown in Figure 5, the k-nearest neighbor feature space network inputs point cloud features f, f undergoes a layer of convolution to obtain features φ and/> After transposition, we get θ,/> φ and θ perform matrix multiplication to obtain the feature similarity χ; after fusing χ with the spatial consistency β, the whole is used as a weight and added to the feature consistency α′, and the updated feature f is obtained through the multi-layer perceptron MLP. The new Features combine feature information and spatial information and increase the receptive field.

C3,通过得到的点云特征更新公式,获得簇内点更新后的包含长距离信息的点云特征。每个点对都有对应的点云特征,按照index将点对的点云特征排序,即筛选出簇内点,簇内点的数量为nseed×nk;未在index中的点对,将被舍弃其点云特征,从而完成离群点剔除。C3. Through the obtained point cloud feature update formula, the updated point cloud features containing long-distance information of the points in the cluster are obtained. Each point pair has a corresponding point cloud feature. The point cloud features of the point pair are sorted according to the index, that is, the points in the cluster are filtered out. The number of points in the cluster is n seed × n k ; for point pairs not in the index, Its point cloud features will be discarded to complete outlier elimination.

S104,通过更新后的点云特征生成概率匹配矩阵,基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准;具体可以包括以下步骤:S104. Generate a probability matching matrix through the updated point cloud features. Based on the probability matching matrix, obtain the rotation vector and translation matrix through singular value decomposition calculation to achieve point cloud registration; specifically, the following steps may be included:

D1,将更新后的点云特征进行L2归一化和非负操作,并计算其主特征值,得到概率匹配矩阵;D1, perform L2 normalization and non-negative operations on the updated point cloud features, and calculate its main eigenvalues to obtain a probability matching matrix;

本实施例中,通过更新后的特征信息,生成概率匹配矩阵e:In this embodiment, the probability matching matrix e is generated through the updated feature information:

e=L{m}e=L{m}

其中,m由k近邻特征空间输出的更新后的点云特征f归一化得到,L{·}表示用幂迭代方法计算主特征向量,[·]+是非负操作,表示m值非负。Among them, m is normalized by the updated point cloud feature f output from the k-nearest neighbor feature space. L{·} represents the calculation of the main feature vector using the power iteration method. [·] + is a non-negative operation, indicating that the m value is non-negative.

D2,基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准。D2, based on the probability matching matrix, calculates the rotation vector and translation matrix through singular value decomposition to achieve point cloud registration.

本实施例中,通过奇异值分解计算得到的旋转向量R和平移矩阵t表示为:In this embodiment, the rotation vector R and translation matrix t calculated through singular value decomposition are expressed as:

为了验证本实施例提供的基于特征一致性和空间一致性的点云精配准方法的效果,本实施例使用如下评价指标:In order to verify the effect of the point cloud precise registration method based on feature consistency and spatial consistency provided in this embodiment, this embodiment uses the following evaluation indicators:

(1)召回率RR:召回率(Recall Rate)是衡量配准算法性能的重要指标之一。它用于评估算法对匹配正确的点对的识别能力,召回率定义为正确匹配的点对数与总的正确匹配点对数之比,召回率的取值范围为0到1之间,数值越大表示算法鲁棒性和准确性越高,能够更好地识别正确的匹配点对。(1) Recall rate RR: Recall rate is one of the important indicators to measure the performance of the registration algorithm. It is used to evaluate the algorithm's ability to identify correctly matched point pairs. The recall rate is defined as the ratio of the number of correctly matched point pairs to the total number of correctly matched point pairs. The recall rate ranges from 0 to 1. The value The larger the value, the higher the robustness and accuracy of the algorithm, and the better it can identify the correct matching point pairs.

(2)旋转误差RE:旋转误差(Rotation Error)用于衡量点云变换矩阵中的旋转矩阵精确度,定义如下:(2) Rotation error RE: Rotation error (Rotation Error) is used to measure the accuracy of the rotation matrix in the point cloud transformation matrix, and is defined as follows:

其中,是预测旋转矩阵值,R*是旋转矩阵真值,arccos是反余弦函数,Tr是迹运算。in, is the predicted rotation matrix value, R * is the rotation matrix true value, arccos is the inverse cosine function, and Tr is the trace operation.

(3)平移误差TE:平移误差(Translation Error)用于衡量点云变换矩阵中的平移向量精确度,定义如下:(3) Translation error TE: Translation error (Translation Error) is used to measure the accuracy of the translation vector in the point cloud transformation matrix, and is defined as follows:

其中,是预测平移向量值,t*是平移向量真值。in, is the predicted translation vector value, and t * is the true value of the translation vector.

为了验证本发明实施例提供的基于特征一致性和空间一致性的点云精配准方法的性能,本实施例中,采用公开数据集3DMatch,与近些年的经典算法进行对比;采用召回率RR、旋转误差RE和平移误差TE作为评价标准,点云配准结果如表1所示。如图6所示,源点云与目标点云不完全重合;根据表1和图6可知,本发明实施例提供的点云配准结果更佳。In order to verify the performance of the point cloud precise registration method based on feature consistency and spatial consistency provided by the embodiment of the present invention, in this embodiment, the public data set 3DMatch is used to compare with the classic algorithms in recent years; the recall rate is used RR, rotation error RE and translation error TE are used as evaluation criteria, and the point cloud registration results are shown in Table 1. As shown in Figure 6, the source point cloud and the target point cloud do not completely overlap; according to Table 1 and Figure 6, it can be seen that the point cloud registration results provided by the embodiment of the present invention are better.

表1点云配准结果Table 1 Point cloud registration results

综上,本发明实施例所述的基于特征一致性和空间一致性的点云精配准方法至少具有以下有益效果:In summary, the point cloud precise registration method based on feature consistency and spatial consistency described in the embodiment of the present invention has at least the following beneficial effects:

(1)在点云配准方面,针对传统方法容易陷入局部最优解的问题,本发明实施例提出了一种基于特征一致性和空间一致性的点云精配准方法,该方法能够快速、精准的给出旋转向量和平移矩阵,获得全局最优解。(1) In terms of point cloud registration, in order to solve the problem that traditional methods easily fall into local optimal solutions, embodiments of the present invention propose a point cloud precise registration method based on feature consistency and spatial consistency. This method can quickly , accurately give the rotation vector and translation matrix, and obtain the global optimal solution.

(2)针对点云配准中,源点云和目标点云数量不同的低重叠率情况,以往算法很难处理离群点的问题,本发明实施例通过特征一致性和空间一致性,剔除离群点,并通过基于置信度的种子选取机制,筛选可以匹配的内点;这样,通过对点云粗配准之后的点对的处理,可以以较高准确率和较快的速度完成低重叠率情况下的点云配准。(2) In point cloud registration, when the number of source point clouds and target point clouds is different and the number of low overlap rates is low, it is difficult for previous algorithms to deal with the problem of outliers. The embodiment of the present invention eliminates outliers through feature consistency and spatial consistency. outlier points, and filter out matching interior points through a confidence-based seed selection mechanism; in this way, by processing point pairs after coarse point cloud registration, low-level points can be completed with higher accuracy and faster speed. Point cloud registration under overlap ratio.

(3)针对点云配准中,以往算法忽略点云间的拓扑信息问题,本发明实施例通过引入动态图卷积神经网络,获取点云间的几何信息(其中,源点云中第n个点的几何信息为g(xn),目标点云中第n个点的几何信息为g(yn)),通过融合非局部注意力,获取包含长距离信息的点云特征,大大提高了点云配准的准确率。(3) In view of the problem that previous algorithms ignore the topological information between point clouds in point cloud registration, the embodiment of the present invention obtains the geometric information between point clouds by introducing a dynamic graph convolutional neural network (wherein, the nth point cloud in the source point cloud The geometric information of points is g(x n ), and the geometric information of the nth point in the target point cloud is g(y n )). By fusing non-local attention, point cloud features containing long-distance information are obtained, which greatly improves The accuracy of point cloud registration is improved.

图7是本发明实施例提供的一种电子设备600的结构示意图,该电子设备600可因配置或性能不同而产生比较大的差异,可以包括一个或一个以上处理器(centralprocessing units,CPU)601和一个或一个以上的存储器602,其中,所述存储器602中存储有至少一条指令,所述至少一条指令由所述处理器601加载并执行以实现上述基于特征一致性和空间一致性的点云精配准方法。FIG. 7 is a schematic structural diagram of an electronic device 600 provided by an embodiment of the present invention. The electronic device 600 may vary greatly due to different configurations or performance, and may include one or more processors (central processing units, CPUs) 601 and one or more memories 602, wherein at least one instruction is stored in the memory 602, and the at least one instruction is loaded and executed by the processor 601 to implement the above point cloud based on feature consistency and spatial consistency. Precise registration method.

在示例性实施例中,还提供了一种计算机可读存储介质,例如包括指令的存储器,上述指令可由终端中的处理器执行以完成上述基于特征一致性和空间一致性的点云精配准方法。例如,所述计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including instructions. The instructions can be executed by a processor in a terminal to complete the above-mentioned point cloud precise registration based on feature consistency and spatial consistency. method. For example, the computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps to implement the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. The above-mentioned The storage media mentioned can be read-only memory, magnetic disks or optical disks, etc.

以上所述仅为本发明的较佳实施例,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection of the present invention. within the range.

Claims (7)

1.一种基于特征一致性和空间一致性的点云精配准方法,其特征在于,包括:1. A point cloud precision registration method based on feature consistency and spatial consistency, which is characterized by: 对点云粗配准之后的点对进行处理,得到特征一致性和空间一致性;Process the point pairs after coarse registration of the point cloud to obtain feature consistency and spatial consistency; 在特征一致性和空间一致性的基础上,利用置信度进行种子点选取;Based on feature consistency and spatial consistency, confidence is used to select seed points; 定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,构成簇,将特征一致性和空间一致性与非局部注意力融合,得到点云特征更新公式,以获得簇内点更新后的包含长距离信息的点云特征;Define the k-nearest neighbor feature space, take the seed point as the center, find its nearest neighbor points in the k-nearest neighbor feature space, form a cluster, fuse feature consistency and spatial consistency with non-local attention, and obtain the point cloud feature update formula to obtain The updated point cloud features containing long-distance information of the points in the cluster; 通过更新后的点云特征生成概率匹配矩阵,基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准。A probability matching matrix is generated through the updated point cloud features. Based on the probability matching matrix, the rotation vector and translation matrix are calculated through singular value decomposition to achieve point cloud registration. 2.根据权利要求1所述的基于特征一致性和空间一致性的点云精配准方法,其特征在于,所述对点云粗配准之后的点对进行处理,得到特征一致性和空间一致性包括:2. The point cloud precise registration method based on feature consistency and spatial consistency according to claim 1, characterized in that, the point pairs after the point cloud coarse registration are processed to obtain feature consistency and spatial consistency. Consistency includes: 定义点对的特征差经过归一化后的值为α,α值反应了点对的特征一致性,α值越小,则特征越趋于一致,具体公式如下:The normalized value of the feature difference of a point pair is defined as α. The α value reflects the feature consistency of the point pair. The smaller the α value, the more consistent the features are. The specific formula is as follows: Δfn=‖g(xn)-g(yn)‖Δf n =‖g(x n )-g(y n )‖ 其中,g(·)表示动态图卷积神经网络;xn和yn由cn分解而来,xn、yn和cn分别表示第n个源点云、第n个目标点云和第n个初始点对,初始点对由点云粗配准得到,N表示点对的总数目,即: 表示6维实数空间,/>表示3维实数空间;Δfn表示第n个点对的特征差;αn表示第n个点对的特征一致性;‖·‖表示欧几里得距离;[·]+是非负操作,表示αn值大于等于0;Among them, g(·) represents the dynamic graph convolutional neural network; x n and y n are decomposed by c n , x n , y n and c n represent the nth source point cloud, nth target point cloud and The nth initial point pair, the initial point pair is obtained by coarse registration of the point cloud, N represents the total number of point pairs, that is: Represents a 6-dimensional real number space,/> represents a 3-dimensional real number space; Δf n represents the feature difference of the n-th point pair; α n represents the feature consistency of the n-th point pair; ‖·‖ represents the Euclidean distance; [·] + is a non-negative operation, indicating α n value is greater than or equal to 0; 定义每两组点对之间的点对空间距离差为β,β值反应了空间一致性,β值越小,则点对与点对间的空间位置特征越匹配,设第i组点对间的欧式距离为di,则第i组点对和第j组点对间的欧式距离差值dij为:Define the point-pair spatial distance difference between each two sets of point pairs as β. The β value reflects the spatial consistency. The smaller the β value, the closer the spatial position characteristics between the point pair and the point pair match. Suppose the i-th group of point pairs The Euclidean distance between is d i , then the Euclidean distance difference d ij between the i-th group of point pairs and the j-th group of point pairs is: dij=||di-dj||d ij =||d i -d j || 第i组点对和第j组点对间的空间一致性βij为:The spatial consistency β ij between the i-th group of point pairs and the j-th group of point pairs is: 3.根据权利要求1所述的基于特征一致性和空间一致性的点云精配准方法,其特征在于,所述在特征一致性和空间一致性的基础上,利用置信度进行种子点选取包括:3. The point cloud precision registration method based on feature consistency and spatial consistency according to claim 1, characterized in that, on the basis of feature consistency and spatial consistency, confidence is used to select seed points. include: 定义种子置信度C为:Define seed confidence C as: C=α+βC=α+β 其中,α值反应了点对的特征一致性,β值反应了空间一致性;Among them, the α value reflects the feature consistency of the point pair, and the β value reflects the spatial consistency; 将点对按照置信度C值由大到小排序,选择置信度排名前p%的点对作为种子点,其中,p为常数。The point pairs are sorted from large to small according to the confidence C value, and the point pairs with the top p% ranking of confidence are selected as seed points, where p is a constant. 4.根据权利要求1所述的基于特征一致性和空间一致性的点云精配准方法,其特征在于,所述定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,构成簇,将特征一致性和空间一致性与非局部注意力融合,得到点云特征更新公式,以获得簇内点更新后的包含长距离信息的点云特征包括:4. The point cloud precise registration method based on feature consistency and spatial consistency according to claim 1, characterized in that the k-nearest neighbor feature space is defined, with the seed point as the center, and the k-nearest neighbor feature space is searched. Its neighboring points form a cluster, and the feature consistency and spatial consistency are combined with non-local attention to obtain the point cloud feature update formula to obtain the point cloud features containing long-distance information after updating the points in the cluster, including: 定义k近邻特征空间,以种子点为中心,在k近邻特征空间中寻找其近邻点,将种子点及其近邻点的索引记作index,其中,index是二维矩阵,其大小为[nseed,nk],nseed是种子点数量,nk是以种子点为中心的近邻点数量;种子点及其近邻点构成簇,若点在簇内,则认为其是内点,若点在簇外,则认为其是离群点;Define the k nearest neighbor feature space, with the seed point as the center, find its nearest neighbor points in the k nearest neighbor feature space, and record the index of the seed point and its nearest neighbor points as index, where index is a two-dimensional matrix with a size of [n seed , n k ], n seed is the number of seed points, n k is the number of neighboring points centered on the seed point; the seed point and its neighboring points form a cluster. If the point is within the cluster, it is considered to be an interior point. If the point is within If it is outside the cluster, it is considered to be an outlier; 将特征一致性和空间一致性与非局部注意力融合,得到k近邻特征空间中的点云特征更新公式为:By fusing feature consistency and spatial consistency with non-local attention, the point cloud feature update formula in the k-nearest neighbor feature space is obtained: 其中,等号右侧的f为粗配准得到的初始点对坐标经过一层卷积后得到的点对特征;等号左侧的f为更新后的特征,MLP(·)为多层感知机模型,softmax(·)是激活函数,χ代表特征相似度,代表向量叉乘,h(·)为线性映射函数,α′是将α展开,即:Among them, f on the right side of the equal sign is the point pair feature obtained after one layer of convolution of the initial point pair coordinates obtained by rough registration; f on the left side of the equal sign is the updated feature, and MLP(·) is multi-layer perception machine model, softmax(·) is the activation function, χ represents feature similarity, Represents vector cross product, h(·) is a linear mapping function, α′ expands α, that is: 其中,Nc表示特征空间中的特征维度;Among them, N c represents the feature dimension in the feature space; 通过得到的点云特征更新公式,获得簇内点更新后的包含长距离信息的点云特征。Through the obtained point cloud feature update formula, the updated point cloud features containing long-distance information of the points in the cluster are obtained. 5.根据权利要求1所述的基于特征一致性和空间一致性的点云精配准方法,其特征在于,所述通过更新后的点云特征生成概率匹配矩阵,基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准包括:5. The point cloud precise registration method based on feature consistency and spatial consistency according to claim 1, characterized in that the probability matching matrix is generated through the updated point cloud features, based on the probability matching matrix, through singular Value decomposition calculation is used to obtain the rotation vector and translation matrix. The implementation of point cloud registration includes: 将更新后的点云特征进行L2归一化和非负操作,并计算其主特征值,得到概率匹配矩阵;Perform L2 normalization and non-negative operations on the updated point cloud features, and calculate their main eigenvalues to obtain a probability matching matrix; 基于概率匹配矩阵,通过奇异值分解计算得到旋转向量和平移矩阵,实现点云配准。Based on the probability matching matrix, the rotation vector and translation matrix are calculated through singular value decomposition to achieve point cloud registration. 6.根据权利要求5所述的基于特征一致性和空间一致性的点云精配准方法,其特征在于,所述将更新后的特征进行L2归一化和非负操作,并计算其主特征值,得到概率匹配矩阵包括:6. The point cloud precision registration method based on feature consistency and spatial consistency according to claim 5, characterized in that the updated features are subjected to L2 normalization and non-negative operations, and their main points are calculated. Eigenvalues, the probability matching matrix obtained includes: 通过更新后的特征信息,生成概率匹配矩阵e:Through the updated feature information, the probability matching matrix e is generated: e=L{m}e=L{m} 其中,m由k近邻特征空间输出的更新后的点云特征f归一化得到,L{·}表示用幂迭代方法计算主特征向量,[·]+是非负操作,表示m值非负。Among them, m is normalized by the updated point cloud feature f output from the k-nearest neighbor feature space. L{·} represents the calculation of the main feature vector using the power iteration method. [·] + is a non-negative operation, indicating that the m value is non-negative. 7.根据权利要求6所述的基于特征一致性和空间一致性的点云精配准方法,其特征在于,通过奇异值分解计算得到的旋转向量R和平移矩阵t表示为:7. The point cloud precise registration method based on feature consistency and spatial consistency according to claim 6, characterized in that the rotation vector R and the translation matrix t calculated by singular value decomposition are expressed as:
CN202311335751.4A 2023-10-16 2023-10-16 Point cloud fine registration method based on feature consistency and spatial consistency Active CN117351052B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311335751.4A CN117351052B (en) 2023-10-16 2023-10-16 Point cloud fine registration method based on feature consistency and spatial consistency

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311335751.4A CN117351052B (en) 2023-10-16 2023-10-16 Point cloud fine registration method based on feature consistency and spatial consistency

Publications (2)

Publication Number Publication Date
CN117351052A true CN117351052A (en) 2024-01-05
CN117351052B CN117351052B (en) 2024-09-20

Family

ID=89359016

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311335751.4A Active CN117351052B (en) 2023-10-16 2023-10-16 Point cloud fine registration method based on feature consistency and spatial consistency

Country Status (1)

Country Link
CN (1) CN117351052B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110176746A1 (en) * 2008-10-03 2011-07-21 Universite Joseph Fourier Grenoble 1 Method for registering a set of points in images
CN107590829A (en) * 2017-09-18 2018-01-16 西安电子科技大学 A kind of seed point pick-up method for being applied to the intensive cloud data registration of various visual angles
CN110322507A (en) * 2019-06-04 2019-10-11 东南大学 A method of based on depth re-projection and Space Consistency characteristic matching
CN112396641A (en) * 2020-11-17 2021-02-23 中国矿业大学(北京) Point cloud global registration method based on congruent two-baseline matching
US20220084221A1 (en) * 2019-02-11 2022-03-17 Siemens Aktiengesellschaft An apparatus and a method for performing a data driven pairwise registration of three-dimensional point clouds
CN114588636A (en) * 2020-12-07 2022-06-07 辉达公司 Graphics processing unit for detecting cheating using neural networks
CN114937066A (en) * 2022-06-09 2022-08-23 重庆理工大学 Point cloud registration system and method based on cross offset features and space consistency
CN115116013A (en) * 2021-03-19 2022-09-27 上海交通大学 Online dense point cloud semantic segmentation system and method fused with time series features

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110176746A1 (en) * 2008-10-03 2011-07-21 Universite Joseph Fourier Grenoble 1 Method for registering a set of points in images
CN107590829A (en) * 2017-09-18 2018-01-16 西安电子科技大学 A kind of seed point pick-up method for being applied to the intensive cloud data registration of various visual angles
US20220084221A1 (en) * 2019-02-11 2022-03-17 Siemens Aktiengesellschaft An apparatus and a method for performing a data driven pairwise registration of three-dimensional point clouds
CN110322507A (en) * 2019-06-04 2019-10-11 东南大学 A method of based on depth re-projection and Space Consistency characteristic matching
CN112396641A (en) * 2020-11-17 2021-02-23 中国矿业大学(北京) Point cloud global registration method based on congruent two-baseline matching
CN114588636A (en) * 2020-12-07 2022-06-07 辉达公司 Graphics processing unit for detecting cheating using neural networks
CN115116013A (en) * 2021-03-19 2022-09-27 上海交通大学 Online dense point cloud semantic segmentation system and method fused with time series features
CN114937066A (en) * 2022-06-09 2022-08-23 重庆理工大学 Point cloud registration system and method based on cross offset features and space consistency

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PORNANAN RAKTRAKULTHUM等: "Vehicle Classification in Congested Traffic Based on 3D Point Cloud Using SVM and KNN", 《2017 9TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND ELECTRICAL ENGINEERING》, 31 December 2017 (2017-12-31), pages 1 - 6 *
陈立: "建筑物三维点云边界特征提取算法研究", 《中国优秀硕士学位论文全文数据库基础科学辑》, no. 06, 15 June 2020 (2020-06-15), pages 005 - 175 *

Also Published As

Publication number Publication date
CN117351052B (en) 2024-09-20

Similar Documents

Publication Publication Date Title
Guo et al. Deep embedded clustering with data augmentation
WO2022095356A1 (en) Transfer learning method for image classification, related device, and storage medium
CN109359725B (en) Training method, device and equipment of convolutional neural network model and computer readable storage medium
WO2019018063A1 (en) Fine-grained image recognition
US20190354844A1 (en) Implementing Traditional Computer Vision Algorithms as Neural Networks
CN112328715A (en) Visual positioning method and related model training method and related devices and equipment
US20230153510A1 (en) Lithography simulation using a neural network
CN113205547A (en) Point cloud registration method, bone registration method, device, equipment and storage medium
CN110704652A (en) Vehicle image fine-grained retrieval method and device based on multiple attention mechanism
CN113240716A (en) Twin network target tracking method and system with multi-feature fusion
CN111223128A (en) Target tracking method, device, device and storage medium
CN113129345A (en) Target tracking method based on multi-feature map fusion and multi-scale expansion convolution
Kwedlo A new random approach for initialization of the multiple restart EM algorithm for Gaussian model-based clustering
CN115908514A (en) A point cloud registration method based on fusion of global features and local features
Sahloul et al. An accurate and efficient voting scheme for a maximally all-inlier 3D correspondence set
US20230376659A1 (en) Vlsi placement optimization using self-supervised graph clustering
Huang et al. Broad recommender system: An efficient nonlinear collaborative filtering approach
CN111583332A (en) Visual positioning method, system and device based on parallel search 2D-3D matching
CN112465876A (en) Stereo matching method and equipment
CN118467793B (en) Heterogeneous graph-oriented graph matching method, device and medium
CN117351052A (en) Point cloud fine registration method based on feature consistency and spatial consistency
Lakhili et al. Rigid and non-rigid 3D shape classification based on 3D Hahn moments neural networks model
CN113111687A (en) Data processing method and system and electronic equipment
CN117237422A (en) Edge-enhanced hierarchical attention point cloud matching method, device and system
Bhattacharya et al. Ranking-based triplet loss function with intra-class mean and variance for fine-grained classification tasks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant