CN111127667B - Point cloud initial registration method based on region curvature binary descriptor - Google Patents
Point cloud initial registration method based on region curvature binary descriptor Download PDFInfo
- Publication number
- CN111127667B CN111127667B CN201911133616.5A CN201911133616A CN111127667B CN 111127667 B CN111127667 B CN 111127667B CN 201911133616 A CN201911133616 A CN 201911133616A CN 111127667 B CN111127667 B CN 111127667B
- Authority
- CN
- China
- Prior art keywords
- point
- points
- module
- feature
- point cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000004364 calculation method Methods 0.000 claims abstract description 11
- 239000011159 matrix material Substances 0.000 claims description 36
- 238000000605 extraction Methods 0.000 claims description 27
- 150000001875 compounds Chemical class 0.000 claims description 14
- 238000007781 pre-processing Methods 0.000 claims description 13
- 230000009466 transformation Effects 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000001914 filtration Methods 0.000 claims description 7
- 230000004931 aggregating effect Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 claims description 3
- 239000000284 extract Substances 0.000 claims description 2
- 238000004321 preservation Methods 0.000 claims 2
- 239000012634 fragment Substances 0.000 abstract description 6
- 238000012545 processing Methods 0.000 abstract description 4
- 238000004422 calculation algorithm Methods 0.000 description 15
- 238000001514 detection method Methods 0.000 description 4
- 210000003127 knee Anatomy 0.000 description 4
- 210000002414 leg Anatomy 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 210000000038 chest Anatomy 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 101000822805 Naja atra Cytotoxin A5 Proteins 0.000 description 2
- 101000822803 Naja kaouthia Cytotoxin homolog Proteins 0.000 description 2
- 101000783567 Naja naja Cytotoxin 1 Proteins 0.000 description 2
- 101000822819 Naja naja Cytotoxin-like basic protein Proteins 0.000 description 2
- 238000000354 decomposition reaction Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000011426 transformation method Methods 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- DMSMPAJRVJJAGA-UHFFFAOYSA-N benzo[d]isothiazol-3-one Chemical compound C1=CC=C2C(=O)NSC2=C1 DMSMPAJRVJJAGA-UHFFFAOYSA-N 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 210000000481 breast Anatomy 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2008—Assembling, disassembling
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a point cloud initial registration method based on a region curvature binary descriptor. The method has the advantages of high calculation speed, high registration accuracy, strong anti-interference capability and the like, can resist normal errors and changed point cloud density, and can meet the requirements of processing cultural relic fragments with different shapes, serious appearance damage and high noise when being applied specifically.
Description
Technical Field
The invention belongs to the technical field of three-dimensional point cloud registration, and particularly relates to a point cloud initial registration method based on a region curvature binary descriptor.
Background
Three-dimensional point cloud registration is a popular research direction in computer graphics at present, and has profound influence on various fields such as modern medicine, cultural relic protection, aerospace and the like. The three-dimensional point cloud registration refers to that the model point cloud is transformed to a coordinate system which is the same as the scene point cloud through rigid transformation to obtain finished three-dimensional point cloud data. The correspondence of points between two point clouds is a core problem that the registration needs to solve. Existing registration methods are generally divided into two steps, initial registration and fine registration. The initial registration starts from the overall situation, an approximate rotation translation matrix of two point clouds is found, the optimization efficiency is improved, and the fine registration is prevented from falling into the local optimum. The fine registration means that after the initial registration, a more accurate registration matrix is obtained through further calculation.
The initial registration of three-dimensional point clouds can be currently divided into three categories: global registration based methods, local feature description based algorithms, and random sample consensus (RANSAC) framework based methods. Based on an algorithm of global feature description, converting point cloud registration into a point cloud feature search problem under different visual angles; based on the algorithm of local feature description, registering by establishing, searching and matching the corresponding relation of key feature points of the point cloud; and determining corresponding points by utilizing an overlapping area between the point cloud data based on a random sampling consistency algorithm, and solving a rigid body transformation relation between the point clouds to be matched according to the corresponding points. Zhou et al propose a fast global registration algorithm. The algorithm performs a matching operation on points of the point cloud surface. This optimization achieves close alignment of the target point cloud without initialization in order to align the surfaces and remove false matches to optimize a single target.
Tombari et al propose a SHOT descriptor, divide 32 subspaces of a spherical space of feature points along radial, azimuth and pitching 3 directions, and count included angles between a normal of a neighborhood point and a normal of a key point in each region to generate the SHOT descriptor. The SHOT method has better local feature description capability, but is sensitive to density variation of point cloud and Gaussian noise.
Shen et al first combined coarse registration of FPFH with fine registration of ICP. The FPFH operation speed is very fast, and the dimension is lower, saves the operation space, but does not consider the selection standard of neighborhood radius when calculating, and the degree of dependence on the point cloud precision is very high. When the accuracy of the cloud data sets of the points to be registered is different, the registration is inefficient.
In conclusion, although scholars at home and abroad make extensive research in the field of initial registration of three-dimensional vision, the existing initial registration method has the defects of low registration precision, poor robustness and low iteration speed.
Disclosure of Invention
In order to solve the problems, the invention provides a point cloud initial registration method based on a region curvature binary descriptor, and solves the defects of low registration accuracy, poor robustness and low iteration speed of the conventional initial registration method.
In order to solve the technical problems, the invention adopts the following technical scheme to realize:
the point cloud initial registration method based on the region curvature binary descriptor specifically comprises the following steps:
step 4.1, inIn and->Closest->And next closest-> When the ratio of the two distances->Below a threshold value T 1 ,0.6≤T 1 Less than or equal to 0.9, and storing>Step 4.2 is carried out; otherwise, repeat 4.1;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And/or>The distance between them;
step 4.2 inThe middle search and the decision in step 4.1 are->Closest->And next closest>When the ratio of the two distances +>Below a threshold value T 2 ,0.6≤T 2 Less than or equal to 0.9 percent and is preserved>Step 4.3 is carried out; otherwise, returning to the step 4.1;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And/or>The distance between them;
step 4.3, calculating the result obtained in step 4.1And ^ obtained in step 4.2>If the obtained Lp distance is larger than the threshold value T 3 ,0.75mr≤T 3 Performing step 4.4 when the concentration is less than or equal to 0.85 mr; otherwise, returning to the step 4.1;
step 4.4, judge the descriptorAnd descriptor>Whether or not the same feature point corresponds, if the descriptor->And descriptorCorresponding to the same characteristic point, obtaining a group of matched characteristic points; otherwise, returning to the step 4.1;
and 5, repeating the steps 2 to 4, traversing all point cloud data in the data set S to obtain all matched feature points, and thus obtaining the point cloud data set S' after initial registration.
Specifically, in the step 2, the feature points are converted into binary stringsThe process comprises the following steps:
Step 2.1, obtaining characteristic pointsIs a set of characteristic points whose central radius is within r>R is more than or equal to 25mr and less than or equal to 75mr, and is calculated>The covariance matrix D of (a);
in the formula (d) i Representing characteristic pointsAnd field point->Is greater than or equal to>Means a sum within a radius r>Adjacent arbitrary points;
step 2.2, establishing characteristic points according to the covariance matrix DAnd then combining the three-dimensional local coordinate system>And all the points adjacent to the point are projected on a two-dimensional plane;
step 2.3, divide the two-dimensional plane into 2L s ×2L s A grid, quantized projection points into the corresponding grid, 2L s Representing the number of each edge division of the two-dimensional plane;
step 2.4, calculating the weighted curvature of the projection point in each grid, aggregating all weighted curvatures to form a curvature distribution matrix, and automatically forming a curvature map by the curvature distribution matrix;
step 2.5, the curvature graph in the step 2.4 is converted into a binary string, and the characteristic points are obtainedThe corresponding descriptors.
Specifically, the process of converting the feature points into the binary character strings in the step 3 is the same as the step 2.
Specifically, the step 2 and the step 3 both use an ISS feature point extraction method to extract feature points.
Specifically, in the step 1, the obtained point cloud data needs to be preprocessed, and the preprocessing process includes filtering denoising and outlier denoising.
The invention also discloses a point cloud initial registration system based on the region curvature binary descriptor, which comprises the following modules:
a data acquisition module for acquiring a three-dimensional point cloud data set S, S = [ S ] of a measured object 1 ,S 2 ,...,S i ,...S j ,...,S m ];S i Represents the ith point cloud data, i =1,2,.. The m, j =1,2,. The m, i ≠ j, and m ≧ 2;
a feature point extraction module for extracting S i Forming a set of feature points of Representing a point cloud S i The v-th feature point in (1); extraction of S j Is formed by a characteristic point-forming set> Representing a point cloud S j The u-th feature point in (1);
a feature point conversion module for converting the feature points in the feature point extraction module into binary character stringsAnd represents->The v-th descriptor in (1); />Represents->The u-th descriptor in (1);
a feature point matching module for findingAnd &>The same characteristic points specifically include:
a positive sequence search module for searching inIn and->Nearest-neighbor>And next closest>/>When the ratio of the two distances->Below a threshold value T 1 ,0.6≤T 1 Less than or equal to 0.9, and storing>Entering a reverse order searching module; otherwise, repeating the positive sequence searching process;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And/or>The distance between them;
a reverse order lookup module forGet ^ in the middle search and positive sequence search module>Closest->And next closest->When the ratio of the two distances +>Below a threshold value T 2 ,0.6≤T 2 Less than or equal to 0.9 percent and is preserved>Entering; otherwise, returning to the positive sequence searching module;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And &>The distance between them;
an Lp distance calculation module for calculating the distance obtained by the positive sequence search moduleAnd the result of the reverse order lookup module>If the obtained Lp distance is larger than the threshold value T 3 ,0.75mr≤T 3 Matching the characteristic points with a module less than or equal to 0.85 mr; otherwise, returning to the positive sequence searching module;
a feature point pairing module for judging the descriptorAnd descriptor->Whether or not the same feature point corresponds, if the descriptor->And descriptor->Corresponding to the same characteristic point, obtaining a group of matched characteristic points; otherwise, returning to the positive sequence searching module;
a repeated calculation module for searching the module from the positive sequence to the characteristic point matching module until the characteristic point is foundAnd &>All the mutually matched feature points are obtained;
and the initially registered point cloud data set S 'generation module is used for repeating the feature point extraction module to the feature point matching module until all point cloud data in the data set S are traversed to obtain all matched feature points, and thus the initially registered point cloud data set S' can be obtained.
Specifically, the feature point conversion module specifically includes:
obtaining characteristic pointsIs a set of characteristic points whose central radius is within r>R is more than or equal to 25mr and less than or equal to 75mr, and calculatingThe covariance matrix D of (a);
in the formula (d) i Representing characteristic pointsAnd field point->Is greater than or equal to>Means a sum within a radius r>Adjacent arbitrary points;
establishing characteristic points according to the covariance matrix DAnd then the three-dimensional local coordinate system is setAnd all the points adjacent to the point are projected on a two-dimensional plane;
divide the two-dimensional plane into 2L s ×2L s A grid, quantized projection points into the corresponding grid, 2L s Representing the number of each edge division of the two-dimensional plane;
calculating the weighted curvature of the projection point in each grid, aggregating all weighted curvatures to form a curvature distribution matrix, and automatically forming a curvature map by the curvature distribution matrix;
converting the obtained curvature diagram into binary strings to obtain the characteristic pointsThe corresponding descriptors.
Specifically, each oneConversion into a binary string is performed in parallel with>The transformation process of (1).
Specifically, the feature point extraction module extracts feature points by using an ISS feature point extraction method.
Further, the system also comprises a data preprocessing module for preprocessing the point cloud data obtained by the data acquisition module, wherein the preprocessing process comprises filtering denoising and outlier denoising.
Compared with the prior art, the invention has the beneficial effects that:
firstly, converting the description of a 3D point cloud into a 2D image block, calculating the regional curvature of the distribution of projection points, generating a binary character string, and providing an efficient and compact binary 3D local descriptor; and then carrying out feature matching through a threshold matching algorithm pair of the bidirectional distance ratio. As an initial registration method of point cloud data, the method has the advantages of high calculation speed, high registration accuracy, strong anti-jamming capability and the like, can resist normal errors and changed point cloud density, and can meet the requirements of processing cultural relic fragments with different shapes, serious appearance damage and high noise when being applied specifically.
Additional features and advantages of the invention will be set forth in the detailed description which follows.
Drawings
FIG. 1 is a flow chart of the method of the present invention.
FIG. 2 is an implementation schematic of a descriptor, (a) a 2D distribution projection of feature points; (b) proxel meshing; (c) curvature profile; and (d) a descriptor.
Fig. 3 shows the fragment data of terracotta soldiers and horses, (a) chest; (b) a waist; (c) a shoulder; (d) a knee; (e) a leg portion.
Fig. 4 is a set of best matches for a fragment group, (a) a breast; (b) a waist; (c) a shoulder; (d) a knee; (e) a leg portion.
Fig. 5 shows the effect of each method on initial registration, (a) the thorax; (b) a waist; (c) a shoulder; (d) a knee; (e) a leg portion.
Fig. 6 is a fine registration of the present registration results using ICP algorithm, (a) thorax; (b) a waist; (c) a shoulder; (d) a knee; (e) a leg portion.
The invention is explained in more detail below with reference to the drawings and the description of the preferred embodiments.
Detailed Description
The scheme of the invention mainly aims at the initial registration stage of point cloud data, and for the later fine registration, some fine registration methods which are widely used at present can be used, such as a closest point iterative ICP algorithm for fine registration and the like, and the fine registration process will not be elaborated in detail herein.
In addition, the feature point referred to in the present invention refers to a point at which the image gradation value changes drastically or a point at which the curvature is large on the edge of the image (i.e., the intersection of two edges).
The point cloud initial registration method based on the binary descriptor of the curvature of the region of the present invention is described in detail below, it should be noted that the present invention is not limited to the following specific embodiments, and any equivalent transformation based on the technical solution of the present invention falls within the scope of the present invention.
The method specifically comprises the following steps:
obtaining a three-dimensional point cloud data set S, S = [ S ] of a measured object 1 ,S 2 ,...,S i ,...S j ,...,S m ];S i Represents the ith point cloud data, i =1,2, · m, j =1,2,. M, i ≠ j, m ≧ 2; in the following embodimentsIn the examples, m =2.
The invention can use different devices such as radar, laser scanning, kinect device and the like to obtain the surface information of the measured object, wherein m is the scanning times.
When the point cloud data is scanned and acquired, due to the influence of problems such as unskilled operators and equipment precision, some redundant noise points are generated in the acquired point cloud data. Filtering and denoising the acquired cultural relic point cloud data and filtering outliers. The method mainly uses a voxelization grid sampling method to filter the point cloud, firstly, the maximum length of the point cloud data in each coordinate axis direction in a three-dimensional coordinate system is calculated, and then the point cloud is divided into a plurality of cubic grids according to the volume of the point cloud data. After the grid is established, detecting whether the grid contains point cloud data points or not, and if not, directly deleting the point cloud data points; if the grid contains data points, the central point of the grid is calculated, the data points with the threshold value reserved part close to the central point are set, and the rest data points are deleted to obtain a point cloud data set after preprocessing.
Next, converting the feature value in each point cloud data in the data set into a binary character string, first, performing conventional feature point extraction:
Common feature point detection methods include a feature point extraction method based on a normal vector, a feature point extraction method based on a curvature, an LSP feature point detection method, an ISS feature point extraction method, and the like. The ISS feature point extraction method is preferably selected for processing.
Converting these feature points into binary strings Represents->The v-th descriptor in (1). The transformation method can select LBP method and its variant algorithm machine, such as MB-LBP, CLBP, LTP and other methods, preferably, the invention describes the point cloud characteristic by a region curvature binary descriptor, the thought is shown in figure 2, which includes the following steps:
step 2.1, obtaining characteristic pointsIs a set of characteristic points whose central radius is within r>Calculate->The covariance matrix D of (a); the value range of r is determined according to the size of the original point cloud data, generally, r is more than or equal to 25mr and less than or equal to 75mr, and in the following embodiment, r =65mr;
in the formula (d) i Representing characteristic pointsAnd field point->In conjunction with a distance of->Means a sum within a radius r>Adjacent arbitrary points. Preferably, is->And weights are distributed, and the weights are larger when the distance is closer, so that the robustness of the descriptor is increased, and the interference of noise and outlier clutter on the feature description is reduced.
Step 2.2, establishing characteristic points according to the covariance matrix DAnd then combining the three-dimensional local coordinate system>And all the adjacent points are projected on a two-dimensional plane, specifically:
performing characteristic decomposition on the D matrix: DV = EV. E is a feature value diagonal matrix l { l 1 ,l 2 ,l 3 },V{v 1 ,v 2 ,v 3 Is a matrix of orthogonal eigenvectors.
Definition ofThe local coordinate system O of the three-dimensional patch is constructed by arranging the feature values in descending order, v1 being the X-axis direction and v2 being the Y-axis direction, based on the right-hand coordinate system principle Z = X × Y, as the origin of LRF (three-dimensional local coordinate system) p -X p Y p Z p 。
Step 2.3, divide the two-dimensional plane into 2L s ×2L s A grid, quantized projection points into the corresponding grid, 2L s The method for representing the number of each edge division of the two-dimensional plane specifically comprises the following steps:
according to the mapping M willIs adjacent point->Projection to O p '-X p 'Y p ' on this two-dimensional plane, the projection points lying on the two-dimensional plane are obtained>The mapping M is defined as:
M(x,y,z)=(Rcosθ,Rsinθ) (3)
in the formula (I), the compound is shown in the specification,is a neighbor point>And a local coordinate system O p -X p Y p Z p Origin O p The distance between them. θ = arctan (y, x) is @>Is measured.
The projected points on the two-dimensional plane are further discretized by dividing the two-dimensional plane into 2L along the X 'axis and the Y' axis s ×2L s Each grid, quantizing the projection points into the corresponding grid, and representing each grid as B in (x, y) with center p s :
Wherein d is s Is the side length of each grid, falling intoOf a regionWill be computed into the grid; the side length of the two-dimensional plane is 2Ls, the center of the square is used as an origin point, a coordinate system is established, and then the boundary and the coordinate axis (L) of the two-dimensional plane are formed s ,0)(-L s ,0)(0,L s )(0,-L s ) Four points intersect. Each small grid has side length d s 2L on each of the x and y axes s +1 coordinate points, 2L s And (4) strip line segments. Each small grid B in Center p of (x, y) s The position is determined by x, y coordinates. For example, there is a small grid, first, let us look at the h and g axes, and multiply the edge length of the grid by h and g respectively to obtain the coordinates of the center point of the grid.
And 2.4, calculating the weighted curvature of the projection point in each grid, aggregating all weighted curvatures to form a curvature distribution matrix, and automatically forming a curvature map by the curvature distribution matrix.
In the calculation of the weighted curvature, according to the method for solving the curvature of the curved surface provided by Zhou Weiguang and the like, a Hessian matrix is calculated according to the adjacent surface formed by adjacent points, and the maximum eigenvalue of the matrix is the characteristic pointMaximum principal curvature k of i It can be expressed as: />
Fall into B in The curvature of the midpoint (x, y) is finally encoded as a curvature profile (equation 6):
wherein, w i Representing the assignment to proxelsEmphasizes points closer to the center. />Is a standardized procedure, in conjunction with a standard evaluation program>A weighted curvature profile of the two-dimensional plane is represented. The region on the two-dimensional plane without projected points is represented as ∞.
Step 2.5, the curvature graph in the step 2.4 is converted into a binary string, and the characteristic points are obtainedThe corresponding descriptor.
In a particular transformation process, to make the process scale invariant, the present invention normalizes the area curvature to [0,1 ] by dividing by the maximum absolute value of each row of descriptors]And (3) a range. The CS-LBP method proposed by Schmid et al was used to describe the image block center. Then, the binary characters are connected in series to obtain characteristic pointsThe descriptor of (1).
The invention starts the process of feature matching, wherein the feature matching is to establish the corresponding relation between feature descriptors and is an important link for realizing initial registration, and the invention carries out the feature matching by the following method:
converting these feature points into binary strings Represents->The u-th descriptor in (1); the specific transformation process is the same as step 2, and is not described herein again.
step 4.1, inIn and->Closest->And next closest-> When the ratio of the two distances +>Below a threshold value T 1 ,0.6≤T 1 ≦ 0.9 (set to 0.75 in the examples described below), ensureStorage/answer unit>Step 4.2 is carried out; otherwise, it indicates not being->In order to find and->Descriptor matched, i.e. not at P j Is found with P i Repeating for 4.1 the point matched with a certain characteristic point;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And/or>The distance between them;
step 4.2, inThe middle search and the decision in step 4.1 are->Distance between two adjacent platesMost recently->And next closest->When the ratio of the two distances->Below a threshold value T 2 ,0.6≤T 2 ≦ 0.9, (set to 0.85 in the examples described below), hold ≦ 0.9, save>Step 4.3 is carried out; otherwise, returning to the step 4.1; />
In the formula (I), the compound is shown in the specification,represents->And &>In combination with (B) in the interior of the housing>Represents->And &>The distance between them;
step 4.3, calculating the result obtained in step 4.1And ^ obtained in step 4.2>If the obtained Lp distance is larger than the threshold value T 3 ,0.75mr≤T 3 0.85mr or less (in the following examples, 0.8mr is set), and step 4.4 is performed; otherwise, returning to the step 4.1;
step 4.4, judge the descriptorAnd descriptor->Whether or not the same feature point corresponds, if the descriptor->And descriptorCorresponding to the same characteristic point, obtaining a group of matched characteristic points; otherwise, returning to the step 4.1;
step 4.7, repeating steps 4.1 to 4.4 until findingAnd &>All the mutually matched feature points in the image are obtained;
and 5, repeating the steps 2 to 4, traversing all point cloud data in the data set S to obtain all matched feature points, namely a complete set C, and obtaining a new point cloud data set S' by registering point pairs in the set C.
The invention also discloses a point cloud initial registration system based on the region curvature binary descriptor, which mainly comprises the following modules:
a data acquisition module for acquiring a three-dimensional point cloud data set S, S = [ S ] of a measured object 1 ,S 2 ,...,S i ,...S j ,...,S m ];S i Represents the ith point cloud data, i =1,2,.. The m, j =1,2,. The m, i ≠ j, and m ≧ 2; m is the number of scanning times, and the acquisition equipment can adopt radar, laser scanning, kinect equipment and the like.
A feature point extraction module for extracting S i Forming a set of feature points of Representing a point cloud S i The v-th feature point in (1); extraction of S j Forms a set-> Representing a point cloud S j The u-th feature point in (1). Common feature point detection methods in this module include a feature point extraction method based on normal vectors, a feature point extraction method based on curvatures, an LSP feature point detection method, an ISS feature point extraction method, and the like. The ISS feature point extraction method is preferably selected for processing.
A feature point conversion module for converting the feature points in the feature point extraction module into binary character stringsAnd represents->The v-th descriptor in (1); />Represents->The u-th descriptor in (1). The transformation method can select an LBP method and a variant algorithm machine thereof, such as MB-LBP, CLBP, LTP and other methods, preferably, the invention describes the point cloud characteristics through a region curvature binary descriptor, and specifically comprises the following steps:
obtaining feature pointsSet of feature points having a center radius within r>Counting/or>The covariance matrix D of (a); the value range of r is determined according to the size of the original point cloud data, generally, r is not less than 25mr and not more than 75mr, and in the following embodiment, r =65mr; />
In the formula (d) i Representing characteristic pointsAnd field point->Is greater than or equal to>Means a sum within a radius r>Adjacent arbitrary points. Preferably, is->And weights are distributed, and the closer the distance is, the higher the weight is, so that the robustness of the descriptor is increased, and the interference of noise and outlier clutter on the feature description is reduced.
Establishing characteristic points according to the covariance matrix DAnd then the three-dimensional local coordinate system is setAnd all the adjacent points are projected on a two-dimensional plane, specifically:
performing characteristic decomposition on the D matrix: DV = EV. E is the eigenvalue diagonal matrix l 1 ,l 2 ,l 3 },V{v 1 ,v 2 ,v 3 Is a matrix of orthogonal eigenvectors.
Definition ofThe local coordinate system O of the three-dimensional patch is constructed by arranging the feature values in descending order, v1 being the X-axis direction and v2 being the Y-axis direction, based on the right-hand coordinate system principle Z = X × Y, as the origin of LRF (three-dimensional local coordinate system) p -X p Y p Z p 。
Divide the two-dimensional plane into 2L s ×2L s A grid, quantized projection points into the corresponding grid, 2L s The method for representing the number of each edge division of the two-dimensional plane specifically comprises the following steps:
according to the mapping M willIs adjacent point->Projection to O p '-X p 'Y p ' on this two-dimensional plane, projection points which are distributed over the two-dimensional plane are obtained>The mapping M is defined as:
M(x,y,z)=(Rcosθ,Rsinθ) (3)
in the formula (I), the compound is shown in the specification,is a neighbor point>And a local coordinate system O p -X p Y p Z p Origin O p The distance between them. θ = arctan (y, x) is @>Is measured.
The projected points on the two-dimensional plane are further discretized, i.e. the two-dimensional projection plane is divided into 2L along the X 'axis and Y' axis s ×2L s Each grid, quantizing the projection points into the corresponding grid, and representing each grid as B in (x, y) with center p s :
Wherein, d s Is the side length of each grid, falling intoOf a regionWill be computed into the grid; the side length of the two-dimensional plane is 2Ls, the center of the square is used as an origin, a coordinate system is established, and then the boundary and the coordinate axis (L) of the two-dimensional plane are formed s ,0)(-L s ,0)(0,L s )(0,-L s ) Four points intersect. Each small grid has side length d s And 2L on each of the x and y axes s +1 coordinate points, 2L s And (4) strip line segments. Each small grid B in Center p of (x, y) s The position is determined by x, y coordinates. For example, there is a small grid, which is the h-th and g-th grid on the x and y axes, and the h and g are multiplied by the grid side length to obtain the grid center point coordinate.
And calculating the weighted curvature of the projection points in each grid, and aggregating all weighted curvatures to form a curvature distribution matrix, wherein the curvature distribution matrix automatically forms a curvature map.
In the calculation of the weighted curvature, according to the method for solving the curvature of the curved surface provided by Zhou Weiguang and the like, a Hessian matrix is calculated according to the adjacent surface formed by adjacent points, and the maximum eigenvalue of the matrix is the characteristic pointMaximum principal curvature k of i It can be expressed as:
fall into B in The curvature of the midpoint (x, y) is finally encoded as a curvature profile (equation 6):
wherein, w i Representing the assignment to proxelsEmphasizes points closer to the center. />Is a normalization procedure, is based on>A weighted curvature profile of the two-dimensional plane is represented. The region on the two-dimensional plane without projected points is represented as ∞.
Converting the obtained curvature diagram into binary strings to obtain the characteristic pointsThe corresponding descriptors.
A feature point matching module for findingAnd &>The same characteristic points specifically include:
a positive sequence search module for searching positive sequence inIn and->Closest->And next closest-> When the ratio of the two distances +>Below a threshold value T 1 ,0.6≤T 1 Less than or equal to 0.9, and storing>Entering a reverse order searching module; otherwise, repeating the positive sequence searching process;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And &>The distance between them;
a reverse order lookup module forGet ^ in the middle search and positive sequence search module>Nearest to each other/>And next closest->When the ratio of the two distances->Below a threshold value T 2 ,0.6≤T 2 Less than or equal to 0.9 percent and is preserved>Entering; otherwise, returning to the positive sequence searching module;
in the formula (I), the compound is shown in the specification,represents->And &>In combination with (B) in the interior of the housing>Represents->And/or>The distance between them;
an Lp distance calculation module for calculating the distance obtained by the positive sequence search moduleAnd reverse order lookupObtained by a module>If the obtained Lp distance is larger than the threshold value T 3 ,0.75mr≤T 3 Matching the characteristic points with a module less than or equal to 0.85 mr; otherwise, returning to the positive sequence searching module;
a feature point pairing module for judging the descriptorAnd descriptor>Whether the feature points correspond to the same feature point or not, if so, obtaining a group of matched feature points; otherwise, returning to the positive sequence searching module;
a repeated calculation module for searching the module from the positive sequence to the characteristic point matching module until the characteristic point is foundAnd &>All the mutually matched feature points are obtained;
and the initially registered point cloud data set S 'generation module is used for repeating the feature point extraction module to the feature point matching module until all point cloud data in the data set S are traversed to obtain all matched feature points, and then the initially registered point cloud data set S' can be obtained.
Preferably, the system of the present invention further includes a data preprocessing module for preprocessing the point cloud data obtained by the data acquisition module, wherein the preprocessing process includes filtering and denoising and outlier denoising. The method mainly uses a voxelization grid sampling method to filter the point cloud, firstly, the maximum length of the point cloud data in each coordinate axis direction in a three-dimensional coordinate system is calculated, and then the point cloud is divided into a plurality of cubic grids according to the volume of the point cloud data. After the grid is established, detecting whether the grid contains point cloud data points or not, and if not, directly deleting the point cloud data points; if the grid contains data points, the central point of the grid is calculated, the data points with the threshold value reserved part close to the central point are set, and the rest data points are deleted to obtain a point cloud data set after preprocessing.
Example (b):
in the embodiment, a terracotta warriors fragment point cloud data set acquired by a K9901 terracotta warrior pit is used as experimental data, and as shown in FIG. 3, according to the embodiment, under the condition of the same point cloud and the same point cloud data overlapping rate, the point cloud initial registration method (RCBD for short) is compared with an improved RANSAC algorithm and an improved F-4PCS algorithm. In this embodiment, the fine registration uses a closest point iterative ICP algorithm. Fig. 4 shows the optimal matching set of the obtained group of fragments, fig. 5 shows the initial registration results of the three methods, and fig. 6 shows the result experiment after the fine registration is performed on the initial registration of this embodiment of the ICP algorithm. The result shows that the registration accuracy of the method is as high as 98.77%, the root mean square error is reduced by 37% compared with that of the traditional method, and the average registration time is reduced by 50%.
The respective specific technical features described in the above-described embodiments may be combined in any suitable manner without contradiction as long as they do not depart from the gist of the present invention, and should also be regarded as being disclosed in the present invention.
Claims (10)
1. The point cloud initial registration method based on the region curvature binary descriptor is characterized by comprising the following steps:
step 1, obtaining a three-dimensional point cloud data set S, S = [ S ] of a measured object 1 ,S 2 ,...,S i ,...S j ,...,S m ];S i Represents the ith point cloud data, i =1,2, · m, j =1,2,. M, i ≠ j, m ≧ 2;
step 2, extracting S i Forming a set of feature points of Representing a point cloud S i The v-th feature point in (1);
step 3, extracting S j Forming a set of feature points of Representing a point cloud S j The u-th feature point in (1);
step 4.1, inIn and->Closest->And next closest-> When the ratio of the two distances +>Below a threshold value T 1 ,0.6≤T 1 ≦ 0.9, preservation>Step 4.2 is carried out; otherwise, repeat 4.1;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And/or>The distance between them;
step 4.2 inThe middle search and the decision in step 4.1 are->Closest->And next closest>When the ratio of the two distances->Below a threshold value T 2 ,0.6≤T 2 Less than or equal to 0.9 percent and is preserved>Step 4.3 is carried out; otherwise, returning to the step 4.1;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And/or>The distance between them;
step 4.3, calculating the result obtained in step 4.1And ^ obtained in step 4.2>If the obtained Lp distance is larger than the threshold value T 3 ,0.75mr≤T 3 Performing step 4.4 when the concentration is less than or equal to 0.85 mr; otherwise, returning to the step 4.1;
step 4.4, judge the descriptorAnd descriptor->Whether or not the same feature point corresponds, if the descriptor->And descriptor>Corresponding to the same characteristic point, obtaining a group of matched characteristic points; otherwise, returning to the step 4.1;
step 4.7, repeat steps 4.1 through 4.4 until foundAnd &>All the matched feature points are selected; />
And 5, repeating the steps 2 to 4, traversing all point cloud data in the data set S to obtain all matched feature points, and thus obtaining the point cloud data set S' after initial registration.
2. The method of claim 1, wherein in step 2, the feature points are converted into binary stringsThe process comprises the following steps:
step 2.1, obtaining characteristic pointsIs a set of characteristic points whose central radius is within r>R is more than or equal to 25mr and less than or equal to 75mr, calculating>The covariance matrix D of (a);
in the formula (d) i Representing characteristic pointsAnd field point->Is greater than or equal to>Means a sum within a radius r>Adjacent arbitrary points;
step 2.2, establishing characteristic points according to the covariance matrix DAnd then the three-dimensional local coordinate system is determined>And all the points adjacent to the point are projected on a two-dimensional plane;
step 2.3, divide the two-dimensional plane into 2L s ×2L s A grid, quantized projection points into the corresponding grid, 2L s Representing the number of each edge division of the two-dimensional plane;
step 2.4, calculating the weighted curvature of the projection point in each grid, aggregating all weighted curvatures to form a curvature distribution matrix, and automatically forming a curvature map by the curvature distribution matrix;
3. The method as claimed in claim 1, wherein the step 3 of converting the feature points into binary character strings is the same as the step 2.
4. The method as claimed in claim 1, wherein the step 2 and the step 3 use an ISS feature point extraction method to extract the feature points.
5. The method as claimed in claim 1, wherein in step 1, the obtained point cloud data is further preprocessed, and the preprocessing includes filtering denoising and outlier denoising.
6. The system for initial registration of point clouds based on binary descriptors of regional curvatures is characterized by comprising the following modules:
a data acquisition module for acquiring a three-dimensional point cloud data set S, S = [ S ] of a measured object 1 ,S 2 ,...,S i ,...S j ,...,S m ];S i Represents the ith point cloud data, i =1,2,.. The m, j =1,2,. The m, i ≠ j, and m ≧ 2;
a feature point extraction module for extracting S i Form a set of feature points Representing a point cloud S i The v-th feature point in (1); extraction of S j Forms a set-> Representing a point cloud S j The u-th feature point in (1);
a feature point conversion module for converting the feature points in the feature point extraction module into binary character stringsAnd &> Represents->The v-th descriptor in (1); />Represents->The u-th descriptor in (1);
a positive sequence search module for searching inIn and->Closest->And next closest-> When the ratio of the two distances->Below a threshold value T 1 ,0.6≤T 1 ≦ 0.9, preservation>Entering a reverse order searching module; otherwise, repeating the positive sequence searching process;
in the formula (I), the compound is shown in the specification,represents->And/or>Is at a distance of->Represents->And/or>The distance therebetween;
a reverse order lookup module forGet ^ in the middle search and positive sequence search module>Closest->And second nearestWhen the ratio of the two distances->Below a threshold value T 2 ,0.6≤T 2 Less than or equal to 0.9 percent and is preserved>Entering; otherwise, returning to the positive sequence searching module;
in the formula (I), the compound is shown in the specification,represents->And/or>In combination with (B) in the interior of the housing>Represents->And/or>The distance between them;
an Lp distance calculation module for calculating the distance obtained by the positive sequence search moduleAnd found by the reverse order look-up module>If the obtained Lp distance is larger than the threshold value T 3 ,0.75mr≤T 3 Matching the characteristic points with a module less than or equal to 0.85 mr; otherwise, returning to the positive sequence searching module;
a feature point pairing module for judging the descriptorAnd descriptor->Whether or not the same feature point corresponds, if the descriptor->And descriptor->Corresponding to the same characteristic point, obtaining a group of matched characteristic points; otherwise, returning to the positive sequence searching module;
a repeated calculation module for searching the positive sequence from the module to the characteristic point matching module until finding outAnd &>All the mutually matched feature points are obtained;
and the initially registered point cloud data set S 'generation module is used for repeating the feature point extraction module to the feature point matching module until all point cloud data in the data set S are traversed to obtain all matched feature points, and then the initially registered point cloud data set S' can be obtained.
7. The initial point cloud registration system based on binary descriptors of regional curvature according to claim 6, wherein the feature point transformation module specifically comprises:
Obtaining characteristic pointsIs a set of characteristic points whose central radius is within r>R is more than or equal to 25mr and less than or equal to 75mr, calculating>The covariance matrix D of (2);
in the formula (d) i Representing characteristic pointsAnd field point->In conjunction with a distance of->Means a sum within a radius r>Adjacent arbitrary points;
establishing characteristic points according to the covariance matrix DAnd then the three-dimensional local coordinate system is determined>And all the points adjacent to the point are projected on a two-dimensional plane;
divide the two-dimensional plane into 2L s ×2L s A grid, quantized projection points into the corresponding grid, 2L s Representing the number of each edge division of the two-dimensional plane;
calculating the weighted curvature of the projection point in each grid, aggregating all weighted curvatures to form a curvature distribution matrix, and automatically forming a curvature map by the curvature distribution matrix;
9. The system as claimed in claim 6, wherein the feature point extraction module extracts feature points by using an ISS feature point extraction method.
10. The system as claimed in claim 6, further comprising a data pre-processing module for pre-processing the point cloud data obtained by the data acquisition module, wherein the pre-processing includes filtering and de-noising and outlier de-noising.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911133616.5A CN111127667B (en) | 2019-11-19 | 2019-11-19 | Point cloud initial registration method based on region curvature binary descriptor |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911133616.5A CN111127667B (en) | 2019-11-19 | 2019-11-19 | Point cloud initial registration method based on region curvature binary descriptor |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111127667A CN111127667A (en) | 2020-05-08 |
CN111127667B true CN111127667B (en) | 2023-03-31 |
Family
ID=70495773
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911133616.5A Active CN111127667B (en) | 2019-11-19 | 2019-11-19 | Point cloud initial registration method based on region curvature binary descriptor |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111127667B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112330661A (en) * | 2020-11-24 | 2021-02-05 | 交通运输部公路科学研究所 | Multi-period vehicle-mounted laser point cloud road change monitoring method |
CN114639115B (en) * | 2022-02-21 | 2024-07-05 | 北京航空航天大学 | Human body key point and laser radar fused 3D pedestrian detection method |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103489218B (en) * | 2013-09-17 | 2016-06-29 | 中国科学院深圳先进技术研究院 | Point cloud data quality automatic optimization method and system |
US9280825B2 (en) * | 2014-03-10 | 2016-03-08 | Sony Corporation | Image processing system with registration mechanism and method of operation thereof |
CN110443840A (en) * | 2019-08-07 | 2019-11-12 | 山东理工大学 | The optimization method of sampling point set initial registration in surface in kind |
-
2019
- 2019-11-19 CN CN201911133616.5A patent/CN111127667B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN111127667A (en) | 2020-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110097093B (en) | Method for accurately matching heterogeneous images | |
CN110443836B (en) | Point cloud data automatic registration method and device based on plane features | |
CN111080684B (en) | Point cloud registration method for point neighborhood scale difference description | |
Zhong | Intrinsic shape signatures: A shape descriptor for 3D object recognition | |
CN108389250B (en) | Method for rapidly generating building section map based on point cloud data | |
CN108107444B (en) | Transformer substation foreign matter identification method based on laser data | |
CN110807781B (en) | Point cloud simplifying method for retaining details and boundary characteristics | |
CN114677418B (en) | Registration method based on point cloud feature point extraction | |
CN108022262A (en) | A kind of point cloud registration method based on neighborhood of a point center of gravity vector characteristics | |
CN113628263A (en) | Point cloud registration method based on local curvature and neighbor characteristics thereof | |
Cheng et al. | Building boundary extraction from high resolution imagery and lidar data | |
CN110211163A (en) | A kind of point cloud matching algorithm based on EPFH feature | |
CN109697729A (en) | Based on the matched 3D rock mass point cloud registration method of plane polygon | |
CN110222661B (en) | Feature extraction method for moving target identification and tracking | |
CN111127667B (en) | Point cloud initial registration method based on region curvature binary descriptor | |
CN111145129A (en) | Point cloud denoising method based on hyper-voxels | |
CN110009745B (en) | Method for extracting plane from point cloud according to plane element and model drive | |
CN113409332B (en) | Building plane segmentation method based on three-dimensional point cloud | |
CN109766903B (en) | Point cloud model curved surface matching method based on curved surface features | |
CN114494368A (en) | Low-overlapping-rate point cloud registration method combining dimensionality reduction projection and feature matching | |
Zhang et al. | Spectral clustering of straight-line segments for roof plane extraction from airborne LiDAR point clouds | |
CN110348310A (en) | A kind of Hough ballot 3D colour point clouds recognition methods | |
Lu et al. | Point cloud registration algorithm fusing of super 4pcs and icp based on the key points | |
CN110942077B (en) | Feature line extraction method based on weight local change degree and L1 median optimization | |
Omidalizarandi et al. | Segmentation and classification of point clouds from dense aerial image matching |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |