CN111815611A - Round hole feature extraction method for rivet hole measurement point cloud data - Google Patents

Round hole feature extraction method for rivet hole measurement point cloud data Download PDF

Info

Publication number
CN111815611A
CN111815611A CN202010674105.0A CN202010674105A CN111815611A CN 111815611 A CN111815611 A CN 111815611A CN 202010674105 A CN202010674105 A CN 202010674105A CN 111815611 A CN111815611 A CN 111815611A
Authority
CN
China
Prior art keywords
point
boundary
point cloud
points
extracting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010674105.0A
Other languages
Chinese (zh)
Other versions
CN111815611B (en
Inventor
李泷杲
黄翔
李�根
曾琪
楼佩煌
钱晓明
陶克梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics
Nanjing University of Aeronautics and Astronautics
Original Assignee
Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics
Nanjing University of Aeronautics and Astronautics
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics, Nanjing University of Aeronautics and Astronautics filed Critical Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics
Priority to CN202010674105.0A priority Critical patent/CN111815611B/en
Publication of CN111815611A publication Critical patent/CN111815611A/en
Application granted granted Critical
Publication of CN111815611B publication Critical patent/CN111815611B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/181Segmentation; Edge detection involving edge growing; involving edge linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30164Workpiece; Machine component

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a round hole feature extraction method for rivet hole measurement point cloud data, and relates to the technical field of part detection in aircraft manufacturing; in order to solve the problem of complex operation; the method specifically comprises the following steps: extracting point cloud boundary points according to the distribution condition of k neighborhood points of each point in the point cloud; obtaining point cloud blocks belonging to different boundary characteristics through Euclidean distance clustering segmentation of boundary points; and extracting the rivet hole boundary in the cloud block of the segmentation point by an ellipse fitting method. The method replaces the traditional contact type rivet hole measuring method, can effectively overcome the defects of manual marking and manual cutting, is high in measuring efficiency and good in flexibility, simplifies the process compared with other rivet hole special extracting methods based on scattered point clouds, can reduce excessive manual participation in the extracting process, is high in automation degree, can eliminate other round holes which are not rivet holes in the point clouds and needs to be eliminated, calculates dc, and eliminates the extracting hole if the dc is smaller than a set threshold value, so that the accuracy is high.

Description

Round hole feature extraction method for rivet hole measurement point cloud data
Technical Field
The invention relates to the technical field of part detection in aircraft manufacturing, in particular to a round hole feature extraction method for rivet hole measurement point cloud data.
Background
The hole forming precision of the rivet hole is of great significance to the quality of aircraft manufacturing and assembly, for the rivet hole with high precision requirement, the hole needs to be detected after hole forming, the traditional three-coordinate measuring machine detection method is low in efficiency and difficult to detect parts such as large-size auxiliary wallboards, the special rivet hole detection tool for manufacturing is long in time consumption and high in cost, the rivet hole is detected by adopting a non-contact scanning measurement mode gradually along with improvement of the rivet hole forming precision requirement of aircraft production and increase of hole detection requirements, the rivet hole is detected by adopting the non-contact scanning measurement mode, scattered point cloud of the rivet hole is obtained by the mode, and the point cloud data needs to be processed to extract the rivet hole characteristics in the point cloud.
Through retrieval, a patent with Chinese patent application number CN201710718764.8 discloses a rivet hole position detection method on an aircraft skin, which comprises the following steps: a. manufacturing a set of bracket matched with the covering part for supporting; b. making a reference hole on the bracket as a reference for measurement; c. after the skin part is placed on the bracket and fixed, positioning holes in the skin part and positioning holes in the bracket are positioned by positioning pins; d. inputting the coordinates of the reference hole into laser tracker equipment, and fitting the coordinates of the reference hole to enable the coordinates of the reference hole to coincide with theoretical coordinates designed by the die; e. measuring the hole position of the rivet hole by using a laser tracker with the reference hole as a reference; f. and comparing the coordinate value data measured by the rivet hole with the digital-analog middle coordinate value of the skin part to judge whether the rivet hole position meets the requirement. The method for detecting the positions of the rivet holes on the aircraft skin in the patent has the following defects: the operation is complicated, the measurement time is long, and the manual work is needed to participate in time.
Disclosure of Invention
The invention aims to solve the defects in the prior art and provides a round hole feature extraction method facing rivet hole measurement point cloud data.
In order to achieve the purpose, the invention adopts the following technical scheme:
a round hole feature extraction method facing rivet hole measurement point cloud data comprises the following steps:
s1: extracting point cloud boundary points according to the distribution condition of k neighborhood points of each point in the point cloud;
s2: obtaining point cloud blocks belonging to different boundary characteristics through Euclidean distance clustering segmentation of boundary points;
s3: and extracting the rivet hole boundary in the cloud block of the segmentation point by an ellipse fitting method.
Preferably: the method for extracting the point cloud boundary points comprises the following steps:
s11: establishing a kd-Tree structure of scattered point cloud by using a kd-Tree method to obtain a point PiAnd its k neighborhood point Nj(j =0,1,2 … k-1) to obtain P by least squares fittingiA local tangent plane to the point;
s12: establishing a plane coordinate system on the tangent plane by PiTo the tangent plane projection point PiAs origin of coordinates, PiPoint sum N0Projected point of points
Figure DEST_PATH_IMAGE002AAAAAAA
Constructed vector
Figure DEST_PATH_IMAGE004AAAAAAAA
As the X-axis of the coordinate system, normal to the plane
Figure DEST_PATH_IMAGE006AAAAAA
With vectors
Figure DEST_PATH_IMAGE004AAAAAAAAA
Ride across
Figure DEST_PATH_IMAGE006AAAAAAA
×
Figure DEST_PATH_IMAGE004AAAAAAAAAA
As the Y axis of the coordinate system;
s13: converting the three-dimensional coordinate of each point in the point set X to the plane coordinate system to obtain a two-dimensional coordinate set of the point set X
Figure 100002_DEST_PATH_IMAGE011AA
S14: to be provided with
Figure DEST_PATH_IMAGE011AAA
In (1)
Figure DEST_PATH_IMAGE014AA
The point is used as the starting point of the vector,
Figure DEST_PATH_IMAGE016AA
taking the point as a vector end point to obtain a plane vector set
Figure 100002_DEST_PATH_IMAGE018AA
(j=0,1,2…k-1), calculating
Figure DEST_PATH_IMAGE018AAA
The included angle alpha j from each vector to the X axis of the local coordinate system and the included angle beta j from the Y axis;
s15: the boundary points are identified from the maximum value θ max among the boundary points θ j.
Preferably: if β j in said S14>Pi/2, then α j = αj + pi, then arranging the alpha j in ascending order to obtain an angle sequence eta j, and calculating an included angle theta j = eta j-1 between adjacent angles of the eta j, wherein
Figure DEST_PATH_IMAGE021
Preferably: in the step S15, when the maximum included angle θ max in the adjacent angle sequence θ j exceeds the maximum included angle threshold θ, the point Pi is a boundary point, otherwise, the point Pi is a non-boundary point and the threshold is set
Figure DEST_PATH_IMAGE023
The size of the threshold is determined according to the cloud distribution situation, and the threshold is generally set
Figure 100002_DEST_PATH_IMAGE023A
Set to pi/2.
Preferably: the boundary point Euclidean distance clustering segmentation is that different boundary features in the boundary point cloud have the characteristic of continuous distance between adjacent points in the same boundary feature, namely, the distance between adjacent points in the same boundary feature is small, and the distance between the closest points of different boundary features is large.
Preferably: the method for partitioning the Euclidean distance clusters of the boundary points comprises the following steps:
s31: a kd tree point cloud structure is established for the boundary point cloud X, so that subsequent point neighborhood searching is facilitated;
s32: creating an empty cluster set C and a point set Q;
s33: for any pointP i
Figure 100002_DEST_PATH_IMAGE026AA
Processing the X;
s34: when each point in the boundary point cloud X is subjected to the step S33, a cluster set C is obtained;
s35: deleting fewer points in the cluster set C thann minAnd (4) obtaining a final cluster set C by cloud block point, and completing segmentation.
Preferably: for any point in the S33P i
Figure 100002_DEST_PATH_IMAGE026AAA
X, performing the following steps:
s41: handleP i Adding into Q;
s42: for each pointP i
Figure 100002_DEST_PATH_IMAGE026AAAA
Q, executing the following steps:
a. k neighbor search algorithm through boundary point kd treeP i The k neighborhood of (2) is put into the point set;
b. for each one
Figure 100002_DEST_PATH_IMAGE030
If, if
Figure 100002_DEST_PATH_IMAGE032
Is not in Q, and
Figure 100002_DEST_PATH_IMAGE032A
andp j of Euclidean distance rj<d th Then add Q and remove from X;
s43: and when the Q cannot find new points to be added, putting the Q into the cluster set C, and emptying the Q.
Preferably: the method for extracting the rivet hole boundary in the cloud block of the segmentation point by the ellipse fitting method comprises the following steps:
s51: cloud block with dividing pointsc i
Figure DEST_PATH_IMAGE026AAAAA
C least square fitting plane, constructing local plane two-dimensional coordinate system, and blocking point cloudc i Converting the three-dimensional coordinates of all the points into a constructed local plane two-dimensional coordinate system to obtain two-dimensional coordinates
Figure 100002_DEST_PATH_IMAGE035
S52: to plane two-dimensional coordinate
Figure 100002_DEST_PATH_IMAGE035A
Least square fitting the plane ellipse to obtain an ellipse equation Ax 2+Bxy+Cy 2+ Dx + Ey + F =0, center of ellipse
Figure 100002_DEST_PATH_IMAGE038
And major and minor axis radii
Figure 100002_DEST_PATH_IMAGE040
And
Figure 100002_DEST_PATH_IMAGE042
s53: and extracting the rivet hole boundary characteristics in the boundary point cloud blocks according to the ellipse fitting Error, the ratio of the major axis to the minor axis, the maximum radius threshold rmax, the minimum radius threshold rmin and the circle center position threshold d.
Preferably: the local plane two-dimensional coordinate system is constructed by any vector on the plane
Figure 100002_DEST_PATH_IMAGE044
Normal to a plane, as the X-axis of the coordinate system
Figure 100002_DEST_PATH_IMAGE046
And
Figure 100002_DEST_PATH_IMAGE048
cross product of (a) as a coordinate system Y-axis, point cloud blockc i Any point inp 0Projected points on a plane
Figure 100002_DEST_PATH_IMAGE050
As the origin of the coordinate system.
The invention has the beneficial effects that:
1. the method has the advantages that the traditional contact type rivet hole measuring method is replaced, the defects of manual marking and manual cutting can be effectively overcome, the measuring efficiency is high, the flexibility is good, compared with other rivet hole special extracting methods based on scattered point clouds, the process is simplified, excessive manual participation in the extracting process can be reduced, and the automation degree is high.
2. The kd-Tree method is adopted to establish the kd-Tree structure of the scattered point cloud, thereby being convenient to find out each point in the point cloudP i K neighborhood point set ofN j (j=0,1,2…k-1)。
3. And if the dc is smaller than a set threshold value, the extraction hole is removed, and the accuracy is high.
Drawings
FIG. 1 is a schematic flow chart of a round hole feature extraction method for rivet hole measurement point cloud data according to the present invention;
FIG. 2 is a rivet hole point cloud data schematic diagram of a round hole feature extraction method for rivet hole measurement point cloud data according to the present invention;
FIG. 3 is a schematic diagram of a local plane coordinate system established by the round hole feature extraction method for rivet hole measurement point cloud data according to the present invention;
FIG. 4 is a schematic diagram of an included angle between adjacent vectors calculated by the round hole feature extraction method for rivet hole measurement point cloud data according to the present invention;
fig. 5 is a schematic diagram of boundary point identification of the round hole feature extraction method for rivet hole measurement point cloud data according to the present invention.
Detailed Description
The technical solution of the present patent will be described in further detail with reference to the following embodiments.
Reference will now be made in detail to embodiments of the present patent, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present patent and are not to be construed as limiting the present patent.
In the description of this patent, it is to be understood that the terms "center," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in the orientations and positional relationships indicated in the drawings for the convenience of describing the patent and for the simplicity of description, and are not intended to indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and are not to be considered limiting of the patent.
In the description of this patent, it is noted that unless otherwise specifically stated or limited, the terms "mounted," "connected," and "disposed" are to be construed broadly and can include, for example, fixedly connected, disposed, detachably connected, disposed, or integrally connected and disposed. The specific meaning of the above terms in this patent may be understood by those of ordinary skill in the art as appropriate.
A round hole feature extraction method facing rivet hole measurement point cloud data is disclosed, as shown in FIGS. 1-4, and comprises the following steps:
s1: extracting point cloud boundary points according to the distribution condition of k neighborhood points of each point in the point cloud;
s2: obtaining point cloud blocks belonging to different boundary characteristics through Euclidean distance clustering segmentation of boundary points;
s3: and extracting the rivet hole boundary in the cloud block of the segmentation point by an ellipse fitting method.
The method for extracting the point cloud boundary points comprises the following steps:
s11: establishing a kd-Tree structure of scattered point cloud by using a kd-Tree method to obtain a point PiAnd its k neighborhood point Nj(j =0,1,2 … k-1) to obtain P by least squares fittingiA local tangent plane to the point;
s12: establishing a plane coordinate system on the tangent plane by PiTo the tangent plane projection point PiAs origin of coordinates, PiPoint sum N0Projected point of points
Figure DEST_PATH_IMAGE002AAAAAAAA
Constructed vector
Figure DEST_PATH_IMAGE004AAAAAAAAAAA
As the X-axis of the coordinate system, normal to the plane
Figure DEST_PATH_IMAGE006AAAAAAAA
With vectors
Figure DEST_PATH_IMAGE004AAAAAAAAAAAA
Ride across
Figure DEST_PATH_IMAGE006AAAAAAAAA
×
Figure DEST_PATH_IMAGE004AAAAAAAAAAAAA
As the Y axis of the coordinate system;
s13: converting the three-dimensional coordinate of each point in the point set X to the plane coordinate system to obtain a two-dimensional coordinate set of the point set X
Figure DEST_PATH_IMAGE011AAAA
S14: to be provided with
Figure DEST_PATH_IMAGE011AAAAA
In (1)
Figure DEST_PATH_IMAGE014AAA
The point is used as the starting point of the vector,
Figure DEST_PATH_IMAGE016AAA
taking the point as a vector end point to obtain a plane vector set
Figure DEST_PATH_IMAGE018AAAA
(j=0,1,2…k-1), calculating
Figure DEST_PATH_IMAGE018AAAAA
The included angle alpha j from each vector to the X axis of the local coordinate system and the included angle beta j from the Y axis;
s15: the boundary points are identified from the maximum value θ max among the boundary points θ j.
Specifically, if β j in the above-mentioned S14>Pi/2, then alpha j = alpha j + pi, then alpha j is arranged in ascending order to obtain an angle sequence eta j, and an included angle theta j = eta j-1 between adjacent angles of eta j is calculated, wherein
Figure 100002_DEST_PATH_IMAGE021A
Specifically, in S15, when the maximum included angle θ max in the adjacent angle sequence θ j exceeds the maximum included angle threshold θ, the point Pi is a boundary point, otherwise, the point Pi is a non-boundary point and the threshold is set
Figure 100002_DEST_PATH_IMAGE023AA
The size of the threshold is determined according to the cloud distribution situation, and the threshold is generally set
Figure DEST_PATH_IMAGE023AAA
Set to pi/2.
The boundary point Euclidean distance clustering segmentation is that different boundary features in the boundary point cloud have the characteristic of continuous distance between adjacent points in the same boundary feature, namely, the distance between adjacent points in the same boundary feature is small, and the distance between the closest points of different boundary features is large.
Further, the method for euclidean distance cluster segmentation of the boundary points comprises the following steps:
s31: a kd tree point cloud structure is established for the boundary point cloud X, so that subsequent point neighborhood searching is facilitated;
s32: creating an empty cluster set C and a point set Q;
s33: for any pointP i
Figure DEST_PATH_IMAGE026AAAAAA
Processing the X;
s34: when each point in the boundary point cloud X is subjected to the step S33, a cluster set C is obtained;
s35: deleting fewer points in the cluster set C thann minAnd (4) obtaining a final cluster set C by cloud block point, and completing segmentation.
Further, the arbitrary point in S33P i
Figure DEST_PATH_IMAGE026AAAAAAA
X, performing the following steps:
s41: handleP i Adding into Q;
s42: for each pointP i
Figure DEST_PATH_IMAGE026AAAAAAAA
Q, executing the following steps:
a. k neighbor search algorithm through boundary point kd treeP i The k neighborhood of (2) is put into the point set;
b. for each one
Figure DEST_PATH_IMAGE030A
If, if
Figure DEST_PATH_IMAGE032AA
Is not in Q, and
Figure DEST_PATH_IMAGE032AAA
andp j of Euclidean distance rj<d th Then add Q and remove from X;
s43: and when the Q cannot find new points to be added, putting the Q into the cluster set C, and emptying the Q.
Still further, thed th A threshold is partitioned for clustering.
Still further, then minIs the minimum threshold of the number of clustering points.
The method for extracting the rivet hole boundary in the cloud block of the segmentation point by the ellipse fitting method comprises the following steps:
s51: cloud block with dividing pointsc i
Figure DEST_PATH_IMAGE026AAAAAAAAA
C least square fitting plane, constructing local plane two-dimensional coordinate system, and blocking point cloudc i Three-dimensional coordinates of all points in the three-dimensional coordinate transformation table are converted into a constructed local plane two-dimensional coordinateUnder the standard system, obtaining two-dimensional coordinates
Figure DEST_PATH_IMAGE035AA
S52: to plane two-dimensional coordinate
Figure DEST_PATH_IMAGE035AAA
Least square fitting the plane ellipse to obtain an ellipse equation Ax 2+Bxy+Cy 2+ Dx + Ey + F =0, center of ellipse
Figure DEST_PATH_IMAGE038A
And major and minor axis radii
Figure DEST_PATH_IMAGE040A
And
Figure DEST_PATH_IMAGE042A
s53: and extracting the rivet hole boundary characteristics in the boundary point cloud blocks according to the ellipse fitting Error, the ratio of the major axis to the minor axis, the maximum radius threshold rmax, the minimum radius threshold rmin and the circle center position threshold d.
Further, the local plane two-dimensional coordinate system is constructed by any vector on the plane
Figure DEST_PATH_IMAGE044A
Normal to a plane, as the X-axis of the coordinate system
Figure DEST_PATH_IMAGE046A
And
Figure DEST_PATH_IMAGE048A
cross product of (a) as a coordinate system Y-axis, point cloud blockc i Any point inp 0Projected points on a plane
Figure DEST_PATH_IMAGE050A
As the origin of the coordinate system.
The ellipse equation Ax 2+Bxy+Cy 2Solution of + Dx + Ey + F =0 as follows:
order to
Figure DEST_PATH_IMAGE081
And
Figure DEST_PATH_IMAGE083
then the optimization goal is: min
Figure DEST_PATH_IMAGE085
=
Figure DEST_PATH_IMAGE087
,s.t.
Figure DEST_PATH_IMAGE089
>0, due to
Figure DEST_PATH_IMAGE085A
When =0, W has a scaling factor such that all W' = aW also meet the optimization goal, so it is possible to let W
Figure DEST_PATH_IMAGE089A
=1, then the optimization objective becomes: min
Figure DEST_PATH_IMAGE085AA
=
Figure DEST_PATH_IMAGE087A
,s.t.
Figure DEST_PATH_IMAGE089AA
=1, construct lagrange function for equation: l (W, λ) =
Figure DEST_PATH_IMAGE089AAA
-λ(
Figure DEST_PATH_IMAGE089AAAA
-1), deriving, order
Figure DEST_PATH_IMAGE098
Is obtained by
Figure DEST_PATH_IMAGE100
-λHW=0→
Figure DEST_PATH_IMAGE100A
λ HW, let S =
Figure DEST_PATH_IMAGE103
SW = λ HW, 6 possible solutions W are obtained by solving the generalized inverse matrix, λ is the positive definite matrix since S is>0, therefore can be used
Figure DEST_PATH_IMAGE089AAAAA
=1 and λ>0 to obtain the final qualified solution
Figure DEST_PATH_IMAGE081A
Wherein H =
Figure DEST_PATH_IMAGE107
Figure DEST_PATH_IMAGE089AAAAAA
>0 is the ellipse fitting parameter constraint 4AC-
Figure DEST_PATH_IMAGE110
>0。
Calculating the center of the ellipse
Figure DEST_PATH_IMAGE038AA
And major and minor axis radii
Figure DEST_PATH_IMAGE040AA
And
Figure DEST_PATH_IMAGE042AA
Figure DEST_PATH_IMAGE115
calculating the ratio of the ellipse fitting Error to the major and minor axes:
Figure DEST_PATH_IMAGE117
wherein
Figure DEST_PATH_IMAGE119
F (p) is a set of grid surfaces, and n is a point cloud block ci
Figure DEST_PATH_IMAGE026AAAAAAAAAA
Number of points C, if Error>e, e is fitting Error threshold, the cloud block is non-elliptical, i.e. non-rivet hole, if Error is<e, comparing the ratio of the long axis to the short axis; if 1-r<ratio<1-r, wherein r is a long-short axis ratio threshold value, the cloud block roundness of the division point is high, namely the boundary of the rivet hole, and otherwise, the cloud block roundness is the boundary of the non-rivet hole; if the radius of the rivet hole is required, a maximum radius threshold value rmax and a minimum radius threshold value rmin can be set, the mean value of the long axis and the short axis is compared with rmax and rmin to extract the rivet hole meeting the radius requirement, other round holes which are not rivet holes in the point cloud can be eliminated, the spatial distance dc between the theoretical center of the non-rivet round hole and the center of the fitting ellipse of the algorithm is calculated, and if the dc is smaller than the set threshold value, the extracted hole is eliminated.
When the method is used, a kd tree structure of scattered point cloud is established by adopting a kd tree method, so that each point in the point cloud is found outP i K neighborhood point set ofN j (j=0,1,2…k-1), replace the method of traditional contact measurement rivet hole, can effectively overcome the shortcoming of manual marking and manual cutting.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.

Claims (9)

1. A round hole feature extraction method facing rivet hole measurement point cloud data is characterized by comprising the following steps:
s1: extracting point cloud boundary points according to the distribution condition of k neighborhood points of each point in the point cloud;
s2: obtaining point cloud blocks belonging to different boundary characteristics through Euclidean distance clustering segmentation of boundary points;
s3: and extracting the rivet hole boundary in the cloud block of the segmentation point by an ellipse fitting method.
2. The method for extracting the features of the round hole facing the rivet hole measurement point cloud data according to claim 1, wherein the method for extracting the boundary points of the point cloud comprises the following steps:
s11: establishing a kd-Tree structure of scattered point cloud by using a kd-Tree method to obtain a point PiAnd its k neighborhood point Nj(j =0,1,2 … k-1) to obtain P by least squares fittingiA local tangent plane to the point;
s12: establishing a plane coordinate system on the tangent plane by PiTo the tangent plane projection point PiAs origin of coordinates, PiPoint sum N0Projected point of points
Figure DEST_PATH_IMAGE002AAA
Constructed vector
Figure DEST_PATH_IMAGE004AAAA
As the X-axis of the coordinate system, normal to the plane
Figure DEST_PATH_IMAGE006AAA
With vectors
Figure DEST_PATH_IMAGE004AAAAA
Ride across
Figure DEST_PATH_IMAGE006AAAA
×
Figure DEST_PATH_IMAGE004AAAAAA
As the Y axis of the coordinate system;
s13: converting the three-dimensional coordinates of each point in the point set X toOn the plane coordinate system, a two-dimensional coordinate set of a point set X is obtained
Figure DEST_PATH_IMAGE011A
S14: to be provided with
Figure DEST_PATH_IMAGE011AA
In (1)
Figure DEST_PATH_IMAGE014A
The point is used as the starting point of the vector,
Figure DEST_PATH_IMAGE016A
taking the point as a vector end point to obtain a plane vector set
Figure DEST_PATH_IMAGE018A
(j=0,1,2…k-1), calculating
Figure DEST_PATH_IMAGE018AA
The included angle alpha j from each vector to the X axis of the local coordinate system and the included angle beta j from the Y axis;
s15: the boundary points are identified from the maximum value θ max among the boundary points θ j.
3. The method for extracting features of a circular hole facing to rivet hole measurement point cloud data as claimed in claim 2, wherein if β j in S14>Pi/2, then alpha j = alpha j + pi, then alpha j is arranged in ascending order to obtain an angle sequence eta j, and an included angle theta j = eta j-1 between adjacent angles of eta j is calculated, wherein
Figure DEST_PATH_IMAGE021A
4. The method for extracting features of a circular hole facing rivet hole measurement point cloud data as claimed in claim 3, wherein in step S15, when a maximum included angle θ max in an adjacent angle sequence θ j exceeds a maximum included angle threshold θ, a point Pi is a boundaryPoint, otherwise point Pi is a non-boundary point, threshold
Figure DEST_PATH_IMAGE023A
The size of the threshold is determined according to the cloud distribution situation, and the threshold is generally set
Figure DEST_PATH_IMAGE023AA
Set to pi/2.
5. The method for extracting circular hole features from point cloud data measured by rivet holes according to claim 1, wherein the Euclidean distance clustering segmentation of the boundary points is that different boundary features in the point cloud have the characteristic of continuous distance between adjacent points in the same boundary feature, that is, the distance between adjacent points in the same boundary feature is small, and the distance between the closest points in different boundary features is large.
6. The method for extracting the circular hole features from the rivet hole measurement point cloud data according to claim 5, wherein the Euclidean distance clustering segmentation method for the boundary points comprises the following steps:
s31: a kd tree point cloud structure is established for the boundary point cloud X, so that subsequent point neighborhood searching is facilitated;
s32: creating an empty cluster set C and a point set Q;
s33: for any pointP i
Figure DEST_PATH_IMAGE026A
Processing the X;
s34: when each point in the boundary point cloud X is subjected to the step S33, a cluster set C is obtained;
s35: deleting fewer points in the cluster set C thann minAnd (4) obtaining a final cluster set C by cloud block point, and completing segmentation.
7. The method for extracting features of circular holes from rivet hole measuring point cloud data according to claim 6, wherein the step S33 is performed on any pointP i
Figure DEST_PATH_IMAGE026AA
X, performing the following steps:
s41: handleP i Adding into Q;
s42: for each pointP i
Figure DEST_PATH_IMAGE026AAA
Q, executing the following steps:
a. k neighbor search algorithm through boundary point kd treeP i The k neighborhood of (2) is put into the point set;
b. for each one
Figure DEST_PATH_IMAGE030
If, if
Figure DEST_PATH_IMAGE032
Is not in Q, and
Figure DEST_PATH_IMAGE032A
andp j of Euclidean distance rj<d th Then add Q and remove from X;
s43: and when the Q cannot find new points to be added, putting the Q into the cluster set C, and emptying the Q.
8. The method for extracting the characteristics of the round hole facing the cloud data of the rivet hole measurement point as claimed in any one of claims 1 to 7, wherein the method for extracting the rivet hole boundary in the cloud block of the segmentation point by the ellipse fitting method comprises the following steps:
s51: cloud block with dividing pointsc i
Figure DEST_PATH_IMAGE026AAAA
C least square fitting plane, constructing local plane two-dimensional coordinate system, and blocking point cloudc i Three-dimensional coordinates of all points in the image are converted into two-dimensional coordinates of a constructed local planeObtaining two-dimensional coordinates under a coordinate system
Figure DEST_PATH_IMAGE035
S52: to plane two-dimensional coordinate
Figure DEST_PATH_IMAGE035A
Least square fitting the plane ellipse to obtain an ellipse equation Ax 2+Bxy+Cy 2+ Dx + Ey + F =0, center of ellipse
Figure DEST_PATH_IMAGE038
And major and minor axis radii
Figure DEST_PATH_IMAGE040
And
Figure DEST_PATH_IMAGE042
s53: and extracting the rivet hole boundary characteristics in the boundary point cloud blocks according to the ellipse fitting Error, the ratio of the major axis to the minor axis, the maximum radius threshold rmax, the minimum radius threshold rmin and the circle center position threshold d.
9. The method for extracting features of a circular hole facing to rivet hole measurement point cloud data according to claim 8, wherein the local plane two-dimensional coordinate system is constructed by any vector on a plane
Figure DEST_PATH_IMAGE044
Normal to a plane, as the X-axis of the coordinate system
Figure DEST_PATH_IMAGE046
And
Figure DEST_PATH_IMAGE048
cross product of (a) as a coordinate system Y-axis, point cloud blockc i Any point inp 0Projected points on a plane
Figure DEST_PATH_IMAGE050
As the origin of the coordinate system.
CN202010674105.0A 2020-07-14 2020-07-14 Round hole feature extraction method for rivet hole measurement point cloud data Active CN111815611B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010674105.0A CN111815611B (en) 2020-07-14 2020-07-14 Round hole feature extraction method for rivet hole measurement point cloud data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010674105.0A CN111815611B (en) 2020-07-14 2020-07-14 Round hole feature extraction method for rivet hole measurement point cloud data

Publications (2)

Publication Number Publication Date
CN111815611A true CN111815611A (en) 2020-10-23
CN111815611B CN111815611B (en) 2024-03-22

Family

ID=72842369

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010674105.0A Active CN111815611B (en) 2020-07-14 2020-07-14 Round hole feature extraction method for rivet hole measurement point cloud data

Country Status (1)

Country Link
CN (1) CN111815611B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113129445A (en) * 2020-11-30 2021-07-16 南京航空航天大学 Large-scale three-dimensional rivet concave-convex amount visualization method based on multi-level fitting
CN113390357A (en) * 2021-07-08 2021-09-14 南京航空航天大学 Rivet levelness measuring method based on binocular multi-line structured light
CN114022617A (en) * 2021-11-18 2022-02-08 中国科学院长春光学精密机械与物理研究所 Method for discriminating scattered point cloud hole boundary
CN114897110A (en) * 2022-07-15 2022-08-12 成都飞机工业(集团)有限责任公司 Group hole measurement swing angle planning method, readable medium and equipment
CN115346019A (en) * 2022-09-06 2022-11-15 南京航空航天大学 Method, device and system for measuring geometrical parameters of point cloud circular hole

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110047133A (en) * 2019-04-16 2019-07-23 重庆大学 A kind of train boundary extraction method towards point cloud data
CN110349252A (en) * 2019-06-30 2019-10-18 华中科技大学 A method of small curvature part actual processing curve is constructed based on point cloud boundary
CN110807781A (en) * 2019-10-24 2020-02-18 华南理工大学 Point cloud simplification method capable of retaining details and boundary features
CN111222516A (en) * 2020-01-06 2020-06-02 西南电子技术研究所(中国电子科技集团公司第十研究所) Method for extracting key outline characteristics of point cloud of printed circuit board

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110047133A (en) * 2019-04-16 2019-07-23 重庆大学 A kind of train boundary extraction method towards point cloud data
CN110349252A (en) * 2019-06-30 2019-10-18 华中科技大学 A method of small curvature part actual processing curve is constructed based on point cloud boundary
CN110807781A (en) * 2019-10-24 2020-02-18 华南理工大学 Point cloud simplification method capable of retaining details and boundary features
CN111222516A (en) * 2020-01-06 2020-06-02 西南电子技术研究所(中国电子科技集团公司第十研究所) Method for extracting key outline characteristics of point cloud of printed circuit board

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113129445A (en) * 2020-11-30 2021-07-16 南京航空航天大学 Large-scale three-dimensional rivet concave-convex amount visualization method based on multi-level fitting
CN113390357A (en) * 2021-07-08 2021-09-14 南京航空航天大学 Rivet levelness measuring method based on binocular multi-line structured light
CN114022617A (en) * 2021-11-18 2022-02-08 中国科学院长春光学精密机械与物理研究所 Method for discriminating scattered point cloud hole boundary
CN114022617B (en) * 2021-11-18 2024-04-30 中国科学院长春光学精密机械与物理研究所 Method for judging hole boundaries of scattered point cloud
CN114897110A (en) * 2022-07-15 2022-08-12 成都飞机工业(集团)有限责任公司 Group hole measurement swing angle planning method, readable medium and equipment
CN114897110B (en) * 2022-07-15 2022-11-18 成都飞机工业(集团)有限责任公司 Group hole measurement swing angle planning method, readable medium and equipment
CN115346019A (en) * 2022-09-06 2022-11-15 南京航空航天大学 Method, device and system for measuring geometrical parameters of point cloud circular hole

Also Published As

Publication number Publication date
CN111815611B (en) 2024-03-22

Similar Documents

Publication Publication Date Title
CN111815611A (en) Round hole feature extraction method for rivet hole measurement point cloud data
CN111080627B (en) 2D +3D large airplane appearance defect detection and analysis method based on deep learning
CN109506580B (en) Spot-facing quality determining method based on line laser 3-D scanning
CN109272523B (en) Random stacking piston pose estimation method based on improved CVFH (continuously variable frequency) and CRH (Crh) characteristics
CN107633502B (en) Target center identification method for automatic centering of shaft hole assembly
CN113112496B (en) Sub-pixel shaft part size measurement method based on self-adaptive threshold
CN116402866A (en) Point cloud-based part digital twin geometric modeling and error assessment method and system
CN113865508B (en) Automatic detection device and method for through hole rate of sound lining of honeycomb sandwich composite material
CN113920081A (en) Cutter wear degree detection method
CN113155027B (en) Tunnel rock wall feature identification method
CN112785596B (en) Dot cloud picture bolt segmentation and height measurement method based on DBSCAN clustering
WO2021082380A1 (en) Laser radar-based pallet recognition method and system, and electronic device
CN115690184B (en) Tunnel face displacement measurement method based on three-dimensional laser scanning
CN110047133A (en) A kind of train boundary extraction method towards point cloud data
CN111145129A (en) Point cloud denoising method based on hyper-voxels
CN114234832B (en) Tunnel monitoring and measuring method based on target identification
CN105627935A (en) Product material thickness three-dimensional analysis system and method
CN116642904A (en) Aircraft skin defect detection and measurement method based on three-dimensional point cloud
CN113390357B (en) Rivet levelness measuring method based on binocular multi-line structured light
CN116432052B (en) Quality detection method for clamp for new energy automobile die
CN117372489A (en) Point cloud registration method and system for double-line structured light three-dimensional measurement
CN117115390A (en) Three-dimensional model layout method of power transformation equipment in transformer substation
CN116385356A (en) Method and system for extracting regular hexagonal hole features based on laser vision
CN115937149A (en) Wall surface local deviation automatic detection method based on triangular gridding
CN109815966A (en) A kind of mobile robot visual odometer implementation method based on improvement SIFT algorithm

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Yudaojie Nanjing 210016 Jiangsu province No. 29

Applicant after: Nanjing University of Aeronautics and Astronautics

Applicant after: Suzhou Research Institute of Nanjing University of Aeronautics and Astronautics

Address before: Building 6, No.78, Keling Road, science and Technology City, Suzhou high tech Zone, Suzhou, Jiangsu Province, 215010

Applicant before: Suzhou Research Institute of Nanjing University of Aeronautics and Astronautics

Applicant before: Nanjing University of Aeronautics and Astronautics

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant