CN101127123A - Sign point hole filling method based on neural network in tri-D scanning point cloud - Google Patents

Sign point hole filling method based on neural network in tri-D scanning point cloud Download PDF

Info

Publication number
CN101127123A
CN101127123A CNA2007101321122A CN200710132112A CN101127123A CN 101127123 A CN101127123 A CN 101127123A CN A2007101321122 A CNA2007101321122 A CN A2007101321122A CN 200710132112 A CN200710132112 A CN 200710132112A CN 101127123 A CN101127123 A CN 101127123A
Authority
CN
China
Prior art keywords
point
points
coordinate
resample points
hole
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2007101321122A
Other languages
Chinese (zh)
Other versions
CN100561521C (en
Inventor
达飞鹏
谷继兵
盖绍彦
朱正键
杨伟光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Haian Su Fu Technology Transfer Center Co., Ltd.
Original Assignee
Southeast University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southeast University filed Critical Southeast University
Priority to CNB2007101321122A priority Critical patent/CN100561521C/en
Publication of CN101127123A publication Critical patent/CN101127123A/en
Application granted granted Critical
Publication of CN100561521C publication Critical patent/CN100561521C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The utility model provides a point cloud hole filling method that is based on three-dimensional scanning of neural networks, ensures the continuity of the filled holes data and the surrounding data, and has better point cloud characteristic. The utility model has the advantage of simple method. The utility model is mainly applied to the application situations of filling holes with various complicated curved surface shapes produced by marking points in three-dimensional scanning system. With the neural network method of the utility model, a network with filled holes is obtained, sampling points in the hole regions are sampled subsequently based on the density of the hole boundary points, further the points of filling holes are adjusted according to the curvature of the points to achieve smooth filling of holes.

Description

In the 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network
Technical field
The present invention relates to a kind of method for repairing and mending, relate in particular in a kind of 3-D scanning point cloud complementing method based on the monumented point hole of neural network to three-dimensional picture.
Background technology
Reverse-engineering (Reverse Engineering, RE) technology is the later stage eighties 20th century to appear at the new technology in the advanced manufacturing field, it generally comprises four basic links: three-dimensional body detects and conversion (acquisition of physical data), data pre-service (put cloud processing, identification, look splicing more), the foundation of cad model (surface reconstruction), the moulding of CAM product, its basic flow sheet as shown in Figure 1.In the process that three-dimensional body detects and changes, by the three-dimensional digital scanner three-dimensional scanning survey is fast carried out on the mock-up surface, under the prerequisite that satisfies the discrete sampling speed and the quality of data, obtain the 3 d-dem data of product, in looking splicing more, a lot of algorithms are used the splicing based on monumented point, and at the object exterior pasting monumented point, the losing of data that must cause the zone that is capped, produce hole, this type of hole has the characteristics of himself: certainly lead to, the position size can be determined, quantity is more, the appearance of dot cloud hole has caused the imperfect of these data, therefore hole is compensated that promptly data to be carried out pre-service be a ring of forming a connecting link very crucial in the reverse-engineering, directly influence the quality of reconstruct success or not and cad model, its follow-up link is played very crucial restrictive function.The present invention mainly relates in the digitized process of reverse-engineering, obtains a kind of automatic complementing method of the monumented point hole of product point cloud model appearance with 3 D scanning system (Fig. 2).
In recent years, the algorithm of filling up of dot cloud hole has all been obtained very big progress at home and abroad, delivered a considerable amount of documents, the some of them algorithm has obtained comparatively widely to use, as the algorithm based on the various hole repairings of energy-optimised and segmentation, surface fitting, triangle grid model.The point cloud model that these algorithms need earlier 3-D scanning directly to be obtained is done certain processing in early stage or dot cloud hole is carried out Boundary Recognition, and real-time is not strong, and complexity is also than higher.In application of practical project, should be able in time solve the problem that occurs.
Document " Minimal energy surfaces using parametric splines. " (Gregory E.Fasshauer, LarryL.Schumarker.ComputerAided Geometric Design, 1996,13:45~79) by finding the solution optimization aim function based on " strain energy of distortion function ", realization is filled up hole, guaranteed certain fairness, yet these class methods need subdivision curved surface mostly, and a plurality of subsurface sheets are spliced, therefore the continuity of surface boundary is had relatively high expectations, be difficult to reach the Second Order Continuous between curved surface usually.Because the related algorithm comparative maturity of existing triangle grid model, existing algorithm all is based on this model mostly, document " Filling holes in meshes using a mechanical model to simulate thecurvature variation minimization. " (Jean-Philippe Pemot for example, George Moraru, Philippe Veron.Computer﹠amp; Graphics, 2006,30:892~902) hole repairing is summed up as the triangulation problem of a space polygon.Behind trigonometric ratio, seek the border of triangular network, automatically detect hole, before perforations adding, at first the border triangle is handled, remove the triangle that direction is bad and degenerate, use the triangular network perforations adding at last, but the method can only be repaired closed hole, and this class algorithm for the cloud data of complexity programming to set up the triangle grid model operand bigger, in filling up the process of hole, also need to change the topological structure of triangle gridding, therefore have triangle grid model revised and the shortcoming of designed capacity deficiency again, complexity height, these shortcomings have all limited its application in practice.Filling algorithm to a class polygon hole is not suitable for general point cloud model.
Filling algorithm for general surface mesh all needs to obtain the hole boundary information accurately, and difficulty is big, is difficult for realizing.Compensate in the algorithmic procedure of hole by scattered point set around the dot cloud hole is carried out surface fitting, the parametrization of point at random is essential.Even parametrization, entad parametrization and accumulation Chord Length Parameterization method are arranged usually, and these methods are primarily aimed at the data point that is topological rectangular array, to the cloud data of random distribution, need sort to it, difficulty is also bigger.
Algorithm based on the neural network perforations adding has also obtained using comparatively widely now, has also obtained effect preferably simultaneously.Document " based on the some cloud incomplete data method for repairing and mending of neural network " (Liu Jun for example, He Jianying. the mechanical engineer, 2007 (2): the BP data network method for repairing and mending that has proposed a kind of three-dimensional incomplete data 32~34), frame is selected the sample point set of incomplete data boundary vicinity, and trained, BP network after the training is used for the prediction at incomplete number of regions strong point, finishes the repairing of data.This class methods accommodation is wider, for nonlinear data, noisy data, the indefinite data of pattern feature reasonable effect is arranged all, but not enough place is arranged: operation is many, each hole, and all the very important person selects the boundary sample point set for frame; The density of repairing area point is with inconsistent on every side; For the big characteristic area of some curved transition, it is good inadequately that feature shows.
In the application process of reality, in 3 D scanning system, introduce monumented point for the looking splicing an of cloud more, just inevitably there is the hole phenomenon this moment, it is crucial that these holes are filled up timely.For this reason, use a kind of new algorithm that the monumented point hole is filled up among the present invention.How to guarantee that the hole data filled up and ambient data are continuously and the difficult point that is more preferably this type of algorithm of character representation.Cloud data density is selected the method for resampling density and can be reached smooth filling to hole for the some cloud of repairing by curvature adjustment around the basis that proposes among the present invention.
Summary of the invention
The invention provides a kind of can guarantee the hole data filled up and ambient data continuously and some cloud character representation better based on the method for filling dot cloud hole of the 3-D scanning of neural network, the present invention has the simple advantage of method.
The present invention adopts following technical scheme:
In a kind of 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network:
The first step: the hole that forms for the monumented point of object exterior pasting, in 3-D scanning point cloud, when obtaining on every side sample point set of hole, according to the three-dimensional coordinate (x of monumented point b, y b, z b), will be that data point in the cube at center is as the sample point P of perforations adding with the monumented point s(s=0,1 ..., t), cubical 8 summits are respectively (x b-r, y b-r, z b-r), (x b-r, y b-r, z b+ r), (x b-r, y b+ r, z b-r), (x b-r, y b+ r, z b+ r), (x b+ r, y b-r, z b-r), (x b+ r, y b-r, z b+ r), (x b+ r, y b+ r, z b-r), (x b+ r, y b+ r, z b+ r), wherein r is the thresholding of being got, and in order to obtain suitable sample point set, gets 1.2~1.5 times of radius of monumented point;
Second the step: according to sample points according to P sThe neural network of training perforations adding, the neural network that is used to fill up hole is three layers a reverse transmittance nerve network, its input layer is 2 neurons, the x coordinate figure and the y coordinate figure of the corresponding sample data of difference, hidden layer is a m neuron, and output layer is the z coordinate figure of 1 neuron and corresponding sample data, and the excitation function of hidden layer and output layer is respectively the tanh sigmoid function f ( x ) = e x - e - x e x + e - x With linear function g (x)=x, and use Levenberg-Marquardt algorithm training counterpropagation network, hidden neuron number m chooses 20, obtains the neural network net of perforations adding by training;
The 3rd step: after obtaining neural network net, choose resample points,, calculate all sample point P for density and its ambient data that incomplete zone is heavily adopted is consistent along step-lengths such as x and y directions s, s=0 wherein, 1 ..., t, as the step-length L that resamples, the scope of resampling is interval (x at the mean distance of the point of xoy plane projection and on every side minor increment Min, x Max), (y Min, y Max), x wherein Min, x MaxBe minimum value and the maximal value of the coordinate x of sample point, y Min, y MaxBe minimum value and the maximal value of the coordinate y of sample point, heavily adopt ading up to a little
Figure A20071013211200052
Wherein
Figure A20071013211200053
Expression rounds downwards, and the x coordinate figure of resample points is from x MinBeginning with step-length L equidistant increase until
Figure A20071013211200061
The y coordinate figure of resample points is from y MinBeginning with step-length L equidistant increase until
Figure A20071013211200062
The x coordinate figure of the point that resamples and y coordinate figure as the input of neural network, just can be obtained resample points z coordinate figure, and then obtain all resample points;
The 4th step: the curvature according to resample points is added sampled point, when asking for discrete space point curvature, all resample points are projected to the xoy plane, by the 3rd step as can be known, all subpoints, equidistantly distribute with spacing L along x and y direction, get ask point in 5 * 5 neighborhoods on the xoy plane a little as the neighborhood point, remove totally 24 point itself,, obtain the curvature ρ of all resample points according to existing method as a little k neighborhood of ask s(s=0,1 ..., n-1), according to given curvature thresholding ρ τ, ρ τGet 0.1, get curvature greater than ρ τResample points, obtain the deep camber point, around deep camber point, increase sampled point then, the strategy of taking is, all resample points are projected on the xoy plane, supposes that it is (x that the coordinate of deep camber point subpoint on the xoy plane is arranged ρ, y ρ), check that it is along x four the subpoint (x adjacent with the y direction ρ-L, y ρ), (x ρ+ L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L), if the deep camber point is wherein also arranged, then two resample points of equidistant increase between deep camber point are without loss of generality, and suppose to project to (x ρ+ L, y ρ) point of coordinate is the deep camber point, then increase
Figure A20071013211200063
Figure A20071013211200064
2 points, all the other are not on the direction of deep camber point, increase a bit, (the x that projects to as described above ρ-L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L) 3 are not the deep camber points, then increase
Figure A20071013211200065
Figure A20071013211200066
Figure A20071013211200067
3 points, adopt above strategy to mend point at all deep camber points, at last among the neural network net that the x of the point of all benefits and second step of y coordinate figure input are obtained, the z coordinate figure of asking, all resample points have so just been obtained according to the curvature increase, resample points together with obtaining in the 3rd step obtains final resample points;
The 5th step: with in the final resample points with 3-D scanning point cloud in the distance of closest approach less than 0.5d 3DResample points give up, remaining sampled point is added in the 3-D scanning point cloud the filling up of complement mark point hole, wherein d 3DBe the density of 3-D scanning point cloud, d 3DBe set to the mean value of the each point of a cloud and minor increment on every side.
The present invention is mainly used in the application scenario that the hole of the various complex-curved shapes that produced by monumented point in the 3 D scanning system is filled up.Utilize the neural net method among the present invention, can obtain filling up the network of hole, according to the density of hole frontier point, get sampled point subsequently, and further adjust the point of perforations adding, reach smooth filling hole according to the curvature of point in the hole zone.This method mainly contains following advantage:
(1) gridding of comparing in the But most of algorithms is handled, and the present invention is primarily aimed at the original point cloud model that 3 D scanning system obtains, without any need for gridding handle, applicability is wide, speed is fast.
(2) because monumented point is attached to each different position of object, therefore the hole that forms also is various shape, therefore in the parametric surface fitting complementing method, just can't select to be fit to the parametric surface of all holes, and neural network has very strong functional approximation capability, three-layer network can with arbitrary accuracy approach any continuous function with and all-order derivative, therefore compare with method based on various parametric surface fittings, based on the hole of neural network method, can obtain and better fill up precision the various complex-curved shapes of monumented point formation.
(3) during the triangular network perforations adding, it is closed that the hole of being mended necessarily requires, and this method can both be filled up wide adaptability for the hole of the arbitrary shape that monumented point forms.
(4) hole that forms for monumented point, because the D coordinates value and the size of monumented point are known, therefore hole is discerned automatically according to the monumented point position, obtaining also of sample point finished automatically around the hole, need not any manual operation, after obtaining 3-D scanning point cloud, just can finish filling up of all monumented point holes automatically.
(5) can be according to actual needs, the artificially number of times of Control Training and precision in network training have been avoided unnecessary calculating redundancy.
When (6) getting on the whole, this method resamples to the hole zone according to the density of hole frontier point, has guaranteed the continuity of hole repairing zone with the border.
(7) this method is to the preliminary resample points of hole, curvature according to resample points, near the big point of curvature, add sampled point, make hole in the big place of curved transition, the point of filling up is more, the general algorithm of evenly filling up of comparing more can show the feature of a cloud, and the hole of being filled up is more smooth.
Description of drawings
Fig. 1 is the reverse-engineering process flow diagram.
Fig. 2 is a grating style three-dimension scanning system composition diagram.
Fig. 3 is algorithm overall flow figure.
Fig. 4 is the pictorial diagram that contains the monumented point hole.
Fig. 5 chooses the monumented point cube synoptic diagram of sample point set on every side.
Fig. 6 chooses k neighborhood point set synoptic diagram.
Fig. 7 is that curvature function is found the solution figure.
Fig. 8 increases the sampled point synoptic diagram according to curvature.
Fig. 9 is the algorithm flow chart that increases sampled point according to curvature.
Figure 10 is the positive effect figure of final perforations adding.
Figure 11 is the design sketch of another angle of final perforations adding.
Embodiment
In a kind of 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network:
The first step: the hole that the monumented point of pasting for Venus's head portrait surface forms, in 3-D scanning point cloud, when obtaining on every side sample point set of hole, according to the three-dimensional coordinate (x of monumented point b, y b, z b), will be that data point in the cube at center is as the sample point P of perforations adding with the monumented point s(s=0,1 ..., t), cubical 8 summits are respectively (x b-r, y b-r, z b-r), (x b-r, y b-r, z b+ r), (x b-r, y b+ r, z b-r), (x b-r, y b+ r, z b+ r), (x b+ r, y b-r, z b-r), (x b+ r, y b-r, z b+ r), (x b+ r, y b+ r, z b-r), (x b+ r, y b+ r, z b+ r), wherein r is the thresholding of being got, and in order to obtain suitable sample point set, gets 1.2~1.5 times of radius of monumented point;
Second the step: according to sample points according to P sThe neural network of training perforations adding, the neural network that is used to fill up hole is three layers a reverse transmittance nerve network, its input layer is 2 neurons, the x coordinate figure and the y coordinate figure of the corresponding sample data of difference, hidden layer is a m neuron, and output layer is the z coordinate figure of 1 neuron and corresponding sample data, and the excitation function of hidden layer and output layer is respectively the tanh sigmoid function f ( x ) = e x - e - x e x + e - x With linear function g (x)=x, and use Levenberg-Marquardt algorithm training counterpropagation network, hidden neuron number m chooses 20, and the step-length of network training gets 2000, and training precision gets 0.001, obtains the neural network net of perforations adding by training;
The 3rd step: after obtaining neural network net, choose resample points along step-lengths such as x and y directions, for density and its ambient data that incomplete zone is heavily adopted is consistent, calculates each sample point earlier and put minor increment d at the point of xoy plane projection in the point of xoy plane projection and all the other i, again with the average of all minimum distances as heavily adopting step-length L, L = 1 t + 1 Σ i = 0 t d i , The scope that resamples is interval (x Min, x Max), (y Min, y Max), x wherein Min, x MaxBe minimum value and the maximal value of the coordinate x of sample point, y Min, y MaxBe minimum value and the maximal value of the coordinate y of sample point, heavily adopt ading up to a little Wherein
Figure A20071013211200083
Expression rounds downwards, and the x coordinate figure of resample points is from x MinBeginning with step-length L equidistant increase until
Figure A20071013211200084
The y coordinate figure of resample points is from y MinBeginning with step-length L equidistant increase until
Figure A20071013211200085
The x coordinate figure of the point that resamples and y coordinate figure as the input of neural network, just can be obtained resample points z coordinate figure, and then obtain all resample points Q s(s=0,1 ... n-1);
The 4th step: according to resample points Q s(s=0,1, n-1) curvature is added sampled point, when asking for discrete space point curvature, all resample points are projected to the xoy plane, go on foot as can be known by the 3rd, all subpoints equidistantly distribute with spacing L along x and y direction, get ask point in 5 * 5 neighborhoods on the xoy plane a little as the neighborhood point, remove totally 24 point itself, as ask a little k neighborhood K (Q s), S (Q s) be resample points Q sK neighbor point least square fitting plane, the order Be resample points Q sK neighbor point set K (Q s) the centre of form, be called resample points Q sCentral point, this central point is:
Q ‾ = 1 ( k + 1 ) Σ Q s ∈ k ( Q s ) Q s
If resample points Q sJ neighbor point to least square plane S (Q s) distance be d j, arrive
Figure A20071013211200088
Distance be λ j, so to resample points Q sJ point have a function f j(Q s), this function f j(Q s) be:
f j ( Q s ) = d j λ j
Resample points Q so sCurvature function can be expressed as:
f ( Q s ) = 1 k Σ j = 1 k f j ( Q s )
According to curvature function f (Q s) obtain the curvature ρ of all resample points s(s=0,1 ..., n-1), according to given curvature thresholding ρ τ, ρ τGet 0.1, get curvature greater than ρ τResample points, obtain the deep camber point, around deep camber point, increase sampled point then, the strategy of taking is, all resample points are projected on the xoy plane, supposes that it is (x that the coordinate of deep camber point subpoint on the xoy plane is arranged ρ, y ρ), check that it is along x four the subpoint (x adjacent with the y direction ρ-L, y ρ), (x ρ+ L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L), if the deep camber point is wherein also arranged, then two resample points of equidistant increase between deep camber point are without loss of generality, and suppose to project to (x ρ+ L, y ρ) point of coordinate is the deep camber point, then increase
Figure A20071013211200091
Figure A20071013211200092
2 points, all the other are not on the direction of deep camber point, increase a bit, (the x that projects to as described above ρ-L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L) 3 are not the deep camber points, then increase
Figure A20071013211200093
Figure A20071013211200095
3 points, adopt above strategy to mend point at all deep camber points, at last among the neural network net that the x of the point of all benefits and second step of y coordinate figure input are obtained, the z coordinate figure of asking, all resample points have so just been obtained according to the curvature increase, resample points together with obtaining in the 3rd step obtains final resample points Q s' (s=0,1 ..., n-1 ..., n+l-1);
The 5th step: with in the final resample points with 3-D scanning point cloud in the distance of closest approach less than 0.5d 3DResample points give up, remaining sampled point is added in the 3-D scanning point cloud the filling up of complement mark point hole, wherein d 3DBe the density of 3-D scanning point cloud, d 3DBe set to the mean value of the each point of a cloud and minor increment on every side.
With reference to the accompanying drawings, the present invention is described in detail:
In reverse-engineering, consider that the measurement data amount is big and at random, contain non-linear strong characteristics of noise and nerual network technique to the advantage on this class data processing, the hole of the various complex-curved shapes that form for monumented point, we introduce neural network (neural network) technology the hole in measuring are repaired, neural network has very strong functional approximation capability, and three layers of feedforward network can approach any continuous function and all-order derivative thereof with arbitrary accuracy.Adopt neural network to replace traditional curved surface fitting method based on spline base function, the mapping relations of expression curved surface are stored in the connection weights and threshold value of neural network, the information stores pattern of this holographic formula, make model have stronger fault freedom and associative ability, can not have a strong impact on its overall performance because partial nerve unit is impaired; Can seriously not distort output yet, have robustness because input signal is subjected to the pollution of noise to a certain degree.Overall algorithm flow is seen Fig. 3.
The present invention relates generally to the content of following four aspects:
1) the sample point set around the monumented point hole obtains and the training of neural network
The hole that the monumented point of pasting for Venus's head portrait surface forms is seen Fig. 4, in 3-D scanning point cloud, when obtaining on every side sample point set of hole, according to the three-dimensional coordinate (x of monumented point b, y b, z b), will be that data point in the cube at center is as the sample point P of perforations adding with the monumented point s, s=0 wherein, 1 ..., t, the three-dimensional coordinate on cubical 8 summits is respectively (x b-r, y b-r, z b-r), (x b-r, y b-r, z b+ r), (x b-r, y b+ r, z b-r), (x b-r, y b+ r, z b+ r), (x b+ r, y b-r, z b-r), (x b+ r, y b-r, z b+ r), (x b+ r, y b+ r, z b-r), (x b+ r, y b+ r, z b+ r), wherein r is the thresholding of being got, and gets 1.2~1.5 times of radius of monumented point, sees Fig. 5.
According to sample point set P sThe neural network of training perforations adding, the Neural Network Toolbox of utilization matlab is set up the BP neural network, network is three layers, and input layer is 2 neurons, respectively the x coordinate figure and the y coordinate figure of corresponding sample data, hidden layer is a m neuron, output layer is 1 neuron, and the z coordinate figure of corresponding sample data, the excitation function of hidden layer and output layer are respectively the tanh sigmoid functions f ( x ) e x - e - x e x + e - x With linear function g (x)=x, and use Levenberg-Marquardt algorithm BP network, hidden neuron number m gets 20, and the step-length of network training gets 2000, and training precision gets 0.001, obtains the neural network net of perforations adding by training.
2) resampling of perforations adding data and by the curvature adjustment
The strategy that resamples is after obtaining neural network net, choose resample points along step-lengths such as x and y directions, for density and its ambient data that makes incomplete area resample is consistent, calculate the resampling step-length in accordance with the following methods: calculate earlier each sample point and put minor increment d at the point of xoy plane projection in the point of xoy plane projection and all the other i, again with the average of all minimum distances as heavily adopting step-length L, L = 1 t + 1 Σ i = 0 t d i .
The scope that resamples is interval (x Min, x Max), (y Min, y Max), x wherein Min, x MaxBe minimum value and the maximal value of the coordinate x of sample point, y Min, y MaxBe minimum value and the maximal value of the coordinate y of sample point,, get ading up to of resample points according to resampling scope and resampling step-length
Figure A20071013211200103
Wherein
Figure A20071013211200104
Expression rounds downwards, and the x coordinate figure of resample points is from x MinBeginning with step-length L equidistant increase until
Figure A20071013211200105
The y coordinate figure of resample points is from y MinBeginning with step-length L equidistant increase until
Figure A20071013211200106
The x coordinate figure of the point that resamples and y coordinate figure as the input of neural network, just can be obtained resample points z coordinate figure, and then obtain all resample points Q s(s=0,1 ... n-1).
To preliminary resample points, adjust according to curvature, in the bigger place of curved transition, increase some sampled points, the more smooth hole of filling up.
Resample points Q sThe method of asking spatial discrete points curvature is used in the calculating of curvature, asks k neighborhood K (Q a little earlier s), owing to equidistantly sample along x and y direction when resampling, therefore the subpoint of all resample points equidistantly distributes with spacing L along x and y direction, get ask point in 5 * 5 neighborhoods on the xoy plane a little as the neighborhood point, see Fig. 6, remove self totally 24 point, gather K (Q as ask k neighbor point a little s), the Q of match resample points again sK neighborhood least square fitting planar S (Q s), order
Figure A20071013211200107
Be resample points Q sK neighbor point set K (Q s) the centre of form, be called resample points Q sCentral point, this central point is:
Q ‾ = 1 ( k + 1 ) Σ Q s ∈ k ( Q s ) Q s
If resample points Q sJ neighbor point to least square plane S (Q s) distance be d j, arrive Distance be λ j, see Fig. 7, so to resample points Q sJ point have a function f j(Q s), this function f j(Q s) be:
f j ( Q s ) = d j λ j
Resample points Q so sCurvature function can be expressed as:
f ( Q s ) = 1 k Σ j = 1 k f j ( Q s )
According to curvature function f (Q s) obtain the curvature ρ of all resample points s(s=0,1 ..., n-1).
After obtaining the curvature of all sampled points, according to given curvature thresholding ρ τ, ρ τGet 0.1, get curvature greater than ρ τResample points, obtain the deep camber point, around deep camber point, increase sampled point then, the strategy of taking is, all resample points are projected on the xoy plane, supposes that it is (x that the coordinate of deep camber point subpoint on the xoy plane is arranged ρ, y ρ), check that it is along x four the subpoint (x adjacent with the y direction ρ-L, y ρ), (x ρ+ L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L), if the deep camber point is wherein also arranged, then two resample points of equidistant increase between deep camber point are without loss of generality, and suppose to project to (x ρ+ L, y ρ) point of coordinate is the deep camber point, then increase
Figure A20071013211200113
Figure A20071013211200114
2 points, all the other are not on the direction of deep camber point, increase a bit, (the x that projects to as described above ρ-L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L) 3 are not the deep camber points, then increase
Figure A20071013211200115
Figure A20071013211200116
Figure A20071013211200117
3 points, see Fig. 8, adopt above strategy to mend point at all deep camber points, at last among the neural network net that the x and the input of y coordinate figure of the point of all benefits trained, try to achieve the z coordinate figure, so just obtained all resample points, added the resampling point set Q that begins to try to achieve according to the curvature increase s, obtain final resampling point set Q s' (s=0,1 ..., n-1 ..., n+l-1), (n point is preliminary resampling point set Q wherein s, the sampled point of back l point for increasing according to the curvature self-adaptation).The algorithm flow chart that increases point according to curvature is seen Fig. 9.
3) finally fill up determining of hole point
Because the scope that resamples is determined by the sample point set, if therefore directly final resample points is added original some cloud, borderline region at hole has the overlay region, for fear of adding redundant points, with in the final resample points with 3-D scanning point cloud in the distance of closest approach less than 0.5d 3DResample points give up, remaining resample points is added in the 3-D scanning point cloud the filling up of complement mark point hole, wherein d 3DBe the density of 3-D scanning point cloud, d 3DBe set to the mean value of the each point of a cloud and minor increment on every side.Some cloud behind the final perforations adding, Figure 10 is positive effect figure, and Figure 11 is the design sketch of another angle, and the rectangle frame zone among the two secondary figure is the zone of perforations adding.

Claims (1)

  1. In the 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network, it is characterized in that:
    The first step: the hole that forms for the monumented point of object exterior pasting, in 3-D scanning point cloud, when obtaining on every side sample point set of hole, according to the three-dimensional coordinate (x of monumented point b, y b, z b), will be that data point in the cube at center is as the sample point P of perforations adding with the monumented point s, s=0 wherein, 1 ..., t, the three-dimensional coordinate on cubical 8 summits is respectively (x b-r, y b-r, z b-r), (x b-r, y b-r, z b+ r), (x b-r, y b+ r, z b-r), (x b-r, y b+ r, z b+ r), (x b+ r, y b-r, z b-r), (x b+ r, y b-r, z b+ r), (x b+ r, y b+ r, z b-r), (x b+ r, y b+ r, z b+ r), wherein r is the thresholding of being got, and gets 1.2~1.5 times of radius of monumented point:
    Second the step: according to sample points according to P sThe neural network of training perforations adding, the neural network that is used to fill up hole is three layers a reverse transmittance nerve network, its input layer is 2 neurons, the x coordinate figure and the y coordinate figure of the corresponding sample data of difference, hidden layer is a m neuron, and output layer is the z coordinate figure of 1 neuron and corresponding sample data, and the excitation function of hidden layer and output layer is respectively the tanh sigmoid function f ( x ) = e x - e - x e x + e - x With linear function g (x)=x, and use Levenberg-Marquardt algorithm training counterpropagation network, hidden neuron number m chooses 20, obtains the neural network net of perforations adding by training;
    The 3rd step: after obtaining neural network net, choose resample points,, calculate all sample point P for density and its ambient data that incomplete zone is heavily adopted is consistent along step-lengths such as x and y directions s, s=0 wherein, 1 ..., t, as the step-length L that resamples, the scope of resampling is interval (x at the mean distance of the point of xoy plane projection and on every side minor increment Min, x Max), (y Min, y Max), x wherein Min, x MaxBe minimum value and the maximal value of the coordinate x of sample point, y Min, y MaxBe minimum value and the maximal value of the coordinate y of sample point, heavily adopt ading up to a little
    Figure A2007101321120002C2
    Wherein "
    Figure A2007101321120002C3
    Expression rounds downwards, and the x coordinate figure of resample points is from x MinBeginning with step-length L equidistant increase until
    Figure A2007101321120002C4
    The y coordinate figure of resample points is from y MinBeginning with step-length L equidistant increase until
    Figure A2007101321120002C5
    With the x coordinate figure and the y of the point that resamples, coordinate figure just can obtain resample points z coordinate figure as the input of neural network, and then obtains all resample points;
    The 4th step: the curvature according to resample points is added sampled point, when asking for discrete space point curvature, all resample points are projected to the xoy plane, by the 3rd step as can be known, all subpoints, equidistantly distribute with spacing L along x and y direction, get ask point in 5 * 5 neighborhoods on the xoy plane a little as the neighborhood point, remove totally 24 point itself,, obtain the curvature ρ of all resample points according to existing method as a little k neighborhood of ask s, s=0 wherein, 1 ..., n-1 is according to given curvature thresholding ρ τ, ρ τGet 0.1, get curvature greater than ρ τResample points, obtain the deep camber point, around deep camber point, increase sampled point then, the strategy of taking is, all resample points are projected on the xoy plane, supposes that it is (x that the coordinate of deep camber point subpoint on the xoy plane is arranged ρ, y ρ), check that it is along x four the subpoint (xs adjacent with the y direction ρ-L, y ρ), (x ρ+ L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L), if the deep camber point is wherein also arranged, then two resample points of equidistant increase between deep camber point are without loss of generality, and suppose to project to (x ρ+ L, y ρ) point of coordinate is the deep camber point, then increase
    Figure A2007101321120003C1
    Figure A2007101321120003C2
    2 points, all the other are not on the direction of deep camber point, increase a bit, (the x that projects to as described above ρ-L, y ρ), (x ρ, y ρ-L), (x ρ, y ρ+ L) 3 are not the deep camber points, then increase
    Figure A2007101321120003C3
    Figure A2007101321120003C4
    Figure A2007101321120003C5
    3 points, adopt above strategy to mend point at all deep camber points, at last among the neural network net that the x of the point of all benefits and second step of y coordinate figure input are obtained, the z coordinate figure of asking, all resample points have so just been obtained according to the curvature increase, resample points together with obtaining in the 3rd step obtains final resample points;
    The 5th step: with in the final resample points with 3-D scanning point cloud in the distance of closest approach less than 0.5d 3DResample points give up, remaining resample points is added in the 3-D scanning point cloud the filling up of complement mark point hole, wherein d 3DBe the density of 3-D scanning point cloud, d 3DBe set to the mean value of the each point of a cloud and minor increment on every side.
CNB2007101321122A 2007-09-11 2007-09-11 In the 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network Expired - Fee Related CN100561521C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2007101321122A CN100561521C (en) 2007-09-11 2007-09-11 In the 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2007101321122A CN100561521C (en) 2007-09-11 2007-09-11 In the 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network

Publications (2)

Publication Number Publication Date
CN101127123A true CN101127123A (en) 2008-02-20
CN100561521C CN100561521C (en) 2009-11-18

Family

ID=39095147

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2007101321122A Expired - Fee Related CN100561521C (en) 2007-09-11 2007-09-11 In the 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network

Country Status (1)

Country Link
CN (1) CN100561521C (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063898A (en) * 2014-06-30 2014-09-24 厦门大学 Three-dimensional point cloud auto-completion method
CN106033620A (en) * 2015-03-13 2016-10-19 腾讯科技(深圳)有限公司 Point clouds model restoration method, point clouds model restoration device and calculation device
CN107464223A (en) * 2017-07-19 2017-12-12 西安理工大学 A kind of dot cloud hole method for repairing and mending based on section
CN107507127A (en) * 2017-08-04 2017-12-22 深圳市易尚展示股份有限公司 The global registration method and system of multiple views three-dimensional point cloud
CN107610061A (en) * 2017-08-30 2018-01-19 西安理工大学 A kind of guarantor's edge point cloud hole repair method based on two-dimensional projection
CN108399609A (en) * 2018-03-06 2018-08-14 北京因时机器人科技有限公司 A kind of method for repairing and mending of three dimensional point cloud, device and robot
CN109670558A (en) * 2017-10-16 2019-04-23 奥多比公司 It is completed using the digital picture of deep learning
CN109961517A (en) * 2019-03-01 2019-07-02 浙江大学 A kind of triangle gridding weight parametric method for parametric surface fitting
CN110091505A (en) * 2019-04-26 2019-08-06 宁波心思为三维科技有限公司 A kind of intelligence control system based on 3D printer
CN112991522A (en) * 2021-03-30 2021-06-18 华南理工大学 Personalized automatic modeling method, system and equipment for mitral valve

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063898B (en) * 2014-06-30 2017-05-03 厦门大学 Three-dimensional point cloud auto-completion method
CN104063898A (en) * 2014-06-30 2014-09-24 厦门大学 Three-dimensional point cloud auto-completion method
CN106033620A (en) * 2015-03-13 2016-10-19 腾讯科技(深圳)有限公司 Point clouds model restoration method, point clouds model restoration device and calculation device
CN106033620B (en) * 2015-03-13 2018-10-19 腾讯科技(深圳)有限公司 A kind of point cloud model restorative procedure, device and computing device
CN107464223B (en) * 2017-07-19 2020-01-14 西安理工大学 Point cloud hole repairing method based on slices
CN107464223A (en) * 2017-07-19 2017-12-12 西安理工大学 A kind of dot cloud hole method for repairing and mending based on section
CN107507127A (en) * 2017-08-04 2017-12-22 深圳市易尚展示股份有限公司 The global registration method and system of multiple views three-dimensional point cloud
CN107507127B (en) * 2017-08-04 2021-01-22 深圳市易尚展示股份有限公司 Global matching method and system for multi-viewpoint three-dimensional point cloud
CN107610061B (en) * 2017-08-30 2020-02-14 西安理工大学 Edge-preserving point cloud hole repairing method based on two-dimensional projection
CN107610061A (en) * 2017-08-30 2018-01-19 西安理工大学 A kind of guarantor's edge point cloud hole repair method based on two-dimensional projection
CN109670558A (en) * 2017-10-16 2019-04-23 奥多比公司 It is completed using the digital picture of deep learning
CN109670558B (en) * 2017-10-16 2024-01-12 奥多比公司 Digital image completion using deep learning
CN108399609A (en) * 2018-03-06 2018-08-14 北京因时机器人科技有限公司 A kind of method for repairing and mending of three dimensional point cloud, device and robot
CN108399609B (en) * 2018-03-06 2020-07-31 北京因时机器人科技有限公司 Three-dimensional point cloud data repairing method and device and robot
CN109961517A (en) * 2019-03-01 2019-07-02 浙江大学 A kind of triangle gridding weight parametric method for parametric surface fitting
CN110091505A (en) * 2019-04-26 2019-08-06 宁波心思为三维科技有限公司 A kind of intelligence control system based on 3D printer
CN112991522A (en) * 2021-03-30 2021-06-18 华南理工大学 Personalized automatic modeling method, system and equipment for mitral valve
CN112991522B (en) * 2021-03-30 2023-03-24 华南理工大学 Personalized automatic modeling method, system and equipment for mitral valve

Also Published As

Publication number Publication date
CN100561521C (en) 2009-11-18

Similar Documents

Publication Publication Date Title
CN100561521C (en) In the 3-D scanning point cloud based on the complementing method of the monumented point hole of neural network
CN100495442C (en) Three-dimensional scanning point cloud compressing method
CN100383823C (en) Filling method for unwanted holes in clouds of three dimension scanning
CN108171780A (en) A kind of method that indoor true three-dimension map is built based on laser radar
CN110288695A (en) Single-frame images threedimensional model method of surface reconstruction based on deep learning
CN104361632A (en) Triangular mesh hole-filling method based on Hermite radial basis function
CN108776993A (en) The modeling method and buried cable work well modeling method of three-dimensional point cloud with hole
CN105931298A (en) Automatic selection method for low relief position based on visual significance
Wang et al. Hole filling of triangular mesh segments using systematic grey prediction
CN104331933A (en) Slicing direction self-adaptive rapid selection method
CN102117488B (en) Method for constructing surface reflection characteristics of real object in virtual environment
CN108335354A (en) A kind of greedy projection Triangulation Algorithm list wood method for reconstructing based on Moving Least
CN110176073A (en) 3 D defects model automatic modeling and adaptive layered method
CN103824323B (en) A kind of three-dimensional rebuilding method based on single width two dimensional image
CN111028335B (en) Point cloud data block surface patch reconstruction method based on deep learning
CN114611359A (en) Grid-parameter hybrid model modeling method and system
CN106842314B (en) The determination method of formation thickness
CN112634145A (en) Three-dimensional model repairing method for generating countermeasure network based on three-dimensional depth convolution
CN111881919A (en) Intelligent line element simplification method and device based on tracking type grid subdivision
CN108763767B (en) VR engine-oriented large-data-volume IGS industrial model POLYGON conversion method
Knopf et al. Interpolating scattered data using 2D self-organizing feature maps
CN104200525B (en) Three-dimensional modeling method and system based on extrusion object images
CN115984441A (en) Method for rapidly reconstructing textured three-dimensional model based on nerve shader
JP4044171B2 (en) Wood texture embossed sheet creation method and creation device
CN107590855A (en) Model for Multi-Objective Optimization, interpolation method and the Surface Reconstruction of surface reconstruction

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: SOWTHEAST UNIV.

Effective date: 20131023

Owner name: HAIAN SUSHI TECHNOLOGY TRANSFORMATION CENTER CO.,

Free format text: FORMER OWNER: SOWTHEAST UNIV.

Effective date: 20131023

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 210096 NANJING, JIANGSU PROVINCE TO: 226600 NANTONG, JIANGSU PROVINCE

TR01 Transfer of patent right

Effective date of registration: 20131023

Address after: 226600 No. 8 Yingbin Road, software park, Haian County, Jiangsu Province

Patentee after: Haian Su Fu Technology Transfer Center Co., Ltd.

Patentee after: Southeast University

Address before: 210096 Jiangsu city Nanjing Province four pailou No. 2

Patentee before: Southeast University

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091118

Termination date: 20190911

CF01 Termination of patent right due to non-payment of annual fee