CN108759669B  Indoor selfpositioning threedimensional scanning method and system  Google Patents
Indoor selfpositioning threedimensional scanning method and system Download PDFInfo
 Publication number
 CN108759669B CN108759669B CN201810552091.8A CN201810552091A CN108759669B CN 108759669 B CN108759669 B CN 108759669B CN 201810552091 A CN201810552091 A CN 201810552091A CN 108759669 B CN108759669 B CN 108759669B
 Authority
 CN
 China
 Prior art keywords
 coordinate
 scanning
 point
 tracking
 target
 Prior art date
 Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
 Active
Links
 238000003384 imaging method Methods 0.000 claims abstract description 38
 230000000875 corresponding Effects 0.000 claims abstract description 23
 230000004927 fusion Effects 0.000 claims abstract description 18
 239000003550 marker Substances 0.000 claims description 18
 230000001131 transforming Effects 0.000 claims description 10
 238000006243 chemical reaction Methods 0.000 claims description 8
 238000005259 measurement Methods 0.000 abstract description 8
 230000000694 effects Effects 0.000 description 9
 230000003287 optical Effects 0.000 description 2
 230000002950 deficient Effects 0.000 description 1
 238000010586 diagram Methods 0.000 description 1
 238000000034 method Methods 0.000 description 1
 230000004048 modification Effects 0.000 description 1
 238000006011 modification reaction Methods 0.000 description 1
 230000001360 synchronised Effects 0.000 description 1
 238000004642 transportation engineering Methods 0.000 description 1
 230000001960 triggered Effects 0.000 description 1
Classifications

 G—PHYSICS
 G01—MEASURING; TESTING
 G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
 G01B11/00—Measuring arrangements characterised by the use of optical means
 G01B11/002—Measuring arrangements characterised by the use of optical means for measuring two or more coordinates
Abstract
The invention relates to an indoor selfpositioning threedimensional scanning method and a system, wherein the method comprises the steps of acquiring the coordinates of a mark reflecting point on an indoor wall in a first coordinate system, and acquiring the pose information of a tracking camera and a stereo camera in a tracking scanner in a second coordinate system; acquiring the position of an imaging point of a mark reflecting point in a tracking camera, and acquiring the coordinate of a scanning point formed by a stereo camera scanning a target object in a second coordinate system; determining the coordinates of the scanning points in a first coordinate system, and fusing the scanning points in the first coordinate system; and repeating the steps until the target object is integrally scanned, obtaining the fusion result of the coordinates of different scanning points in the first coordinate system, and constructing the surface of the target object in the first coordinate system according to the fusion result corresponding to the different scanning points to generate the threedimensional model of the target object. The scanning method can avoid the sticking of mark points on the surface of an object, realize the omnibearing, highprecision, highefficiency and convenient threedimensional reconstruction, and the indoor measurement scene can be reused.
Description
Technical Field
The invention relates to the technical field of optical scanning, in particular to an indoor selfpositioning threedimensional scanning method and system.
Background
The threedimensional optical scanner can conveniently solve the highprecision measurement work of most objects with deficient surface textures, but a large number of uniformly distributed mark reflecting points must be pasted on the surface of an object to be measured for frame splicing in scanning, the process of pasting the mark points on the surface of each object to be measured is complicated, a large amount of time is spent, and the workload of scanning and measuring is increased.
Disclosure of Invention
The invention aims to solve the technical problem of providing an indoor selfpositioning threedimensional scanning method and system aiming at the defects of the prior art.
The technical scheme for solving the technical problems is as follows: an indoor selfpositioning threedimensional scanning method comprises the following steps:
step 1: acquiring coordinates of a mark reflecting point on an indoor wall in a first coordinate system, and acquiring pose information of a tracking camera and a stereo camera in a tracking scanner in a second coordinate system;
step 2: the tracking camera images the mark reflecting point to obtain the position of an imaging point of the mark reflecting point in the tracking camera, the stereo camera scans a target object, and the coordinate of a scanning point formed by the stereo camera scanning the target object in a second coordinate system is determined according to the pose information of the stereo camera in the second coordinate system;
and step 3: determining the coordinate of the scanning point in the first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system, and fusing the scanning points in the first coordinate system;
and 4, step 4: repeating the step 2 and the step 3 until the overall scanning of the target object is completed, obtaining a coordinate fusion result of different scanning points in the first coordinate system, and constructing the surface of the target object in the first coordinate system according to the coordinate fusion result of the different scanning points in the first coordinate system to generate a threedimensional model of the target object;
the first coordinate is a threedimensional coordinate system constructed by using at least four mark light reflecting points on an indoor wall, and the second coordinate is a threedimensional coordinate system constructed by using the tracking scanner as a center.
The invention has the beneficial effects that: the indoor selfpositioning threedimensional scanning method comprises the steps of respectively scanning the mark reflecting point and a target object through a tracking camera and a stereo camera of the scanner, obtaining the position of an imaging point of the mark reflecting point and the coordinate of the scanning point in a second coordinate system, determining the coordinate of the scanning point in a first coordinate system by combining the pose information of the stereo camera in the second coordinate system and the coordinate of the mark reflecting point in the first coordinate system, constructing the surface of the target object in the first coordinate system, generating a threedimensional model of the target object, avoiding pasting a large number of mark points on the surface of the object, realizing omnibearing, highprecision, highefficiency and convenient threedimensional reconstruction, and enabling an indoor measurement scene to be repeatedly used.
On the basis of the technical scheme, the invention can be further improved as follows:
further: in step 1, the acquiring pose information of the tracking camera and the stereo camera in the tracking scanner in the second coordinate system specifically includes:
and respectively calibrating a tracking camera and a stereo camera of the tracking scanner by using the coordinates of the mark reflecting points in the first coordinate system to obtain the pose information of the tracking camera and the stereo camera in the second coordinate system.
The beneficial effects of the further scheme are as follows: by calibrating the tracking camera and the stereo camera in the scanner, parameter information of the scanner, such as the length of a lens base line and internal and external parameters of the scanner, can be determined, so that the pose information of the tracking camera and the stereo camera in the scanner in the second coordinate system can be calculated according to the parameters of the scanner, and the coordinates of a scanning point formed by the stereo camera on a target object in the second coordinate system can be determined according to the pose information of the stereo camera in the second coordinate system.
Further: the step 3 specifically includes:
step 31: determining the coordinate of the scanning point in the first coordinate system according to the pose information of a tracking camera in the tracking scanner in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera of the tracking scanner, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system;
step 32: gridding the threedimensional space where the first coordinate system is located, so that the scanning points on the target object fall into corresponding grids;
step 33: and fusing the scanning points of the first coordinate system, and calculating the approximate directed distance from the central point of each grid to the nearest scanning point on the surface of the object according to the coordinates of the scanning points in the first coordinate system.
The beneficial effects of the further scheme are as follows: the coordinate of the scanning point in the first coordinate system can be accurately calculated through the pose information of the tracking camera in the second coordinate system, the imaging point position of the marker reflecting point in the tracking camera and the coordinate of the marker reflecting point in the first coordinate system, so that the surface of the target object can be conveniently constructed according to the fusion result of the coordinate of the scanning point in the first coordinate system, a threedimensional model of the target object is generated, and an accurate scanning result is obtained.
Further: the step 31 specifically includes:
step 311: determining pose information of a tracking camera in a tracking scanner in a first coordinate system by using a back intersection algorithm according to the coordinates of the mark reflecting points in the first coordinate system and the positions of imaging points of the mark reflecting points in the tracking camera of the tracking scanner;
step 312: determining a coordinate transformation relation between a first coordinate system and a second coordinate system according to the pose information of a tracking camera in the tracking scanner in the first coordinate system and the pose information of a tracking camera in the tracking scanner in the second coordinate system;
step 313: and converting the coordinate of the scanning point in the second coordinate system into the first coordinate system according to the coordinate conversion relation to obtain the coordinate of the scanning point in the first coordinate system.
The beneficial effects of the further scheme are as follows: the position and posture information of the tracking camera in the first coordinate system can be accurately calculated through the coordinates of the mark reflecting points in the first coordinate system and the positions of the imaging points of the mark reflecting points in the tracking camera, and then the coordinate transformation relation between the first coordinate system and the second coordinate system can be determined according to the position and posture information of the tracking camera in the first coordinate system and the position and posture information of the tracking camera in the second coordinate system, so that the coordinates of the scanning points in the first coordinate system can be accurately determined, and accurate scanning results can be conveniently obtained according to the coordinates of the scanning points in the first coordinate system.
Further: in step 4, the constructing the surface of the target object in the first coordinate system and generating the threedimensional model of the target object specifically includes:
step 41: constructing the subsurface of the target object in the corresponding grid according to the approximate directed distance from the central point of the different grids to the nearest scanning point on the surface of the object;
step 42: and generating a target object surface according to the target object subsurfaces corresponding to all the grids, and generating a target object threedimensional model.
The beneficial effects of the further scheme are as follows: through the approximate directed distance, the surface area corresponding to the target object can be constructed in each grid, so that a threedimensional model of the target object can be finally created, an accurate scanning result is formed, and the method is rapid, efficient and wide in application range.
The invention also provides an indoor selfpositioning threedimensional scanning system, which comprises a photogrammetric component, a tracking scanner and a main controller;
the photogrammetric component is used for acquiring the coordinates of the mark reflecting points on the indoor wall in the first coordinate system;
the tracking scanner comprises a tracking camera and two stereo cameras, wherein the tracking camera is used for scanning the mark reflecting point to obtain the position of an imaging point of the mark reflecting point in the tracking camera, and the stereo cameras are used for scanning a target object;
the main controller is used for acquiring pose information of a tracking camera in a scanner and pose information of a stereo camera in a second coordinate system, determining coordinates of a scanning point formed by the stereo camera scanning the target object in the second coordinate system according to the pose information of the stereo camera in the second coordinate system, determining coordinates of the scanning point in a first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the marker reflecting point in the tracking camera of the tracking scanner, the coordinates of the marker reflecting point in the first coordinate system and the coordinates of the scanning point in the second coordinate system in the scanner, fusing the scanning points in the first coordinate system, repeating the steps until the target object is integrally scanned, obtaining the fusion result of the coordinates of different scanning points in the first coordinate system, and constructing the surface of the target object in the first coordinate system according to the coordinate fusion result of the different scanning points in the first coordinate system, generating a threedimensional model of the target object;
the first coordinate is a threedimensional coordinate system constructed by using at least four mark light reflecting points on an indoor wall, and the second coordinate is a threedimensional coordinate system constructed by using the tracking scanner as a center.
According to the indoor selfpositioning threedimensional scanning system, the mark reflecting point and the target object are respectively scanned by the tracking camera and the stereo camera of the scanner, the position of the imaging point of the mark reflecting point and the coordinate of the scanning point in the second coordinate system are obtained, and the coordinate of the scanning point in the first coordinate system is determined by combining the pose information of the stereo camera in the second coordinate system and the coordinate of the mark reflecting point in the first coordinate system, so that the surface of the target object is constructed in the first coordinate system, a threedimensional model of the target object is generated, a large number of mark points can be prevented from being pasted on the surface of the object, omnibearing, highprecision, highefficiency and convenient threedimensional reconstruction is realized, and an indoor measurement scene can be repeatedly used.
On the basis of the technical scheme, the invention can be further improved as follows:
further: the method for acquiring the pose information of the tracking camera and the stereo camera in the second coordinate system in the tracking scanner by the main controller specifically comprises the following steps:
and respectively calibrating a tracking camera and a stereo camera of the tracking scanner by using the coordinates of the mark reflecting points in the first coordinate system to obtain the pose information of the tracking camera and the stereo camera in the second coordinate system.
The beneficial effects of the further scheme are as follows: by calibrating the tracking camera and the stereo camera in the scanner, parameter information of the scanner, such as a lens baseline length and internal and external parameters of the scanner, can be determined, so that pose information of the tracking camera and the stereo camera in the scanner in the second coordinate system can be obtained according to the parameters of the scanner, the coordinates of a scanning point formed by the stereo camera on a target object in the second coordinate system can be determined subsequently according to the pose information of the stereo camera in the second coordinate system, a conversion relation between the first coordinate system and the second coordinate system can be calculated according to the pose information of the tracking camera in the first coordinate system, and the coordinates of the scanning point in the first coordinate system can be determined by combining the coordinates of the scanning point in the second coordinate system.
Further: the master controller is specifically configured to:
determining the coordinate of the scanning point in the first coordinate system according to the pose information of a tracking camera in the tracking scanner in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera of the tracking scanner, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system;
gridding the threedimensional space where the first coordinate system is located, so that the scanning points on the target object fall into corresponding grids;
and fusing the scanning points of the first coordinate system, and calculating the approximate directed distance from the central point of each grid to the nearest scanning point on the surface of the object.
The beneficial effects of the further scheme are as follows: the coordinate of the scanning point in the first coordinate system can be accurately calculated through the pose information of the tracking camera in the second coordinate system, the imaging point position of the marker reflecting point in the tracking camera and the coordinate of the marker reflecting point in the first coordinate system, so that the surface of the target object can be conveniently constructed according to the fusion result of the coordinate of the scanning point in the first coordinate system, a threedimensional model of the target object is generated, and an accurate scanning result is obtained.
Further: the main controller determines the coordinates of the scanning point in the first coordinate system to be specifically realized as follows:
determining pose information of a tracking camera in a tracking scanner in a first coordinate system by using a back intersection algorithm according to the coordinates of the mark reflecting points in the first coordinate system and the positions of imaging points of the mark reflecting points in the tracking camera of the tracking scanner;
determining a coordinate transformation relation between a first coordinate system and a second coordinate system according to the pose information of a tracking camera in the tracking scanner in the first coordinate system and the pose information of a tracking camera in the tracking scanner in the second coordinate system;
and converting the coordinate of the scanning point in the second coordinate system into the first coordinate system according to the coordinate conversion relation to obtain the coordinate of the scanning point in the first coordinate system.
The beneficial effects of the further scheme are as follows: the position and posture information of the tracking camera in the first coordinate system can be accurately calculated through the coordinates of the mark reflecting points in the first coordinate system and the positions of the imaging points of the mark reflecting points in the tracking camera, and then the coordinate transformation relation between the first coordinate system and the second coordinate system can be determined according to the position and posture information of the tracking camera in the first coordinate system and the position and posture information of the tracking camera in the second coordinate system, so that the coordinates of the scanning points in the first coordinate system can be accurately determined, and accurate scanning results can be conveniently obtained according to the coordinates of the scanning points in the first coordinate system.
Further: the method for constructing the surface of the target object in the first coordinate system and generating the threedimensional model of the target object is specifically realized as follows:
constructing the subsurface of the target object in the corresponding grid according to the approximate directed distance from the central point of the different grids to the nearest scanning point on the surface of the object;
and generating a target object surface according to the target object subsurfaces corresponding to all the grids, and generating a target object threedimensional model.
The beneficial effects of the further scheme are as follows: through the approximate directed distance, the surface area corresponding to the target object can be constructed in each grid, so that a threedimensional model of the target object can be finally created, an accurate scanning result is formed, and the method is rapid, efficient and wide in application range.
Drawings
FIG. 1 is a schematic flow chart of an indoor selfpositioning threedimensional scanning method according to the present invention;
fig. 2 is a schematic structural diagram of an indoor selfpositioning threedimensional scanning system according to the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, an indoor selfpositioning threedimensional scanning method includes the following steps:
step 1: acquiring coordinates of a mark reflecting point on an indoor wall in a first coordinate system, and acquiring pose information of a tracking camera and a stereo camera in a tracking scanner in a second coordinate system;
step 2: the tracking camera images the mark reflecting point to obtain the position of an imaging point of the mark reflecting point in the tracking camera, the stereo camera scans a target object, and the coordinate of a scanning point formed by the stereo camera scanning the target object in a second coordinate system is determined according to the pose information of the stereo camera in the second coordinate system;
and step 3: determining the coordinate of the scanning point in the first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system, and fusing the scanning points in the first coordinate system;
and 4, step 4: repeating the step 2 and the step 3 until the overall scanning of the target object is completed, obtaining a coordinate fusion result of different scanning points in the first coordinate system, and constructing the surface of the target object in the first coordinate system according to the coordinate fusion result of the different scanning points in the first coordinate system to generate a threedimensional model of the target object;
the first coordinate is a threedimensional coordinate system constructed by using at least four mark light reflecting points on an indoor wall, and the second coordinate is a threedimensional coordinate system constructed by using the tracking scanner as a center.
According to the indoor selfpositioning threedimensional scanning method provided by the embodiment of the invention, the mark reflecting point and the target object are respectively scanned by the tracking camera and the stereo camera of the scanner, the position of the imaging point of the mark reflecting point and the coordinate of the scanning point in the second coordinate system are obtained, and the coordinate of the scanning point in the first coordinate system is further determined by combining the pose information of the stereo camera in the second coordinate system and the coordinate of the mark reflecting point in the first coordinate system, so that the surface of the target object is constructed in the first coordinate system, a threedimensional model of the target object is generated, a large number of mark points can be prevented from being pasted on the surface of the object, the omnibearing, highprecision, highefficiency and convenient threedimensional reconstruction is realized, and the indoor measurement scene can be repeatedly used.
Compared with the prior art that complicated operations such as sticking a plurality of mark reflecting points on the surface of a target object are carried out, the method and the device do not need to stick the mark reflecting points on the surface of the target object, can realize omnibearing, efficient and highprecision scanning of the target object by means of the mark reflecting points arranged on the wall in an indoor scene and a photogrammetric component, and can repeatedly use the indoor scene.
In an embodiment of the present invention, in step 1, the acquiring pose information of the tracking camera and the stereo camera in the tracking scanner in the second coordinate system specifically includes:
and respectively calibrating a tracking camera and a stereo camera of the tracking scanner by using the coordinates of the mark reflecting points in the first coordinate system to obtain the pose information of the tracking camera and the stereo camera in the second coordinate system.
In the above embodiment, by calibrating the tracking camera and the stereo camera in the scanner, parameter information of the scanner, such as a lens baseline length and internal and external parameters of the scanner, can be determined, so that pose information of the tracking camera and the stereo camera in the scanner in the second coordinate system can be obtained according to the parameters of the scanner, and it is convenient to subsequently determine coordinates of a scanning point formed by the stereo camera on the target object in the second coordinate system according to the pose information of the stereo camera in the second coordinate system.
Compared with the prior art that repeated calibration is needed due to movement, transportation or touch when the scanner is used, the scanner is calibrated once in the application, the pose information of the tracking camera and the stereo camera in the tracking scanner in the second coordinate system is determined, and the tracking camera and the stereo camera in the tracking scanner are not needed to be repeatedly calibrated subsequently, so that the workload of scanning measurement is greatly reduced, and the scanning measurement efficiency is improved.
In an embodiment of the present invention, step 3 specifically includes:
step 31: determining the coordinate of the scanning point in the first coordinate system according to the pose information of a tracking camera in the tracking scanner in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera of the tracking scanner, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system;
step 32: gridding the threedimensional space where the first coordinate system is located, so that the scanning points on the target object fall into corresponding grids;
step 33: and fusing the scanning points of the first coordinate system, and calculating the approximate directed distance from the central point of each grid to the nearest scanning point on the surface of the object according to the coordinates of the scanning points in the first coordinate system.
In the above embodiment, the coordinates of the scanning point in the first coordinate system can be accurately calculated through the pose information of the tracking camera in the second coordinate system, the imaging point position of the marker reflecting point in the tracking camera, and the coordinates of the marker reflecting point in the first coordinate system, so that the surface of the target object can be conveniently constructed according to the fusion result of the coordinates of the scanning point in the first coordinate system, the threedimensional model of the target object can be generated, and the accurate scanning result can be obtained.
Preferably, the step 31 specifically includes:
step 311: determining pose information of a tracking camera in a tracking scanner in a first coordinate system by using a back intersection algorithm according to the coordinates of the mark reflecting points in the first coordinate system and the positions of imaging points of the mark reflecting points in the tracking camera of the tracking scanner;
step 312: determining a coordinate transformation relation between a first coordinate system and a second coordinate system according to the pose information of a tracking camera in the tracking scanner in the first coordinate system and the pose information of a tracking camera in the tracking scanner in the second coordinate system;
step 313: and converting the coordinate of the scanning point in the second coordinate system into the first coordinate system according to the coordinate conversion relation to obtain the coordinate of the scanning point in the first coordinate system.
In the above embodiment, the position and posture information of the tracking camera in the first coordinate system can be accurately calculated through the coordinates of the marker reflecting point in the first coordinate system and the position of the imaging point of the marker reflecting point in the tracking camera, and then the coordinate transformation relationship between the first coordinate system and the second coordinate system can be determined according to the position and posture information of the tracking camera in the first coordinate system and the position and posture information of the tracking camera in the second coordinate system, so that the coordinates of the scanning point in the first coordinate system can be accurately determined, and an accurate scanning result can be obtained according to the coordinates of the scanning point in the first coordinate system.
In an embodiment of the present invention, in step 4, the constructing a surface of the target object in the first coordinate system, and generating a threedimensional model of the target object specifically includes:
step 41: constructing the subsurface of the target object in the corresponding grid according to the approximate directed distance from the central point of the different grids to the nearest scanning point on the surface of the object;
step 42: and generating a target object surface according to the target object subsurfaces corresponding to all the grids, and generating a target object threedimensional model.
In the above embodiment, through the approximate directional distance, the surface area corresponding to the target object may be constructed in each grid, so that a threedimensional model of the target object may be finally created, an accurate scanning result is formed, and the method is fast and efficient, and has a wide application range.
In practice, the space of the first coordinate system may be divided into 0.5mm by 0.5mm grids, when a frame of data scanned by the tracking camera falls into a certain grid, a plurality of multisegment lines are present in a frame of data, assuming that the points of one multisegment line are deconstructed into { p1, p2, …, pn }, each multisegment line may calculate the tangent lines of other points except the multisegment line points, for each line segment t, calculating the tangent lines of the end points at both ends of each line segment in the multisegment line, assuming ti and tj,
obtaining tangents to points on the polyline other than the endpoints:
and determining the influence range of each line segment, and solving the approximate directed distance of the scanning points in the influence range. This method is prior art and will not be described herein.
As shown in fig. 2, the present invention further provides an indoor selfpositioning threedimensional scanning system, which comprises a photogrammetric component, a tracking scanner and a main controller;
the photogrammetric component is used for acquiring the coordinates of the mark reflecting points on the indoor wall in the first coordinate system;
the tracking scanner comprises a tracking camera and two stereo cameras, wherein the tracking camera is used for scanning the mark reflecting point to obtain the position of an imaging point of the mark reflecting point in the tracking camera, and the stereo cameras are used for scanning a target object;
the main controller is used for acquiring pose information of a tracking camera in a scanner and pose information of a stereo camera in a second coordinate system, determining coordinates of a scanning point formed by the stereo camera scanning the target object in the second coordinate system according to the pose information of the stereo camera in the second coordinate system, determining coordinates of the scanning point in a first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the marker reflecting point in the tracking camera of the tracking scanner, the coordinates of the marker reflecting point in the first coordinate system and the coordinates of the scanning point in the second coordinate system in the scanner, fusing the scanning points in the first coordinate system, repeating the steps until the target object is integrally scanned, obtaining the fusion result of the coordinates of different scanning points in the first coordinate system, and constructing the surface of the target object in the first coordinate system according to the coordinate fusion result of the different scanning points in the first coordinate system, generating a threedimensional model of the target object;
the first coordinate is a threedimensional coordinate system constructed by using at least four mark light reflecting points on an indoor wall, and the second coordinate is a threedimensional coordinate system constructed by using the tracking scanner as a center.
It should be noted that, in the present invention, the tracking scanner includes a tracking camera, a stereo camera, a scanner (including but not limited to a laser projector or a threeclass projector), a tripod and a cross bar, the middle of the cross bar is movably connected to the top end of the tripod, two stereo cameras are respectively disposed at two ends of the cross bar, the center of the entire tracking scanner can be selected as the central point of the cross bar, the tracking camera and the projector are disposed at the middle of the cross bar, the stereo camera is disposed toward a wall during calibration, a plurality of (at least four) mark lightreflecting points are disposed on the wall, after calibration is completed, the stereo camera is disposed toward a target object and scans the target object, the tracking camera faces the mark lightreflecting points on the wall and images the mark lightreflecting points, and the projector is disposed toward the target object.
The photogrammetric subassembly includes camera, sign reflection of light point and scale on the wall etc. through shooing reference mark point then calculate the coordinate of sign reflection of light point at first coordinate system on the wall, and specific algorithm is prior art, and it is no longer repeated here.
According to the indoor selfpositioning threedimensional scanning system provided by the embodiment of the invention, the mark reflecting point and the target object are respectively scanned by the tracking camera and the stereo camera of the scanner, the position of the imaging point of the mark reflecting point and the coordinate of the scanning point in the second coordinate system are obtained, and the coordinate of the scanning point in the first coordinate system is further determined by combining the pose information of the stereo camera in the second coordinate system and the coordinate of the mark reflecting point in the first coordinate system, so that the surface of the target object is constructed in the first coordinate system, a threedimensional model of the target object is generated, a large number of mark points can be prevented from being pasted on the surface of the object, the omnibearing, highprecision, highefficiency and convenient threedimensional reconstruction is realized, and the indoor measurement scene can be repeatedly used.
In the above embodiment, the acquiring, by the master controller, pose information of the tracking camera and the stereo camera in the tracking scanner in the second coordinate system specifically includes:
and respectively calibrating a tracking camera and a stereo camera of the tracking scanner by using the coordinates of the mark reflecting points in the first coordinate system to obtain the pose information of the tracking camera and the stereo camera in the second coordinate system.
In the above embodiment, by calibrating the tracking camera and the stereo camera in the scanner, parameter information of the scanner, such as a lens baseline length and inside and outside parameters of the scanner, can be determined, so that pose information of the tracking camera and the stereo camera in the scanner in the second coordinate system can be obtained according to the parameters of the scanner, and it is convenient to subsequently determine coordinates of a scanning point formed by the stereo camera on the target object in the second coordinate system according to the pose information of the stereo camera in the second coordinate system, calculate a conversion relationship between the first coordinate system and the second coordinate system according to the pose information of the tracking camera in the first coordinate system, and determine the coordinates of the scanning point in the first coordinate system by combining the coordinates of the scanning point in the second coordinate system.
In practice, a plurality of wall photos are shot through the tracking camera, when data are collected, the reflecting points of the wall marks are clearly imaged in the tracking camera and the two stereo cameras, the projection of the imaging points is basically unchanged and is opposite (the contact ratio is more than 90%), and the relative pose information of the tracking camera and the two stereo cameras in a second coordinate system is obtained through camera calibration.
Specifically, after scanning is started, the tracking camera in the tracking scanner obtains the pose information of the tracking camera in the second coordinate system through back intersection, and since the relative pose information of the three cameras of the tracking scanner is obtained through the calibration, after the position and the posture of the tracking camera in the second coordinate system are obtained, the pose information of the other two stereo cameras in the tracking scanner in the second coordinate system can be obtained. The pose information may be used to position the spatial position pose of the stereo camera.
When the scanning instrument is used for scanning after the pose information of the stereo camera in the second coordinate system is obtained, firstly, the scanner is triggered to project patterns, then the stereo camera is used for obtaining the patterns at certain intervals (for example, 2 milliseconds), meanwhile, the tracking camera images the reflecting points of the wall surface markers, and the stereo camera and the tracking camera are controlled to be synchronous through hard triggering on hardware (data are collected at the same time).
In an embodiment of the present invention, the main controller is specifically configured to:
determining the coordinate of the scanning point in the first coordinate system according to the pose information of a tracking camera in the tracking scanner in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera of the tracking scanner, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system;
gridding the threedimensional space where the first coordinate system is located, so that the scanning points on the target object fall into corresponding grids;
and fusing the scanning points of the first coordinate system, and calculating the approximate directed distance from the central point of each grid to the nearest scanning point on the surface of the object.
In the above embodiment, the coordinates of the scanning point in the first coordinate system can be accurately calculated through the pose information of the tracking camera in the second coordinate system, the imaging point position of the marker reflecting point in the tracking camera, and the coordinates of the marker reflecting point in the first coordinate system, so that the surface of the target object can be conveniently constructed according to the fusion result of the coordinates of the scanning point in the first coordinate system, the threedimensional model of the target object can be generated, and the accurate scanning result can be obtained.
In the embodiment of the present invention, the determining, by the master controller, the coordinates of the scanning point in the first coordinate system is specifically implemented as:
determining pose information of a tracking camera in a tracking scanner in a first coordinate system by using a back intersection algorithm according to the coordinates of the mark reflecting points in the first coordinate system and the positions of imaging points of the mark reflecting points in the tracking camera of the tracking scanner;
determining a coordinate transformation relation between a first coordinate system and a second coordinate system according to the pose information of a tracking camera in the tracking scanner in the first coordinate system and the pose information of a tracking camera in the tracking scanner in the second coordinate system;
and converting the coordinate of the scanning point in the second coordinate system into the first coordinate system according to the coordinate conversion relation to obtain the coordinate of the scanning point in the first coordinate system.
In the above embodiment, the position and posture information of the tracking camera in the first coordinate system can be accurately calculated through the coordinates of the marker reflecting point in the first coordinate system and the position of the imaging point of the marker reflecting point in the tracking camera, and then the coordinate transformation relationship between the first coordinate system and the second coordinate system can be determined according to the position and posture information of the tracking camera in the first coordinate system and the position and posture information of the tracking camera in the second coordinate system, so that the coordinates of the scanning point in the first coordinate system can be accurately determined, and an accurate scanning result can be obtained according to the coordinates of the scanning point in the first coordinate system.
In the embodiment of the present invention, the constructing the surface of the target object in the first coordinate system and the generating the threedimensional model of the target object are specifically implemented as follows:
constructing the subsurface of the target object in the corresponding grid according to the approximate directed distance from the central point of the different grids to the nearest scanning point on the surface of the object;
and generating a target object surface according to the target object subsurfaces corresponding to all the grids, and generating a target object threedimensional model.
In the above embodiment, through the approximate directional distance, the surface area corresponding to the target object may be constructed in each grid, so that a threedimensional model of the target object may be finally created, an accurate scanning result is formed, and the method is fast and efficient, and has a wide application range.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (10)
1. An indoor selfpositioning threedimensional scanning method is characterized by comprising the following steps:
step 1: acquiring coordinates of a mark reflecting point on an indoor wall in a first coordinate system, and acquiring pose information of a tracking camera and a stereo camera in a tracking scanner in a second coordinate system;
step 2: the tracking camera images the mark reflecting point to obtain the position of an imaging point of the mark reflecting point in the tracking camera, the stereo camera scans a target object, and the coordinate of a scanning point formed by the stereo camera scanning the target object in a second coordinate system is determined according to the pose information of the stereo camera in the second coordinate system;
and step 3: determining the coordinate of the scanning point in the first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system, and fusing the scanning points in the first coordinate system;
and 4, step 4: repeating the step 2 and the step 3 until the overall scanning of the target object is completed, obtaining a coordinate fusion result of different scanning points in the first coordinate system, and constructing the surface of the target object in the first coordinate system according to the coordinate fusion result of the different scanning points in the first coordinate system to generate a threedimensional model of the target object;
the first coordinate is a threedimensional coordinate system constructed by using at least four mark light reflecting points on an indoor wall, and the second coordinate is a threedimensional coordinate system constructed by using the tracking scanner as a center.
2. The indoor selfpositioning threedimensional scanning method according to claim 1, wherein in the step 1, the acquiring pose information of the tracking camera and the stereo camera in the tracking scanner in the second coordinate system specifically comprises:
and respectively calibrating a tracking camera and a stereo camera of the tracking scanner by using the coordinates of the mark reflecting points in the first coordinate system to obtain the pose information of the tracking camera and the stereo camera in the second coordinate system.
3. The indoor selfpositioning threedimensional scanning method according to claim 1, characterized in that: the step 3 specifically includes:
step 31: determining the coordinate of the scanning point in the first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system;
step 32: gridding the threedimensional space where the first coordinate system is located, so that the scanning points on the target object fall into corresponding grids;
step 33: and fusing the scanning points of the first coordinate system, and calculating the approximate directed distance from the central point of each grid to the nearest scanning point on the surface of the object according to the coordinates of the scanning points in the first coordinate system.
4. The indoor selfpositioning threedimensional scanning method according to claim 3, characterized in that: the step 31 specifically includes:
step 311: determining the pose information of the tracking camera in the first coordinate system by using a back intersection algorithm according to the coordinates of the mark reflecting points in the first coordinate system and the positions of the imaging points of the mark reflecting points in the tracking camera;
step 312: determining a coordinate transformation relation between a first coordinate system and a second coordinate system according to the pose information of the tracking camera in the first coordinate system and the pose information of the tracking camera in the second coordinate system;
step 313: and converting the coordinate of the scanning point in the second coordinate system into the first coordinate system according to the coordinate conversion relation to obtain the coordinate of the scanning point in the first coordinate system.
5. The indoor selfpositioning threedimensional scanning method according to claim 3, characterized in that: in step 4, the constructing the surface of the target object in the first coordinate system and generating the threedimensional model of the target object specifically includes:
step 41: constructing the subsurface of the target object in the corresponding grid according to the approximate directed distance from the central point of the different grids to the nearest scanning point on the surface of the object;
step 42: and generating a target object surface according to the target object subsurfaces corresponding to all the grids, and generating a target object threedimensional model.
6. An indoor selfalign threedimensional scanning system which characterized in that: the device comprises a photogrammetric component, a tracking scanner and a main controller;
the photogrammetric component is used for acquiring the coordinates of the mark reflecting points on the indoor wall in the first coordinate system;
the tracking scanner comprises a tracking camera and a stereo camera, wherein the tracking camera is used for scanning the mark reflecting point to obtain the position of an imaging point of the mark reflecting point in the tracking camera, and the stereo camera is used for scanning a target object;
the main controller is used for acquiring pose information of a tracking camera in a tracking scanner and pose information of a stereo camera in a second coordinate system, determining coordinates of a scanning point formed by the stereo camera scanning the target object in the second coordinate system according to the pose information of the stereo camera in the second coordinate system, determining coordinates of the scanning point in a first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the marker reflecting point in the tracking camera of the tracking scanner, the coordinates of the marker reflecting point in the first coordinate system and the coordinates of the scanning point in the second coordinate system in the scanner, fusing the scanning points in the first coordinate system, repeating the steps until the target object is integrally scanned, obtaining the fusion result of the coordinates of different scanning points in the first coordinate system, and constructing the surface of the target object in the first coordinate system according to the coordinate fusion result of the different scanning points in the first coordinate system, generating a threedimensional model of the target object;
the first coordinate is a threedimensional coordinate system constructed by using at least four mark light reflecting points on an indoor wall, and the second coordinate is a threedimensional coordinate system constructed by using the tracking scanner as a center.
7. The indoor selfpositioning threedimensional scanning system of claim 6, wherein: the specific implementation of the main controller for acquiring the coordinates of the tracking camera and the stereo camera in the second coordinate system in the tracking scanner is as follows:
and respectively calibrating a tracking camera and a stereo camera of the tracking scanner by using the coordinates of the mark reflecting points in the first coordinate system to obtain the pose information of the tracking camera and the stereo camera in the second coordinate system.
8. The indoor selfpositioning threedimensional scanning system of claim 6, wherein: the master controller is specifically configured to:
determining the coordinate of the scanning point in the first coordinate system according to the pose information of the tracking camera in the second coordinate system, the imaging point position of the mark reflecting point in the tracking camera, the coordinate of the mark reflecting point in the first coordinate system and the coordinate of the scanning point in the second coordinate system;
gridding the threedimensional space where the first coordinate system is located, so that the scanning points on the target object fall into corresponding grids;
and fusing the scanning points of the first coordinate system, and calculating the approximate directed distance from the central point of each grid to the nearest scanning point on the surface of the object.
9. The indoor selfpositioning threedimensional scanning system of claim 8, wherein: the main controller determines the coordinates of the scanning point in the first coordinate system to be specifically realized as follows:
determining the pose information of the tracking camera in the first coordinate system by using a back intersection algorithm according to the coordinates of the mark reflecting points in the first coordinate system and the positions of the imaging points of the mark reflecting points in the tracking camera;
determining a coordinate transformation relation between a first coordinate system and a second coordinate system according to the pose information of the tracking camera in the first coordinate system and the pose information of the tracking camera in the second coordinate system;
and converting the coordinate of the scanning point in the second coordinate system into the first coordinate system according to the coordinate conversion relation to obtain the coordinate of the scanning point in the first coordinate system.
10. The indoor selfpositioning threedimensional scanning system of claim 8, wherein: the method for constructing the surface of the target object in the first coordinate system and generating the threedimensional model of the target object is specifically realized as follows:
constructing the subsurface of the target object in the corresponding grid according to the approximate directed distance from the central point of the different grids to the nearest scanning point on the surface of the object;
and generating a target object surface according to the target object subsurfaces corresponding to all the grids, and generating a target object threedimensional model.
Priority Applications (1)
Application Number  Priority Date  Filing Date  Title 

CN201810552091.8A CN108759669B (en)  20180531  20180531  Indoor selfpositioning threedimensional scanning method and system 
Applications Claiming Priority (1)
Application Number  Priority Date  Filing Date  Title 

CN201810552091.8A CN108759669B (en)  20180531  20180531  Indoor selfpositioning threedimensional scanning method and system 
Publications (2)
Publication Number  Publication Date 

CN108759669A CN108759669A (en)  20181106 
CN108759669B true CN108759669B (en)  20200721 
Family
ID=64001472
Family Applications (1)
Application Number  Title  Priority Date  Filing Date 

CN201810552091.8A Active CN108759669B (en)  20180531  20180531  Indoor selfpositioning threedimensional scanning method and system 
Country Status (1)
Country  Link 

CN (1)  CN108759669B (en) 
Families Citing this family (4)
Publication number  Priority date  Publication date  Assignee  Title 

CN110030943A (en) *  20190321  20190719  中铁二十二局集团有限公司  A kind of Free Station mode specifies the scan method of particular range 
CN111879235A (en) *  20200622  20201103  杭州思看科技有限公司  Threedimensional scanning detection method and system for bent pipe and computer equipment 
CN112833816A (en) *  20201231  20210525  武汉中观自动化科技有限公司  Positioning method and system with mixed landmark positioning and intelligent reverse positioning 
CN113409406A (en) *  20210819  20210917  武汉中观自动化科技有限公司  Largerange monocular tracking scanning device 
Citations (4)
Publication number  Priority date  Publication date  Assignee  Title 

CN104457569A (en) *  20141127  20150325  大连理工大学  Geometric parameter visual measurement method for large composite board 
CN106373118A (en) *  20160830  20170201  华中科技大学  A complex curved surface part point cloud reduction method capable of effectively keeping boundary and local features 
CN107067469A (en) *  20161227  20170818  中国人民解放军装甲兵工程学院  The system for obtaining injuring part defect model 
CN108072327A (en) *  20171231  20180525  浙江维思无线网络技术有限公司  A kind of measuring method and device using control point 

2018
 20180531 CN CN201810552091.8A patent/CN108759669B/en active Active
Patent Citations (4)
Publication number  Priority date  Publication date  Assignee  Title 

CN104457569A (en) *  20141127  20150325  大连理工大学  Geometric parameter visual measurement method for large composite board 
CN106373118A (en) *  20160830  20170201  华中科技大学  A complex curved surface part point cloud reduction method capable of effectively keeping boundary and local features 
CN107067469A (en) *  20161227  20170818  中国人民解放军装甲兵工程学院  The system for obtaining injuring part defect model 
CN108072327A (en) *  20171231  20180525  浙江维思无线网络技术有限公司  A kind of measuring method and device using control point 
Also Published As
Publication number  Publication date 

CN108759669A (en)  20181106 
Similar Documents
Publication  Publication Date  Title 

CN108759669B (en)  Indoor selfpositioning threedimensional scanning method and system  
JP4290733B2 (en)  Threedimensional shape measuring method and apparatus  
CN101603812B (en)  Ultrahigh speed realtime threedimensional measuring device and method  
JP5132832B1 (en)  Measuring apparatus and information processing apparatus  
EP2568253B1 (en)  Structuredlight measuring method and system  
CN104913737A (en)  Component quality checking device based on line laser threedimensional measurement and detection method of device  
JP2016516196A (en)  Structured optical scanner correction tracked in 6 degrees of freedom  
CN105066909A (en)  Handheld multilaserstripe quick threedimensional measuring method  
WO2004044522A1 (en)  Threedimensional shape measuring method and its device  
CN108759668B (en)  Tracking type threedimensional scanning method and system in vibration environment  
CN101901501B (en)  Method for generating laser color cloud picture  
CN104007444A (en)  Ground laser radar reflection intensity image generation method based on central projection  
JP6612740B2 (en)  Modeling arrangement and method and system for modeling 3D surface topography  
CN105115560B (en)  A kind of noncontact measurement method of cabin volume of compartment  
CN101504275A (en)  Handhold line laser threedimensional measuring system based on spacing wireless location  
CN108692656B (en)  Laser scanning data acquisition method and device  
CN104976968A (en)  Threedimensional geometrical measurement method and threedimensional geometrical measurement system based on LED tag tracking  
CN107860337B (en)  Structured light threedimensional reconstruction method and device based on array camera  
CN105444729B (en)  Optical remote measurement method  
JP2623367B2 (en)  Calibration method of threedimensional shape measuring device  
JP2005106491A (en)  System for measuring threedimensional shape of head part  
CN102155937B (en)  Method for measuring flexible netty surface shape by shooting  
JP2013178174A (en)  Threedimensional shape measuring apparatus using a plurality of gratings  
CN209820423U (en)  Auxiliary target screen device for rapid calibration of laser plane space equation  
CN208061260U (en)  A kind of linescan digital camera caliberating device for stereovisiuon measurement 
Legal Events
Date  Code  Title  Description 

PB01  Publication  
PB01  Publication  
SE01  Entry into force of request for substantive examination  
SE01  Entry into force of request for substantive examination  
GR01  Patent grant  
GR01  Patent grant 