WO2018201677A1 - 基于光束平差的远心镜头三维成像系统的标定方法及装置 - Google Patents
基于光束平差的远心镜头三维成像系统的标定方法及装置 Download PDFInfo
- Publication number
- WO2018201677A1 WO2018201677A1 PCT/CN2017/107274 CN2017107274W WO2018201677A1 WO 2018201677 A1 WO2018201677 A1 WO 2018201677A1 CN 2017107274 W CN2017107274 W CN 2017107274W WO 2018201677 A1 WO2018201677 A1 WO 2018201677A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target
- parameter
- projection device
- calibration
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T7/85—Stereo camera calibration
Definitions
- the invention relates to the field of three-dimensional imaging and optical three-dimensional reconstruction, in particular to a calibration method and device for a telecentric lens three-dimensional imaging system based on beam adjustment.
- Three-dimensional imaging based on phase fringe coding is simple, fast in calculation and high in measurement accuracy, and is widely used in three-dimensional imaging and measurement of objects.
- the image containing the sinusoidal fringes is projected onto the object to be tested by the projection device, and the shape of the surface of the object causes the projected structured light image to be differently modulated, and the structured light image with the modulated information is acquired by the camera, combined with the mediation method and stereoscopic vision.
- the technology can obtain three-dimensional digital topography data of an object.
- the main object of the present invention is to provide a calibration method and apparatus for a telecentric lens three-dimensional imaging system based on beam adjustment, which aims to solve the technical problem of low precision of the three-dimensional imaging system in the prior art.
- a first aspect of the present invention provides a calibration method for a telecentric lens three-dimensional imaging system based on beam adjustment, the method being applied to a three-dimensional imaging system, the three-dimensional imaging system comprising: a telecentric lens Projection device, camera device having a telecentric lens, and a movable platform; the optical axis of the projection device is perpendicular to the movable platform placed horizontally, and the optical axis of the imaging device is preset with the movable platform An angle on which the target is placed on the movable platform, the movable platform
- the calibration method includes:
- Step 1 Move the movable platform such that the target is in a plurality of different target postures, and in each target posture, project the target with uniform light, and collect the image through the imaging device. Delineating a target image under the target attitude, and projecting the fringe pattern to the target by using the projection device, and acquiring a fringe pattern under the target posture by using the imaging device;
- Step 2 Initializing an internal parameter and an external parameter of the imaging device to obtain an internal reference and an external parameter after initializing the parameter of the imaging device, and using a target image and a plurality of target postures under different target postures according to the beam adjustment method Performing joint nonlinear optimization on the three-dimensional coordinate system parameter of the target and the initialized internal and external parameters to obtain calibration parameters of the imaging device to complete calibration of the imaging device;
- Step 3 De-phase and phase-expand the fringe pattern acquired by a plurality of different target poses by using the N-step phase shift method to obtain a phase unwrapping diagram of a plurality of different target poses;
- Step 4 Initializing an internal parameter and an external parameter of the projection device to obtain an internal parameter and an external parameter after initialization of the projection device, and using a phase adjustment diagram of the plurality of different target postures according to a beam adjustment method, The three-dimensional coordinate system parameter of the target and the initialized internal and external parameters are jointly nonlinearly optimized to obtain calibration parameters of the projection device to complete calibration of the projection device;
- Step 5 Calibrate the three-dimensional imaging system by using calibration parameters of the imaging device and calibration parameters of the projection device, and obtain calibration parameters of the three-dimensional imaging system to complete calibration of the three-dimensional imaging system.
- the present invention also provides a calibration device for a telecentric lens three-dimensional imaging system based on beam adjustment, the device being applied to a three-dimensional imaging system, the three-dimensional imaging system comprising: a projection device having a telecentric lens, An imaging device having a telecentric lens and a movable platform; the optical axis of the projection device is perpendicular to the movable platform placed horizontally, and an optical axis of the imaging device is at a preset angle with the movable platform.
- a target is placed on the movable platform, and the movable platform is always within a common depth of field of the imaging device and the projection device, and the calibration device includes:
- An acquisition module for moving the movable platform such that the target is in a plurality of different target positions And in each target posture, using uniform light to project to the target, collecting the target image in the target posture by the imaging device, and projecting the fringe pattern to the projection device by using the projection device Using the imaging device to acquire a fringe pattern under the target posture;
- An imaging device calibration module is configured to initialize an internal parameter and an external parameter of the imaging device to obtain an internal reference and an external parameter after the initialization of the parameter of the imaging device, and use a plurality of different target postures based on a beam adjustment method
- the target image, the three-dimensional coordinate system parameter of the target, and the initialized internal reference and the external parameter are jointly nonlinearly optimized to obtain calibration parameters of the imaging device to complete calibration of the imaging device;
- the obtaining module is configured to dephase and phase unfold the fringe pattern acquired by the plurality of different target poses by using the N-step phase shift method, and obtain a phase unwrapping diagram of the plurality of different target poses;
- a projection device calibration module configured to initialize an internal parameter and an external parameter of the projection device, to obtain an internal reference and an external parameter after the initialization of the projection device, and use the plurality of different target postures according to a beam adjustment method a phase unwrapping map, a three-dimensional coordinate system parameter of the target, and a joint non-linear optimization of the initialized internal and external parameters to obtain calibration parameters of the projection device to complete calibration of the projection device;
- a system calibration module configured to calibrate the three-dimensional imaging system by using calibration parameters of the imaging device and calibration parameters of the projection device, to obtain calibration parameters of the three-dimensional imaging system, to complete calibration of the three-dimensional imaging system .
- the invention provides a calibration method for a telecentric lens three-dimensional imaging system based on beam adjustment, in which a camera device with a telecentric lens and a projection device with a telecentric lens are used in a three-dimensional imaging system, and the camera is imaged by a beam adjustment method.
- the device and the projection device are non-linearly calibrated, and the three-dimensional imaging system is calibrated by using the calibration parameters of the calibrated imaging device and the projection device.
- FIG. 1 is a schematic structural view of a telecentric lens three-dimensional imaging system based on beam adjustment according to an embodiment of the present invention
- Figure 1.1 is a schematic diagram of a double telecentric lens in an embodiment of the present invention.
- Figure 1.2 is a schematic diagram of a coordinate system established in an embodiment of the present invention.
- FIG. 2 is a schematic flow chart of a calibration method of a three-dimensional imaging system of a telecentric lens based on beam adjustment according to an embodiment of the present invention
- FIG. 3 is a schematic diagram of functional modules of a calibration device of a three-dimensional imaging system of a telecentric lens based on beam adjustment in an embodiment of the present invention.
- FIG. 1 is a schematic structural diagram of a three-dimensional imaging system for a telecentric lens based on beam adjustment according to an embodiment of the present invention
- the three-dimensional imaging system includes: a telecentric lens Projection equipment, camera equipment with telecentric lenses, and a movable platform.
- the optical axis of the projection device is perpendicular to the horizontally movable platform, and the optical axis of the imaging device is at a predetermined angle with the movable platform, and the preset angle may be in a range of 70 to 85 degrees. among them,
- the movable platform can be placed on a horizontal test bench, and the target can be placed on the movable platform.
- the movable platform can move up and down and move left and right, and can also adjust the angle of the movable platform to the horizontal plane, wherein by moving the movable platform, the target can be placed in different target postures.
- the telecentric lens can use a double telecentric lens
- the projection device can use a DMD projector
- the camera device can use a CMOS device or a digital camera.
- the movable platform is always within the common depth of field of the imaging device and the projection device, so that the image projected by the projection device onto the target is clear, and the image captured by the imaging device is also clear.
- the telecentric lens Compared with the existing pinhole model lens, the telecentric lens has high measurement accuracy and is suitable for high-precision measurement.
- the telecentric lens can be divided into an object telecentric lens, an image telecentric lens, and a double telecentric lens.
- a double telecentric lens as an example, please refer to FIG. 1.1, which is the principle of the double telecentric lens in the embodiment of the present invention. Figure.
- the schematic diagram can also be called a telecentric lens model.
- the telecentric lens model is a parallel imaging model. In the depth of field of the telecentric lens, the distance between the object and the lens does not change. Affecting the magnification of the image by the camera device, in order to better describe the telecentric lens model, a coordinate system as shown in Fig. 1.2 is established, wherein O w (X w , Y w , Z w ) is the world coordinate system as a unified coordinate system. Describe the relative position of all objects in the space.
- the camera coordinate system is O c (X c Y c Z c ).
- the optical axis of the camera is selected as the Z c of the camera coordinate system.
- the coordinate conversion relationship is similar to the pinhole model.
- the camera coordinate system is a coordinate system based on the imaging plane.
- the optical axis is taken as the coordinate system Z axis, and the points on the world coordinate system correspond to the points on the camera coordinate system.
- the image coordinates may also be referred to as pixel coordinates, belonging to the coordinates in the pixel coordinate system, and the pixel coordinate system refers to the arrangement coordinate system of the pixel points on the pixel surface of the camera.
- the pixel point in the upper left corner of the image is taken as the coordinate origin, and the abscissa is represented.
- the number of rows of pixels, the ordinate indicates the number of columns.
- telecentric lens imaging is parallel projection imaging, the camera coordinate system loses the Z-axis during imaging.
- the above information therefore, telecentric lens imaging can be understood as two-dimensional coordinate information projected onto the imaging surface of the imaging device at a certain magnification.
- the camera coordinates and image coordinates are as follows:
- the telecentric lens imaging model is as follows:
- m denotes the magnification of the telecentric lens
- s denotes the distortion factor of the telecentric lens
- (u 0 , v 0 ) denotes the origin of the pixel coordinate system
- r denotes the rotation matrix and the translation matrix in the outer parameter, respectively
- d u , d v are the physical dimensions of each pixel in the X-axis and Y-axis directions, respectively.
- the external parameter is obtained by combining the known initialization internal parameter and the normalization matrix.
- h ij represents the number of the i-th row and the j-th column in the normalized matrix H, according to the above formula ( 3.1)
- the normalized matrix formula (3.2) can be obtained:
- this normalization function H can be directly solved by the DLT method.
- R the unit is orthogonal to the matrix, so you can get:
- the position of the image plane can be arbitrarily set within the depth of field of the telecentric lens, and it is assumed here that the pixel point at the center of the image is regarded as the center of the image, so that (u 0 , v 0 ) can be determined by known CCD information, thereby The translation matrix t s in equation (3.6) can be determined.
- r 1 , r 2 , and r 3 are the coordinate vectors of the R matrix, because the unit orthogonal matrix feature of R can only provide a constraint using a circular marker point target, taking any point in the marker point as a control point. And to ensure that the target has a slight displacement along the Z-axis through the displacement platform, and r 13 and r 23 can also be obtained by using equation (3.8).
- the telecentric lens imaging model of the telecentric lens can be obtained, and the initialization of the external parameters and the internal parameters of the imaging device and the projection device can be realized based on the telecentric lens imaging model.
- k 1 to k 5 are distortion coefficients, where (k 1 , k 2 , k 5 ) represent different radial parameters in three directions, and (k 3 , k 4 ) represents a distortion parameter in the tangential direction.
- the distortion coefficient can be determined using equation (3.9).
- FIG. 2 is a schematic flowchart of a calibration method of a telecentric lens three-dimensional imaging system based on beam adjustment according to a first embodiment of the present invention, including:
- Step 201 Move the movable platform such that the target is in a plurality of different target postures, and in each target posture, use uniform light to project to the target, and collect the image through the imaging device. Delineating a target image under the target attitude, and projecting the fringe pattern to the target by using the projection device, and acquiring a fringe pattern under the target posture by using the imaging device;
- the present invention it is required to collect target images and fringe patterns in a plurality of different target postures. And after the movable platform moves to a certain target attitude, the uniform light is emitted by the uniform light source, and the uniform light is projected onto the target, and the target image under the target posture is acquired by the imaging device. After the target image is acquired in the target posture, the target posture is kept unchanged, the fringe pattern is projected onto the target by using the projection device, and the fringe pattern under the target posture is acquired by using the imaging device. . Pass In the above manner, the target image and the fringe pattern in a certain target posture can be collected, and the target image in a plurality of different target postures can be obtained by moving the movable platform to different target postures. And striped pattern.
- a plurality of fringe patterns have been saved in the projection device, and the plurality of fringe patterns can use four sinusoidal fringe patterns with a fringe period of 20 and nine fringe patterns in two directions. And implanting the projection device such that the projection device can project the sine fringe pattern and the Gray code fringe pattern to the target. Specifically, in each target pose, the projection device will project the sinusoidal fringe pattern and the Gray code fringe pattern onto the target in sequence, and the imaging device will also perform a collection after each fringe pattern is projected. And collecting the plurality of fringe patterns as the fringe pattern acquired under the target posture.
- the movable platform is always within the depth of field of the imaging device and the projection device regardless of the change of the target posture.
- the target image and the fringe pattern need to be collected in at least three different target poses to complete the collection work.
- the angle between the uniform light source and the movable platform in the embodiment of the present invention does not limit its size as long as there is uniform light projected onto the target on the movable platform, and the image of the projected light is made. Clear, and the target image captured by the camera device is clear.
- Step 202 Initialize an internal parameter and an external parameter of the imaging device to obtain an internal parameter and an external parameter after initializing the parameter of the imaging device, and use a target image and a plurality of target positions under different target postures according to the beam adjustment method. Performing joint nonlinear optimization on the three-dimensional coordinate system parameter of the target and the initialized internal and external parameters to obtain calibration parameters of the imaging device to complete calibration of the imaging device;
- the imaging device is calibrated based on the beam adjustment method, and the calibration parameters of the imaging device may be obtained according to the following formula:
- N represents the total number of target images in a plurality of different target poses
- M represents the number of identified points in the target
- An imaging point representing the jth landmark in the target image at the i-th target pose
- O ij (R, t s , m, u 0 , v 0 , k, X) represents the ith target
- X represents the three-dimensional coordinate system parameter of the target
- R is the rotation matrix of the external parameter of the imaging device
- t s is a translation matrix of the external reference of the imaging device
- m is a magnification of the telecentric lens in the internal reference of the imaging device
- (u 0 , v 0 ) represents an origin of the pixel coordinate system
- k is a distortion coefficient.
- the beam adjustment method is a joint nonlinear optimization of the three-dimensional image parameters of the target and the external and internal parameters of the imaging device.
- the initial value of m is obtained after the camera device is built; the external parameter R, t s is initialized by the parameter, and R usually obtains the partial derivative of R and then substitutes the optimization by Rodrigues ⁇ s law; k is Distortion coefficient, where the initial value of the distortion parameter is set to 0 for the first optimization, and then the second optimization is used to obtain the optimal solution; the initial value of (u 0 , v 0 ) is determined by the camera resolution.
- the Levbery-Marquardt method it can be solved by the Levbery-Marquardt method.
- the beam adjustment method is a nonlinear optimization method.
- the problem of solving the above beam adjustment method becomes the problem of the optimal solution of the Jacobian matrix nonlinear optimization.
- the target contains M marker points, and the target image and the fringe pattern of the N different target poses are collected.
- the dimensions of the Jacobian matrix are:
- the partial derivative of the function to the unrelated variable is 0.
- the Jacobian matrix is large. In order to improve the computational efficiency, reduce the calibration time and introduce the properties of the sparse matrix, and then partition the Jacobian matrix. The operation is performed so that the beam adjustment method can be solved and the corresponding calibration parameters are obtained.
- the calibration of the imaging device can be obtained.
- the parameter, and the calibration parameter includes at least pixel coordinates of the marker point in the target of the imaging device, the magnification of the optimized imaging device, and the optimized rotation matrix and translation matrix, and the internal parameters of the imaging device.
- Step 203 Dephase and phase unfold the fringe pattern acquired by the plurality of different target poses by using the N-step phase shift method, and obtain a phase unwrapping diagram of the plurality of different target poses;
- the N-step phase method is used to dephase and phase unroll the acquired fringe patterns in the plurality of different target poses.
- the phase folding map can be obtained by the phase unwrapping technique, and the phase unwrapping graph can be obtained by the phase unwrapping technique.
- the N-step phase shift method can be a four-step phase shift method or other multi-step phase shift method.
- Step 204 Initialize an internal parameter and an external parameter of the projection device to obtain an internal parameter and an external parameter after the initialization of the projection device, and use a phase unwrapping diagram of the plurality of different target postures according to a beam adjustment method.
- the three-dimensional coordinate system parameter of the target and the initialized internal and external parameters are jointly nonlinearly optimized to obtain calibration parameters of the projection device to complete calibration of the projection device;
- the calibration parameters of the projection device obtained by using the beam adjustment method are as follows:
- N represents the total number of phase unwrapped graphs in a plurality of different target poses
- M represents the number of identified points in the target
- An imaging point representing the jth landmark point in the phase unwrapped map at the i-th target pose
- O ij (R, t s , m, u 0 , v 0 , k, X) represents the ith target
- X represents the three-dimensional coordinate system parameter of the target
- R is the rotation matrix of the external reference of the projection device
- t s is a translation matrix of the external reference of the projection device
- m is a magnification of the telecentric lens in the internal reference of the projection device
- (u 0 , v 0 ) represents an origin of the pixel coordinate system
- k is a distortion coefficient.
- the marker point of the target can be obtained by the phase unwrapping map on the projection device.
- the pixel coordinates of the target marker point recorded by the projection device can be obtained by the beam adjustment method described above, and the pixel coordinates and the phase expansion map of the target marker point recorded by the projection device are obtained.
- Step 205 Calibrate the three-dimensional imaging system by using calibration parameters of the imaging device and calibration parameters of the projection device to obtain calibration parameters of the three-dimensional imaging system to complete calibration of the three-dimensional imaging system.
- the calibration of the three-dimensional imaging system by using the calibration parameters of the imaging camera device and the calibration parameters of the projection device includes:
- Step A Obtain calibration parameters of the three-dimensional imaging system according to the following formula:
- R p represents a rotation matrix in the external reference of the projection device
- t p represents a translation matrix in the external reference of the projection device
- R c represents a rotation matrix in the external reference of the imaging device
- t c represents the imaging
- R s represents the rotation matrix of the three-dimensional imaging system
- t s represents the translation matrix of the three-dimensional imaging system
- p w represents the world coordinate vector of any point P in the space
- Step B performing least squares optimization on the rotation matrix and the translation matrix of the three-dimensional imaging system, and determining the conversion relationship between the pixel coordinates and the world coordinates of the three-dimensional imaging system by using the optimized rotation matrix and the translation matrix.
- the pixel coordinate is a coordinate in the image coordinate system, and the image coordinate system may also be referred to as a camera coordinate system.
- the optical axis is generally taken as the coordinate system Z axis, and the point on the world coordinate system may be One-to-one correspondence with points on the image coordinate system.
- an imaging apparatus having a telecentric lens and a tool are used in a three-dimensional imaging system
- the telecentric lens can perform precise measurement, it is particularly suitable for measurement of an object having a certain depth and thickness and having a radius of a stepped hole. Therefore, the calibration accuracy and measurement accuracy can be further improved.
- FIG. 3 is a schematic diagram of functional modules of a calibration apparatus for a telecentric lens three-dimensional imaging system based on beam adjustment according to a second embodiment of the present invention, wherein the apparatus is applied to a three-dimensional imaging system, and the three-dimensional imaging system includes: a projection apparatus having a telecentric lens, an imaging apparatus having a telecentric lens, and a movable platform; an optical axis of the projection apparatus being perpendicular to the movable platform placed horizontally, an optical axis of the imaging apparatus and the movable
- the platform is at a preset angle, and the target is placed on the movable platform, and the movable platform is always in a common depth of field of the imaging device and the projection device
- the calibration device includes:
- An acquisition module 301 configured to move the movable platform such that the target is in a plurality of different target postures, and in each target posture, the uniform light is projected onto the target through the imaging
- the device collects a target image in the target posture, and projects a fringe pattern to the target by using the projection device, and uses the imaging device to collect a fringe pattern under the target posture;
- the imaging device calibration module 302 is configured to initialize an internal parameter and an external parameter of the imaging device to obtain an internal reference and an external parameter after the initialization of the parameter of the imaging device, and use a plurality of different target postures according to a beam adjustment method.
- the target image, the three-dimensional coordinate system parameter of the target, and the internal parameter and the external parameter after the initialization are jointly nonlinearly optimized, and the calibration parameters of the imaging device are obtained to complete calibration of the imaging device;
- the obtaining module 303 is configured to perform phase cancellation and phase unwrapping of the fringe patterns collected by the plurality of different target poses by using the N-step phase shift method, and obtain phase unwrapping diagrams of the plurality of different target poses;
- a projection device calibration module 304 configured to initialize an internal parameter and an external parameter of the projection device, to obtain an internal reference and an external parameter after the initialization of the projection device, and use the plurality of different target postures according to a beam adjustment method a phase unwrapping diagram, a three-dimensional coordinate system parameter of the target, and a joint nonlinear optimization of the initialized internal and external parameters to obtain calibration parameters of the projection device to complete calibration of the projection device;
- a system calibration module 305 configured to calibrate the three-dimensional imaging system by using calibration parameters of the imaging device and calibration parameters of the projection device, to obtain calibration parameters of the three-dimensional imaging system, to complete the three-dimensional imaging system Calibration.
- the imaging device calibration module 302 is specifically configured to initialize an internal parameter and an external parameter of the imaging device, obtain an internal parameter and an external parameter after the initialization of the parameter of the imaging device, and obtain the imaging device according to the following formula.
- N represents the total number of target images in a plurality of different target poses
- M represents the number of identified points in the target
- An imaging point representing the jth landmark in the target image at the i-th target pose
- O ij (R, t s , m, u 0 , v 0 , k, X) represents the ith target
- X represents the three-dimensional coordinate system parameter of the target
- R is the rotation matrix of the external parameter of the imaging device
- t s is a translation matrix of the external reference of the imaging device
- m is a magnification of the telecentric lens in the internal reference of the imaging device
- (u 0 , v 0 ) represents an origin of the pixel coordinate system
- k is a distortion coefficient.
- the projection device calibration module 304 is specifically configured to initialize an internal parameter and an external parameter of the projection device, obtain an internal parameter and an external parameter after the initialization of the projection device, and obtain a calibration of the projection device according to the following formula. parameter:
- N represents the total number of phase unwrapped graphs in a plurality of different target poses
- M represents the number of identified points in the target
- An imaging point representing the jth marker point in the phase expansion map at the i-th target pose
- O ij (R, t s , m, u 0 , v 0 , k, X) represents the ith target
- X represents the three-dimensional coordinate system parameter of the target
- R is the rotation matrix of the external reference of the projection device
- t s is a translation matrix of the external reference of the projection device
- m is a magnification of the telecentric lens in the internal reference of the projection device
- (u 0 , v 0 ) represents an origin of the pixel coordinate system
- k is a distortion coefficient.
- system calibration module 305 is specifically configured to:
- the calibration parameters of the three-dimensional imaging system are obtained according to the following formula:
- R p represents a rotation matrix in the external reference of the projection device
- t p represents a translation matrix in the external reference of the projection device
- R c represents a rotation matrix in the external reference of the imaging device
- t c represents the imaging
- R s represents the rotation matrix of the three-dimensional imaging system
- t s represents the translation matrix of the three-dimensional imaging system
- p w represents the world coordinate vector of any point P in the space
- an imaging device having a telecentric lens and a projection device having a telecentric lens are used in the three-dimensional imaging system, and the imaging device and the projection device are nonlinearly calibrated by the beam adjustment method, and the calibration is completed by using the beam calibration method.
- the calibration parameters of the subsequent imaging device and projection device are calibrated to the three-dimensional imaging system.
- the telecentric lens can perform precise measurement, it is particularly suitable for measurement of an object having a certain depth and thickness and having a radius of a stepped hole. Therefore, the calibration accuracy and measurement accuracy can be further improved.
- the disclosed apparatus and method can be In other ways.
- the device embodiments described above are merely illustrative.
- the division of the modules is only a logical function division.
- there may be another division manner for example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or module, and may be electrical, mechanical or otherwise.
- the modules described as separate components may or may not be physically separated.
- the components displayed as modules may or may not be physical modules, that is, may be located in one place, or may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.
- the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
- the integrated modules if implemented in the form of software functional modules and sold or used as separate products, may be stored in a computer readable storage medium.
- the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
- a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
本发明公开了一种基于光束平差的远心镜头三维成像系统的标定方法及装置,在该方法中,在三维成像系统中使用具有远心镜头的摄像设备及具有远心镜头的投影设备,且通过光束平差法对摄像设备及投影设备进行非线性标定,并利用完成标定后的摄像设备及投影设备的标定参数对该三维成像系统进行标定。通过使用光束平差法能够有效减小标靶误差对三维成像系统的标定精度的影响,有效提升了标定精度,进而提高了三维成像系统的精度。
Description
本发明涉及三维成像及光学三维重建领域,尤其涉及一种基于光束平差的远心镜头三维成像系统的标定方法及装置。
基于相位条纹编码的三维成像具有简单,计算速度快、测量精度高等优点,被广泛应用于物体三维成像和测量中。通过投影设备将含有正弦条纹的图像投射到待测物体上,物体表面的形状会使得投射的结构光图像产生不同调制,通过相机获取这些带有调制信息的结构光图像,结合调解方法和立体视觉技术可得到物体的三维数字形貌数据。
现有技术中,由于光学结构本身的限制,三维成像和三维扫描技术在对金属反光物、微小且形状奇异物体等特殊对象的处理上还有很大发展空间,另外在对系统标定,物体相位信息获取的完整度和精度的研究,对三维重建方法和技术等相关核心问题还需不断深入。
目前,如何提升三维成像系统的精度是亟待解决的问题。
发明内容
本发明的主要目的在于提供一种基于光束平差的远心镜头三维成像系统的标定方法及装置,旨在解决现有技术中三维成像系统的精度低的技术问题。
为实现上述目的,本发明第一方面提供一种一种基于光束平差的远心镜头三维成像系统的标定方法,所述方法应用于三维成像系统,所述三维成像系统包括:具有远心镜头的投影设备、具有远心镜头的摄像设备及可移动平台;所述投影设备的光轴垂直于水平放置的所述可移动平台,所述摄像设备的光轴与所述可移动平台成预设夹角,所述可移动平台上放置标靶,所述可移动平台始
终处于所述摄像设备及所述投影设备共同景深范围内,所述标定方法包括:
步骤1、移动所述可移动平台,使得所述标靶处于多个不同标靶姿态下,且在每一个标靶姿态下,利用均匀光投射到所述标靶,通过所述摄像设备采集所述标靶姿态下的标靶图像,及利用所述投影设备将条纹图投射到所述标靶,利用所述摄像设备采集所述标靶姿态下的条纹图;
步骤2、对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,基于光束平差法,利用多个不同标靶姿态下的标靶图像、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述摄像设备的标定参数,以完成所述摄像设备的标定;
步骤3、利用N步相移法分别对多个不同标靶姿态下采集到的条纹图进行解相位及相位展开,得到多个不同标靶姿态下的相位展开图;
步骤4、对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,基于光束平差法,利用所述多个不同标靶姿态下的相位展开图、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述投影设备的标定参数,以完成所述投影设备的标定;
步骤5、利用所述摄像设备的标定参数及所述投影设备的标定参数对所述三维成像系统进行标定,得到所述三维成像系统的标定参数,以完成所述三维成像系统的标定。
为实现上述目的,本发明还提供一种基于光束平差的远心镜头三维成像系统的标定装置,所述装置应用于三维成像系统,所述三维成像系统包括:具有远心镜头的投影设备、具有远心镜头的摄像设备及可移动平台;所述投影设备的光轴垂直于水平放置的所述可移动平台,所述摄像设备的光轴与所述可移动平台成预设夹角,所述可移动平台上放置标靶,所述可移动平台始终处于所述摄像设备及所述投影设备共同景深范围内,所述标定装置包括:
采集模块,用于移动所述可移动平台,使得所述标靶处于多个不同标靶姿
态下,且在每一个标靶姿态下,利用均匀光投射到所述标靶,通过所述摄像设备采集所述标靶姿态下的标靶图像,及利用所述投影设备将条纹图投射到所述标靶,利用所述摄像设备采集所述标靶姿态下的条纹图;
摄像设备标定模块,用于对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,基于光束平差法,利用多个不同标靶姿态下的标靶图像、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述摄像设备的标定参数,以完成所述摄像设备的标定;
获取模块,用于利用N步相移法分别对多个不同标靶姿态下采集到的条纹图进行解相位及相位展开,得到多个不同标靶姿态下的相位展开图;
投影设备标定模块,用于对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,基于光束平差法,利用所述多个不同标靶姿态下的相位展开图、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述投影设备的标定参数,以完成所述投影设备的标定;
系统标定模块,用于利用所述摄像设备的标定参数及所述投影设备的标定参数对所述三维成像系统进行标定,得到所述三维成像系统的标定参数,以完成所述三维成像系统的标定。
本发明提供一种基于光束平差的远心镜头三维成像系统的标定方法,在三维成像系统中使用具有远心镜头的摄像设备及具有远心镜头的投影设备,且通过光束平差法对摄像设备及投影设备进行非线性标定,并利用完成标定后的摄像设备及投影设备的标定参数对该三维成像系统进行标定。通过使用光束平差法能够有效减小标靶误差对三维成像系统的标定精度的影响,有效提升了标定精度,进而提高了三维成像系统的精度。
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本发明实施例中基于光束平差的远心镜头三维成像系统的的结构示意图;
图1.1为本发明实施例中双远心镜头的原理图;
图1.2为本发明实施例中建立的坐标系的示意图;
图2为本发明实施例中基于光束平差的远心镜头的三维成像系统的标定方法的流程示意图;
图3为本发明实施例中基于光束平差的远心镜头的三维成像系统的标定装置的功能模块的示意图。
为使得本发明的发明目的、特征、优点能够更加的明显和易懂,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而非全部实施例。基于本发明中的实施例,本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
为了更好的理解本发明实施例中的技术方案,请参阅图1,为本发明实施例中基于光束平差的远心镜头三维成像系统的结构示意图,该三维成像系统包括:具有远心镜头的投影设备、具有远心镜头的摄像设备及可移动平台。
其中,该投影设备的光轴垂直于水平放置的可移动平台,该摄像设备的光轴与该可移动平台成预设夹角,且该预设夹角可以是70~85度的范围内,其中,
可移动平台可放置在水平实验台上,且该可移动平台上可放置标靶。
其中,可移动平台是可以上下移动及左右移动的,也可以调节该可移动平台与水平面的角度,其中,通过移动该可移动平台,可以使得标靶处于不同的标靶姿态下。
其中,远心镜头可以使用双远心镜头,投影设备可以使用DMD投影仪,摄像设备可以使用CMOS器件或数码相机,
需要说明的是,为了能够实现标定,该可移动平台始终处于摄像设备及投影设备共同景深范围内,以便投影设备投影至标靶上的图像清晰,且摄像设备采集的图像也是清晰的。
为了更好的理解本发明实施例中的技术方案,下面将介绍远心镜头的相关内容。
远心镜头相对于现有的针孔模型镜头具有测量精度高,适用于高精度测量的优点。远心镜头可以分为物方远心镜头、像方远心镜头,及双远心镜头,以双远心镜头为例,请参阅图1.1,为本发明实施例中,双远心镜头的原理图。
其中,该原理图也可以称为远心镜头模型,从模型的角度分析,该远心镜头模型是一种平行成像模型,在远心镜头的景深范围内,物体与镜头间的距离变化不会影响摄像设备对图像的放大率,为了更好的描述远心镜头模型,建立如图1.2的坐标系,其中,Ow(Xw,Yw,Zw)是世界坐标系作为统一坐标系来描述空间所有物体的相对位置,相机坐标系为Oc(XcYcZc),通常选择相机的光轴直接作为相机坐标系的Zc。坐标转换关系与针孔模型类似,其中,相机坐标系是依据成像面制定的坐标系,一般常取光轴为坐标系Z轴,世界坐标系上的点与相机坐标系上的点一一对应。其中,图像坐标也可以称为像素坐标,属于像素坐标系中的坐标,且像素坐标系是指相机像素面上像素点的排列坐标系,通常以图像左上角像素点为坐标原点,横坐标表示像素行数,纵坐标表示列数。
由于远心镜头成像是平行投影成像,相机坐标系在成像过程中会丢失Z轴
上的信息,因此,远心镜头成像实际可以理解为二维坐标信息经过一定的放大率投射在摄像设备的成像面上。
假设此处镜头放大率是m,则相机坐标和图像坐标如下所示的成像关系:
由于上述的成像关系,再考虑到远心镜头的内外参数,由于外参是描述世界坐标和图像坐标之间位置关系转换关系的参数,且由于远心镜头的外参缺少Z轴上参数变化的信息,因此,可以基于远心镜头的放大率m建立远心镜头世界坐标与图像坐标之间的初始转换关系,因此,远心镜头成像模型如下:
其中,m表示远心镜头的放大率,s表示远心镜头的扭曲因子,(u0,v0)表示像素坐标系的原点,r,t分别表示外参中的旋转矩阵和平移矩阵,du,dv分别为每个像素在X轴、Y轴方向上的物理尺寸。
需要说明的是,外参是由已知的初始化内参和归一化矩阵联合得到的,在这里假设hij表示的是归一化矩阵H中第i行第j列的数,根据上式(3.1)可以得到归一化矩阵公式(3.2):
同样的,可以用DLT方法直接求解此归一化函数H。再根据R为单位正交矩阵,所以可以得到:
联立上式可得到公式(3.4):
由式(3.1)假设m/du=m/dv=a,则合并式3.1和上式3.4,可以得到以下公式:
上式有两个非负的解(a2为上式解),所以还需要有一个条件才能求解,由式(3.1)和式(3.2)可以得到基本条件这里的i=1,2且j=1,2.,这样就可以得到a的解,即求得R矩阵中左上的一个2×2的旋转矩阵。
初始化过程中还需要求得r13,r23的值,由公式(3.1)和公式(3.2)点乘关系联立得到,位移参数ts和图像中心点(u0,v0)可以满足的以下公式:
上式中(u0,v0)和ts为未知变量,所以不能单独通过(3.6)式直接求解,这个步骤和针孔模型的求解不一样,出现这种现象的原因是归一化函数H在Z轴方向上的坐标变化是没有意义的,因为远心镜头没有焦点(或者理解为焦点在无穷远处),所以h13,h23在数值上为零。因此像平面的位置可以在远心镜头的景深内随意设定,在这里假设将图像中心的像素点看成是图像中心,这样可通过已知的CCD信息确定(u0,v0),从而有公式(3.6)中的平移矩阵ts就可以确定了。
另外,旋转矩阵R中左上的2×2的旋转矩阵前文介绍已经可以得到。然后其余的矩阵参数可以由式(3.3)和式(3.7)联立利用R为单位正交阵的特性得到。
r3=r1×r2 (3.7)
这其中r1,r2,r3都是R矩阵的坐标矢量,因为R的单位正交阵特征只能提供一个约束运用的是圆形标志点标靶,取标志点中任一点作为控制点,并保证标靶通过位移平台沿Z轴方向有微小的位移,同样可以运用式(3.8)求得r13和r23。
因此,通过上述方式,可以得到远心镜头的远心镜头成像模型,并基于该远心镜头成像模型实现摄像设备及投影设备的外参及内参的初始化。
进一步的,考虑镜头畸变,可以得到以下公式:
(3.9)
其中,u和v表示理想坐标系下无畸变的点,同时u′和v′表示含畸变的图像点,且满足在公式中k1~k5均是畸变系数,其中(k1,k2,k5)表示三个方向上的不同径向参数,(k3,k4)表示切向上的畸变参数。利用式(3.9)能够确定畸变系数。
基于上述的三维成像系统,请参阅图2,为本发明第一实施例中基于光束平差的远心镜头三维成像系统的标定方法的流程示意图,包括:
步骤201、移动所述可移动平台,使得所述标靶处于多个不同标靶姿态下,且在每一个标靶姿态下,利用均匀光投射到所述标靶,通过所述摄像设备采集所述标靶姿态下的标靶图像,及利用所述投影设备将条纹图投射到所述标靶,利用所述摄像设备采集所述标靶姿态下的条纹图;
在本发明实施例中,需要采集多个不同标靶姿态下的标靶图像及条纹图。且在可移动平台移动至某一个标靶姿态之后,通过均匀光光源发出均匀光,并将该均匀光投射到标靶,通过摄像设备采集该标靶姿态下的标靶图像。且在该标靶姿态下完成标靶图像的采集之后,保持标靶姿态不变,利用投影设备将该条纹图投射到该标靶上,并利用摄像设备采集在该标靶姿态下的条纹图。通过
上述方式,可以采集在某一个标靶姿态下的标靶图像及条纹图,且通过移动该可移动平台的到不同标靶姿态下的方式,能够得到多个不同标靶姿态下的标靶图像及条纹图。
需要说明的是,投影设备中已经保存了多个条纹图,该多个条纹图可以利用计算机编写的条纹周期为20的4幅正弦条纹图和9幅格雷码横竖两个方向上的条纹图,且植入该投影设备,使得投影设备可以向标靶投射上述的正弦条纹图及格雷码条纹图。具体的,在每一个标靶姿态下,投影设备都将按照顺序将正弦条纹图及格雷码条纹图投影至标靶上,且摄像设备也将在每一投影一个条纹图之后,进行一次采集,且将采集到的多个条纹图作为该标靶姿态下采集得到的条纹图。
需要说明的是,本发明实施例中,无论标靶姿态如何改变,可移动平台始终处于摄像设备及投影设备的景深范围内。
可以理解的是,在本发明实施例中,需要在至少三个不同的标靶姿态下采集标靶图像及条纹图,以完成采集工作。
可以理解的是,本发明实施例中的均匀光光源与可移动平台之间的夹角并不限定其大小,只要有均匀光投射至可移动平台上的标靶,且使得投射的光的图像清晰,且摄像设备采集的标靶图像清晰即可。
步骤202、对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,基于光束平差法,利用多个不同标靶姿态下的标靶图像、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述摄像设备的标定参数,以完成所述摄像设备的标定;
在本发明实施例中,基于光束平差法对摄像设备进行标定,具体可以按照如下公式得到所述摄像设备的标定参数:
其中,xBA
*表示重投影误差残差值,N表示多个不同标靶姿态下的标靶图像
的总数,M表示所述标靶中标识点的个数,表示在第i个标靶姿态下的标靶图像中的第j个标志点的成像点;Oij(R,ts,m,u0,v0,k,X)表示第i个标靶姿态下的标靶图像中的第j个标志点在像素坐标系中的理想点;X表示所述标靶的三维坐标系参数,R为所述摄像设备外参的旋转矩阵,及ts为所述摄像设备外参的平移矩阵,m为所述摄像设备内参中远心镜头的放大率,(u0,v0)表示所述像素坐标系的原点,k为畸变系数。
其中,光束平差法是将标靶的三维图像参数和摄像设备的外参和内参进行联合非线性优化。
其中,在初始化方面,m的初始值在搭建摄像设备之后得到;外参外参R,ts由参数初始化得到的,R通常通过Rodrigues`s定律先得到R的偏导数再代入优化;k为畸变系数,这里将畸变参数初始值设为0进行第一次优化,然后通过第二次优化得到最优解;(u0,v0)的初始值由相机分辨率决定。对于这种非线性优化问题,可以用Levenbery-Marquardt法解决。
可以理解的是,光束平差法是一种非线性优化方法,求解上述的光束平差法的问题就变成了Jacobian矩阵非线性优化求最优解的问题,在摄像设备的标定中,若标靶包含M个标志点,采集了N个不同标靶姿态下标靶图像及条纹图,则Jacobian矩阵的尺寸为:
4MN×(26+6N+3M)
由于远心镜头的特殊性,函数对无关变量的偏导数为0,由上式可知,该Jacobian矩阵很大,为了提高运算效率,减少标定时间引入稀疏矩阵的性质,然后对Jacobian矩阵进行分块运算,以便能够完成光束平差法的求解,得到相应的标定参数。
在本发明实施例中,完成对摄像设备的标定后,可得到该摄像设备的标定
参数,且该标定参数至少包括该摄像设备的标靶中的标志点的像素坐标、优化后的摄像设备的放大率,及优化后的旋转矩阵及平移矩阵、摄像设备的内参。
步骤203、利用N步相移法分别对多个不同标靶姿态下采集到的条纹图进行解相位及相位展开,得到多个不同标靶姿态下的相位展开图;
在本发明实施例中,对于采集到的多个不同标靶姿态下的条纹图,将利用N步相位法分别对该多个不同标靶姿态下的采集到的条纹图进行解相位及相位展开,得到该多个不同标靶姿态下的相位展开图。其中,对于条纹图,可以通过解相位技术得到相位折叠图,并通过相位展开技术得到相位展开图。
可以理解的是,该N步相移法可以是四步相移法,也可以是其他多步相移法,
步骤204、对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,基于光束平差法,利用所述多个不同标靶姿态下的相位展开图、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述投影设备的标定参数,以完成所述投影设备的标定;
在本发明实施例中,利用光束平差法得到所述投影设备的标定参数具体如下:
其中,xBA
*表示重投影误差残差值,N表示多个不同标靶姿态下的相位展开图的总数,M表示所述标靶中标识点的个数,表示在第i个标靶姿态下的相位展开图中的第j个标志点的成像点;Oij(R,ts,m,u0,v0,k,X)表示第i个标靶姿态下的相位展开图中的第j个标志点在像素坐标系中的理想点;X表示所述标靶的三维坐标系参数,R为所述投影设备外参的旋转矩阵,及ts为所述投影设备外参的平移矩阵,m为所述投影设备内参中远心镜头的放大率,(u0,v0)表示所述像素坐标系的原点,k为畸变系数。
在本发明实施例中,通过相位展开图可以获得标靶的标志点在投影设备上
的像素坐标,即通过投影设备的逆成像关系得到投影设备的虚拟“拍摄图像”。
在本发明实施例中,通过上述的光束平差法可得到该投影设备记录的标靶标志点的像素坐标,且将得到该投影设备记录的标靶标志点的像素坐标及相位展开图上投影设备各标志点的像素坐标的对应关系,以完成投影设备的标定,其中,该对应关系属于投影设备的标定参数中的一种,此外,投影设备的标定参数还包括该投影设备优化后的放大率,优化后的旋转矩阵及平移矩阵。
步骤205、利用所述摄像设备的标定参数及所述投影设备的标定参数对所述三维成像系统进行标定,得到所述三维成像系统的标定参数,以完成所述三维成像系统的标定。
在本发明实施例中,将利用摄像摄像设备的标定参数及投影设备的标定参数对三维成像系统进行标定包括:
步骤A、按照如下公式得到所述三维成像系统的标定参数:
Rp·pw+tp=Rs·(Rc·pw+tc)+ts
其中,Rp表示所述投影设备外参中的旋转矩阵,tp表示所述投影设备外参中的平移矩阵,Rc表示所述摄像设备外参中的旋转矩阵,tc表示所述摄像设备外参中的平移矩阵,Rs表示三维成像系统的旋转矩阵,ts表示三维成像系统的平移矩阵,pw表示空间中任意一点P的世界坐标向量;
其中,Pw=[xw,yw,zw]T;
步骤B、对所述三维成像系统的旋转矩阵及平移矩阵进行最小二乘优化,利用优化后的旋转矩阵及平移矩阵确定所述三维成像系统的像素坐标和世界坐标之间的转换关系。
其中,像素坐标是图像坐标系中的坐标,该图像坐标系也可称为相机坐标系,依据成像面制定的坐标系,一般常取光轴为坐标系Z轴,世界坐标系上的点可以与图像坐标系上的点一一对应。
在本发明实施例中,在三维成像系统中使用具有远心镜头的摄像设备及具
有远心镜头的投影设备,且通过光束平差法对摄像设备及投影设备进行非线性标定,并利用完成标定后的摄像设备及投影设备的标定参数对该三维成像系统进行标定。通过使用光束平差法能够有效减小标靶误差对三维成像系统的标定精度的影响,有效提升了标定精度,进而提高了三维成像系统的精度。进一步的,通过使用具有远心镜头的摄像设备及具有远心镜头的摄像设备,由于远心镜头能够实现精密测量,特别适用于具有一定深度和厚度,且孔的半径成台阶状的物体的测量,因此,能够进一步提高标定精度及测量精度。
请参阅图3,为本发明第二实施例中基于光束平差的远心镜头三维成像系统的标定装置的功能模块的示意图,其中,该装置应用于三维成像系统,所述三维成像系统包括:具有远心镜头的投影设备、具有远心镜头的摄像设备及可移动平台;所述投影设备的光轴垂直于水平放置的所述可移动平台,所述摄像设备的光轴与所述可移动平台成预设夹角,所述可移动平台上放置标靶,所述可移动平台始终处于所述摄像设备及所述投影设备共同景深范围内,所述标定装置包括:
采集模块301,用于移动所述可移动平台,使得所述标靶处于多个不同标靶姿态下,且在每一个标靶姿态下,利用均匀光投射到所述标靶,通过所述摄像设备采集所述标靶姿态下的标靶图像,及利用所述投影设备将条纹图投射到所述标靶,利用所述摄像设备采集所述标靶姿态下的条纹图;
摄像设备标定模块302,用于对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,基于光束平差法,利用多个不同标靶姿态下的标靶图像、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述摄像设备的标定参数,以完成所述摄像设备的标定;
获取模块303,用于利用N步相移法分别对多个不同标靶姿态下采集到的条纹图进行解相位及相位展开,得到多个不同标靶姿态下的相位展开图;
投影设备标定模块304,用于对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,基于光束平差法,利用所述多个不同标靶姿态下的相位展开图、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述投影设备的标定参数,以完成所述投影设备的标定;
系统标定模块305,用于利用所述摄像设备的标定参数及所述投影设备的标定参数对所述三维成像系统进行标定,得到所述三维成像系统的标定参数,以完成所述三维成像系统的标定。
进一步的,所述摄像设备标定模块302具体用于对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,及按照如下公式得到所述摄像设备的标定参数:
其中,xBA
*表示重投影误差残差值,N表示多个不同标靶姿态下的标靶图像的总数,M表示所述标靶中标识点的个数,表示在第i个标靶姿态下的标靶图像中的第j个标志点的成像点;Oij(R,ts,m,u0,v0,k,X)表示第i个标靶姿态下的标靶图像中的第j个标志点在像素坐标系中的理想点;X表示所述标靶的三维坐标系参数,R为所述摄像设备外参的旋转矩阵,及ts为所述摄像设备外参的平移矩阵,m为所述摄像设备内参中远心镜头的放大率,(u0,v0)表示所述像素坐标系的原点,k为畸变系数。
进一步的,所述投影设备标定模块304具体用于对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,及按照如下公式得到所述投影设备的标定参数:
其中,xBA
*表示重投影误差残差值,N表示多个不同标靶姿态下的相位展开图的总数,M表示所述标靶中标识点的个数,表示在第i个标靶姿态下的相
位展开图中的第j个标志点的成像点;Oij(R,ts,m,u0,v0,k,X)表示第i个标靶姿态下的相位展开图中的第j个标志点在像素坐标系中的理想点;X表示所述标靶的三维坐标系参数,R为所述投影设备外参的旋转矩阵,及ts为所述投影设备外参的平移矩阵,m为所述投影设备内参中远心镜头的放大率,(u0,v0)表示所述像素坐标系的原点,k为畸变系数。
进一步的,所述系统标定模块305具体用于:
按照如下公式得到所述三维成像系统的标定参数:
Rp·pw+tp=Rs·(Rc·pw+tc)+ts
其中,Rp表示所述投影设备外参中的旋转矩阵,tp表示所述投影设备外参中的平移矩阵,Rc表示所述摄像设备外参中的旋转矩阵,tc表示所述摄像设备外参中的平移矩阵,Rs表示三维成像系统的旋转矩阵,ts表示三维成像系统的平移矩阵,pw表示空间中任意一点P的世界坐标向量;
其中,Pw=[xw,yw,zw]T;
以及,对所述三维成像系统的旋转矩阵及平移矩阵进行最小二乘优化,利用优化后的旋转矩阵及平移矩阵确定所述三维成像系统的像素坐标和世界坐标之间的转换关系。
在本发明实施例中,在三维成像系统中使用具有远心镜头的摄像设备及具有远心镜头的投影设备,且通过光束平差法对摄像设备及投影设备进行非线性标定,并利用完成标定后的摄像设备及投影设备的标定参数对该三维成像系统进行标定。通过使用光束平差法能够有效减小标靶误差对三维成像系统的标定精度的影响,有效提升了标定精度,进而提高了三维成像系统的精度。进一步的,通过使用具有远心镜头的摄像设备及具有远心镜头的摄像设备,由于远心镜头能够实现精密测量,特别适用于具有一定深度和厚度,且孔的半径成台阶状的物体的测量,因此,能够进一步提高标定精度及测量精度。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可
以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或模块的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
需要说明的是,对于前述的各方法实施例,为了简便描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的
动作顺序的限制,因为依据本发明,某些步骤可以采用其它顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定都是本发明所必须的。
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其它实施例的相关描述。
以上为对本发明所提供的一种基于光束平差的远心镜头三维成像系统的标定方法及装置的描述,对于本领域的技术人员,依据本发明实施例的思想,在具体实施方式及应用范围上均会有改变之处,综上,本说明书内容不应该理解为对本发明的限制。
Claims (8)
- 一种基于光束平差的远心镜头三维成像系统的标定方法,其特征在于,所述方法应用于三维成像系统,所述三维成像系统包括:具有远心镜头的投影设备、具有远心镜头的摄像设备及可移动平台;所述投影设备的光轴垂直于水平放置的所述可移动平台,所述摄像设备的光轴与所述可移动平台成预设夹角,所述可移动平台上放置标靶,所述可移动平台始终处于所述摄像设备及所述投影设备共同景深范围内,所述标定方法包括:步骤1、移动所述可移动平台,使得所述标靶处于多个不同标靶姿态下,且在每一个标靶姿态下,利用均匀光投射到所述标靶,通过所述摄像设备采集所述标靶姿态下的标靶图像,及利用所述投影设备将条纹图投射到所述标靶,利用所述摄像设备采集所述标靶姿态下的条纹图;步骤2、对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,基于光束平差法,利用多个不同标靶姿态下的标靶图像、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述摄像设备的标定参数,以完成所述摄像设备的标定;步骤3、利用N步相移法分别对多个不同标靶姿态下采集到的条纹图进行解相位及相位展开,得到多个不同标靶姿态下的相位展开图;步骤4、对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,基于光束平差法,利用所述多个不同标靶姿态下的相位展开图、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述投影设备的标定参数,以完成所述投影设备的标定;步骤5、利用所述摄像设备的标定参数及所述投影设备的标定参数对所述三维成像系统进行标定,得到所述三维成像系统的标定参数,以完成所述三维成像系统的标定。
- 根据权利要求1所述的方法,其特征在于,所述步骤2中,所述基于光 束平差法,利用多个不同标靶姿态下的标靶图像、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述摄像设备的标定参数,包括:按照如下公式得到所述摄像设备的标定参数:
- 根据权利要求1所述的方法,其特征在于,所述步骤4中基于光束平差法,利用所述多个不同标靶姿态下的相位展开图、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述投影设备的标定参数,包括:按照如下公式得到所述投影设备的标定参数:
- 根据权利要求1所述的方法,其特征在于,所述步骤5具体包括:步骤51、按照如下公式得到所述三维成像系统的标定参数:Rp·pw+tp=Rs·(Rc·pw+tc)+ts其中,Rp表示所述投影设备外参中的旋转矩阵,tp表示所述投影设备外参中的平移矩阵,Rc表示所述摄像设备外参中的旋转矩阵,tc表示所述摄像设备外参中的平移矩阵,Rs表示三维成像系统的旋转矩阵,ts表示三维成像系统的平移矩阵,pw表示空间中任意一点P的世界坐标向量;其中,Pw=[xw,yw,zw]T;步骤52、对所述三维成像系统的旋转矩阵及平移矩阵进行最小二乘优化,利用优化后的旋转矩阵及平移矩阵确定所述三维成像系统的像素坐标和世界坐标之间的转换关系。
- 一种基于光束平差的远心镜头三维成像系统的标定装置,其特征在于,所述装置应用于三维成像系统,所述三维成像系统包括:具有远心镜头的投影设备、具有远心镜头的摄像设备及可移动平台;所述投影设备的光轴垂直于水平放置的所述可移动平台,所述摄像设备的光轴与所述可移动平台成预设夹角,所述可移动平台上放置标靶,所述可移动平台始终处于所述摄像设备及所述投影设备共同景深范围内,所述标定装置包括:采集模块,用于移动所述可移动平台,使得所述标靶处于多个不同标靶姿态下,且在每一个标靶姿态下,利用均匀光投射到所述标靶,通过所述摄像设备采集所述标靶姿态下的标靶图像,及利用所述投影设备将条纹图投射到所述标靶,利用所述摄像设备采集所述标靶姿态下的条纹图;摄像设备标定模块,用于对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,基于光束平差法,利用多个不同标靶姿态下的标靶图像、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述摄像设备的标定参数,以完成所述摄像设备 的标定;获取模块,用于利用N步相移法分别对多个不同标靶姿态下采集到的条纹图进行解相位及相位展开,得到多个不同标靶姿态下的相位展开图;投影设备标定模块,用于对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,基于光束平差法,利用所述多个不同标靶姿态下的相位展开图、所述标靶的三维坐标系参数及所述初始化后的内参及外参进行联合非线性优化,得到所述投影设备的标定参数,以完成所述投影设备的标定;系统标定模块,用于利用所述摄像设备的标定参数及所述投影设备的标定参数对所述三维成像系统进行标定,得到所述三维成像系统的标定参数,以完成所述三维成像系统的标定。
- 根据权利要求5所述的装置,其特征在于,所述摄像设备标定模块具体用于对所述摄像设备的内参及外参进行初始化,得到所述摄像设备参数初始化后的内参及外参,及按照如下公式得到所述摄像设备的标定参数:
- 根据权利要求5所述的装置,其特征在于,所述投影设备标定模块具体用于对所述投影设备的内参及外参进行初始化,得到所述投影设备初始化后的内参及外参,及按照如下公式得到所述投影设备的标定参数:
- 根据权利要求5所述的装置,其特征在于,所述系统标定模块具体用于:按照如下公式得到所述三维成像系统的标定参数:Rp·pw+tp=Rs·(Rc·pw+tc)+ts其中,Rp表示所述投影设备外参中的旋转矩阵,tp表示所述投影设备外参中的平移矩阵,Rc表示所述摄像设备外参中的旋转矩阵,tc表示所述摄像设备外参中的平移矩阵,Rs表示三维成像系统的旋转矩阵,ts表示三维成像系统的平移矩阵,pw表示空间中任意一点P的世界坐标向量;其中,Pw=[xw,yw,zw]T;以及,对所述三维成像系统的旋转矩阵及平移矩阵进行最小二乘优化,利用优化后的旋转矩阵及平移矩阵确定所述三维成像系统的像素坐标和世界坐标之间的转换关系。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710306655.5 | 2017-05-04 | ||
| CN201710306655.5A CN107230233A (zh) | 2017-05-04 | 2017-05-04 | 基于光束平差的远心镜头三维成像系统的标定方法及装置 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018201677A1 true WO2018201677A1 (zh) | 2018-11-08 |
Family
ID=59934300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/107274 Ceased WO2018201677A1 (zh) | 2017-05-04 | 2017-10-23 | 基于光束平差的远心镜头三维成像系统的标定方法及装置 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107230233A (zh) |
| WO (1) | WO2018201677A1 (zh) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115205399A (zh) * | 2022-07-13 | 2022-10-18 | 深圳市优必选科技股份有限公司 | 不共视多目相机标定方法、装置、机器人及存储介质 |
| CN115953474A (zh) * | 2022-10-11 | 2023-04-11 | 梅卡曼德(北京)机器人科技有限公司 | 参数标定方法、三维重建方法及电子设备、存储介质 |
| CN116309822A (zh) * | 2023-01-31 | 2023-06-23 | 东南大学 | 一种基于多模态特征关联的后端优化方法 |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107230233A (zh) * | 2017-05-04 | 2017-10-03 | 深圳大学 | 基于光束平差的远心镜头三维成像系统的标定方法及装置 |
| CN108489395B (zh) * | 2018-04-27 | 2019-03-22 | 中国农业大学 | 视觉测量系统结构参数标定和仿射坐标系构建方法与系统 |
| CN109341668B (zh) * | 2018-10-11 | 2020-12-22 | 重庆邮电大学 | 基于折射投影模型和光束追踪法的多相机测量方法 |
| CN110176035B (zh) * | 2019-05-08 | 2021-09-28 | 深圳市易尚展示股份有限公司 | 标志点的定位方法、装置、计算机设备和存储介质 |
| CN110298888B (zh) * | 2019-06-12 | 2021-09-07 | 上海智能制造功能平台有限公司 | 基于单轴高精度位移平台的相机标定方法 |
| CN110595374B (zh) * | 2019-09-17 | 2020-05-05 | 中国人民解放军火箭军工程大学 | 基于传递像机的大型结构件实时形变监测方法 |
| CN112489109B (zh) * | 2020-11-19 | 2022-10-21 | 广州视源电子科技股份有限公司 | 一种三维成像系统方法、装置及三维成像系统 |
| CN113188478B (zh) * | 2021-04-28 | 2022-10-18 | 伏燕军 | 一种远心显微三维测量系统混合标定方法 |
| CN114666480B (zh) * | 2022-03-28 | 2023-12-22 | 天津大学 | 基于相位信息的组合成像系统入射光线逐像素标定方法及装置 |
| CN116500851B (zh) * | 2023-06-30 | 2023-09-08 | 苏州华兴源创科技股份有限公司 | 3d成像系统及其标定方法、装置、设备和存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7046839B1 (en) * | 2000-09-19 | 2006-05-16 | Spg Hydro International Inc. | Techniques for photogrammetric systems |
| CN102654391A (zh) * | 2012-01-17 | 2012-09-05 | 深圳大学 | 基于光束平差原理的条纹投影三维测量系统及其标定方法 |
| CN104729429A (zh) * | 2015-03-05 | 2015-06-24 | 深圳大学 | 一种远心成像的三维形貌测量系统标定方法 |
| CN107230233A (zh) * | 2017-05-04 | 2017-10-03 | 深圳大学 | 基于光束平差的远心镜头三维成像系统的标定方法及装置 |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102889882B (zh) * | 2012-09-03 | 2014-11-12 | 北京信息科技大学 | 一种基于光束平差的三维重建方法 |
| CN103528543B (zh) * | 2013-11-05 | 2015-12-02 | 东南大学 | 一种光栅投影三维测量中的系统标定方法 |
-
2017
- 2017-05-04 CN CN201710306655.5A patent/CN107230233A/zh active Pending
- 2017-10-23 WO PCT/CN2017/107274 patent/WO2018201677A1/zh not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7046839B1 (en) * | 2000-09-19 | 2006-05-16 | Spg Hydro International Inc. | Techniques for photogrammetric systems |
| CN102654391A (zh) * | 2012-01-17 | 2012-09-05 | 深圳大学 | 基于光束平差原理的条纹投影三维测量系统及其标定方法 |
| CN104729429A (zh) * | 2015-03-05 | 2015-06-24 | 深圳大学 | 一种远心成像的三维形貌测量系统标定方法 |
| CN107230233A (zh) * | 2017-05-04 | 2017-10-03 | 深圳大学 | 基于光束平差的远心镜头三维成像系统的标定方法及装置 |
Non-Patent Citations (1)
| Title |
|---|
| LIU, RENSI: "Telecentric Lens Calibration and 3D Imaging System Based on Bundle Adjustment", CHINA MASTER'S THESES FULL-TEXT DATABASE ( ELECTRONIC JOURNALS, 15 July 2017 (2017-07-15) * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115205399A (zh) * | 2022-07-13 | 2022-10-18 | 深圳市优必选科技股份有限公司 | 不共视多目相机标定方法、装置、机器人及存储介质 |
| CN115953474A (zh) * | 2022-10-11 | 2023-04-11 | 梅卡曼德(北京)机器人科技有限公司 | 参数标定方法、三维重建方法及电子设备、存储介质 |
| CN116309822A (zh) * | 2023-01-31 | 2023-06-23 | 东南大学 | 一种基于多模态特征关联的后端优化方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107230233A (zh) | 2017-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018201677A1 (zh) | 基于光束平差的远心镜头三维成像系统的标定方法及装置 | |
| CN110296691B (zh) | 融合imu标定的双目立体视觉测量方法与系统 | |
| CN106408556B (zh) | 一种基于一般成像模型的微小物体测量系统标定方法 | |
| CN106595528B (zh) | 一种基于数字散斑的远心显微双目立体视觉测量方法 | |
| CN109323650B (zh) | 测量系统中视觉图像传感器与光点测距传感器测量坐标系的统一方法 | |
| CN106548489B (zh) | 一种深度图像与彩色图像的配准方法、三维图像采集装置 | |
| Douxchamps et al. | High-accuracy and robust localization of large control markers for geometric camera calibration | |
| Gai et al. | A novel dual-camera calibration method for 3D optical measurement | |
| CN109272555B (zh) | 一种rgb-d相机的外部参数获得及标定方法 | |
| CN103759670A (zh) | 一种基于数字近景摄影的物体三维信息获取方法 | |
| CN116309879B (zh) | 一种机器人辅助的多视角三维扫描测量方法 | |
| CN115861445A (zh) | 一种基于标定板三维点云的手眼标定方法 | |
| Chen et al. | Self-recalibration of a colour-encoded light system for automated three-dimensional measurements | |
| CN112229323A (zh) | 基于手机单目视觉的棋盘格合作目标的六自由度测量方法及其应用 | |
| CN103366356A (zh) | 通用标定系统和方法及其集成成像重构系统和方法 | |
| CN115661226B (zh) | 镜面物体的三维测量方法、计算机可读存储介质 | |
| CN113034565A (zh) | 一种单目结构光的深度计算方法及系统 | |
| CN114037768A (zh) | 一种多套跟踪式扫描仪联合标定的方法和装置 | |
| JP2006098065A (ja) | キャリブレーション装置および方法、ならびにそれらを利用可能な3次元モデリング装置および3次元モデリングシステム | |
| CN104794718A (zh) | 一种单图像ct机房监控摄像机标定的方法 | |
| CN116500851B (zh) | 3d成像系统及其标定方法、装置、设备和存储介质 | |
| CN113251953B (zh) | 一种基于立体偏折技术的镜面夹角测量装置和方法 | |
| CN118982585B (zh) | 相机标定方法、装置、设备及存储介质 | |
| CN119359817A (zh) | 一种远心三维测量系统标定方法 | |
| Oniga et al. | Metric and Non-Metric Cameras Calibration for the Improvement of Real-Time Monitoring Process Results. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17908223 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17908223 Country of ref document: EP Kind code of ref document: A1 |









