CN106643563B - A kind of Table top type wide view-field three-D scanning means and method - Google Patents

A kind of Table top type wide view-field three-D scanning means and method Download PDF

Info

Publication number
CN106643563B
CN106643563B CN201611117477.3A CN201611117477A CN106643563B CN 106643563 B CN106643563 B CN 106643563B CN 201611117477 A CN201611117477 A CN 201611117477A CN 106643563 B CN106643563 B CN 106643563B
Authority
CN
China
Prior art keywords
field
depth
cameras
laser
scanning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611117477.3A
Other languages
Chinese (zh)
Other versions
CN106643563A (en
Inventor
李欢欢
刘涛
车玉彩
郭迪
姚东
明向业
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xi'an Like Photoelectric Technology Co Ltd
Original Assignee
Xi'an Like Photoelectric Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Like Photoelectric Technology Co Ltd filed Critical Xi'an Like Photoelectric Technology Co Ltd
Priority to CN201611117477.3A priority Critical patent/CN106643563B/en
Publication of CN106643563A publication Critical patent/CN106643563A/en
Application granted granted Critical
Publication of CN106643563B publication Critical patent/CN106643563B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2518Projection by scanning of the object
    • G01B11/2522Projection by scanning of the object the position of the object changing and being recorded
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/254Projection of a pattern, viewing through a pattern, e.g. moiré

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a kind of Table top type three-dimensional scanner and method, a kind of Table top type wide view-field three-D scanning means is made of multiple groups camera, laser MEMS galvanometer projector and precision rotation platform, and projector is arranged among multiple groups camera, is used for projecting structural optical;Multiple groups camera is symmetrically distributed in projector two sides, wherein symmetrical two cameras are one group.The present invention can cover the 3-D scanning from smaller size smaller to bulky objects, and object is smaller, and measurement accuracy is higher;One-touch scanning may be implemented in this method, obtains 360 degree of relatively good complete models.

Description

Desktop type large-view-field three-dimensional scanning device and method
Technical Field
The invention belongs to the field of optical detection, relates to an optical detection method for a three-dimensional profile, and particularly relates to a structured light three-dimensional measurement method with large depth of field and large field of view.
Background
Three-dimensional scanning has important application in the aspects of reverse engineering, industrial detection, cultural relic protection and the like, and along with the popularization of 3D printing, the three-dimensional scanning has wider application in the industries of reverse design, education training and the like. The existing three-dimensional scanners mainly aim at the professional fields of industrial detection and the like, and few scanners are provided for common consumers in industries such as vast reverse design and 3D printing education.
At present, the three-dimensional scanning generally adopts methods such as laser line scanning, white light structured light, stereoscopic vision and the like. The laser line scanning is developed most mature, the depth of field of measurement is large, but the efficiency is low, the splicing precision is low, the requirement on the precision of a moving device is high, and the cost is high. The white light structure is high in light efficiency, but its system calibration is difficult. The uncertainty of stereo matching in the stereo vision technology is low measurement precision. The phase shift profilometry in the white light structured light is combined with a binocular stereo vision method, so that the problems of difficult calibration of the phase shift profilometry and difficult stereo vision matching are solved. However, this approach requires encoding the light by a DLP projection device, whose measurement depth of field is limited by the projection depth of field; and simultaneously measuring the influence of the triangular relation included angle of the view field by binocular vision. In practical use, the sizes and the shapes of objects are different, and the measurement is invalid due to insufficient depth of field.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a desktop type three-dimensional scanning device, which adopts a laser MEMS galvanometer projection device to improve the depth of field of projection; capturing deformation fringe patterns in different view field ranges by adopting a plurality of groups of cameras, and improving the measurement range; and calibrating the position relation among the angle models by using a precision rotating table to splice the angle models into a complete model. The invention can cover three-dimensional scanning from a small volume to a large volume, and the smaller the measured object is, the higher the measurement precision is; the method can realize one-click scanning and obtain a better 360-degree complete model.
The invention aims to provide a three-dimensional scanning device for a desktop type large-view-field table.
The technical scheme is as follows:
the system consists of 4 to 10 cameras, 1 laser MEMS galvanometer projection device and a precise rotating platform; the laser MEMS galvanometer projection device is arranged in the middle and used for projecting structured light, the cameras are symmetrically arranged on two sides of the laser MEMS galvanometer projection device in pairs, and the distances among the symmetrically arranged cameras are L1, L2, L3, L4 and L5, wherein L1< L2< L3< L4< L5; the turret is placed within one or more fields of view of the camera. The turret is placed within one or more fields of view of the camera.
The laser MEMS galvanometer scanning projection device is used as a projection light source for three-dimensional scanning, the laser MEMS galvanometer scanning projection system is different from the traditional DLP, LCD and other projection systems, and is not provided with a projection lens. Because the light source is laser, the projection depth range is greatly improved.
The multiple groups of cameras are respectively used for shooting structured light in different fields of view to match the depth of field of the projection device, and the measuring range of the scanner is enlarged. The cost of the camera is much lower than that of the projection device, so that the cost of the equipment is not greatly increased, but the measurement range and the performance are greatly improved. Meanwhile, the basic conditions of binocular stereo vision are met, the visual fields of each group of cameras are overlapped as much as possible, and the included angle is generally 10-60 degrees, and preferably 15-45 degrees.
When the device is used for three-dimensional scanning, an object is placed on a rotating table and rotates for N times, wherein the rotating table rotates for α degrees each time, N is 360/α times, N is an integer, each time, a group of grating patterns or linear patterns are projected on the surface of the object by a laser MEMS galvanometer, the patterns on the surface of the object are shot by the camera, and the patterns are transmitted to a computer for three-dimensional point cloud calculation;
calibrating the position relation between the center of the precision rotating platform and the camera, and carrying out rigid transformation on the three-dimensional model reconstructed at each angle according to the calibration result to obtain a roughly spliced complete model; and performing optimized splicing by using ICP (inductively coupled plasma) to obtain a 360-degree three-dimensional digital model.
Advantageous effects
The invention uses the laser MEMS galvanometer projection device as a projection light source for three-dimensional structured light measurement, thereby greatly improving the projection depth of field; adopting a plurality of groups of camera designs to match the projection field of view; compared with the traditional three-dimensional scanner, the scanning range is increased by 3-5; the measurement accuracy of different sizes is different, and the accuracy of small objects is better; the precise rotary table is adopted for matching, so that the matching robustness is high, the effect is good, and the use difficulty of a user is reduced; the portable design of the turntable reduces the volume and weight of the product.
Drawings
FIG. 1 is a Gaussian laser beam propagation diagram;
FIG. 2 is a schematic diagram of a three-dimensional scanner structure arrangement;
FIG. 3 is a schematic view of a camera coordinate system and a turntable coordinate system;
wherein: 21-laser MEMS galvanometer projection device; 22-camera; a-range of small size objects; b-range of medium size objects; C-Large size object Range.
The specific implementation mode is as follows:
the calculation of the measurement range of the scanner is mainly determined by the projection device, the measurement range is matched by adopting a plurality of groups of cameras, and the configuration parameters of the scanner system are calculated as follows:
firstly, determining depth of field calculation of a laser MEMAS galvanometer projection system:
as shown in fig. 1, a gaussian laser beam emitted from a laser 11 passes through a collimating lens 12, and then enters an MEMS scanning galvanometer 13 and is reflected to the surface of an object. The focal plane of the Gaussian beam is L0At, the depth of field is Δ L. Calculating the spot size and the maximum working distance L of the light beam after passing through the lens according to the ABCD matrix2Size of spot omega2Minimum working distance L1The size of the light spot is omega1Finally, L is determined by the following constraint of 1-11And L2
The depth of field of the laser MEMS galvanometer projection device can be determined according to the requirement of a measurement range. Second, designing the number of cameras to match the depth of field of the projection
The typical optical imaging system has a depth of field calculation formula of
In the formula: Δ L-Camera depth of field; Δ L1、ΔL2-the front and back depth of field of the imaging system; delta-the allowable circle diameter of dispersion, typically 2 times the size of the image element; f is the F number of the lens; l is the object distance. For example, F is 20mm, F is 2.0, and L is 500 mm; the pixel size is 7.5 μm, so δ is 0.015 mm. The depth of field DeltaL is calculated by a formula 3-2C1=75mm。
The system is compatible with measuring objects with different sizes, and has higher measuring precision for A group of small objects, the optical axes of each group of cameras are intersected at the center of the measuring view field, and the included angle is generally between 10 and 60 degrees, preferably between 15 and 45 degrees as shown in the following figure.
Mode of operation and data processing
The scanning mode of the desktop three-dimensional scanner designed by the invention is as follows, if the system comprises three groups of cameras:
1. designing a system:
selecting a measuring camera group such as group A, group B and group C according to the size of the measured object; each group of cameras corresponds to different measuring ranges, namely different sizes of measured objects.
a) Determining the measuring range, namely the depth range, of the laser MEMS galvanometer projection device according to the formula;
b) calculating the depth of field, namely the depth range, of the selected camera;
c) according to the method in the above inventive content, a suitable camera group is selected.
2. Rotary table calibration
As shown in the following figure, we use the rotation coordinate system as the world coordinate system and set a point Pw(xw,yw,zw) Is an arbitrary point on the object to be measured, point Pθ(x,y,z) The coordinates corresponding to point P when the turntable is rotated counterclockwise about the axis by an angle θ, then they satisfy the relationship:
p=Rzpθ
wherein p isw(xw,yw,zw,1)TAnd pθ(x,y,z,1)TIs Pw(xw,yw,zw) And Pθ(x,y,z) Homogeneous coordinate in the turntable coordinate system, RzIs a corresponding rotation matrix when the rotating platform rotates around the axis by an angle theta,
model point coordinate P obtained by reconstruction of actual personc(xc,yc,zc) Is in the camera coordinate system and corresponds to the point P in the world coordinate systemw(xw,yw,zw) Satisfies the following conditions: pc=RPw+T。
The coordinate transformation between the camera coordinates and the world coordinates obtained from the above formula can be represented by R (α, γ) and T (T ═ R (α, γ)x,ty,tz)Tα, gamma is the Euler angle of rotation around the x, y and z axes respectively, when coordinate transformation is performed successively with the x, y and z rotation,
let Pc(xc,yc,zc) And Pw(xw,yw,zw) Corresponding to a homogeneous coordinate of pc(xc,yc,zc1) and pw(xw,yw,zw1), then pc=Mpw
Wherein,since there is no requirement for the x-and y-axis directions by point cloud stitching with the rotating table coordinate system, γ can be set to 0, and the transformation matrix M can be simplified as:
thus, for the known point P in the camera coordinate system that we have reconstructedc(xc,yc,zc) The turntable rotates anticlockwise around the axis by an angle theta corresponding to a point P(x,y,z) They satisfy:
pc=MRzM-1p \*MERGEFORMAT(3-7)
wherein p isc(xc,yc,zc1) and p(x,y,z1) is Pc(xc,yc,zc) And P(x,y,z) Corresponding homogeneous form.
Correctly placing the rotating table, and marking the chessboard grids at the center of the rotating table where the board is placed so that the object is in the centers of two images of a group of cameras; calculating the coordinate P of the corner point on the calibration plate under the camera coordinate systemc(xc,yc,zc) Two calibration plate pictures are taken every 10 ° rotation between ± 60 ° and their world coordinates are calculated.
Thus, we obtained a series of pc(xc,yc,zc1) and p(x,y,z1), wherein
M is obtained from the above equation.
3. The object to be measured is placed on the rotating table, and is scanned once, that is, after the rotating table rotates α degrees each time, the rotating table is stationary for a period of time, the scanner completes model scanning of one angle, and performs N times of rotation measurement, where N is 360/α times (N is an integer), for example, α is 45 °, and N is 8.
4. According to the calibrated rotating table center result, carrying out rigid transformation on each angle, namely using to obtain a roughly spliced complete model;
the reconstructed known point P in the camera coordinate systemc(xc,yc,zc) The angle α at which the turntable rotates anticlockwise about the axis corresponds to point P(x,y,z) They satisfy:
pc=MRzM-1p
wherein p isc(xc,yc,zc1) and P(x,y,z1) is Pc(xc,yc,zc) And P(x,y,z) Corresponding homogeneous form. The matrix M is obtained from step 2 turntable calibration,
Rzis the corresponding rotation matrix when the turntable rotates around the axis by an angle α,α is the angle of rotation set manually in step 3.
Therefore, we use Pose ═ MR for the corresponding modelszM-1And the result matrix is subjected to coordinate transformation to finish rough splicing of the point cloud model data.
5. Carrying out accurate splicing by using ICP (iterative Closed Point);
although the present invention has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (3)

1. A desktop type large-view-field three-dimensional scanning device is characterized by comprising 10 cameras, 1 laser MEMS galvanometer projection device and a precise rotating platform, wherein the laser MEMS galvanometer projection device is arranged in the middle and used for projecting structured light, the cameras are symmetrically arranged on two sides of the laser MEMS galvanometer projection device in pairs, the distances among the symmetrically arranged cameras are L1, L2, L3, L4 and L5, L1< L2< L3< L4< L5, the rotating platform is arranged in one or more view field ranges of the cameras, an object is placed on the rotating platform to rotate N times during three-dimensional scanning, the object rotates α degrees every time, N is 360/α times, N is an integer, the laser MEMS galvanometer is used for projecting a group of patterns or linear patterns to the surface of the object once per rotation, the patterns on the surface of the object are transmitted to a shooting computer for three-dimensional calculation, the position relation between a calibration center and the cameras is calibrated, coarse grating angle reconstruction is carried out according to the grating angle, rigid splicing is carried out, and a point cloud model is obtained, and a complete three-dimensional calculation is carried out.
2. The scanning method of the desktop type large-field-of-view three-dimensional scanning device based on claim 1 is characterized in that: the scanner part adopts a laser MEMS galvanometer projection device to project structured light so as to improve the depth of field of projection; capturing deformation fringe patterns in different view field ranges by adopting a plurality of groups of cameras, and improving the measurement range; and calibrating the position relation among the angle models by using a precision rotating table, and splicing the scanning results of the three-dimensional scanner into a complete 360-degree model.
3. The scanning method of the desktop type large-field-of-view three-dimensional scanning device according to claim 2, wherein the calculation of the measurement range of the three-dimensional scanner is determined by the projection device, the measurement range is covered by a plurality of sets of cameras, and the configuration parameters of the scanner system are calculated as follows:
firstly, determining depth of field calculation of a laser MEMS galvanometer projection system:
after passing through a collimating lens, a Gaussian laser beam emitted by a laser is incident on an MEMS scanning galvanometer and then reflected to the surface of an object; the focal plane of the Gaussian beam is L0The depth of field is Δ L; calculating the spot size and the maximum working distance L of the light beam after passing through the lens according to the ABCD matrix2Size of spot omega2Minimum working distance L1The size of the light spot is omega1Finally, L is determined by the following constraint of 1-11And L2
Determining the depth of field of the laser MEMS galvanometer projection device according to the requirement of a measurement range;
secondly, designing the number of cameras to match the depth of field of the projection:
the typical optical imaging system has a depth of field calculation formula of
In the formula: Δ L-Camera depth of field; Δ L1-the front depth of field of the imaging system; Δ L2-a back field of view of the imaging system; delta-the allowable circle diameter of dispersion, typically 2 times the size of the image element; f is the F number of the lens; l is the object distance.
CN201611117477.3A 2016-12-07 2016-12-07 A kind of Table top type wide view-field three-D scanning means and method Active CN106643563B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611117477.3A CN106643563B (en) 2016-12-07 2016-12-07 A kind of Table top type wide view-field three-D scanning means and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611117477.3A CN106643563B (en) 2016-12-07 2016-12-07 A kind of Table top type wide view-field three-D scanning means and method

Publications (2)

Publication Number Publication Date
CN106643563A CN106643563A (en) 2017-05-10
CN106643563B true CN106643563B (en) 2019-03-12

Family

ID=58819814

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611117477.3A Active CN106643563B (en) 2016-12-07 2016-12-07 A kind of Table top type wide view-field three-D scanning means and method

Country Status (1)

Country Link
CN (1) CN106643563B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107144236A (en) * 2017-05-25 2017-09-08 西安交通大学苏州研究院 A kind of robot automatic scanner and scan method
CN109961463B (en) * 2017-12-14 2021-12-31 北京京东尚科信息技术有限公司 View registration method, system, device and storage medium based on dual quaternion
CN109186493B (en) * 2018-04-17 2021-02-19 苏州佳世达光电有限公司 Three-dimensional scanning system
CN109242873B (en) * 2018-08-22 2022-10-11 浙江大学 Method for carrying out 360-degree real-time three-dimensional reconstruction on object based on consumption-level color depth camera
CN110609386B (en) * 2019-08-16 2020-10-13 浙江大学 Design method and application of small-F-number large-depth-of-field lens based on superlens
CN111750805B (en) * 2020-07-06 2021-12-10 山东大学 Three-dimensional measuring device and method based on binocular camera imaging and structured light technology
CN116571875B (en) * 2023-07-13 2023-11-03 西南交通大学 Laser processing and detecting integrated equipment and method based on active projection technology

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101726257A (en) * 2009-12-22 2010-06-09 西安交通大学 Multiple large range laser scanning measurement method
JP2012202803A (en) * 2011-03-25 2012-10-22 Space Vision:Kk Patterned light projecting apparatus and method
CN104299211A (en) * 2014-09-25 2015-01-21 周翔 Free-moving type three-dimensional scanning method
CN104303091A (en) * 2013-03-11 2015-01-21 英特尔公司 Mems scanning mirror field of view provision methods and apparatus

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10036631B2 (en) * 2012-05-01 2018-07-31 Texas Department Of Transportation System and method for measuring three-dimensional surface features

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101726257A (en) * 2009-12-22 2010-06-09 西安交通大学 Multiple large range laser scanning measurement method
JP2012202803A (en) * 2011-03-25 2012-10-22 Space Vision:Kk Patterned light projecting apparatus and method
CN104303091A (en) * 2013-03-11 2015-01-21 英特尔公司 Mems scanning mirror field of view provision methods and apparatus
CN104299211A (en) * 2014-09-25 2015-01-21 周翔 Free-moving type three-dimensional scanning method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Angle extended linear MEMS scanning system for 3D laser vision sensor;Pang,YJ 等;《NFRARED PHYSICS & TECHNOLOGY》;20160930;第78卷;第129-132页
基于数字微镜的旋转体三维显示装置研究;李莉 等;《仪器仪表学报》;20080115(第1期);第67-72页

Also Published As

Publication number Publication date
CN106643563A (en) 2017-05-10

Similar Documents

Publication Publication Date Title
CN106643563B (en) A kind of Table top type wide view-field three-D scanning means and method
CN107063129B (en) A kind of array parallel laser projection three-dimensional scan method
CN110447220B (en) Calibration device, calibration method, optical device, imaging device, and projection device
CN111750806B (en) Multi-view three-dimensional measurement system and method
CN104376558B (en) Cuboid-based intrinsic parameter calibration method for Kinect depth camera
Schmalz et al. Camera calibration: active versus passive targets
CN106056587A (en) Full-view linear laser scanning 3D imaging calibration device and full-view linear laser scanning 3D imaging calibration method
CN112489109B (en) Three-dimensional imaging system method and device and three-dimensional imaging system
Zou et al. High-accuracy calibration of line-structured light vision sensors using a plane mirror
CN104197846B (en) Method for measuring displacement of reflector based on characteristic pattern reflection
CN109490251A (en) Underwater refractive index self-calibrating method based on light field multilayer refraction model
Wilm et al. Accurate and simple calibration of DLP projector systems
Song et al. Full-view three-dimensional measurement of complex surfaces
Lin Automatic 3D color shape measurement system based on a stereo camera
CN103559710B (en) A kind of scaling method for three-dimensional reconstruction system
CN109506629B (en) Method for calibrating rotation center of underwater nuclear fuel assembly detection device
Yu et al. An improved projector calibration method for structured-light 3D measurement systems
Li et al. Principal observation ray calibration for tiled-lens-array integral imaging display
CN114111626B (en) Light field camera three-dimensional measurement device and system based on coaxial projection
JP4429135B2 (en) Three-dimensional shape measurement system and measurement method
JP2006308452A (en) Method and apparatus for measuring three-dimensional shape
Vehar et al. Single-shot structured light with diffractive optic elements for real-time 3D imaging in collaborative logistic scenarios
Wang et al. Three-dimensional panoramic sensor based on a variable-frequency fringe pattern
KR102591844B1 (en) Apparatus for camera calibration using mirrors
Xie et al. A full-body 3D reconstruction using planar mirrors

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: A desktop large field of view 3D scanning device and method

Effective date of registration: 20210121

Granted publication date: 20190312

Pledgee: Pudong Development Bank of Shanghai Limited by Share Ltd. Xi'an branch

Pledgor: XI'AN CHISHINE OPTOELECTRONICS TECHNOLOGY Co.,Ltd.

Registration number: Y2021610000019