CN100573040C - The scaling method of object surface three-dimensional contour structure light measurement system - Google Patents

The scaling method of object surface three-dimensional contour structure light measurement system Download PDF

Info

Publication number
CN100573040C
CN100573040C CNB200810019813XA CN200810019813A CN100573040C CN 100573040 C CN100573040 C CN 100573040C CN B200810019813X A CNB200810019813X A CN B200810019813XA CN 200810019813 A CN200810019813 A CN 200810019813A CN 100573040 C CN100573040 C CN 100573040C
Authority
CN
China
Prior art keywords
target plate
target
projector
black
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB200810019813XA
Other languages
Chinese (zh)
Other versions
CN101245994A (en
Inventor
程筱胜
戴宁
廖文和
崔海华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Aeronautics and Astronautics
Original Assignee
Nanjing University of Aeronautics and Astronautics
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Aeronautics and Astronautics filed Critical Nanjing University of Aeronautics and Astronautics
Priority to CNB200810019813XA priority Critical patent/CN100573040C/en
Publication of CN101245994A publication Critical patent/CN101245994A/en
Application granted granted Critical
Publication of CN100573040C publication Critical patent/CN100573040C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

A kind of scaling method of object surface three-dimensional contour structure light measurement system belongs to method for three-dimensional measurement and Instrument technology field.It is made up of following steps: (1) black and white camera calibration; (2) projector calibrating; (3) many plane references method obtains the required parameter of total system; It is characterized in that: (4) described target plate is colored target plate, and the prospect on the target plate and background colour are two kinds of two kinds of colors that the black and white camera had same reflecting properties; (5) when (1) goes on foot the black and white camera calibration, throw a kind of colorama to the target plate, this colorama is identical with one of background colour with target plate prospect.The inventive method has higher stability, reliability than traditional use black and white target plate, has improved stated accuracy, accurately important effect is arranged aspect the measurement at object surface three-dimensional contour structure light.

Description

The scaling method of object surface three-dimensional contour structure light measurement system
Affiliated technical field
A kind of scaling method of object surface three-dimensional contour structure light measurement system relates to the computer vision measurement field, belongs to method for three-dimensional measurement and Instrument technology field, relates in particular to the demarcation occasion to structured light measurement system.
Background technology
The three-dimensional measurement technology of object should have very general in fields such as product design and manufacturing, quality testing and control, robot vision.The structural light measurement technology is the branch of a very important and development prospect in the three-dimensional measurement technology, and whether the accurate demarcation of measuring system is prerequisite and the key condition that can system accurate reconstruction.It is exactly geometry and the optical characteristics of obtaining video camera and projector inside that measuring system is demarcated, i.e. the coordinate system of inner parameter, and two instruments is with respect to the position relation of space coordinates, i.e. external parameter.
The demarcation of structured light measurement system comprises two parts, the one, and to the demarcation of camera, the 2nd, to the demarcation of projector.To the present Tsa i of the demarcation of camera based on radial constraint unanimity (RAC) [R.Y.Tsai, " A Versatile CameraCalibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-shelf TVCameras and Lenses; " IEEE Joumal of Robotics Automation.Vol.RA-3.No.4, August 1987.] the most commonly used, this method is earlier by the linear dimensions that radially collimates the constraint solving camera model, introduce nonlinear parameter then, adopt process of iteration to obtain whole parameter.Demarcation to projector has also had certain research at present, is the most widely the reverse model that projector is used as camera is demarcated scaling method and similar to the demarcation of camera.But to the structural light measurement that camera and projector integrate is that body is demarcated, and just has a lot of restrictive conditions.With the circular index point is the target pattern, concrete scaling method is: at first to camera calibration, camera is gathered known coordinate space target dot image, by the noise filtering to image, Threshold Segmentation, profile extracts, oval identification, extract at ellipse fitting and center, obtains the two dimensional image coordinate of three-dimensional target punctuate, corresponding each the 3-d and 2-d point of coupling adopts the scaling method of Tsai that camera is demarcated to as the input data; Then, projector is demarcated: because projector do not have image collecting function, therefore, it is right to adopt auxiliary structured light or other coding mode to obtain to be used for the two-dimentional three-dimensional target punctuate of projector calibrating indirectly to the demarcation of projector.Mode one, the target Board position that assurance is used for camera calibration is known, the circle of projector projects known coordinate or square pattern are to being used for camera calibration target plate, camera collects the pattern of projection, detect central coordinate of circle, utilize the camera parameter of demarcation and the coordinate of target plate Z direction, reconstruct the space three-dimensional target point coordinate of the pattern of projector projects, the corresponding two-dimentional three-dimensional point of coupling is demarcated conduct and is imported data; Mode two, the target Board position that assurance is used for camera calibration is known, the strip encoding of projector projects structured light is to the target plate, camera collects strip encoding, utilize (Gray+phase) Gray code+phase-shifting technique decoding technique to obtain the encoded radio of each target point two-dimensional pixel coordinate, the encoded radio of each target point is matched in the projector, and the pixel coordinate in the projector is exactly the two-dimensional pixel coordinate of three-dimensional target punctuate, has realized the function of " extracting " image of projector.The two-dimentional three-dimensional point of coupling correspondence is to carrying out the demarcation of projector as the input data.Find from above method, in the demarcation to projector, guarantee the location aware of target, the projector projects image, the camera images acquired, it is exactly the demarcation that target point on the target is used for camera and projector simultaneously, and the demarcation pattern that is used for camera and projector is different, when the projection coding mode is used for projector calibrating on traditional black and white target pattern so, the target image of gathering will be subjected to being used to demarcating the influence of the target pattern of camera, can not obtain good target pattern, seriously influence the precision of demarcating.
Summary of the invention
Deficiency at existing method, a kind of scaling method that utilizes the object surface three-dimensional contour structure light measurement system of colored target pattern has been proposed, characteristic according to optics has well solved above problem, and guaranteed that the target pattern of gathering is the very high black of contrast, make table fixed more reliable and more stable.
A kind of scaling method of object surface three-dimensional contour structure light measurement system, form by following steps:
(1), black and white camera calibration: camera collects and is used for camera calibration target image clearly, utilize image process method, extract the two-dimensional pixel coordinate of target point, known target point three-dimensional coordinate and corresponding two-dimensional pixel coordinate are stored in the demarcation input data of this locus as the target plate;
(2), projector calibrating: keep the target plate in this locus, the target plate is under the irradiation of white light, projector projects black and white encode grating is to the target plate, the camera collection has the target image of grating fringe, utilize decoding technique to obtain the encoded radio of each pixel, correspond to the pixel coordinate that has the same-code value in the projector according to encoded radio, obtain this pixel coordinate in projector.The three-dimensional coordinate of this point and in projector corresponding one dimension pixel coordinate store in the demarcation input data of this locus as the target plate;
(3), the target plate is accurately moved a certain distance repetition (1), (2) step along the direction perpendicular to the target plate, at least move three times, the multi-group data that obtains is imported data as demarcating, use many plane references method to carry out system calibrating, obtain the parameter of camera and the final required demarcation of projector;
It is characterized in that:
(4), described target plate is colored target plate, and the prospect on the target plate and background colour are two kinds of two kinds of colors that the black and white camera had same reflecting properties.During projector calibrating: colored target plate is under the irradiation of white light, and the projector projects grating pattern is to the target plate, and black-white CCD phase function collects and not influenced by the pattern of scaling board own, the good grating encoding stripe pattern of half-tone information;
(5), when (1) step black and white camera calibration, throw a kind of colorama to the target plate, this colorama is identical with one of background colour with target plate prospect.During the black and white camera calibration: because a kind of color target pattern only reflects the light that has same color with it, the colour demarcation pattern of taking in the black-white CCD camera so is the good black white image of black white contrast.Wherein identical with projection light color target pattern presents white in soot-and-whitewash, the target patterns different with the projection light color present black in soot-and-whitewash.Can utilize projector to finish with the described projection colorama of this step, to have avoided the complicated of device.
The present invention adopts two kinds the black and white camera had same emanative two kinds of colors respectively as target plate foreground and background colour.Tradition black and white target plate, when projector calibrating, black and white target image has interference to the half-tone information collection of encode grating image, and it is influential to find the solution phase decoding.And adopt colored target to avoid this problem.
On the basis of adopting colored target plate, utilize a kind of colorama the same of optical characteristics projection to colored target plate, in the black and white camera, can obtain and the strong black white image of contrast that traditional black and white target plate has the equal in quality effect with target plate prospect or background colour.
The inventive method has higher stability, reliability than traditional black and white target plate method, has improved stated accuracy.
Description of drawings
Fig. 1 is used for the circular colored target synoptic diagram of system calibrating for the present invention, and the target disc thing is that foreground is red, and target backboard scenery be a blueness.
Fig. 2 is the colored target plate of the present invention target plate image that the black and white camera collects under the irradiation of ruddiness.
The grating fringe target image that Fig. 3 presents in camera for the conventional target target.
Fig. 4 is the colored target plate of the present invention projector projects that camera collects under white light grating fringe target image to the target plate.
Fig. 5 sets up the schematic diagram of 3 d space coordinate for target plate of the present invention.
Specific embodiments
Below the inventive method is described in further details in conjunction with the accompanying drawings.The present invention uses simple color plane target first, and all parameters of structure light vision measuring systems camera and two parts of projector are demarcated.
The target plate is made.Fig. 1 is a colored target of the present invention, and the target disc thing is that foreground is red, and target plate background color is that background colour is blue.This target is a printing color target round dot on an irreflexive viscose paper, be attached to flatness less than on 0.01 the flat board, this target dot matrix is classified M * N as, ranks are strict vertical, the centre distance of circular hole equates and known (Δ x, Δ y), is that with traditional target difference target of the present invention is colored, under certain illumination, can obtains and the black and white gray scale target image of traditional black and white target effect same.The straight line at place, the horizontal center of circle of target image is an X-axis, and vertically the straight line at place, the center of circle is a Y-axis, is the Z axle with vertical target target direction, sets up space coordinates, and coordinate system meets the right-hand rule.Among the figure near the center big radius of circle be 1.5 or 2 times of roundlet, guarantee obviously to distinguish out both use so that detect ordering.
Demarcation pre-treatment work.Open camera and projector, adjust the target plate in the common visual field of camera and projector and the best depth of field, the projector projects red light source adjusts camera lens and make the phase function see a good target pattern of contrast, and the target image is enough clear to the target plate.The projector projects grating fringe makes the phase function see that a half-tone information well has grating fringe target pattern by adjusting camera aperture.
Camera calibration input data are obtained.The projector projects red light source is to the target plate, red identical with foreground in the target plate, because the characteristic of optics, because a kind of color target pattern only reflects the light that has same color with it, the colour demarcation pattern of taking in the black-white CCD camera so is black and white.Camera collects the good and target image clearly of black white contrast, to the picture noise filtering, and Threshold Segmentation, profile extracts, oval identification, extract at ellipse fitting and center, obtains the two dimensional image sub-pix central coordinate of circle of the target point of known three-dimensional coordinate on the target plate.Three peacekeeping two-dimensional coordinates of mark on the target plate to as demarcating the input data storage.The black and white that collects is demarcated pattern such as Fig. 2.
Projector calibrating input data are obtained.Projector does not have the function of images acquired, therefore, obtain the picture point of calibration point at projector by round-about way.The projector projects encode grating utilizes the method for encoded light and phase shift to obtain the encoded radio of every bit on the photographic images to target, finds the picture point of calibration point in projector according to encoded radio.For the same pixel coordinate point that guarantees camera calibration and twice shooting of projector calibrating corresponding to same three-dimensional target punctuate, guarantee that the target plate is constant in this locus, projector projects encode grating striped light is to the target plate, camera capturing and coding grating pattern such as Fig. 4, the raster image that camera collects is not subjected to the influence of the alternate target plate that is used for camera calibration of the red indigo plant of bottom, obtain good grating fringe half-tone information, avoided traditional black and white bottom that is subjected to be used for the influence of the target pattern of camera calibration, by Flame Image Process raster image is carried out coding-decoding operation, obtain the encoded radio of each picture element, because during the projector projects raster image, on projecting apparatus screen to identical encoded radio should be arranged, the pixel coordinate that has the same-code value in camera and the projector is mapped, just realized the coupling of picture in camera and projector of same three-dimensional coordinate point, make projector have the function of " extracting " image, thereby obtained the picture point of three-dimensional target punctuate in projector.So just realized the acquisition function of a position target image.
Obtain a plurality of position calibration input data.Promptly (the z distance repeats above step, collects the picture point of the demarcation input data of the camera of a reposition and projector perpendicular to the direction running target target of target plate along the z direction of principal axis.In order to obtain more accurate calibrating parameters, the target plate should cover bigger area of space such as Fig. 5 in the position in space as far as possible.
Systematic parameter is obtained in demarcation.As the input data, use many plane references of RAC method of Tsai to carry out system calibrating three-dimensional target punctuate corresponding in many planes, space and corresponding picture point, obtain the systematic survey parameters needed.So just realized the accurate demarcation of object surface three-dimensional contour structure light measurement system.

Claims (3)

1, a kind of scaling method of object surface three-dimensional contour structure light measurement system, form by following steps:
(1), black and white camera calibration: camera collects and is used for camera calibration target image clearly, utilize image process method, extract the two-dimensional pixel coordinate of target point, known target point three-dimensional coordinate and corresponding two-dimensional pixel coordinate are stored in the demarcation input data of this locus as the target plate;
(2), projector calibrating: keep the target plate motionless in this locus, the target plate is under the irradiation of white light, projector projects black and white encode grating striped is to the target plate, the camera collection has the target image of grating fringe, utilize decoding technique to obtain the encoded radio of each pixel, correspond to the pixel coordinate that has the same-code value in the projector according to encoded radio, obtain this pixel coordinate in projector, the three-dimensional coordinate of this point and in projector corresponding one dimension pixel coordinate store in the demarcation input data of this locus as the target plate;
(3), the target plate is accurately moved a certain distance along the direction perpendicular to the target plate, repetition (1), (2) step, at least move three times, the multi-group data that obtains is imported data as demarcating, use many plane references method to obtain the parameter of camera and the final required demarcation of projector;
It is characterized in that:
(4), described target plate is colored target plate, and the prospect on the target plate and background colour are two kinds of two kinds of colors that the black and white camera had same reflecting properties;
(5), in (1) step during the black and white camera calibration, throw a kind of colorama to the target plate, this colorama is identical with one of background colour with target plate prospect.
2, the scaling method of object surface three-dimensional contour structure light measurement system according to claim 1 is characterized in that: described (3) step many plane references method be Tsai based on radial constraint unanimity (RAC) method.
3, the scaling method of object surface three-dimensional contour structure light measurement system according to claim 1 and 2 is characterized in that: the described projection of (5) step is colored to utilize projector to finish.
CNB200810019813XA 2008-03-17 2008-03-17 The scaling method of object surface three-dimensional contour structure light measurement system Expired - Fee Related CN100573040C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200810019813XA CN100573040C (en) 2008-03-17 2008-03-17 The scaling method of object surface three-dimensional contour structure light measurement system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200810019813XA CN100573040C (en) 2008-03-17 2008-03-17 The scaling method of object surface three-dimensional contour structure light measurement system

Publications (2)

Publication Number Publication Date
CN101245994A CN101245994A (en) 2008-08-20
CN100573040C true CN100573040C (en) 2009-12-23

Family

ID=39946579

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200810019813XA Expired - Fee Related CN100573040C (en) 2008-03-17 2008-03-17 The scaling method of object surface three-dimensional contour structure light measurement system

Country Status (1)

Country Link
CN (1) CN100573040C (en)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101871773B (en) * 2009-04-22 2012-08-29 陈亮嘉 Synchronous hue shift conversion method and three-dimensional appearance measurement system thereof
CN101799924A (en) * 2010-03-09 2010-08-11 哈尔滨工业大学 Method for calibrating projector by CCD (Charge Couple Device) camera
CN101881605B (en) * 2010-06-02 2011-11-30 南京航空航天大学 Optical three-dimensional measuring method based on phase coding technology
CN101900536B (en) * 2010-07-28 2011-11-16 西安交通大学 Method for measuring object surface appearance based on digital picture method
CN102519395B (en) * 2011-11-25 2013-12-18 东南大学 Color response calibration method in colored structure light three-dimensional measurement
CN102854192B (en) * 2012-08-22 2014-11-19 北京农业智能装备技术研究中心 Method for detecting apple surface defect based on apple surface defect detecting system
US9185392B2 (en) * 2012-11-12 2015-11-10 Spatial Integrated Systems, Inc. System and method for 3-D object rendering of a moving object using structured light patterns and moving window imagery
CN103162643A (en) * 2013-04-02 2013-06-19 北京博维恒信科技发展有限责任公司 Monocular structured light three-dimensional scanner
CN104511905A (en) * 2013-09-28 2015-04-15 沈阳新松机器人自动化股份有限公司 Robot visual servo control method based on structured light
CN103559710B (en) * 2013-11-05 2016-06-29 重庆安钻理科技股份有限公司 A kind of scaling method for three-dimensional reconstruction system
CN103753585A (en) * 2014-01-10 2014-04-30 南通大学 Method for intelligently adjusting manipulator and grasping force on basis of visual image analysis
CN104376560B (en) * 2014-11-17 2024-04-09 国家电网公司 Multifunctional camera calibration method and device based on optical projector
CN105551039B (en) * 2015-12-14 2017-12-08 深圳先进技术研究院 The scaling method and device of structural light three-dimensional scanning system
CN106595517B (en) * 2016-11-29 2019-01-29 天津大学 Project striped geometry distribution characteristics structured light measurement system scaling method
CN109425292B (en) * 2017-08-29 2020-06-16 西安知微传感技术有限公司 Three-dimensional measurement system calibration device and method based on one-dimensional line structured light
CN108007387B (en) * 2017-11-30 2018-12-07 哈尔滨工业大学 Surface shape measurement device and method based on Structured Illumination
CN110866793A (en) * 2018-08-27 2020-03-06 阿里健康信息技术有限公司 Virtual object display, generation and providing method
CN112840175A (en) * 2018-10-15 2021-05-25 成都频泰鼎丰企业管理中心(有限合伙) Measuring system for curved surface of transparent or semitransparent material
CN109765036A (en) * 2019-02-28 2019-05-17 人加智能机器人技术(北京)有限公司 A kind of luminous scaling board and preparation method thereof for camera parameter calibration
CN112066917B (en) * 2020-09-17 2023-01-31 北京半导体专用设备研究所(中国电子科技集团公司第四十五研究所) Flatness detection device, method and electronic device
CN113494891B (en) * 2021-06-29 2023-09-29 南京航空航天大学 Multi-view splicing method for measuring integral profile of train bearing saddle
EP4447435A1 (en) * 2023-04-11 2024-10-16 Huvitz Co., Ltd. Method for calibrating intraoral scanner

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6101455A (en) * 1998-05-14 2000-08-08 Davis; Michael S. Automatic calibration of cameras and structured light sources
CN1354355A (en) * 2001-12-10 2002-06-19 西安交通大学 Laser linear scanning three-dimensional measurement double liquid knife virtual grid mapping calibrating method and equipment
US6822748B2 (en) * 2002-10-29 2004-11-23 Metron Systems, Inc. Calibration for 3D measurement system
CN1645037A (en) * 2004-12-31 2005-07-27 天津大学 Partitioned pointing method for three-dimensional scanning measurement system by light band method
CN101074869A (en) * 2007-04-27 2007-11-21 东南大学 Method for measuring three-dimensional contour based on phase method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6101455A (en) * 1998-05-14 2000-08-08 Davis; Michael S. Automatic calibration of cameras and structured light sources
CN1354355A (en) * 2001-12-10 2002-06-19 西安交通大学 Laser linear scanning three-dimensional measurement double liquid knife virtual grid mapping calibrating method and equipment
US6822748B2 (en) * 2002-10-29 2004-11-23 Metron Systems, Inc. Calibration for 3D measurement system
CN1645037A (en) * 2004-12-31 2005-07-27 天津大学 Partitioned pointing method for three-dimensional scanning measurement system by light band method
CN101074869A (en) * 2007-04-27 2007-11-21 东南大学 Method for measuring three-dimensional contour based on phase method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
基于虚拟相位靶标的光栅投射三维测量系统标定. 林玉池等.光电子·激光,第16卷第5期. 2005
基于虚拟相位靶标的光栅投射三维测量系统标定. 林玉池等.光电子·激光,第16卷第5期. 2005 *
数字光栅投影轮廓测量系统不确定视角标定法. 张效栋,孙长库.清华大学学报,第47卷第5期. 2007
数字光栅投影轮廓测量系统不确定视角标定法. 张效栋,孙长库.清华大学学报,第47卷第5期. 2007 *

Also Published As

Publication number Publication date
CN101245994A (en) 2008-08-20

Similar Documents

Publication Publication Date Title
CN100573040C (en) The scaling method of object surface three-dimensional contour structure light measurement system
CN107945268B (en) A kind of high-precision three-dimensional method for reconstructing and system based on binary area-structure light
CN101576379B (en) Fast calibration method of active projection three dimensional measuring system based on two-dimension multi-color target
CN106468553B (en) A kind of localization method of the mobile object based on road sign
CN104197861B (en) Three-dimension digital imaging method based on structure light gray scale vector
CN101308012B (en) Double monocular white light three-dimensional measuring systems calibration method
KR102236297B1 (en) Calibration device and method for calibrating a dental camera
CN107167093B (en) A kind of the combined type measuring system and measurement method of laser line scanning and shadow Moire
CN101667303A (en) Three-dimensional reconstruction method based on coding structured light
CN107607040A (en) A kind of three-dimensional scanning measurement device and method suitable for High Reflective Surface
CN104864809B (en) A kind of the position detection Code targets and system of view-based access control model
CN101382418B (en) Absolute displacement measuring device and method based on digital picture
CN101794461B (en) Three-dimensional modeling method and system
CN101482398B (en) Fast three-dimensional appearance measuring method and device
CN102243103A (en) Method for quickly measuring colors and three-dimensional profile of object
CN105158275B (en) Apple stem/calyx detection method based on near-infrared coding dot matrix structure light
CN102622739A (en) Image non-uniformity correction method for Bayer filter array color camera
CN112161586A (en) Line structured light vision sensor calibration method based on coding checkerboard
CN103033171B (en) Encoding mark based on colors and structural features
CN100561118C (en) A kind of color rendering method in the three-dimensional digitized measurement
CN104254755A (en) Optical measurement system, method and scaleplate therefor
CN108550171B (en) Linear array camera calibration method containing eight-diagram coding information based on cross ratio invariance
CN104636779A (en) Annular code identifier recognition system
CN2831045Y (en) Digital electronic level
CN1141670C (en) 3D tracking and measurement method of moving objects by 2D code

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091223

Termination date: 20140317