CN107192348A - A kind of high-precision 3D vision measuring methods - Google Patents

A kind of high-precision 3D vision measuring methods Download PDF

Info

Publication number
CN107192348A
CN107192348A CN201610140647.3A CN201610140647A CN107192348A CN 107192348 A CN107192348 A CN 107192348A CN 201610140647 A CN201610140647 A CN 201610140647A CN 107192348 A CN107192348 A CN 107192348A
Authority
CN
China
Prior art keywords
camera
precision
parameter
edge
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610140647.3A
Other languages
Chinese (zh)
Inventor
张亮
高泽晋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Lioncel Technology Co Ltd
Original Assignee
Wuhan Lioncel Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Lioncel Technology Co Ltd filed Critical Wuhan Lioncel Technology Co Ltd
Priority to CN201610140647.3A priority Critical patent/CN107192348A/en
Publication of CN107192348A publication Critical patent/CN107192348A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures

Abstract

The invention provides a kind of high-precision 3D vision measuring methods.This method carries out three-dimensional measurement to object with rebuilding using three pairs of cubic phase machine equipments, a series of problems, such as traditional 2D vision measuring methods can not measure object height, depth, thickness, flatness is this method solve, and three-dimensional measurement precision has reached 10um.

Description

A kind of high-precision 3D vision measuring methods
Technical field
The present invention relates to a kind of high-precision 3D vision measuring methods, belong to machine vision, three-dimensional reconstruction and high-accuracy automatic Change measuring instrument field.
Background technology
In manufacturing industry, certain accuracy of manufacture error is inevitably there is in itself for the machine that produces workpiece. Therefore, every workpiece produced by it will necessarily have certain tolerance.For those requirement on machining accuracy very high workpiece For, we must accurately measure the poor scope of its work.
Vision measurement has also embodied its unique advantage in terms of the dimensional measurement of industrial part, and noncontact inspection can be achieved Measurement, and long-time stable work.Using vision measurement, a large amount of human resources can be saved, it is considerable to be that company brings Benefit, its application prospect is considerable.Vision measurement system has measurement function, is capable of the apparent size of automatic measurement product, Than if the size of the parameter such as appearance profile, aperture, area of automatic measurement product.
The current detection means in field of machine vision main flow relies primarily on the vision measurement technology of 2D cameras.This side Method can only measure the correspondingly-sized for the object for belonging to 2D, when needs measure height, depth, thickness, flatness, volume, abrasion When spending, the measuring method is then unable to reach requirement.Industrially, the instrument for high-precision part dimensional measurement is three-dimensional coordinate Measuring instrument, its precision is general all in micron level, but three-coordinates measuring machine measurement efficiency is low, is manufactured far from industry is met Actual efficiency demand.In recent years, as " proposition of industry 4.0 ", the vision measurement technology being closely related with intelligent plant is obtained Great attention is arrived and has developed.
Therefore, the high-precision 3D vision measurements technology of research and development rapidly and efficiently, it has also become realize " the eager need of industry 4.0 " Ask.
The content of the invention
The present invention is to overcome the above-mentioned deficiency of prior art, it is proposed that a kind of high-precision 3D vision measuring methods, should Method overcomes the problem of traditional 2D vision measurements can not measure the relevant parameter not between approximately the same plane target, while The problem of traditional three-dimensional coordinate measuring instrument measurement efficiency is low is overcome, directly measurement target is entered by multipair binocular camera Row 3D is measured, and precision has reached below 10um.
The present invention is realized by such technical scheme:A kind of high-precision 3D vision measuring methods, it is characterised in that pass through The three pairs of binocular cameras in left side, right side, top for being placed in target to be measured rebuild the three-dimensional coordinate of target to be measured respectively.Realize described Method comprises the following steps:
Step 1, high-precision calibration of camera internal parameters, determines the intrinsic parameter of all cameras.First with Zhang Zhengyou standardizations The intrinsic parameter of camera is calculated, the pixel that variance is more than defined threshold is deleted further according to covariance law.Afterwards, remaining side is used Difference carries out camera calibration again less than the pixel of defined threshold.
Step 2, stereo camera calibration, determines the outer parameter of stereoscopic camera.Determining the outer parameter of camera needs to use step 1 The result of the intrinsic parameter of middle demarcation, in order to eliminate the propagation effect of error, needs to carry out all result of calculation in this step Binding collection adjusting and optimizing is calculated.
Step 3, the conversion of different cameral coordinate system, same camera coordinates system is uniformly transformed into by different cameral coordinate system Under, the conversion of six parameter coordinate systems is carried out using Quaternion method.
Step 4, extract the marginal position of the object in each camera fields of view (by taking ellipse target as an example).Use first Canny rim detections extract the marginal position of entire image designated area, then calculate with border following algorithm each edge picture The number of vegetarian refreshments, deletes the edge that pixel is less than fixed threshold.
Step 5, elliptical edge in step 4 is fitted, digital simulation oval major and minor axis and area, deletion are unsatisfactory for The elliptical edge of condition, and extract elliptical center.
Step 6, obtained respectively according to the pixel coordinate of two elliptical centers in left and right in step 5 with step 1 and step 2 Camera parameter rebuilds left side, right side, the three-dimensional coordinate of top elliptical center respectively with Linear Triangular method first, according to line Property trigonometric ratio result nonlinear optimization is carried out to the three-dimensional point of reconstruction, obtain the higher three-dimensional coordinate point of precision.
Step 7, all three-dimensional points are transformed under same coordinate system according to obtaining coordinate system conversion parameter in step 3, It can obtain high accuracy three-dimensional coordinate points.
The present invention has the advantage that compared with prior art:
1. the present invention directly can carry out three-dimensional measurement to target to be measured, the three-dimensional coordinate of target to be measured is obtained.
2. camera calibration precision is high, the stated accuracy of existing conventional Zhang Zhengyou standardizations is about 0.4 pixel, the present invention Camera calibration precision be about 0.1 pixel.
3. the elliptical edge extraction accuracy of the present invention is controlled within 0.2 pixel.
4. the final reconstruction accuracy of the present invention is within 0.3 pixel.
Brief description of the drawings
Fig. 1 is the inventive method camera installation position schematic diagram.
Fig. 2 is the pictorial diagram of the inventive method object to be measured.
Fig. 3 is the inventive method algorithm flow chart.
Fig. 4 is the inventive method and the comparison diagram of Zhang Zhengyou calibration algorithm re-projection errors.
Fig. 5 is the gridiron pattern locus figure reconstructed.
Fig. 6 is that object edge extracts result.
Fig. 7 is edge fitting and its topography.
Embodiment
With reference to the accompanying drawings and examples, the present invention will be further described.
As shown in figure 1, disposing scheme for measurement process camera, wherein two cameras of left side placement, right side disposes two phases Machine, top is installed by two cameras.Fig. 2 is the pictorial diagram of the measurement object of the present invention.The flow chart of the present invention is as shown in Figure 3.
In the present embodiment, measurement target, the measurement left side center of circle corresponding with right side are used as with the calibrating block of a manual manufacture The distance of connected straight line, the calibrating block obtains the three-dimensional coordinate in the center of circle by three-dimensional coordinate measuring instrument, and precision is 1um.In camera In calibration process, the glass planar gridiron pattern scaling board that the demarcation thing that we use is 10um for precision.
Below in conjunction with the accompanying drawings, the detailed process to the technical scheme of invention is illustrated.Because present invention left side, right side, on The camera calculating process of side is identical, therefore is described by taking the calculating process of two cameras in left side as an example.
(1) high-precision intrinsic parameter is carried out to each camera of left side to demarcate, determine the Intrinsic Matrix (4 of left camera Parameter is respectively fx, fy, cx, cy).The step calculates the Intrinsic Matrix of camera first with Zhang Zhengyou standardizations, and we obtain 5 intrinsic parameters to two cameras are respectively [10912.9 10908.1 2069.9 1018.5], [10765.4 10767.6 2030.3 1066.4], the pixel that variance is more than defined threshold is deleted further according to covariance law.Afterwards, remaining variance is used Pixel less than defined threshold carries out camera calibration again, and the intrinsic parameter of two obtained camera is respectively [10916.4 10915.4 2030.0 1100.8]、[10893.7 10889.9 2083.5 1104.1].Fig. 4 is obtained by above-mentioned steps Intrinsic Matrix reconstruct come three-dimensional point re-projection error distribution, it can be seen that error be substantially distributed in 0.1 pixel with It is interior.
(2) stereo camera calibration, it is determined that the outer parameter of two, left side camera.Determine that the outer parameter of camera needs to use (1) acceptance of the bid The result of fixed intrinsic parameter, in order to eliminate the propagation effect of error, needs to carry out binding collection to all result of calculation in this step (or bundle adjustment) optimization calculation procedure is adjusted, obtaining outer parameter ist =[- 168.039, -1.172,41.871].Fig. 5 is to reconstruct tessellated location drawing picture in three dimensions according to stereo calibration.
(3) extract the marginal position of the object in each camera fields of view (by taking ellipse target as an example).Canny is used first Rim detection extracts the marginal position of entire image designated area, then calculates with border following algorithm each edge pixel point Number, deletes the edge that pixel is less than fixed threshold.In the present embodiment, we select to delete number of edge points less than 500 Edge.Marginal position extraction effect is as shown in Figure 6.
(5) elliptical edge in (4) is fitted, digital simulation oval major and minor axis and area, deletion are unsatisfactory for condition Elliptical edge, and extract elliptical center.In the present embodiment, five with direct method solution elliptic equation that we use Parameter, the major and minor axis and corresponding area of ellipse can be tried to achieve according to obtained elliptic parameter, in this, as whether to retain this ellipse The foundation of rounded edge.Final elliptical edge extracts result and its partial enlarged drawing is as shown in Figure 7.
(6) respectively according to the pixel coordinate of two elliptical centers in left and right in (5), the camera parameter obtained with (1) (2) is first The three-dimensional coordinate of elliptical center is rebuild with Linear Triangular method, now because the presence of systematic error and random error, is obtained The coordinate precision of the elliptical center arrived is not high.We carry out non-linear further according to Linear Triangular result to the three-dimensional point of reconstruction Optimization, the higher three-dimensional coordinate point of precision is obtained with this.
(7) above-mentioned steps are being combined, carrying out (1)-(6) step to right side and top camera respectively calculates, and according to quaternary All three-dimensional points are transformed under same coordinate system by plain method, you can obtain the distance of corresponding three-dimensional coordinate to be measured.With three-dimensional The three-dimensional point coordinate that coordinate measuring apparatus is obtained is standard value, the three-dimensional point that the left perspective camera measurement that the final present invention is obtained goes out Resultant error is analyzed as follows table 1 to coordinate in contrast, and the three-dimensional point coordinate that perspective right camera measurement goes out in contrast miss by result Difference is analyzed as follows table 2, and resultant error is analyzed as follows table 3 to the three-dimensional point coordinate that top perspective camera measurement goes out in contrast.
Table 1
Target Target 1 Target 2 Target 3 Target 4 Target 5
Error (um) -1.7 3.6 1.9 9.3 -5.4
Table 2
Target Target 1 Target 2 Target 3 Target 4 Target 5
Error (um) 2.7 3.5 5.5 6.1 2.2
Table 3
Target Target 1 Target 2 Target 3 Target 4 Target 5
Error (um) 3.1 -3.5 -1.3 8.5 -5.2
Particular embodiments described above, has been carried out furtherly to the purpose of the present invention, technical scheme and beneficial effect Bright, understanding used the foregoing is only the specific embodiment of the present invention, be not intended to limit the invention, all at this Within the spirit and principle of invention, any modification, equivalent substitution and improvements done etc. should be included in the protection model of the present invention Within enclosing.

Claims (7)

1. a kind of high-precision 3D vision measuring methods, it is characterised in that comprise the following steps:
Step 1, high-precision calibration of camera internal parameters, determines the intrinsic parameter of all cameras.Calculated first with Zhang Zhengyou standardizations The intrinsic parameter of camera, the pixel that variance is more than defined threshold is deleted further according to covariance law.Afterwards, it is small with remaining variance Camera calibration is carried out again in the pixel of defined threshold.
Step 2, stereo camera calibration, determines the outer parameter of stereoscopic camera.Determine that the outer parameter of camera needs to use step 1 to get the bid The result of fixed intrinsic parameter, in order to eliminate the propagation effect of error, needs to bundle all result of calculation in this step Collect adjusting and optimizing to calculate.
Step 3, the conversion of different cameral coordinate system, different cameral coordinate system is uniformly transformed under same camera coordinates system, The conversion of six parameter coordinate systems is carried out using Quaternion method.
Step 4, extract the marginal position of the object in each camera fields of view (by taking ellipse target as an example).Canny is used first Rim detection extracts the marginal position of entire image designated area, then calculates with border following algorithm each edge pixel point Number, deletes the edge that pixel is less than fixed threshold.
Step 5, elliptical edge in step 4 is fitted, digital simulation oval major and minor axis and area, deletion are unsatisfactory for condition Elliptical edge, and extract elliptical center.
Step 6, respectively according to the pixel coordinate of two elliptical centers in left and right in step 5, the camera obtained with step 1 and step 2 Parameter rebuilds left side, right side, the three-dimensional coordinate of top elliptical center respectively with Linear Triangular method first, according to linear three Angling result carries out nonlinear optimization to the three-dimensional point of reconstruction, obtains the higher three-dimensional coordinate point of precision.
Step 7, all three-dimensional points are transformed under same coordinate system according to obtaining coordinate system conversion parameter in step 3, you can Obtain high accuracy three-dimensional coordinate points.
2. a kind of high-precision 3D vision measuring methods according to claim 1, it is characterised in that the specific step of the step 1 Suddenly it is:High-precision intrinsic parameter demarcation is carried out to each camera, 4 parameters for determining the Intrinsic Matrix of left camera are respectively fx、fy、cx、cy.The step calculates the Intrinsic Matrix of camera first with Zhang Zhengyou standardizations, and we obtain two cameras 5 intrinsic parameters are respectively to delete the pixel that variance is more than defined threshold further according to covariance law.Afterwards, remaining side is used Difference carries out camera calibration again less than the pixel of defined threshold, the intrinsic parameter of two obtained camera.
3. a kind of high-precision 3D vision measuring methods according to claim 1, it is characterised in that the specific step of the step 2 Suddenly it is:Determine the outer parameter of each two stereoscopic camera pair.Determining the outer parameter of camera needs to use the intrinsic parameter demarcated in step 1 Result, in order to eliminate the propagation effect of error, need to carry out all result of calculation binding collection adjusting and optimizing in this step Calculation procedure, obtains accurate outer parametric results.
4. a kind of high-precision 3D vision measuring methods according to claim 1, it is characterised in that the specific step of the step 3 Suddenly it is:Extract the marginal position of the object in each camera fields of view (by taking ellipse target as an example).Examined first with Canny edges Survey the marginal position for extracting entire image designated area, then calculate with border following algorithm the number of each edge pixel point, Delete pixel and be less than the edge of fixed threshold, and delete the edge that number of edge points is less than 500.
5. a kind of high-precision 3D vision measuring methods according to claim 1, it is characterised in that the specific step of the step 4 Suddenly it is:Elliptical edge in step 4 is fitted, digital simulation oval major and minor axis and area, deletion are unsatisfactory for the ellipse of condition Rounded edge, and elliptical center is extracted, five parameters that elliptic equation is solved with direct method of use are joined according to obtained ellipse Number can try to achieve the major and minor axis and corresponding area of ellipse, in this, as whether retaining the foundation of the elliptical edge.
6. a kind of high-precision 3D vision measuring methods according to claim 1, it is characterised in that the specific step of the step 5 Suddenly it is:Respectively according to the pixel coordinate of two elliptical centers in left and right in step 4, with the camera parameter obtained in step 1 and step 2 The three-dimensional coordinate of elliptical center is rebuild with Linear Triangular method first, now because systematic error and random error are deposited The coordinate precision of obtained elliptical center is not high.We are carried out further according to Linear Triangular result to the three-dimensional point of reconstruction Nonlinear optimization, the higher three-dimensional coordinate point of precision is obtained with this.
7. a kind of high-precision 3D vision measuring methods according to claim 1, it is characterised in that the specific step of the step 6 Suddenly it is:All three-dimensional points are transformed under same coordinate system according to Quaternion method, you can obtain corresponding three-dimensional coordinate to be measured And its exact position of correspondence target.
CN201610140647.3A 2016-03-14 2016-03-14 A kind of high-precision 3D vision measuring methods Pending CN107192348A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610140647.3A CN107192348A (en) 2016-03-14 2016-03-14 A kind of high-precision 3D vision measuring methods

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610140647.3A CN107192348A (en) 2016-03-14 2016-03-14 A kind of high-precision 3D vision measuring methods

Publications (1)

Publication Number Publication Date
CN107192348A true CN107192348A (en) 2017-09-22

Family

ID=59870763

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610140647.3A Pending CN107192348A (en) 2016-03-14 2016-03-14 A kind of high-precision 3D vision measuring methods

Country Status (1)

Country Link
CN (1) CN107192348A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108154536A (en) * 2017-12-13 2018-06-12 南京航空航天大学 The camera calibration method of two dimensional surface iteration
CN109341591A (en) * 2018-11-12 2019-02-15 杭州思看科技有限公司 A kind of edge detection method and system based on handheld three-dimensional scanner
CN111815704A (en) * 2020-07-16 2020-10-23 中国农业机械化科学研究院 Grain bin grain heap volume measuring and calculating method based on binocular camera

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101231750A (en) * 2008-02-21 2008-07-30 南京航空航天大学 Calibrating method of binocular three-dimensional measuring system
CN101995231A (en) * 2010-09-20 2011-03-30 深圳大学 Three-dimensional detection system for surface of large thin-shell object and detection method thereof
CN102944191A (en) * 2012-11-28 2013-02-27 北京航空航天大学 Method and device for three-dimensional vision measurement data registration based on planar circle target
CN104315978A (en) * 2014-11-10 2015-01-28 北京理工大学 Method and device for measuring pipeline end face central points
CN104809738A (en) * 2015-05-18 2015-07-29 长春工业大学 Airbag overall dimension detection method based on binocular vision
CN105043250A (en) * 2015-05-29 2015-11-11 南京邮电大学 Dual-view-angle data alignment method based on at least two common mark points
CN105157609A (en) * 2015-09-01 2015-12-16 大连理工大学 Two-sets-of-camera-based global morphology measurement method of large parts

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101231750A (en) * 2008-02-21 2008-07-30 南京航空航天大学 Calibrating method of binocular three-dimensional measuring system
CN101995231A (en) * 2010-09-20 2011-03-30 深圳大学 Three-dimensional detection system for surface of large thin-shell object and detection method thereof
CN102944191A (en) * 2012-11-28 2013-02-27 北京航空航天大学 Method and device for three-dimensional vision measurement data registration based on planar circle target
CN104315978A (en) * 2014-11-10 2015-01-28 北京理工大学 Method and device for measuring pipeline end face central points
CN104809738A (en) * 2015-05-18 2015-07-29 长春工业大学 Airbag overall dimension detection method based on binocular vision
CN105043250A (en) * 2015-05-29 2015-11-11 南京邮电大学 Dual-view-angle data alignment method based on at least two common mark points
CN105157609A (en) * 2015-09-01 2015-12-16 大连理工大学 Two-sets-of-camera-based global morphology measurement method of large parts

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
万刚 等: "《无人机测绘技术及应用》", 31 December 2015, 测绘出版社 *
吴伟仁 等: "《深空探测器自主导航原理与技术》", 31 May 2011, 中国宇航出版社 *
吴侃 等: "《矿山开采沉陷监测及预测新技术》", 31 December 2012, 中国环境科学出版社 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108154536A (en) * 2017-12-13 2018-06-12 南京航空航天大学 The camera calibration method of two dimensional surface iteration
CN109341591A (en) * 2018-11-12 2019-02-15 杭州思看科技有限公司 A kind of edge detection method and system based on handheld three-dimensional scanner
CN111815704A (en) * 2020-07-16 2020-10-23 中国农业机械化科学研究院 Grain bin grain heap volume measuring and calculating method based on binocular camera

Similar Documents

Publication Publication Date Title
Chen et al. High-accuracy multi-camera reconstruction enhanced by adaptive point cloud correction algorithm
Garcia et al. A combined temporal tracking and stereo-correlation technique for accurate measurement of 3D displacements: application to sheet metal forming
CN105300316B (en) Optical losses rapid extracting method based on grey scale centre of gravity method
CN104359403B (en) Planar part dimension measurement method based on sub-pixel edge algorithm
CN110443836A (en) A kind of point cloud data autoegistration method and device based on plane characteristic
CN102800096B (en) Robustness estimation algorithm of camera parameter
CN109360246B (en) Stereoscopic vision three-dimensional displacement measurement method based on synchronous subarea search
CN110335234B (en) Three-dimensional change detection method based on antique LiDAR point cloud
CN105783786B (en) Part chamfering measuring method and device based on structured light vision
CN103535960B (en) Human body three-dimensional measurement method based on digital images
CN108389250A (en) The method for quickly generating building cross-section diagram based on point cloud data
CN112082493B (en) Binocular imaging-based pipeline flange inner radius visual measurement method
CN104392476A (en) Method of extracting three-dimensional axis of tunnel based on minimum bounding box algorithm
CN104748683A (en) Device and method for online and automatic measuring numerical control machine tool workpieces
CN103278138A (en) Method for measuring three-dimensional position and posture of thin component with complex structure
CN108765495B (en) Rapid calibration method and system based on binocular vision detection technology
CN104655011A (en) Non-contact optical measurement method for volume of irregular convex-surface object
CN104751458B (en) A kind of demarcation angular-point detection method based on 180 ° of rotation operators
CN101720992A (en) Three-dimensional human body measurement method by using single camera
CN107192348A (en) A kind of high-precision 3D vision measuring methods
CN109272542A (en) A kind of determination method of three-dimension object volume
CN106033653A (en) Ground-laser-scanning-based three-dimensional indoor map making method
CN106767433B (en) A kind of method and system measuring foot sizing
CN115909025A (en) Terrain vision autonomous detection and identification method for small celestial body surface sampling point
CN103679713A (en) Two-dimensional image registration method for partially matched images

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
DD01 Delivery of document by public notice
DD01 Delivery of document by public notice

Addressee: Zhang Liang

Document name: Notification of Passing Examination on Formalities

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170922