CN113251944B - Line structured light vision sensor calibration method and device based on single cylindrical target - Google Patents
Line structured light vision sensor calibration method and device based on single cylindrical target Download PDFInfo
- Publication number
- CN113251944B CN113251944B CN202110508393.7A CN202110508393A CN113251944B CN 113251944 B CN113251944 B CN 113251944B CN 202110508393 A CN202110508393 A CN 202110508393A CN 113251944 B CN113251944 B CN 113251944B
- Authority
- CN
- China
- Prior art keywords
- cylindrical
- light
- coordinate system
- cylindrical target
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B21/00—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
Abstract
A linear structured light vision sensor calibration method and device based on a single cylindrical target are disclosed, wherein a camera internal reference matrix K and a distortion coefficient D are obtained by using a Zhang Zhengyou calibration method; carrying out distortion correction on the obtained cylindrical and light bar images; extracting projection outlines of the cylinders and light bar central feature points; ellipse fitting is carried out on the projection ellipses of the two end surfaces of the cylinder to obtain the central coordinate p of the ellipse1And p2(ii) a Performing straight line fitting on the two apparent contour lines of the cylindrical quadric surface, wherein the intersection point is the cylindrical axis P1P2Vanishing point v of0(ii) a Obtaining the circle centers P of two end surfaces of the cylinder by using the geometric characteristics and the vanishing point properties of the cylinder1And P2Establishing a cylindrical quadric surface equation in a camera coordinate system; combining a cylindrical quadric surface equation and a perspective projection equation of the light bar projection point P to obtain a three-dimensional coordinate of the light bar central feature point P in a camera coordinate system; and fitting the light plane equation by using characteristic points of the centers of all the light bars. The invention does not need other auxiliary equipment, has higher precision, can freely arrange the cylinders and is suitable for narrow space.
Description
Technical Field
The invention belongs to the field of vision measurement, and particularly relates to a line structured light vision sensor calibration method and device based on a single cylindrical target.
Background
Since the structured light three-dimensional vision measurement technology was proposed in the last 70 th century, the structured light three-dimensional vision measurement technology has the advantages of non-contact, high precision, large measurement range, easy extraction of light strip image information, high data processing speed, strong real-time performance and the like, and is widely applied to the three-dimensional measurement fields of industrial detection, reverse engineering, cultural heritage recording, human body measurement and analysis and the like. Line structured light visual sensors are the most common structured light three-dimensional visual sensors.
The line structured light vision sensor consists of a camera and a line laser projector. The laser projector projects the line-structured light to the surface of the measured object and modulates the line-structured light, a camera is used for shooting the line-structured light, and the three-dimensional shape of the measured object is obtained according to the optical triangulation method measuring principle. In this process, the calibration of the light plane equation is a crucial step, and the precision of the light plane calibration directly determines the success or failure of the subsequent three-dimensional reconstruction and three-dimensional measurement.
The common calibration method for the line structured light vision sensor mainly comprises the following steps: huynh uses a three-dimensional target and a calibration method for acquiring optical plane mark points based on an intersection ratio invariant principle. However, the three-dimensional target has high processing difficulty, high manufacturing cost and inconvenient carrying. The Sun military uses the light plane calibration method of the plane target; the method is simple to operate and high in calibration accuracy, but the plane target is not suitable for a narrow space. And solving the three-dimensional coordinates of the intersection point of the light plane and the one-dimensional target by using the distance between the characteristic points of the one-dimensional target, thereby completing the calibration of the light plane. Although this target is simple to operate, it is inefficient because there is only one light bar feature point per image. Wangxinyun et al use cylindrical targets for light plane calibration (see published in 2019 in Optics and Lasers in Engineering paper Complete calibration of a structured light vision sensor through a single cylindrical target), but this method requires the axis of the cylindrical target to be perpendicular to the optical axis of the camera, which causes the method to be extremely inconvenient for practical application and not suitable for field calibration.
Disclosure of Invention
The invention aims to provide a method and a device for calibrating a linear structured light vision sensor based on a single cylindrical target.
The invention adopts the following technical scheme:
the invention discloses a calibration method of a linear structured light vision sensor based on a single cylindrical target, which comprises the following steps:
step 4, extracting the centers of the light bar projection and the apparent contour curve of the cylindrical target by an extraction algorithm;
Step 6, performing straight line fitting on the two apparent contour lines of the cylindrical quadric surface to obtain two straight lines l1And l2Is used to simultaneously obtain the coordinates of the intersection point, i.e. the vanishing point v of the cylindrical axis0;
Step 7, obtaining the center P of the circle of the cylindrical end surface1And P2Three-dimensional coordinates in a camera coordinate system;
step 8, calculating the apparent contour line l of the cylindrical quadric surface1And l2The back projection plane of (a);
step 9, obtaining the center P of the circle of the cylindrical end surface1And P2The optimal solution of (2);
step 10, using the center P of the circle of the cylindrical end surface1As origin, along the cylinder axis P1P2Establishing a cylindrical target coordinate system for a Z axis in the direction, and further obtaining a coefficient matrix of the cylindrical quadric surface in the camera coordinate system;
step 11, combining a cylindrical quadric surface equation and a perspective projection equation of the light bar central characteristic point P to obtain a three-dimensional coordinate of the light bar central characteristic point P in a camera coordinate system;
step 13, repeating the steps 3 to 12 on all the images to obtain the three-dimensional coordinates of the central feature points of all the light bars in the coordinate system of the camera;
and step 14, fitting the light plane equation by using the three-dimensional coordinates of the light strip central characteristic points obtained in the step 13 based on the least square method.
The invention also discloses a line structured light vision sensor calibration method based on the single cylindrical target, which is applied to the line structured light calibration device.
The calibration method of the linear structure optical vision sensor based on the cylindrical target does not need auxiliary equipment to control the movement of the target and the camera, the cylindrical target can be freely placed in the field of view of the camera, the calibration method is suitable for a narrow space, the calibration of the linear structure optical vision sensor can be realized by one image, and in addition, the cylindrical target is easy to process, low in price, small in size and convenient to carry.
Drawings
FIG. 1 is a perspective projection model diagram of a cylindrical target.
Fig. 2 is a schematic image.
Fig. 3 is an overall flow diagram of the present invention.
Reference numerals:
1. camera, 2 laser, 3, cylindrical target.
Detailed Description
The present invention will be described in further detail with reference to examples and drawings, but the present invention is not limited to these examples.
First, the perspective projection relationship of the camera of the present invention, as shown in FIG. 1, OuXuYuPixel coordinate system, OcXcYcZcCamera coordinate system, OTXTYTZTTarget coordinate system, P is any light bar central characteristic point, P1And P2The center of the cylindrical end face is 1, the camera is 2, the laser is 2, and the cylindrical target is 3.
The invention adopts a camera (the model is MER-504-10GM-P) with the resolution of 2448 pixels multiplied by 2048 pixels of a great constant image science and technology company; the focal length of the lens of 8mm by computer company (model M0814-MP 2); the line laser projector is a common red single-line laser with the power of 1 mW; the length L of the cylindrical target is 201.423mm, and the radius r of the cylinder is 11.991 mm.
The invention provides a calibration method of a linear structured light vision sensor based on a single cylindrical target, which comprises the following specific steps:
step 4, using a sub-pixel edge Accurate positioning algorithm based on local area effect (the Accurate sub-pixel edge location based on partial area effect, which is published in Image and Vision Computing in 2013 by the people of industry i n Trujillo-Pino et al, and provides MATLAB source codes), extracting projection elliptical contours of two end faces of a cylinder and two apparent contour lines of a cylindrical quadric surface, using a steger light strip center extraction algorithm to extract the center of light strip projection, namely performing Gaussian filtering on the Image, then performing edge detection on the filtered Image based on a Hessian matrix, and finally connecting discontinuous pixels to obtain Image coordinates of the light strip projection;
Step 6, respectively carrying out straight line fitting on the two apparent contour lines of the cylindrical quadric surface to obtain two straight lines l1And l2Are shown in fig. 2, which are associated to obtain the coordinates of the intersection point, i.e. the cylinder axis P1P2Vanishing point v of0;
And 7, according to the properties of the vanishing points: vanishing point v0Is back projected to the cylinder axis P1P2Are parallel, thus having
Wherein L is the cylinder length; when e is1<e2When g is 1; otherwise, g is-1.
Combined with the center P of the cylinder end face1And P2The perspective projection equation of
Simultaneous (1) and (2) to obtain P1And P2Three-dimensional coordinates in a camera coordinate system;
step 8, calculating the apparent contour line l of the cylindrical quadric surface1And l2Is directed to the back projection plane
πi=(KE)Tli
step 9, establish the following objective function
Wherein the content of the first and second substances,1,2, 1, 2; obtaining the center P of the cylindrical end surface by minimizing an objective function1And P2The optimal solution of (2);
step 10, using the center P of the circle of the cylindrical end surface1As origin, along the cylinder axis P1P2Establishing a cylindrical target coordinate system O with the direction as a Z axisTXTYTZTTo make it and the camera coordinate system OCXCYCZCThe following relationship is satisfied: i.e. with VZT×VZCAs a rotation axis, a target coordinate system OTXTYTZTRotating arccos (V)ZC·VZT) Then along the vectorTranslating to obtain a camera coordinate system OCXCYCZC. Thus from the target coordinate system OTXTYTZTTo camera coordinate system OCXCYCZCCan be expressed as
Wherein the content of the first and second substances,andfrom the target coordinate system OTXTYTZTTo camera coordinate system OCXCYCZCThe rotational matrix and the translation vector of (a),is a Rodrigues transform;
the coefficient matrix of the cylindrical quadric equation in the camera coordinate system can thus be expressed as follows:
wherein r is the radius of the cylinder;
step 11, a cylindrical quadric equation and a perspective projection equation of the central characteristic point P of the optical strip are combined, namely
Wherein s is a non-zero scale factor,is the central characteristic point P ═ X of the light stripc,Yc,Zc)THomogeneous coordinates of (a). Further obtaining the three-dimensional coordinate of the light bar central characteristic point P in the camera coordinate system;
step 13, repeating the steps 3 to 12 on all the images to obtain the three-dimensional coordinates of the central feature points of all the light bars in the coordinate system of the camera;
step 14, adopting an MATLAB curve fitting tool to perform plane fitting on the three-dimensional coordinates of the light strip central characteristic points obtained in the step 13 to obtain a light plane equation
1.149X-0.049Y-Z+405.106=0
In order to prove the feasibility of the invention, the calibration method of the invention is analyzed and compared with a calibration method based on a plane target (the "general field calibration method for structured light vision sensor" published in 2009 by Sunweishi et al in mechanical engineering). In a contrast group, a planar target with the number of angular points of 6 multiplied by 8 and the size of a cell of 37mm is adopted, the planar target and light bars are shot from 10 different visual angles, then a line structure light vision sensor is calibrated by using a calibration method based on the planar target, and the light plane equation is obtained as
1.151X-0.049Y-Z+404.971=0
The light plane equations obtained by the two calibration methods are listed in table 1, namely, the method of the invention is used for calibrating the linear structured light vision sensor on images shot at 10 different visual angles, and the light plane equation 1.149X-0.049Y-Z +405.106 is obtained as 0; using the calibration method of the planar target, images taken at 10 different viewing angles were calibrated for the line structured light vision sensor, and the light plane equation 1.151X-0.049Y-Z +404.971 was obtained as 0. The experimental results demonstrate the feasibility and effectiveness of the present invention.
Calibration method | Number of shooting angles | Equation of plane of light |
Plane-based target | 10 different viewing angles | 1.151X-0.049Y-Z+404.971=0 |
Calibration method of the invention | 10 different viewing angles | 1.149X-0.049Y-Z+405.106=0 |
The invention also discloses a line structured light vision sensor calibration method adopting the freely placed cylindrical target, which is applied to a line structured light calibration device.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention.
Claims (10)
1. A line structured light vision sensor calibration method based on a single cylindrical target comprises the following steps:
step 1, acquiring a camera internal reference matrix K and a distortion coefficient D;
step 2, acquiring at least 1 image of the cylindrical target and the light bar under different poses;
step 3, processing the acquired light bar image through the distortion coefficient D obtained in the step 1, and eliminating camera distortion;
step 4, extracting the centers of the projection of the light bars and the apparent contour curves of the cylindrical targets by using two different algorithms;
step 5, carrying out ellipse fitting on the projection outlines of the two end face circles of the cylinder to obtain the centers of the two ellipsesAndmajor axis e1And e2;
Step 6, performing straight line fitting on the two apparent contour lines of the cylindrical quadric surface to obtain two straight linesAndthe expression (c) is used to simultaneously obtain the coordinates of the intersection point, i.e. the vanishing point V of the cylindrical axis0;
Step 7, obtaining the center of the circle of the cylindrical end surfaceAndthree-dimensional coordinates in a camera coordinate system;
step 8, calculating the apparent contour line of the cylindrical quadric surfaceAndthe back projection plane of (a);
step 9, obtaining the center of the circle of the cylindrical end surfaceAndthe optimal solution of (2);
step 10, using the center of the circle of the cylindrical end surfaceAs origin, along the cylinder axisEstablishing a cylindrical target coordinate system for a Z axis in the direction, and further obtaining a coefficient matrix of the cylindrical quadric surface in the camera coordinate system;
step 11, combining a cylindrical quadric surface equation and a perspective projection equation of the light bar central characteristic point P to obtain a three-dimensional coordinate of the light bar central characteristic point P in a camera coordinate system;
step 12, repeating the step 11 for all the light strip central feature points on one image to obtain the three-dimensional coordinates of all the light strip central feature points on the image;
step 13, repeating the steps 3 to 12 on all the images to obtain the three-dimensional coordinates of the central feature points of all the light bars in the coordinate system of the camera;
and step 14, fitting the light plane equation by using the three-dimensional coordinates of the light strip central characteristic points obtained in the step 13 based on the least square method.
2. The method for calibrating a line structured light vision sensor based on a single cylindrical target as claimed in claim 1, wherein: the step 1 further comprises calibrating the camera by adopting a Zhang Zhengyou calibration method.
3. The method for calibrating a line structured light vision sensor based on a single cylindrical target as claimed in claim 1, wherein: the step 2 further comprises: opening the line laser to project a light plane, forming light stripes on the quadric surface of the cylindrical target by the light plane, and collecting a cylindrical target image containing the light stripes by the camera; and changing the pose of the cylindrical target and ensuring that the light plane is always intersected with the quadric surface of the cylindrical target, then shooting the cylindrical target and the light strip, and acquiring at least 1 image of the cylindrical target and the light strip in different poses.
4. The method for calibrating a line structured light vision sensor based on a single cylindrical target as claimed in claim 1, wherein: the step 4 further comprises the following steps: and extracting the center of the projection of the light bar by using a steger light bar center extraction algorithm by using a sub-pixel edge precise positioning algorithm based on a local region effect.
5. The method for calibrating a line structured light vision sensor based on a single cylindrical target as claimed in claim 1, wherein: the step 7 further comprises: according to the nature of the vanishing points: vanishing point V0Back projection and cylinderAxial lineAre parallel, thus having
6. A single cylinder based unit according to claim 1The calibration method of the linear optical vision sensor of the target is characterized in that: the step 8 further comprises: calculating the apparent contour of a cylindrical quadricAndis directed to the back projection plane
7. the method for calibrating a line structured light vision sensor based on a single cylindrical target as claimed in claim 1, wherein: the step 9 further comprises: the following objective function is established
8. The method for calibrating a line structured light vision sensor based on a single cylindrical target as claimed in claim 1, wherein: the step 10 further comprises: by the center of a circle of the cylindrical end surfaceAs origin, along the cylinder axisA cylindrical target coordinate system is established with the direction as the Z axis to meet the requirement
Wherein the content of the first and second substances,andrespectively a rotation matrix and a translation vector from the target coordinate system to the camera coordinate system,is a Rodrigues transform;
further obtaining the coefficient matrix of the cylindrical quadric surface in the camera coordinate system
Wherein r is the cylinder radius.
9. The method for calibrating a line structured light vision sensor based on a single cylindrical target as claimed in claim 1, wherein: the step 11 further comprises: simultaneous cylindrical quadric surface equation and perspective projection equation of characteristic point P of light bar center, i.e.
10. The use of a single cylindrical target-based line structured light vision sensor calibration method of any one of claims 1 to 9 in a line structured light calibration device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110508393.7A CN113251944B (en) | 2021-05-11 | 2021-05-11 | Line structured light vision sensor calibration method and device based on single cylindrical target |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110508393.7A CN113251944B (en) | 2021-05-11 | 2021-05-11 | Line structured light vision sensor calibration method and device based on single cylindrical target |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113251944A CN113251944A (en) | 2021-08-13 |
CN113251944B true CN113251944B (en) | 2022-03-01 |
Family
ID=77222829
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110508393.7A Active CN113251944B (en) | 2021-05-11 | 2021-05-11 | Line structured light vision sensor calibration method and device based on single cylindrical target |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113251944B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101627147A (en) * | 2007-02-26 | 2010-01-13 | 莱博德光学有限责任公司 | Vacuum treatment of strip-shaped substrates |
CN104848801A (en) * | 2015-06-05 | 2015-08-19 | 北京航空航天大学 | Line structure light vision sensor calibration method based on parallel bicylindrical target |
CN107121109A (en) * | 2017-06-12 | 2017-09-01 | 北京航空航天大学 | A kind of structure light parameter calibration device and method based on preceding plated film level crossing |
CN107218904A (en) * | 2017-07-14 | 2017-09-29 | 北京航空航天大学 | A kind of line structured light vision sensor calibration method based on sawtooth target |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ITUA20162698A1 (en) * | 2016-04-19 | 2017-10-19 | Mer Mec S P A | OPTICAL SYSTEM FOR THE MEASUREMENT OF THE CONTACT FORCE BETWEEN THE PANTOGRAPH AND THE CATENARY |
CN110118528B (en) * | 2019-04-29 | 2020-11-06 | 天津大学 | Line structure light calibration method based on chessboard target |
-
2021
- 2021-05-11 CN CN202110508393.7A patent/CN113251944B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101627147A (en) * | 2007-02-26 | 2010-01-13 | 莱博德光学有限责任公司 | Vacuum treatment of strip-shaped substrates |
CN104848801A (en) * | 2015-06-05 | 2015-08-19 | 北京航空航天大学 | Line structure light vision sensor calibration method based on parallel bicylindrical target |
CN107121109A (en) * | 2017-06-12 | 2017-09-01 | 北京航空航天大学 | A kind of structure light parameter calibration device and method based on preceding plated film level crossing |
CN107218904A (en) * | 2017-07-14 | 2017-09-29 | 北京航空航天大学 | A kind of line structured light vision sensor calibration method based on sawtooth target |
Non-Patent Citations (5)
Title |
---|
Calibration method for a line-structured light;zhenmin zhu;《applied optics》;20200210;全文 * |
Camera calibration based on two-cylinder target;chenxiaoqi;《optics express》;20190930;全文 * |
Complete calibration of a structured light stripe vision sensor through a single cylindrical target;Xinyun Wang;《Optics and Lasers in Engineering》;20200430;全文 * |
全景结构光视觉测量通用畸变校正模型;孙军华;《光学学报》;20181120;全文 * |
基于轴线投影精确模型的弯管立体视觉测量方法;孙军华;《航空制造技术》;20190301;全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN113251944A (en) | 2021-08-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110118528B (en) | Line structure light calibration method based on chessboard target | |
CN110276808B (en) | Method for measuring unevenness of glass plate by combining single camera with two-dimensional code | |
CN107121109B (en) | structural optical parameter calibration device and method based on front coated plane mirror | |
Zhou et al. | Complete calibration of a structured light stripe vision sensor through planar target of unknown orientations | |
CN106683137B (en) | Artificial mark based monocular and multiobjective identification and positioning method | |
CN110378969B (en) | Convergent binocular camera calibration method based on 3D geometric constraint | |
CN109163657B (en) | Round target pose detection method based on binocular vision three-dimensional reconstruction | |
CN109579695B (en) | Part measuring method based on heterogeneous stereoscopic vision | |
CN110672020A (en) | Stand tree height measuring method based on monocular vision | |
CN113744351B (en) | Underwater structure light measurement calibration method and system based on multi-medium refraction imaging | |
CN110455225B (en) | Rectangular spline shaft coaxiality and key position measuring method based on structured light vision | |
CN110940295B (en) | High-reflection object measurement method and system based on laser speckle limit constraint projection | |
CN109974618B (en) | Global calibration method of multi-sensor vision measurement system | |
CN107084680A (en) | A kind of target depth measuring method based on machine monocular vision | |
CN110763204A (en) | Planar coding target and pose measurement method thereof | |
Zhou et al. | Constructing feature points for calibrating a structured light vision sensor by viewing a plane from unknown orientations | |
CN111080711A (en) | Method for calibrating microscopic imaging system in approximately parallel state based on magnification | |
CN109712139A (en) | The dimension measurement method of monocular vision based on linear movement mould group | |
CN116129037A (en) | Visual touch sensor, three-dimensional reconstruction method, system, equipment and storage medium thereof | |
CN108364318A (en) | A kind of planar dimension monocular measuring method for eliminating protective glass refractive effect | |
Liu et al. | Calibration method based on the image of the absolute quadratic curve | |
CN109506629B (en) | Method for calibrating rotation center of underwater nuclear fuel assembly detection device | |
CN113251944B (en) | Line structured light vision sensor calibration method and device based on single cylindrical target | |
CN116402904A (en) | Combined calibration method based on laser radar inter-camera and monocular camera | |
CN112562010B (en) | Simplified imaging model with double telecentric lenses and calibration method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |