CN111811395A - Monocular vision-based dynamic plane pose measurement method - Google Patents
Monocular vision-based dynamic plane pose measurement method Download PDFInfo
- Publication number
- CN111811395A CN111811395A CN202010518752.2A CN202010518752A CN111811395A CN 111811395 A CN111811395 A CN 111811395A CN 202010518752 A CN202010518752 A CN 202010518752A CN 111811395 A CN111811395 A CN 111811395A
- Authority
- CN
- China
- Prior art keywords
- laser
- points
- measurement
- tables
- plane
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/002—Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
Abstract
The invention relates to a monocular vision-based dynamic plane pose measurement method, which comprises the following steps: the vision measuring device is constructed by adopting two one-dimensional rotating tables, an industrial camera and a laser, and the two rotating tables are respectively named as: a horizontal turntable, a vertical turntable; returning the two rotary tables to zero positions, calibrating the space poses of the rotary shafts of the two rotary tables and the laser beams by using the laser tracker and the hemispherical targets, determining direction vectors and fixed points, and normalizing the direction vectors; establishing a depth recovery mathematical model by utilizing the corresponding relation between the depth information of the laser points and the image coordinates; determining the conversion relation between the measurement coordinate system of the laser tracker and the measurement coordinate system of the measurement device; the vision measuring device scans a target plane, one image is shot at one position, the rotating angles of the two rotary tables are recorded simultaneously, and the number of scanning points is more than three; and carrying out plane fitting by the three-dimensional space coordinates of the scanning points to determine the space attitude of the target plane.
Description
Technical Field
The invention relates to a measuring device based on vision, in particular to a plane pose dynamic measuring method based on monocular vision.
Background
According to different technical requirements and application environments, various measuring methods and devices are produced, wherein the measuring system based on monocular vision is simple in structure, strong in real-time performance and environment adaptability, free of problems such as three-dimensional matching and the like, and is widely concerned. The paper document (i.e., a line structure light vision method [ J ] astronavigation academic newspaper for measuring pose of a non-cooperative large target, 2012,33(6:728-, the difference between the structural mode and the measurement principle is not large, the mapping relation between the characteristic information and the image is established by utilizing the information between the characteristic points, and the pose of the target is solved, but the method is mostly suitable for specific occasions and lacks adaptability and universality.
The granted chinese patent 201410850221.8 (measuring method based on non-orthogonal axis laser theodolite) proposes a "three-axis" architecture of non-orthogonal axis laser theodolite, and two rotary tables and laser beams do not have orthogonal structure requirements, and also do not need to intersect at a point in space, and two one-dimensional rotary tables, one industrial camera and one laser are used to construct a vision measuring device. Compared with the traditional pose measurement mode based on monocular vision, the device has the advantages of simple structure, easiness in installation and lower cost, can realize pose measurement through one-time calibration after assembly, does not need cooperation of cooperative targets in the measurement process, has wide application range and provides a new way for measuring the plane pose.
Disclosure of Invention
The invention provides a monocular vision-based pose measuring method based on an existing non-orthogonal shafting laser theodolite. Because the measuring device adopts a shafting structure, the measuring range is fully expanded by matching the two one-dimensional rotary tables. In addition, the laser point is used as an imaging mark point, and the method does not need to set a special cooperation target any more, so that the application range of the measuring device is wider. Meanwhile, due to the characteristics of the structure and the principle of the device, a camera does not need to be calibrated in the measuring process, and the device is convenient and practical. The technical scheme is as follows:
a monocular vision-based dynamic plane pose measurement method comprises the following steps:
(1) the vision measuring device is constructed by adopting two one-dimensional rotating tables, an industrial camera and a laser, and the two rotating tables are respectively named as: a horizontal turntable, a vertical turntable;
(2) returning the two rotary tables to zero positions, calibrating the space poses of the rotary shafts of the two rotary tables and the laser beams by using the laser tracker and the hemispherical targets, determining direction vectors and fixed points, and normalizing the direction vectors;
(3) acquiring actual distances L of a plurality of groups of laser points and image point pixel coordinates u thereof as control points by utilizing the corresponding relation between the depth information of the laser points and the image coordinates, and establishing a depth recovery mathematical model;
(4) establishing a measurement coordinate system of a vision measurement device according to the calibration parameters, and determining the conversion relation between the measurement coordinate system of the laser tracker and the measurement coordinate system of the measurement device;
(5) the vision measuring device scans a target plane, one image is shot at one position, the rotating angles of the two rotary tables are recorded simultaneously, and the number of scanning points is more than three;
(6) according to the calibration parameters and the measurement data, the motion process is divided into two independent processes of horizontal turntable rotation and vertical turntable rotation based on an Euler angle and quaternion method, and the three-dimensional space coordinates of the scanning points are obtained through calculation by using a depth recovery mathematical model;
(7) and carrying out plane fitting by the three-dimensional space coordinates of the scanning points to determine the space attitude of the target plane.
The invention can construct an omnibearing non-contact dynamic measuring device for the plane pose in order to realize a plane space pose measuring method with higher precision and simple and convenient operation.
Drawings
Fig. 1 is a schematic structural view of a pose measuring device based on monocular vision, wherein 1 is a horizontal rotary table, 2 is a vertical rotary table, 3 is a laser, 4 is a camera, 5 is a vertical rotary shaft, 6 is a horizontal rotary shaft, and 7 is a laser beam.
FIG. 2 is a schematic diagram of the principle of monocular visual depth information based recovery, wherein 8 is the perspective projection center of the camera imaging system, 9 is the laser beam fixed point, 10 is the laser point, 11 is the imaging plane, 12 is the symmetry plane of the imaging plane, 13 is the laser point imaging point, 14 is the imaging plane center, u is the pixel coordinate of the laser point in the horizontal direction, u is the u laser point0The pixel coordinate of the center of the image plane in the horizontal direction, f is the effective focal length, D is the distance between the optical axis and the laser beam in the horizontal direction, and L is the laser spot distance.
Detailed Description
The invention is further described below with reference to the accompanying drawings.
The direction vectors and fixed points of the horizontal rotary table rotating shaft, the vertical rotary table rotating shaft and the laser beam are key parameters for realizing accurate measurement of the measuring device, and for the convenience of expression, the directions are shown in table 1:
TABLE 1
(1) Two one-dimensional rotating tables, an industrial camera and a laser are adopted to construct a measuring device, and the two rotating tables are named as: horizontal turntable, vertical turntable, as shown in fig. 1;
(2) and the rotary table returns to the zero position, and the spatial pose of the rotary table and the laser beam is calibrated by using the laser tracker and the hemispherical target. 1) Firstly, a rotating shaft of a rotary table is calibrated, a target ball of a laser tracker is fixed on the rotary table, the rotary table is rotated for multiple times at equal intervals, coordinates of the target ball are measured simultaneously, and space circle fitting is carried out on obtained data to obtain a direction vector and a fixed point of a straight line where the rotating shaft is located. 2) Then calibrating a laser beam, adjusting the position of the hemispherical target through a precision displacement platform until the laser aims at the sphere center of the semicircular target ball, replacing the semicircular target ball with a target ball of a laser tracker to obtain the coordinate of the sphere center, repeating the steps, and performing straight line fitting on the obtained data to obtain a direction vector and a fixed point of the straight line where the laser beam is located;
(3) as shown in FIG. 2, according to the laser triangulation, the depth information of the laser spot is calculated in such a manner that
Wherein d isxAs for the pixel size, the distance information of the laser spot corresponds to the pixel coordinates thereof one by one as can be seen from the equation (1). According to the depth recovery method, the depth recovery mathematical model is established by utilizing the corresponding relation between a plurality of groups of distance information L and the pixel coordinate u in the horizontal direction, compared with the laser triangulation principle, the complicated calibration process is avoided, and the depth information can be directly calculated according to the pixel coordinate of the laser point image point. The realization method comprises the following steps: according to the calibration process of the laser beam in the step (2), acquiring a plurality of groups of laser point actual distances L and image point pixel coordinates u thereof as control points, and determining parameters (a, b, c and d) of a depth recovery mathematical model by using a least square method, wherein the parameters comprise:
L＝au3+bu2+cu+d (2)
(4) setting a measurement coordinate system o-xyz of the laser tracker, establishing a measurement coordinate system o '-x' y 'z' of the measurement device according to calibration parameters, taking a fixed point of a vertical rotating shaft as an original point o ', and the positive direction of the vertical rotating shaft as a z' axis, and determining a conversion matrix M of the measurement coordinate system of the laser tracker and the measurement coordinate system of the measurement device;
[x′ y′ z′ 1]T＝M[x y z 1]T(3)
(5) the measuring device scans a target plane, an image is shot at one position, the rotating angles of the two rotary tables are recorded at the same time, the rotating angle of the horizontal rotary table is recorded as alpha, the rotating angle of the vertical rotary table is recorded as beta, and the number of scanning points is more than three;
(6) and analyzing the motion state of the laser beam based on an Euler angle and quaternion method according to the calibration parameters and the measurement data, wherein the motion process is divided into two independent processes of horizontal turntable rotation and vertical turntable rotation.
1) Horizontal rotation alphaThe conversion relation before and after the rotation of the laser beam can be represented by a rotation matrix RHRepresents:
after horizontal rotation, the horizontal rotation axis is an initial direction vector, a fixed point and a laser beam direction vector, wherein the fixed point is respectively expressed as:
2) vertical rotation beta, rotation matrix RVExpressed in quaternion form:
wherein q is0＝cos(β/2)，q1＝vxsin(β/2)，q2＝vysin(β/2)，q3＝vzsin(β/2)，
After vertical rotation, the laser beam direction vector, the fixed point, is represented as:
through image processing, extracting a laser point, acquiring a laser point pixel coordinate, and obtaining distance information L of a scanning point P by a depth recovery mathematical model, namely determining a space coordinate of the laser point, wherein the space coordinate comprises the following steps:
(7) and performing plane fitting on the scanning points based on the space coordinates of the scanning points to determine a normal vector (l, m, n) of the target plane, namely the space attitude information of the target plane.
Claims (1)
1. A monocular vision-based dynamic plane pose measurement method comprises the following steps:
(1) the vision measuring device is constructed by adopting two one-dimensional rotating tables, an industrial camera and a laser, and the two rotating tables are respectively named as: horizontal revolving stage, vertical revolving stage.
(2) Returning the two rotary tables to zero positions, calibrating the space poses of the rotary shafts of the two rotary tables and the laser beams by using the laser tracker and the hemispherical targets, determining direction vectors and fixed points, and normalizing the direction vectors;
(3) acquiring actual distances L of a plurality of groups of laser points and image point pixel coordinates u thereof as control points by utilizing the corresponding relation between the depth information of the laser points and the image coordinates, and establishing a depth recovery mathematical model;
(4) establishing a measurement coordinate system of a vision measurement device according to the calibration parameters, and determining the conversion relation between the measurement coordinate system of the laser tracker and the measurement coordinate system of the measurement device;
(5) the vision measuring device scans a target plane, one image is shot at one position, the rotating angles of the two rotary tables are recorded simultaneously, and the number of scanning points is more than three;
(6) according to the calibration parameters and the measurement data, the motion process is divided into two independent processes of horizontal turntable rotation and vertical turntable rotation based on an Euler angle and quaternion method, and the three-dimensional space coordinates of the scanning points are obtained through calculation by using a depth recovery mathematical model;
(7) and carrying out plane fitting by the three-dimensional space coordinates of the scanning points to determine the space attitude of the target plane.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010518752.2A CN111811395B (en) | 2020-06-09 | 2020-06-09 | Monocular vision-based dynamic plane pose measurement method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010518752.2A CN111811395B (en) | 2020-06-09 | 2020-06-09 | Monocular vision-based dynamic plane pose measurement method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111811395A true CN111811395A (en) | 2020-10-23 |
| CN111811395B CN111811395B (en) | 2021-08-10 |
Family
ID=72846545
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010518752.2A Active CN111811395B (en) | 2020-06-09 | 2020-06-09 | Monocular vision-based dynamic plane pose measurement method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111811395B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112729245A (en) * | 2020-11-30 | 2021-04-30 | 成都飞机工业（集团）有限责任公司 | Automatic aiming point projector and point projecting method |
| CN112857265A (en) * | 2021-01-12 | 2021-05-28 | 包头钢铁（集团）有限责任公司 | Method for constructing center line of hidden point rolling mill by laser tracker |
| CN113029124A (en) * | 2021-03-03 | 2021-06-25 | 吉林大学 | Three-dimensional attitude and position measuring device based on infrared vision guidance and laser ranging |
| CN113379846A (en) * | 2021-05-28 | 2021-09-10 | 上海汇像信息技术有限公司 | Method for calibrating rotating shaft of rotary table based on direction indication mark point calibration template |
| CN113639633A (en) * | 2021-07-26 | 2021-11-12 | 中国航空工业集团公司北京航空精密机械研究所 | Method for aligning angular zero position of clamp in multi-axis vision measuring device |
| CN113791086A (en) * | 2021-09-08 | 2021-12-14 | 天津大学 | Method and device for measuring surface defects of fan-shaped section blade based on computer vision |
| CN116772744A (en) * | 2023-08-24 | 2023-09-19 | 成都量芯集成科技有限公司 | 3D scanning device and method based on laser ranging and vision fusion |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102009043823A1 (en) * | 2008-08-28 | 2010-07-29 | Werth Messtechnik Gmbh | Object i.e. stent, structure and geometry determining method for use in coordinate measuring device, involves arranging tactile, image processing and X-ray sensors in X, Y and Z directions of coordinate measuring device relative to object |
| US8155870B2 (en) * | 2008-06-20 | 2012-04-10 | Agrocom Gmbh & Co. Agrarsystem Kg | Method of navigating an agricultural vehicle, and an agricultural vehicle implementing the same |
| CN104535042A (en) * | 2014-12-31 | 2015-04-22 | 天津大学 | Measuring method based on non-orthogonal shafting laser theodolite |
| CN104748679A (en) * | 2015-03-19 | 2015-07-01 | 中国矿业大学(北京) | Space point three dimension coordinate measuring method based on rotation sector laser angle measurement |
| CN105043251A (en) * | 2015-06-01 | 2015-11-11 | 河北工业大学 | Calibration method for line-structured light sensor based on mechanical movement and device |
| CN105758364A (en) * | 2016-02-29 | 2016-07-13 | 天津大学 | Method for establishing collimation axis dynamic model of non-orthogonal axes laser theodolite |
| CN108362266A (en) * | 2018-02-22 | 2018-08-03 | 北京航空航天大学 | One kind is based on EKF laser rangings auxiliary monocular vision measurement method and system |
| CN110211175A (en) * | 2019-05-21 | 2019-09-06 | 天津大学 | Alignment laser light beam spatial pose scaling method |
| CN110332887A (en) * | 2019-06-27 | 2019-10-15 | 中国地质大学（武汉） | A kind of monocular vision pose measurement system and method based on characteristic light punctuate |
| CN110686595A (en) * | 2019-09-27 | 2020-01-14 | 天津大学 | Laser beam space pose calibration method of non-orthogonal axis system laser total station |
| CN111210468A (en) * | 2018-11-22 | 2020-05-29 | 中移（杭州）信息技术有限公司 | Image depth information acquisition method and device |
-
2020
- 2020-06-09 CN CN202010518752.2A patent/CN111811395B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8155870B2 (en) * | 2008-06-20 | 2012-04-10 | Agrocom Gmbh & Co. Agrarsystem Kg | Method of navigating an agricultural vehicle, and an agricultural vehicle implementing the same |
| DE102009043823A1 (en) * | 2008-08-28 | 2010-07-29 | Werth Messtechnik Gmbh | Object i.e. stent, structure and geometry determining method for use in coordinate measuring device, involves arranging tactile, image processing and X-ray sensors in X, Y and Z directions of coordinate measuring device relative to object |
| CN104535042A (en) * | 2014-12-31 | 2015-04-22 | 天津大学 | Measuring method based on non-orthogonal shafting laser theodolite |
| CN104748679A (en) * | 2015-03-19 | 2015-07-01 | 中国矿业大学(北京) | Space point three dimension coordinate measuring method based on rotation sector laser angle measurement |
| CN105043251A (en) * | 2015-06-01 | 2015-11-11 | 河北工业大学 | Calibration method for line-structured light sensor based on mechanical movement and device |
| CN105758364A (en) * | 2016-02-29 | 2016-07-13 | 天津大学 | Method for establishing collimation axis dynamic model of non-orthogonal axes laser theodolite |
| CN108362266A (en) * | 2018-02-22 | 2018-08-03 | 北京航空航天大学 | One kind is based on EKF laser rangings auxiliary monocular vision measurement method and system |
| CN111210468A (en) * | 2018-11-22 | 2020-05-29 | 中移（杭州）信息技术有限公司 | Image depth information acquisition method and device |
| CN110211175A (en) * | 2019-05-21 | 2019-09-06 | 天津大学 | Alignment laser light beam spatial pose scaling method |
| CN110332887A (en) * | 2019-06-27 | 2019-10-15 | 中国地质大学（武汉） | A kind of monocular vision pose measurement system and method based on characteristic light punctuate |
| CN110686595A (en) * | 2019-09-27 | 2020-01-14 | 天津大学 | Laser beam space pose calibration method of non-orthogonal axis system laser total station |
Non-Patent Citations (3)
| Title |
|---|
| 关瑞芬等: "基于正交柱面成像的空间物体位姿精密测量", 《光学学报》 * |
| 段晓登等: "激光束空间位姿高精度标定方法", 《光学学报》 * |
| 王占胜等: "基于视觉引导的激光全站仪精确测量方法", 《光电子·激光》 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112729245A (en) * | 2020-11-30 | 2021-04-30 | 成都飞机工业（集团）有限责任公司 | Automatic aiming point projector and point projecting method |
| CN112729245B (en) * | 2020-11-30 | 2022-08-12 | 成都飞机工业（集团）有限责任公司 | Automatic aiming point projector and point projecting method |
| CN112857265A (en) * | 2021-01-12 | 2021-05-28 | 包头钢铁（集团）有限责任公司 | Method for constructing center line of hidden point rolling mill by laser tracker |
| CN112857265B (en) * | 2021-01-12 | 2022-06-21 | 包头钢铁（集团）有限责任公司 | Method for constructing center line of hidden point rolling mill by laser tracker |
| CN113029124A (en) * | 2021-03-03 | 2021-06-25 | 吉林大学 | Three-dimensional attitude and position measuring device based on infrared vision guidance and laser ranging |
| CN113029124B (en) * | 2021-03-03 | 2024-01-16 | 吉林大学 | Three-dimensional attitude position measurement device based on infrared visual guidance and laser ranging |
| CN113379846A (en) * | 2021-05-28 | 2021-09-10 | 上海汇像信息技术有限公司 | Method for calibrating rotating shaft of rotary table based on direction indication mark point calibration template |
| CN113639633A (en) * | 2021-07-26 | 2021-11-12 | 中国航空工业集团公司北京航空精密机械研究所 | Method for aligning angular zero position of clamp in multi-axis vision measuring device |
| CN113639633B (en) * | 2021-07-26 | 2023-07-07 | 中国航空工业集团公司北京航空精密机械研究所 | Clamp angular zero alignment method in multi-axis vision measurement device |
| CN113791086A (en) * | 2021-09-08 | 2021-12-14 | 天津大学 | Method and device for measuring surface defects of fan-shaped section blade based on computer vision |
| CN116772744A (en) * | 2023-08-24 | 2023-09-19 | 成都量芯集成科技有限公司 | 3D scanning device and method based on laser ranging and vision fusion |
| CN116772744B (en) * | 2023-08-24 | 2023-10-24 | 成都量芯集成科技有限公司 | 3D scanning device and method based on laser ranging and vision fusion |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111811395B (en) | 2021-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111811395B (en) | Monocular vision-based dynamic plane pose measurement method | |
| CN113532311B (en) | Point cloud splicing method, device, equipment and storage equipment | |
| CN109859275B (en) | Monocular vision hand-eye calibration method of rehabilitation mechanical arm based on S-R-S structure | |
| CN110243283B (en) | Visual measurement system and method with variable visual axis | |
| Zhang et al. | A robust and rapid camera calibration method by one captured image | |
| CN108594245A (en) | A kind of object movement monitoring system and method | |
| Luna et al. | Calibration of line-scan cameras | |
| CN105046715B (en) | A kind of line-scan digital camera scaling method based on interspace analytic geometry | |
| CN106767913B (en) | Compound eye system calibration device and calibration method based on single LED luminous point and two-dimensional rotary table | |
| CN109087355B (en) | Monocular camera pose measuring device and method based on iterative updating | |
| CN112132908B (en) | Camera external parameter calibration method and device based on intelligent detection technology | |
| CN111366908B (en) | Laser radar rotary table and measuring device and measuring method thereof | |
| JP6333396B2 (en) | Method and apparatus for measuring displacement of mobile platform | |
| CN112492292B (en) | Intelligent visual 3D information acquisition equipment of free gesture | |
| CN110686595A (en) | Laser beam space pose calibration method of non-orthogonal axis system laser total station | |
| CN110763204A (en) | Planar coding target and pose measurement method thereof | |
| CN111915685B (en) | Zoom camera calibration method | |
| CN107727118B (en) | Method for calibrating GNC subsystem equipment attitude measurement system in large aircraft | |
| Grudziński et al. | Stereovision tracking system for monitoring loader crane tip position | |
| CN109059761B (en) | EIV model-based handheld target measuring head calibration method | |
| CN115937326A (en) | Large-view-field camera on-site rapid calibration method suitable for complex working conditions | |
| CN115183981A (en) | Wind tunnel coordinate shafting calibration method and calibration device based on coding marks | |
| Yang et al. | A novel vision localization method of automated micro-polishing robot | |
| JPH07139918A (en) | Method for measuring central position/radius of cylinder | |
| CN114910241B (en) | Wind tunnel coordinate system conversion method for wind tunnel model attitude measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |