CN101876555A - Lunar rover binocular vision navigation system calibration method - Google Patents

Lunar rover binocular vision navigation system calibration method Download PDF

Info

Publication number
CN101876555A
CN101876555A CN2009102368572A CN200910236857A CN101876555A CN 101876555 A CN101876555 A CN 101876555A CN 2009102368572 A CN2009102368572 A CN 2009102368572A CN 200910236857 A CN200910236857 A CN 200910236857A CN 101876555 A CN101876555 A CN 101876555A
Authority
CN
China
Prior art keywords
calibrated
coordinate
caliberating device
cameras
coordinate system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2009102368572A
Other languages
Chinese (zh)
Other versions
CN101876555B (en
Inventor
李春艳
王立
卢欣
范生宏
李晓
周建涛
刘淑娟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Control Engineering
Original Assignee
Beijing Institute of Control Engineering
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Control Engineering filed Critical Beijing Institute of Control Engineering
Priority to CN2009102368572A priority Critical patent/CN101876555B/en
Publication of CN101876555A publication Critical patent/CN101876555A/en
Application granted granted Critical
Publication of CN101876555B publication Critical patent/CN101876555B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a lunar rover binocular vision navigation system calibration method. A measurement system measures a calibration device comprising a light-reflecting measurement mark and a coded mark to obtain a control point coordinate, two cameras to be calibrated respectively shoot the calibration device, and internal parameters of the two cameras to be calibrated and external parameters of the two cameras to be calibrated at different positions relative to the calibration device can be calibrated by adopting a collinearity equation; and a theodolite measurement system is matched with the calibration device to calibrate respective prism square coordinate system of the two cameras to be calibrated, and respective external parameters of the two cameras to be calibrated are calibrated by utilizing the respective prism square coordinate system and the external parameters of the two cameras to be calibrated at different positions relative to the calibration device respectively. The lunar rover binocular vision navigation system calibration method radically solves the problem that a coordinate system of a camera cannot be obtained by a direct measurement method, and makes the coordinate system of the camera visible; meanwhile, the lunar rover binocular vision navigation system calibration method has the advantages of simple operation, high calibration precision and high work efficiency.

Description

A kind of calibration method for lunar rover binocular vision navigation system
Technical field
The present invention relates to a kind of calibration method for lunar rover binocular vision navigation system, be mainly used in fields such as digital photogrammetry, computer vision.
Background technology
Binocular vision navigation system of lunar surface vehicle mainly is made of two digital cameras, two prism squares, and as shown in Figure 1, two prism squares are separately fixed on two cameras.The lunar rover binocular vision navigation is main to rely on two digital cameras to obtain external information and then definite self-position simultaneously, comprising vision measurement, terrain match, path planning etc.In binocular vision navigation system, it is gordian technique that system synthesis is demarcated, and accurate the demarcation is the basis that guarantees correct navigation.So can the stated accuracy of the binocular vision navigation system of lunar surface vehicle directly follow-up work of decision carry out smoothly.The demarcation of binocular vision navigation system of lunar surface vehicle is primarily aimed at two cameras to be carried out, camera is demarcated intrinsic parameter and the outer parameter of camera under the prism square coordinate system that comprises camera, this camera belongs to big visual field wide-angle optics, distortion effects is serious, and the demarcation of camera is belonged to the difficult point problem.
Generally adopt turntable to add the mode of parallel light tube to the traditional scaling method of above-mentioned camera, obtain the pixel coordinate of different attitude correspondences, treat the fixed system least-squares calculation according to high-order quadric surface fitting algorithm then.This scaling method characteristics are that undetermined coefficient is many, interrogatory is true, and the high-order quadratic equation is easy to generate fitting parameter vibration, and are not too suitable for camera (non-infinite distance target imaging) closely, double camera.
Summary of the invention
Technology of the present invention is dealt with problems and is: overcome the deficiencies in the prior art, propose a kind of calibration method for lunar rover binocular vision navigation system, the present invention is simple to operate, stated accuracy height, high efficiency.
Technical solution of the present invention is: a kind of calibration method for lunar rover binocular vision navigation system comprises that the demarcating steps of camera intrinsic parameter and the demarcating steps of Camera extrinsic number are;
The demarcating steps of camera intrinsic parameter is:
(1) sets up the caliberating device that comprises light echo reflection measurement sign and coding maker, obtain the coordinate system of this caliberating device, utilize measuring system that light echo reflection measurement sign and coding maker on the caliberating device are measured, the three-dimensional coordinate that obtains caliberating device photo measure last time reflective marker and coding maker is as the reference mark coordinate, then the reference mark coordinate conversion is arrived under this caliberating device coordinate system, obtain the reference mark coordinate under the caliberating device coordinate system;
(2) utilizing two cameras to be calibrated respectively the caliberating device of setting up in the step (1) to be carried out the honest of at least four positions takes pictures, after two cameras to be calibrated are finished honest taking pictures to each position, two camera half-twists to be calibrated are taken pictures at least four positions of caliberating device respectively once more, comprise four coding maker points in every photo at least;
(3) utilize reference mark coordinate under the caliberating device coordinate system that step (1) obtains, the photo that left and right two cameras to be calibrated in the step (2) are taken carries out Flame Image Process respectively, the controlled some picpointed coordinate under the picture plane that two cameras to be calibrated are taken, utilize reference mark coordinate and two picpointed coordinates adopt collinearity equation calculate respectively two cameras to be calibrated separately intrinsic parameter and two cameras to be calibrated with respect to the outer parameter of caliberating device in each position;
The demarcating steps of Camera extrinsic number is:
(a) utilize the transit survey system to set up the transit survey system coordinate system, utilize the transit survey system that the prism square on two cameras to be calibrated is collimated respectively, obtain the three-dimensional coordinate of two prism squares under the transit survey system coordinate system;
(b) utilize the transit survey system that measurement reflective marker of the light echo in the caliberating device and coding maker are measured, obtain light echo reflection measurement sign and the coding maker three-dimensional coordinate under the transit survey system coordinate system;
(c) light echo reflection measurement sign and coding maker being carried out common point at the three-dimensional coordinate under the transit survey system coordinate system and light echo reflection measurement sign and the three-dimensional coordinate of coding maker under the caliberating device coordinate system transforms, obtain the transformational relation of caliberating device coordinate system and transit survey system coordinate system, utilize this transformational relation to convert two prism squares the three-dimensional coordinate of two prism squares under the caliberating device coordinate system at the three-dimensional coordinate under the transit survey system coordinate system, set up the prism square coordinate system of two cameras to be calibrated;
(d) utilize two cameras to be calibrated that step (3) obtains with respect to the outer parameter of caliberating device in each position, according to the public coordinate transformation relation of two prism squares three-dimensional coordinate under the caliberating device coordinate system, calibrate the outer parameter under each comfortable its prism square coordinate system of two cameras to be calibrated respectively at three-dimensional coordinate under the transit survey system coordinate system and prism square.
Described caliberating device comprises demarcates framework, light echo reflection measurement sign (4), coding maker (5) and annular light source; Demarcate framework and comprise main frame (1), left redundant framework (2) and right redundant framework (3) that size is identical, main frame (1) wherein, left redundant framework (2) is rectangular structure with right redundant framework (3), main frame (1), left redundant framework (2) and right redundant framework (3) three's height is all identical with width, angle between left redundant framework (2) and right redundant framework (3) and the main frame (1) is the obtuse angle, the length sum l of three frameworks and demarcation camera are l=2htan (w) apart from the pass between the distance h of main frame, the length of main frame and highly be equal to and demarcate the distance of camera apart from main frame, multiple row mounting bar frame (6) is crisscross arranged on the front surface of demarcating framework and rear surface, spacing between front surface or the rear surface two row mounting bar frames is the 1/10-1/8 of main frame (1) length, a plurality of light echo reflection measurement signs (4) are set on every row mounting bar frame (6), distance between two light echo reflection measurement signs (4) is the 1/20-1/18 of main frame (1) length, at least one point-like coding maker (5) is set in every row light echo reflection measurement sign (4), annular light source is made of the anterior position that is arranged on the demarcation framework two groups of led light sources, install in every group of annular light source and demarcate camera, every group of annular light source comprises six uniform led light sources, and w is half of navigational system viewing field of camera angle.
The present invention's beneficial effect compared with prior art is: the characteristics that the present invention is directed to binocular vision navigation system, utilize measuring system that the caliberating device that comprises light echo reflection measurement sign and coding maker is measured the reference mark coordinate, utilizes two cameras to be calibrated respectively caliberating device to be taken pictures, adopt collinearity equation can calibrate the intrinsic parameter of two cameras to be calibrated and two cameras to be calibrated then with respect to the outer parameter of caliberating device in each position; Utilize the transit survey system to cooperate caliberating device to calibrate two cameras to be calibrated prism square coordinate system separately, utilize separately prism square coordinate system and two cameras to be calibrated separately the relative Calibration device the outer parameter realization of each position to two cameras to be calibrated separately outside the demarcation of parameter.It is to derive with camera coordinates to be calibrated that the present invention uses outside caliberating device, use prism square to represent camera coordinates system then, calculate the transformational relation of camera coordinates system and prism square coordinate system, fundamentally solved the problem that camera coordinates system can not obtain by direct measuring method, made the camera coordinates cording observability be arranged; The present invention has made full use of the Given information at a large amount of reference mark of caliberating device, cooperate industrial measuring system, improved the outer not high problem of parameter calibration precision of traditional camera, explicit physical meaning, simple to operate, the stated accuracy height, can directly obtain the parameter to be calibrated of camera to be calibrated under the prism square coordinate system, demarcate comprehensive relative accuracy and can reach 1/1000, the external mutually parameter calibration precision of camera can reach 1/3000, finish camera intrinsic parameter to be calibrated and the externally demarcation of parameter mutually, can in one hour, finish, improved work efficiency greatly.
Description of drawings
Fig. 1 is a binocular vision navigation system of lunar surface vehicle structure composition diagram;
Fig. 2 is the workflow accompanying drawing of scaling method of the present invention;
Fig. 3 is that the structure of caliberating device is formed synoptic diagram;
Fig. 4 is caliberating device design concept figure;
Fig. 5 is the shape figure of coding maker in the caliberating device;
Fig. 6 is the design concept figure of coding maker in the caliberating device;
Fig. 7 is the picpointed coordinate figure of reference mark of the present invention on the picture plane;
Demarcation field synoptic diagram when Fig. 8 demarcates outer parameter for single camera of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments the present invention is done further detailed description:
The present invention places the caliberating device dead ahead with camera to be calibrated, and camera to be calibrated is two, at intervals, is generally 200mm between two cameras to be calibrated, and two prism squares lay respectively on the camera to be calibrated.Calibration method for lunar rover binocular vision navigation system, specific implementation process is as follows:
As shown in Figure 2, comprise demarcating steps and the prism square coordinate system and the composite calibration step of demarcating the Camera extrinsic number of demarcating the camera intrinsic parameter;
The demarcating steps of demarcating the camera intrinsic parameter is:
(1) sets up the caliberating device that comprises light echo reflection measurement sign and coding maker, obtain the coordinate system of this caliberating device, utilize measuring system that light echo reflection measurement sign and coding maker on the caliberating device are measured, the three-dimensional coordinate that obtains caliberating device photo measure last time reflective marker and coding maker is as the reference mark coordinate, then the reference mark coordinate conversion is arrived under this caliberating device coordinate system, obtain the reference mark coordinate under the caliberating device coordinate system;
As shown in Figure 3, caliberating device is mainly formed by demarcating framework, light echo reflection measurement sign 4, coding maker 5 and annular light source.Demarcate framework and comprise main frame 1, left redundant framework 2 and right redundant framework 3 that size is identical, wherein main frame 1, left redundant framework 2 is rectangular structure with right redundant framework 3, main frame 1, the height H of left redundant framework 2 and right redundant framework 3 is all identical with width M, angle between left redundant framework 2 and right redundant framework 3 and the main frame 1 is the obtuse angle, the length sum l of three frameworks and camera are l=2htan (w) apart from the pass between the distance h of main frame 1, the length L 1 of main frame 1 and height H are equal to demarcates the distance h of camera apart from main frame 1, multiple row mounting bar frame 6 is crisscross arranged on the front surface of demarcating framework and rear surface, spacing t between front surface or the rear surface two row mounting bar frames is the 1/10-1/8 of main frame 1 length L 1, a plurality of light echo reflection measurement signs 4 are set on every row mounting bar frame 6, distance between two light echo reflection measurement signs 4 is the 1/20-1/18 of main frame length, in every row light echo reflection measurement sign 4, at least one point-like coding maker 5 is set, annular light source is made of the anterior position that is arranged on the demarcation framework two groups of led light sources, install in every group of annular light source and demarcate camera, every group of annular light source comprises six uniform led light sources, and w is half of navigational system viewing field of camera angle.
Demarcate framework, the demarcation framework is a carrying manual measurement sign (comprising coding maker) as the main effect of caliberating device, and can keep stable for a long time, the field is demarcated in conduct in the calibration process, will consider to demarcate the actual demand situation of a space size and camera calibration system in the design process, materials used is a stainless steel.Demarcating framework will design according to the imaging model and the distribution of survey mark on image of timing signal photo distance and camera, demarcates on the framework survey mark during shooting and should be covered with and look like the plane.As shown in Figure 4, to the binocular vision navigation system of lunar surface vehicle camera, because field angle (2 ω=63 °), therefore, the design of demarcating frame size should be a standard to satisfy field angle, be l=2htan (w), l is that the framework total length is demarcated in design in the formula, and h is for demarcating the photo distance between camera and the demarcation framework.To 2 ω=63 °, when h=3m, l=3.6m, when h=5m, l=6.2m.Adopt form of straight lines if demarcate framework, require very big to demarcating a space length, therefore the present invention demarcates between main frame in the framework and the left and right sides auxiliary frame certain angle, can strengthen the stability of demarcating framework so greatly, for the ease of demarcating the shooting of camera, the angle between left redundant framework, right redundant framework and the main frame 1 all is designed to the obtuse angle.To 2 ω=63 °, when h=3m, the mounting bar frame that is provided with on the front surface of main frame or the rear surface is 9 row, the spacing of every row is 0.3m, left and right sides auxiliary frame respectively is provided with a row mounting bar frame, when h=5m, and l=6.2m, the spacing of every row is 0.5m, and left and right sides auxiliary frame respectively is provided with a row mounting bar frame.To 2 ω=80 °, when h=3m, l=5m, the mounting bar frame that is provided with on the front surface of main frame or the rear surface is 9 row, and the spacing of every row is 0.3m, and left and right sides auxiliary frame respectively is provided with 2 row mounting bar frames, when h=5m, l=8.4m, the spacing of every row is 0.5m, left and right sides auxiliary frame respectively is provided with 2 row mounting bar frames.
Light echo reflection measurement sign in lunar rover binocular vision navigation system calibration, requires high-precision measurement result.The requirement that a feature of use demarcating itself does not reach high-acruracy survey as measurement features or traditional grid scaling board.Because needing many survey stations in the lunar rover binocular vision navigation system calibration realizes demarcating the manual measurement sign photography of field, can produce different images when photographing from different perspectives, come finishing of auxiliary calibration process by on the demarcation field, increasing light echo reflection measurement sign with obvious characteristic.Use light echo reflection measurement sign in the lunar rover binocular vision navigation system calibration, can guarantee and improve measuring accuracy and reliability on the one hand, light echo reflection measurement sign is easy to lay on the other hand, utilize light echo reflection measurement sign can improve the identification and the identification of testee imaging point as measured point or reference mark at the lunar rover binocular vision navigation system calibration scene, and can realize automatic measurement, improve and demarcate efficient.
Light echo reflection measurement sign is made by the reflectance coating with light echo reflecting material (the 7610 light echo reflecting materials that Minnesota Mining and Manufacturing Company produces), this light echo reflectance coating is made up of glass microballoon or the micro-crystal cubic angle body of the about 50um of diameter, each microballon has opal or reflecting prism function, and reflected light is reflected back by the incident direction of light.At the ad-hoc location light source, under the irradiation as doughnut-shaped flash lamp, light echo reflection measurement sign just can produce the image of high-contrast by low intensity exposure, and the efficient of this sign is more than 100~1000 times of ordinary white sign efficient under the equal illumination condition.In calibration process, camera, in order to guarantee measuring accuracy, need design light echo reflection measurement sign size about 2m from the distance of demarcating framework.In image processing and analytic process, the size of light echo reflection measurement sign imaging on photo should for Can guarantee that image extracts precision.Below the light echo reflection measurement sign size of needs is calculated:
Figure B2009102368572D0000062
Wherein d is a light echo reflection measurement sign diameter, and c is a number of pixels, and r is a pixel size, and h is for demarcating the distance of camera apart from main frame, and f is a camera focus, c in the formula 〉=5.To binocular vision navigation system of lunar surface vehicle camera: f=17.6mm, r=0.015mm, d should consider in the calibration process to ensure that stated accuracy is a prerequisite greater than 8.5mm, take the convenience of operation simultaneously into account, the present invention designs the 10mm that is of light echo reflection measurement sign size.
Coding maker, coding maker are a kind of manual measurement signs that self has digital code information.Coding maker can be discerned automatically by methods such as Flame Image Process, realize the automatic coupling of manual measurement sign in the stereoscopic vision camera calibration process, the automatic splicing that photo is demarcated in realization as the common point between the different photos is as resection reference mark data.According to the requirement that the stereoscopic vision camera calibration has some to the manual measurement sign, use the point-like coding maker as the manual measurement sign in the calibration process, the point-like coding maker is that different in the plane distributions constitutes numerical coding according to point.As shown in Figure 5, the point-like coding maker is made up of 8 identical circular index points of size, and wherein five points are the template point, as having some A, B, C, D, the E of letter among Fig. 6, the point of these five band letters has defined the coordinate system of coding maker, and wherein the E point is an anchor point; Other three light echo reflective marker points are used for describing coding, be called encoded point, as having the point of numeral among Fig. 5, these three codings are distributed on 20 design attitudes (can require to increase or reduce positional number according to reality), each encoded point is given a unique numeral respectively according to design coordinate difference, the process of decoding obtains a little Digital ID by the positional information of recovering encoded point, and the Digital ID realization by encoded point is to the decoding of coding maker.In order easily coding maker to be discerned in image processing process and to be located, any two points all can not be adjacent in three encoded points during practical application.
Light source design according to the reflective characteristic of light echo reflection measurement marking material, needs to use the light source of active illuminating to cooperate in the calibration process, can carry out high-precision calibrating.Use the ring-type light source in the demarcation.Annular light source is formed the anterior position that is arranged on the demarcation framework by two groups of led light sources, installs in every group of annular light source and demarcates camera, and every group of annular light source comprises six uniform led light sources.Led light source in the annular light source has with function and characteristics: light-source brightness is adjustable, can stroboscopic and long bright, when gathering photo, open light source in advance, close light source after gathering end of transmission (EOT), two groups of annular light source horizontal angles are adjustable, and adjustable extent is 0 °~15 °; Its illumination distances: 0.5m-3m; Illumination zone: the 5m*5m of 3m place; Illuminance uniformity: greater than 85%; Spectrum: white light; Light intensity: the single pixel intensity of 3m place images acquired sign is implemented between 100~230; Ring-type light source ring internal diameter is used for installing the demarcation camera more than or equal to 64 millimeters.
(2) utilizing two cameras to be calibrated respectively the caliberating device of setting up in the step (1) to be carried out the honest of at least four positions takes pictures, after two cameras to be calibrated are finished honest taking pictures to each position, two camera half-twists to be calibrated are taken pictures at least four positions of caliberating device respectively once more, comprise four coding maker points in every photo at least;
(3) utilize reference mark coordinate under the caliberating device coordinate system that step (1) obtains, respectively to a left side in the step (2), the photo that right two cameras to be calibrated are taken carries out Flame Image Process, as shown in Figure 7, the controlled some picpointed coordinate under the picture plane that two cameras to be calibrated are taken, it is p that reference mark P projects to as the picture point on the plane through S, optical axis SO is vertical with the picture plane, O is called principal point, distance between SO is called main distance, be designated as f, utilize reference mark coordinate and two picpointed coordinates adopt collinearity equation calculate respectively two cameras to be calibrated separately intrinsic parameter and two cameras to be calibrated with respect to the outer parameter of caliberating device in each position;
Collinearity equation is:
x = - f a 1 ( X - X S ) + b 1 ( Y - Y S ) + c 1 ( Z - Z S ) a 3 ( X - X S ) + b 3 ( Y - Y S ) + c 3 ( Z - Z S ) y = - f a 2 ( X - X S ) + b 2 ( Y - Y S ) + c 2 ( Z - Z S ) a 3 ( X - X S ) + b 3 ( Y - Y S ) + c 3 ( Z - Z S )
A in the following formula 1~c 3Parameter for the camera rotation matrix:
a 1=cos(RY)*cos(RZ);
a 2=-cos(RY)*sin(RZ);
a 3=sin(RY);
b 1=sin(RX)*sin(RY)*cos(RZ)+cos(RX)*sin(RZ);
b 2=-sin(RX)*sin(RY)*sin(RZ)+cos(RX)*cos(RZ);
b 3=-sin(RX)*cos(RY);
c 1=-cos(RX)*sin(RY)*cos(RZ)+sin(RX)*sin(RZ);
c 2=cos(RX)*sin(RY)*sin(RZ)+sin(RX)*cos(RZ);
c 3=cos(RX)*cos(RY);
RX in the following formula, RY, RZ are three rotation angle of one of them camera to be calibrated under the caliberating device coordinate system; X, Y, Z are the reference mark coordinate under the caliberating device coordinate system; Xs, Ys, Zs are the coordinate of camera to be calibrated under the caliberating device coordinate system; F is a camera focus, and x, y are the picpointed coordinate of reference mark under the picture plane that camera is taken.
Elements of interior orientation (the x of camera 0, y 0, f) with optical system distortion factor (K 1, K 2, K 3, P 1, P 2, b 1, b 2) be defined as the inner parameter of camera.
The systematic error of picture point, according to the pinhole imaging system principle, reference mark, optical center and 3 of picture points are conllinear.In fact because the existence of various disturbing factors makes picture point relative its theoretical position on the focal plane have deviation (Δ x, Δ y).At this moment, collinearity equation will be set up the actual deviation value that must consider picture point.Disturb the factor of imaging mainly contain the radial distortion of optical system and decentering distortion, as ratio and quadrature distortion in uneven distortion in plane and the picture plane, if but the elements of interior orientation (x that adopts 0, y 0, f) inaccurate, also can disturb the establishment of collinearity equation then from mathematics.
Radial distortion, optical system radial distortion make picture point radially produce deviation, and radial distortion is symmetrical, and symcenter also not exclusively overlaps with principal point, but usually principal point is considered as symcenter.
Radial distortion can be with following odd polynomial repressentation:
Δ x r = K 1 x ‾ r 2 + K 2 x ‾ r 4 + K 3 x ‾ r 6 + · · · Δ y r = K 1 y ‾ r 2 + K 2 y ‾ r 4 + K 3 y ‾ r 6 + · · ·
In the following formula:
Figure B2009102368572D0000092
Figure B2009102368572D0000093
Figure B2009102368572D0000094
K1, K2, K3 are coefficient of radial distortion.
Decentering distortion, optical lens decentration produces decentering distortion from primary optical axis, and decentering distortion makes picture point not only produce radial missing but also produce tangential deviation, and its expression formula is as follows:
Δ x d = P 1 ( r 2 + 2 x ‾ 2 ) + 2 P 2 x ‾ · y ‾ Δ y d = P 2 ( r 2 + 2 y ‾ 2 ) + 2 P 1 x ‾ · y -
P1, P2 are the decentering distortion coefficient in the following formula.
The distortion of picture plane, because shifting error, asynchronous A/D conversion that causes of the sampling clock of pixel and signal then can cause the plane distortion of picture point in the picture plane, usually can be simplified to the length and width dimension scale factor of pixel and as plane x axle and the non-orthogonal distortion that produces of y axle, its expression formula is as follows:
Δ x m = b 1 x ‾ + b 2 y ‾ Δ y m = 0
B1, b2 are distortion factor in the picture plane in the following formula.
If the elements of interior orientation error is the elements of interior orientation (x that adopts 1, y 0, f) inaccurate, then also can make picpointed coordinate produce deviation, disturb the establishment of collinearity equation.If main apart from error delta f is arranged, then corresponding picpointed coordinate deviation is:
Figure B2009102368572D0000103
Add the error (x of principal point 0, y 0), then the caused picture point deviation of elements of interior orientation error can be expressed as:
Figure B2009102368572D0000104
In sum, the Systematic Errors of arbitrary picture point is radial distortion, decentering distortion, as the summation of distortion and the inaccurate distortion that causes of elements of interior orientation in the plane, the caused picpointed coordinate deviation of these inner parameters is referred to as the systematic error of picture point, is expressed from the next:
Δx ′ = Δ x r + Δ x d + Δ x m + Δ x n Δy ′ = Δ y r + Δ y d + Δ y m + Δ y n
Consider the influence of picture point systematic error, the collinearity condition equation formula of actual image point can be write as:
x + Δ x ′ = - f a 1 ( X - X S ) + b 1 ( Y - Y S ) + c 1 ( Z - Z S ) a 3 ( X - X S ) + b 3 ( Y - Y S ) + c 3 ( Z - Z S ) y + Δ y ′ = - f a 2 ( X - X S ) + b 2 ( Y - Y S ) + c 2 ( Z - Z S ) a 3 ( X - X S ) + b 3 ( Y - Y S ) + c 3 ( Z - Z S )
To The Linearization of Collinearity Equations, can be write as following matrix form:
V=A 1X 1+A 2X 2+A 3X 3-L
In the following formula: V is the picpointed coordinate residual error; X 1, X 2And X 3Be respectively elements of exterior orientation, reference mark coordinate and intrinsic parameter, A 1, A 2And A 3Be respectively the factor arrays of relevant parameter; L is the difference of picpointed coordinate and approximation calculation coordinate.
Wherein, intrinsic parameter X 3Comprise elements of interior orientation and optical system distortion parameter:
X 3=f(x 0,y 0,f,K 1,K 2,K 3,P 1,P 2,b 1,b 2)
Corresponding coefficient matrices A 3For:
A 3 = - 1 0 - x ‾ / f x ‾ r 2 x ‾ r 4 x ‾ r 6 ( 2 x ‾ 2 + r 2 ) 2 x ‾ y ‾ x ‾ y ‾ 0 - 1 - y ‾ / f y ‾ r 2 y ‾ r 4 y ‾ r 6 2 x ‾ y ‾ ‾ ( 2 y ‾ 2 + r 2 ) 0 0
The outer parameter of camera to be calibrated under the caliberating device coordinate system comprises three translation parameter (Δ X s, Δ Y s, Δ Z s) and three rotation parameter RX, RY, RZ.
The demarcating steps of demarcating the Camera extrinsic number is;
(a) as shown in Figure 8, utilize the transit survey system to set up the transit survey system coordinate system, utilize the transit survey system that the prism square on two cameras to be calibrated is collimated respectively, obtain the three-dimensional coordinate of two prism squares under the transit survey system coordinate system;
(b) utilize the transit survey system that measurement reflective marker of the light echo in the caliberating device and coding maker are measured, obtain light echo reflection measurement sign and the coding maker three-dimensional coordinate under the transit survey system coordinate system;
(c) light echo reflection measurement sign and coding maker being carried out common point at the three-dimensional coordinate under the transit survey system coordinate system and light echo reflection measurement sign and the three-dimensional coordinate of coding maker under the caliberating device coordinate system transforms, obtain the transformational relation of caliberating device coordinate system and transit survey system coordinate system, utilize this transformational relation to convert two prism squares the three-dimensional coordinate of two prism squares under the caliberating device coordinate system at the three-dimensional coordinate under the transit survey system coordinate system, set up the prism square coordinate system of two cameras to be calibrated;
(d) utilize two cameras to be calibrated that step (3) obtains with respect to the outer parameter of caliberating device in each position, according to the public coordinate transformation relation of two prism squares three-dimensional coordinate under the caliberating device coordinate system, calibrate the outer parameter under each comfortable its prism square coordinate system of two cameras to be calibrated respectively at three-dimensional coordinate under the transit survey system coordinate system and prism square.To demarcate good camera at last and be installed in the moon binocular vision navigation system, its distance of being separated by is 200mm.
Be contained in respectively on the lunar rover demarcating good camera, make parallax range between it satisfy the job requirement of navigational system.
Embodiment
The step that elder generation demarcates the intrinsic parameter of camera to be calibrated:
(1) (model is respectively: 7610) diameter of making for raw material is that the circular light echo reflection measurement sign of 10mm (perhaps diameter is 8mm) and the caliberating device of coding maker are placed in the laboratory to set up the reflectorized material that comprises by Minnesota Mining and Manufacturing Company's production, promptly can obtain representing the three-dimensional coordinate of this caliberating device relative position, use the industrial measuring system of Zhengzhou Chenwei Technology Co., Ltd.'s research and development or use the V-STARS digital Photogrammetric System that light echo reflection measurement sign and coding maker in the caliberating device are measured, the three-dimensional coordinate that obtains caliberating device photo measure last time reflective marker and coding maker is as the reference mark coordinate, then the reference mark coordinate conversion is arrived under this caliberating device coordinate system, obtain the reference mark coordinate under the caliberating device coordinate system.This industrial measuring system comprises SMN Survey Software one cover of a cover by Zhengzhou Chenwei Technology Co., Ltd.'s research and development, the NET05 total powerstation that the Japanese Suo Jia of two two TM5005 electronic theodolites being produced by Switzerland come card company, company produces, one through demarcation, length is 1007.8 millimeters one of station meter.The V-STARS digital Photogrammetric System, produce by U.S. GSI company, comprise a cover V-STARS digital photography software, INCA3 smart camera, self-orientation rod, two through America NI ST (American National Standard and Technical Board) demarcate, length is the station meter of 1096.mm.
(2) two cameras to be calibrated in distance demarcation position, 5 a meters left and right sides use navigational system are to demarcating 4 honest respectively taking pictures in position, after each position finished honest taking pictures, camera half-twist to be calibrated is carried out taking pictures of four positions to caliberating device once more, 4 positions obtain taking a picture 32 altogether, and 4 photos are all taken in each position.
(3) utilize reference mark coordinate under the caliberating device coordinate system that step (1) obtains, the photo that left and right two cameras to be calibrated in the step (2) are taken carries out Flame Image Process respectively, the controlled some picpointed coordinate under the picture plane that two cameras to be calibrated are taken, utilize reference mark coordinate and two picpointed coordinates adopt collinearity equation calculate respectively two cameras to be calibrated separately intrinsic parameter and two cameras to be calibrated with respect to the outer parameter of caliberating device in each position;
The step that the outer parameter of camera to be calibrated is demarcated:
(a) utilize the SMN industrial measuring system to set up the transit survey system coordinate system, utilize the transit survey system that the prism square on two cameras to be calibrated is collimated respectively, obtain the three-dimensional coordinate of two prism squares under the transit survey system coordinate system; Should be noted that in the process to the prism square alignment measurement that the prism square alignment measurement is measured 8 times at least in order to guarantee measuring accuracy.
(b) utilize the SMN industrial measuring system that measurement reflective marker of the light echo in the caliberating device and coding maker are measured, obtain light echo reflection measurement sign and the coding maker three-dimensional coordinate under the transit survey system coordinate system; This step it should be noted that using transit survey to demarcate a reference mark measures more than 4 at least.
(c) light echo reflection measurement sign and coding maker being carried out common point at the three-dimensional coordinate under the transit survey system coordinate system and light echo reflection measurement sign and the three-dimensional coordinate of coding maker under the caliberating device coordinate system transforms, obtain the transformational relation of caliberating device coordinate system and transit survey system coordinate system, utilize this transformational relation to convert two prism squares the three-dimensional coordinate of two prism squares under the caliberating device coordinate system at the three-dimensional coordinate under the transit survey system coordinate system, set up the prism square coordinate system of two cameras to be calibrated;
(d) utilize two cameras to be calibrated that step (3) obtains with respect to the outer parameter of caliberating device in each position, according to the public coordinate transformation relation of two prism squares three-dimensional coordinate under the caliberating device coordinate system, calibrate the outer parameter under each comfortable its prism square coordinate system of two cameras to be calibrated respectively at three-dimensional coordinate under the transit survey system coordinate system and prism square.Calibration process to the outer parameter of each camera to be calibrated repeats more than 8 times at least, averages as the last calibration result of navigation system calibration.
The present invention not detailed description is a general knowledge as well known to those skilled in the art.

Claims (2)

1. a calibration method for lunar rover binocular vision navigation system is characterized in that: comprise that the demarcating steps of camera intrinsic parameter and the demarcating steps of Camera extrinsic number are;
The demarcating steps of camera intrinsic parameter is:
(1) sets up the caliberating device that comprises light echo reflection measurement sign and coding maker, obtain the coordinate system of this caliberating device, utilize measuring system that light echo reflection measurement sign and coding maker on the caliberating device are measured, the three-dimensional coordinate that obtains caliberating device photo measure last time reflective marker and coding maker is as the reference mark coordinate, then the reference mark coordinate conversion is arrived under this caliberating device coordinate system, obtain the reference mark coordinate under the caliberating device coordinate system;
(2) utilizing two cameras to be calibrated respectively the caliberating device of setting up in the step (1) to be carried out the honest of at least four positions takes pictures, after two cameras to be calibrated are finished honest taking pictures to each position, two camera half-twists to be calibrated are taken pictures at least four positions of caliberating device respectively once more, comprise four coding maker points in every photo at least;
(3) utilize reference mark coordinate under the caliberating device coordinate system that step (1) obtains, the photo that left and right two cameras to be calibrated in the step (2) are taken carries out Flame Image Process respectively, the controlled some picpointed coordinate under the picture plane that two cameras to be calibrated are taken, utilize reference mark coordinate and two picpointed coordinates adopt collinearity equation calculate respectively two cameras to be calibrated separately intrinsic parameter and two cameras to be calibrated with respect to the outer parameter of caliberating device in each position;
The demarcating steps of Camera extrinsic number is:
(a) utilize the transit survey system to set up the transit survey system coordinate system, utilize the transit survey system that the prism square on two cameras to be calibrated is collimated respectively, obtain the three-dimensional coordinate of two prism squares under the transit survey system coordinate system;
(b) utilize the transit survey system that measurement reflective marker of the light echo in the caliberating device and coding maker are measured, obtain light echo reflection measurement sign and the coding maker three-dimensional coordinate under the transit survey system coordinate system;
(c) light echo reflection measurement sign and coding maker being carried out common point at the three-dimensional coordinate under the transit survey system coordinate system and light echo reflection measurement sign and the three-dimensional coordinate of coding maker under the caliberating device coordinate system transforms, obtain the transformational relation of caliberating device coordinate system and transit survey system coordinate system, utilize this transformational relation to convert two prism squares the three-dimensional coordinate of two prism squares under the caliberating device coordinate system at the three-dimensional coordinate under the transit survey system coordinate system, set up the prism square coordinate system of two cameras to be calibrated;
(d) utilize two cameras to be calibrated that step (3) obtains with respect to the outer parameter of caliberating device in each position, according to the public coordinate transformation relation of two prism squares three-dimensional coordinate under the caliberating device coordinate system, calibrate the outer parameter under each comfortable its prism square coordinate system of two cameras to be calibrated respectively at three-dimensional coordinate under the transit survey system coordinate system and prism square.
2. a kind of calibration method for lunar rover binocular vision navigation system according to claim 1 is characterized in that: described caliberating device comprises demarcates framework, light echo reflection measurement sign (4), coding maker (5) and annular light source; Demarcate framework and comprise main frame (1), left redundant framework (2) and right redundant framework (3) that size is identical, main frame (1) wherein, left redundant framework (2) is rectangular structure with right redundant framework (3), main frame (1), left redundant framework (2) and right redundant framework (3) three's height is all identical with width, angle between left redundant framework (2) and right redundant framework (3) and the main frame (1) is the obtuse angle, the length sum l of three frameworks and demarcation camera are l=2htan (w) apart from the pass between the distance h of main frame, the length of main frame and highly be equal to and demarcate the distance of camera apart from main frame, multiple row mounting bar frame (6) is crisscross arranged on the front surface of demarcating framework and rear surface, spacing between front surface or the rear surface two row mounting bar frames is the 1/10-1/8 of main frame (1) length, a plurality of light echo reflection measurement signs (4) are set on every row mounting bar frame (6), distance between two light echo reflection measurement signs (4) is the 1/20-1/18 of main frame (1) length, at least one point-like coding maker (5) is set in every row light echo reflection measurement sign (4), annular light source is made of the anterior position that is arranged on the demarcation framework two groups of led light sources, install in every group of annular light source and demarcate camera, every group of annular light source comprises six uniform led light sources, and w is half of navigational system viewing field of camera angle.
CN2009102368572A 2009-11-04 2009-11-04 Lunar rover binocular vision navigation system calibration method Active CN101876555B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009102368572A CN101876555B (en) 2009-11-04 2009-11-04 Lunar rover binocular vision navigation system calibration method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009102368572A CN101876555B (en) 2009-11-04 2009-11-04 Lunar rover binocular vision navigation system calibration method

Publications (2)

Publication Number Publication Date
CN101876555A true CN101876555A (en) 2010-11-03
CN101876555B CN101876555B (en) 2011-12-21

Family

ID=43019172

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009102368572A Active CN101876555B (en) 2009-11-04 2009-11-04 Lunar rover binocular vision navigation system calibration method

Country Status (1)

Country Link
CN (1) CN101876555B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104376328A (en) * 2014-11-17 2015-02-25 国家电网公司 Distribution type coded mark identification method and system based on coordinates
CN105067011A (en) * 2015-09-15 2015-11-18 沈阳飞机工业(集团)有限公司 Overall measurement system calibration method based on vision calibration and coordinate transformation
CN105701827A (en) * 2016-01-15 2016-06-22 中林信达(北京)科技信息有限责任公司 Method and device for jointly calibrating parameters of visible light camera and infrared camera
CN105823420A (en) * 2016-05-16 2016-08-03 北京控制工程研究所 Method for precise derivation of light-return energy center coordinates of pyramid combined part
CN106127724A (en) * 2016-05-06 2016-11-16 北京信息科技大学 Calibration Field for field associated dysmorphia model designs and scaling method
CN106370103A (en) * 2016-08-31 2017-02-01 成都主导软件技术有限公司 Method and device for detecting pantograph state
CN106767895A (en) * 2015-11-25 2017-05-31 南京中观软件技术有限公司 The system and method for solving camera elements of exterior orientation using index point orientation
CN106871873A (en) * 2017-02-24 2017-06-20 上海坤辕检测科技有限公司 The coding method of coding maker in a kind of close-range photogrammetry
CN106898025A (en) * 2017-02-24 2017-06-27 上海坤辕检测科技有限公司 It is a kind of to be based on 8 camera displacement transformation matrix scaling methods of coding maker
CN108195398A (en) * 2017-11-29 2018-06-22 北京控制工程研究所 A kind of complex configuration into the in-orbit geometric calibration device of image sensor
CN109900205A (en) * 2019-02-21 2019-06-18 武汉大学 A kind of quick calibrating method of high-precision single line laser device and optical camera
CN110766759A (en) * 2019-10-09 2020-02-07 北京航空航天大学 Multi-camera calibration method and device without overlapped view fields
CN112648956A (en) * 2021-03-01 2021-04-13 北京卫星制造厂有限公司 Spatial pose real-time measuring and adjusting method based on joint calibration
CN114494031A (en) * 2021-12-10 2022-05-13 新拓三维技术(深圳)有限公司 Camera positioning compensation correction device and method

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4496354B2 (en) * 2004-06-18 2010-07-07 独立行政法人 宇宙航空研究開発機構 Transmission type calibration equipment for camera calibration and its calibration method
CN1620153A (en) * 2004-12-02 2005-05-25 武汉大学 Method of implementing non-measuration digital camera calibration using plane control point field
CN100529679C (en) * 2007-07-03 2009-08-19 北京控制工程研究所 Optical imaging sensor mounting method in machine vision
CN101308012B (en) * 2008-05-29 2010-06-23 上海交通大学 Double monocular white light three-dimensional measuring systems calibration method
CN101699223B (en) * 2009-10-27 2011-06-15 北京控制工程研究所 Calibration device of binocular vision navigation system of lunar surface vehicle
CN101726318B (en) * 2009-11-04 2011-06-15 北京控制工程研究所 Calibration method for lunar rover binocular vision navigation system

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104376328A (en) * 2014-11-17 2015-02-25 国家电网公司 Distribution type coded mark identification method and system based on coordinates
CN104376328B (en) * 2014-11-17 2023-10-24 国家电网公司 Coordinate-based distributed coding mark identification method and system
CN105067011A (en) * 2015-09-15 2015-11-18 沈阳飞机工业(集团)有限公司 Overall measurement system calibration method based on vision calibration and coordinate transformation
CN106767895B (en) * 2015-11-25 2019-05-31 南京中观软件技术有限公司 The system and method for solving camera elements of exterior orientation are oriented using index point
CN106767895A (en) * 2015-11-25 2017-05-31 南京中观软件技术有限公司 The system and method for solving camera elements of exterior orientation using index point orientation
CN105701827A (en) * 2016-01-15 2016-06-22 中林信达(北京)科技信息有限责任公司 Method and device for jointly calibrating parameters of visible light camera and infrared camera
CN105701827B (en) * 2016-01-15 2019-04-02 中林信达(北京)科技信息有限责任公司 The parametric joint scaling method and device of Visible Light Camera and infrared camera
CN106127724A (en) * 2016-05-06 2016-11-16 北京信息科技大学 Calibration Field for field associated dysmorphia model designs and scaling method
CN106127724B (en) * 2016-05-06 2018-09-21 北京信息科技大学 Calibration Field design and scaling method for field associated dysmorphia model
CN105823420A (en) * 2016-05-16 2016-08-03 北京控制工程研究所 Method for precise derivation of light-return energy center coordinates of pyramid combined part
CN105823420B (en) * 2016-05-16 2018-06-01 北京控制工程研究所 A kind of pyramid sub-assembly light echo center of energy coordinate precise deriving method
CN106370103A (en) * 2016-08-31 2017-02-01 成都主导软件技术有限公司 Method and device for detecting pantograph state
CN106898025A (en) * 2017-02-24 2017-06-27 上海坤辕检测科技有限公司 It is a kind of to be based on 8 camera displacement transformation matrix scaling methods of coding maker
CN106871873A (en) * 2017-02-24 2017-06-20 上海坤辕检测科技有限公司 The coding method of coding maker in a kind of close-range photogrammetry
CN108195398A (en) * 2017-11-29 2018-06-22 北京控制工程研究所 A kind of complex configuration into the in-orbit geometric calibration device of image sensor
CN108195398B (en) * 2017-11-29 2020-06-09 北京控制工程研究所 Imaging sensor in-orbit geometric calibration device with complex configuration
CN109900205B (en) * 2019-02-21 2020-04-24 武汉大学 High-precision single-line laser and optical camera rapid calibration method
CN109900205A (en) * 2019-02-21 2019-06-18 武汉大学 A kind of quick calibrating method of high-precision single line laser device and optical camera
CN110766759A (en) * 2019-10-09 2020-02-07 北京航空航天大学 Multi-camera calibration method and device without overlapped view fields
CN110766759B (en) * 2019-10-09 2022-08-02 北京航空航天大学 Multi-camera calibration method and device without overlapped view fields
CN112648956A (en) * 2021-03-01 2021-04-13 北京卫星制造厂有限公司 Spatial pose real-time measuring and adjusting method based on joint calibration
CN114494031A (en) * 2021-12-10 2022-05-13 新拓三维技术(深圳)有限公司 Camera positioning compensation correction device and method

Also Published As

Publication number Publication date
CN101876555B (en) 2011-12-21

Similar Documents

Publication Publication Date Title
CN101876555B (en) Lunar rover binocular vision navigation system calibration method
CN101726318B (en) Calibration method for lunar rover binocular vision navigation system
CN101858755B (en) Method for calibrating star sensor
CN101699223B (en) Calibration device of binocular vision navigation system of lunar surface vehicle
CN101832772B (en) Calibration method for laser dot matrix device of obstacle avoidance system of lunar vehicle
CN102012236B (en) Method for calibrating moon rover binocular vision obstacle avoidance system
CN106017436B (en) BIM augmented reality setting-out system based on total station and photogrammetric technology
CN106952309A (en) The device and method of Fast Calibration TOF depth camera many kinds of parameters
CN105424058B (en) Digital camera projection centre position method for precisely marking based on photogrammetric technology
CN102749047B (en) Measuring method for size of roll bearing block
CN107121124B (en) A kind of satellite antenna machinery pointing accuracy method for fast measuring
CN108510546B (en) Camera calibration method suitable for map and structure information synchronous detection system
CN201803731U (en) Star sensor calibration equipment
CN102305598B (en) Underwater photography measurement method for profile accuracy of semi-rigid self-resilience reflector
CN106468544B (en) Satellite high-precision angle-measuring method based on photoelectric auto-collimator
CN104567666A (en) Measuring method for roller bearing block spatial position
CN101718550B (en) Optical system for stereo mapping with low base-height ratio
CN101900552B (en) Longitude-latitude camera videogrammetric method and system
CN107014293A (en) A kind of photogrammetric survey method of camera scanning imaging
CN104240221A (en) Opposite-lens two-camera relative azimuth calibration device and method
CN2831045Y (en) Digital electronic level
CN101581580B (en) Spatial digitalized method and spatial digitalized device for land measurement
CN102829757A (en) Digital levelling system, method, composite coding levelling staff and production method thereof
CN110068313A (en) A kind of digital zenith instrument orientation method based on projective transformation
CN105937913B (en) CCD combines total station method for comprehensive detection

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant