CN1323547C - Three-line calibration method for external parmeters of camera carried by car - Google Patents

Three-line calibration method for external parmeters of camera carried by car Download PDF

Info

Publication number
CN1323547C
CN1323547C CNB2003101058444A CN200310105844A CN1323547C CN 1323547 C CN1323547 C CN 1323547C CN B2003101058444 A CNB2003101058444 A CN B2003101058444A CN 200310105844 A CN200310105844 A CN 200310105844A CN 1323547 C CN1323547 C CN 1323547C
Authority
CN
China
Prior art keywords
centerdot
video camera
coordinate system
vehicle
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2003101058444A
Other languages
Chinese (zh)
Other versions
CN1537749A (en
Inventor
李青
郑南宁
张雪涛
程洪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Jiaotong University
Original Assignee
Xian Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Jiaotong University filed Critical Xian Jiaotong University
Priority to CNB2003101058444A priority Critical patent/CN1323547C/en
Publication of CN1537749A publication Critical patent/CN1537749A/en
Application granted granted Critical
Publication of CN1323547C publication Critical patent/CN1323547C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Image Analysis (AREA)

Abstract

The present invention discloses a three-line calibration method for external parameters of a vehicle-mounted camera. The method aims at the calibration problem of a vehicle-mounted camera of an intelligent vehicle on the basis of visual navigation; a ready-made tool box is used for carrying out the calibration of internal parameters; three parallel lines have the same vanishing point and different slope rates on a picture plane according to the principle of perspective projection; the external parameters of the camera have internal relation with the vanishing point and the slope rates; the expression of the external parameters of the camera in pixels can be established through mathematical derivation and coordinate transformation. In a pixel coordinate system, after the coordinates of the intersection points of the parallel lines and the other three points are manually or automatically determined, parameters needed can be directly calculated. The process can be realized under different environment such as roads, playground tracks or special delineated parallel lines. Experimental results verify the feasibility and the correctness of the method.

Description

The three-way scaling method of a kind of vehicle-mounted vidicon external parameter
Technical field
The invention belongs to computer vision field, relate to camera calibration in the computer vision, the three-way scaling method of particularly a kind of vehicle-mounted vidicon external parameter.
Background technology
Along with popularizing of development of urbanization and automobile, the communications and transportation problem is serious day by day, and the notion of intelligent vehicle navigation is arisen at the historic moment.Road tracking based on vision is paid attention to most, according to the data-searching that the applicant carries out, finds following document:
[1]Bertozzi M,Broggi A,Cellario M,et al.ArtificialVision in road vehicles[C].In:Proceedings of the IEEE on IntelligentTransmission System,2002,90(7):1258-1271
[2] Yang Ming, Lu Jianye, Wang Hong opens cymbals etc. and the road based on vision is followed the tracks of [J]. " pattern recognition and artificial intelligence ", 2001,14 (2): 186-193
[3] Qiu Maolin, Ma Songde, Li Yi. camera calibration summary in the computer vision. " automation journal ", 2000,26 (1): 43-55
[4]Bertozzi M,Broggi A.GOLD:a parallel real-time stereovision system for generic obstacle and lane detection [J].IEEEtransactions on image processing,1998,7(1):62-81
[5]Bertozzi M,Broggi A,Fascioli A.Self-calibration of astereo vision system for automotive applications[C].In:Proceedingsof IEEE International Conference on Robotics and Automation,2001,4:3698-3703
[6]Southall B,Taylor C J. Stochastic road shapeestimation[C].In:Proceedings of Eighth IEEE InternationalConference on Computer Vision,2001,1:205-212
[7] Song Xuefeng, Yang Ming, Wang Hong. based on the simple and easy camera marking method of latticed texture. " computer engineering and application [J] " .2002,7:72-74
In many complexity of intelligent vehicle navigation and challenging task, the most valued road that is based on vision is followed the tracks of [1] [2]In this process, need calculate the geological information of object in the three dimensions according to the image information that video camera obtains usually, and rebuild thus or recognition object, thereby camera calibration is absolutely necessary [3]For the demarcation problem of vehicle-mounted vidicon, have a lot of people to study: the inner parameter of the ARGO system supposition video camera of Parma university is known, draws the grid of known dimensions on the ground, utilizes the intersection point of grid to demarcate external parameter [4]They have also adopted a kind of so-called self-calibrating method in addition [5], the gauge point on the use hood is as spotting, and these calibration points are known with respect to the position of bodywork reference frame; The breadboard researcher of the GRASP of the University of Pennsylvania has used the calibration tool case of University of Southern California's exploitation to carry out the demarcation of inner parameter, utilizes and represents the straight line in track to carry out the demarcation of external parameter [6]The researcher of Tsing-Hua University utilizes ground grid to demarcate [7]Also have other researchers to use the function library of Intel to carry out the demarcation of intrinsic parameters of the camera, use the method that is similar to the ARGO system to demarcate external parameter.Though above-mentioned scaling method can be dealt with problems preferably, all there is weak point: complicated operating process, higher to environment requirement, or the parameter of demarcating is less.
To the research of intelligent vehicle, mainly concentrate on more smooth zone, road surface at present, therefore can make ground flatness hypothesis.Because vehicle is to travel on the road surface, the deviation in the certain limit can not cause too big problem, so the precision of demarcating can be significantly less than the precision in the applications such as Robot Hand-eye demarcation, three-dimensional reconstruction.
Summary of the invention
These characteristics at above-mentioned vehicle-mounted vidicon is demarcated the objective of the invention is to, and the method for the three-way demarcation of a kind of vehicle-mounted vidicon external parameter is provided.
Realize that foregoing invention purpose technical solution is, the three-way scaling method of vehicle-mounted vidicon external parameter, be characterized in, on smooth ground, draw three straight lines parallel to each other, or utilize existing parallel lines, or look for one section straight road that three markings are arranged, and make the car body longitudinal axis of the automobile that is loaded with video camera be parallel to these straight lines, record the distance of they and the car body longitudinal axis; Foundation is that the video camera external parameter expression formula of unit is determined the vehicle-mounted vidicon external parameter with the pixel, through mathematical derivation and coordinate transform, obtain the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and the video camera photocentre apart from the lateral separation d of the car body longitudinal axis.
Method of the present invention only needs three parallel straight lines on the smooth ground, just can carry out the video camera calibrating external parameters, need not special-purpose place, even can finish in the driving process of vehicle.
Description of drawings
Fig. 1 is the schematic diagram that concerns between car body of the present invention and the video camera, also is one embodiment of the present of invention; Wherein (a) is end view, (b) is vertical view, (c) is rearview;
Fig. 2 is the schematic diagram that concerns of camera coordinate system, plane of delineation coordinate system and pixel coordinate system;
Fig. 3 is straight highway and the superincumbent straight line picture of manual stack of demarcating usefulness;
Fig. 4 is sports filed track and the superincumbent straight line picture of manual stack of demarcating usefulness.
Embodiment
The present invention is described in further detail below in conjunction with embodiment that accompanying drawing and inventor provide.
According to technique scheme, the three-way scaling method of vehicle-mounted vidicon external parameter may further comprise the steps:
1) on smooth ground, draws three straight lines parallel to each other, or utilize existing parallel lines, or look for one section straight road that three markings are arranged, make the car body longitudinal axis of the automobile that is loaded with video camera be parallel to these straight lines, record the distance of they and the car body longitudinal axis;
2) the vehicle-mounted vidicon external parameter determines
The vehicle-mounted vidicon external parameter comprise the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and video camera apart from car centre distance d;
3) setting up with the pixel is the video camera external parameter expression formula of unit
As shown in Figure 1, adopt left-handed coordinate system, establishing in the bodywork reference frame certain any coordinate is p v=(x v, y v, z v), its coordinate at camera coordinate system is p c=(x c, y c, z c).The angle of heel of the relative car body of video camera is ψ (observing to tilt clockwise for just along vehicle heading), and the angle of pitch is θ (points upwards for just), deflection is _ (sensing vehicle body axis left for just), the position of the photocentre of video camera in bodywork reference frame is t=(l, d, h), then
p v=R·p c+t
p c=R -1·p v-R -1·t=R T·p v-R T·t (1)
Wherein
Figure C20031010584400101
= r 11 r 12 r 13 r 21 r 32 r 23 r 31 r 32 r 33
Wherein
Suppose that ground is smooth, optical axis o is at plane z vThe vector that projection on=0 forms is η, η and X vThe angle that axle forms is _, optical axis o is θ with the angle that η forms, the angle of heel of the relative car body of video camera (or roll angle of title video camera) is ψ, l 1, l 2, l 3For three straight lines that are parallel to the vehicle body longitudinal axis on the smooth ground, apart from X vDistance be respectively a, b, c;
For on the smooth ground one be parallel to the vehicle body longitudinal axis X v, and arriving it apart from being the straight line l of k, its parametric equation is
x v = s y v = k , s ∈ R z v = 0 - - - ( 2 )
According to formula (1), the parametric equation of l in camera coordinate system is
x c y c z c = r 11 r 21 r 31 r 12 r 22 r 32 r 13 r 23 r 33 · s k 0 - r 11 r 21 r 31 r 12 r 22 r 32 r 13 r 23 r 33 · l d h
= s · r 11 + k · r 21 - l · r 11 - d · r 21 - h · r 31 s · r 12 + k · r 22 - l · r 12 - d · r 22 - h · r 32 s · r 13 + k · r 23 - l · r 13 - d · r 23 - h · r 33 - - - ( 3 )
Correlation (Fig. 2) according between camera coordinate system, plane of delineation coordinate system and the pixel coordinate system of this paper definition has
u=y c,v=-z c,u=(i-c i)·dx,v=(j-c j)·dy (4)
Wherein dx, dy and c i, c jBe respectively laterally, proportionality coefficient and principal point position longitudinally.
According to the pinhole imaging system model, convolution (3), formula (4), the parametric equation of l on plane of delineation coordinate system is (focal length is unit representation with the pixel)
u = f i · dx · y c x c = f i · dx · s · r 12 + k · r 22 - l · r 12 - d · r 22 - h · r 32 s · r 11 + k · r 21 - l · r 11 - d · r 21 - h · r 31 v = - f j · dy · z c x c = - f j · dy · s · r 13 + k · r 23 - l · r 13 - d · r 23 - h · r 33 s · r 11 + k · r 21 - l · r 11 - d · r 21 - h · r 31 - - - ( 5 )
Because s is any real number, and and l on same direction, formula (5) is rewritten into
u = f i · dx · y c x c = f i · dx · s · r 12 + k · r 22 - d · r 22 - h · r 32 s · r 11 + k · r 21 - d · r 21 - h · r 31 v = - f j · dy · z c x c = - f j · dy · s · r 13 + k · r 23 - d · r 23 - h · r 33 s · r 11 + k · r 21 - d · r 21 - h · r 31 - - - ( 6 )
When s → ∞, straight line l extends to infinite distant place, and its end point on plane of delineation coordinate system is
u h = lim s → ∞ u
= lim s → ∞ f i · dx · s · r 12 + k · r 22 - d · r 22 - h · r 32 s · r 11 + k · r 21 - d · r 21 - h · r 31
= f i · dx · r 12 r 11 - - - ( 7 a )
v h = lim s → ∞ v
= lim s → ∞ - f j · dy · s · r 13 + k · r 23 - d · r 23 - h r 33 s · r 11 + k · r 21 - d · r 21 - h · r 31 - - - ( 7 b )
= - f j · dy · r 13 r 11
Because the family of straight lines that is parallel to each other in the space has identical end point at view plane, so straight line l 1, l 2, l 3The end point of imaging is
u h1=u h2=u h3=u h
v h1=v h2=v h3=v h
g = du dv = du ds dv ds - - - ( 8 )
= - f i · dx f j · dy · k · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - k · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 k · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - k · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
For 3 parallel lines l 1, l 2, l 3, have respectively
g 1 = - f i · dx f j · dy · a · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - a · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 a · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - a · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
g 2 = - f i · dx f j · dy · b · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - b · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 b · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - b · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33 - - - ( 9 )
g 3 = - f i · dx f j · dy · c · r 12 · r 21 - d · r 12 · r 21 - h · r 12 r 31 - c · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 c · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - c · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
According to formula (9), solve
tgψ = ( r 1 - r 3 ) ( a - b ) - ( r 1 - r 2 ) ( a - c ) ( r 1 - r 3 ) ( r 1 a - r 2 b ) - ( r 1 - r 2 ) ( r 1 a - r 3 c ) - - - ( 10 )
According to formula (7a), (7b)
tgθ = u h · sin ψ f i · dx + v h · cos ψ f j · dy - - - ( 11 )
Figure C20031010584400131
According to formula (9), solve
h = ( b - a ) AC BC - AD - - - ( 13 )
d = B A · ( b - a ) AC BC - AD + a
Wherein:
A=r 1·sinψ·cosθ-cosθcos ψ
B=-(cos_sinψ+sin_cosψsinθ)-r 1(cos_cosψ-sin_sinψsinθ)
C=r 2·sinψcosθ-cosθcosψ
D=-(cos_sinψ+sin_cosψsinθ)-r 2(cos_cosψ-sin_sinψsinθ)
r n = - g n f i f j · dx dy , n = 1,2,3
4) parameter calibration
The inner parameter of video camera use the calibration tool case of University of Southern California's exploitation demarcate (J.Y.Bouget.Matlab camera calibration toolbox.http: //www.vision.caltech.edu/bougetj/calib_doc/index.html), from the image of one group of demarcation thing different azimuth, extract the characteristic point of known geological information, then it is sent into optimizing process, just can obtain the principal point and the effective focal length of video camera.
Utilize the present invention on smooth ground, to draw three straight lines parallel to each other, or utilize existing parallel lines (as hundred meters racing tracks of sports ground), or look for one section straight road that three lane lines are arranged, make the longitudinal axis of automobile be parallel to these straight lines, the distance (being a, b, c) that records they and the car body longitudinal axis just can be carried out the video camera calibrating external parameters easily.
Embodiment:
This method is tested on the instruction carriage of Jilin University and Xi'an Communications University with different forms.What at first select for use is one section straight highway with three lane lines.Fig. 3 is the frame in the video gathered of laboratory vehicle, camera is the TMC-9700 of U.S. PULNIX company, capture card and transaction card are respectively the Viper RGB and the Python of Canadian CORECO company, camera lens is selected Computar 8mm for use, image resolution ratio is set at 256 * 240, and video camera is installed in the front upper place of copilot station.This frame picture is saved as the file of bmp form, utilizes the paintbrush of Windows to handle then, with the straight line tool of the paintbrush l that draws 1 c, l 2 c, l 3 cArticle three, straight line is superimposed upon on the lane line, represents the center line of markings imaging.H (i h, j h) expression three parallel lines intersection point, P 1(i 1, j 1) be l 1 cGo up and remove H (i h, j h) outer more arbitrarily, P 2(i 2, j 2) be l 2 cGo up and remove H (i h, j h) outer more arbitrarily, P 3(i 3, j 3) be l 3 cGo up and remove H (i h, j h) outer more arbitrarily.Utilize the image coordinate positioning function of paintbrush, find out the pixel coordinate of four Chosen Points, record a=-3.2m in addition, b=0.3m, c=3.8m.In pixel coordinate system,
g n = dx dy · i h - i n j h - j n , n = 1,2,3 - - - ( 14 )
In formula (14) substitution formula (10), (11), (12), (13), can try to achieve ψ, θ, _, d, the value of h.
Table 1 PULNIX intrinsic parameters of the camera and calibrating external parameters result
Parameter f i f j c i c j ψ θ _ d h
Value 599 pixels 605 pixels 89 pixels 150 pixels 0.034rad -0.219rad 0.053rad 0.29m 1.70m
Above-mentioned experimental technique is a kind of implementation of this scaling method, can also carry out in another mode.As shown in Figure 4, the 100-metre dash road (can directly utilize the known geological information of racing track markings like this and setting-out again, and satisfy ground flatness hypothesis) of plastic sports ground is selected in the place for use, makes the longitudinal axis of automobile be parallel to the runway marking line.Used camera is SONY DSR-PD150P, and zoom is set at the maximum of the mode of looking in the distance, Manual focusing, resolution setting is 640 * 480, records a=-1.25m, b=0m, c=1.25m, demarcation the results are shown in Table 2.
Table 2 SONY intrinsic parameters of the camera and calibrating external parameters result
Parameter f i f j c i c j ψ θ _ d h
Value 789 pixels 806 pixels 322 pixels 218 pixels 0.039rad -0.026rad -0.028rad 0.25m 1.37m
Can in the vehicle ' process, demarcate in addition.For example under steam, the driver makes a certain sign aligning middle lane line of reserving in advance on the car body, and direct of travel is parallel with lane line, just can determine the value of a, b, c, thereby finishes demarcation.
Parallel lines imaging location in the three-way scaling method of vehicle-mounted vidicon external parameter of the present invention is manual the realization, if introduce image processing techniques in calibration process, just can realize the automatic demarcation of vehicle-mounted vidicon external parameter.Even vehicle under steam like this,, just can demarcate at any time as long as run into suitable highway section.
Obviously, three-way scaling method of the present invention can not be demarcated the length travel l of the relative bodywork reference frame of video camera photocentre, needs extra this parameter of measuring, and makes l introduce measure error, but generally not too large.In the ordinary course of things, the preview distance of automobile is 30m~70m, and it is negligible therefore measuring the error of introducing, and other CALCULATION OF PARAMETERS does not rely on this parameter fortunately.
In addition, calibration process can produce error inevitably, and its main cause can be summed up as follows:
● can not satisfy ground flatness hypothesis;
● three straight lines exist crooked or not parallel each other;
● the longitudinal axis of vehicle body does not have and straight line parallel;
● the straight line of manual stack is not the center line of markings;
● three straight lines are bigger with respect to the range measurement error of vehicle body longitudinal axis;
● the demarcation of inner parameter is inaccurate.
Theory analysis and experimental result show that trilinear method only needs three parallel lines, just can finish the calibrating external parameters of vehicle-mounted vidicon, existing relatively certain methods, it is simple to have principle, easy to operate, highly versatile, implementation is various, and is easy of integration in the medium advantage of on-vehicle machines vision system.After introducing image processing techniques, whole calibrating procedure can full automation, even can carry out in vehicle ', thereby has solved the drifting problem of vehicle-mounted vidicon parameter to a certain extent.In addition, trilinear method can also be simplified to 6 methods, and promptly six points with rectangular distribution replace three parallel lines.6 methods are particularly suitable for demarcating in a fixed venue, only need six points of picture, but are not suitable for demarcating on highway.
Attached:
The proof of some formula in " vehicle-mounted vidicon calibrating external parameters trilinear method "
1. the derivation of civilian Chinese style (8)
du ds = f i · dx · r 12 ( s · r 11 + k · r 21 - d · r 21 - h · r 31 ) - ( s · r 12 + k · r 22 - d · r 22 - h · r 32 ) · r 11 ( s · r 11 + k · r 21 - d · r 21 - h · r 31 ) 2 · r 11
= f i · dx · k · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - k · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 ( s · r 11 + k · r 21 - d · r 21 - h · r 31 ) 2 · r 11
dv ds = - f j · dy · r 13 · ( s · r 11 + k · r 21 - d · r 21 - h · r 31 ) - ( s · r 13 + k · r 23 - d · r 23 - h · r 32 ) · r 11 ( s · r 11 + k · r 21 - d · r 21 - h · r 31 ) 2 · r 11
= - f i · dy · k · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - k · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33 ( s · r 11 + k · r 21 - d · r 21 - h · r 31 ) 2 · r 11
Have then
g = du dv = du ds dv ds
= - f i · dx f j · dy · k · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - k · r 11 · r 22 + d · r 22 · r 22 + h · r 11 r 32 k · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - k · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
2. the derivation of civilian Chinese style (10)
According to civilian Chinese style (9)
g 1 = - f i · · dx f j · dy · a · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - a · r 11 · r 22 + d · r 11 · r 22 + h · r 22 r 32 a · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - a · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
g 2 = - f i · dx f j · dy · b · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - b · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 b · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - b · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
g 3 = - f i · dx f j · dy · c · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - c · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 c · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - c · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
Order r n = - g n f i f j · dx dy , n = 1,2,3
Then
r 1 = a ( r 12 · r 21 - r 11 · r 22 ) + d ( r 11 · r 22 - r 12 · r 21 ) + h ( r 11 · r 32 - r 12 · r 31 ) a · ( r 13 · r 21 - r 11 · r 23 ) + d ( r 11 · r 23 - r 13 · r 21 ) + h ( r 11 · r 33 - r 13 · r 31 )
Launch
r 1·a·(r 13·r 21-r 11·r 23)+r 1·d·(r 11·r 23-r 13·r 21)+r 1·h·(r 11r 33-r 13·r 31)=a·(r 12·r 21-r 11·r 22)+d·(r 11·r 22-r 12·r 21)+h·(r 11r 32-r 12·r 31) (A1)
In like manner can get
r 2·b·(r 13·r 21-r 11r 23)+r 2·d·(r 11·r 23-r 13·r 21)+r 2·h·(r 11r 33-r 13·r 31)=b·(r 12·r 21-r 11·r 22)+d·(r 11·r 22-r 12·r 21)+h·(r 11r 32-r 12·r 31) (A2)
r 3·c·(r 13·r 21-r 11·r 23)+r 3·d·(r 11·r 23-r 13·r 21)+r 3·h·(r 11r 33-r 13·r 31)=c·(r 12·r 21-r 11·r 22)+d·(r 11·r 22-r 12·r 21)+h·(r 11r 32-r 12·r 31) (A3)
Formula (A1) deducts formula (A2) and gets
(r 1·a-r 2·b)·(r 13·r 21-r 11·r 23)+d·(r 1-r 2)·(r 11·r 23-r 13·r 21)+h·(r 1-r 2)·(r 11·r 33-r 13·r 31)=(a-b)·(r 12·r 21-r 11·r 22) (A4)
Formula (A1) deducts formula (A3) and gets
(r 1·a-r 3·c)·(r 13·r 21-r 11·r 23)+d·(r 1-r 3)·(r 11·r 23-r 13·r 21)+h·(r 1-r 3)·(r 11·r 33-r 13·r 31)=(a-c)·(r 12·r 21-r 11·r 22) (A5)
Formula (A2) deducts formula (A3) and gets
(r 2·b-r 3·c)·(r 13·r 21-r 11·r 23)+d·(r 2-r 3)·(r 11·r 23-r 13·r 21)+h·(r 2-r 3)·(r 11·r 33-r 13·r 31)=(b-c)·(r 12·r 21-r 11·r 22) (A6)
Get by (A4)
d·(r 1-r 2)·(r 11·r 23-r 13·r 21)=(a-b)·(r 12·r 21-r 11·r 22)-(r 1·a-r 2·b)·(r 13·r 21-r 11·r 23)-h·(r 1-r 2)·(r 11·r 33-r 13·r 31) (A7)
Get by (A5)
d·(r 1-r 3)·(r 11·r 23-r 13·r 21)=(a-c)·(r 12·r 21-r 11·r 22)-(r 1·a-r 3·c)·(r 13·r 21-r 11·r 23)-h·(r 1-r 3)·(r 11·r 33-r 13·r 31) (A8)
Get by (A6)
d·(r 2-r 3)·(r 11·r 23-r 13·r 21)=(b-c)·(r 12·r 21-r 11·r 22)-(r 2·b-r 3·c)·(r 13·r 21-r 11·r 23)-h·(r 2-r 3)·(r 11·r 33-r 13·r 31) (A9)
(A7) divided by (A8),
r 1 - r 2 r 1 - r 3 = ( a - b ) · ( r 12 · r 21 - r 11 · r 32 ) - ( r 1 · a - r 2 · a ) · ( r 13 · r 21 - r 11 · r 23 ) - h · ( r 1 - r 2 ) · ( r 11 · r 33 - r 13 · r 33 ) ( a - c ) · ( r 12 · r 21 - r 11 · r 22 ) - ( r 1 · a - r 3 · c ) · ( r 13 · r 21 - r 11 · r 23 ) - h · ( r 1 - r 3 ) · ( r 11 · r 33 - r 13 · r 31 ) - - - ( A 10 )
Put in order:
(r 1-r 2)·(a-c)·(r 12·r 21-r 11·r 22)-(r 1-r 2)·(r 1·a-r 3·c)·(r 13·r 21-r 11·r 23)=(r 1-r 3)·(a-b)·(r 12·r 21-r 11·r 22)-(r 1-r 3)·(r 1·a-r 2·b)·(r 13·r 11-r 11·r 23) (A11)
Because
r 12·r 21-r 11·r 22=(sin_cosψ+cos_sinψsinθ)·(-sin_cosθ)-cosθcos_·(cos_cosψ-sin_sinψsinθ)=-cosψcosθ
r 13R 21-r 11R 23=(sin_sin ψ-cos_cos ψ sin θ) (sin_cos θ)-cos θ cos_ (cos_sin ψ+sin_cos ψ sin θ)=-sin_cos θ formula (A11) is rewritten as
(r 1-r 2)·(a-c)·(-cos_cosθ)-(r 1-r 2)·(r 1·a-r 3·c)·(-sinψcosθ)=(r 1-r 3)·(a-b)·(-cosψcosθ)-(r 1-r 3)·(r 1·a-r 2·b)·(-sinψcosθ) (A12)
The both members cos θ that divides out has
-(r 1-r 2)·(a-c)·cosψ+(r 1-r 3)·(a-b)·cosψ=(r 1-r 3)·(r 1·a-r 2·b)·sinψ-(r 1-r 2)·(r 1·a-r 3·c)·sin_
So have
tgψ = ( r 1 - r 3 ) ( a - b ) - ( r 1 - r 2 ) ( a - c ) ( r 1 - r 3 ) ( r 1 a - r 2 b ) - ( r 1 - r 2 ) ( r 1 a - r 3 c ) - - - ( A 13 )
3. the derivation of civilian Chinese style (11)
According to civilian Chinese style (7a) and (7b), have
Figure C20031010584400202
Formula (A14) solves at last divided by formula (A15)
tgθ = u h · sin ψ f i · dx + v h · cos ψ f j · dy - - - ( A 16 )
4. the derivation of civilian Chinese style (12)
According to formula (A14), solve
Figure C20031010584400204
5. the derivation of civilian Chinese style (13)
Get by formula (A1)
d·[r 1·(r 11·r 23-r 13·r 21)-(r 11·r 22-r 12·r 21)]=h·[(r 11·r 32-r 12·r 31)-r 1·(r 11r 33-r 13·r 31)]+a·(r 12·r 21-r 11·r 22)-r 1·a·(r 13·r 21-r 11·r 23) (A18)
Get by formula (A2)
d·[r 2·(r 11·r 23-r 13·r 21)-(r 11·r 22-r 12·r 21)]=h·[(r 11·r 32-r 12·r 31)-r 2·(r 11r 33-r 13·r 31)]+b·(r 12·r 21-r 11·r 22)-r 2·b·(r 13·r 21-r 11·r 23) (A19)
Wherein
r 11·r 22-r 12·r 21=cosθcos_·(cos_cosψ-sin_sinψsinθ)-(sin_cosψ+cos_sinψsinθ)·(-sin_cosθ)
=cosθcosψ
r 11·r 23-r 13·r 21=cosθcos_·(cos_sinψ+sin_cosψsinθ)-(sin_sinψ-cos_cosψsinθ)·(-sin_cosθ)
=sinψcosθ
r 11·r 32-r 12·r 31=cosθcos_·(-cosθsinψ)-(sin_sinψ-cos_cosψsinθ)·sinθ
=-cos_·sinψ-sin_·cosψ·sinθ
r 11·r 33-r 13·r 31=cosθcos_·cosθcosψ-(sin_sinψ-cos_cosψsinθ)·sinθ
=cos_·cosψ-sin_·sin·sinθ
Order
A=r 1·(r 11·r 23-r 13·r 21)-(r 11·r 22-r 12·r 21)=r 1·sinψ·cosθ-cosθcos_
B=[(r 11·r 32-r 12·r 31)-r 1·(r 11r 33-r 13·r 31)]=-(cos_sinψ+sin_cosψsinθ)-r 1(cos_cosψ-sin_sinψsinθ)
C=r 2(r 11·r 23-r 13·r 21)-(r 11·r 22-r 12·r 21)=r 2·sinψcosθ-cosθcosψ
D=(r 11·r 32-r 12·r 31)-r 2·(r 11r 33-r 13·r 31)=-(cos_sinψ+sin_cosψsinθ)-r 2(cos_cosψ-sin_sinψsinθ)
Formula (A18) gets divided by (A19)
A C = hB + aA hD + bC
So
h = ( b - a ) AC BC - AD
By formula (A18), get again
d = B A · ( b - a ) AC BC - AD + a

Claims (1)

1. the three-way scaling method of vehicle-mounted vidicon external parameter is characterized in that, may further comprise the steps:
1) on smooth ground, draws three straight lines parallel to each other, or utilize existing parallel lines, or look for one section straight road that three markings are arranged, the car body longitudinal axis that is loaded with the automobile of video camera is parallel to these straight lines, record the distance of these straight lines and the car body longitudinal axis;
2) the vehicle-mounted vidicon external parameter determines
The vehicle-mounted vidicon external parameter comprise the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and the video camera photocentre apart from the lateral separation d of the car body longitudinal axis;
Bodywork reference frame adopts left-handed coordinate system, and the initial point of bodywork reference frame is the barycenter of vehicle, and car body longitudinal axis directed forward is X vAxle, pointing to right-hand is Y v, points upwards is Z v
(1) setting up with the pixel is the video camera external parameter expression formula of unit, adopts left-handed coordinate system, and establishing in the bodywork reference frame certain any coordinate is p v=(x v, y v, z v), its coordinate at camera coordinate system is p c=(x c, y c, z c); The angle of heel of the relative car body of video camera is ψ, and this angle of heel is observed to tilt clockwise for just along vehicle heading; The angle of pitch is θ, and this angle of pitch points upwards is for just; Deflection is _, this deflection points to vehicle body axis left for just; The position of the photocentre of video camera in bodywork reference frame be t=(l, d, h), then
p v=R·p c+t
p c=R -1·p v-R -1·t=R T·p v-R T·t (1)
Wherein
= r 11 r 12 r 13 r 21 r 22 r 23 r 31 r 32 r 33
(2) suppose that ground is smooth, optical axis ο is at plane z vThe vector that projection on=0 forms is η, η and X vThe angle that axle forms is _, optical axis ο is θ with the angle of η formation, the angle of heel of video camera is ψ, l 1, l 2, l 3For three straight lines that are parallel to the vehicle body longitudinal axis on the smooth ground, apart from X vDistance be respectively a, b, c;
For on the smooth ground one be parallel to the vehicle body longitudinal axis X v, and arriving it apart from being the straight line l of k, its parametric equation is
x v = s y v = k , s ∈ R z v = 0 - - - ( 2 )
(3) according to formula (1), the parametric equation of l in camera coordinate system is
x c y c z c = r 11 r 21 r 31 r 12 r 22 r 32 r 13 r 23 r 33 · s k 0 - r 11 r 21 r 31 r 12 r 22 r 32 r 13 r 23 r 33 · l d h
= s · r 11 + k · r 21 - l · r 11 - d · r 21 - h · r 31 s · r 12 + k · r 22 - l · r 12 - d · r 22 - h · r 32 s · r 13 + k · r 23 - l · r 13 - d · r 23 - h · r 33 - - - ( 3 )
(4) according to the camera coordinate system of above-mentioned definition, the correlation between its plane of delineation coordinate system, pixel coordinate system and the camera coordinate system has:
u=y c,v=-z c,u=(i-c i)·dx,v=(j-c j)·dy (4)
Wherein u, v are the coordinate of plane of delineation coordinate system, and i, j are the coordinate of pixel coordinate system, dx, dy and c i, c jBe respectively laterally, proportionality coefficient and principal point position longitudinally; Wherein dx, dy are constant;
(5) according to the pinhole imaging system model, convolution (3), formula (4), the parametric equation of l on plane of delineation coordinate system is
u = f i · dx · y c x c = f i · dx · s · r 12 + k · r 22 - l · r 12 - d · r 22 - h · r 32 s · r 11 + k · r 21 - l · r 11 - d · r 21 - h · r 31 v = - f j · dy · z c x c = - f j · dy · s · r 13 + k · r 23 - l · r 13 - d · r 23 - h · r 33 s · r 11 + k · r 21 - l · r 11 - d · r 21 - h · r 31 - - - ( 5 )
F in the formula i, f jBe focal length of camera, its unit is a pixel; Because s is any real number, and and l on same direction, formula (5) is rewritten into
u = f i · dx · y c x c = f i · dx · s · r 12 + k · r 22 - d · r 22 - h · r 32 s · r 11 + k · r 21 - d · r 21 - h · r 31 v = - f j · dy · z c x c = - f j · dy · s · r 13 + k · r 23 - d · r 23 - h · r 33 s · r 11 + k · r 21 - d · r 21 - h · r 31 - - - ( 6 )
(6) when s → ∞, straight line l extends to infinite distant place, and its end point on plane of delineation coordinate system is
u h = lim s → ∞ u
= lim s → ∞ f i · dx · s · r 12 + k · r 22 - d · r 22 - h · r 32 s · r 11 + k · r 21 - d · r 21 - h · r 31
= f i · dx · r 12 r 11 - - - ( 7 a )
v h = lim s → ∞ v
= lim s → ∞ - f j · dy · s · r 13 + k · r 23 - d · r 23 - h · r 33 s · r 11 + k · r 21 - d · r 21 - h · r 31
= - f j · dy · r 13 r 11 - - - ( 7 b )
Because the family of straight lines that is parallel to each other in the space has identical end point at view plane, so straight line l 1, l 2, l 3The end point of imaging is
u h1=u h2=u h3=u h
v h1=v h2=v h3=v h
(7) slope according to the image plane cathetus gets
g = du dv = du ds dv ds - - - ( 8 )
= - f i · dx f j · dy · k · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - k · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 33 k · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - k · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
For 3 parallel lines l 1, l 2, l 3, have respectively
g 1 = - f i · dx f j · dy · a · r 12 · r 21 - d · r 12 · r 21 - h · r 21 · r 31 - a · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 a · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - a · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
g 2 = - f i · dx f j · dy · b · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · · r 31 - b · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 b · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - b · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33 - - - ( 9 )
g 3 = - f i · dx f j · d · c · r 12 · r 21 - d · r 12 · r 21 - h · r 12 · r 31 - c · r 11 · r 22 + d · r 11 · r 22 + h · r 11 r 32 c · r 13 · r 21 - d · r 13 · r 21 - h · r 13 · r 31 - c · r 11 · r 23 + d · r 11 · r 23 + h · r 11 r 33
(8) according to formula (9), solve
tgψ = ( r 1 - r 3 ) ( a - b ) - ( r 1 - r 2 ) ( a - c ) ( r 1 - r 3 ) ( r 1 a - r 2 b ) - ( r 1 - r 2 ) ( r 1 a - r 3 c ) - - - ( 10 )
(9), obtain the expression formula of the angle of pitch according to formula (7a), (7b)
tgθ = u h · sin ψ f i · dx + v h · cos ψ f j · dy - - - ( 11 )
(10), can also obtain the expression formula of deflection according to formula (7a), (7b)
(11) according to formula (9), can solve
h = ( b - a ) AC BC - AD
d = B A · ( b - a ) AC BC - AD + a - - - ( 13 )
Wherein:
A=r 1·sinψ·cosθ-cosθcosψ
B=-(cos_sinψ+sin_cosψsinθ)-r 1(cos_cosψ-sin_sinψsinθ)
C=r 2·sinψcosθ-cosθcosψ
D=-(cos_sinψ+sin_cosψsinθ)-r 2(cos_cosψ-sin_sinψsinθ)
r n = - g n f i f j · dx dy , n = 1 , 2,3
In pixel coordinate system, with manual or automatically mode determine the intersecting point coordinate of three parallel lines, on three parallel lines, choose three points except that intersection point then respectively, can directly calculate desired parameters;
3) through above-mentioned mathematical derivation and coordinate transform, obtain the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and the video camera photocentre apart from the lateral separation d of the car body longitudinal axis, can finish the video camera calibrating external parameters;
4) inner parameter of video camera uses the calibration tool case of University of Southern California's exploitation to demarcate, from the image of one group of demarcation thing different azimuth, extract the characteristic point of known geological information, then it is sent into optimizing process, just can obtain the principal point and the effective focal length of video camera.
CNB2003101058444A 2003-10-22 2003-10-22 Three-line calibration method for external parmeters of camera carried by car Expired - Fee Related CN1323547C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2003101058444A CN1323547C (en) 2003-10-22 2003-10-22 Three-line calibration method for external parmeters of camera carried by car

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2003101058444A CN1323547C (en) 2003-10-22 2003-10-22 Three-line calibration method for external parmeters of camera carried by car

Publications (2)

Publication Number Publication Date
CN1537749A CN1537749A (en) 2004-10-20
CN1323547C true CN1323547C (en) 2007-06-27

Family

ID=34333890

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2003101058444A Expired - Fee Related CN1323547C (en) 2003-10-22 2003-10-22 Three-line calibration method for external parmeters of camera carried by car

Country Status (1)

Country Link
CN (1) CN1323547C (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101408423B (en) * 2007-10-09 2011-05-18 财团法人工业技术研究院 Method for detecting angle of image viewfinding device and vehicle collision alarming system thereof
CN101488222B (en) * 2008-01-16 2011-02-09 中国科学院自动化研究所 Camera self-calibration method based on movement target image and movement information
CN101814184B (en) * 2010-01-15 2012-05-30 北京智安邦科技有限公司 Calibration method and device based on line segments
CN102013099B (en) * 2010-11-26 2012-07-04 中国人民解放军国防科学技术大学 Interactive calibration method for external parameters of vehicle video camera
JP5898475B2 (en) * 2011-11-28 2016-04-06 クラリオン株式会社 In-vehicle camera system, calibration method thereof, and calibration program thereof
CN103185543B (en) * 2011-12-31 2015-11-25 上海汽车集团股份有限公司 Vehicle-mounted camera scaling method and system
EP2618305B1 (en) * 2012-01-20 2014-04-30 ESG Elektroniksystem- und Logistik-GmbH Method and device for online calibration of vehicle cameras
CN102661733B (en) * 2012-05-28 2014-06-04 天津工业大学 Front vehicle ranging method based on monocular vision
CN102968548B (en) * 2012-09-29 2016-01-06 昆山市智汽电子科技有限公司 A kind of method of vehicle calibration, equipment and system thereof
CN103832338B (en) * 2012-11-27 2016-05-04 德尔福电子(苏州)有限公司 A kind of vehicle rearview camera assembling deviation bucking-out system
CN104943620A (en) * 2015-06-19 2015-09-30 寅家电子科技(上海)有限公司 Auxiliary installation system and method for vehicle-mounted camera
CN105701801A (en) * 2015-12-31 2016-06-22 清华大学 Distant view camera calibration method based on three-line method
CN106355581B (en) * 2016-09-29 2019-02-01 上海智驾汽车科技有限公司 The device and method of the on-line proving of vehicle-mounted camera is realized using vehicle detection
CN107292282B (en) * 2017-07-04 2019-10-11 西安交通大学 A kind of vehicle checking method updated based on semantic reasoning and space-time memory
CN108154535B (en) * 2017-12-04 2020-02-11 中国人民解放军国防科技大学 Camera calibration method based on collimator
CN110349219A (en) * 2018-04-04 2019-10-18 杭州海康威视数字技术股份有限公司 A kind of Camera extrinsic scaling method and device
CN110555886B (en) * 2018-05-31 2021-09-17 杭州海康威视数字技术股份有限公司 Vehicle-mounted camera external parameter calibration method and device, electronic equipment and storage medium
CN111316337A (en) * 2018-12-26 2020-06-19 深圳市大疆创新科技有限公司 Method and equipment for determining installation parameters of vehicle-mounted imaging device and controlling driving
CN110490936B (en) * 2019-07-15 2021-09-07 杭州飞步科技有限公司 Calibration method, device and equipment of vehicle camera and readable storage medium
CN111442845A (en) * 2020-03-26 2020-07-24 浙江大华技术股份有限公司 Infrared temperature measurement method and device based on distance compensation and computer storage medium
CN116381632B (en) * 2023-06-05 2023-08-18 南京隼眼电子科技有限公司 Self-calibration method and device for radar roll angle and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002232869A (en) * 2001-02-02 2002-08-16 Mitsubishi Electric Corp Calibration method for camera
CN1386363A (en) * 2000-08-03 2002-12-18 皇家菲利浦电子有限公司 Method and apparatus for external calibration of a camera via a graphical user interface
JP2003050107A (en) * 2001-08-07 2003-02-21 Matsushita Electric Ind Co Ltd Camera calibration device
US6542840B2 (en) * 2000-01-27 2003-04-01 Matsushita Electric Industrial Co., Ltd. Calibration system, target apparatus and calibration method
JP2003259357A (en) * 2002-03-05 2003-09-12 Mitsubishi Electric Corp Calibration method for camera and attachment of camera

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6542840B2 (en) * 2000-01-27 2003-04-01 Matsushita Electric Industrial Co., Ltd. Calibration system, target apparatus and calibration method
CN1386363A (en) * 2000-08-03 2002-12-18 皇家菲利浦电子有限公司 Method and apparatus for external calibration of a camera via a graphical user interface
JP2002232869A (en) * 2001-02-02 2002-08-16 Mitsubishi Electric Corp Calibration method for camera
JP2003050107A (en) * 2001-08-07 2003-02-21 Matsushita Electric Ind Co Ltd Camera calibration device
JP2003259357A (en) * 2002-03-05 2003-09-12 Mitsubishi Electric Corp Calibration method for camera and attachment of camera

Also Published As

Publication number Publication date
CN1537749A (en) 2004-10-20

Similar Documents

Publication Publication Date Title
CN1323547C (en) Three-line calibration method for external parmeters of camera carried by car
Vivacqua et al. Self-localization based on visual lane marking maps: An accurate low-cost approach for autonomous driving
CN106774313B (en) A kind of outdoor automatic obstacle-avoiding AGV air navigation aid based on multisensor
CN110146910B (en) Positioning method and device based on data fusion of GPS and laser radar
CN103400392B (en) Binocular vision navigation system and method based on Intelligent Mobile Robot
Scaramuzza et al. Real-time monocular visual odometry for on-road vehicles with 1-point ransac
CN100541121C (en) Intelligent vehicular vision device and global localization method thereof based on ground texture
CN101566471B (en) Intelligent vehicular visual global positioning method based on ground texture
CN101894366B (en) Method and device for acquiring calibration parameters and video monitoring system
DE112020002175T5 (en) SYSTEMS AND METHODS FOR VEHICLE NAVIGATION
CN102467821B (en) Road distance detection method based on video image and apparatus thereof
DE112018002143T5 (en) SYSTEMS AND METHODS FOR COMPRESSING TRAFFIC DATA
CN103731652B (en) All-moving surface line of demarcation cognitive device and method and moving body apparatus control system
DE102015203016B4 (en) Method and device for optical self-localization of a motor vehicle in an environment
CN107438754A (en) Sparse map for autonomous vehicle navigation
CN107229908A (en) A kind of method for detecting lane lines
CN100567886C (en) A kind of three-point scaling measuring method
DE112021002680T5 (en) SYSTEMS AND METHODS FOR DETECTING AN OPEN DOOR
CN103204104B (en) Monitored control system and method are driven in a kind of full visual angle of vehicle
DE112020002592T5 (en) SYSTEMS AND METHODS FOR VEHICLE NAVIGATION BASED ON IMAGE ANALYSIS
CN111862673A (en) Parking lot vehicle self-positioning and map construction method based on top view
CN109492599A (en) A kind of multiaxis electricity car self- steering method
DE112021003811T5 (en) SYSTEMS AND METHODS FOR DYNAMIC ROAD GEOMETRY MODELING AND NAVIGATION
DE112021004128T5 (en) SYSTEMS AND METHODS FOR MAP-BASED MODELING OF THE REAL WORLD
DE112021002014T5 (en) CONTROL LOOP FOR NAVIGATING A VEHICLE

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20070627

Termination date: 20111022