CN1323547C - Three-line calibration method for external parmeters of camera carried by car - Google Patents
Three-line calibration method for external parmeters of camera carried by car Download PDFInfo
- Publication number
- CN1323547C CN1323547C CNB2003101058444A CN200310105844A CN1323547C CN 1323547 C CN1323547 C CN 1323547C CN B2003101058444 A CNB2003101058444 A CN B2003101058444A CN 200310105844 A CN200310105844 A CN 200310105844A CN 1323547 C CN1323547 C CN 1323547C
- Authority
- CN
- China
- Prior art keywords
- centerdot
- video camera
- coordinate system
- vehicle
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Image Analysis (AREA)
Abstract
The present invention discloses a three-line calibration method for external parameters of a vehicle-mounted camera. The method aims at the calibration problem of a vehicle-mounted camera of an intelligent vehicle on the basis of visual navigation; a ready-made tool box is used for carrying out the calibration of internal parameters; three parallel lines have the same vanishing point and different slope rates on a picture plane according to the principle of perspective projection; the external parameters of the camera have internal relation with the vanishing point and the slope rates; the expression of the external parameters of the camera in pixels can be established through mathematical derivation and coordinate transformation. In a pixel coordinate system, after the coordinates of the intersection points of the parallel lines and the other three points are manually or automatically determined, parameters needed can be directly calculated. The process can be realized under different environment such as roads, playground tracks or special delineated parallel lines. Experimental results verify the feasibility and the correctness of the method.
Description
Technical field
The invention belongs to computer vision field, relate to camera calibration in the computer vision, the three-way scaling method of particularly a kind of vehicle-mounted vidicon external parameter.
Background technology
Along with popularizing of development of urbanization and automobile, the communications and transportation problem is serious day by day, and the notion of intelligent vehicle navigation is arisen at the historic moment.Road tracking based on vision is paid attention to most, according to the data-searching that the applicant carries out, finds following document:
[1]Bertozzi M,Broggi A,Cellario M,et al.ArtificialVision in road vehicles[C].In:Proceedings of the IEEE on IntelligentTransmission System,2002,90(7):1258-1271
[2] Yang Ming, Lu Jianye, Wang Hong opens cymbals etc. and the road based on vision is followed the tracks of [J]. " pattern recognition and artificial intelligence ", 2001,14 (2): 186-193
[3] Qiu Maolin, Ma Songde, Li Yi. camera calibration summary in the computer vision. " automation journal ", 2000,26 (1): 43-55
[4]Bertozzi M,Broggi A.GOLD:a parallel real-time stereovision system for generic obstacle and lane detection [J].IEEEtransactions on image processing,1998,7(1):62-81
[5]Bertozzi M,Broggi A,Fascioli A.Self-calibration of astereo vision system for automotive applications[C].In:Proceedingsof IEEE International Conference on Robotics and Automation,2001,4:3698-3703
[6]Southall B,Taylor C J. Stochastic road shapeestimation[C].In:Proceedings of Eighth IEEE InternationalConference on Computer Vision,2001,1:205-212
[7] Song Xuefeng, Yang Ming, Wang Hong. based on the simple and easy camera marking method of latticed texture. " computer engineering and application [J] " .2002,7:72-74
In many complexity of intelligent vehicle navigation and challenging task, the most valued road that is based on vision is followed the tracks of
[1] [2]In this process, need calculate the geological information of object in the three dimensions according to the image information that video camera obtains usually, and rebuild thus or recognition object, thereby camera calibration is absolutely necessary
[3]For the demarcation problem of vehicle-mounted vidicon, have a lot of people to study: the inner parameter of the ARGO system supposition video camera of Parma university is known, draws the grid of known dimensions on the ground, utilizes the intersection point of grid to demarcate external parameter
[4]They have also adopted a kind of so-called self-calibrating method in addition
[5], the gauge point on the use hood is as spotting, and these calibration points are known with respect to the position of bodywork reference frame; The breadboard researcher of the GRASP of the University of Pennsylvania has used the calibration tool case of University of Southern California's exploitation to carry out the demarcation of inner parameter, utilizes and represents the straight line in track to carry out the demarcation of external parameter
[6]The researcher of Tsing-Hua University utilizes ground grid to demarcate
[7]Also have other researchers to use the function library of Intel to carry out the demarcation of intrinsic parameters of the camera, use the method that is similar to the ARGO system to demarcate external parameter.Though above-mentioned scaling method can be dealt with problems preferably, all there is weak point: complicated operating process, higher to environment requirement, or the parameter of demarcating is less.
To the research of intelligent vehicle, mainly concentrate on more smooth zone, road surface at present, therefore can make ground flatness hypothesis.Because vehicle is to travel on the road surface, the deviation in the certain limit can not cause too big problem, so the precision of demarcating can be significantly less than the precision in the applications such as Robot Hand-eye demarcation, three-dimensional reconstruction.
Summary of the invention
These characteristics at above-mentioned vehicle-mounted vidicon is demarcated the objective of the invention is to, and the method for the three-way demarcation of a kind of vehicle-mounted vidicon external parameter is provided.
Realize that foregoing invention purpose technical solution is, the three-way scaling method of vehicle-mounted vidicon external parameter, be characterized in, on smooth ground, draw three straight lines parallel to each other, or utilize existing parallel lines, or look for one section straight road that three markings are arranged, and make the car body longitudinal axis of the automobile that is loaded with video camera be parallel to these straight lines, record the distance of they and the car body longitudinal axis; Foundation is that the video camera external parameter expression formula of unit is determined the vehicle-mounted vidicon external parameter with the pixel, through mathematical derivation and coordinate transform, obtain the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and the video camera photocentre apart from the lateral separation d of the car body longitudinal axis.
Method of the present invention only needs three parallel straight lines on the smooth ground, just can carry out the video camera calibrating external parameters, need not special-purpose place, even can finish in the driving process of vehicle.
Description of drawings
Fig. 1 is the schematic diagram that concerns between car body of the present invention and the video camera, also is one embodiment of the present of invention; Wherein (a) is end view, (b) is vertical view, (c) is rearview;
Fig. 2 is the schematic diagram that concerns of camera coordinate system, plane of delineation coordinate system and pixel coordinate system;
Fig. 3 is straight highway and the superincumbent straight line picture of manual stack of demarcating usefulness;
Fig. 4 is sports filed track and the superincumbent straight line picture of manual stack of demarcating usefulness.
Embodiment
The present invention is described in further detail below in conjunction with embodiment that accompanying drawing and inventor provide.
According to technique scheme, the three-way scaling method of vehicle-mounted vidicon external parameter may further comprise the steps:
1) on smooth ground, draws three straight lines parallel to each other, or utilize existing parallel lines, or look for one section straight road that three markings are arranged, make the car body longitudinal axis of the automobile that is loaded with video camera be parallel to these straight lines, record the distance of they and the car body longitudinal axis;
2) the vehicle-mounted vidicon external parameter determines
The vehicle-mounted vidicon external parameter comprise the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and video camera apart from car centre distance d;
3) setting up with the pixel is the video camera external parameter expression formula of unit
As shown in Figure 1, adopt left-handed coordinate system, establishing in the bodywork reference frame certain any coordinate is p
v=(x
v, y
v, z
v), its coordinate at camera coordinate system is p
c=(x
c, y
c, z
c).The angle of heel of the relative car body of video camera is ψ (observing to tilt clockwise for just along vehicle heading), and the angle of pitch is θ (points upwards for just), deflection is _ (sensing vehicle body axis left for just), the position of the photocentre of video camera in bodywork reference frame is t=(l, d, h), then
p
v=R·p
c+t
p
c=R
-1·p
v-R
-1·t=R
T·p
v-R
T·t (1)
Wherein
Wherein
Suppose that ground is smooth, optical axis o is at plane z
vThe vector that projection on=0 forms is η, η and X
vThe angle that axle forms is _, optical axis o is θ with the angle that η forms, the angle of heel of the relative car body of video camera (or roll angle of title video camera) is ψ, l
1, l
2, l
3For three straight lines that are parallel to the vehicle body longitudinal axis on the smooth ground, apart from X
vDistance be respectively a, b, c;
For on the smooth ground one be parallel to the vehicle body longitudinal axis X
v, and arriving it apart from being the straight line l of k, its parametric equation is
According to formula (1), the parametric equation of l in camera coordinate system is
Correlation (Fig. 2) according between camera coordinate system, plane of delineation coordinate system and the pixel coordinate system of this paper definition has
u=y
c,v=-z
c,u=(i-c
i)·dx,v=(j-c
j)·dy (4)
Wherein dx, dy and c
i, c
jBe respectively laterally, proportionality coefficient and principal point position longitudinally.
According to the pinhole imaging system model, convolution (3), formula (4), the parametric equation of l on plane of delineation coordinate system is (focal length is unit representation with the pixel)
Because s is any real number, and and l on same direction, formula (5) is rewritten into
When s → ∞, straight line l extends to infinite distant place, and its end point on plane of delineation coordinate system is
Because the family of straight lines that is parallel to each other in the space has identical end point at view plane, so straight line l
1, l
2, l
3The end point of imaging is
u
h1=u
h2=u
h3=u
h
v
h1=v
h2=v
h3=v
h
For 3 parallel lines l
1, l
2, l
3, have respectively
According to formula (9), solve
According to formula (7a), (7b)
According to formula (9), solve
Wherein:
A=r
1·sinψ·cosθ-cosθcos ψ
B=-(cos_sinψ+sin_cosψsinθ)-r
1(cos_cosψ-sin_sinψsinθ)
C=r
2·sinψcosθ-cosθcosψ
D=-(cos_sinψ+sin_cosψsinθ)-r
2(cos_cosψ-sin_sinψsinθ)
4) parameter calibration
The inner parameter of video camera use the calibration tool case of University of Southern California's exploitation demarcate (J.Y.Bouget.Matlab camera calibration toolbox.http: //www.vision.caltech.edu/bougetj/calib_doc/index.html), from the image of one group of demarcation thing different azimuth, extract the characteristic point of known geological information, then it is sent into optimizing process, just can obtain the principal point and the effective focal length of video camera.
Utilize the present invention on smooth ground, to draw three straight lines parallel to each other, or utilize existing parallel lines (as hundred meters racing tracks of sports ground), or look for one section straight road that three lane lines are arranged, make the longitudinal axis of automobile be parallel to these straight lines, the distance (being a, b, c) that records they and the car body longitudinal axis just can be carried out the video camera calibrating external parameters easily.
Embodiment:
This method is tested on the instruction carriage of Jilin University and Xi'an Communications University with different forms.What at first select for use is one section straight highway with three lane lines.Fig. 3 is the frame in the video gathered of laboratory vehicle, camera is the TMC-9700 of U.S. PULNIX company, capture card and transaction card are respectively the Viper RGB and the Python of Canadian CORECO company, camera lens is selected Computar 8mm for use, image resolution ratio is set at 256 * 240, and video camera is installed in the front upper place of copilot station.This frame picture is saved as the file of bmp form, utilizes the paintbrush of Windows to handle then, with the straight line tool of the paintbrush l that draws
1 c, l
2 c, l
3 cArticle three, straight line is superimposed upon on the lane line, represents the center line of markings imaging.H (i
h, j
h) expression three parallel lines intersection point, P
1(i
1, j
1) be l
1 cGo up and remove H (i
h, j
h) outer more arbitrarily, P
2(i
2, j
2) be l
2 cGo up and remove H (i
h, j
h) outer more arbitrarily, P
3(i
3, j
3) be l
3 cGo up and remove H (i
h, j
h) outer more arbitrarily.Utilize the image coordinate positioning function of paintbrush, find out the pixel coordinate of four Chosen Points, record a=-3.2m in addition, b=0.3m, c=3.8m.In pixel coordinate system,
In formula (14) substitution formula (10), (11), (12), (13), can try to achieve ψ, θ, _, d, the value of h.
Table 1 PULNIX intrinsic parameters of the camera and calibrating external parameters result
Parameter | f i | f j | c i | c j | ψ | θ | _ | d | h |
Value | 599 pixels | 605 pixels | 89 pixels | 150 pixels | 0.034rad | -0.219rad | 0.053rad | 0.29m | 1.70m |
Above-mentioned experimental technique is a kind of implementation of this scaling method, can also carry out in another mode.As shown in Figure 4, the 100-metre dash road (can directly utilize the known geological information of racing track markings like this and setting-out again, and satisfy ground flatness hypothesis) of plastic sports ground is selected in the place for use, makes the longitudinal axis of automobile be parallel to the runway marking line.Used camera is SONY DSR-PD150P, and zoom is set at the maximum of the mode of looking in the distance, Manual focusing, resolution setting is 640 * 480, records a=-1.25m, b=0m, c=1.25m, demarcation the results are shown in Table 2.
Table 2 SONY intrinsic parameters of the camera and calibrating external parameters result
Parameter | f i | f j | c i | c j | ψ | θ | _ | d | h |
Value | 789 pixels | 806 pixels | 322 pixels | 218 pixels | 0.039rad | -0.026rad | -0.028rad | 0.25m | 1.37m |
Can in the vehicle ' process, demarcate in addition.For example under steam, the driver makes a certain sign aligning middle lane line of reserving in advance on the car body, and direct of travel is parallel with lane line, just can determine the value of a, b, c, thereby finishes demarcation.
Parallel lines imaging location in the three-way scaling method of vehicle-mounted vidicon external parameter of the present invention is manual the realization, if introduce image processing techniques in calibration process, just can realize the automatic demarcation of vehicle-mounted vidicon external parameter.Even vehicle under steam like this,, just can demarcate at any time as long as run into suitable highway section.
Obviously, three-way scaling method of the present invention can not be demarcated the length travel l of the relative bodywork reference frame of video camera photocentre, needs extra this parameter of measuring, and makes l introduce measure error, but generally not too large.In the ordinary course of things, the preview distance of automobile is 30m~70m, and it is negligible therefore measuring the error of introducing, and other CALCULATION OF PARAMETERS does not rely on this parameter fortunately.
In addition, calibration process can produce error inevitably, and its main cause can be summed up as follows:
● can not satisfy ground flatness hypothesis;
● three straight lines exist crooked or not parallel each other;
● the longitudinal axis of vehicle body does not have and straight line parallel;
● the straight line of manual stack is not the center line of markings;
● three straight lines are bigger with respect to the range measurement error of vehicle body longitudinal axis;
● the demarcation of inner parameter is inaccurate.
Theory analysis and experimental result show that trilinear method only needs three parallel lines, just can finish the calibrating external parameters of vehicle-mounted vidicon, existing relatively certain methods, it is simple to have principle, easy to operate, highly versatile, implementation is various, and is easy of integration in the medium advantage of on-vehicle machines vision system.After introducing image processing techniques, whole calibrating procedure can full automation, even can carry out in vehicle ', thereby has solved the drifting problem of vehicle-mounted vidicon parameter to a certain extent.In addition, trilinear method can also be simplified to 6 methods, and promptly six points with rectangular distribution replace three parallel lines.6 methods are particularly suitable for demarcating in a fixed venue, only need six points of picture, but are not suitable for demarcating on highway.
Attached:
The proof of some formula in " vehicle-mounted vidicon calibrating external parameters trilinear method "
1. the derivation of civilian Chinese style (8)
Have then
2. the derivation of civilian Chinese style (10)
According to civilian Chinese style (9)
Order
Then
Launch
r
1·a·(r
13·r
21-r
11·r
23)+r
1·d·(r
11·r
23-r
13·r
21)+r
1·h·(r
11r
33-r
13·r
31)=a·(r
12·r
21-r
11·r
22)+d·(r
11·r
22-r
12·r
21)+h·(r
11r
32-r
12·r
31) (A1)
In like manner can get
r
2·b·(r
13·r
21-r
11r
23)+r
2·d·(r
11·r
23-r
13·r
21)+r
2·h·(r
11r
33-r
13·r
31)=b·(r
12·r
21-r
11·r
22)+d·(r
11·r
22-r
12·r
21)+h·(r
11r
32-r
12·r
31) (A2)
r
3·c·(r
13·r
21-r
11·r
23)+r
3·d·(r
11·r
23-r
13·r
21)+r
3·h·(r
11r
33-r
13·r
31)=c·(r
12·r
21-r
11·r
22)+d·(r
11·r
22-r
12·r
21)+h·(r
11r
32-r
12·r
31) (A3)
Formula (A1) deducts formula (A2) and gets
(r
1·a-r
2·b)·(r
13·r
21-r
11·r
23)+d·(r
1-r
2)·(r
11·r
23-r
13·r
21)+h·(r
1-r
2)·(r
11·r
33-r
13·r
31)=(a-b)·(r
12·r
21-r
11·r
22) (A4)
Formula (A1) deducts formula (A3) and gets
(r
1·a-r
3·c)·(r
13·r
21-r
11·r
23)+d·(r
1-r
3)·(r
11·r
23-r
13·r
21)+h·(r
1-r
3)·(r
11·r
33-r
13·r
31)=(a-c)·(r
12·r
21-r
11·r
22) (A5)
Formula (A2) deducts formula (A3) and gets
(r
2·b-r
3·c)·(r
13·r
21-r
11·r
23)+d·(r
2-r
3)·(r
11·r
23-r
13·r
21)+h·(r
2-r
3)·(r
11·r
33-r
13·r
31)=(b-c)·(r
12·r
21-r
11·r
22) (A6)
Get by (A4)
d·(r
1-r
2)·(r
11·r
23-r
13·r
21)=(a-b)·(r
12·r
21-r
11·r
22)-(r
1·a-r
2·b)·(r
13·r
21-r
11·r
23)-h·(r
1-r
2)·(r
11·r
33-r
13·r
31) (A7)
Get by (A5)
d·(r
1-r
3)·(r
11·r
23-r
13·r
21)=(a-c)·(r
12·r
21-r
11·r
22)-(r
1·a-r
3·c)·(r
13·r
21-r
11·r
23)-h·(r
1-r
3)·(r
11·r
33-r
13·r
31) (A8)
Get by (A6)
d·(r
2-r
3)·(r
11·r
23-r
13·r
21)=(b-c)·(r
12·r
21-r
11·r
22)-(r
2·b-r
3·c)·(r
13·r
21-r
11·r
23)-h·(r
2-r
3)·(r
11·r
33-r
13·r
31) (A9)
(A7) divided by (A8),
Put in order:
(r
1-r
2)·(a-c)·(r
12·r
21-r
11·r
22)-(r
1-r
2)·(r
1·a-r
3·c)·(r
13·r
21-r
11·r
23)=(r
1-r
3)·(a-b)·(r
12·r
21-r
11·r
22)-(r
1-r
3)·(r
1·a-r
2·b)·(r
13·r
11-r
11·r
23) (A11)
Because
r
12·r
21-r
11·r
22=(sin_cosψ+cos_sinψsinθ)·(-sin_cosθ)-cosθcos_·(cos_cosψ-sin_sinψsinθ)=-cosψcosθ
r
13R
21-r
11R
23=(sin_sin ψ-cos_cos ψ sin θ) (sin_cos θ)-cos θ cos_ (cos_sin ψ+sin_cos ψ sin θ)=-sin_cos θ formula (A11) is rewritten as
(r
1-r
2)·(a-c)·(-cos_cosθ)-(r
1-r
2)·(r
1·a-r
3·c)·(-sinψcosθ)=(r
1-r
3)·(a-b)·(-cosψcosθ)-(r
1-r
3)·(r
1·a-r
2·b)·(-sinψcosθ) (A12)
The both members cos θ that divides out has
-(r
1-r
2)·(a-c)·cosψ+(r
1-r
3)·(a-b)·cosψ=(r
1-r
3)·(r
1·a-r
2·b)·sinψ-(r
1-r
2)·(r
1·a-r
3·c)·sin_
So have
3. the derivation of civilian Chinese style (11)
According to civilian Chinese style (7a) and (7b), have
Formula (A14) solves at last divided by formula (A15)
4. the derivation of civilian Chinese style (12)
According to formula (A14), solve
5. the derivation of civilian Chinese style (13)
Get by formula (A1)
d·[r
1·(r
11·r
23-r
13·r
21)-(r
11·r
22-r
12·r
21)]=h·[(r
11·r
32-r
12·r
31)-r
1·(r
11r
33-r
13·r
31)]+a·(r
12·r
21-r
11·r
22)-r
1·a·(r
13·r
21-r
11·r
23) (A18)
Get by formula (A2)
d·[r
2·(r
11·r
23-r
13·r
21)-(r
11·r
22-r
12·r
21)]=h·[(r
11·r
32-r
12·r
31)-r
2·(r
11r
33-r
13·r
31)]+b·(r
12·r
21-r
11·r
22)-r
2·b·(r
13·r
21-r
11·r
23) (A19)
Wherein
r
11·r
22-r
12·r
21=cosθcos_·(cos_cosψ-sin_sinψsinθ)-(sin_cosψ+cos_sinψsinθ)·(-sin_cosθ)
=cosθcosψ
r
11·r
23-r
13·r
21=cosθcos_·(cos_sinψ+sin_cosψsinθ)-(sin_sinψ-cos_cosψsinθ)·(-sin_cosθ)
=sinψcosθ
r
11·r
32-r
12·r
31=cosθcos_·(-cosθsinψ)-(sin_sinψ-cos_cosψsinθ)·sinθ
=-cos_·sinψ-sin_·cosψ·sinθ
r
11·r
33-r
13·r
31=cosθcos_·cosθcosψ-(sin_sinψ-cos_cosψsinθ)·sinθ
=cos_·cosψ-sin_·sin·sinθ
Order
A=r
1·(r
11·r
23-r
13·r
21)-(r
11·r
22-r
12·r
21)=r
1·sinψ·cosθ-cosθcos_
B=[(r
11·r
32-r
12·r
31)-r
1·(r
11r
33-r
13·r
31)]=-(cos_sinψ+sin_cosψsinθ)-r
1(cos_cosψ-sin_sinψsinθ)
C=r
2(r
11·r
23-r
13·r
21)-(r
11·r
22-r
12·r
21)=r
2·sinψcosθ-cosθcosψ
D=(r
11·r
32-r
12·r
31)-r
2·(r
11r
33-r
13·r
31)=-(cos_sinψ+sin_cosψsinθ)-r
2(cos_cosψ-sin_sinψsinθ)
Formula (A18) gets divided by (A19)
So
By formula (A18), get again
Claims (1)
1. the three-way scaling method of vehicle-mounted vidicon external parameter is characterized in that, may further comprise the steps:
1) on smooth ground, draws three straight lines parallel to each other, or utilize existing parallel lines, or look for one section straight road that three markings are arranged, the car body longitudinal axis that is loaded with the automobile of video camera is parallel to these straight lines, record the distance of these straight lines and the car body longitudinal axis;
2) the vehicle-mounted vidicon external parameter determines
The vehicle-mounted vidicon external parameter comprise the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and the video camera photocentre apart from the lateral separation d of the car body longitudinal axis;
Bodywork reference frame adopts left-handed coordinate system, and the initial point of bodywork reference frame is the barycenter of vehicle, and car body longitudinal axis directed forward is X
vAxle, pointing to right-hand is Y
v, points upwards is Z
v
(1) setting up with the pixel is the video camera external parameter expression formula of unit, adopts left-handed coordinate system, and establishing in the bodywork reference frame certain any coordinate is p
v=(x
v, y
v, z
v), its coordinate at camera coordinate system is p
c=(x
c, y
c, z
c); The angle of heel of the relative car body of video camera is ψ, and this angle of heel is observed to tilt clockwise for just along vehicle heading; The angle of pitch is θ, and this angle of pitch points upwards is for just; Deflection is _, this deflection points to vehicle body axis left for just; The position of the photocentre of video camera in bodywork reference frame be t=(l, d, h), then
p
v=R·p
c+t
p
c=R
-1·p
v-R
-1·t=R
T·p
v-R
T·t (1)
Wherein
(2) suppose that ground is smooth, optical axis ο is at plane z
vThe vector that projection on=0 forms is η, η and X
vThe angle that axle forms is _, optical axis ο is θ with the angle of η formation, the angle of heel of video camera is ψ, l
1, l
2, l
3For three straight lines that are parallel to the vehicle body longitudinal axis on the smooth ground, apart from X
vDistance be respectively a, b, c;
For on the smooth ground one be parallel to the vehicle body longitudinal axis X
v, and arriving it apart from being the straight line l of k, its parametric equation is
(3) according to formula (1), the parametric equation of l in camera coordinate system is
(4) according to the camera coordinate system of above-mentioned definition, the correlation between its plane of delineation coordinate system, pixel coordinate system and the camera coordinate system has:
u=y
c,v=-z
c,u=(i-c
i)·dx,v=(j-c
j)·dy (4)
Wherein u, v are the coordinate of plane of delineation coordinate system, and i, j are the coordinate of pixel coordinate system, dx, dy and c
i, c
jBe respectively laterally, proportionality coefficient and principal point position longitudinally; Wherein dx, dy are constant;
(5) according to the pinhole imaging system model, convolution (3), formula (4), the parametric equation of l on plane of delineation coordinate system is
F in the formula
i, f
jBe focal length of camera, its unit is a pixel; Because s is any real number, and and l on same direction, formula (5) is rewritten into
(6) when s → ∞, straight line l extends to infinite distant place, and its end point on plane of delineation coordinate system is
Because the family of straight lines that is parallel to each other in the space has identical end point at view plane, so straight line l
1, l
2, l
3The end point of imaging is
u
h1=u
h2=u
h3=u
h
v
h1=v
h2=v
h3=v
h
(7) slope according to the image plane cathetus gets
For 3 parallel lines l
1, l
2, l
3, have respectively
(8) according to formula (9), solve
(9), obtain the expression formula of the angle of pitch according to formula (7a), (7b)
(10), can also obtain the expression formula of deflection according to formula (7a), (7b)
(11) according to formula (9), can solve
Wherein:
A=r
1·sinψ·cosθ-cosθcosψ
B=-(cos_sinψ+sin_cosψsinθ)-r
1(cos_cosψ-sin_sinψsinθ)
C=r
2·sinψcosθ-cosθcosψ
D=-(cos_sinψ+sin_cosψsinθ)-r
2(cos_cosψ-sin_sinψsinθ)
In pixel coordinate system, with manual or automatically mode determine the intersecting point coordinate of three parallel lines, on three parallel lines, choose three points except that intersection point then respectively, can directly calculate desired parameters;
3) through above-mentioned mathematical derivation and coordinate transform, obtain the angle of heel ψ, pitching angle theta, deflection of the relative car body of video camera _, video camera in car body overhead height h and the video camera photocentre apart from the lateral separation d of the car body longitudinal axis, can finish the video camera calibrating external parameters;
4) inner parameter of video camera uses the calibration tool case of University of Southern California's exploitation to demarcate, from the image of one group of demarcation thing different azimuth, extract the characteristic point of known geological information, then it is sent into optimizing process, just can obtain the principal point and the effective focal length of video camera.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2003101058444A CN1323547C (en) | 2003-10-22 | 2003-10-22 | Three-line calibration method for external parmeters of camera carried by car |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2003101058444A CN1323547C (en) | 2003-10-22 | 2003-10-22 | Three-line calibration method for external parmeters of camera carried by car |
Publications (2)
Publication Number | Publication Date |
---|---|
CN1537749A CN1537749A (en) | 2004-10-20 |
CN1323547C true CN1323547C (en) | 2007-06-27 |
Family
ID=34333890
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNB2003101058444A Expired - Fee Related CN1323547C (en) | 2003-10-22 | 2003-10-22 | Three-line calibration method for external parmeters of camera carried by car |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN1323547C (en) |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101408423B (en) * | 2007-10-09 | 2011-05-18 | 财团法人工业技术研究院 | Method for detecting angle of image viewfinding device and vehicle collision alarming system thereof |
CN101488222B (en) * | 2008-01-16 | 2011-02-09 | 中国科学院自动化研究所 | Camera self-calibration method based on movement target image and movement information |
CN101814184B (en) * | 2010-01-15 | 2012-05-30 | 北京智安邦科技有限公司 | Calibration method and device based on line segments |
CN102013099B (en) * | 2010-11-26 | 2012-07-04 | 中国人民解放军国防科学技术大学 | Interactive calibration method for external parameters of vehicle video camera |
JP5898475B2 (en) * | 2011-11-28 | 2016-04-06 | クラリオン株式会社 | In-vehicle camera system, calibration method thereof, and calibration program thereof |
CN103185543B (en) * | 2011-12-31 | 2015-11-25 | 上海汽车集团股份有限公司 | Vehicle-mounted camera scaling method and system |
EP2618305B1 (en) * | 2012-01-20 | 2014-04-30 | ESG Elektroniksystem- und Logistik-GmbH | Method and device for online calibration of vehicle cameras |
CN102661733B (en) * | 2012-05-28 | 2014-06-04 | 天津工业大学 | Front vehicle ranging method based on monocular vision |
CN102968548B (en) * | 2012-09-29 | 2016-01-06 | 昆山市智汽电子科技有限公司 | A kind of method of vehicle calibration, equipment and system thereof |
CN103832338B (en) * | 2012-11-27 | 2016-05-04 | 德尔福电子(苏州)有限公司 | A kind of vehicle rearview camera assembling deviation bucking-out system |
CN104943620A (en) * | 2015-06-19 | 2015-09-30 | 寅家电子科技(上海)有限公司 | Auxiliary installation system and method for vehicle-mounted camera |
CN105701801A (en) * | 2015-12-31 | 2016-06-22 | 清华大学 | Distant view camera calibration method based on three-line method |
CN106355581B (en) * | 2016-09-29 | 2019-02-01 | 上海智驾汽车科技有限公司 | The device and method of the on-line proving of vehicle-mounted camera is realized using vehicle detection |
CN107292282B (en) * | 2017-07-04 | 2019-10-11 | 西安交通大学 | A kind of vehicle checking method updated based on semantic reasoning and space-time memory |
CN108154535B (en) * | 2017-12-04 | 2020-02-11 | 中国人民解放军国防科技大学 | Camera calibration method based on collimator |
CN110349219A (en) * | 2018-04-04 | 2019-10-18 | 杭州海康威视数字技术股份有限公司 | A kind of Camera extrinsic scaling method and device |
CN110555886B (en) * | 2018-05-31 | 2021-09-17 | 杭州海康威视数字技术股份有限公司 | Vehicle-mounted camera external parameter calibration method and device, electronic equipment and storage medium |
WO2020132965A1 (en) * | 2018-12-26 | 2020-07-02 | 深圳市大疆创新科技有限公司 | Method and apparatus for determining installation parameters of on-board imaging device, and driving control method and apparatus |
CN110490936B (en) * | 2019-07-15 | 2021-09-07 | 杭州飞步科技有限公司 | Calibration method, device and equipment of vehicle camera and readable storage medium |
CN111442845A (en) * | 2020-03-26 | 2020-07-24 | 浙江大华技术股份有限公司 | Infrared temperature measurement method and device based on distance compensation and computer storage medium |
CN116381632B (en) * | 2023-06-05 | 2023-08-18 | 南京隼眼电子科技有限公司 | Self-calibration method and device for radar roll angle and storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002232869A (en) * | 2001-02-02 | 2002-08-16 | Mitsubishi Electric Corp | Calibration method for camera |
CN1386363A (en) * | 2000-08-03 | 2002-12-18 | 皇家菲利浦电子有限公司 | Method and apparatus for external calibration of a camera via a graphical user interface |
JP2003050107A (en) * | 2001-08-07 | 2003-02-21 | Matsushita Electric Ind Co Ltd | Camera calibration device |
US6542840B2 (en) * | 2000-01-27 | 2003-04-01 | Matsushita Electric Industrial Co., Ltd. | Calibration system, target apparatus and calibration method |
JP2003259357A (en) * | 2002-03-05 | 2003-09-12 | Mitsubishi Electric Corp | Calibration method for camera and attachment of camera |
-
2003
- 2003-10-22 CN CNB2003101058444A patent/CN1323547C/en not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6542840B2 (en) * | 2000-01-27 | 2003-04-01 | Matsushita Electric Industrial Co., Ltd. | Calibration system, target apparatus and calibration method |
CN1386363A (en) * | 2000-08-03 | 2002-12-18 | 皇家菲利浦电子有限公司 | Method and apparatus for external calibration of a camera via a graphical user interface |
JP2002232869A (en) * | 2001-02-02 | 2002-08-16 | Mitsubishi Electric Corp | Calibration method for camera |
JP2003050107A (en) * | 2001-08-07 | 2003-02-21 | Matsushita Electric Ind Co Ltd | Camera calibration device |
JP2003259357A (en) * | 2002-03-05 | 2003-09-12 | Mitsubishi Electric Corp | Calibration method for camera and attachment of camera |
Also Published As
Publication number | Publication date |
---|---|
CN1537749A (en) | 2004-10-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN1323547C (en) | Three-line calibration method for external parmeters of camera carried by car | |
Vivacqua et al. | Self-localization based on visual lane marking maps: An accurate low-cost approach for autonomous driving | |
CN106774313B (en) | A kind of outdoor automatic obstacle-avoiding AGV air navigation aid based on multisensor | |
CN110146910B (en) | Positioning method and device based on data fusion of GPS and laser radar | |
CN103400392B (en) | Binocular vision navigation system and method based on Intelligent Mobile Robot | |
Scaramuzza et al. | Real-time monocular visual odometry for on-road vehicles with 1-point ransac | |
CN100541121C (en) | Intelligent vehicular vision device and global localization method thereof based on ground texture | |
CN101976460B (en) | Generating method of virtual view image of surveying system of vehicular multi-lens camera | |
CN101566471B (en) | Intelligent vehicular visual global positioning method based on ground texture | |
DE112020002175T5 (en) | SYSTEMS AND METHODS FOR VEHICLE NAVIGATION | |
DE112020006426T5 (en) | SYSTEMS AND METHODS FOR VEHICLE NAVIGATION | |
DE102015203016B4 (en) | Method and device for optical self-localization of a motor vehicle in an environment | |
CN103731652B (en) | All-moving surface line of demarcation cognitive device and method and moving body apparatus control system | |
CN107438754A (en) | Sparse map for autonomous vehicle navigation | |
DE112020002764T5 (en) | SYSTEMS AND METHODS FOR VEHICLE NAVIGATION | |
CN106651953A (en) | Vehicle position and gesture estimation method based on traffic sign | |
CN103226354A (en) | Photoelectricity-navigation-based unmanned road recognition system | |
CN107229908A (en) | A kind of method for detecting lane lines | |
CN100567886C (en) | A kind of three-point scaling measuring method | |
CN111862673A (en) | Parking lot vehicle self-positioning and map construction method based on top view | |
DE112021003811T5 (en) | SYSTEMS AND METHODS FOR DYNAMIC ROAD GEOMETRY MODELING AND NAVIGATION | |
CN103204104B (en) | Monitored control system and method are driven in a kind of full visual angle of vehicle | |
CN109492599A (en) | A kind of multiaxis electricity car self- steering method | |
DE112021002014T5 (en) | CONTROL LOOP FOR NAVIGATING A VEHICLE | |
DE112021004128T5 (en) | SYSTEMS AND METHODS FOR MAP-BASED MODELING OF THE REAL WORLD |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C17 | Cessation of patent right | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20070627 Termination date: 20111022 |