CN103630072A - Layout optimization method for camera in binocular vision measuring system - Google Patents

Layout optimization method for camera in binocular vision measuring system Download PDF

Info

Publication number
CN103630072A
CN103630072A CN201310508264.3A CN201310508264A CN103630072A CN 103630072 A CN103630072 A CN 103630072A CN 201310508264 A CN201310508264 A CN 201310508264A CN 103630072 A CN103630072 A CN 103630072A
Authority
CN
China
Prior art keywords
camera
video camera
point
centerdot
straight line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310508264.3A
Other languages
Chinese (zh)
Other versions
CN103630072B (en
Inventor
贾振元
刘巍
李明星
杨景豪
刘阳
张驰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dalian University of Technology
Original Assignee
Dalian University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dalian University of Technology filed Critical Dalian University of Technology
Priority to CN201310508264.3A priority Critical patent/CN103630072B/en
Publication of CN103630072A publication Critical patent/CN103630072A/en
Application granted granted Critical
Publication of CN103630072B publication Critical patent/CN103630072B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a layout optimization method for a camera in a binocular vision measuring system, belongs to the fields of computer vision detection and image detection, and particularly relates to the layout optimization method for the camera in the binocular vision measuring system for obtaining dimension parameters of a large-scale forging piece. In the binocular vision measuring system, image point extraction deviation caused by image sampling is considered, a mathematic relation model, namely a camera layout optimization mathematic model, is established between a measuring error which is caused by the image point extraction deviation and three structural parameters of a camera focal distance, a reference line distance and a camera deflection angle, and an optimized structural parameter combination is obtained by utilizing a genetic algorithm. According to the layout optimization method disclosed by the invention, the layout optimization design of the camera in the binocular vision measuring system is realized by utilizing the genetic algorithm, minimization of the measuring error caused by the image point extraction deviation is achieved, effective theoretical guidance and reference can be provided for reasonable layout of the camera under the situation that the camera is not calibrated, and the layout optimization method has the characteristics of good optimization effect and strong applicability.

Description

The layout optimization method of video camera in two CCD camera measure system
Technical field
The invention belongs to Computer Vision Detection and image detection field, particularly for obtaining the layout optimization method of the two CCD camera measure system video camera of large forgings dimensional parameters.
Background technology
Binocular vision is measured as a kind of real-time, non-contact measurement method that measuring accuracy is high, be widely used in the numerous areas such as industrial detection, target identification, especially in measuring in real time large forgings forging and stamping process, aspect hot physical dimension, there is incomparable advantage.Many scholars have carried out a large amount of research around how obtaining high-precision measurement result, yet these research work mainly concentrate on and improve the stated accuracy of camera system and the matching precision of unique point, often ignored the impact of the structural parameters of measuring system on measuring accuracy, and structural parameters have not only been determined the size of apparent field, and determining the measuring accuracy of diverse location in apparent field.While utilizing two CCD camera measure system to measure, target to be measured must be in apparent field.Therefore, analytical structure parameter during on the affecting of measuring error, does not consider that the research of carrying out under apparent field's constraint all has one-sidedness.In actual measurement process, once after system calibrating, it is relatively fixing that system just must keep, the structural parameters of system all can not change, so before starting to demarcate, be necessary system structure parameter to be optimized.By the installation position of reasonable Arrangement video camera, improve the measuring accuracy of two CCD camera measure system.
Existing Camera composition optimization method draws general conclusion by investigating one by one single structure parameter to the impact of measuring accuracy mostly, fail each structural parameters to consider to obtain optimum structural parameters combination, or utilize first order optimization method etc. to carry out video camera and optimize distribution, but be easily absorbed in local minimum point.In fact, current most of optimization method all belongs to local optimal searching category, and its effect of optimization depends on choosing of initial value to a great extent, and genetic algorithm is a kind of heuristic random searching algorithm, has efficient global optimizing ability.In addition the picture point that, seldom has focus of attention to produce by sampling is extracted the impact of deviation on final measuring error.
Summary of the invention
Technical matters to be solved by this invention is to overcome the deficiencies in the prior art, for lack effective Camera composition optimization method at forging scene, and not by the problems such as each structural parameters of system consider, the layout optimization method of inventing video camera in a kind of two CCD camera measure system based on genetic algorithm.In two CCD camera measure system, consider that the picture point that image sampling causes extracts deviation, the present invention has set up by picture point and has extracted measuring error that deviation causes and the numerical relationship model between focal length of camera, parallax range and three structural parameters of video camera deflection angle.Distance between the Liang Tai video camera centre of perspectivity, is parallax range; The angle of two camera optical axis and Z axis, is video camera deflection angle.Considering under the constraints such as apparent field, the layout optimization problem of two CCD camera measure system is converted to the single goal optimization problem of belt restraining, and use genetic algorithm to carry out global optimizing, obtained the measuring system structural parameters of one group of optimum, made the measuring error being caused by picture point extraction deviation reach minimum.
The technical scheme that the present invention takes is the layout optimization method of video camera in a kind of two CCD camera measure system, it is characterized in that, in two CCD camera measure system, image sampling can cause picture point extraction deviation, the measuring error that foundation is caused by picture point extraction deviation and focal length of camera f, parallax range D, video camera deflection angle
Figure BDA0000401704140000021
the numerical relationship model of three structural parameters, i.e. Camera composition optimized mathematical model, and utilize genetic algorithm to obtain optimum structural parameters combination.Concrete steps are as follows:
Step 1: in two CCD camera measure system, set up two Camera composition optimized mathematical models.
As shown in Figure 2, left side camera CCD1 and right side video camera CCD2 converge arranged in form with optical axis, the initial point O of world coordinate system OXYZ and the camera coordinate system O of left side camera lx ly lz linitial point O loverlap.If the coordinate of a certain object point P in world coordinate system OXYZ is (X w, Y w, Z w), at the camera coordinate system O of left side camera lx ly lz lcamera coordinate system O with right side video camera rx ry rz runder coordinate be respectively (X l, Y l, Z l), (X r, Y r, Z r), in left and right side video camera CCD1, CCD2 image planes, the image physical coordinates of picture point is respectively (x l, y l) and (x r, y r).
Object point P is at the camera coordinate system O of left and right side video camera lx ly lz l, O rx ry rz runder coordinate and the image physical coordinates of picture point there is following relation:
x l = f X l Z l y l = f Y l Z l x r = f X r Z r y r = f Y r Z r - - - ( 1 )
Object point P is at the camera coordinate system O of left and right side video camera lx ly lz l, O rx ry rz runder coordinate and its coordinate under world coordinate system OXYZ there is following relation:
Figure BDA0000401704140000032
By formula (3) and formula (2) substitution formula (1), obtain the coordinate of object point P under world coordinate system OXYZ and the following relation of image physical coordinates existence of picture point:
Figure BDA0000401704140000041
Simultaneous formula (1)~formula (5), obtains the coordinate (X of object point P under world coordinate system OXYZ w, Y w, Z w) as follows:
Wherein, establish the expression formula of Ψ as follows:
Consider that sampling causes the situation of maximum picture point deviation, suppose that Pixel Dimensions is δ, the actual left and right video camera obtaining as the extraction deviation existing between the picture point in plane and picture point is ideally:
ε l=ε r=±0.5δ (10)
The left and right video camera that actual extracting obtains is respectively as the picture point physical coordinates in plane
Figure BDA0000401704140000047
Figure BDA0000401704140000048
, itself and picture point physical coordinates (x ideally l, y l), (x r, y r) pass be:
Figure BDA0000401704140000044
The picture point physical coordinates being obtained by actual extracting obtains the coordinate of object point P under world coordinate system OXYZ
Figure BDA0000401704140000045
as follows:
Wherein, establish
Figure BDA0000401704140000058
expression formula as follows:
Setting up picture point extracts measuring error Q and the mathematical relation between structural parameters that deviation causes and is:
Figure BDA0000401704140000053
The measurement space that is used for obtaining forging ' s block dimension is as shown in the profile line region of Fig. 2, it is of a size of L * W * H, and L represents the size of length direction (X-direction), and W represents the size of Width (Z-direction), H represents the size of short transverse (Y-direction), Y-axis forward be vertical paper inwards.
In XOZ plane, the angle theta of the left and right visual field border line of camera optical axis and video camera is:
θ = arctan ( γ 2 f ) - - - ( 17 )
Wherein, γ is effective image planes size.
The front depth of field Δ L1 of video camera is:
ΔL 1 = F · CoC · d 2 f 2 + F · CoC · d - - - ( 18 )
The rear depth of field Δ L2 of video camera is:
ΔL 2 = F · CoC · d 2 f 2 - F · CoC · d - - - ( 19 )
The depth of field Δ L of video camera is:
ΔL = ΔL 1 + ΔL 2 = 2 f 2 · F · CoC · d 2 f 4 - F 2 · CoC 2 · d 2 - - - ( 20 )
Wherein, F is f-number, d=|O la|=|O rb| be focusing from, CoC, for allowing blur circle diameter, calculates by following formula:
CoC=a/1730 (21)
Wherein, the catercorner length that a is effective image planes.
In XOZ coordinate system, build the equation of each place, border straight line, the form of straight-line equation is z=k 0x+b, wherein k 0for the slope of straight line, the intercept that b is straight line.
The equation of video camera CCD2 depth of field inner boundary l1 place, right side straight line is:
Figure BDA0000401704140000061
The equation of video camera CCD2 depth of field outer boundary l2 place, right side straight line is:
Figure BDA0000401704140000062
The equation of left side camera CCD1 depth of field inner boundary l3 place straight line is:
Figure BDA0000401704140000063
The equation of left side camera CCD1 depth of field outer boundary l4 place straight line is:
Figure BDA0000401704140000064
The equation of left margin l5 place, video camera CCD2 visual field, right side straight line is:
Figure BDA0000401704140000065
The equation of left margin l6 place, left side camera CCD1 visual field straight line is:
The equation of right margin l7 place, video camera CCD2 visual field, right side straight line is:
Figure BDA0000401704140000067
The equation of right margin l8 place, left side camera CCD1 visual field straight line is:
Figure BDA0000401704140000068
On measurement space length direction, the equation of left margin l9 (l9') place straight line is:
x=D/2-L/2 (30)
On measurement space length direction, the equation of right margin l10 place straight line is:
x=D/2+L/2 (31)
The statement of measurement space Width size W is divided into two kinds of situations: | CU|=W, | C'V'|=W.There is W=min{|CU|, | C'V'|}.Wherein,
Figure BDA0000401704140000071
According to the range of size of actual measurement Location of requirement measurement space, the size L>=L of length direction (X-direction) 0, the size W>=W of Width (Z-direction) 0, the size H>=H of short transverse (Y-direction) 0, should meet L=L 0time corresponding measurement space width
Figure BDA0000401704140000075
.Choose and be positioned at apparent field center L 0* W 0* H 0in measurement space, an equally distributed p position is as test point, and the layout situation of test point is as follows: according to be divided into q the test plane being equally spaced along Z-direction direction from the close-by examples to those far off, test interplanar spacing is W 0/ (q-1), each test plane is L 0* H 0,Ge region, region on choose that r is capable, s is listed as uniform test point.
Video camera adopts zoom lens, and the range of adjustment of focal distance f is [f 1, f 2]; The scope of parallax range D is [D 1, D 2]; Video camera depth of field Δ L>=W 0; Distance between reference measure system and forging arranges suitable focusing from d; Video camera deflection angle
Figure BDA0000401704140000072
scope be [0, θ];
The layout optimization problem of this two CCD camera measure system is converted to the single goal optimization problem of following belt restraining:
Figure BDA0000401704140000073
Wherein, ∑ Q is the summation of p test point measuring error.Γ is the mean value of each test point measuring error, and it is objective function to be optimized.
Figure BDA0000401704140000074
for the reference position along two camera field of view laps of Z direction, its value is less than focusing from d.
Step 2: use genetic algorithm to find optimum solution, i.e. optimum structural parameters combination.
For the single goal optimization problem of the belt restraining obtaining in step 1, adopt genetic algorithm to carry out global optimizing.Detailed process is as follows:
(1) algorithm routine is write, and comprises and writes the objective function of optimization problem described in step 1 and the program file of non-linear constrain.
(2) optimized variable is focal distance f, parallax range D and video camera deflection angle
Figure BDA0000401704140000081
the span of each variable is respectively [f 1, f 2], [D 1, D 2] and
Figure BDA0000401704140000082
(3) Population Size is set, crossover probability, variation probability and algorithm end condition.
Population Size is elected PopSize as, and crossover probability is elected p as c, variation probability is elected p as m.The stop criterion of algorithm is: iterations reaches maximum iteration time MaxGen; Or when algorithm, stagnating in the algebraically ConGen of algebraically regulation, the weighted mean variation of fitness function is less than function franchise FunTol.
(4) move the program of genetic algorithm, draw the optimum solution of optimization problem, i.e. optimum structural parameters combination, makes the measuring error in whole measurement space reach minimum.
The invention has the beneficial effects as follows and utilize genetic algorithm to realize the layout optimization design of video camera in two CCD camera measure system, make the measuring error being caused by picture point extraction error reach minimum, in the situation that video camera not being demarcated, the rational deployment that can be video camera provides effective theoretical direction and reference, there is effect of optimization good, the feature such as application is strong.
Accompanying drawing explanation
Fig. 1 is the schematic diagram that analog image is sampled as digital picture.(a) analog image that figure is unique point, (b) figure is corresponding digital picture after unique point sampling, wherein: 1-unique point, 2-boost line, 3-pixel, 4-unique point place pixel.
Fig. 2 is the structural representation of two CCD camera measure system, the distribution schematic diagram that Fig. 3 is test point.Wherein: CCD1-left side camera, CCD2-right side video camera, O lx ly lz lthe camera coordinate system of-left side camera, O l-left side camera the centre of perspectivity, O lz l-left side camera optical axis, | O lthe focusing of A|-left side camera is from, O rx ry rz rthe camera coordinate system of-right side video camera, O rthe video camera centre of perspectivity ,-right side, O rz r-right side camera optical axis, | O rthe video camera focusing of B|-right side is from, OXYZ-world coordinate system, O-world coordinate system initial point, and D-parallax range, f-focal length of camera,
Figure BDA0000401704140000091
-video camera deflection angle, the angle of θ-camera optical axis and camera field of view boundary line, L-measurement space length, W-measurement space width, Z 0-along the reference position of two camera field of view laps of Z direction, the Δ L-video camera depth of field, l1-right side video camera depth of field inner boundary, l2-right side video camera depth of field outer boundary, l3-left side camera depth of field inner boundary, l4-left side camera depth of field outer boundary, l5-right side camera field of view left margin, l6-left side camera visual field left margin, l7-right side camera field of view right margin, l8-left side camera visual field right margin, left margin on l9-measurement space length direction, the intersection point of C-l9 and l2, the intersection point of U-l9 and l3, the intersection point of V-l9 and l5, right margin on l10-measurement space length direction, left margin on measurement space length direction in the another kind of situation of l9'-, the intersection point of C'-l9' and l2, the intersection point of U'-l9' and l3, the intersection point of V'-l9' and l5, P k, (i, j)the test point that in-k test plane, the capable j of i lists.
Embodiment
Below in conjunction with accompanying drawing and technical scheme, further describe the specific embodiment of the present invention.
As shown in Figure 1, after only having analog image (a) sampling of a unique point 1, obtain unique point 1 corresponding digital picture (b), continuous image planes by discrete be many square region, pixel 3.Characteristic point positioning method for Pixel-level precision, can only obtain the positional information of unique point 1 place pixel 4, if think that the position of this pixel is the position of unique point 1, will exist the picture point being caused by image sampling to extract deviation so.The system structure parameter that the present invention considers is the deflection angle of focal length of camera f, parallax range D and video camera
Figure BDA0000401704140000092
the present invention has set up by picture point and has extracted measuring error that deviation causes and the numerical relationship model of said structure parameter, it is Camera composition optimized mathematical model, considering, under apparent field's constraint, to use genetic algorithm to carry out global optimizing, the measuring system structural parameters of one group of optimum have been obtained.Concrete steps are as follows:
Step 1: in two CCD camera measure system, set up two Camera composition optimized mathematical models.
The imaging device that the present invention selects is Princeton MegaPlus II ES4020 type black-white CCD video camera, and its resolution is 2048 * 2048, and Pixel Dimensions is δ=7.4 μ m; Effectively image planes are of a size of 15.2mm * 15.2mm, i.e. γ=15.2mm, catercorner length for adapting to different visual field demands, two video cameras are all furnished with Tamron Di-II LD zoom lens, and the range of adjustment of its focal distance f is [f 1, f 2]=[18,250], unit is mm.The range of adjustment of the f-number F of this camera lens is [3.5,6.3], and for making logical light quantity large as far as possible, to obtain image clearly, lens aperture value F selects 3.5.The parameters of supposing two video cameras is identical.
The derivation of aforesaid formula (1)~formula (9) is to be all based upon on the basis that meets perspective projection relation ideally, and object point is in space continuous distribution.Yet, the continuous object point in space is sampled as picture point discrete in digital camera image planes, cause and exist picture point to extract deviation, consider to cause in sampling process the situation of maximum deviation, by formula (10), try to achieve and between picture point in the actual left and right picture plane of obtaining and picture point ideally, have extraction deviation:
ε l=ε r=±3.7μm
By formula (21), calculate and allow blur circle diameter CoC to be:
CoC = a / 1730 = 15.2 2 / 1730 mm = 0.0124 mm
While utilizing binocular vision system to measure, target to be measured must refer to the overlapped fov in two video camera field depths in apparent field Nei, apparent field, as shown in the shadow region in Fig. 2.The measurement space that is used for obtaining forging ' s block dimension is as shown in the profile line region of Fig. 2.According to practical measurement requirement, require measurement space to meet: L 0=3000mm, W 0=3000mm, H 0=3000mm, i.e. the size L>=3000mm of length direction (X-direction), the size W>=1000mm of Width (Z-direction), the size H>=3000mm of short transverse (Y-direction).
The measuring error of two CCD camera measure system is inhomogeneous in the distribution of measurement space, for without loss of generality, choose and be positioned at equally distributed 180 location points of apparent field center 3000mm * 1000mm * 3000mm measurement space (the shade rectangular parallelepiped region shown in Fig. 3) as test point, be i.e. p=180.Test point is numbered according to following rule: according to be divided into 5 tests plane, i.e. q=5 that are equally spaced along Z-direction direction from the close-by examples to those far off.Interplanar spacing is 1000/4=250mm, and each test plane is chosen the uniform test point of 6 row * 6 row on the ,Ge region, region that is 3000mm * 3000mm, i.e. r=6, s=6.Test point coding rule in each test plane is consistent with the pixel coordinate coding of image, and the upper left corner is coordinate origin, and (i, j) represents the test point that the capable j of i lists, and the sequence number of row increases progressively from top to bottom, and the sequence number of row increases progressively from left to right, uses P k, (i, j)represent the test point that k the capable j of i in test plane lists.Therefore, can obtain the value of all test points each coordinate components in the ideal coordinates under world coordinate system, X wvalue have: { D/2-1500, D/2-900, D/2-300, D/2+300, D/2+900, D/2+1500}, Y wvalue have: 1500 ,-900 ,-300,300,900,1500}, Z wvalue according to intersection point C (C'), U (U') and V (V') relatively video camera focusing from the position at d place, [ 1000 ( Z C - d ′ ) Z C - Z U + d ′ , d ′ - 1000 ( d ′ - Z U ) Z C - Z U ] In scope, evenly choose 5 be worth and be spaced apart 250mm or [ 1000 ( Z C - d ′ ) Z C - Z V + d ′ , d ′ - 1000 ( d ′ - Z V ) Z C - Z V ] In scope, evenly choose 5 and be worth and be spaced apart 250mm.The expression formula of wherein, establishing d' is:
Figure BDA0000401704140000113
Under XOZ coordinate system, solve the Z-direction coordinate of intersection point C (C'), U (U') and V (V'):
The Z-direction coordinate of C (C') point is:
The Z-direction coordinate of U (U') point is:
The Z-direction coordinate of V (V') point is:
Figure BDA0000401704140000116
According to forging on-site actual situations, consideration equipment install and avoid equipment because of some constraint conditions that obtain other compared with the factor such as near and overheated apart from hot large forgings as follows: the statement of the size W of measurement space Width is divided into two kinds of situations, a kind of situation is that the distance between C and U equals W, | CU|=W, another kind of situation is when on measurement space length direction, left margin l9' is near apparent field's right side edge, distance between C' and V' equals W, , there is W=min{|CU|, | C'V'|}.During measurement space lengthwise dimension L=3000mm, corresponding measurement space Width size W l=3000=min{|CU| l=3000, | C'V'| l=3000and W l=3000>=W 0therefore, have | CU| l=3000>=1000 and | C'V'| l=3000>=1000.Consider the compactedness requirement of two CCD camera measure system, in conjunction with the restriction of video camera self size and erecting bed size, parallax range D span is [D 1, D 2]=[100,2000], unit is mm.Because measurement space is arranged in the overlapped fov of two video camera field depths, therefore, video camera depth of field Δ L must be greater than the width W of measurement space 0, have Δ L>=1000mm.For avoiding high temperature to cause damage to measuring equipment, measuring system is at least d apart from anvil block center under forge press 1=8000mm is far away, with reference to d 1choose video camera focusing from d=8000mm.For making full use of apparent field, video camera deflection angle
Figure BDA0000401704140000121
scope is [0, θ].By formula (17), in conjunction with focal range [f 1, f 2] and the span that effectively image planes size γ calculates θ be [1.74 °, 22.89 °].
In sum, the layout optimization problem of this two CCD camera measure system is converted to the single goal optimization problem of following belt restraining:
Wherein, Q k, (i, j)be the measuring error that k the capable j of i in test plane lists test point, Z 0for along the overlapping reference position of Z direction two camera field of view, should there is Z 0< 8000mm.
Step 2: use genetic algorithm to find optimum solution, i.e. optimum structural parameters combination.
For the single goal optimization problem of the belt restraining obtaining in step 1, adopt genetic algorithm to carry out global optimizing.From initial population, use genetic operator, select operator, crossover operator and mutation operator to produce population of future generation, so make population evolve towards the direction of optimization solution, until meet the end condition of setting.Detailed process is as follows:
(1) algorithm routine is write, and comprises and writes the objective function of optimization problem described in step 1 and the program file of non-linear constrain.
(2) optimized variable is focal distance f, parallax range D and video camera deflection angle
Figure BDA0000401704140000131
each variable-value scope is respectively [18,250], [100,2000] and [0,22.89], and unit is respectively millimeter, millimeter and degree.
(3) Population Size is set, crossover probability, variation probability and algorithm end condition
Algorithm parameter is set as PopSize=500, p c=0.78, p m=0.008, MaxGen=2000, ConGen=500, FunTol=10 -12, that is: Population Size elects 500 as, and crossover probability elects 0.78 as, and variation probability elects 0.008 as.The stop criterion of algorithm is: iterations reaches maximum iteration time 2000; Or when algorithm, stagnating in the algebraically 500 of algebraically regulation, the weighted mean variation of fitness function is less than function franchise 10 -12.
(4) call genetic algorithm master routine, draw the optimum solution of optimization problem, i.e. optimum structural parameters combination, makes the measuring error in whole measurement space reach minimum.
In step 1, the optimum solution of optimization problem is focal length of camera f=42.552mm, parallax range D=2000mm, video camera deflection angle
Figure BDA0000401704140000132
target function value converges to minimum value 5.834mm.Above-mentioned experiment is carried out on the computing machine of 1.99GB internal memory, 2.09GHz processor, and average consuming time is 2.8h.
In two CCD camera measure system, image sampling can cause picture point extraction deviation, the present invention extracts measuring error that deviation causes and the mathematical relation between structural parameters by setting up picture point, consider measurement space, equipment install and avoid equipment because of apart from large forgings radiation compared with the factor such as near and overheated, for video camera and the fixed two CCD camera measure system of camera lens, adopt genetic algorithm to carry out the layout optimization design of video camera, rely on the efficient global optimizing ability of genetic algorithm can obtain the structural parameters combination of global optimum.

Claims (1)

1. the layout optimization method of video camera in a two CCD camera measure system, it is characterized in that, in two CCD camera measure system, consider the picture point extraction deviation that image sampling causes, the numerical relationship model of the measuring error that foundation is caused by picture point extraction deviation and focal length of camera, parallax range, three structural parameters of video camera deflection angle, be Camera composition optimized mathematical model, and utilize genetic algorithm to obtain optimum structural parameters combination; Concrete steps are as follows:
Step 1: in two CCD camera measure system, set up two Camera composition optimized mathematical models;
Left side camera CCD1 and right side video camera CCD2 converge arranged in form with optical axis, the initial point O of world coordinate system OXYZ and the camera coordinate system O of left side camera lx ly lz linitial point O loverlap; If the coordinate of a certain object point P in world coordinate system OXYZ is (X w, Y w, Z w), at the camera coordinate system O of left side camera lx ly lz lcamera coordinate system O with right side video camera rx ry rz runder coordinate be respectively (X l, Y l, Z l), (X r, Y r, Z r), in left and right side video camera CCD1, CCD2 image planes, the image physical coordinates of picture point is respectively (x l, y l) and (x r, y r);
Object point P is at the camera coordinate system O of left and right side video camera lx ly lz l, O rx ry rz runder coordinate and the image physical coordinates of its picture point there is following relation:
x l = f X l Z l y l = f Y l Z l x r = f X r Z r y r = f Y r Z r - - - ( 1 )
Object point P is at the camera coordinate system O of left and right side video camera lx ly lz l, O rx ry rz runder coordinate and its coordinate under world coordinate system OXYZ there is following relation:
Figure FDA0000401704130000021
By formula (3) and formula (2) substitution formula (1), obtain the coordinate of object point P under world coordinate system OXYZ and the following relation of image physical coordinates existence of picture point:
Figure FDA0000401704130000022
Simultaneous formula (1)~formula (5), obtains the coordinate (X of object point P under world coordinate system OXYZ w, Y w, Z w) as follows:
Figure FDA0000401704130000023
Wherein, establish the expression formula of Ψ as follows:
Consider that sampling causes the situation of maximum picture point deviation, suppose that Pixel Dimensions is δ, the actual left and right video camera obtaining as the extraction deviation existing between the picture point in plane and picture point is ideally:
ε l=ε r=±0.5δ (10)
The left and right video camera that actual extracting obtains is respectively as the picture point physical coordinates in plane
Figure FDA0000401704130000038
, itself and picture point physical coordinates (x ideally l, y l), (x r, y r) pass be:
The picture point physical coordinates being obtained by actual extracting obtains the coordinate of object point P under world coordinate system OXYZ
Figure FDA0000401704130000032
as follows:
Wherein, establish
Figure FDA0000401704130000039
expression formula as follows:
Figure FDA0000401704130000034
Setting up picture point extracts measuring error Q and the mathematical relation between structural parameters that deviation causes and is:
For the measurement space that obtains forging ' s block dimension, be of a size of L * W * H, L represents the size of length direction (X-direction), and W represents the size of Width (Z-direction), and H represents the size of short transverse (Y-direction), Y-axis forward be vertical paper inwards;
In XOZ plane, the angle theta of the left and right visual field border line of camera optical axis and video camera is:
&theta; = arctan ( &gamma; 2 f ) - - - ( 17 )
Wherein, γ is effective image planes size;
The front depth of field Δ L1 of video camera is:
&Delta;L 1 = F &CenterDot; CoC &CenterDot; d 2 f 2 + F &CenterDot; CoC &CenterDot; d - - - ( 18 )
The rear depth of field Δ L2 of video camera is:
&Delta;L 2 = F &CenterDot; CoC &CenterDot; d 2 f 2 - F &CenterDot; CoC &CenterDot; d - - - ( 19 )
The depth of field Δ L of video camera is:
&Delta;L = &Delta;L 1 + &Delta;L 2 = 2 f 2 &CenterDot; F &CenterDot; CoC &CenterDot; d 2 f 4 - F 2 &CenterDot; CoC 2 &CenterDot; d 2 - - - ( 20 )
Wherein, F is f-number, d=|O la|=|O rb| be focusing from, CoC, for allowing blur circle diameter, calculates by following formula:
CoC=a/1730 (21)
Wherein, the catercorner length that a is effective image planes;
In XOZ coordinate system, build the equation of each place, border straight line, the form of straight-line equation is z=k 0x+b, wherein k 0for the slope of straight line, the intercept that b is straight line;
The equation of video camera CCD2 depth of field inner boundary l1 place, right side straight line is:
The equation of video camera CCD2 depth of field outer boundary l2 place, right side straight line is:
Figure FDA0000401704130000045
The equation of left side camera CCD1 depth of field inner boundary l3 place straight line is:
Figure FDA0000401704130000046
The equation of left side camera CCD1 depth of field outer boundary l4 place straight line is:
Figure FDA0000401704130000047
The equation of left margin l5 place, video camera CCD2 visual field, right side straight line is:
The equation of left margin l6 place, left side camera CCD1 visual field straight line is:
Figure FDA0000401704130000051
The equation of right margin l7 place, video camera CCD2 visual field, right side straight line is:
Figure FDA0000401704130000052
The equation of right margin l8 place, left side camera CCD1 visual field straight line is:
Figure FDA0000401704130000053
On measurement space length direction, the equation of left margin l9 (l9') place straight line is:
x=D/2-L/2 (30)
On measurement space length direction, the equation of right margin l10 place straight line is:
x=D/2+L/2 (31)
The statement of measurement space Width size W is divided into two kinds of situations: | CU|=W or | C'V'|=W, have W=min{|CU|, | C'V'|}; Wherein,
Figure FDA0000401704130000054
According to the range of size of actual measurement Location of requirement measurement space, the size L>=L of length direction (X-direction) 0, the size W>=W of Width (Z-direction) 0, the size H>=H of short transverse (Y-direction) 0, should meet L=L 0time corresponding measurement space width W l=L0>=W 0; Choose and be positioned at apparent field center L 0* W 0* H 0in measurement space, an equally distributed p position is as test point, and the layout situation of test point is as follows: according to be divided into q the test plane being equally spaced along Z-direction direction from the close-by examples to those far off, test interplanar spacing is W 0/ (q-1), each test plane is L 0* H 0,Ge region, region on choose that r is capable, s is listed as uniform test point;
Video camera adopts zoom lens, and the range of adjustment of focal distance f is [f 1, f 2]; The scope of parallax range D is [D 1, D 2]; Video camera depth of field Δ L>=W 0; Distance between reference measure system and forging arranges suitable focusing from d; Video camera deflection angle
Figure FDA0000401704130000055
scope be [0, θ];
The layout optimization problem of this two CCD camera measure system is converted to the single goal optimization problem of following belt restraining:
Wherein, ∑ Q is the summation of p test point measuring error; Γ is the mean value of each test point measuring error, and it is objective function to be optimized; for the reference position along two camera field of view laps of Z direction, its value is less than focusing from d;
Step 2: use genetic algorithm to find optimum solution, i.e. optimum structural parameters combination;
For the single goal optimization problem of the belt restraining obtaining in step 1, adopt genetic algorithm to carry out global optimizing; Detailed process is as follows:
(1) algorithm routine is write, and comprises and writes the objective function of optimization problem described in step 1 and the program file of non-linear constrain;
(2) optimized variable is focal distance f, parallax range D and video camera deflection angle
Figure FDA0000401704130000063
the span of each variable is respectively [f 1, f 2], [D 1, D 2] and
Figure FDA0000401704130000064
(3) Population Size is set, crossover probability, variation probability and algorithm end condition;
Population Size is elected PopSize as, and crossover probability is elected p as c, variation probability is elected p as m; The stop criterion of algorithm is: iterations reaches maximum iteration time MaxGen; Or when algorithm, stagnating in the algebraically ConGen of algebraically regulation, the weighted mean variation of fitness function is less than function franchise FunTol;
(4) move the program of genetic algorithm, draw the optimum solution of optimization problem, i.e. optimum structural parameters combination, makes the measuring error in whole measurement space reach minimum.
CN201310508264.3A 2013-10-25 2013-10-25 The layout optimization method of video camera in two CCD camera measure system Active CN103630072B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310508264.3A CN103630072B (en) 2013-10-25 2013-10-25 The layout optimization method of video camera in two CCD camera measure system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310508264.3A CN103630072B (en) 2013-10-25 2013-10-25 The layout optimization method of video camera in two CCD camera measure system

Publications (2)

Publication Number Publication Date
CN103630072A true CN103630072A (en) 2014-03-12
CN103630072B CN103630072B (en) 2016-01-13

Family

ID=50211363

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310508264.3A Active CN103630072B (en) 2013-10-25 2013-10-25 The layout optimization method of video camera in two CCD camera measure system

Country Status (1)

Country Link
CN (1) CN103630072B (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430266A (en) * 2015-11-30 2016-03-23 努比亚技术有限公司 Image processing method based on multi-scale transform and terminal
CN107066747A (en) * 2017-04-24 2017-08-18 哈尔滨理工大学 A kind of vision measurement network organizing planing method
CN107443369A (en) * 2017-06-25 2017-12-08 重庆市计量质量检测研究院 A kind of robotic arm of the inverse identification of view-based access control model measurement model is without demarcation method of servo-controlling
CN107483820A (en) * 2017-08-23 2017-12-15 福建星瑞格软件有限公司 A kind of quick focus method and device of the focusing of contrast formula
CN108562265A (en) * 2018-03-12 2018-09-21 内蒙古大学 A kind of measurement range method of estimation of binocular stereo vision range unit
CN109003307A (en) * 2018-06-11 2018-12-14 西北工业大学 Fishing mesh sizing method based on underwater Binocular vision photogrammetry
CN109084688A (en) * 2018-09-20 2018-12-25 杭州电子科技大学 A kind of binocular distance measurement method based on varifocal camera
CN109102548A (en) * 2018-08-23 2018-12-28 武汉中观自动化科技有限公司 It is a kind of for identifying the method and system of following range
CN110342252A (en) * 2019-07-01 2019-10-18 芜湖启迪睿视信息技术有限公司 A kind of article automatically grabs method and automatic grabbing device
CN110851978A (en) * 2019-11-08 2020-02-28 江苏科技大学 Camera position optimization method based on visibility
CN111460735A (en) * 2020-04-08 2020-07-28 深圳市瑞立视多媒体科技有限公司 Genetic-inheritance-based camera layout function optimization method and related equipment
CN112254672A (en) * 2020-10-15 2021-01-22 天目爱视(北京)科技有限公司 Height-adjustable's intelligent 3D information acquisition equipment
CN112556639A (en) * 2020-11-06 2021-03-26 广州艾目易科技有限公司 Device and method for testing actual effective field range of binocular vision system
CN113240829A (en) * 2021-02-24 2021-08-10 南京工程学院 Intelligent gate passing detection method based on machine vision
CN113532473A (en) * 2021-06-17 2021-10-22 浙江工业大学 Camera measurement error suppression method by arranging near-field fixed points
CN114329855A (en) * 2020-11-06 2022-04-12 北京航空航天大学 Sensor layout optimization and rapid deployment method of wireless visual sensing network
CN114329854A (en) * 2020-11-06 2022-04-12 北京航空航天大学 Two-dimensional space vision sensor layout optimization method based on multi-objective constraint
CN114724323A (en) * 2022-06-09 2022-07-08 北京科技大学 Point distribution method of portable intelligent electronic fence for fire scene protection
CN115529437A (en) * 2021-06-25 2022-12-27 青岛海信智慧生活科技股份有限公司 Method, device, equipment and medium for determining monitoring equipment arrangement information

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000056056A2 (en) * 1999-03-18 2000-09-21 Showbites, Inc. Method for optimization of video coverage
CN101251925A (en) * 2007-12-29 2008-08-27 中国科学院计算技术研究所 Virtual video camera planning and distributing method and system
CN103247053A (en) * 2013-05-16 2013-08-14 大连理工大学 Accurate part positioning method based on binocular microscopy stereo vision
CN104349134A (en) * 2013-08-07 2015-02-11 安讯士有限公司 Method and system for selecting position and orientation for a monitoring camera

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000056056A2 (en) * 1999-03-18 2000-09-21 Showbites, Inc. Method for optimization of video coverage
CN101251925A (en) * 2007-12-29 2008-08-27 中国科学院计算技术研究所 Virtual video camera planning and distributing method and system
CN103247053A (en) * 2013-05-16 2013-08-14 大连理工大学 Accurate part positioning method based on binocular microscopy stereo vision
CN104349134A (en) * 2013-08-07 2015-02-11 安讯士有限公司 Method and system for selecting position and orientation for a monitoring camera

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈杰春 等: "立体视觉测量中的摄像机优化布局", 《机床与液压》 *

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430266A (en) * 2015-11-30 2016-03-23 努比亚技术有限公司 Image processing method based on multi-scale transform and terminal
CN107066747A (en) * 2017-04-24 2017-08-18 哈尔滨理工大学 A kind of vision measurement network organizing planing method
CN107443369A (en) * 2017-06-25 2017-12-08 重庆市计量质量检测研究院 A kind of robotic arm of the inverse identification of view-based access control model measurement model is without demarcation method of servo-controlling
CN107483820A (en) * 2017-08-23 2017-12-15 福建星瑞格软件有限公司 A kind of quick focus method and device of the focusing of contrast formula
CN108562265B (en) * 2018-03-12 2021-01-12 内蒙古大学 Measuring range estimation method of binocular stereo vision distance measuring device
CN108562265A (en) * 2018-03-12 2018-09-21 内蒙古大学 A kind of measurement range method of estimation of binocular stereo vision range unit
CN109003307A (en) * 2018-06-11 2018-12-14 西北工业大学 Fishing mesh sizing method based on underwater Binocular vision photogrammetry
CN109003307B (en) * 2018-06-11 2021-10-22 西北工业大学 Underwater binocular vision measurement-based fishing mesh size design method
CN109102548A (en) * 2018-08-23 2018-12-28 武汉中观自动化科技有限公司 It is a kind of for identifying the method and system of following range
CN109084688B (en) * 2018-09-20 2020-09-29 杭州电子科技大学 Binocular vision distance measurement method based on variable-focus camera
CN109084688A (en) * 2018-09-20 2018-12-25 杭州电子科技大学 A kind of binocular distance measurement method based on varifocal camera
CN110342252A (en) * 2019-07-01 2019-10-18 芜湖启迪睿视信息技术有限公司 A kind of article automatically grabs method and automatic grabbing device
CN110342252B (en) * 2019-07-01 2024-06-04 河南启迪睿视智能科技有限公司 Automatic article grabbing method and automatic grabbing device
CN110851978A (en) * 2019-11-08 2020-02-28 江苏科技大学 Camera position optimization method based on visibility
CN110851978B (en) * 2019-11-08 2024-03-19 江苏科技大学 Camera position optimization method based on visibility
CN111460735A (en) * 2020-04-08 2020-07-28 深圳市瑞立视多媒体科技有限公司 Genetic-inheritance-based camera layout function optimization method and related equipment
CN111460735B (en) * 2020-04-08 2023-09-01 深圳市瑞立视多媒体科技有限公司 Camera layout function optimization method based on genetic inheritance and related equipment
CN112254672A (en) * 2020-10-15 2021-01-22 天目爱视(北京)科技有限公司 Height-adjustable's intelligent 3D information acquisition equipment
CN112556639A (en) * 2020-11-06 2021-03-26 广州艾目易科技有限公司 Device and method for testing actual effective field range of binocular vision system
CN114329854A (en) * 2020-11-06 2022-04-12 北京航空航天大学 Two-dimensional space vision sensor layout optimization method based on multi-objective constraint
CN114329854B (en) * 2020-11-06 2023-05-12 北京航空航天大学 Two-dimensional space vision sensor layout optimization method based on multi-target constraint
CN114329855B (en) * 2020-11-06 2023-05-12 北京航空航天大学 Sensor layout optimization and rapid deployment method of wireless vision sensing network
CN114329855A (en) * 2020-11-06 2022-04-12 北京航空航天大学 Sensor layout optimization and rapid deployment method of wireless visual sensing network
CN113240829A (en) * 2021-02-24 2021-08-10 南京工程学院 Intelligent gate passing detection method based on machine vision
CN113532473A (en) * 2021-06-17 2021-10-22 浙江工业大学 Camera measurement error suppression method by arranging near-field fixed points
CN113532473B (en) * 2021-06-17 2024-04-19 浙江工业大学 Image pickup measurement error suppression method by arranging near-field stationary points
CN115529437A (en) * 2021-06-25 2022-12-27 青岛海信智慧生活科技股份有限公司 Method, device, equipment and medium for determining monitoring equipment arrangement information
CN114724323A (en) * 2022-06-09 2022-07-08 北京科技大学 Point distribution method of portable intelligent electronic fence for fire scene protection
CN114724323B (en) * 2022-06-09 2022-09-02 北京科技大学 Point distribution method of portable intelligent electronic fence for fire scene protection

Also Published As

Publication number Publication date
CN103630072B (en) 2016-01-13

Similar Documents

Publication Publication Date Title
CN103630072B (en) The layout optimization method of video camera in two CCD camera measure system
CN103714535B (en) Binocular vision measurement system camera parameter online adjustment method
CN101814185B (en) Line structured light vision sensor calibration method for micro-size measurement
CN104331896A (en) System calibration method based on depth information
CN104408689A (en) Holographic-image-based streetscape image fragment optimization method
CN102930544A (en) Parameter calibration system of vehicle-mounted camera
Zhu et al. Camera calibration method based on optimal polarization angle
JP2006053890A (en) Obstacle detection apparatus and method therefor
CN103292695A (en) Monocular stereoscopic vision measuring method
CN106780388A (en) A kind of line-scan digital camera optical distortion antidote
CN102663767A (en) Method for calibrating and optimizing camera parameters of vision measuring system
CN103676976B (en) The bearing calibration of three-dimensional working platform resetting error
CN103727927A (en) High-velocity motion object pose vision measurement method based on structured light
CN103632364A (en) Camera spatial position relation calibration device in multi-camera photographing measurement system
CN104574332A (en) Image fusion method for airborne optoelectronic pod
CN102221331A (en) Measuring method based on asymmetric binocular stereovision technology
CN104457719A (en) Posture measurement device and measurement method of rectangular shield construction
CN103308000B (en) Based on the curve object measuring method of binocular vision
WO2015098222A1 (en) Information processing device, information processing method, and program
CN106570906A (en) Rectangular pattern-based method for detecting distances under camera angle deflection condition
CN107560549A (en) A kind of laser vision two-dimension displacement measuring system practicality calibration technique scheme
CN108088381A (en) A kind of contactless minim gap method for measuring width based on image procossing
CN103913149A (en) Binocular range finding system based on STM 32 single chip microcomputer and range finding method thereof
CN112017248A (en) 2D laser radar camera multi-frame single-step calibration method based on dotted line characteristics
CN102663727A (en) Method for calibrating parameters by dividing regions in a camera based on CMM moving target

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant