CN102012217B  Method for measuring threedimensional geometrical outline of largesize appearance object based on binocular vision  Google Patents
Method for measuring threedimensional geometrical outline of largesize appearance object based on binocular vision Download PDFInfo
 Publication number
 CN102012217B CN102012217B CN2010105115022A CN201010511502A CN102012217B CN 102012217 B CN102012217 B CN 102012217B CN 2010105115022 A CN2010105115022 A CN 2010105115022A CN 201010511502 A CN201010511502 A CN 201010511502A CN 102012217 B CN102012217 B CN 102012217B
 Authority
 CN
 China
 Prior art keywords
 plane
 laser
 delineation
 rail
 polar curve
 Prior art date
Links
 230000000875 corresponding Effects 0.000 claims description 14
 230000003287 optical Effects 0.000 claims description 13
 230000001808 coupling Effects 0.000 claims description 9
 238000010168 coupling process Methods 0.000 claims description 9
 238000005859 coupling reactions Methods 0.000 claims description 9
 238000000034 methods Methods 0.000 claims description 4
 238000003384 imaging method Methods 0.000 claims description 3
 230000001678 irradiating Effects 0.000 abstract 1
 239000011159 matrix materials Substances 0.000 description 11
 238000010586 diagrams Methods 0.000 description 3
 280000012370 Confidential companies 0.000 description 2
 230000000694 effects Effects 0.000 description 2
 238000005516 engineering processes Methods 0.000 description 2
 230000003071 parasitic Effects 0.000 description 2
 241000271571 Dromaius novaehollandiae Species 0.000 description 1
 230000002950 deficient Effects 0.000 description 1
 238000001514 detection method Methods 0.000 description 1
 238000003379 elimination reactions Methods 0.000 description 1
 239000000284 extracts Substances 0.000 description 1
 238000005286 illumination Methods 0.000 description 1
 238000009434 installation Methods 0.000 description 1
 238000003754 machining Methods 0.000 description 1
 238000000691 measurement method Methods 0.000 description 1
Abstract
Description
Technical field
The present invention is a kind of based on the threedimensional structure optical measurement techniques, and is contactless especially fast in the rail object detection method that transfinites, and belongs to the computer vision measurement technical field.
Background technology
In recent years, domestic railway repeatedly raises speed, the particularly operation of EMU, and the travel speed of train is more and more faster, and this also has higher requirement to the safety of railway.When train when particularly goods train surpasses the space constraint of cruising, promptly being called transfinites, and might cause serious security incident this moment.The measurement of therefore, railway freight train etc. being transfinited at the rail object is extremely important.
Structural light measurement is a kind of contactless measuring threedimensional morphology technology, can be applied in transfiniting of rail object detected.What threedimensional structure photo measure method was in the past used is that monocularcamera adds the method that the laser striation extracts; But this method is not suitable under the outdoor situation that has strong natural light to disturb, using; Simultaneously monocular is measured because the turntable mechanical precision is required than higher, also is easy to generate than mistake when measuring big pattern object.In order under outdoor rugged surroundings, accurately to measure the appearance size of big pattern objects such as train, require lower binocular vision to measure the distinctive advantage of just having given play to mechanical precision.
Inventive problem
The objective of the invention is: the big pattern object dimensional geometric shape measuring method based on binocular vision is provided, especially a kind of in the noncontacting measuring method that transfinites of rail object, be used for measuring automatically appearance size at the rail object.
Technical scheme of the present invention is: based on the big pattern object dimensional geometric shape measuring method of binocular vision; Promptly in the binocular of the rail object measuring method that transfinites; Use realizes that based on the computer vision methods of structural light measurement detailed process is following to the noncontact measurement at rail object dimensional pattern:
Utilize computercontrolled laser illumination on the rail object, the laser image (can be optical strip image or dot pattern picture that vertical laser line generator produces) that is projected on the rail object is carried out the difference shooting simultaneously with left and right sides binocular camera; Through computing machine the laser optical strip image of binocular camera imaging is carried out threedimensional coupling and calculate, obtain the three dimensional space coordinate of all points on the rail object on this laser striation that binocular camera forms images;
Rotate the laser instrument angle and the laser striation can be scanned or cover all tested surfaces when measuring moving object through an interval time, and repeat aforesaid operations, thereby obtain the threedimensional space model and the parameter of whole tested surface; At rail object dimensional pattern and track middle vertical plane coordinate, computing machine can be made size automatically and judge and the judgement of transfiniting through contrast;
The computer control laser line generator produces laser radiation on the object tested surface, gathers an image that has the tested surface of laser striation respectively with two cameras; Computer controlled laser is closed irradiation, gathers an image that does not have the tested surface of laser striation respectively with two cameras again, and the picture that each video camera obtains is done difference respectively, obtains the laser optical strip image.
The pixel coordinate of coupling gained is a subpixel, I1 and I2 be about two video cameras look like the plane, C1 and C2 be respectively about the photocentre of two video cameras; P be in the space more arbitrarily, its picture point on left camera review plane is m1, the picture point on right camera plane is m2; According to outer polar curve geometrical constraint; Outer polar curve is the line of line intersection point of intersection point and the C1 and the C2 on P point and said I1 and I2 plane on I1 and the I2 plane; M2 should be positioned at m1 on the outer polar curve lm2 of the right plane of delineation; Same m1 should be positioned at m2 on the outer polar curve lm1 of the left plane of delineation, and they are corresponding point each other each other; By C1; C2, the planar I I that P confirms is outer poleface, the intersection that the outer polar curve lm2 of m1 is the outer poleface II and the right plane of delineation; The intersection that the outer polar curve lm1 of m2 is the outer poleface II and the left plane of delineation; Outer limit e1, e2 are the line of C1 and C2 and the intersection point of the left and right sides plane of delineation, limit e2 outside the outer polar curve of any point in the right plane of delineation all will pass through in the left plane of delineation, and the point on the left plane of delineation still meets this relation; Promptly take up an official post and get 1 m1 at the laser striation of the left plane of delineation; 1 P that laser rays covered on its corresponding object; According to outer polar curve constraint can know the projection of a P in right figure necessarily appear at outside on the polar curve Lm2; And can try to achieve the equation of line Lm2, so just can the searching of twodimentional match point be narrowed down in the one dimension scope; Simultaneously owing to some P also one fixes on the laser light bar in the projection on the right plane of delineation; So get in the right plane of delineation on the laser striation apart from straight line Lm2 nearest two pixel Dl, Dr; Obtain the straightline equation L at these two pixel places; The intersection point m2 of straight line L and Lm2 is exactly the projection of a P on figure I2 so, and the coordinate of m2 has subpixel precision.
Through two influences that have the camera elimination environment parasitic light of optical filter, be adapted at environment and measure than under the condition of severe.
Use the binocular measuring method, can be under the situation less demanding to machining and installation accuracy to train, steamer etc. greatly the pattern object accurately measure.
The invention has the beneficial effects as follows: the present invention has adopted the structural light threedimensional detection technique; And use the coordinate of difference method and subpixel to mate; Can be under outdoor rugged surroundings to carry out at the rail object fast, noncontact, the highprecision detection of transfiniting; Overcome the existing defective that transfinites and measure, greatly improved efficiency of measurement and measuring accuracy.
Description of drawings
Fig. 1 is a monocular structural light measurement model.Among the figure, 1. being crossbeam, 2. is computing machine, 3. is video camera, 6. is the linear structural laser device, 5. is turntable, and angle α, β are respectively the angles between camera optical axis and laser rays and the crossbeam center line.The jig at crossbeam two ends can be with turntable center, camera focus and crossbeam center fixation pointblank.
Fig. 2 is a binocular structural light measurement model.Among the figure, 1. being crossbeam, 2. is computing machine, 3. is video camera 1,4. is video camera 2,5. is turntable, 6. is the linear structural laser device.The jig at crossbeam two ends and center is with the turntable center, and the focus of two cameras and crossbeam center fixation are pointblank.
Fig. 3 is outer polar curve coupling synoptic diagram.As shown in the figure, 1 P must be present in as the subpoint m1 on the plane, m2 on the plane that is made up of two video camera photocentres and some P at two video cameras in the space.
Fig. 4 and Fig. 5 are binocular coupling synoptic diagram, and Fig. 4 is left figure, and Fig. 5 is right figure, and m1 is a bit on the left figure laser striation, and lm2 is the outer polar curve of m1 point correspondence on right figure, and the intersection point m2 of outer polar curve and laser rays is the match point of m1 on right figure.
Fig. 6 is the coordinate coupling synoptic diagram (right figure) of subpixel, Dl and Dr be respectively on the laser striation apart from two nearest pixels of outer polar curve, L is the line at Dl and Dr center, putting m2 is the intersection point between L and the outer polar curve lm2, just the match point that will seek.
Embodiment
Monocular structural light measurement device in the past is as shown in Figure 1, and distance L ab and angle [alpha], β need accurately be known in the position of using triangulation c to order.But because machinery is installed and the restriction of control accuracy, motor rotation angle β also is not easy control, thereby has influenced measuring accuracy.In this case, binocular is measured the distinctive advantage that just embodies.The position and the attitude relative fixed of video camera in binocular is measured, so distance L ab can be considered steady state value, and angle [alpha], β can accurately obtain through image processing algorithm, thereby can accurately measure the appearance size of big pattern object.This measurement mechanism is made up of pedestal, high power line structure laser instrument, two camera, driving circuit and computing machines that optical filter is housed, and is as shown in Figure 2.The camera collection view data calculates object appearance size by computing machine according to the three dimensions matching relationship.
Binocular coupling in the three dimensions left and right sides is as shown in Figure 3, and I1 and I2 are the planes that looks like of two video cameras, C1 and C2 be respectively about the photocentre of two video cameras.P be in the space more arbitrarily, its picture point on left camera review plane is m1, the picture point on right camera plane is m2.According to outer polar curve (line of the line intersection point of the intersection point on P point and said I1 and I2 plane and C1 and C2 on I1 and the I2 plane) geometrical constraint; M2 should be positioned at m1 on the outer polar curve lm2 of the right plane of delineation; Same m1 should be positioned at m2 on the outer polar curve lm1 of the left plane of delineation, and they are corresponding point each other each other.By C1; C2; The planar I I that P confirms is outer poleface; The intersection that the outer polar curve lm2 of m1 is the outer poleface II and the right plane of delineation, the intersection that the outer polar curve lm1 of m2 is the outer poleface II and the left plane of delineation, outer limit e1, e2 are the line of C1 and C2 and the intersection point of the left and right sides plane of delineation (also being the intersection point with outer polar curve lm1, lm2).Perspective relation based on binocular imaging can be known, limit e2 outside the outer polar curve of any point in the right plane of delineation all will pass through in the left plane of delineation, and the point on the left image still meets this relation.The concrete grammar of images match is following:
The homogeneous coordinates of definition space point P are [x, y, z, 1] T, and the homogeneous pixel coordinate of its corresponding point m on the picture plane is [u, v, 1], has
Here, s is a scale factor, and M is the perspective matrix, M=K [R T], and wherein K is video camera confidential reference items matrixes, R, T are respectively rotation matrix and translation vector.
Be without loss of generality, the camera coordinate system of video camera 1,2 is a world coordinate system, and R, T are respectively spatial alternation rotation matrix and the translation vector between video camera 1 and the video camera 2, s _{1}, s _{2}Be scale factor, m _{1}, m _{2}Be perspective matrix, k _{1}, k _{2}For video camera confidential reference items matrix, then have
Can get by following formula cancellation s1, s2
In the formula, [T] _{X}Be antisymmetric matrix, by translation vector T (T _{x}T _{y}T _{z}Be translational component) decision
Order
E＝[T] _{X}R (7)
Then have
Formula (9) is the description of binocular vision China and foreign countries polar curve geometric relationship, wherein I _{M2}=Fm _{1}Be corresponding m _{1}Polar curve, I _{M1}=FT _{M2}Be corresponding m _{2}Polar curve, matrix F is fundamental matrix (Fundamental matrix), it is relevant with the corresponding pose between camera intrinsic parameter, the video camera.Based on demarcating gained fundamental matrix F, the coordinate of corresponding points in two planes of delineation can be mated.
After obtaining the pixel of coupling, calculate, can obtain the threedimensional coordinate of the corresponding contour of object of this striation according to camera interior and exterior parameter.Through scanned laser, can realize measurement at rail external surface of objects threedimensional appearance.Do contrast with the volume coordinate of track middle vertical plane again, computing machine just can be made the judgement of transfiniting automatically.
In experiment, we use laser line generator and the optical filter of center live width as 635nm, 1 meter of base length, and the measured point is 10 meters apart from the polar curve distance, can know that through calculating angle α, β are 87.14 degree, the value of F matrix does
F＝0.000000485008366 0.000038768789204 0.007350632235932
0.000045784962796 0.000001147668094 0.717662770440072
0.017100613104312 0.778959169714406 32.324287848102870
Measuring process is following:
1) linear structural laser is shone the testee surface, obtain an image that comprises the laser striation respectively with two cameras;
2) close laser instrument, obtaining one respectively with two cameras does not again have the laser optical strip image;
3) two images that each camera obtained are done difference processing, can improve the signal to noise ratio (S/N ratio) of image.Because the interference of parasitic light in the external environment can be further eliminated in the effect of optical filter, improve the quality of image simultaneously.
4) utilize computing machine that two laser optical strip images are carried out matching operation, can obtain the threedimensional coordinate of the corresponding contour of object of this laser striation
5) rotate laser instrument angle, repeating step 1) to step 4), can obtain the threedimensional coordinate of the corresponding contour of object of another line laser striation.The continuous sweep laser instrument makes the laser striation can cover the tested surface of full object as far as possible.Line with these tested surfaces splices then, just can obtain the threedimensional appearance size of object.The coordinate and the track middle vertical plane of tested surface are done contrast, can make judgement whether transfiniting at the rail object.
In the 3D view matching operation of step 4), the method that is based on outer polar curve and linestructured light intersection point that this method is used obtains other intersecting point coordinate of subpixel, and concrete grammar is following:
For 1 m1 on the laser striation among Fig. 4, can obtain outer polar curve equation lm2 corresponding in Fig. 5 according to outer polar curve constraint condition, like Fig. 4, shown in 5, so just can the match point of two dimension be selected to narrow down in the one dimension scope.Simultaneously since some m1 on the laser striation, so also should be on the laser striation at the match point on the right figure, so just can be in the hope of arriving the coordinate of match point based on outer polar curve constraint and structured light constraint.In Fig. 6, search out nearest laser striation pixel Dl, the Dr of polar curve outside the distance, connect the straight line of Dl, Dr and the intersection point m2 of outer polar curve and be unique point m1 pairing unique point in right figure, and the coordinate of some m2 has subpixel precision.
Claims (1)
Priority Applications (1)
Application Number  Priority Date  Filing Date  Title 

CN2010105115022A CN102012217B (en)  20101019  20101019  Method for measuring threedimensional geometrical outline of largesize appearance object based on binocular vision 
Applications Claiming Priority (1)
Application Number  Priority Date  Filing Date  Title 

CN2010105115022A CN102012217B (en)  20101019  20101019  Method for measuring threedimensional geometrical outline of largesize appearance object based on binocular vision 
Publications (2)
Publication Number  Publication Date 

CN102012217A CN102012217A (en)  20110413 
CN102012217B true CN102012217B (en)  20120704 
Family
ID=43842472
Family Applications (1)
Application Number  Title  Priority Date  Filing Date 

CN2010105115022A CN102012217B (en)  20101019  20101019  Method for measuring threedimensional geometrical outline of largesize appearance object based on binocular vision 
Country Status (1)
Country  Link 

CN (1)  CN102012217B (en) 
Families Citing this family (29)
Publication number  Priority date  Publication date  Assignee  Title 

CN102422832B (en) *  20110817  20130724  中国农业大学  Visual spraying location system and location method 
CN102507600B (en) *  20111108  20130605  南京大学  Automatic abrasion detection device for pantograph pan of highspeed locomotive 
CN103148806A (en) *  20111207  20130612  史金龙  Ship steel plate dynamic threedimensional measuring system based on projection and multiview vision 
CN104176089B (en) *  20130522  20160810  中特物流有限公司  Lorries automobile overweight detecting system 
CN103308000B (en) *  20130619  20151118  武汉理工大学  Based on the curve object measuring method of binocular vision 
CN103983207A (en) *  20140530  20140813  深圳先进技术研究院  Threedimensional scanning endoscope and threedimensional scanning method 
CN104296681B (en) *  20141016  20161207  浙江大学  Dimensional topography method for sensing based on laser dotmatrix mark 
CN104406594B (en) *  20141209  20170606  上海新跃仪表厂  The Measurement Algorithm of spacecrafts rendezvous spacecraft relative pose 
CN104457586A (en) *  20141218  20150325  西南交通大学  System for detecting mounting height of key position of train 
CN104792278B (en) *  20150323  20180824  覃泳睿  The method that Structure light method threedimensional measurement is carried out in sun luminous environment 
CN204944431U (en) *  20150812  20160106  杭州思看科技有限公司  Adopt the handheld laser 3 d scanner of flashing mode projection 
EP3323237A4 (en)  20150826  20190731  Zhejiang Dahua Technology Co., Ltd  Methods and systems for traffic monitoring 
CN105157608B (en) *  20150831  20181207  浙江大华技术股份有限公司  A kind of detection method of overrun vehicle, apparatus and system 
DE112015006349T5 (en) *  20150930  20171207  Komatsu Ltd.  working vehicle 
CN105387818B (en) *  20151026  20170613  天津大学  A kind of large scale 3 D measuring method based on one dimensional image sequence 
CN106225676B (en) *  20160905  20181023  凌云光技术集团有限责任公司  Method for threedimensional measurement, apparatus and system 
CN106840031A (en) *  20170407  20170613  吉林大学  Raster pattern automobile Shap feature detection system based on cylinder pose benchmark 
CN106871817A (en) *  20170407  20170620  吉林大学  Raster pattern automobile Shap feature detection system based on sphere pose benchmark 
CN107044832A (en) *  20170407  20170815  吉林大学  The variable scantype automobile morphology detector based on sphere pose benchmark of baseline distance 
CN106840040A (en) *  20170407  20170613  吉林大学  Raster pattern automobile Shap feature detection system based on cube posture benchmark 
CN107063120A (en) *  20170407  20170818  吉林大学  The variable scantype automobile morphology detector based on cylinder pose benchmark of baseline distance 
CN106871818A (en) *  20170407  20170620  吉林大学  Become the scantype automobile morphology detector based on cube posture benchmark of baseline distance 
CN106840041A (en) *  20170407  20170613  吉林大学  Automobile pattern scanner based on binocular active vision 
CN107063129B (en) *  20170525  20190607  西安知象光电科技有限公司  A kind of array parallel laser projection threedimensional scan method 
CN107907048A (en) *  20170630  20180413  长沙湘计海盾科技有限公司  A kind of binocular stereo vision method for threedimensional measurement based on linestructured light scanning 
CN107505324B (en) *  20170810  20200616  李�杰  3D scanning device and scanning method based on binocular collaborative laser 
CN108895984A (en) *  20180718  20181127  大连理工大学  A kind of binocular vision and DMD structured light threedimensional measurement device design method 
WO2020047863A1 (en) *  20180907  20200312  深圳配天智能技术研究院有限公司  Distance measurement method and apparatus 
CN109443244A (en) *  20181019  20190308  华中科技大学无锡研究院  The method for rejecting high light reflectivity exception error point based on stereoscopic vision and the constraint of lightknife face 
Family Cites Families (3)
Publication number  Priority date  Publication date  Assignee  Title 

FI20012204A0 (en) *  20011113  20011113  Mapvision Oy  Combining point clouds 
CN1259542C (en) *  20030611  20060614  北京航空航天大学  Vision measuring method for spaced round geometrical parameters 
CN102109321B (en) *  20091225  20130102  江苏金源锻造有限公司  Nearinfrared vision sensing detection device for largescale hightemperature forgeable piece 

2010
 20101019 CN CN2010105115022A patent/CN102012217B/en not_active IP Right Cessation
Also Published As
Publication number  Publication date 

CN102012217A (en)  20110413 
Similar Documents
Publication  Publication Date  Title 

Pan et al.  Realtime, noncontact and targetless measurement of vertical deflection of bridges using offaxis digital image correlation  
CN104005325B (en)  Based on pavement crack checkout gear and the method for the degree of depth and gray level image  
CN106959080B (en)  A kind of large complicated carved components threedimensional pattern optical measuring system and method  
Pavlidis et al.  Methods for 3D digitization of cultural heritage  
Sansoni et al.  Threedimensional optical measurements and reverse engineering for automotive applications  
CN105953747B (en)  Structured light projection full view 3D imaging system and method  
Li et al.  An algorithm for extrinsic parameters calibration of a camera and a laser range finder using line features  
Aguilar et al.  Stereo vision for 3D measurement: accuracy analysis, calibration and industrial applications  
US9454816B2 (en)  Enhanced stereo imagingbased metrology  
CN103245322B (en)  A kind of distancefinding method based on binocular stereo vision and system  
CN103578117B (en)  Determine the photographic head method relative to the attitude of environment  
CN102254318B (en)  Method for measuring speed through vehicle road traffic videos based on image perspective projection transformation  
Fröhlich et al.  Terrestrial laser scanning—new perspectives in 3D surveying  
CN103247053B (en)  Based on the part accurate positioning method of binocular microscopy stereo vision  
CN102927908B (en)  Robot eyeonhand system structured light plane parameter calibration device and method  
CN100476345C (en)  Method for measuring geometric parameters of spatial circle based on technique of binocular stereoscopic vision  
CN102410811B (en)  Method and system for measuring parameters of bent pipe  
CN102564347B (en)  Object threedimensional outline measuring device and method based on Dammann grating  
CN104299261A (en)  Threedimensional imaging method and system for human body  
CN101986350B (en)  Monocular structured lightbased threedimensional modeling method  
Xu et al.  Realtime 3D shape inspection system of automotive parts based on structured light pattern  
CN104101331B (en)  Based on the noncooperative target pose measurement of alloptical field camera  
CN102607457B (en)  Measuring device and measuring method for large threedimensional morphology based on inertial navigation technology  
CN105066909B (en)  A kind of many laser stripe quick threedimensional measuring methods of handheld  
CN100562707C (en)  Binocular vision rotating axis calibration method 
Legal Events
Date  Code  Title  Description 

C06  Publication  
PB01  Publication  
C10  Entry into substantive examination  
SE01  Entry into force of request for substantive examination  
C14  Grant of patent or utility model  
GR01  Patent grant  
EXPY  Termination of patent right or utility model  
CF01  Termination of patent right due to nonpayment of annual fee 
Granted publication date: 20120704 Termination date: 20141019 