CN104899554A - Vehicle ranging method based on monocular vision - Google Patents

Vehicle ranging method based on monocular vision Download PDF

Info

Publication number
CN104899554A
CN104899554A CN201510229988.3A CN201510229988A CN104899554A CN 104899554 A CN104899554 A CN 104899554A CN 201510229988 A CN201510229988 A CN 201510229988A CN 104899554 A CN104899554 A CN 104899554A
Authority
CN
China
Prior art keywords
vehicle
video image
target vehicle
image
monocular
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510229988.3A
Other languages
Chinese (zh)
Inventor
张云洲
孙鹏飞
李继凡
孟蕾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northeastern University China
Original Assignee
Northeastern University China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northeastern University China filed Critical Northeastern University China
Priority to CN201510229988.3A priority Critical patent/CN104899554A/en
Publication of CN104899554A publication Critical patent/CN104899554A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C3/00Measuring distances in line of sight; Optical rangefinders
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/215Motion-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior

Abstract

The invention discloses a vehicle ranging method based on monocular vision, and belongs to the field of target detection and ranging. The method comprises the steps of installing a monocular camera on a vehicle, measuring the height and the pitching angle of the camera, and determining focal distance parameters of the camera; acquiring a video image in an expressway environment; performing preliminary de-noising and filtration on the video image by adopting Gaussian filtration; performing interest region segmentation preprocessing before detection of a target vehicle on the video image; performing vehicle detection in a segmented video image region, wherein an Haar feature for increasing a wheel feature and a tail feature is adopted in the target vehicle detection, so as to effectively improve the accuracy of target vehicle identification; and measuring the distance of the target vehicle, wherein a ranging method based on pin-hole imaging is adopted within a short-distance range, while a ranging method of data fitting is adopted within a long-distance range, so that the error rate is reduced, and a real-time ranging effect can be achieved. The method has the advantages of high detection speed, high accuracy, strong real-time property and low cost.

Description

A kind of vehicle odometry method based on monocular vision
Art
The invention belongs to target detection and range finding field, particularly relate to a kind of vehicle odometry method based on monocular vision.
Background technology
Along with the development of highway communication particularly freeway facility, road accident rate also presents ascendant trend, and traffic safety more and more becomes the focus that people pay close attention to.Therefore, research vehicle safety assists driving technology, for vehicle provides safety assistant driving function, thus provides intellectual technology service for reducing the traffic hazard caused because of driver's subjective factor.Computer vision because of its provide contain much information, the factor such as good stability, become the research emphasis that vehicle safety assists driving technology gradually, along with the development of computer vision technique, its effect in Intelligent Vehicle System is constantly perfect, computer vision technique is applied in vehicle detection, great effect is created to the raising of vehicle safety.
Utilize monocular cam to carry out the detection of moving target (such as vehicle), its development roughly experienced by three phases: passive learning stage---Active Learning stage---the adaptive learning stage.In the passive learning stage, mainly according to the feature of image, carry out matching to the object of all existence, the target that after comparing the difference of front and back two field picture, district office will detect, its main algorithm has mixed Gauss model, background subtraction, Kalman filter etc.In the Active Learning stage, mainly for specific moving target, study its inherent feature, by the study to feature, moving target is detected.At present for the vehicle of motion, conventional inherent feature comprises shade that vehicle bottom produces, the entropy of shade, the symmetry of vehicle edge, the brightness of vehicle pixel, the texture etc. of vehicle.In adaptive learning, the detection of moving target is roughly divided into three steps: the first step is feature extraction, here feature mainly mathematical feature, feature extraction algorithm conventional now has HOG, Haar, SIFT, LBT etc., and this step is the basis of two steps next; Second is the training of sorter, and by inputting a large amount of positive negative sample, obtain the sorter identifying target mathematical feature through training, classifier algorithm conventional now comprises SVM, Adaboost etc.; 3rd step is moving object detection, and this step is mainly used through training the sorter obtained, and carries out moving object detection to the video image of input.
Monocular vision range finding is that the picture utilizing a video camera to obtain draws depth information, is mainly divided into the measuring method based on geometric relationship and the measuring method based on data message according to the principle measured.Measuring method based on geometric relationship refers to that the picture utilizing the structure of video camera and video camera to obtain records depth distance.Utilizing theory on computer vision and method, carrying out the front vehicles in runway, on quick detection and the basis demarcated in advance video camera, utilizing camera parameters and road geometric model, obtaining front vehicles distance.The shortcoming of above-mentioned measurement is the coupling will carrying out unique point to a width or a few width picture, and matching error has obvious impact to measurement result, and the processing time is long simultaneously, for multiple image, then must need more computing time.
Measuring method based on data message refers to that the Target Photo utilizing video camera to obtain under the condition of known object information obtains depth distance.The shortcoming of these class methods needs the accurate information utilizing image to measure, and easily causes the inaccurate of measurement because of the inaccurate of image information.
Summary of the invention
For the deficiency that existing method exists, the present invention proposes a kind of vehicle odometry method based on monocular vision.
Technical scheme of the present invention is achieved in that
Based on a vehicle odometry method for monocular vision, vehicle odometry object is the front vehicles travelled in the same way, comprises the steps:
Step 1: install monocular cam on vehicle, measures camera height and the angle of pitch thereof, and determines camera focal length parameter;
First monocular cam is fixed on vehicle front, determines this camera distance height on ground and the angle of axis and horizontal direction thereof, be i.e. the vertical height of this monocular cam and the angle of pitch;
Step 2: the video image under utilizing described monocular cam to gather highway environment;
Step 3: the video image preprocessing process before target vehicle detection;
Step 3.1: adopt gaussian filtering to carry out preliminary denoising, filtering process to video image;
Step 3.2: the segmentation of the region-of-interest before target vehicle detection pre-service is carried out to the video image after step 3.1 rough handling;
Step 4: target vehicle detection process;
Carry out vehicle detection in video image region after singulation, and the target vehicle detected is marked in real time on picture;
Step 5: target vehicle ranging process;
Measurement target vehicle distances also shows this target vehicle distance in real time on video pictures.
Described step 3.2 comprises following concrete steps:
Step 3.2.1: sky areas segmentation is carried out to the video image gathered;
Adopt the video image gathered and carry out sky areas segmentation based on color space, method is specific as follows: first obtain the histogram of video image in HIS (tone, color saturation, brightness), RGB (red, green, blue three look), YIQ (brightness, tone, saturation degree) and YCbCr (colour brightness, blueness and red color side-play amount) four kinds of color spaces; Then in these four kinds of color spaces, determine the distribution range of each color component of sky areas respectively, calculate and the variance of more determined Four composition cloth range data and extreme value, choose wherein variance and the minimum also YCbCr color space that namely distribution of each component is the most concentrated of extreme value as the color space of sky spatial segmentation; Finally binary conversion treatment is carried out to video image, determine the UNICOM region of sky and calculate its area, and adopting Otsu Adaptive Thresholding, automatically adjusting segmentation threshold, sky portion is removed from image;
Step 3.2.2: to the video image after the segmentation of sky areas, adopt Minimum error threshold method inspection vehicle diatom, namely near the road edge line of image border, and two-dimentional straight-line equation is set up to the lane line detected, and the region of removing based on this equation outside edge line, reduce vehicle detection region area further;
Described step 4 comprises following concrete steps:
Step 4.1: gather positive and negative sample image (positive sample refers to vehicle rear picture, and negative sample refers to other any image, but can not comprise vehicle rear), be normalized as onesize to all positive and negative samples pictures;
Step 4.2: increase tailstock characteristic sum back wheels of vehicle feature in Haar feature, and according to this Haar feature, adopt Adaboost algorithm to train positive and negative sample set, obtain cascade classifier;
Step 4.3: utilize the cascade classifier obtained, target vehicle detection is carried out to the video image of monocular cam collection, and the target vehicle detected is marked in real time on picture;
In target vehicle detection process in described step 4.3, multiple dimensioned windowhood method (multiscale approach) video image to monocular cam collection is utilized to carry out Scanning Detction;
In described step 5, the method for measurement target vehicle distances is as follows:
If target vehicle distance is within 30 meters, then set up video camera projection model according to pinhole imaging system principle, world coordinate system is projected in image coordinate system, sets up vehicle odometry geometric relationship model by relation corresponding between Two coordinate system, ask for objects ahead vehicle distances; If target vehicle distance is greater than 30 meters, then first obtains the mapping relations between real road sample point and picture plane by data fitting method, and ask for objects ahead vehicle distances according to these mapping relations.
Advantage of the present invention is: the suitable environment of the vehicle odometry method based on monocular vision of the present invention is highway, first the method carries out the acquisition of call parameter to the monocular cam be arranged on vehicle, then after adopting gaussian filtering to carry out rough handling to the video image of this camera acquisition, again pre-service is carried out to video image: be first adopt the sky areas dividing method based on color space, rational segmentation threshold is found by the method for adaptive adjustment threshold value, tell sky areas, decrease the scan area of image; Next territory, track is split, further reduce the scan area of image; The Haar feature being the increase in wheel characteristics and tailstock feature adopted in the process of target vehicle detection, effectively improves the accuracy of target vehicle identification; In the process of target vehicle detection (identification), adopt multiple dimensioned windowhood method to carry out Scanning Detction to the video image of monocular cam collection, also can significantly improve target vehicle detection speed.In target vehicle range observation, in short range, (within 30 meters) adopt the distance-finding method based on pinhole imaging system; The scope of long distance (is greater than 30 meters), adopts the distance-finding method of data fitting (linear difference), reduce error rate, the effect of real time distance can be reached.And method of the present invention only adopts a camera collection video, and equipment is simple.Therefore, method of the present invention has that detection speed is fast, and accuracy rate is high, the comparatively strong and advantage that cost is low of real-time.
Accompanying drawing explanation
Fig. 1 is the vehicle odometry method flow diagram based on monocular vision of one embodiment of the present invention;
Fig. 2 is the Haar characteristic set figure of one embodiment of the present invention;
Fig. 3 is that the Adaboost of one embodiment of the present invention trains process flow diagram;
Fig. 4 is the multiple dimensioned windowhood method scanning process schematic diagram of one embodiment of the present invention;
Fig. 5 is the pinhole imaging system principle schematic of one embodiment of the present invention;
Fig. 6 is schematic diagram when tested point departs from center in the pinhole imaging system of one embodiment of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
Fig. 1 is the vehicle odometry method flow diagram based on monocular vision of present embodiment, and the method comprises following concrete steps:
Step 1: install monocular cam on vehicle, measures camera height, knows camera focal length parameter;
First monocular cam is fixed on vehicle front, determines this camera distance height on ground and the angle of its axis and horizontal direction thereof, be i.e. the vertical height of this monocular cam and the angle of pitch;
Step 2: the video image under utilizing described monocular cam to gather highway environment;
Step 3: the video image preprocessing process before target vehicle detection;
Step 3.1: adopt gaussian filtering to carry out preliminary denoising, filtering process to video image;
Step 3.2: the segmentation of the region-of-interest before target vehicle detection pre-service is carried out to the video image after step 3.1 rough handling, needs processing region to reduce, improve target vehicle detection speed;
Step 3.2.1: sky areas segmentation is carried out to the video image gathered;
Adopt the method for carrying out sky areas segmentation based on color space, specific as follows: first to obtain the histogram of video image in HIS (tone, color saturation, brightness), RGB (red, green, blue three look), YIQ (brightness, tone, saturation degree) and YCbCr (colour brightness, blueness and red color side-play amount) four kinds of color spaces; Then in these four kinds of color spaces, determine the distribution range of each color component of sky areas respectively, the variance of calculating and more determined Four composition cloth range data and extreme value, choose the color space of the minimum also YCbCr color space that namely distribution of each component is the most concentrated of wherein variance and extreme value as sky spatial segmentation, experiment finds, for YCbCr color space, Y and Cr distribution is more concentrated, the distributed areas of sky can be recognized preferably, and less on the impact of entire image, therefore adopt YCbCr color space as the color space removing sky; Finally binary conversion treatment is carried out to video image, determine the UNICOM region of sky and calculate its area, and adopting Otsu Adaptive Thresholding, automatically adjusting segmentation threshold, sky portion is removed from image; Present embodiment is to remove the harmful effect of the undesirable elements such as illumination to COLOR COMPOSITION THROUGH DISTRIBUTION region in sky spatial segmentation process, adopts Otsu Adaptive Thresholding automatically suitably to adjust threshold value thus improves the accuracy of sky segmentation;
Formula (1) is the process function to sky areas in experiment, the gray-scale value that F (x, y) is image.When sky areas meets the color element scope in formula (1), the gray-scale value of sky areas is set to 255, removes sky areas.
F ( x , y ) = 255 Y ∈ [ 0.627,0.702 ] and Cr ∈ [ 0.494,0.564 ] and Cb ∈ [ 0.407,0.502 ] 0 others - - - ( 1 )
In order to get rid of the distracter (color, building etc. as car) consistent with sky color that may exist in picture, when only having the area when UNICOM region to be greater than 1/10 of image, small pieces just can be removed, and eliminate disturbing factor so to a great extent.After the image of sky areas detects, corresponding cutting process can be carried out, for follow-up vehicle detection process.
Pixel coverage due to sky is vulnerable to the impact of the undesirable elements such as illumination, can be found by the histogram distribution of image, the color gamut of sky obeys Gauss normal distribution, if suitable threshold value can be found, image is divided into sky and non-sky portion, so just can well solves have impact on of the problems such as light.
According to Otsu Adaptive Thresholding, with the separation of threshold value ψ as binaryzation, what be greater than ψ is classified as a class, is less than being classified as of ψ another kind of, if the average of two classes is respectively v 1and v 2, the distribution probability of two classes is respectively u 1and u 2.
α 2=u 1u 2(v 2-v 1) 2(2)
By adjusting the size of threshold value ψ, allow variance α 2obtain maximal value, ψ at this time can as the threshold value of sky areas segmentation.
Present embodiment adopts adaptivenon-uniform sampling algorithm, and for the sky that process illumination is undesirable, effect is ideal.
Step 3.2.2: to the video image after the segmentation of sky areas, adopt Minimum error threshold method inspection vehicle diatom, namely near the road edge line of image border, and two-dimentional straight-line equation is set up to the lane line detected, and the region of removing based on this equation outside edge line, reduce vehicle detection region area further; Most of extraneous areas can be removed through sky areas segmentation and this twice segmentation of track regional partition process, reduce image-region to be dealt with in vehicle detection, thus improve the speed of vehicle detection.
Present embodiment adopts Minimum error threshold method inspection vehicle diatom, and determine road area and non-rice habitats region with this.Extraneous areas in every frame picture is got rid of, only retains road sections.Minimum error threshold algorithm has good noise immunity, and Detection results is desirable.Compared to two-dimentional Minimum error threshold algorithm, the calculated amount of one dimension least error algorithm is less, greatly can shorten the processing time, and can meet the requirement of the image process in early stage for target vehicle identification (detection).
Detailed process is as follows:
Be the image of M × N for a width size, if the gray-scale value that coordinate is the pixel of (x, y) be h (x, y) ∈ G=[0,1 ..., 255].Represent the one dimensional histograms of image by function f (g), it represent the frequency that in image, each gray-scale value occurs, for gray threshold m ∈ G=[0,1 ..., 255], the function of minimum classification error is
Z(m)=1+2[P 0(m)lnσ 0(m)+P 1(m)lnσ 1(m)]-2[P 0(m)lnP 0(m)+P 1(m)lnP 1(m)] (3)
Wherein, P 0 ( m ) = &Sigma; g = 0 m f ( g ) And P 1 ( m ) = &Sigma; g = m + 1 255 f ( g ) It is the prior probability of two son distributions; &mu; 0 ( m ) = &Sigma; g = 0 m g &CenterDot; f ( g ) P 0 ( m ) With &mu; 0 ( m ) = &Sigma; g = m + 1 255 g &CenterDot; f ( g ) P 1 ( m ) It is the average of two son distributions; &sigma; 2 0 ( m ) = &Sigma; g = 0 t ( g - &mu; 0 ( m ) ) 2 f ( g ) P 0 ( m ) With it is the variance of two son distributions; Optimum gradation threshold value m *for the threshold value making Z (m) get minimum value, at this moment there is m *=arg (minZ (m)) (0 < m < 255); The classifying mode of the pixel after therefore can obtaining Minimum error threshold is:
h &OverBar; ( x , y ) = 0 when h ( x , y ) < m * 25 when h ( x , y ) &GreaterEqual; m *
Wherein, for the pixel after Minimum error threshold; H (x, y) is the pixel before Minimum error threshold.
Experiment proves, Minimum error threshold method can be good at by lane detection out.Track and non-track can be separated by the lane line equation set up in two dimensional surface, a large amount of extraneous areas can be removed, thus the workload of vehicle detection process can be reduced.
Step 4: target vehicle detection process;
Carry out vehicle detection in video image region after singulation, and the target vehicle detected is marked in real time on picture;
Step 4.1: gather positive and negative sample image; Wherein positive sample refers to vehicle rear picture, and negative sample refers to other any image, but can not comprise vehicle rear, is all normalized all positive and negative samples pictures, and present embodiment is that all pictures are all normalized to 20*20.
Step 4.2: increase tailstock characteristic sum wheel characteristics in Haar feature, and according to amended Haar feature, adopt Adaboost algorithm to train positive and negative sample set, obtain cascade classifier.
Eigenwert according to feature templates defines, white rectangle pixel and deduct black rectangle pixel and, because integrogram has that computing velocity is fast and calculated value is only relevant with edge, so, adopt integrogram to calculate Haar eigenwert herein.
Present embodiment, on the basis of original Haar feature, adds wheel characteristics and tailstock feature as shown in Figure 2.The accuracy rate of target vehicle detection can be improved.The computing method of Haar feature be white rectangle pixel and deduct black rectangle pixel and, because integrogram has that computing velocity is fast and calculated value is only relevant with edge, so, adopt integrogram to calculate Haar eigenwert to improve computing velocity herein.
Present embodiment, further according to Haar feature, utilizes Adaboost algorithm to align negative sample and trains, obtain cascade classifier.As shown in Figure 3, cascade classifier is made up of multiple Weak Classifier training process flow diagram, and every one-level is all complicated than previous stage.Each sorter can allow nearly all positive example pass through, the negative example of the major part of filtering simultaneously.The positive example to be detected of so every one-level is just few than previous stage, eliminates a large amount of non-detection targets, greatly can improve detection speed.
Step 4.3: utilize the cascade classifier obtained, the video image of monocular cam collection is detected, and in testing process, utilizes multiple dimensioned windowhood method (multiscale approach) to scan;
In order to reduce the time spent when calculating rectangular characteristic, present embodiment have employed multiple dimensioned windowhood method and scans, namely respectively Subarea detecting is carried out to image with the subwindow of different size, and calculate the Haar feature of zones of different simultaneously, scanning schematic diagram as shown in Figure 4, according to the feature of vehicle detection, utilize the vehicle feature that the tailstock varies in size when different distance, image is divided into four regions, and with the subwindow of four different sizes, Subarea detecting is carried out to image, and calculate the Haar feature of four subwindows simultaneously.
Step 5: measurement target vehicle distances also shows this target vehicle distance in real time on video pictures.
If target vehicle distance is within 30 meters, then set up video camera projection model according to pinhole imaging system principle, world coordinate system is projected in image coordinate system, sets up vehicle odometry geometric relationship model by relation corresponding between Two coordinate system, ask for objects ahead vehicle distances; According to pinhole imaging system principle, object in world coordinate system is projected in image coordinate system through small holes, as shown in Figure 5, the reality imagery of plane bchq corresponding to world coordinate system, the projection image of plane BCHQ corresponding to image coordinate system, in plane bchq, hq limit and bc limit extend intersection point is s, and simultaneously s point is also the intersection point of road extended line, and road surface is actual, and that be observed is trapezoidal bchq.Representated by M point is the aperture that convex lens are formed.
If do not consider the impact of camera distortion, optical axis Ii is the center of two planes at the intersection point of two corresponding flats, I as shown in Figure 5, i 2 point.
As shown in Figure 5, in world coordinate system, get a t, through the projection of a M, obtain the some T in image coordinate system.∠ TMI and the ∠ α of Δ MIT can be found 2be equal, and line segment MI is the focal distance f of lens in video camera, so there is tan α 2in=TI/f, Fig. 5, MN is horizontal line, ∠ α 1the angle of pitch formed by optical axis and horizontal line, the height that camera is installed is δ=MW, and observed some t is S=Wi to the distance of photocentre, has:
tan &alpha; 1 = &delta; S - - - ( 4 )
Thus can in the hope of range formula:
d 1 = Mt &OverBar; = h tan [ &alpha; 1 + arctan ( TI / f ) ] - - - ( 5 )
As shown in Figure 6, when tested point departs from center time, need calculating off-centered lateral separation so measured actual range is
In order to ask for d 2point, chooses b 1point is test point, b 1point is B at the subpoint of image coordinate system 1; The another one test point crossing with sides aligned parallel and with center line is a 1, the intersection point projecting to image coordinate system is accordingly A 1; By the existence of projection theory and vertical plane, ∠ MA can be known 1b 1with ∠ Ma 1b 1be 90 °, owing to also there are a pair vertical angle, so Δ MA 1b 1with Δ Ma 1b 1similar.The criterion proportional according to similar triangles corresponding sides, obtains following formula:
A 1 B 1 a 1 b 1 = MA 1 Ma 1 - - - ( 6 )
For A 1b 1, in image coordinate system, if the distance between horizontal ordinate pixel and ordinate pixel is respectively d xand d y, then A 1b 1between actual range be then wherein represent A 1b 1pixel value difference.
In like manner for MA 1, can push away according to the relation between pixel and actual range and obtain its expression formula and be:
MA 1 = f 2 + ( A 1 I &OverBar; * d y ) 2 - - - ( 7 )
Wherein that represent is A 1the pixel value difference of I.
For Ma 1, owing to having tried to achieve d by Fig. 5 1, the Wa namely in figure 1, the geometric relationship from figure:
Ma 1 = h 2 + Wa 1 2 = MW 2 + Wa 1 2 - - - ( 8 )
A 1b 1be the parameter d of requirement 2.In sum, the formula calculating distance is:
d = d 1 2 + d 2 2 = sqrt ( h tan [ &alpha; 1 + arctan ( TI / f ) ] ) 2 + . . . A 1 B 1 &OverBar; &CenterDot; d x f 2 + ( A 1 I &OverBar; * d y ) 2 &CenterDot; h 2 + Wa 1 2 - - - ( 9 )
In formula (9), the focal distance f of video camera and TI can check in from the specifications parameter of camera, and setting height(from bottom) h can measure and obtain, α 1can try to achieve with formula (5).
If target vehicle distance is greater than 30 meters, then first obtains the mapping relations between real road sample point and picture plane by data fitting method, and ask for objects ahead vehicle distances according to these mapping relations.For the video camera laid perpendicular to ground that a frame specification is determined, when its angle of pitch is determined, the distance range of the road ahead that it can detect is certain, position coordinates in the world coordinate system that on image area, each point is corresponding is also certain, as long as so find the position corresponding relation between image coordinate system and world coordinate system just can ask for front vehicles distance by this relation in reality range finding.This method effectively overcomes the harmful effect that the path error such as the lens distortion existed in actual imaging cause, and the problem such as video camera modes of emplacement, surface conditions, road type (straight way or structured road).
The relation matching of Two coordinate system needs to obtain data by experiment to realize.What the data obtained in experiment were formed is discrete point, and present embodiment is the relation of the method construct Two coordinate system adopting cubic spline interpolation.

Claims (6)

1., based on a vehicle odometry method for monocular vision, vehicle odometry object is the front vehicles travelled in the same way, it is characterized in that: comprise the steps:
Step 1: install monocular cam on vehicle, measures camera height and the angle of pitch thereof, and determines camera focal length parameter;
First monocular cam is fixed on vehicle front, determines this camera distance height on ground and the angle of axis and horizontal direction thereof, be i.e. the vertical height of this monocular cam and the angle of pitch;
Step 2: the video image under utilizing described monocular cam to gather highway environment;
Step 3: the video image preprocessing process before target vehicle detection;
Step 3.1: adopt gaussian filtering to carry out preliminary denoising, filtering process to video image;
Step 3.2: the segmentation of the region-of-interest before target vehicle detection pre-service is carried out to the video image after step 3.1 rough handling;
Step 4: target vehicle detection process;
Carry out vehicle detection in video image region after singulation, and the target vehicle detected is marked in real time on picture;
Step 5: target vehicle ranging process;
Measurement target vehicle distances also shows this target vehicle distance in real time on video pictures.
2. the vehicle odometry method based on monocular vision according to claim 1, is characterized in that: described step 3.2 comprises following concrete steps:
Step 3.2.1: sky areas segmentation is carried out to the video image gathered;
Step 3.2.2: to the video image after the segmentation of sky areas, adopt Minimum error threshold method inspection vehicle diatom, namely near the road edge line of image border, and two-dimentional straight-line equation is set up to the lane line detected, and the region of removing based on this equation outside edge line, reduce vehicle detection region area further.
3. the vehicle odometry method based on monocular vision according to claim 1, is characterized in that: described step 4 comprises following concrete steps:
Step 4.1: gather positive and negative sample image, is normalized as onesize to all positive and negative samples pictures; Wherein positive sample refers to vehicle rear picture, and negative sample refers to other any image, but can not comprise vehicle rear;
Step 4.2: increase tailstock characteristic sum back wheels of vehicle feature in Haar feature, and according to this Haar feature, adopt Adaboost algorithm to train positive and negative sample set, obtain cascade classifier;
Step 4.3: utilize the cascade classifier obtained, target vehicle detection is carried out to the video image of monocular cam collection, and the target vehicle detected is marked in real time on picture.
4. the vehicle odometry method based on monocular vision according to claim 2, it is characterized in that: adopt the video image gathered in described step 3.2.1 and carry out sky areas segmentation based on color space, method is specific as follows: first obtain the histogram of video image in HIS, RGB, YIQ and YCbCr tetra-kinds of color spaces; Then in these four kinds of color spaces, determine the distribution range of each color component of sky areas respectively, calculate and the variance of more determined Four composition cloth range data and extreme value, choose wherein variance and the minimum also YCbCr color space that namely distribution of each component is the most concentrated of extreme value as the color space of sky spatial segmentation; Finally binary conversion treatment is carried out to video image, determine the UNICOM region of sky and calculate its area, and adopting Otsu Adaptive Thresholding, automatically adjusting segmentation threshold, sky portion is removed from image.
5. the vehicle odometry method based on monocular vision according to claim 3, is characterized in that: in the target vehicle detection process in described step 4.3, utilizes multiple dimensioned windowhood method to carry out Scanning Detction to the video image of monocular cam collection.
6. the vehicle odometry method based on monocular vision according to claim 1, is characterized in that: in described step 5, the method for measurement target vehicle distances is as follows:
If target vehicle distance is within 30 meters, then set up video camera projection model according to pinhole imaging system principle, world coordinate system is projected in image coordinate system, sets up vehicle odometry geometric relationship model by relation corresponding between Two coordinate system, ask for objects ahead vehicle distances; If target vehicle distance is greater than 30 meters, then first obtains the mapping relations between real road sample point and picture plane by data fitting method, and ask for objects ahead vehicle distances according to these mapping relations.
CN201510229988.3A 2015-05-07 2015-05-07 Vehicle ranging method based on monocular vision Pending CN104899554A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510229988.3A CN104899554A (en) 2015-05-07 2015-05-07 Vehicle ranging method based on monocular vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510229988.3A CN104899554A (en) 2015-05-07 2015-05-07 Vehicle ranging method based on monocular vision

Publications (1)

Publication Number Publication Date
CN104899554A true CN104899554A (en) 2015-09-09

Family

ID=54032210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510229988.3A Pending CN104899554A (en) 2015-05-07 2015-05-07 Vehicle ranging method based on monocular vision

Country Status (1)

Country Link
CN (1) CN104899554A (en)

Cited By (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105354857A (en) * 2015-12-07 2016-02-24 北京航空航天大学 Matching method for vehicle track shielded by overpass
CN105488454A (en) * 2015-11-17 2016-04-13 天津工业大学 Monocular vision based front vehicle detection and ranging method
CN105718870A (en) * 2016-01-15 2016-06-29 武汉光庭科技有限公司 Road marking line extracting method based on forward camera head in automatic driving
CN106157311A (en) * 2016-07-04 2016-11-23 南京安驾信息科技有限公司 Scaling method and the device of system is identified for vehicle ADAS
FR3045816A1 (en) * 2015-12-22 2017-06-23 Renault Sas METHOD AND DEVICE FOR DETERMINING SPATIAL POSITIONS AND CINEMATIC PARAMETERS OF OBJECTS IN THE ENVIRONMENT OF A VEHICLE
CN107148639A (en) * 2015-09-15 2017-09-08 深圳市大疆创新科技有限公司 It is determined that method and device, tracks of device and the system of the positional information of tracking target
CN107305632A (en) * 2017-02-16 2017-10-31 武汉极目智能技术有限公司 Destination object distance measurement method and system based on monocular computer vision technique
CN107341478A (en) * 2017-07-11 2017-11-10 京东方科技集团股份有限公司 The vehicle checking method and its device of a kind of DAS (Driver Assistant System)
CN107764233A (en) * 2016-08-15 2018-03-06 杭州海康威视数字技术股份有限公司 A kind of measuring method and device
CN107832788A (en) * 2017-11-01 2018-03-23 青岛理工大学 A kind of vehicle distance measurement method based on monocular vision and Car license recognition
CN108122244A (en) * 2016-11-30 2018-06-05 浙江宇视科技有限公司 The video frequency speed-measuring method and device of a kind of video image
CN108759667A (en) * 2018-05-29 2018-11-06 福州大学 Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera
CN108830159A (en) * 2018-05-17 2018-11-16 武汉理工大学 A kind of front vehicles monocular vision range-measurement system and method
CN109117691A (en) * 2017-06-23 2019-01-01 百度在线网络技术(北京)有限公司 Drivable region detection method, device, equipment and storage medium
CN109146948A (en) * 2018-07-27 2019-01-04 内蒙古大学 The quantization of crop growing state phenotypic parameter and the correlation with yield analysis method of view-based access control model
CN109443319A (en) * 2018-12-21 2019-03-08 联创汽车电子有限公司 Barrier range-measurement system and its distance measuring method based on monocular vision
CN109583267A (en) * 2017-09-28 2019-04-05 京东方科技集团股份有限公司 Vehicle object detection method, vehicle object detecting device and vehicle
CN109724560A (en) * 2018-12-17 2019-05-07 南京理工大学 A kind of monocular range-measurement system based on Inertial Measurement Unit
CN109827516A (en) * 2019-03-19 2019-05-31 魔视智能科技(上海)有限公司 A method of distance is measured by wheel
CN109979206A (en) * 2017-12-28 2019-07-05 杭州海康威视系统技术有限公司 Vehicle speed measuring method, device, system, electronic equipment and storage medium
CN110006422A (en) * 2019-03-28 2019-07-12 浙江吉利汽车研究院有限公司 A kind of equipment safety operation determination method for parameter, device, equipment and storage medium
CN110334678A (en) * 2019-07-12 2019-10-15 哈尔滨理工大学 A kind of pedestrian detection method of view-based access control model fusion
CN110533945A (en) * 2019-08-28 2019-12-03 肇庆小鹏汽车有限公司 Method for early warning, system, vehicle and the storage medium of traffic lights
CN110632339A (en) * 2019-10-09 2019-12-31 天津天地伟业信息系统集成有限公司 Water flow testing method of video flow velocity tester
CN110966981A (en) * 2018-09-30 2020-04-07 北京奇虎科技有限公司 Distance measuring method and device
CN111046843A (en) * 2019-12-27 2020-04-21 华南理工大学 Monocular distance measurement method under intelligent driving environment
US10860040B2 (en) 2015-10-30 2020-12-08 SZ DJI Technology Co., Ltd. Systems and methods for UAV path planning and control
CN112562331A (en) * 2020-11-30 2021-03-26 的卢技术有限公司 Vision perception-based other-party vehicle track prediction method
CN112802090A (en) * 2021-01-23 2021-05-14 行云智能(深圳)技术有限公司 Monocular vision distance measurement processing method
CN112880642A (en) * 2021-03-01 2021-06-01 苏州挚途科技有限公司 Distance measuring system and distance measuring method
CN113188509A (en) * 2021-04-28 2021-07-30 上海商汤临港智能科技有限公司 Distance measuring method and device, electronic equipment and storage medium
CN113221739A (en) * 2021-05-12 2021-08-06 中国科学技术大学 Monocular vision-based vehicle distance measuring method
CN113838075A (en) * 2020-06-23 2021-12-24 南宁富桂精密工业有限公司 Monocular distance measuring method, device and computer readable storage medium
CN114228432A (en) * 2022-01-25 2022-03-25 同济大学 Dynamic chassis pre-aiming control method based on pavement state recognition
CN114295099A (en) * 2021-12-28 2022-04-08 合肥英睿系统技术有限公司 Monocular camera-based distance measurement method, vehicle-mounted distance measurement equipment and storage medium
US20220121850A1 (en) * 2020-10-19 2022-04-21 Aurora Flight Sciences Corporation, a subsidiary of The Boeing Company Above-horizon target tracking
US11392801B2 (en) 2018-05-29 2022-07-19 Huawei Technologies Co., Ltd. Action recognition method and apparatus
US11478169B2 (en) 2017-10-13 2022-10-25 Huawei Technologies Co., Ltd. Action recognition and pose estimation method and apparatus
CN117218681A (en) * 2023-11-09 2023-12-12 厦门瑞为信息技术有限公司 Height estimation method of monocular lens, child passing gate device and judging method

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102661733A (en) * 2012-05-28 2012-09-12 天津工业大学 Front vehicle ranging method based on monocular vision

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102661733A (en) * 2012-05-28 2012-09-12 天津工业大学 Front vehicle ranging method based on monocular vision

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
刘燕等: ""基于计算机视觉的单目摄影纵向车距测量系统研究"", 《公路交通科技》 *
宋彩霞等: ""车量测距方法"", 《电子测量与仪器学报》 *
韦庭: ""基于单目视觉的辅助驾驶系统中的图像处理研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107148639A (en) * 2015-09-15 2017-09-08 深圳市大疆创新科技有限公司 It is determined that method and device, tracks of device and the system of the positional information of tracking target
US10976753B2 (en) 2015-09-15 2021-04-13 SZ DJI Technology Co., Ltd. System and method for supporting smooth target following
US10928838B2 (en) 2015-09-15 2021-02-23 SZ DJI Technology Co., Ltd. Method and device of determining position of target, tracking device and tracking system
US11635775B2 (en) 2015-09-15 2023-04-25 SZ DJI Technology Co., Ltd. Systems and methods for UAV interactive instructions and control
CN107148639B (en) * 2015-09-15 2019-07-16 深圳市大疆创新科技有限公司 Determine method and device, tracking device and the system of the location information of tracking target
US10860040B2 (en) 2015-10-30 2020-12-08 SZ DJI Technology Co., Ltd. Systems and methods for UAV path planning and control
CN105488454B (en) * 2015-11-17 2019-04-23 天津工业大学 Front vehicles detection and ranging based on monocular vision
CN105488454A (en) * 2015-11-17 2016-04-13 天津工业大学 Monocular vision based front vehicle detection and ranging method
CN105354857B (en) * 2015-12-07 2018-09-21 北京航空航天大学 A kind of track of vehicle matching process for thering is viaduct to block
CN105354857A (en) * 2015-12-07 2016-02-24 北京航空航天大学 Matching method for vehicle track shielded by overpass
WO2017109359A1 (en) * 2015-12-22 2017-06-29 Renault S.A.S Method and device for determining spatial positions and kinematic parameters of objects in the environment of a vehicle
FR3045816A1 (en) * 2015-12-22 2017-06-23 Renault Sas METHOD AND DEVICE FOR DETERMINING SPATIAL POSITIONS AND CINEMATIC PARAMETERS OF OBJECTS IN THE ENVIRONMENT OF A VEHICLE
CN105718870B (en) * 2016-01-15 2019-06-14 武汉光庭科技有限公司 Based on the preceding roadmarking extracting method to camera in automatic Pilot
CN105718870A (en) * 2016-01-15 2016-06-29 武汉光庭科技有限公司 Road marking line extracting method based on forward camera head in automatic driving
CN106157311A (en) * 2016-07-04 2016-11-23 南京安驾信息科技有限公司 Scaling method and the device of system is identified for vehicle ADAS
US11017552B2 (en) 2016-08-15 2021-05-25 Hangzhou Hikvision Digital Technology Co., Ltd Measurement method and apparatus
CN107764233B (en) * 2016-08-15 2020-09-04 杭州海康威视数字技术股份有限公司 Measuring method and device
CN107764233A (en) * 2016-08-15 2018-03-06 杭州海康威视数字技术股份有限公司 A kind of measuring method and device
CN108122244B (en) * 2016-11-30 2022-02-01 浙江宇视科技有限公司 Video speed measuring method and device for video image
CN108122244A (en) * 2016-11-30 2018-06-05 浙江宇视科技有限公司 The video frequency speed-measuring method and device of a kind of video image
CN107305632B (en) * 2017-02-16 2020-06-12 武汉极目智能技术有限公司 Monocular computer vision technology-based target object distance measuring method and system
CN107305632A (en) * 2017-02-16 2017-10-31 武汉极目智能技术有限公司 Destination object distance measurement method and system based on monocular computer vision technique
CN109117691A (en) * 2017-06-23 2019-01-01 百度在线网络技术(北京)有限公司 Drivable region detection method, device, equipment and storage medium
CN107341478A (en) * 2017-07-11 2017-11-10 京东方科技集团股份有限公司 The vehicle checking method and its device of a kind of DAS (Driver Assistant System)
US20190019041A1 (en) * 2017-07-11 2019-01-17 Boe Technology Group Co., Ltd. Method and apparatus for detecting a vehicle in a driving assisting system
US10579883B2 (en) * 2017-07-11 2020-03-03 Boe Technology Group Co., Ltd. Method and apparatus for detecting a vehicle in a driving assisting system
US11482013B2 (en) 2017-09-28 2022-10-25 Beijing Boe Technology Development Co., Ltd. Object tracking method, object tracking apparatus, vehicle having the same, and computer-program product
CN109583267A (en) * 2017-09-28 2019-04-05 京东方科技集团股份有限公司 Vehicle object detection method, vehicle object detecting device and vehicle
US11478169B2 (en) 2017-10-13 2022-10-25 Huawei Technologies Co., Ltd. Action recognition and pose estimation method and apparatus
CN107832788B (en) * 2017-11-01 2021-07-23 青岛中汽特种汽车有限公司 Vehicle distance measuring method based on monocular vision and license plate recognition
CN107832788A (en) * 2017-11-01 2018-03-23 青岛理工大学 A kind of vehicle distance measurement method based on monocular vision and Car license recognition
CN109979206A (en) * 2017-12-28 2019-07-05 杭州海康威视系统技术有限公司 Vehicle speed measuring method, device, system, electronic equipment and storage medium
CN108830159A (en) * 2018-05-17 2018-11-16 武汉理工大学 A kind of front vehicles monocular vision range-measurement system and method
US11704938B2 (en) 2018-05-29 2023-07-18 Huawei Technologies Co., Ltd. Action recognition method and apparatus
US11392801B2 (en) 2018-05-29 2022-07-19 Huawei Technologies Co., Ltd. Action recognition method and apparatus
CN108759667A (en) * 2018-05-29 2018-11-06 福州大学 Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera
CN109146948A (en) * 2018-07-27 2019-01-04 内蒙古大学 The quantization of crop growing state phenotypic parameter and the correlation with yield analysis method of view-based access control model
CN110966981A (en) * 2018-09-30 2020-04-07 北京奇虎科技有限公司 Distance measuring method and device
CN110966981B (en) * 2018-09-30 2023-03-24 北京奇虎科技有限公司 Distance measuring method and device
CN109724560A (en) * 2018-12-17 2019-05-07 南京理工大学 A kind of monocular range-measurement system based on Inertial Measurement Unit
CN109443319A (en) * 2018-12-21 2019-03-08 联创汽车电子有限公司 Barrier range-measurement system and its distance measuring method based on monocular vision
CN109827516B (en) * 2019-03-19 2020-09-04 魔视智能科技(上海)有限公司 Method for measuring distance through wheel
CN109827516A (en) * 2019-03-19 2019-05-31 魔视智能科技(上海)有限公司 A method of distance is measured by wheel
CN110006422B (en) * 2019-03-28 2021-03-09 浙江吉利汽车研究院有限公司 Method, device, equipment and storage medium for determining safe operation parameters of equipment
CN110006422A (en) * 2019-03-28 2019-07-12 浙江吉利汽车研究院有限公司 A kind of equipment safety operation determination method for parameter, device, equipment and storage medium
CN110334678A (en) * 2019-07-12 2019-10-15 哈尔滨理工大学 A kind of pedestrian detection method of view-based access control model fusion
CN110533945A (en) * 2019-08-28 2019-12-03 肇庆小鹏汽车有限公司 Method for early warning, system, vehicle and the storage medium of traffic lights
CN110632339A (en) * 2019-10-09 2019-12-31 天津天地伟业信息系统集成有限公司 Water flow testing method of video flow velocity tester
CN111046843A (en) * 2019-12-27 2020-04-21 华南理工大学 Monocular distance measurement method under intelligent driving environment
CN111046843B (en) * 2019-12-27 2023-06-20 华南理工大学 Monocular ranging method in intelligent driving environment
CN113838075B (en) * 2020-06-23 2024-01-09 南宁富联富桂精密工业有限公司 Monocular ranging method, monocular ranging device and computer readable storage medium
CN113838075A (en) * 2020-06-23 2021-12-24 南宁富桂精密工业有限公司 Monocular distance measuring method, device and computer readable storage medium
US20220121850A1 (en) * 2020-10-19 2022-04-21 Aurora Flight Sciences Corporation, a subsidiary of The Boeing Company Above-horizon target tracking
CN112562331A (en) * 2020-11-30 2021-03-26 的卢技术有限公司 Vision perception-based other-party vehicle track prediction method
CN112802090A (en) * 2021-01-23 2021-05-14 行云智能(深圳)技术有限公司 Monocular vision distance measurement processing method
CN112880642A (en) * 2021-03-01 2021-06-01 苏州挚途科技有限公司 Distance measuring system and distance measuring method
CN113188509B (en) * 2021-04-28 2023-10-24 上海商汤临港智能科技有限公司 Distance measurement method and device, electronic equipment and storage medium
CN113188509A (en) * 2021-04-28 2021-07-30 上海商汤临港智能科技有限公司 Distance measuring method and device, electronic equipment and storage medium
CN113221739A (en) * 2021-05-12 2021-08-06 中国科学技术大学 Monocular vision-based vehicle distance measuring method
CN114295099A (en) * 2021-12-28 2022-04-08 合肥英睿系统技术有限公司 Monocular camera-based distance measurement method, vehicle-mounted distance measurement equipment and storage medium
CN114295099B (en) * 2021-12-28 2024-01-30 合肥英睿系统技术有限公司 Ranging method based on monocular camera, vehicle-mounted ranging equipment and storage medium
CN114228432A (en) * 2022-01-25 2022-03-25 同济大学 Dynamic chassis pre-aiming control method based on pavement state recognition
CN117218681A (en) * 2023-11-09 2023-12-12 厦门瑞为信息技术有限公司 Height estimation method of monocular lens, child passing gate device and judging method
CN117218681B (en) * 2023-11-09 2024-02-06 厦门瑞为信息技术有限公司 Height estimation method of monocular lens, child passing gate device and judging method

Similar Documents

Publication Publication Date Title
CN104899554A (en) Vehicle ranging method based on monocular vision
CN110178167B (en) Intersection violation video identification method based on cooperative relay of cameras
US10970566B2 (en) Lane line detection method and apparatus
CN108960183B (en) Curve target identification system and method based on multi-sensor fusion
CN105488454B (en) Front vehicles detection and ranging based on monocular vision
Nienaber et al. Detecting potholes using simple image processing techniques and real-world footage
CN109299674B (en) Tunnel illegal lane change detection method based on car lamp
CN105913041B (en) It is a kind of based on the signal lamp recognition methods demarcated in advance
US9384401B2 (en) Method for fog detection
US8670592B2 (en) Clear path detection using segmentation-based method
CN101334836B (en) License plate positioning method incorporating color, size and texture characteristic
CN101950350B (en) Clear path detection using a hierachical approach
Danescu et al. Detection and classification of painted road objects for intersection assistance applications
CN105718870A (en) Road marking line extracting method based on forward camera head in automatic driving
CN105260699A (en) Lane line data processing method and lane line data processing device
CN105654073B (en) A kind of speed automatic control method of view-based access control model detection
AU2020102039A4 (en) A high-precision multi-targets visual detection method in automatic driving scene
CN102982304B (en) Utilize polarized light image to detect the method and system of vehicle location
KR101094752B1 (en) Lane Classification Method Using Statistical Model of HSI Color Information
CN103034843B (en) Method for detecting vehicle at night based on monocular vision
US20180114089A1 (en) Attachable matter detection apparatus and attachable matter detection method
CN107886034B (en) Driving reminding method and device and vehicle
KR101191308B1 (en) Road and lane detection system for intelligent transportation system and method therefor
Aminuddin et al. A new approach to highway lane detection by using Hough transform technique
CN112001216A (en) Automobile driving lane detection system based on computer

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150909

WD01 Invention patent application deemed withdrawn after publication