CN104899554A - Vehicle ranging method based on monocular vision - Google Patents
Vehicle ranging method based on monocular vision Download PDFInfo
- Publication number
- CN104899554A CN104899554A CN201510229988.3A CN201510229988A CN104899554A CN 104899554 A CN104899554 A CN 104899554A CN 201510229988 A CN201510229988 A CN 201510229988A CN 104899554 A CN104899554 A CN 104899554A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- video image
- target vehicle
- image
- monocular
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/215—Motion-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
Abstract
The invention discloses a vehicle ranging method based on monocular vision, and belongs to the field of target detection and ranging. The method comprises the steps of installing a monocular camera on a vehicle, measuring the height and the pitching angle of the camera, and determining focal distance parameters of the camera; acquiring a video image in an expressway environment; performing preliminary de-noising and filtration on the video image by adopting Gaussian filtration; performing interest region segmentation preprocessing before detection of a target vehicle on the video image; performing vehicle detection in a segmented video image region, wherein an Haar feature for increasing a wheel feature and a tail feature is adopted in the target vehicle detection, so as to effectively improve the accuracy of target vehicle identification; and measuring the distance of the target vehicle, wherein a ranging method based on pin-hole imaging is adopted within a short-distance range, while a ranging method of data fitting is adopted within a long-distance range, so that the error rate is reduced, and a real-time ranging effect can be achieved. The method has the advantages of high detection speed, high accuracy, strong real-time property and low cost.
Description
Art
The invention belongs to target detection and range finding field, particularly relate to a kind of vehicle odometry method based on monocular vision.
Background technology
Along with the development of highway communication particularly freeway facility, road accident rate also presents ascendant trend, and traffic safety more and more becomes the focus that people pay close attention to.Therefore, research vehicle safety assists driving technology, for vehicle provides safety assistant driving function, thus provides intellectual technology service for reducing the traffic hazard caused because of driver's subjective factor.Computer vision because of its provide contain much information, the factor such as good stability, become the research emphasis that vehicle safety assists driving technology gradually, along with the development of computer vision technique, its effect in Intelligent Vehicle System is constantly perfect, computer vision technique is applied in vehicle detection, great effect is created to the raising of vehicle safety.
Utilize monocular cam to carry out the detection of moving target (such as vehicle), its development roughly experienced by three phases: passive learning stage---Active Learning stage---the adaptive learning stage.In the passive learning stage, mainly according to the feature of image, carry out matching to the object of all existence, the target that after comparing the difference of front and back two field picture, district office will detect, its main algorithm has mixed Gauss model, background subtraction, Kalman filter etc.In the Active Learning stage, mainly for specific moving target, study its inherent feature, by the study to feature, moving target is detected.At present for the vehicle of motion, conventional inherent feature comprises shade that vehicle bottom produces, the entropy of shade, the symmetry of vehicle edge, the brightness of vehicle pixel, the texture etc. of vehicle.In adaptive learning, the detection of moving target is roughly divided into three steps: the first step is feature extraction, here feature mainly mathematical feature, feature extraction algorithm conventional now has HOG, Haar, SIFT, LBT etc., and this step is the basis of two steps next; Second is the training of sorter, and by inputting a large amount of positive negative sample, obtain the sorter identifying target mathematical feature through training, classifier algorithm conventional now comprises SVM, Adaboost etc.; 3rd step is moving object detection, and this step is mainly used through training the sorter obtained, and carries out moving object detection to the video image of input.
Monocular vision range finding is that the picture utilizing a video camera to obtain draws depth information, is mainly divided into the measuring method based on geometric relationship and the measuring method based on data message according to the principle measured.Measuring method based on geometric relationship refers to that the picture utilizing the structure of video camera and video camera to obtain records depth distance.Utilizing theory on computer vision and method, carrying out the front vehicles in runway, on quick detection and the basis demarcated in advance video camera, utilizing camera parameters and road geometric model, obtaining front vehicles distance.The shortcoming of above-mentioned measurement is the coupling will carrying out unique point to a width or a few width picture, and matching error has obvious impact to measurement result, and the processing time is long simultaneously, for multiple image, then must need more computing time.
Measuring method based on data message refers to that the Target Photo utilizing video camera to obtain under the condition of known object information obtains depth distance.The shortcoming of these class methods needs the accurate information utilizing image to measure, and easily causes the inaccurate of measurement because of the inaccurate of image information.
Summary of the invention
For the deficiency that existing method exists, the present invention proposes a kind of vehicle odometry method based on monocular vision.
Technical scheme of the present invention is achieved in that
Based on a vehicle odometry method for monocular vision, vehicle odometry object is the front vehicles travelled in the same way, comprises the steps:
Step 1: install monocular cam on vehicle, measures camera height and the angle of pitch thereof, and determines camera focal length parameter;
First monocular cam is fixed on vehicle front, determines this camera distance height on ground and the angle of axis and horizontal direction thereof, be i.e. the vertical height of this monocular cam and the angle of pitch;
Step 2: the video image under utilizing described monocular cam to gather highway environment;
Step 3: the video image preprocessing process before target vehicle detection;
Step 3.1: adopt gaussian filtering to carry out preliminary denoising, filtering process to video image;
Step 3.2: the segmentation of the region-of-interest before target vehicle detection pre-service is carried out to the video image after step 3.1 rough handling;
Step 4: target vehicle detection process;
Carry out vehicle detection in video image region after singulation, and the target vehicle detected is marked in real time on picture;
Step 5: target vehicle ranging process;
Measurement target vehicle distances also shows this target vehicle distance in real time on video pictures.
Described step 3.2 comprises following concrete steps:
Step 3.2.1: sky areas segmentation is carried out to the video image gathered;
Adopt the video image gathered and carry out sky areas segmentation based on color space, method is specific as follows: first obtain the histogram of video image in HIS (tone, color saturation, brightness), RGB (red, green, blue three look), YIQ (brightness, tone, saturation degree) and YCbCr (colour brightness, blueness and red color side-play amount) four kinds of color spaces; Then in these four kinds of color spaces, determine the distribution range of each color component of sky areas respectively, calculate and the variance of more determined Four composition cloth range data and extreme value, choose wherein variance and the minimum also YCbCr color space that namely distribution of each component is the most concentrated of extreme value as the color space of sky spatial segmentation; Finally binary conversion treatment is carried out to video image, determine the UNICOM region of sky and calculate its area, and adopting Otsu Adaptive Thresholding, automatically adjusting segmentation threshold, sky portion is removed from image;
Step 3.2.2: to the video image after the segmentation of sky areas, adopt Minimum error threshold method inspection vehicle diatom, namely near the road edge line of image border, and two-dimentional straight-line equation is set up to the lane line detected, and the region of removing based on this equation outside edge line, reduce vehicle detection region area further;
Described step 4 comprises following concrete steps:
Step 4.1: gather positive and negative sample image (positive sample refers to vehicle rear picture, and negative sample refers to other any image, but can not comprise vehicle rear), be normalized as onesize to all positive and negative samples pictures;
Step 4.2: increase tailstock characteristic sum back wheels of vehicle feature in Haar feature, and according to this Haar feature, adopt Adaboost algorithm to train positive and negative sample set, obtain cascade classifier;
Step 4.3: utilize the cascade classifier obtained, target vehicle detection is carried out to the video image of monocular cam collection, and the target vehicle detected is marked in real time on picture;
In target vehicle detection process in described step 4.3, multiple dimensioned windowhood method (multiscale approach) video image to monocular cam collection is utilized to carry out Scanning Detction;
In described step 5, the method for measurement target vehicle distances is as follows:
If target vehicle distance is within 30 meters, then set up video camera projection model according to pinhole imaging system principle, world coordinate system is projected in image coordinate system, sets up vehicle odometry geometric relationship model by relation corresponding between Two coordinate system, ask for objects ahead vehicle distances; If target vehicle distance is greater than 30 meters, then first obtains the mapping relations between real road sample point and picture plane by data fitting method, and ask for objects ahead vehicle distances according to these mapping relations.
Advantage of the present invention is: the suitable environment of the vehicle odometry method based on monocular vision of the present invention is highway, first the method carries out the acquisition of call parameter to the monocular cam be arranged on vehicle, then after adopting gaussian filtering to carry out rough handling to the video image of this camera acquisition, again pre-service is carried out to video image: be first adopt the sky areas dividing method based on color space, rational segmentation threshold is found by the method for adaptive adjustment threshold value, tell sky areas, decrease the scan area of image; Next territory, track is split, further reduce the scan area of image; The Haar feature being the increase in wheel characteristics and tailstock feature adopted in the process of target vehicle detection, effectively improves the accuracy of target vehicle identification; In the process of target vehicle detection (identification), adopt multiple dimensioned windowhood method to carry out Scanning Detction to the video image of monocular cam collection, also can significantly improve target vehicle detection speed.In target vehicle range observation, in short range, (within 30 meters) adopt the distance-finding method based on pinhole imaging system; The scope of long distance (is greater than 30 meters), adopts the distance-finding method of data fitting (linear difference), reduce error rate, the effect of real time distance can be reached.And method of the present invention only adopts a camera collection video, and equipment is simple.Therefore, method of the present invention has that detection speed is fast, and accuracy rate is high, the comparatively strong and advantage that cost is low of real-time.
Accompanying drawing explanation
Fig. 1 is the vehicle odometry method flow diagram based on monocular vision of one embodiment of the present invention;
Fig. 2 is the Haar characteristic set figure of one embodiment of the present invention;
Fig. 3 is that the Adaboost of one embodiment of the present invention trains process flow diagram;
Fig. 4 is the multiple dimensioned windowhood method scanning process schematic diagram of one embodiment of the present invention;
Fig. 5 is the pinhole imaging system principle schematic of one embodiment of the present invention;
Fig. 6 is schematic diagram when tested point departs from center in the pinhole imaging system of one embodiment of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
Fig. 1 is the vehicle odometry method flow diagram based on monocular vision of present embodiment, and the method comprises following concrete steps:
Step 1: install monocular cam on vehicle, measures camera height, knows camera focal length parameter;
First monocular cam is fixed on vehicle front, determines this camera distance height on ground and the angle of its axis and horizontal direction thereof, be i.e. the vertical height of this monocular cam and the angle of pitch;
Step 2: the video image under utilizing described monocular cam to gather highway environment;
Step 3: the video image preprocessing process before target vehicle detection;
Step 3.1: adopt gaussian filtering to carry out preliminary denoising, filtering process to video image;
Step 3.2: the segmentation of the region-of-interest before target vehicle detection pre-service is carried out to the video image after step 3.1 rough handling, needs processing region to reduce, improve target vehicle detection speed;
Step 3.2.1: sky areas segmentation is carried out to the video image gathered;
Adopt the method for carrying out sky areas segmentation based on color space, specific as follows: first to obtain the histogram of video image in HIS (tone, color saturation, brightness), RGB (red, green, blue three look), YIQ (brightness, tone, saturation degree) and YCbCr (colour brightness, blueness and red color side-play amount) four kinds of color spaces; Then in these four kinds of color spaces, determine the distribution range of each color component of sky areas respectively, the variance of calculating and more determined Four composition cloth range data and extreme value, choose the color space of the minimum also YCbCr color space that namely distribution of each component is the most concentrated of wherein variance and extreme value as sky spatial segmentation, experiment finds, for YCbCr color space, Y and Cr distribution is more concentrated, the distributed areas of sky can be recognized preferably, and less on the impact of entire image, therefore adopt YCbCr color space as the color space removing sky; Finally binary conversion treatment is carried out to video image, determine the UNICOM region of sky and calculate its area, and adopting Otsu Adaptive Thresholding, automatically adjusting segmentation threshold, sky portion is removed from image; Present embodiment is to remove the harmful effect of the undesirable elements such as illumination to COLOR COMPOSITION THROUGH DISTRIBUTION region in sky spatial segmentation process, adopts Otsu Adaptive Thresholding automatically suitably to adjust threshold value thus improves the accuracy of sky segmentation;
Formula (1) is the process function to sky areas in experiment, the gray-scale value that F (x, y) is image.When sky areas meets the color element scope in formula (1), the gray-scale value of sky areas is set to 255, removes sky areas.
In order to get rid of the distracter (color, building etc. as car) consistent with sky color that may exist in picture, when only having the area when UNICOM region to be greater than 1/10 of image, small pieces just can be removed, and eliminate disturbing factor so to a great extent.After the image of sky areas detects, corresponding cutting process can be carried out, for follow-up vehicle detection process.
Pixel coverage due to sky is vulnerable to the impact of the undesirable elements such as illumination, can be found by the histogram distribution of image, the color gamut of sky obeys Gauss normal distribution, if suitable threshold value can be found, image is divided into sky and non-sky portion, so just can well solves have impact on of the problems such as light.
According to Otsu Adaptive Thresholding, with the separation of threshold value ψ as binaryzation, what be greater than ψ is classified as a class, is less than being classified as of ψ another kind of, if the average of two classes is respectively v
1and v
2, the distribution probability of two classes is respectively u
1and u
2.
α
2=u
1u
2(v
2-v
1)
2(2)
By adjusting the size of threshold value ψ, allow variance α
2obtain maximal value, ψ at this time can as the threshold value of sky areas segmentation.
Present embodiment adopts adaptivenon-uniform sampling algorithm, and for the sky that process illumination is undesirable, effect is ideal.
Step 3.2.2: to the video image after the segmentation of sky areas, adopt Minimum error threshold method inspection vehicle diatom, namely near the road edge line of image border, and two-dimentional straight-line equation is set up to the lane line detected, and the region of removing based on this equation outside edge line, reduce vehicle detection region area further; Most of extraneous areas can be removed through sky areas segmentation and this twice segmentation of track regional partition process, reduce image-region to be dealt with in vehicle detection, thus improve the speed of vehicle detection.
Present embodiment adopts Minimum error threshold method inspection vehicle diatom, and determine road area and non-rice habitats region with this.Extraneous areas in every frame picture is got rid of, only retains road sections.Minimum error threshold algorithm has good noise immunity, and Detection results is desirable.Compared to two-dimentional Minimum error threshold algorithm, the calculated amount of one dimension least error algorithm is less, greatly can shorten the processing time, and can meet the requirement of the image process in early stage for target vehicle identification (detection).
Detailed process is as follows:
Be the image of M × N for a width size, if the gray-scale value that coordinate is the pixel of (x, y) be h (x, y) ∈ G=[0,1 ..., 255].Represent the one dimensional histograms of image by function f (g), it represent the frequency that in image, each gray-scale value occurs, for gray threshold m ∈ G=[0,1 ..., 255], the function of minimum classification error is
Z(m)=1+2[P
0(m)lnσ
0(m)+P
1(m)lnσ
1(m)]-2[P
0(m)lnP
0(m)+P
1(m)lnP
1(m)] (3)
Wherein,
And
It is the prior probability of two son distributions;
With
It is the average of two son distributions;
With
it is the variance of two son distributions; Optimum gradation threshold value m
*for the threshold value making Z (m) get minimum value, at this moment there is m
*=arg (minZ (m)) (0 < m < 255); The classifying mode of the pixel after therefore can obtaining Minimum error threshold is:
Wherein,
for the pixel after Minimum error threshold; H (x, y) is the pixel before Minimum error threshold.
Experiment proves, Minimum error threshold method can be good at by lane detection out.Track and non-track can be separated by the lane line equation set up in two dimensional surface, a large amount of extraneous areas can be removed, thus the workload of vehicle detection process can be reduced.
Step 4: target vehicle detection process;
Carry out vehicle detection in video image region after singulation, and the target vehicle detected is marked in real time on picture;
Step 4.1: gather positive and negative sample image; Wherein positive sample refers to vehicle rear picture, and negative sample refers to other any image, but can not comprise vehicle rear, is all normalized all positive and negative samples pictures, and present embodiment is that all pictures are all normalized to 20*20.
Step 4.2: increase tailstock characteristic sum wheel characteristics in Haar feature, and according to amended Haar feature, adopt Adaboost algorithm to train positive and negative sample set, obtain cascade classifier.
Eigenwert according to feature templates defines, white rectangle pixel and deduct black rectangle pixel and, because integrogram has that computing velocity is fast and calculated value is only relevant with edge, so, adopt integrogram to calculate Haar eigenwert herein.
Present embodiment, on the basis of original Haar feature, adds wheel characteristics and tailstock feature as shown in Figure 2.The accuracy rate of target vehicle detection can be improved.The computing method of Haar feature be white rectangle pixel and deduct black rectangle pixel and, because integrogram has that computing velocity is fast and calculated value is only relevant with edge, so, adopt integrogram to calculate Haar eigenwert to improve computing velocity herein.
Present embodiment, further according to Haar feature, utilizes Adaboost algorithm to align negative sample and trains, obtain cascade classifier.As shown in Figure 3, cascade classifier is made up of multiple Weak Classifier training process flow diagram, and every one-level is all complicated than previous stage.Each sorter can allow nearly all positive example pass through, the negative example of the major part of filtering simultaneously.The positive example to be detected of so every one-level is just few than previous stage, eliminates a large amount of non-detection targets, greatly can improve detection speed.
Step 4.3: utilize the cascade classifier obtained, the video image of monocular cam collection is detected, and in testing process, utilizes multiple dimensioned windowhood method (multiscale approach) to scan;
In order to reduce the time spent when calculating rectangular characteristic, present embodiment have employed multiple dimensioned windowhood method and scans, namely respectively Subarea detecting is carried out to image with the subwindow of different size, and calculate the Haar feature of zones of different simultaneously, scanning schematic diagram as shown in Figure 4, according to the feature of vehicle detection, utilize the vehicle feature that the tailstock varies in size when different distance, image is divided into four regions, and with the subwindow of four different sizes, Subarea detecting is carried out to image, and calculate the Haar feature of four subwindows simultaneously.
Step 5: measurement target vehicle distances also shows this target vehicle distance in real time on video pictures.
If target vehicle distance is within 30 meters, then set up video camera projection model according to pinhole imaging system principle, world coordinate system is projected in image coordinate system, sets up vehicle odometry geometric relationship model by relation corresponding between Two coordinate system, ask for objects ahead vehicle distances; According to pinhole imaging system principle, object in world coordinate system is projected in image coordinate system through small holes, as shown in Figure 5, the reality imagery of plane bchq corresponding to world coordinate system, the projection image of plane BCHQ corresponding to image coordinate system, in plane bchq, hq limit and bc limit extend intersection point is s, and simultaneously s point is also the intersection point of road extended line, and road surface is actual, and that be observed is trapezoidal bchq.Representated by M point is the aperture that convex lens are formed.
If do not consider the impact of camera distortion, optical axis Ii is the center of two planes at the intersection point of two corresponding flats, I as shown in Figure 5, i 2 point.
As shown in Figure 5, in world coordinate system, get a t, through the projection of a M, obtain the some T in image coordinate system.∠ TMI and the ∠ α of Δ MIT can be found
2be equal, and line segment MI is the focal distance f of lens in video camera, so there is tan α
2in=TI/f, Fig. 5, MN is horizontal line, ∠ α
1the angle of pitch formed by optical axis and horizontal line, the height that camera is installed is δ=MW, and observed some t is S=Wi to the distance of photocentre, has:
Thus can in the hope of range formula:
As shown in Figure 6, when tested point departs from center time, need calculating off-centered lateral separation
so measured actual range is
In order to ask for d
2point, chooses b
1point is test point, b
1point is B at the subpoint of image coordinate system
1; The another one test point crossing with sides aligned parallel and with center line is a
1, the intersection point projecting to image coordinate system is accordingly A
1; By the existence of projection theory and vertical plane, ∠ MA can be known
1b
1with ∠ Ma
1b
1be 90 °, owing to also there are a pair vertical angle, so Δ MA
1b
1with Δ Ma
1b
1similar.The criterion proportional according to similar triangles corresponding sides, obtains following formula:
For A
1b
1, in image coordinate system, if the distance between horizontal ordinate pixel and ordinate pixel is respectively d
xand d
y, then A
1b
1between actual range be then
wherein
represent A
1b
1pixel value difference.
In like manner for MA
1, can push away according to the relation between pixel and actual range and obtain its expression formula and be:
Wherein
that represent is A
1the pixel value difference of I.
For Ma
1, owing to having tried to achieve d by Fig. 5
1, the Wa namely in figure
1, the geometric relationship from figure:
A
1b
1be the parameter d of requirement
2.In sum, the formula calculating distance is:
In formula (9), the focal distance f of video camera and TI can check in from the specifications parameter of camera, and setting height(from bottom) h can measure and obtain, α
1can try to achieve with formula (5).
If target vehicle distance is greater than 30 meters, then first obtains the mapping relations between real road sample point and picture plane by data fitting method, and ask for objects ahead vehicle distances according to these mapping relations.For the video camera laid perpendicular to ground that a frame specification is determined, when its angle of pitch is determined, the distance range of the road ahead that it can detect is certain, position coordinates in the world coordinate system that on image area, each point is corresponding is also certain, as long as so find the position corresponding relation between image coordinate system and world coordinate system just can ask for front vehicles distance by this relation in reality range finding.This method effectively overcomes the harmful effect that the path error such as the lens distortion existed in actual imaging cause, and the problem such as video camera modes of emplacement, surface conditions, road type (straight way or structured road).
The relation matching of Two coordinate system needs to obtain data by experiment to realize.What the data obtained in experiment were formed is discrete point, and present embodiment is the relation of the method construct Two coordinate system adopting cubic spline interpolation.
Claims (6)
1., based on a vehicle odometry method for monocular vision, vehicle odometry object is the front vehicles travelled in the same way, it is characterized in that: comprise the steps:
Step 1: install monocular cam on vehicle, measures camera height and the angle of pitch thereof, and determines camera focal length parameter;
First monocular cam is fixed on vehicle front, determines this camera distance height on ground and the angle of axis and horizontal direction thereof, be i.e. the vertical height of this monocular cam and the angle of pitch;
Step 2: the video image under utilizing described monocular cam to gather highway environment;
Step 3: the video image preprocessing process before target vehicle detection;
Step 3.1: adopt gaussian filtering to carry out preliminary denoising, filtering process to video image;
Step 3.2: the segmentation of the region-of-interest before target vehicle detection pre-service is carried out to the video image after step 3.1 rough handling;
Step 4: target vehicle detection process;
Carry out vehicle detection in video image region after singulation, and the target vehicle detected is marked in real time on picture;
Step 5: target vehicle ranging process;
Measurement target vehicle distances also shows this target vehicle distance in real time on video pictures.
2. the vehicle odometry method based on monocular vision according to claim 1, is characterized in that: described step 3.2 comprises following concrete steps:
Step 3.2.1: sky areas segmentation is carried out to the video image gathered;
Step 3.2.2: to the video image after the segmentation of sky areas, adopt Minimum error threshold method inspection vehicle diatom, namely near the road edge line of image border, and two-dimentional straight-line equation is set up to the lane line detected, and the region of removing based on this equation outside edge line, reduce vehicle detection region area further.
3. the vehicle odometry method based on monocular vision according to claim 1, is characterized in that: described step 4 comprises following concrete steps:
Step 4.1: gather positive and negative sample image, is normalized as onesize to all positive and negative samples pictures; Wherein positive sample refers to vehicle rear picture, and negative sample refers to other any image, but can not comprise vehicle rear;
Step 4.2: increase tailstock characteristic sum back wheels of vehicle feature in Haar feature, and according to this Haar feature, adopt Adaboost algorithm to train positive and negative sample set, obtain cascade classifier;
Step 4.3: utilize the cascade classifier obtained, target vehicle detection is carried out to the video image of monocular cam collection, and the target vehicle detected is marked in real time on picture.
4. the vehicle odometry method based on monocular vision according to claim 2, it is characterized in that: adopt the video image gathered in described step 3.2.1 and carry out sky areas segmentation based on color space, method is specific as follows: first obtain the histogram of video image in HIS, RGB, YIQ and YCbCr tetra-kinds of color spaces; Then in these four kinds of color spaces, determine the distribution range of each color component of sky areas respectively, calculate and the variance of more determined Four composition cloth range data and extreme value, choose wherein variance and the minimum also YCbCr color space that namely distribution of each component is the most concentrated of extreme value as the color space of sky spatial segmentation; Finally binary conversion treatment is carried out to video image, determine the UNICOM region of sky and calculate its area, and adopting Otsu Adaptive Thresholding, automatically adjusting segmentation threshold, sky portion is removed from image.
5. the vehicle odometry method based on monocular vision according to claim 3, is characterized in that: in the target vehicle detection process in described step 4.3, utilizes multiple dimensioned windowhood method to carry out Scanning Detction to the video image of monocular cam collection.
6. the vehicle odometry method based on monocular vision according to claim 1, is characterized in that: in described step 5, the method for measurement target vehicle distances is as follows:
If target vehicle distance is within 30 meters, then set up video camera projection model according to pinhole imaging system principle, world coordinate system is projected in image coordinate system, sets up vehicle odometry geometric relationship model by relation corresponding between Two coordinate system, ask for objects ahead vehicle distances; If target vehicle distance is greater than 30 meters, then first obtains the mapping relations between real road sample point and picture plane by data fitting method, and ask for objects ahead vehicle distances according to these mapping relations.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510229988.3A CN104899554A (en) | 2015-05-07 | 2015-05-07 | Vehicle ranging method based on monocular vision |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510229988.3A CN104899554A (en) | 2015-05-07 | 2015-05-07 | Vehicle ranging method based on monocular vision |
Publications (1)
Publication Number | Publication Date |
---|---|
CN104899554A true CN104899554A (en) | 2015-09-09 |
Family
ID=54032210
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510229988.3A Pending CN104899554A (en) | 2015-05-07 | 2015-05-07 | Vehicle ranging method based on monocular vision |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104899554A (en) |
Cited By (39)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105354857A (en) * | 2015-12-07 | 2016-02-24 | 北京航空航天大学 | Matching method for vehicle track shielded by overpass |
CN105488454A (en) * | 2015-11-17 | 2016-04-13 | 天津工业大学 | Monocular vision based front vehicle detection and ranging method |
CN105718870A (en) * | 2016-01-15 | 2016-06-29 | 武汉光庭科技有限公司 | Road marking line extracting method based on forward camera head in automatic driving |
CN106157311A (en) * | 2016-07-04 | 2016-11-23 | 南京安驾信息科技有限公司 | Scaling method and the device of system is identified for vehicle ADAS |
FR3045816A1 (en) * | 2015-12-22 | 2017-06-23 | Renault Sas | METHOD AND DEVICE FOR DETERMINING SPATIAL POSITIONS AND CINEMATIC PARAMETERS OF OBJECTS IN THE ENVIRONMENT OF A VEHICLE |
CN107148639A (en) * | 2015-09-15 | 2017-09-08 | 深圳市大疆创新科技有限公司 | It is determined that method and device, tracks of device and the system of the positional information of tracking target |
CN107305632A (en) * | 2017-02-16 | 2017-10-31 | 武汉极目智能技术有限公司 | Destination object distance measurement method and system based on monocular computer vision technique |
CN107341478A (en) * | 2017-07-11 | 2017-11-10 | 京东方科技集团股份有限公司 | The vehicle checking method and its device of a kind of DAS (Driver Assistant System) |
CN107764233A (en) * | 2016-08-15 | 2018-03-06 | 杭州海康威视数字技术股份有限公司 | A kind of measuring method and device |
CN107832788A (en) * | 2017-11-01 | 2018-03-23 | 青岛理工大学 | A kind of vehicle distance measurement method based on monocular vision and Car license recognition |
CN108122244A (en) * | 2016-11-30 | 2018-06-05 | 浙江宇视科技有限公司 | The video frequency speed-measuring method and device of a kind of video image |
CN108759667A (en) * | 2018-05-29 | 2018-11-06 | 福州大学 | Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera |
CN108830159A (en) * | 2018-05-17 | 2018-11-16 | 武汉理工大学 | A kind of front vehicles monocular vision range-measurement system and method |
CN109117691A (en) * | 2017-06-23 | 2019-01-01 | 百度在线网络技术(北京)有限公司 | Drivable region detection method, device, equipment and storage medium |
CN109146948A (en) * | 2018-07-27 | 2019-01-04 | 内蒙古大学 | The quantization of crop growing state phenotypic parameter and the correlation with yield analysis method of view-based access control model |
CN109443319A (en) * | 2018-12-21 | 2019-03-08 | 联创汽车电子有限公司 | Barrier range-measurement system and its distance measuring method based on monocular vision |
CN109583267A (en) * | 2017-09-28 | 2019-04-05 | 京东方科技集团股份有限公司 | Vehicle object detection method, vehicle object detecting device and vehicle |
CN109724560A (en) * | 2018-12-17 | 2019-05-07 | 南京理工大学 | A kind of monocular range-measurement system based on Inertial Measurement Unit |
CN109827516A (en) * | 2019-03-19 | 2019-05-31 | 魔视智能科技(上海)有限公司 | A method of distance is measured by wheel |
CN109979206A (en) * | 2017-12-28 | 2019-07-05 | 杭州海康威视系统技术有限公司 | Vehicle speed measuring method, device, system, electronic equipment and storage medium |
CN110006422A (en) * | 2019-03-28 | 2019-07-12 | 浙江吉利汽车研究院有限公司 | A kind of equipment safety operation determination method for parameter, device, equipment and storage medium |
CN110334678A (en) * | 2019-07-12 | 2019-10-15 | 哈尔滨理工大学 | A kind of pedestrian detection method of view-based access control model fusion |
CN110533945A (en) * | 2019-08-28 | 2019-12-03 | 肇庆小鹏汽车有限公司 | Method for early warning, system, vehicle and the storage medium of traffic lights |
CN110632339A (en) * | 2019-10-09 | 2019-12-31 | 天津天地伟业信息系统集成有限公司 | Water flow testing method of video flow velocity tester |
CN110966981A (en) * | 2018-09-30 | 2020-04-07 | 北京奇虎科技有限公司 | Distance measuring method and device |
CN111046843A (en) * | 2019-12-27 | 2020-04-21 | 华南理工大学 | Monocular distance measurement method under intelligent driving environment |
US10860040B2 (en) | 2015-10-30 | 2020-12-08 | SZ DJI Technology Co., Ltd. | Systems and methods for UAV path planning and control |
CN112562331A (en) * | 2020-11-30 | 2021-03-26 | 的卢技术有限公司 | Vision perception-based other-party vehicle track prediction method |
CN112802090A (en) * | 2021-01-23 | 2021-05-14 | 行云智能(深圳)技术有限公司 | Monocular vision distance measurement processing method |
CN112880642A (en) * | 2021-03-01 | 2021-06-01 | 苏州挚途科技有限公司 | Distance measuring system and distance measuring method |
CN113188509A (en) * | 2021-04-28 | 2021-07-30 | 上海商汤临港智能科技有限公司 | Distance measuring method and device, electronic equipment and storage medium |
CN113221739A (en) * | 2021-05-12 | 2021-08-06 | 中国科学技术大学 | Monocular vision-based vehicle distance measuring method |
CN113838075A (en) * | 2020-06-23 | 2021-12-24 | 南宁富桂精密工业有限公司 | Monocular distance measuring method, device and computer readable storage medium |
CN114228432A (en) * | 2022-01-25 | 2022-03-25 | 同济大学 | Dynamic chassis pre-aiming control method based on pavement state recognition |
CN114295099A (en) * | 2021-12-28 | 2022-04-08 | 合肥英睿系统技术有限公司 | Monocular camera-based distance measurement method, vehicle-mounted distance measurement equipment and storage medium |
US20220121850A1 (en) * | 2020-10-19 | 2022-04-21 | Aurora Flight Sciences Corporation, a subsidiary of The Boeing Company | Above-horizon target tracking |
US11392801B2 (en) | 2018-05-29 | 2022-07-19 | Huawei Technologies Co., Ltd. | Action recognition method and apparatus |
US11478169B2 (en) | 2017-10-13 | 2022-10-25 | Huawei Technologies Co., Ltd. | Action recognition and pose estimation method and apparatus |
CN117218681A (en) * | 2023-11-09 | 2023-12-12 | 厦门瑞为信息技术有限公司 | Height estimation method of monocular lens, child passing gate device and judging method |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102661733A (en) * | 2012-05-28 | 2012-09-12 | 天津工业大学 | Front vehicle ranging method based on monocular vision |
-
2015
- 2015-05-07 CN CN201510229988.3A patent/CN104899554A/en active Pending
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102661733A (en) * | 2012-05-28 | 2012-09-12 | 天津工业大学 | Front vehicle ranging method based on monocular vision |
Non-Patent Citations (3)
Title |
---|
刘燕等: ""基于计算机视觉的单目摄影纵向车距测量系统研究"", 《公路交通科技》 * |
宋彩霞等: ""车量测距方法"", 《电子测量与仪器学报》 * |
韦庭: ""基于单目视觉的辅助驾驶系统中的图像处理研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (64)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107148639A (en) * | 2015-09-15 | 2017-09-08 | 深圳市大疆创新科技有限公司 | It is determined that method and device, tracks of device and the system of the positional information of tracking target |
US10976753B2 (en) | 2015-09-15 | 2021-04-13 | SZ DJI Technology Co., Ltd. | System and method for supporting smooth target following |
US10928838B2 (en) | 2015-09-15 | 2021-02-23 | SZ DJI Technology Co., Ltd. | Method and device of determining position of target, tracking device and tracking system |
US11635775B2 (en) | 2015-09-15 | 2023-04-25 | SZ DJI Technology Co., Ltd. | Systems and methods for UAV interactive instructions and control |
CN107148639B (en) * | 2015-09-15 | 2019-07-16 | 深圳市大疆创新科技有限公司 | Determine method and device, tracking device and the system of the location information of tracking target |
US10860040B2 (en) | 2015-10-30 | 2020-12-08 | SZ DJI Technology Co., Ltd. | Systems and methods for UAV path planning and control |
CN105488454B (en) * | 2015-11-17 | 2019-04-23 | 天津工业大学 | Front vehicles detection and ranging based on monocular vision |
CN105488454A (en) * | 2015-11-17 | 2016-04-13 | 天津工业大学 | Monocular vision based front vehicle detection and ranging method |
CN105354857B (en) * | 2015-12-07 | 2018-09-21 | 北京航空航天大学 | A kind of track of vehicle matching process for thering is viaduct to block |
CN105354857A (en) * | 2015-12-07 | 2016-02-24 | 北京航空航天大学 | Matching method for vehicle track shielded by overpass |
WO2017109359A1 (en) * | 2015-12-22 | 2017-06-29 | Renault S.A.S | Method and device for determining spatial positions and kinematic parameters of objects in the environment of a vehicle |
FR3045816A1 (en) * | 2015-12-22 | 2017-06-23 | Renault Sas | METHOD AND DEVICE FOR DETERMINING SPATIAL POSITIONS AND CINEMATIC PARAMETERS OF OBJECTS IN THE ENVIRONMENT OF A VEHICLE |
CN105718870B (en) * | 2016-01-15 | 2019-06-14 | 武汉光庭科技有限公司 | Based on the preceding roadmarking extracting method to camera in automatic Pilot |
CN105718870A (en) * | 2016-01-15 | 2016-06-29 | 武汉光庭科技有限公司 | Road marking line extracting method based on forward camera head in automatic driving |
CN106157311A (en) * | 2016-07-04 | 2016-11-23 | 南京安驾信息科技有限公司 | Scaling method and the device of system is identified for vehicle ADAS |
US11017552B2 (en) | 2016-08-15 | 2021-05-25 | Hangzhou Hikvision Digital Technology Co., Ltd | Measurement method and apparatus |
CN107764233B (en) * | 2016-08-15 | 2020-09-04 | 杭州海康威视数字技术股份有限公司 | Measuring method and device |
CN107764233A (en) * | 2016-08-15 | 2018-03-06 | 杭州海康威视数字技术股份有限公司 | A kind of measuring method and device |
CN108122244B (en) * | 2016-11-30 | 2022-02-01 | 浙江宇视科技有限公司 | Video speed measuring method and device for video image |
CN108122244A (en) * | 2016-11-30 | 2018-06-05 | 浙江宇视科技有限公司 | The video frequency speed-measuring method and device of a kind of video image |
CN107305632B (en) * | 2017-02-16 | 2020-06-12 | 武汉极目智能技术有限公司 | Monocular computer vision technology-based target object distance measuring method and system |
CN107305632A (en) * | 2017-02-16 | 2017-10-31 | 武汉极目智能技术有限公司 | Destination object distance measurement method and system based on monocular computer vision technique |
CN109117691A (en) * | 2017-06-23 | 2019-01-01 | 百度在线网络技术(北京)有限公司 | Drivable region detection method, device, equipment and storage medium |
CN107341478A (en) * | 2017-07-11 | 2017-11-10 | 京东方科技集团股份有限公司 | The vehicle checking method and its device of a kind of DAS (Driver Assistant System) |
US20190019041A1 (en) * | 2017-07-11 | 2019-01-17 | Boe Technology Group Co., Ltd. | Method and apparatus for detecting a vehicle in a driving assisting system |
US10579883B2 (en) * | 2017-07-11 | 2020-03-03 | Boe Technology Group Co., Ltd. | Method and apparatus for detecting a vehicle in a driving assisting system |
US11482013B2 (en) | 2017-09-28 | 2022-10-25 | Beijing Boe Technology Development Co., Ltd. | Object tracking method, object tracking apparatus, vehicle having the same, and computer-program product |
CN109583267A (en) * | 2017-09-28 | 2019-04-05 | 京东方科技集团股份有限公司 | Vehicle object detection method, vehicle object detecting device and vehicle |
US11478169B2 (en) | 2017-10-13 | 2022-10-25 | Huawei Technologies Co., Ltd. | Action recognition and pose estimation method and apparatus |
CN107832788B (en) * | 2017-11-01 | 2021-07-23 | 青岛中汽特种汽车有限公司 | Vehicle distance measuring method based on monocular vision and license plate recognition |
CN107832788A (en) * | 2017-11-01 | 2018-03-23 | 青岛理工大学 | A kind of vehicle distance measurement method based on monocular vision and Car license recognition |
CN109979206A (en) * | 2017-12-28 | 2019-07-05 | 杭州海康威视系统技术有限公司 | Vehicle speed measuring method, device, system, electronic equipment and storage medium |
CN108830159A (en) * | 2018-05-17 | 2018-11-16 | 武汉理工大学 | A kind of front vehicles monocular vision range-measurement system and method |
US11704938B2 (en) | 2018-05-29 | 2023-07-18 | Huawei Technologies Co., Ltd. | Action recognition method and apparatus |
US11392801B2 (en) | 2018-05-29 | 2022-07-19 | Huawei Technologies Co., Ltd. | Action recognition method and apparatus |
CN108759667A (en) * | 2018-05-29 | 2018-11-06 | 福州大学 | Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera |
CN109146948A (en) * | 2018-07-27 | 2019-01-04 | 内蒙古大学 | The quantization of crop growing state phenotypic parameter and the correlation with yield analysis method of view-based access control model |
CN110966981A (en) * | 2018-09-30 | 2020-04-07 | 北京奇虎科技有限公司 | Distance measuring method and device |
CN110966981B (en) * | 2018-09-30 | 2023-03-24 | 北京奇虎科技有限公司 | Distance measuring method and device |
CN109724560A (en) * | 2018-12-17 | 2019-05-07 | 南京理工大学 | A kind of monocular range-measurement system based on Inertial Measurement Unit |
CN109443319A (en) * | 2018-12-21 | 2019-03-08 | 联创汽车电子有限公司 | Barrier range-measurement system and its distance measuring method based on monocular vision |
CN109827516B (en) * | 2019-03-19 | 2020-09-04 | 魔视智能科技(上海)有限公司 | Method for measuring distance through wheel |
CN109827516A (en) * | 2019-03-19 | 2019-05-31 | 魔视智能科技(上海)有限公司 | A method of distance is measured by wheel |
CN110006422B (en) * | 2019-03-28 | 2021-03-09 | 浙江吉利汽车研究院有限公司 | Method, device, equipment and storage medium for determining safe operation parameters of equipment |
CN110006422A (en) * | 2019-03-28 | 2019-07-12 | 浙江吉利汽车研究院有限公司 | A kind of equipment safety operation determination method for parameter, device, equipment and storage medium |
CN110334678A (en) * | 2019-07-12 | 2019-10-15 | 哈尔滨理工大学 | A kind of pedestrian detection method of view-based access control model fusion |
CN110533945A (en) * | 2019-08-28 | 2019-12-03 | 肇庆小鹏汽车有限公司 | Method for early warning, system, vehicle and the storage medium of traffic lights |
CN110632339A (en) * | 2019-10-09 | 2019-12-31 | 天津天地伟业信息系统集成有限公司 | Water flow testing method of video flow velocity tester |
CN111046843A (en) * | 2019-12-27 | 2020-04-21 | 华南理工大学 | Monocular distance measurement method under intelligent driving environment |
CN111046843B (en) * | 2019-12-27 | 2023-06-20 | 华南理工大学 | Monocular ranging method in intelligent driving environment |
CN113838075B (en) * | 2020-06-23 | 2024-01-09 | 南宁富联富桂精密工业有限公司 | Monocular ranging method, monocular ranging device and computer readable storage medium |
CN113838075A (en) * | 2020-06-23 | 2021-12-24 | 南宁富桂精密工业有限公司 | Monocular distance measuring method, device and computer readable storage medium |
US20220121850A1 (en) * | 2020-10-19 | 2022-04-21 | Aurora Flight Sciences Corporation, a subsidiary of The Boeing Company | Above-horizon target tracking |
CN112562331A (en) * | 2020-11-30 | 2021-03-26 | 的卢技术有限公司 | Vision perception-based other-party vehicle track prediction method |
CN112802090A (en) * | 2021-01-23 | 2021-05-14 | 行云智能(深圳)技术有限公司 | Monocular vision distance measurement processing method |
CN112880642A (en) * | 2021-03-01 | 2021-06-01 | 苏州挚途科技有限公司 | Distance measuring system and distance measuring method |
CN113188509B (en) * | 2021-04-28 | 2023-10-24 | 上海商汤临港智能科技有限公司 | Distance measurement method and device, electronic equipment and storage medium |
CN113188509A (en) * | 2021-04-28 | 2021-07-30 | 上海商汤临港智能科技有限公司 | Distance measuring method and device, electronic equipment and storage medium |
CN113221739A (en) * | 2021-05-12 | 2021-08-06 | 中国科学技术大学 | Monocular vision-based vehicle distance measuring method |
CN114295099A (en) * | 2021-12-28 | 2022-04-08 | 合肥英睿系统技术有限公司 | Monocular camera-based distance measurement method, vehicle-mounted distance measurement equipment and storage medium |
CN114295099B (en) * | 2021-12-28 | 2024-01-30 | 合肥英睿系统技术有限公司 | Ranging method based on monocular camera, vehicle-mounted ranging equipment and storage medium |
CN114228432A (en) * | 2022-01-25 | 2022-03-25 | 同济大学 | Dynamic chassis pre-aiming control method based on pavement state recognition |
CN117218681A (en) * | 2023-11-09 | 2023-12-12 | 厦门瑞为信息技术有限公司 | Height estimation method of monocular lens, child passing gate device and judging method |
CN117218681B (en) * | 2023-11-09 | 2024-02-06 | 厦门瑞为信息技术有限公司 | Height estimation method of monocular lens, child passing gate device and judging method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104899554A (en) | Vehicle ranging method based on monocular vision | |
CN110178167B (en) | Intersection violation video identification method based on cooperative relay of cameras | |
US10970566B2 (en) | Lane line detection method and apparatus | |
CN108960183B (en) | Curve target identification system and method based on multi-sensor fusion | |
CN105488454B (en) | Front vehicles detection and ranging based on monocular vision | |
Nienaber et al. | Detecting potholes using simple image processing techniques and real-world footage | |
CN109299674B (en) | Tunnel illegal lane change detection method based on car lamp | |
CN105913041B (en) | It is a kind of based on the signal lamp recognition methods demarcated in advance | |
US9384401B2 (en) | Method for fog detection | |
US8670592B2 (en) | Clear path detection using segmentation-based method | |
CN101334836B (en) | License plate positioning method incorporating color, size and texture characteristic | |
CN101950350B (en) | Clear path detection using a hierachical approach | |
Danescu et al. | Detection and classification of painted road objects for intersection assistance applications | |
CN105718870A (en) | Road marking line extracting method based on forward camera head in automatic driving | |
CN105260699A (en) | Lane line data processing method and lane line data processing device | |
CN105654073B (en) | A kind of speed automatic control method of view-based access control model detection | |
AU2020102039A4 (en) | A high-precision multi-targets visual detection method in automatic driving scene | |
CN102982304B (en) | Utilize polarized light image to detect the method and system of vehicle location | |
KR101094752B1 (en) | Lane Classification Method Using Statistical Model of HSI Color Information | |
CN103034843B (en) | Method for detecting vehicle at night based on monocular vision | |
US20180114089A1 (en) | Attachable matter detection apparatus and attachable matter detection method | |
CN107886034B (en) | Driving reminding method and device and vehicle | |
KR101191308B1 (en) | Road and lane detection system for intelligent transportation system and method therefor | |
Aminuddin et al. | A new approach to highway lane detection by using Hough transform technique | |
CN112001216A (en) | Automobile driving lane detection system based on computer |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150909 |
|
WD01 | Invention patent application deemed withdrawn after publication |