CN108759667A - Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera - Google Patents

Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera Download PDF

Info

Publication number
CN108759667A
CN108759667A CN201810529462.0A CN201810529462A CN108759667A CN 108759667 A CN108759667 A CN 108759667A CN 201810529462 A CN201810529462 A CN 201810529462A CN 108759667 A CN108759667 A CN 108759667A
Authority
CN
China
Prior art keywords
vehicle
image
information
bounding box
front truck
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810529462.0A
Other languages
Chinese (zh)
Other versions
CN108759667B (en
Inventor
黄立勤
陈雅楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN201810529462.0A priority Critical patent/CN108759667B/en
Publication of CN108759667A publication Critical patent/CN108759667A/en
Application granted granted Critical
Publication of CN108759667B publication Critical patent/CN108759667B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)

Abstract

The present invention discloses the front truck distance measuring method based on monocular vision and image segmentation under a kind of vehicle-mounted camera, is primarily based on the extraction that deep learning algorithm carries out target vehicle two-dimentional bounding box and three-dimensional boundaries frame, obtains its corresponding position information；Secondly, the length, width and height based on three-dimensional boundaries frame are matched with 3D CAD auto models, obtain the approximate three-dimensional vehicle model of corresponding vehicle；Again and, two-dimentional bounding box is based on to vehicle extraction vehicle classification information in figure；Therewith, the corresponding three-dimensional information of vehicle and vehicle information are sent into example segmentation network, according to camera imaging principle, the absolute depth values of vehicle in image is calculated according to the dimension information of different automobile types.It present invention saves the time of depth calculation and ensure that driving vision, driver allow intuitively to observe the specific distance value of front truck, make rational drive and judge.

Description

Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera
Technical field
The present invention relates to technical field of computer vision, and in particular to based on monocular vision and figure under a kind of vehicle-mounted camera As the front truck distance measuring method of segmentation.
Background technology
Automobile universal is so that demand of the world to intelligent vehicle increasingly increases, and the development of machine vision, allows machine Image information can be generally obtained with human eye.
Estimation of Depth based on video image is to realize the precondition of Vehicular automatic driving and safe driving, so-called image Estimation of Depth be the two dimensional image stream obtained according to video equipment acquisition of information real world under correspond to the actual range of object Method.Traditional distance measuring method needs to demarcate camera inside and outside parameter with camera heights mostly, currently based on nerve net The distance measuring method of network study integrally carries out relative depth measurement mainly for image.
Commonly the distance measuring method based on neural network mainly designs different convolutional neural networks structures at this stage, instructs The loss function for practicing known depth image obtains depth model, is directly obtained to the image of input in test corresponding relatively deep Degree figure.Such method indicates relative depth with color, it is necessary to for obtaining the demand of depth globality, as indoor ranging this It is that there are some superiorities, but for actual traffic scene, redundancy is travelled with traffic from the point of view of the closed spatial dimension of kind Correlation is weaker in the process, and it is little to detect its depth information advantage in open space, or even can reduce detection efficiency, and It indicates far and near with color and there is a situation where that comparison color change is small, it is difficult to judge that vehicle is specifically far and near.When measured object with take the photograph Depth can be indicated significantly by color when camera distance is closer, but for object remotely, due to color change width Degree is big, naked eyes be difficult recognize the specific depth information of distant objects and when being overlapped there are more vehicle or vehicle not Can completely provides the information of vehicle.It, can not using the differential expression relative depth information of color under true traffic scene Real safety guarantee is provided to user.
Under true traffic scene, traditional distance measuring method estimates picture depth merely with geometric projection relationship Meter, such methods need to be readily incorporated error to distinct device calibration, and for carrying out the side of ranging using laser radar instrument Method, since detectable distance is limited under specific place and needs to introduce new equipment in cost and convenient degree It sees, such method is not the best approach of current ranging.And the common distance measuring method of neural network is used to image entirety ranging And indicate that the distant relationships of vehicle in image exist using color distortion, not only it cannot provide intuitive range information to driver Its emergency reaction time to emergency is increased, while being also unfavorable for the observation to the road ahead visual field.
It makes a general survey of the existing depth estimation method for being mostly based on neural network and all there are problems that two：1) estimate relative depth Rather than absolute depth；2) include bulk redundancy item, such as sky, the building of distant place and both sides shade tree etc. in depth information.
Invention content
In view of the deficiencies of the prior art, the present invention is provided under a kind of vehicle-mounted camera based on monocular vision and image segmentation Front truck distance measuring method solves the vehicle real time distance being suitable under traffic scene, only detects the vehicle under traffic scene, do not utilize Color distortion indicates relative distance, and intuitively provides absolute distance of each car in true.
To achieve the above object, the technical scheme is that：Monocular vision and image are based under a kind of vehicle-mounted camera The front truck distance measuring method of segmentation, includes the following steps：
Step S1：From the video flowing that vehicle-mounted camera is shot image is read by frame；
Step S2：Target detection is carried out to vehicle, extracts the location information of vehicle in image, including two-dimentional bounding box information With three-dimensional boundaries frame information；
Step S3：The CAD of corresponding vehicle is matched in preset vehicle 3D CAD models library according to three-dimensional boundaries frame information Model；
Step S4：The distance that overlapping vehicle is judged according to the two-dimentional bounding box information of vehicle, according to vehicle two dimension bounding box Top left corner apex ordinate value, CAD model projection mask on the image determines the block information of vehicle；Step S5：According to The two-dimentional bounding box information of vehicle detects vehicle, and the dimension information of vehicle is obtained according to specific vehicle；
Step S6：According to the dimension information of vehicle and block information corresponding position in image is obtained using example segmentation network The Pixel-level mask value of vehicle；
Step S7：According to camera imaging principle, each car is calculated using the dimension information of vehicle and the result of vehicles segmentation Corresponding absolute depth values and the Some vehicles absolute depth values that are blocked.
Further, the step S3 is specifically included：
According to three-dimensional boundaries frame information, chosen in preset vehicle 3D CAD models library and the cuboid of target vehicle 3D CAD models mapping is matched in the 3D cuboids of respective objects vehicle by the immediate model of length and width high proportion.
Further, the step S4 is specifically included：In image coordinate system, the upper left of the two-dimentional bounding box of vehicle is compared Angular vertex ordinate value, the small corresponding vehicle of two-dimentional bounding box of ordinate value are nearby vehicle, the big two-dimentional side of ordinate value Frame corresponding vehicle in boundary's is remote vehicle, and according to the top left corner apex ordinate value of vehicle two dimension bounding box, CAD model is projected in Mask on image determines the visible part of target vehicle, the part being blocked and the part blocked by image.
Further, the vehicle include multi-functional Recreational Vehicle, sport vehicle, wing-rooms on either side of a one-story house type hatchback vehicle, four Car, mini bus, streamlined car, four three compartment extended type station wagons, picking-up vehicle, transboundary Recreational Vehicle, open car, sport car and steel Plate top sport car.
Further, the step S7 is specifically included：
According to camera imaging principle, fathomed using the relationship between the elemental area of vehicle and true area, In image coordinate system, the coordinate of the two-dimentional bounding box top left corner apex of vehicle is q (x, y, f), in actual spatial coordinates system, vehicle Two-dimentional bounding box top left corner apex coordinate be Q (X, Y, Z), then
It is write as matrix form, is obtained
Pixel coordinate system is defined as (u, v), Q1(u0,v0) be image coordinate system plane and optical axis intersection point, image coordinate Point coordinates in system is (x, y), is reflected as in pixel coordinate system (u, v), then image coordinate system and pixel coordinate system exist with Lower relationship, wherein dxdy indicate the physics size of each pixel
It is write above formula (3) as matrix form, is obtained
Formula (2) is brought into formula (4), is obtained
Do not consider translation problem, enables u0=v0=0,fx=fy=7.1254 × 102
Dividing vehicle area is S under pixel coordinate systempixel
It is S that dividing vehicle area is wherein corresponded under real spacereal=xy, Z axis coordinate value correspond to take the photograph under real space Distance d as head apart from front truck, obtains
Compared with prior art, the present invention has advantageous effect：
(1) present invention is divided to obtain corresponding vehicle location in image in conjunction with example using objective detection and is believed with shape Breath, eliminates the interference of redundancy in detection, this scheme saves the time of depth calculation and ensure that driving vision, gives Driver provides longer operable time.
(2) monocular vision principle is utilized, is detected according to objective and is combined vehicle under actual time with example dividing method Dimensioned area directly calculates the absolute depth values of corresponding vehicle and provides concrete numerical value information, do not utilize color is fuzzy to distinguish Distant relationships, this scheme allow driver intuitively to observe the specific distance value of front truck, make rational drive and judge.
Description of the drawings
Fig. 1 is the flow of the front truck distance measuring method based on monocular vision and image segmentation under a kind of vehicle-mounted camera of the present invention Schematic diagram；
Fig. 2 is the schematic diagram of the judgement overlapping headlight for vehicle of the present invention；
Fig. 3 is the schematic diagram of occlusion information of the present invention；
Fig. 4 is that example divides network Mask R-CNN structural schematic diagrams in one embodiment of the invention；
Fig. 5 is vehicle classification schematic diagram in one embodiment of the invention；
Fig. 6 is projection relation schematic diagram in one embodiment of the invention；
Fig. 7 is the plane of delineation and pixel planes transition diagram in one embodiment of the invention.
Specific implementation mode
The present invention will be further described with reference to the accompanying drawings and embodiments.
As shown in Figure 1, the front truck distance measuring method based on monocular vision and image segmentation under a kind of vehicle-mounted camera, including with Lower step：
Step S1：From the video flowing that vehicle-mounted camera is shot image is read by frame；
Step S2：Target detection is carried out to vehicle, extracts the location information of vehicle in image, including two-dimentional bounding box information With three-dimensional boundaries frame information；
Step S3：The CAD of corresponding vehicle is matched in preset vehicle 3D CAD models library according to three-dimensional boundaries frame information Model；
Step S4：The distance that overlapping vehicle is judged according to the two-dimentional bounding box information of vehicle, according to vehicle two dimension bounding box Top left corner apex ordinate value, CAD model projection mask on the image determines the block information of vehicle；
Step S5：Vehicle is detected according to the two-dimentional bounding box information of vehicle, the size that vehicle is obtained according to specific vehicle is believed Breath；
Step S6：According to the dimension information of vehicle and block information corresponding position in image is obtained using example segmentation network The Pixel-level mask value of vehicle；
Step S7：According to camera imaging principle, each car is calculated using the dimension information of vehicle and the result of vehicles segmentation Corresponding absolute depth values and the Some vehicles absolute depth values that are blocked.
Using monocular vision basis, in conjunction with objective detection with image instance segmentation measurement road in front vehicles it is exhausted To depth.
In the present embodiment, video flowing is inputted according to frame sequential in network, is extracted in image by target detection network The location information of vehicle includes prerequisite item of the two-dimentional bounding box with three-dimensional boundaries frame information as follow-up calculating front truck absolute depth Part.For objective detection part, the corresponding 3D CAD models of each vehicle are stored in the model library of web in image The model set that (Trimble 3D Warehouse) is pre-defined, according to the three-dimensional boundaries detected from 2D images Frame location information most connects to be chosen in the data acquisition system of 3D CAD models with the length and width of the cuboid of target vehicle at high proportion Most like 3D CAD models are reflected and are matched in the 3D cuboids of respective objects vehicle by close model.It is remote to overlapping vehicle It is close to judge, as shown in Fig. 2, two top left co-ordinate y values of the two-dimentional bounding box of comparison, the corresponding vehicle of the small bounding box of y values are Be blocked vehicle position nearby vehicle, then the big bounding box of y values corresponds to remote vehicle.According to the upper left corner of vehicle two dimension bounding box Y value sizes, CAD model projection mask on the image can determine the visible part of target vehicle, be blocked and be truncated part As shown in Figure 3.
In the present embodiment, utilize Mask R-CNN networks to figure two dimension target detection part and example partitioning portion As carrying out processing operation.Mask R-CNN are one and divide network based on the example that Faster R-CNN extend, for each mesh Mark object has three output branchs, is classification branch, bounding box branch and mask branch respectively, as shown in Figure 4.Utilize Mask R-CNN first detects target location (i.e. the output of bounding box branch), and the principle of cutting object, is not repeatedly introduced target detection later Network and be completed at the same time the extraction of target location and the segmentation of target using Mask R-CNN networks.Example partitioning portion utilizes The parted pattern only for vehicle of re -training carries out the acquisition of result, it is ensured that does not occur except other than vehicle in detection process Redundancy.
The vehicle position information obtained by Mask R-CNN networks is conveyed to rear end and carries out example cutting operation, conveys simultaneously Vehicle classification network is given, the vehicle extraction for corresponding to vehicle location in image.Vehicle detection part uses Compcars data The trained vehicle classification model of collection.Vehicle is divided into 12 classes, as shown in figure 5, respectively multi-functional Recreational Vehicle (Multi- Purpose Vehicle,MPV)；Sport vehicle (Sport Utility Vehicle, SUV)；Wing-rooms on either side of a one-story house type hatchback vehicle (hatchback)；Four-door sedan (sedan)；Mini bus (minibus)；Streamlined car (fastback)；Four three compartments lengthen Type station wagon (estate)；Picking-up vehicle (pickup)；Recreational Vehicle (crossover) transboundary；Open car (convertible)；It runs Vehicle (sport)；Steel plate top sport car (hardtop convertible).Vehicle in figure is obtained according to the vehicle position information of gained It is sequentially sent to obtain corresponding vehicle information in vehicle classification network, obtaining the corresponding length, width and height of vehicle further according to specific vehicle believes Breath, improves calculated absolute depth accuracy, model data is as shown in table 1 with this.
Table 1
On the basis of the detection of the above objective, example segmentation are with vehicle classification, solved by distance measuring method below Certainly it is present in the problem of depth definition in estimation of Depth is with detection redundancy.In the absolute depth for obtaining each vehicle while reducing The appearance of redundancy.According to camera imaging principle, location algorithm can be reduced to such as drag, such as Fig. 6 and Fig. 7.
It according to camera imaging principle, is fathomed using the relationship between elemental area and true area, (x, y) is figure As the coordinate of coordinate system, (X, Y, Z) is the coordinate of actual spatial coordinates system, as shown in Figure 6.
It is write above formula (1) as matrix form, is obtained
Such as Fig. 7, pixel coordinate system is defined as (u, v), Q1(u0,v0) be image coordinate system plane and optical axis intersection point.Figure As the point coordinates in coordinate system be (x, y), be reflected as in pixel coordinate system (u, v).Then image coordinate system and pixel coordinate system There are following relationship, wherein dxdy indicates the physics size of each pixel
It is write above formula (3) as matrix form, is obtained
Formula (2) is brought into formula (4), is obtained
It puts aside translation problem, enables u0=v0=0,fx=fy=7.1254 × 102
Dividing vehicle area is S under pixel coordinate systempixel
It is S that dividing vehicle area is wherein corresponded under real spacereal=xy, Z axis distance correspond to image under real space Distance d of the head apart from front truck, obtains
The front truck absolute depth being partitioned into accurate can be acquired in the case of unobstructed according to formula (8), for vehicle The case where being blocked, obtained being blocked after the mask value of part according to 3D CAD models, formula (8) is still applicable in；For vehicle The case where being truncated is corresponded on 3D CAD models by the missing of mask in 2D images and determines its shared length and width in three dimensions High size, to the S for being truncated vehiclerealIt adjusts, formula (8) is recycled to carry out absolute depth estimation.
Monocular vision is combined the absolute depth values of estimation vehicle by the present invention with image segmentation phase and objective detection, first The extraction for first carrying out two-dimentional bounding box and three-dimensional boundaries frame to target vehicle based on deep learning algorithm, obtains its corresponding position letter Breath；Secondly, the length, width and height based on three-dimensional boundaries frame are matched with 3D CAD auto models, obtain the approximate three-dimensional vehicle of corresponding vehicle Model；Again and, two-dimentional bounding box is based on to vehicle extraction vehicle classification information in figure；Therewith, by the corresponding three-dimensional information of vehicle It is sent into example segmentation network with vehicle information, according to camera imaging principle, image is calculated according to the dimension information of different automobile types The absolute depth values of middle vehicle.The present invention meets the requirement of front truck real time distance under vehicle-mounted camera, is only carried out to vehicle absolute Depth detection, while solving the problems, such as the overlapping between vehicle or truncated region so that the vehicle for being blocked or being truncated still can be with Accurate its absolute depth values of detection.
The above are preferred embodiments of the present invention, all any changes made according to the technical solution of the present invention, and generated function is made When with range without departing from technical solution of the present invention, all belong to the scope of protection of the present invention.

Claims (5)

1. the front truck distance measuring method based on monocular vision and image segmentation under a kind of vehicle-mounted camera, which is characterized in that including with Lower step：
Step S1：From the video flowing that vehicle-mounted camera is shot image is read by frame；
Step S2：Target detection is carried out to vehicle, extracts the location information of vehicle in image, including two-dimentional bounding box information and three Tie up bounding box information；
Step S3：The CAD model of corresponding vehicle is matched in preset vehicle 3D CAD models library according to three-dimensional boundaries frame information；
Step S4：The distance that overlapping vehicle is judged according to the two-dimentional bounding box information of vehicle, according to a left side for vehicle two dimension bounding box Upper angular vertex ordinate value, the mask of CAD model projection on the image determine the block information of vehicle；
Step S5：Vehicle is detected according to the two-dimentional bounding box information of vehicle, the dimension information of vehicle is obtained according to specific vehicle；
Step S6：According to the dimension information of vehicle and block information corresponding position vehicle in image is obtained using example segmentation network Pixel-level mask value；
Step S7：According to camera imaging principle, calculates each car using the dimension information of vehicle and the result of vehicles segmentation and correspond to Absolute depth values and the Some vehicles absolute depth values that are blocked.
2. front truck distance measuring method according to claim 1, which is characterized in that the step S3 is specifically included：According to three-dimensional Bounding box information is chosen closest at high proportion with the length and width of the cuboid of target vehicle in preset vehicle 3D CAD models library Model, by the 3D CAD models mapping be matched in the 3D cuboids of respective objects vehicle.
3. front truck distance measuring method according to claim 1, which is characterized in that the step S4 is specifically included：It is sat in image In mark system, the top left corner apex ordinate value of the two-dimentional bounding box of vehicle is compared, the small two-dimentional bounding box of ordinate value is corresponding Vehicle is nearby vehicle, and the big corresponding vehicle of two-dimentional bounding box of ordinate value is remote vehicle, according to vehicle two dimension bounding box Top left corner apex ordinate value, CAD model projection mask on the image determines the visible part of target vehicle, is blocked Part and the part blocked by image.
4. front truck distance measuring method according to claim 1, which is characterized in that the vehicle includes multi-functional Recreational Vehicle, fortune Ejector half vehicle, wing-rooms on either side of a one-story house type hatchback vehicle, four-door sedan, mini bus, streamlined car, four three compartment extended type station wagons, Picking-up vehicle, transboundary Recreational Vehicle, open car, sport car and steel plate top sport car.
5. front truck distance measuring method according to claim 1, which is characterized in that the step S7 is specifically included：
According to camera imaging principle, fathomed using the relationship between the elemental area of vehicle and true area, in image In coordinate system, the coordinate of the two-dimentional bounding box top left corner apex of vehicle is q (x, y, f), in actual spatial coordinates system, vehicle The coordinate of two-dimentional bounding box top left corner apex is Q (X, Y, Z), then
It is write as matrix form, is obtained
Pixel coordinate system is defined as (u, v), Q1(u0,v0) be image coordinate system plane and optical axis intersection point, in image coordinate system Point coordinates be (x, y), be reflected as in pixel coordinate system (u, v), then image coordinate system and pixel coordinate system exist with ShiShimonoseki System, wherein dxdy indicate the physics size of each pixel
It is write above formula (3) as matrix form, is obtained
Formula (2) is brought into formula (4), is obtained
Do not consider translation problem, enables u0=v0=0,fx=fy=7.1254 × 102
Dividing vehicle area is S under pixel coordinate systempixel
It is S that dividing vehicle area is wherein corresponded under real spacereal=xy, Z axis coordinate value correspond under real space camera away from From front truck distance d, obtain
CN201810529462.0A 2018-05-29 2018-05-29 Front truck distance measuring method under vehicle-mounted camera based on monocular vision and image segmentation Expired - Fee Related CN108759667B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810529462.0A CN108759667B (en) 2018-05-29 2018-05-29 Front truck distance measuring method under vehicle-mounted camera based on monocular vision and image segmentation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810529462.0A CN108759667B (en) 2018-05-29 2018-05-29 Front truck distance measuring method under vehicle-mounted camera based on monocular vision and image segmentation

Publications (2)

Publication Number Publication Date
CN108759667A true CN108759667A (en) 2018-11-06
CN108759667B CN108759667B (en) 2019-11-12

Family

ID=64003149

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810529462.0A Expired - Fee Related CN108759667B (en) 2018-05-29 2018-05-29 Front truck distance measuring method under vehicle-mounted camera based on monocular vision and image segmentation

Country Status (1)

Country Link
CN (1) CN108759667B (en)

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109658419A (en) * 2018-11-15 2019-04-19 浙江大学 The dividing method of organella in a kind of medical image
CN109726692A (en) * 2018-12-29 2019-05-07 重庆集诚汽车电子有限责任公司 High-definition camera 3D object detection system based on deep learning
CN109785661A (en) * 2019-02-01 2019-05-21 广东工业大学 A kind of parking guide method based on machine learning
CN109859489A (en) * 2019-01-30 2019-06-07 驭势科技（北京）有限公司 A kind of spacing estimation method, device, mobile unit and storage medium
CN109902643A (en) * 2019-03-07 2019-06-18 浙江啄云智能科技有限公司 Intelligent safety inspection method, device, system and its electronic equipment based on deep learning
CN109917359A (en) * 2019-03-19 2019-06-21 福州大学 Robust vehicle distances estimation method based on vehicle-mounted monocular vision
CN109919072A (en) * 2019-02-28 2019-06-21 桂林电子科技大学 Fine vehicle type recognition and flow statistics method based on deep learning and trajectory tracking
CN110060298A (en) * 2019-03-21 2019-07-26 径卫视觉科技（上海）有限公司 A kind of vehicle location and attitude and heading reference system based on image and corresponding method
CN110297232A (en) * 2019-05-24 2019-10-01 合刃科技（深圳）有限公司 Monocular distance measuring method, device and electronic equipment based on computer vision
CN110307791A (en) * 2019-06-13 2019-10-08 东南大学 Vehicle length and speed calculation method based on three-dimensional vehicle bounding box
CN110517349A (en) * 2019-07-26 2019-11-29 电子科技大学 A kind of 3D vehicle target detection method based on monocular vision and geometrical constraint
CN110992304A (en) * 2019-10-30 2020-04-10 浙江力邦合信智能制动系统股份有限公司 Two-dimensional image depth measuring method and application thereof in vehicle safety monitoring
CN111009166A (en) * 2019-12-04 2020-04-14 上海市城市建设设计研究总院（集团）有限公司 Road three-dimensional sight distance checking calculation method based on BIM and driving simulator
CN111046843A (en) * 2019-12-27 2020-04-21 华南理工大学 Monocular distance measurement method under intelligent driving environment
CN111126248A (en) * 2019-12-20 2020-05-08 湖南千视通信息科技有限公司 Method and device for identifying shielded vehicle
CN111256651A (en) * 2018-12-03 2020-06-09 北京京东尚科信息技术有限公司 Week vehicle distance measuring method and device based on monocular vehicle-mounted camera
CN111351436A (en) * 2020-03-06 2020-06-30 大连理工大学 Method for verifying precision of structural plane displacement vision measurement system
WO2020133488A1 (en) * 2018-12-29 2020-07-02 深圳市大疆创新科技有限公司 Vehicle detection method and device
CN111627078A (en) * 2019-02-28 2020-09-04 现代摩比斯株式会社 Automatic image synthesizing device and method
CN112036389A (en) * 2020-11-09 2020-12-04 天津天瞳威势电子科技有限公司 Vehicle three-dimensional information detection method, device and equipment and readable storage medium
CN112580402A (en) * 2019-09-30 2021-03-30 广州汽车集团股份有限公司 Monocular vision pedestrian distance measurement method and system, vehicle and medium thereof
CN112816496A (en) * 2021-01-05 2021-05-18 广州市华颉电子科技有限公司 Automatic optical detection method and device for interface assembly quality of automobile domain controller
CN113221739A (en) * 2021-05-12 2021-08-06 中国科学技术大学 Monocular vision-based vehicle distance measuring method
CN113225447A (en) * 2021-04-14 2021-08-06 杭州思看科技有限公司 Three-dimensional scanning system, data processing method and device and computer equipment
CN113269118A (en) * 2021-06-07 2021-08-17 重庆大学 Monocular vision forward vehicle distance detection method based on depth estimation
CN113490863A (en) * 2019-03-06 2021-10-08 高通股份有限公司 Radar-assisted three-dimensional depth reconstruction of a single image
CN114049394A (en) * 2021-11-23 2022-02-15 智道网联科技(北京)有限公司 Monocular distance measuring method, device, equipment and storage medium
CN114882727A (en) * 2022-03-15 2022-08-09 深圳市德驰微视技术有限公司 Parking space detection method based on domain controller, electronic device and storage medium
CN116012453A (en) * 2023-03-28 2023-04-25 常州星宇车灯股份有限公司 Monocular distance measuring method, device, equipment and medium for intelligent driving of vehicle and vehicle
CN116500796A (en) * 2023-06-30 2023-07-28 合肥疆程技术有限公司 Projection processing method, head-up display, automobile and storage medium
CN117854055A (en) * 2024-03-07 2024-04-09 河南百合特种光学研究院有限公司 Front vehicle distance judging method for license plate recognition and monocular vision of vehicle-mounted camera

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101408978A (en) * 2008-11-27 2009-04-15 东软集团股份有限公司 Method and apparatus for detecting barrier based on monocular vision
CN103287372A (en) * 2013-06-19 2013-09-11 贺亮才 Automobile anti-collision safe protecting method based on image processing
CN104899554A (en) * 2015-05-07 2015-09-09 东北大学 Vehicle ranging method based on monocular vision
CN106826815A (en) * 2016-12-21 2017-06-13 江苏物联网研究发展中心 Target object method of the identification with positioning based on coloured image and depth image
CN107390205A (en) * 2017-07-20 2017-11-24 清华大学 A kind of monocular vision vehicle odometry method that front truck feature is obtained using car networking
CN107796373A (en) * 2017-10-09 2018-03-13 长安大学 A kind of distance-finding method of the front vehicles monocular vision based on track plane geometry model-driven
CN107972662A (en) * 2017-10-16 2018-05-01 华南理工大学 To anti-collision warning method before a kind of vehicle based on deep learning
JPWO2018030319A1 (en) * 2016-08-12 2018-08-09 パナソニックＩｐマネジメント株式会社 Ranging system and mobile system
EP3428876A1 (en) * 2016-03-10 2019-01-16 Ricoh Company, Ltd. Image processing device, apparatus control system, imaging device, image processing method, and program
JPWO2018042954A1 (en) * 2016-08-29 2019-04-18 日立オートモティブシステムズ株式会社 In-vehicle camera, adjustment method of in-vehicle camera, in-vehicle camera system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101408978A (en) * 2008-11-27 2009-04-15 东软集团股份有限公司 Method and apparatus for detecting barrier based on monocular vision
CN103287372A (en) * 2013-06-19 2013-09-11 贺亮才 Automobile anti-collision safe protecting method based on image processing
CN104899554A (en) * 2015-05-07 2015-09-09 东北大学 Vehicle ranging method based on monocular vision
EP3428876A1 (en) * 2016-03-10 2019-01-16 Ricoh Company, Ltd. Image processing device, apparatus control system, imaging device, image processing method, and program
JPWO2018030319A1 (en) * 2016-08-12 2018-08-09 パナソニックＩｐマネジメント株式会社 Ranging system and mobile system
JPWO2018042954A1 (en) * 2016-08-29 2019-04-18 日立オートモティブシステムズ株式会社 In-vehicle camera, adjustment method of in-vehicle camera, in-vehicle camera system
CN106826815A (en) * 2016-12-21 2017-06-13 江苏物联网研究发展中心 Target object method of the identification with positioning based on coloured image and depth image
CN107390205A (en) * 2017-07-20 2017-11-24 清华大学 A kind of monocular vision vehicle odometry method that front truck feature is obtained using car networking
CN107796373A (en) * 2017-10-09 2018-03-13 长安大学 A kind of distance-finding method of the front vehicles monocular vision based on track plane geometry model-driven
CN107972662A (en) * 2017-10-16 2018-05-01 华南理工大学 To anti-collision warning method before a kind of vehicle based on deep learning

Cited By (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109658419A (en) * 2018-11-15 2019-04-19 浙江大学 The dividing method of organella in a kind of medical image
CN111256651B (en) * 2018-12-03 2022-06-07 北京京东乾石科技有限公司 Week vehicle distance measuring method and device based on monocular vehicle-mounted camera
CN111256651A (en) * 2018-12-03 2020-06-09 北京京东尚科信息技术有限公司 Week vehicle distance measuring method and device based on monocular vehicle-mounted camera
CN109726692A (en) * 2018-12-29 2019-05-07 重庆集诚汽车电子有限责任公司 High-definition camera 3D object detection system based on deep learning
CN111386530A (en) * 2018-12-29 2020-07-07 深圳市大疆创新科技有限公司 Vehicle detection method and apparatus
WO2020133488A1 (en) * 2018-12-29 2020-07-02 深圳市大疆创新科技有限公司 Vehicle detection method and device
CN109859489A (en) * 2019-01-30 2019-06-07 驭势科技（北京）有限公司 A kind of spacing estimation method, device, mobile unit and storage medium
CN109785661A (en) * 2019-02-01 2019-05-21 广东工业大学 A kind of parking guide method based on machine learning
CN109919072A (en) * 2019-02-28 2019-06-21 桂林电子科技大学 Fine vehicle type recognition and flow statistics method based on deep learning and trajectory tracking
CN109919072B (en) * 2019-02-28 2021-03-19 桂林电子科技大学 Fine vehicle type recognition and flow statistics method based on deep learning and trajectory tracking
CN111627078B (en) * 2019-02-28 2023-09-19 现代摩比斯株式会社 Automatic image synthesizing device and method
CN111627078A (en) * 2019-02-28 2020-09-04 现代摩比斯株式会社 Automatic image synthesizing device and method
CN113490863A (en) * 2019-03-06 2021-10-08 高通股份有限公司 Radar-assisted three-dimensional depth reconstruction of a single image
CN113490863B (en) * 2019-03-06 2024-05-24 高通股份有限公司 Radar-assisted single image three-dimensional depth reconstruction
CN109902643A (en) * 2019-03-07 2019-06-18 浙江啄云智能科技有限公司 Intelligent safety inspection method, device, system and its electronic equipment based on deep learning
CN109917359A (en) * 2019-03-19 2019-06-21 福州大学 Robust vehicle distances estimation method based on vehicle-mounted monocular vision
CN109917359B (en) * 2019-03-19 2022-10-14 福州大学 Robust vehicle distance estimation method based on vehicle-mounted monocular vision
CN110060298A (en) * 2019-03-21 2019-07-26 径卫视觉科技（上海）有限公司 A kind of vehicle location and attitude and heading reference system based on image and corresponding method
CN110060298B (en) * 2019-03-21 2023-06-20 径卫视觉科技（上海）有限公司 Image-based vehicle position and posture determining system and corresponding method
CN110297232A (en) * 2019-05-24 2019-10-01 合刃科技（深圳）有限公司 Monocular distance measuring method, device and electronic equipment based on computer vision
CN110307791A (en) * 2019-06-13 2019-10-08 东南大学 Vehicle length and speed calculation method based on three-dimensional vehicle bounding box
CN110307791B (en) * 2019-06-13 2020-12-29 东南大学 Vehicle length and speed calculation method based on three-dimensional vehicle boundary frame
CN110517349A (en) * 2019-07-26 2019-11-29 电子科技大学 A kind of 3D vehicle target detection method based on monocular vision and geometrical constraint
CN112580402A (en) * 2019-09-30 2021-03-30 广州汽车集团股份有限公司 Monocular vision pedestrian distance measurement method and system, vehicle and medium thereof
CN110992304A (en) * 2019-10-30 2020-04-10 浙江力邦合信智能制动系统股份有限公司 Two-dimensional image depth measuring method and application thereof in vehicle safety monitoring
CN110992304B (en) * 2019-10-30 2023-07-07 浙江力邦合信智能制动系统股份有限公司 Two-dimensional image depth measurement method and application thereof in vehicle safety monitoring
CN111009166B (en) * 2019-12-04 2021-06-01 上海市城市建设设计研究总院（集团）有限公司 Road three-dimensional sight distance checking calculation method based on BIM and driving simulator
CN111009166A (en) * 2019-12-04 2020-04-14 上海市城市建设设计研究总院（集团）有限公司 Road three-dimensional sight distance checking calculation method based on BIM and driving simulator
CN111126248A (en) * 2019-12-20 2020-05-08 湖南千视通信息科技有限公司 Method and device for identifying shielded vehicle
CN111046843A (en) * 2019-12-27 2020-04-21 华南理工大学 Monocular distance measurement method under intelligent driving environment
CN111046843B (en) * 2019-12-27 2023-06-20 华南理工大学 Monocular ranging method in intelligent driving environment
CN111351436B (en) * 2020-03-06 2021-06-18 大连理工大学 Method for verifying precision of structural plane displacement vision measurement system
CN111351436A (en) * 2020-03-06 2020-06-30 大连理工大学 Method for verifying precision of structural plane displacement vision measurement system
CN112036389A (en) * 2020-11-09 2020-12-04 天津天瞳威势电子科技有限公司 Vehicle three-dimensional information detection method, device and equipment and readable storage medium
CN112816496A (en) * 2021-01-05 2021-05-18 广州市华颉电子科技有限公司 Automatic optical detection method and device for interface assembly quality of automobile domain controller
CN113225447A (en) * 2021-04-14 2021-08-06 杭州思看科技有限公司 Three-dimensional scanning system, data processing method and device and computer equipment
CN113225447B (en) * 2021-04-14 2024-03-26 思看科技(杭州)股份有限公司 Three-dimensional scanning system, data processing method, data processing device and computer equipment
CN113221739A (en) * 2021-05-12 2021-08-06 中国科学技术大学 Monocular vision-based vehicle distance measuring method
CN113269118A (en) * 2021-06-07 2021-08-17 重庆大学 Monocular vision forward vehicle distance detection method based on depth estimation
CN114049394A (en) * 2021-11-23 2022-02-15 智道网联科技(北京)有限公司 Monocular distance measuring method, device, equipment and storage medium
CN114882727B (en) * 2022-03-15 2023-09-05 深圳市德驰微视技术有限公司 Parking space detection method based on domain controller, electronic equipment and storage medium
CN114882727A (en) * 2022-03-15 2022-08-09 深圳市德驰微视技术有限公司 Parking space detection method based on domain controller, electronic device and storage medium
CN116012453A (en) * 2023-03-28 2023-04-25 常州星宇车灯股份有限公司 Monocular distance measuring method, device, equipment and medium for intelligent driving of vehicle and vehicle
CN116500796A (en) * 2023-06-30 2023-07-28 合肥疆程技术有限公司 Projection processing method, head-up display, automobile and storage medium
CN117854055A (en) * 2024-03-07 2024-04-09 河南百合特种光学研究院有限公司 Front vehicle distance judging method for license plate recognition and monocular vision of vehicle-mounted camera

Also Published As

Publication number Publication date
CN108759667B (en) 2019-11-12

Similar Documents

Publication Publication Date Title
CN108759667B (en) Front truck distance measuring method under vehicle-mounted camera based on monocular vision and image segmentation
CN111126269B (en) Three-dimensional target detection method, device and storage medium
US11216673B2 (en) Direct vehicle detection as 3D bounding boxes using neural network image processing
CN106256606B (en) A kind of lane departure warning method based on vehicle-mounted binocular camera
CN108638999B (en) Anti-collision early warning system and method based on 360-degree look-around input
CN104933409B (en) A kind of parking stall recognition methods based on panoramic picture dotted line feature
CN105300403B (en) A kind of vehicle mileage calculating method based on binocular vision
CN102774325B (en) Rearview reversing auxiliary system and method for forming rearview obstacle images
CN110517349A (en) A kind of 3D vehicle target detection method based on monocular vision and geometrical constraint
CN109359409A (en) A kind of vehicle passability detection system of view-based access control model and laser radar sensor
US20230215187A1 (en) Target detection method based on monocular image
US11887336B2 (en) Method for estimating a relative position of an object in the surroundings of a vehicle and electronic control unit for a vehicle and vehicle
CN108269235A (en) A kind of vehicle-mounted based on OPENGL looks around various visual angles panorama generation method
CN110969064B (en) Image detection method and device based on monocular vision and storage equipment
CN110758243A (en) Method and system for displaying surrounding environment in vehicle driving process
US11756317B2 (en) Methods and systems for labeling lidar point cloud data
CN102158684A (en) Self-adapting scene image auxiliary system with image enhancement function
CN110619674B (en) Three-dimensional augmented reality equipment and method for accident and alarm scene restoration
CN115082881A (en) Target detection method, storage medium, electronic device, and vehicle
CN114463303B (en) Road target detection method based on fusion of binocular camera and laser radar
CN110060298A (en) A kind of vehicle location and attitude and heading reference system based on image and corresponding method
CN108645375A (en) One kind being used for vehicle-mounted biocular systems rapid vehicle distance measurement optimization method
Omar et al. Detection and localization of traffic lights using YOLOv3 and Stereo Vision
Gruyer et al. Vehicle detection and tracking by collaborative fusion between laser scanner and camera
Jung et al. Intelligent hybrid fusion algorithm with vision patterns for generation of precise digital road maps in self-driving vehicles

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20191112