CN105160324B - A kind of vehicle checking method based on space of components relationship - Google Patents

A kind of vehicle checking method based on space of components relationship Download PDF

Info

Publication number
CN105160324B
CN105160324B CN201510566019.7A CN201510566019A CN105160324B CN 105160324 B CN105160324 B CN 105160324B CN 201510566019 A CN201510566019 A CN 201510566019A CN 105160324 B CN105160324 B CN 105160324B
Authority
CN
China
Prior art keywords
component
car plate
car
inverse projection
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510566019.7A
Other languages
Chinese (zh)
Other versions
CN105160324A (en
Inventor
宋焕生
崔华
王璇
孙士杰
孙丽婷
关琦
庞凤兰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xi'an Dewei Shitong Intelligent Technology Co ltd
Original Assignee
Changan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changan University filed Critical Changan University
Priority to CN201510566019.7A priority Critical patent/CN105160324B/en
Publication of CN105160324A publication Critical patent/CN105160324A/en
Application granted granted Critical
Publication of CN105160324B publication Critical patent/CN105160324B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights

Abstract

The invention discloses a kind of vehicle checking methods based on space of components relationship, belong to field of image recognition.The invention includes establishing gauss hybrid models, obtain perspective transformation matrix, the inverse projection face of structure, the information in the video image is subjected to inverse projection according to the perspective transformation matrix, obtain inverse projection figure, the car plate component and the car light component are determined from the inverse projection figure, if the number of the car plate component and the car light component in the inverse projection figure and being not less than preset value, number of vehicles is determined after determining the component that the car plate component and the car light component are a vehicle.The present invention during vehicle detection by introducing gauss hybrid models, compared with prior art, can overcome and block and influence of the illumination condition difference to algorithm of target detection, improve the accuracy of vehicle identification.

Description

A kind of vehicle checking method based on space of components relationship
Technical field
The invention belongs to field of image recognition, more particularly to a kind of vehicle checking method based on space of components relationship.
Background technology
With the fast development in city, traffic control system is greatly challenged in traffic jam, accident and illegal activities.Past Three during the decade, we have witnessed the rise of intelligent transportation system (Intelligent Traffic System, ITS), development And application, and the life to us and social significance.Under this overall background, computer vision and vehicle detection at For two importances in ITS.Vehicle detection is the basis of DETECTION OF TRAFFIC PARAMETERS, and common detection method has ground induction coil Method, microwave radar method, video detection method etc., the detection method based on video is not only easy for installation in these methods, cheap, And more information can be provided for traffic analysis, as traffic flow analysis, vehicle classification, Bus- Speed Monitoring, event detection with And the capture and transmission storage etc. of live real-time video.Nowadays advanced traveler information systems are completed using computer vision technique Vehicle detection.
With the continuous development of ITS, every country all increases the research dynamics in intelligent transportation field, is regarded based on computer The vehicle checking method of feel is that many contributions have been done in the development of ITS, and a variety of vehicle checking methods come into being, as based on model Method, the method based on local feature and the method etc. based on machine learning.
In the implementation of the present invention, the inventor finds that the existing technology has at least the following problems:
But about vehicle detection, still there are many problems in ITS.Vehicle surface and the diversity of behavior make training one A unified detection model is relatively difficult.Complicated urban environment, bad weather, light variation and weak/strong illumination condition will Largely reduce detection performance.The case where being blocked mutually there are vehicle when especially for traffic congestion, so that multiple Vehicle is easy to be fused into a vehicle, and difficulty is brought to accurately identifying for vehicle.
Invention content
In order to solve problems in the prior art, the present invention provides a kind of vehicle detection sides based on space of components relationship Method, the vehicle checking method based on space of components relationship, including:
Video image is obtained, determines the distance between car plate component and car light component of vehicle sample in the video image Value and angle value represent empty between car plate component and car light component according to the distance value and angle value combination algorithm foundation Between relationship gauss hybrid models;
The video image is demarcated using direct linear transformation, obtains perspective transformation matrix;
Information in the video image is carried out inverse projection according to the perspective transformation matrix, obtained by the inverse projection face of structure Obtain inverse projection figure;
According to color transformation model, in conjunction with gradient algorithm, the car plate component and described is determined from the inverse projection figure Car light component;
If the number of the car plate component and the car light component in the inverse projection figure and be not less than preset value, The likelihood score of the car plate component and the car light component in the gauss hybrid models is obtained, if the number of the likelihood score Value is more than likelihood score threshold value, it is determined that the car plate component and the component that the car light component is a vehicle, and then determine vehicle Number.
Optionally, described that the video image is demarcated using direct linear transformation, obtain perspective transformation matrix, packet It includes:
The calibration point of six known coordinates is chosen in world coordinate system, wherein four calibration points are located at horizontal plane, The height value of calibration point described in another two is not zero;
Image coordinate of the calibration point of six known coordinates in image coordinate system is obtained, is obtained by least square method Take the perspective transformation matrix between the world coordinate system and described image coordinate system.
Optionally, the structure inverse projection face, according to the perspective transformation matrix by the information in the video image into Row inverse projection obtains inverse projection figure, including:
Pane location is chosen on the inverse projection face, determines that each pane location is corresponding on the video image Sampled pixel point;
The video image is converted into gray level image, and obtains the gray value of the sampled pixel point;
Inverse throw will be carried out on inverse projection face described in the gray value phase of the sampled pixel point according to the perspective transformation matrix Shadow obtains the inverse projection figure after inverse projection.
Optionally, described according to color transformation model, in conjunction with gradient algorithm, the car plate is determined from the inverse projection figure Component and the car light component, including:
By the car plate color model in color transformation model, the car plate gray-scale map of the video image is obtained, and then is obtained Take the car plate gradient map of the car plate gray-scale map;
Car plate sample areas identical with car plate size is chosen from the car plate gradient map, obtains the car plate sample area The average gradient value of all pixels in domain, if the average gradient value is more than predetermined gradient threshold value, it is determined that the car plate sample One's respective area is license plate area, and determines the car plate component by connected component labeling method in the license plate area;
By the car light color model in the color transformation model, the car light gray-scale map of the video image is obtained, into And the binary image of the car light gray-scale map is obtained in conjunction with binary-state threshold;
The white area in the binary image is obtained, it is true by the connected component labeling method in the white area The fixed car light component.
Optionally, if the number of the car plate component and the car light component in the inverse projection figure and not small In preset value, then the likelihood score of the car plate component and the car light component in the gauss hybrid models is obtained, if institute The numerical value for stating likelihood score is more than likelihood score threshold value, it is determined that the car plate component and the component that the car light component is a vehicle, And then determine number of vehicles, including:
Obtain the car plate component and the car light component in the inverse projection figure number and;
If the number and be not less than preset value, obtain the car plate component and the vehicle in the inverse projection figure The distance between lamp part value and angle value, and then determine the distance value and the angle value in the gauss hybrid models Likelihood score;
If the numerical value of the likelihood score is more than likelihood score threshold value, it is determined that the car plate component and the car light component are The component of one vehicle, and then determine number of vehicles.
Optionally, the vehicle checking method based on space of components relationship further includes:
If the numerical value of the likelihood score is less than the likelihood score threshold value, because of the car light component and the car plate component Quantity it is very few, can not determine vehicle detection result.
The advantageous effect that technical solution provided by the invention is brought is:
By introducing gauss hybrid models during vehicle detection, compared with prior art, can overcome block and Influence of the illumination condition difference to algorithm of target detection, improves the accuracy of vehicle identification.
Description of the drawings
It, below will be to attached drawing needed in embodiment description in order to illustrate more clearly of technical scheme of the present invention It is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, general for this field For logical technical staff, without creative efforts, other drawings may also be obtained based on these drawings.
Fig. 1 is a kind of flow diagram of vehicle checking method based on space of components relationship provided by the invention;
Fig. 2 is the spatial relationship schematic diagram between car plate component and car light component provided by the invention;
Fig. 3 is the schematic diagram of camera calibration method provided by the invention;
Fig. 4 (a) is the inverse projection face provided by the invention built;
Fig. 4 (b) is the inverse projection face for carrying out video image to be parallel to X-O-Z planes in inverse projection processing to three dimensions Inverse projection Fig. 1 of upper structure;
Fig. 4 (c) is the inverse projection face for carrying out video image to be parallel to Y-O-Z planes in inverse projection processing to three dimensions Inverse projection Fig. 2 of upper structure;
Fig. 5 (a) is the raw video image of car plate component retrieval provided by the invention;
Fig. 5 (b) is obtained inverse projection figure after Inverse projection provided by the invention;
Fig. 5 (c) is the car plate gray-scale map after conversion provided by the invention;
Fig. 5 (d) is the car plate gradient map provided by the invention got;
Fig. 5 (e) is the average gradient value image of car plate sample areas provided by the invention;
Fig. 5 (f) is the sharp picture of obtained car plate component provided by the invention.
Fig. 6 (a) provides the raw video image of car light component retrieval for invention;
Fig. 6 (b) is the car plate gray-scale map after the conversion that invention provides;
Fig. 6 (d) is the binary image after the Threshold segmentation that invention provides;
Fig. 6 (e) is the sharp picture for the obtained car plate component that invention provides.
Specific implementation mode
To keep structure of the invention and advantage clearer, the structure of the present invention is made further below in conjunction with attached drawing Description.
Embodiment one
The present invention provides a kind of vehicle checking methods based on space of components relationship, as shown in Figure 1, described be based on component The vehicle checking method of spatial relationship, including:
11, video image is obtained, is determined between the car plate component of vehicle sample in the video image and car light component Distance value and angle value, according to the distance value and angle value combination algorithm foundation represent car plate component and car light component it Between spatial relationship gauss hybrid models;
12, the video image is demarcated using direct linear transformation, obtains perspective transformation matrix;
13, inverse projection face is built, the information in the video image is carried out by inverse projection according to the perspective transformation matrix, Obtain inverse projection figure;
14, according to color transformation model, in conjunction with gradient algorithm, the car plate component and institute are determined from the inverse projection figure State car light component;
If the 15, number of the car plate component in the inverse projection figure and the car light component and not less than default Value, then obtain the likelihood score of the car plate component and the car light component in the gauss hybrid models, if the likelihood The numerical value of degree is more than likelihood score threshold value, it is determined that the car plate component and the component that the car light component is a vehicle, and then really Determine number of vehicles.
In force, in order to solve defect difficult to road vehicle identification in the prior art, present applicant proposes A kind of vehicle checking method based on space of components relationship, the particular content of this method are as follows:
First, the video image with vehicle to be detected is obtained, determines the car plate component of vehicle sample in the video image The distance between car light component value length and angle value angle, according to the distance value length and the angle value Angle combination EM algorithms establish the gauss hybrid models (GMM) for representing spatial relationship between car plate component and car light component.Here Spatial relationship between car plate component and car light component can refer to left car light with reference chart 2, the wherein regions LR, and the regions RR refer to right Car light, the regions LP then refer to car plate.D refers to the distance between two components value length, and θ is then referred between two components Angle value angle.
It is worth noting that, it is one that EM algorithms used herein, which are (Expection-Maximizationalgorithm), Kind iterative algorithm walks two big iterative steps by E steps and M, and each iteration all makes maximum likelihood function increase.Specifically:
(1) by the way that initialization value is arranged, finding out makes the maximum value of likelihood equation, this step is known as E- steps (E-step)
(2) value found out, update are utilized.This step is known as M- steps (M-step).
And Gauss model (GMM, Gaussian mixture model) is exactly to use Gaussian probability-density function (normal distribution Curve) accurately quantify things, a things is decomposed into several based on Gaussian probability-density function (normal distribution curve) The model of formation.The principle and process of Gauss model are established to image background:Image grey level histogram reflection is certain in image The frequency that a gray value occurs, can also be thought as the estimation of gradation of image probability density.If the target area that image is included Domain and background area difference are bigger, and there are certain difference in background area and target area in gray scale, then the image Double peak-to-valley shapes are presented in grey level histogram, and one of peak corresponds to target, another peak corresponds to the center gray scale of background.
Then, the video image is demarcated using direct linear transformation, obtains perspective transformation matrix;
Here direct linear transformation is also known as Direct Linear Transformation, abbreviation DLT.It is to establish picture The algorithm of direct linear relationship between point coordinates instrument and corresponding object point object space coordinate.With following features:In not needing Elements of exterior orientation, is suitable for non-metric camera, in satisfaction, the measurement task of low precision.
Secondly, inverse projection face is built, in order to which the perspective transformation matrix that is obtained according to back is by the letter in video image Type inverse projection is ceased, to get inverse projection figure.
During actual photographed, the scene graph that video camera takes is projection of the three dimensional spatial scene in two-dimensional space, During the vehicle travelled on road and road is identified using machine vision, a kind of Converse solved mistake is needed Journey is reduced into the pavement image of vertical view from obtained two dimensional image.According to after above-mentioned transformation by reciprocal direction as a result, can obtain The depth information of road is got, pavement of road situation can be preferably provided, vehicle is more easily provided and travels reference information.This It is also the theoretical foundation of vehicle checking method provided by the invention.
Again, on the basis of the inverse projection figure that back is got, according to color transformation model and gradient algorithm is combined, Detailed car plate component and car light component are determined from the inverse projection figure.The particular content of the step carries out in detail below Analysis, details are not described herein again.
Finally, the quantity of the car plate component and car light component that are determined to back summarizes, if the inverse projection figure In the car plate component and the car light component number and be not less than preset value, then obtain the car plate component and the vehicle Likelihood score of the lamp part in the gauss hybrid models, if the numerical value of the likelihood score is more than likelihood score threshold value, it is determined that The car plate component and the component that the car light component is a vehicle, and then determine number of vehicles.Equally, detailed content is later In analyzed.
The present invention provides a kind of vehicle checking methods based on space of components relationship, including establish gauss hybrid models, Perspective transformation matrix is obtained, inverse projection face is built, is carried out the information in the video image according to the perspective transformation matrix Inverse projection obtains inverse projection figure, the car plate component and the car light component is determined from the inverse projection figure, if described inverse The number of the car plate component and the car light component in perspective view and be not less than preset value, then determining the car plate component It is determining number of vehicles after the component of a vehicle with the car light component.By introducing Gaussian Mixture mould during vehicle detection Type can overcome and block and influence of the illumination condition difference to algorithm of target detection, improve vehicle knowledge compared with prior art Other accuracy.
Optionally, described that the video image is demarcated using direct linear transformation, obtain perspective transformation matrix, packet It includes:
The calibration point of six known coordinates is chosen in world coordinate system, wherein four calibration points are located at horizontal plane, The height value of calibration point described in another two is not zero;
Image coordinate of the calibration point of six known coordinates in image coordinate system is obtained, is obtained by least square method Take the perspective transformation matrix between the world coordinate system and described image coordinate system.
In force, in conjunction with Fig. 3, the camera calibration method in above-mentioned steps is illustrated, camera calibration needs six The calibration point of its known world coordinate system, wherein four calibration points are in the horizontal plane, such as P0~P3 points in Fig. 3, other two Calibration point is not in the horizontal plane, that is to say, that height in space is not equal to 0, such as P4~P5 points in Fig. 4.
Refer to projection relation of the scene in three-dimensional space to the plane of delineation in specifically used imaging model, in objective world Three-dimensional scene projection be related to several coordinate systems to the two dimensional image that video camera takes:
(1) world coordinate system, also referred to as true or real coordinate system are the absolute coordinate systems of objective world.
(2) camera coordinate system is the coordinate system sheared as coordinate origin using video camera.
(3) image coordinate system is the plane coordinate system formed in the image that video camera takes.
(4) computer picture coordinate system is the coordinate system used in computer-internal digital picture.
First kind world coordinate system and third class image coordinate system are used in this step, are led in image coordinate system Coordinate of the known point in world coordinate system is crossed, and is got between image coordinate system and world coordinate system in conjunction with least square method Transition matrix, which is perspective transformation matrix.The inverse projection that the perspective transformation matrix is used in subsequent step turns It changes.
Optionally, the structure inverse projection face, according to the perspective transformation matrix by the information in the video image into Row inverse projection obtains inverse projection figure, including:
Pane location is chosen on the inverse projection face, determines that each pane location is corresponding on the video image Sampled pixel point;
The video image is converted into gray level image, and obtains the gray value of the sampled pixel point;
Inverse throw will be carried out on inverse projection face described in the gray value phase of the sampled pixel point according to the perspective transformation matrix Shadow obtains the inverse projection figure after inverse projection.
In force, it in order to which the information in video image to be carried out to the process of inverse projection according to perspective transformation matrix, needs Carry out following steps:
(1) using the lattice of 5cm × 5cm as pane location on inverse projection face, and by the pane location to video figure As being projected in residing plane, in order to each pane location of determination corresponding image-region on the video images, and then determining should The sampled pixel point for including in image-region.
(2) video image is converted into gray level image, the sample picture that back is got is determined from the gray level image The gray value of vegetarian refreshments.
(3) perspective transformation matrix obtained before is combined according to the gray value of the sampled pixel point got, in inverse projection Type inverse projection on face, to get the inverse projection figure after inverse projection.Box in Fig. 4 (a) is the inverse projection face of structure, figure 4 (b) be by video image carry out inverse projection processing to be parallel in three dimensions built on the inverse projection face of X-O-Z planes it is inverse Perspective view 1, Fig. 4 (c) are the inverse projection face for carrying out video image to be parallel to Y-O-Z planes in inverse projection processing to three dimensions Inverse projection Fig. 2 of upper structure.
By the Inverse projection of this step, the step of projecting video image on inverse projection face is realized, in order to According to the vehicle identification step realized in perspective plane progress subsequent step.
Optionally, described according to color transformation model, in conjunction with gradient algorithm, the car plate is determined from the inverse projection figure Component and the car light component, including:
By the car plate color model in color transformation model, the car plate gray-scale map of the video image is obtained, and then is obtained Take the car plate gradient map of the car plate gray-scale map;
Car plate sample areas identical with car plate size is chosen from the car plate gradient map, obtains the car plate sample area The average gradient value of all pixels in domain, if the average gradient value is more than predetermined gradient threshold value, it is determined that the car plate sample One's respective area is license plate area, and determines the car plate component by connected component labeling method in the license plate area;
By the car light color model in the color transformation model, the car light gray-scale map of the video image is obtained, into And the binary image of the car light gray-scale map is obtained in conjunction with binary-state threshold;
The white area in the binary image is obtained, it is true by the connected component labeling method in the white area The fixed car light component.
In force, it in order to be accurately obtained the image of car plate component, needs to carry out following steps:
By the car plate color model in preset color conversion model, video image is converted, after obtaining conversion Car plate gray-scale map, and then obtain the car plate gradient map of the car plate gray-scale map.Then selection and car plate from the car plate gradient map The comparable car plate sample areas of area, and then the average gradient value of the car plate sample areas is obtained, in order to combine predetermined gradient Threshold value determines license plate area, and accurate car plate component is determined by connected component labeling method in determining license plate area.
Fig. 5 (a) is raw video image, and Fig. 5 (b) is the inverse projection figure obtained after Inverse projection, and Fig. 5 (c) is conversion Car plate gray-scale map afterwards, Fig. 5 (d) are the car plate gradient map got, and Fig. 5 (e) is the average gradient value figure of car plate sample areas Picture, Fig. 5 (f) are the sharp picture of obtained car plate component.
In order to be accurately obtained the image of car light component, need to carry out following steps:
By the car light color model in preset color conversion model, video image is converted, after obtaining conversion Car light gray-scale map, the binary image of car light gray-scale map is then obtained by binary conversion treatment.It extracts in the binary image White area, the car light component is determined by the connected component labeling method in white area.
Fig. 6 (a) is raw video image, and Fig. 6 (b) is the car plate gray-scale map after conversion, and Fig. 6 (d) is after Threshold segmentation Binary image, Fig. 6 (e) are the sharp picture of obtained car plate component.
Through the above steps, the car plate component in video image and car light component can be accurately obtained, to be follow-up step Accurate vehicle identification is carried out in rapid to lay the foundation.
Optionally, if the number of the car plate component and the car light component in the inverse projection figure and not small In preset value, then the likelihood score of the car plate component and the car light component in the gauss hybrid models is obtained, if institute The numerical value for stating likelihood score is more than likelihood score threshold value, it is determined that the car plate component and the component that the car light component is a vehicle, And then determine number of vehicles, including:
Obtain the car plate component and the car light component in the inverse projection figure number and;
If the number and be not less than preset value, obtain the car plate component and the vehicle in the inverse projection figure The distance between lamp part value and angle value, and then determine the distance value and the angle value in the gauss hybrid models Likelihood score;
If the numerical value of the likelihood score is more than likelihood score threshold value, it is determined that the car plate component and the car light component are The component of one vehicle, and then determine number of vehicles.
In force, after back gets accurate car plate component and car light component, the quantity of the two is converged Always, if number and be not less than preset value, obtain the car plate component and the car light component in the gauss hybrid models In likelihood score, if the numerical value of the likelihood score be more than likelihood score threshold value, it is determined that the car plate component and the car light portion Part is the component of a vehicle, to complete the judgement to a vehicle, is repeated the above steps in video image, and then is determined whole Number of vehicles.
Road vehicle is identified through the above steps, compared with the existing technology in scheme, can be significant Improve the accuracy of vehicle identification.
Optionally, the vehicle checking method based on space of components relationship further includes:
If the numerical value of the likelihood score is less than the likelihood score threshold value, because of the car light component and the car plate component Quantity it is very few, can not determine vehicle detection result.
In force, after back gets accurate car plate component and car light component, the quantity of the two is converged Always, if the number summarized is less than preset value, likelihood score threshold can be less than because of the very few numerical value for leading to likelihood score of number of components Value cannot also realize accurate vehicle identification to determine whether above-mentioned component belongs to same vehicle.
The present invention provides a kind of vehicle checking methods based on space of components relationship, including establish gauss hybrid models, Perspective transformation matrix is obtained, inverse projection face is built, is carried out the information in the video image according to the perspective transformation matrix Inverse projection obtains inverse projection figure, the car plate component and the car light component is determined from the inverse projection figure, if described inverse The number of the car plate component and the car light component in perspective view and be not less than preset value, then determining the car plate component It is determining number of vehicles after the component of a vehicle with the car light component.By introducing Gaussian Mixture mould during vehicle detection Type can overcome and block and influence of the illumination condition difference to algorithm of target detection, improve vehicle knowledge compared with prior art Other accuracy.
It should be noted that:The vehicle checking method based on space of components relationship that above-described embodiment provides carries out vehicle inspection The embodiment of survey, the only explanation as the vehicle checking method in practical applications, can also according to actual needs will be above-mentioned Vehicle checking method uses in other application scene, and specific implementation process is similar to above-described embodiment, and which is not described herein again.
Each serial number in above-described embodiment is for illustration only, the assembling for not representing each component or the elder generation during use Sequence afterwards.
Example the above is only the implementation of the present invention is not intended to limit the invention, all in the spirit and principles in the present invention Within, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.

Claims (5)

1. a kind of vehicle checking method based on space of components relationship, which is characterized in that the vehicle based on space of components relationship Detection method, including:
Obtain video image, determine the distance between car plate component and the car light component of vehicle sample in video image value and Angle value represents space between car plate component and car light component according to the distance value and angle value combination algorithm foundation and closes The gauss hybrid models of system;
The video image is demarcated using direct linear transformation, obtains perspective transformation matrix;
Information in the video image is carried out inverse projection according to the perspective transformation matrix, obtained inverse by the inverse projection face of structure Perspective view;
According to color transformation model, in conjunction with gradient algorithm, the car plate component and the car light are determined from the inverse projection figure Component;
If the number of the car plate component and the car light component in the inverse projection figure and be not less than preset value, obtain The likelihood score of the car plate component and the car light component in the gauss hybrid models, if the numerical value of the likelihood score is big In likelihood score threshold value, it is determined that the car plate component and the component that the car light component is a vehicle, and then determine number of vehicles, Including:
Obtain the car plate component and the car light component in the inverse projection figure number and;
If the number and be not less than preset value, obtain the car plate component in the inverse projection figure and the car light portion The distance between part value and angle value, and then determine the distance value and the angle value in the gauss hybrid models seemingly So degree;
If the numerical value of the likelihood score is more than likelihood score threshold value, it is determined that the car plate component and the car light component are one The component of vehicle, and then determine number of vehicles.
2. the vehicle checking method according to claim 1 based on space of components relationship, which is characterized in that described using straight It connects linear transformation to demarcate the video image, obtains perspective transformation matrix, including:
The calibration point of six known coordinates is chosen in world coordinate system, wherein four calibration points are located at horizontal plane, another two The height value of a calibration point is not zero;
Image coordinate of the calibration point of six known coordinates in image coordinate system is obtained, institute is obtained by least square method State the perspective transformation matrix between world coordinate system and described image coordinate system.
3. the vehicle checking method according to claim 1 based on space of components relationship, which is characterized in that the structure is inverse Information in the video image is carried out inverse projection according to the perspective transformation matrix, obtains inverse projection figure, packet by perspective plane It includes:
Pane location is chosen on the inverse projection face, determines each pane location corresponding sample on the video image This pixel;
The video image is converted into gray level image, and obtains the gray value of the sampled pixel point;
Inverse projection will be carried out on inverse projection face described in the gray value phase of the sampled pixel point according to the perspective transformation matrix, obtained Take the inverse projection figure after inverse projection.
4. the vehicle checking method according to claim 1 based on space of components relationship, which is characterized in that described according to face Color transformation model determines the car plate component and the car light component in conjunction with gradient algorithm from the inverse projection figure, including:
By the car plate color model in color transformation model, the car plate gray-scale map of the video image is obtained, and then obtain institute State the car plate gradient map of car plate gray-scale map;
Car plate sample areas identical with car plate size is chosen from the car plate gradient map, is obtained in the car plate sample areas The average gradient value of all pixels, if the average gradient value is more than predetermined gradient threshold value, it is determined that the car plate sample area Domain is license plate area, and determines the car plate component by connected component labeling method in the license plate area;
By the car light color model in the color transformation model, the car light gray-scale map of the video image, Jin Erjie are obtained Close the binary image that binary-state threshold obtains the car light gray-scale map;
The white area in the binary image is obtained, institute is determined by the connected component labeling method in the white area State car light component.
5. the vehicle checking method according to claim 1 based on space of components relationship, which is characterized in that described to be based on portion The vehicle checking method of part spatial relationship further includes:
If the numerical value of the likelihood score is less than the likelihood score threshold value, because of the number of the car light component and the car plate component It measures very few, can not determine vehicle detection result.
CN201510566019.7A 2015-09-08 2015-09-08 A kind of vehicle checking method based on space of components relationship Active CN105160324B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510566019.7A CN105160324B (en) 2015-09-08 2015-09-08 A kind of vehicle checking method based on space of components relationship

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510566019.7A CN105160324B (en) 2015-09-08 2015-09-08 A kind of vehicle checking method based on space of components relationship

Publications (2)

Publication Number Publication Date
CN105160324A CN105160324A (en) 2015-12-16
CN105160324B true CN105160324B (en) 2018-10-26

Family

ID=54801176

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510566019.7A Active CN105160324B (en) 2015-09-08 2015-09-08 A kind of vehicle checking method based on space of components relationship

Country Status (1)

Country Link
CN (1) CN105160324B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106056102A (en) * 2016-07-01 2016-10-26 哈尔滨工业大学 Video-image-analysis-based road vehicle type classification method
CN106295528A (en) * 2016-08-01 2017-01-04 长安大学 A kind of vehicle checking method based on multi-part spatial relation GMM modeling
CN106898016A (en) * 2017-01-19 2017-06-27 博康智能信息技术有限公司北京海淀分公司 Obtain the method and device of vehicle scale information in traffic image
CN108932453B (en) * 2017-05-23 2021-04-09 杭州海康威视数字技术股份有限公司 Vehicle spare tire detection method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101211408A (en) * 2006-12-29 2008-07-02 沈阳东软软件股份有限公司 Vehicle side image recognition method and apparatus, car lamp error identification detection and driving safety prediction method
CN102136194A (en) * 2011-03-22 2011-07-27 浙江工业大学 Road traffic condition detection device based on panorama computer vision
CN103870809A (en) * 2014-02-27 2014-06-18 奇瑞汽车股份有限公司 Vehicle detection method and device
US9025825B2 (en) * 2013-05-10 2015-05-05 Palo Alto Research Center Incorporated System and method for visual motion based object segmentation and tracking

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120148092A1 (en) * 2010-12-09 2012-06-14 Gorilla Technology Inc. Automatic traffic violation detection system and method of the same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101211408A (en) * 2006-12-29 2008-07-02 沈阳东软软件股份有限公司 Vehicle side image recognition method and apparatus, car lamp error identification detection and driving safety prediction method
CN102136194A (en) * 2011-03-22 2011-07-27 浙江工业大学 Road traffic condition detection device based on panorama computer vision
US9025825B2 (en) * 2013-05-10 2015-05-05 Palo Alto Research Center Incorporated System and method for visual motion based object segmentation and tracking
CN103870809A (en) * 2014-02-27 2014-06-18 奇瑞汽车股份有限公司 Vehicle detection method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于可变形部件模型的车辆检测方法研究;吴东承;《中国优秀硕士学位论文全文数据库 信息科技辑》;20150115(第2015年01期);I138-956 *

Also Published As

Publication number Publication date
CN105160324A (en) 2015-12-16

Similar Documents

Publication Publication Date Title
CN108983219B (en) Fusion method and system for image information and radar information of traffic scene
CN111694010B (en) Roadside vehicle identification method based on fusion of vision and laser radar
Kühnl et al. Spatial ray features for real-time ego-lane extraction
CN102044151B (en) Night vehicle video detection method based on illumination visibility identification
CN111666805B (en) Class marking system for autopilot
Yao et al. Extraction and motion estimation of vehicles in single-pass airborne LiDAR data towards urban traffic analysis
CN105335702B (en) A kind of bayonet model recognizing method based on statistical learning
Liu et al. A survey of vision-based vehicle detection and tracking techniques in ITS
CN105160324B (en) A kind of vehicle checking method based on space of components relationship
CN102708356A (en) Automatic license plate positioning and recognition method based on complex background
CN107607953A (en) A kind of lateral vehicle collision avoidance system and method
CN109791607A (en) It is detected from a series of images of video camera by homography matrix and identifying object
CN112434706B (en) High-precision traffic element target extraction method based on image point cloud fusion
CN115830265A (en) Automatic driving movement obstacle segmentation method based on laser radar
Kühnl et al. Visual ego-vehicle lane assignment using spatial ray features
CN112257668A (en) Main and auxiliary road judging method and device, electronic equipment and storage medium
Wu et al. A variable dimension-based method for roadside LiDAR background filtering
Yao et al. Automated detection of 3D individual trees along urban road corridors by mobile laser scanning systems
Wang et al. Pavement marking incorporated with binary code for accurate localization of autonomous vehicles
CN114639115A (en) 3D pedestrian detection method based on fusion of human body key points and laser radar
Munajat et al. Road detection system based on RGB histogram filterization and boundary classifier
Gigli et al. Road segmentation on low resolution lidar point clouds for autonomous vehicles
Börcs et al. On board 3D object perception in dynamic urban scenes
CN115588047A (en) Three-dimensional target detection method based on scene coding
CN113762195A (en) Point cloud semantic segmentation and understanding method based on road side RSU

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20211231

Address after: 710000 room d4405, 4th floor, free trade bonded building, No. 1, free trade Avenue, airport new town, Xixian new area, Xi'an, Shaanxi a44

Patentee after: Xi'an Dewei Shitong Intelligent Transportation Co.,Ltd.

Address before: 710064 No. 126 central section of South Ring Road, Yanta District, Xi'an, Shaanxi

Patentee before: CHANG'AN University

CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 710000 room d4405, 4th floor, free trade bonded building, No. 1, free trade Avenue, airport new town, Xixian new area, Xi'an, Shaanxi a44

Patentee after: Xi'an Dewei Shitong Intelligent Technology Co.,Ltd.

Address before: 710000 room d4405, 4th floor, free trade bonded building, No. 1, free trade Avenue, airport new town, Xixian new area, Xi'an, Shaanxi a44

Patentee before: Xi'an Dewei Shitong Intelligent Transportation Co.,Ltd.