CN103903445A - Vehicle queuing length detection method and system based on video - Google Patents

Vehicle queuing length detection method and system based on video Download PDF

Info

Publication number
CN103903445A
CN103903445A CN201410162991.3A CN201410162991A CN103903445A CN 103903445 A CN103903445 A CN 103903445A CN 201410162991 A CN201410162991 A CN 201410162991A CN 103903445 A CN103903445 A CN 103903445A
Authority
CN
China
Prior art keywords
vehicle
area
interest
queue
tail
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410162991.3A
Other languages
Chinese (zh)
Inventor
戴丽萍
喻松
陶万杰
李天歌
姜明凤
顾畹仪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Posts and Telecommunications
Original Assignee
Beijing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Posts and Telecommunications filed Critical Beijing University of Posts and Telecommunications
Priority to CN201410162991.3A priority Critical patent/CN103903445A/en
Publication of CN103903445A publication Critical patent/CN103903445A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)

Abstract

The invention provides a vehicle queuing length detection method and system based on a video in the intelligent transportation system. The method and system can provide a certain digital basis to relieve and solve traffic jams. The method relates to a system initialization unit used for extracting information and establishing initialization parameters, an environment classification unit used for environment classification and switching and guaranteeing the accuracy of the system in different weathers and environments, a vehicle feature extracting unit for extracting prominent vehicle features in the current environment, and a vehicle queuing detection unit for finding out the tail of a queue and calculating the queuing length. According to the method and system, a camera model is established by means of standard pavement markers without the assistance of a calibration board, and the parameters of the model can be adjusted in real time to reduce the errors caused by tiny offset of a camera; the tail of the queue is looked for by controlling the movement of an interested area, the vacant phenomenon during vehicle queuing can be dealt with, real-time requirements of video monitoring are met, the detection efficiency and accuracy of the systemare improved, the application range is wide, and stability and reliability are high.

Description

A kind of vehicle queue length detection method and system based on video
Technical field
The present invention relates to intelligent transportation field, particularly in the system such as road traffic control and expressway tol lcollection, utilize the system that detects the vehicle characteristics of area-of-interest and state and control area-of-interest and move to vehicle queue's tail of the queue.
Background technology
Along with developing rapidly of transportation, it is more and more serious that traffic congestion phenomenon has become.Especially the jam before freeway toll station and city traffic signal lamp is very outstanding.Traffic congestion uprises traffic hazard incidence, has brought great inconvenience to people's trip.Therefore a kind of vehicle queue length detection method and systematic research based on video is extremely urgent, the queue length of the acquisition vehicle that it can be real-time, and feed back in time the control of intelligent transportation control axis and relieve traffic congestion, improve intelligent level.
Traditional vehicle queue length detection scheme is at porch, track sensor installation formula detecting device.In the publication number patent that is CN102568215A, the Data mining device that adopts toroid winding, coil tuning loop and testing circuit to form, detect flow signal and transmit it to teleseme, by teleseme, the analysis meter of flow signal being calculated the queue length of vehicle.The accuracy of this class sensor type detecting device detection vehicle queue and real-time depend on quantity and the installation site of detecting device largely.In addition on the one hand, once the breaking down of this class sensor type detecting device, maintenance difficulties can be larger.
Existing vehicle queue length detection scheme is the vehicle queue length detection technique based on video image analysis.As the some feature (angle point) by having merged image and line feature (edge), complete wagon flow length detection (referring to Li Yan etc. (12 phases in 2003). application image disposal route detects crossing vehicle queue length automatically. computer utility and software); As the movement of the moving window by artificial demarcation detects vehicle queue length (patent that is CN103258425A referring to publication number).
In the time of actual vehicle queue video analysis, in vehicle queue length detection technique based on video image analysis, the vehicle queue length detection method based on a feature (angle point) and line feature (edge) analysis proposing as above-mentioned journal, due to the problem of the shooting angle of video camera, when vehicle congestion, between vehicle, mutual eclipse phenomena can cause the unstable of the disappearance of a feature and line feature, so that cannot carry out accurately the calculating of follow-up vehicle queue length, finally can not reach the object that detects vehicle queue length.Detect vehicle queue length as above-mentioned patent CN101751558A proposition by the movement of the moving window of artificial demarcation, artificial demarcation moving window described in the method detects and has certain limitation for vehicle queue length, testing result accuracy is had a certain impact, on the other hand, in this technical scheme, only detect for vehicle queue under daytime environment, variation that can not adaptive environment, and the unicity that vehicle characteristics is chosen, by the accuracy that is finally difficult to ensure that vehicle queue length detects.In sum, at present in the urgent need to a kind of method and system that can detect round-the-clock detection vehicle queue length.
Summary of the invention
The object of the embodiment of the present invention is to provide a kind of information real-time based on video camera and the vehicle queue length detection method and the system that build.This system extracts after initial background image from video flowing, sets up camera imaging model and delimits track, finally according to vehicle feature extraction result under different scenes, Vehicle length is adjudicated.This system, in ensureing that necessary information processing real-time is high, considers that round-the-clock environmental change is greatly improved the accuracy detecting.
For meeting above-mentioned purpose, the mist detecting device based on video and the method that provide according to the embodiment of the present invention, the method comprises:
First step, initialization unit, sets up background model by the N two field picture to continuous, obtain stable initialization background image and and initialization reference picture, in initialization reference picture, delimit track, set up camera imaging model;
Second step, by catch a two field picture every time T, calculates this two field picture average brightness value, this value curve over time in adding up one day, analyze the first order derivative of this curve, carry out environment classification according to analysis result, and start the detection system of respective environment.
Third step, based on two kinds of environment classifications: daytime, night.According to the type of environment, extract respectively under current environment clarification of objective and state in area-of-interest, judge whether target is slow running vehicle.
The 4th step, according to the existence of vehicle and motion state, judges whether current area-of-interest to move to next area-of-interest by predefined rule.
The 5th step, circulation third step and the 4th step, until find the tail of the queue of vehicle queue, arrive three-dimensional transformational relation according to two dimensional image, thus the actual queue length of calculating and exporting vehicle.
According to another aspect of the present invention, the vehicle queue length detection system based on video camera that the embodiment of the present invention provides, this system composition structure comprises:
(1) initialization unit, sets up background model by the N two field picture to continuous, obtain stable initialization background image and and initialization reference picture, in initialization reference picture, delimit track, set up camera imaging model;
(2) environment classification unit, by catch a two field picture every time T, calculates this two field picture average brightness value, this value curve over time in adding up one day, analyze the first order derivative of this curve, carry out environment classification according to analysis result, and start the detection system of respective environment.
(3) vehicle identifying unit, based on two kinds of environment classifications: daytime, night.According to the type of environment, extract respectively under current environment clarification of objective and state in area-of-interest, judge whether target is slow running vehicle.
(4) vehicle queue's detecting unit, according to the existence of vehicle and motion state, judges whether current area-of-interest to move to next area-of-interest by predefined rule.
(5) output unit, circulation (3) and (4), until find the tail of the queue of vehicle queue, and according to the transformational relation of 2 d-to-3 d, thus the actual queue length of calculating and exporting vehicle.
Compared with prior art, the key distinction and effect thereof are embodiment of the present invention:
Existing vehicle queue's detection method based on video is all for the detection under daytime environment mostly, detection under night environment is had to less concern, on the other hand, it detects the slip of vehicle queue length based on detection window, but its size to moving window is set and do not done too much introduction, the artificial moving window of setting has larger impact to the accuracy that detects vehicle queue length.In addition, existing detection method, do not consider due to some vehicle reaction not in time, the room phenomenon of the doubtful arrival tail of the queue causing, this can calculate and have a great impact final vehicle queue length.Based on above 3 points, the accuracy that existing vehicle queue length detects adaptive ability to environment and detection needs to improve.
The method that the present invention proposes, in initialization unit, first set up background model by the N two field picture to continuous, obtain stable initialization background image, in initialization background image,, obtain four points in pavement markers with rectangle geometrical property and form rectangle frame in conjunction with manual correction by video camera Corner Detection, complete the foundation of camera model.Further, according to the mapping relations of the 2 d-to-3 d in camera model, taking vehicle length L on actual road surface as according to by driveway partition as several area-of-interests.Compare the size of the artificial setting moving window in existing vehicle queue detection method, accuracy has had raising to a certain degree.In environment classification unit, by catching a two field picture every the T time, calculate the ensemble average brightness of this two field picture, draw ensemble average brightness conditional curve over time.Analyze the first order derivative of this curve, can obtain the trend of environment overall brightness curve, thereby start accurately the detection system of respective environment, improved the environment self-adaption ability that vehicle queue is detected.In vehicle characteristics extraction unit, for automobile storage in daytime environment when the feature extraction, what adopt is that background image and current frame image are carried out respectively to difference, binaryzation and Roborts edge extracting, after obtaining vehicle ' s contour, profile is filled, dilation and erosion, obtain the vehicle image that compactedness is intact, reduce the impact in the vehicle region cavity of causing due to stationary vehicle, thereby improved the accuracy that vehicle characteristics extracts.In vehicle tail of the queue detects, due to some vehicle reaction not in time, the room phenomenon of the doubtful arrival tail of the queue causing, in fact the vehicle of these surveyed areas is still in queue queue, the present invention has increased the processing mode for this phenomenon, can improve to a great extent the accuracy of vehicle queue length.In sum, the method that the present invention proposes has improved the adaptive faculty of detection system to environmental change, has stronger robustness.
With reference to explanation and accompanying drawing hereinafter, and disclosing in detail embodiments of the present invention, other features of the present invention and advantage are set forth, should be appreciated that embodiments of the invention only provide as example, in the spirit of claims and the scope of clause, real-time mode of the present invention comprises many changes, revises and is equal to.
Brief description of the drawings
Fig. 1 is the system chart of the vehicle queue length detection method based on video;
Fig. 2 is the method schematic diagram of initialization unit;
Fig. 3 is the method schematic diagram of environment classification unit;
Fig. 4 is vehicle characteristics and the method schematic diagram of state extraction unit on daytime;
Fig. 5 is vehicle characteristics and the method schematic diagram of state extraction unit at night;
Fig. 6 is the method schematic diagram of vehicle queue length detecting unit;
Fig. 7 is the method schematic diagram that vehicle tail of the queue detects.
Embodiment
Below in conjunction with accompanying drawing, embodiments of the present invention are described in detail, the embodiment of setting forth, only as exemplary illustration, is not limitation of the present invention.For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing, embodiments of the present invention are described in detail.The specific embodiment of the present invention also needs some common video analysis basic modules, such as image pre-service, context update etc., no longer explains here.The present invention is applicable to freeway toll station and city traffic signal lamp crossing.
Fig. 1 shows according to the system chart of the vehicle queue length detection method based on video of the present invention, mainly comprises 4 parts according to the vehicle queue length detection method based on video of invention:
Part I, initialization unit 101, is used for extracting initial background image and sets up camera model, and the runway region of going forward side by side, selected track to be detected is divided.
Part II, environment classification unit 102, in real time current residing environment being classified, and according to the detection system of classification results startup respective environment.
Part III, vehicle characteristics extraction unit 103, according to the type of environment, extracts the vehicle prominent feature in a certain area-of-interest and the operation characteristic of vehicle under current environment, also judge automobile storage and motion state.
Part IV, vehicle queue's detecting unit 104, according to obtaining vehicle characteristics and state of motion of vehicle in vehicle characteristics extraction unit, controls area-of-interest and moves in selected track, until move to the tail of the queue of vehicle queue, thus calculate vehicle queue length.
Fig. 2 shows according to the method schematic diagram of the initialization unit of the vehicle queue length detection method based on video of the present invention.
In 201, adopt the method for image averaging, obtain main background image by the mean value that calculates N continuous two field picture, formula is as shown in (1).Suppose that present image is I i, initial background image I backfor:
I back = 1 N Σ i = 1 i = N I i - - - ( 1 )
Wherein, reference picture is I ref=I back.
In 202, by utilizing Harris Corner Detection Algorithm to find out angle point in image, revised by manual, demarcate four some A, B, C, the D with rectangle geometrical property, demarcate track to be detected simultaneously.According to the three's of photo coordinate system, camera coordinate system and world coordinate system transformational relation, set up camera imaging model, by condition AB=CD and AC=BD, obtain the following parameter of video camera: flat-moving angle is that p, pitch angle are that t, rotation angle are the distance l of s, focal distance f and the vertical directed towards ground of video camera minute surface.Thereby set up the mapping relations of two-dimensional image plane (m, n) to three-dimensional world coordinate system (x, y, 0)
Figure BDA0000494798130000055
, mapping relations formula is as shown in (2) and (3):
x = l sin p ( m sin s + n cos s ) + l sin t cos p ( m cos s - n sin s ) m cos t sin s + n cos t cos s + f sin t - - - ( 2 )
y = - l cos p ( m sin s + n cos s ) + l sin t cos p ( m cos s - n sin s ) m cos t sin s + n cos t cos s + f sin t - - - ( 3 )
In 203, choose the starting point (start_x, start_y) of queuing up on lane line to be detected in initialization reference picture and the terminating point (end_x, end_y) of unlimited distance, according to mapping relations
Figure BDA0000494798130000056
be mapped to the three-dimensional curve that fits to a z=f (x, y) after three-dimensional world coordinate system, wherein z=0.Obtain relational expression as shown in (4):
The corresponding three-dimensional world coordinate (x of the starting point of wherein queuing up (start_x, start_y) 0, y 0, 0) put known.Therefore can obtain point set (x equidistant on z=f (x, y) curve k, y k, 0), (x k-1, y k-1, 0) ... (x 0, y 0, 0).Again according to F -1, looked like accordingly plane point set (m k, n k), (m k-1, n k-1) ... (m 0, n 0), according to these point sets, will be that several length are the area-of-interest of L as the driveway partition to be detected in plane.Regulation L is 4 meters of the average lengths (comprising the length of vehicle itself and the spacing of its maintenance) of the vehicle on actual road surface.
Fig. 3 shows according to the method schematic diagram of the environment classification unit of the vehicle queue length detection method based on video of the present invention.
In 301, by obtaining a two field picture every the T time, calculate the ensemble average brightness of t time chart picture.If the brightness of certain pixel is Lum (i, j), shown in t moment ensemble average brightness L (t) computing formula (5):
L ( t ) = 1 N 1 Σ ( i , j ) Lum ( i , j , t ) - - - ( 5 )
Wherein N 1=i*j, represents pixel number, and t represents the time (zero clearing every day).
In 302, according to the Changing Pattern of L (t) value, calculate L ' (t).
In 303, make acting according to 302 result: if L ' is (t) >0, status=1 is set, expression current environment is daytime.
In 304, make acting according to 302 result: if L ' is (t) <0, status=0 is set, expression current environment is night.
Fig. 4 has gone out the vehicle characteristics and the method schematic diagram of state extraction unit on daytime according to the vehicle queue length detection method based on video of the present invention.
In 401, obtain state status=1, start vehicle queue length detection system on daytime.
In 402, to initial background image I backwith current frame image I cur, carry out respectively Roborts edge extracting, obtain I ' backand I ' curedge image.To I ' backand I ' curedge image carries out Difference Calculation and obtains difference image I chafen, then to I chafencarry out binaryzation, obtain the I ' of the edge contour information that comprises all vehicles chafenimage.The threshold value T of regulation binary conversion treatment 2value is 20.
In 403, to I ' chafenimage carries out profile filling, obtains the binary image I that comprises complete information of vehicles result.
In 404, to 403 statistics I resultthe pixel number N of vehicle in a certain area-of-interest in image 2, and all pixel number N of this area-of-interest 3.Calculate N 2and N 3ratio p, formula is as shown in (6):
p = N 2 N 3 - - - ( 6 )
If p>T 2, representing has automobile storage to exist in area-of-interest, otherwise does not have vehicle, wherein specifies T 2be 0.8.
In 405, obtain three two field pictures, suppose current frame image I cur, front cross frame image is I cur-1, I cur-2, by the poor operation of this three two field pictures frame, formula is as shown in (7) and (8):
I cha1=|I cur-I cur-1| (7)
I cha2=|I cur-I cur-2| (8)
To image I cha1and I cha2image carries out binaryzation, obtain image I ' cha1and I ' cha2, wherein, binary-state threshold parameter is T 3can get the arbitrary integer between 8~15, T 4can get the arbitrary integer between 8~15.
In 406, calculate respectively I ' cha1and I ' cha2the non-zero pixels points N in the region of vehicle movement in image 4and N 5, k the pixel number N that area-of-interest is all k, obtaining the motion state parameters of vehicle, formula is as shown in (9):
&upsi; = | N 4 - N 5 | N k * T f - - - ( 9 )
Wherein T frelevant with frame per second, T in the present invention fvalue get 0.08.State to υ is adjudicated: if υ≤T 5, represent that vehicle is in slow running state, otherwise vehicle is in high-speed cruising state, wherein T 5value get the arbitrary value between 1.5~2.5.
Fig. 5 has gone out the vehicle characteristics and the method schematic diagram of state extraction unit at night according to the vehicle queue length detection method based on video of the present invention.
In 501, obtain state status=0, start vehicle queue length detection system at night.
In 502, current frame image is carried out to white cap transformation, obtain the binary image I that comprises car light information night.
In 503, at I nightin image, extract profile boundary information (profile number cnt, the centre coordinate C ' of profile i(x, y)).Wherein, according to mapping relations F, the profile barycentric coordinates as in plane are mapped to three-dimensional world coordinate C ' i(x, y), wherein 0<i≤cnt.
In 504, the profile boundary information in a certain area-of-interest is analyzed.Automobile storage condition, formula is as shown in (10) and (11):
cnt=2 (10)
||C′ 1(x,y)-C′ 2(x,y)||=T 6 (11)
Meet above two conditions and have vehicle.Wherein T 6represent the fixed range of vehicle car light, can value 2~2.5 meters.
In 505, obtain three two field pictures, present frame binary image I nightwith its front cross frame binary image I night-1, I night-2, carry out the poor operation of three frames.As shown in formula (12) and (13):
I ch1=I night∩I night-2 (12)
I ch2=I night∩I night-1 (13)
In 506, calculate respectively I ch1and I ch2the pixel number N in the region of vehicle movement in image 6and N 7, and k the pixel number N that area-of-interest is all k.Obtain the motion state of vehicle, as shown in formula (14):
&upsi; &prime; = | N 6 - N 7 | N k * T k &prime; - - - ( 14 )
Wherein T ' frelevant with frame per second, T ' in the present invention fvalue get 0.08.。State to υ ' is adjudicated: if υ '≤T 7represent that vehicle is in slow running state, otherwise vehicle is in high-speed cruising state.Wherein T 7get the arbitrary value between 0.3~0.6.
Fig. 6 has gone out according to the method schematic diagram of the vehicle queue length detecting unit of the vehicle queue length detection method based on video of the present invention.
In 601, represent that existing front n-1 car is in queueing condition, the queueing condition of n surveyed area of current detection.
In 602, obtain current detection region automobile storage state, and make judgement: E n=1, jump to 603; E n=0, jump to 607.
In 603, obtain the state of current detection region vehicle movement, and make judgement: S n=1, jump to 604; S n=0, jump to 607.
In 604, carry out the detection of vehicle tail of the queue, judge whether current detection region is vehicle queue's tail of the queue, and Fig. 7 is shown in by method detailed schematic diagram.
In 605, from 604, obtain the state value IsFind of tail of the queue, and make judgement: IsFing=2, jumps to 606; Otherwise, jump to 608.
In 606, IsFind=2 represents to arrive queuing tail of the queue, and tail of the queue region i.e. n surveyed area.Calculate vehicle queue length.Take two kinds of modes to calculate vehicle queue length, Fuzzy Calculation and accurate Calculation.
Fuzzy Calculation mode, as shown in formula (15):
Length=n*L; (15)
Accurate Calculation mode:
Obtain the coordinate (x, y) of vehicle queue's tail of the queue, shown in queue length Length computing formula (16):
Length = ( x - x 0 ) 2 + ( y - y 0 ) 2 - - - ( 16 )
In 607, control surveyed area and move to n-1 surveyed area.
In 608, control surveyed area and move to n+IsFind+1 surveyed area.
Fig. 7 has gone out the method schematic diagram detecting according to the vehicle tail of the queue of the vehicle queue length detection method based on video of the present invention.
Suppose that in l area-of-interest, automobile storage is E at status flag l, the motion state of vehicle is S l, can be defined as follows:
Figure BDA0000494798130000082
In 701, represent E in n surveyed area n=1 and S n=1, in n surveyed area, there is the vehicle of slow running.
In 702, detect n+1 surveyed area E n+1state, and go out judgement: E n+1=0, jump to 703; Otherwise, jump to 705.
In 703, detect n+2 surveyed area E n+2state, and make judgement E n+2=0, jump to 704; Otherwise, jump to 707.
In 704, represent as IsFind=2 under precondition, represent to find to arrive tail of the queue place of vehicle queue.
In 705, detect n+1 surveyed area S n+1state, S n+1=1, jump to 706.Under current situation, based on traffic rules and safe consideration, should there is not S n+1=0 state.
In 706, represent as IsFind=0 under precondition, represent not arrive tail of the queue place of vehicle queue, surveyed area is moved to n+IsFind+1 surveyed area, proceed to detect.
In 707, detect n+2 surveyed area S n+2state, and make judgement: S n+2=1, jump to 708; Otherwise, jump to 709.
In 708, represent that n+1 surveyed area of this state representation do not exist vehicle as IsFind=1 under precondition, and there is not vehicle in n+2 surveyed area, has the vehicle of slow running.Also the vehicle reaction of n+2 surveyed area is not in time, the room phenomenon of the doubtful arrival tail of the queue causing, actually the vehicle of n+2 surveyed area still in queue queue, does not find tail of the queue yet, surveyed area is moved to n+IsFind+1 surveyed area, proceed to detect.
In 709, represent as IsFind=0 under precondition, represent not arrive tail of the queue place of vehicle queue, surveyed area is moved to n+IsFind+1 surveyed area, proceed to detect.
It should be noted that, for the innovation part of outstanding the inventive method, in above-mentioned each equipment embodiment of the present invention, do not mention and realize the relevant conventional elementary cell that this technology is used, but this does not show to implement the elementary cell that the said equipment mode does not need other.

Claims (8)

1. vehicle queue length detection method and the system based on video, in particular, this invents by delimit track in initialisation image, control the movement of surveyed area interested, obtain the status information of surveyed area interested, and convert the queue length of two dimensional image plane to queue length that actual three dimensions is corresponding by setting up camera imaging model, realize the detection of real-time vehicle queue length, described installation composition structure comprises:
(1) initialization unit, sets up background model by the N two field picture to continuous, obtain stable initialization background image and and initialization reference picture, in initialization reference picture, delimit track, set up camera imaging model;
(2) environment classification unit, by catch a two field picture every time T, calculate this value curve over time in this two field picture mean flow rate Data-Statistics one day, analyze the first order derivative of this curve, carry out environment classification according to analysis result, and start the detection system of respective environment;
(3) vehicle identifying unit, based on daytime, night two kinds of environment, according to the type of environment, extracts respectively under current environment clarification of objective and state in area-of-interest, judges whether target is slow running vehicle;
(4) vehicle queue's detecting unit, according to the existence of vehicle and motion state, judges whether current area-of-interest to move to next area-of-interest by predefined rule;
(5) output unit, circulation (3) and (4), until find the tail of the queue of vehicle queue, arrives three-dimensional transformational relation according to two dimensional image, thus the actual queue length of calculating and exporting vehicle.
2. method according to claim 1, it is characterized in that, in initialization reference picture, utilize Harris Corner Detection Algorithm to find out angle point in image, revised by manual, demarcation has four points of rectangle geometrical property, demarcate track to be detected simultaneously, then can obtain the following parameter of video camera by camera calibration model: flat-moving angle is that p, pitch angle are that t, rotation angle are that s, focal length are that f and video camera distance are l, thereby, can obtain two-dimensional image plane to three-dimensional world coordinate system mapping relations , that is:
Figure FDA0000494798120000011
Wherein, (m, n) is the point on image, and (x, y, 0) is the point of real world coordinate system.
3. method according to claim 2, it is characterized in that, the demarcation in described detection track, specifically, starting point (the start_x of vehicle queue on lane line to be detected will be chosen in initialization reference picture, start_y) and the terminating point (end_x, end_y) of unlimited distance, according to mapping relations
Figure FDA0000494798120000015
be mapped to the three-dimensional curve that fits to a z=f (x, y) after three-dimensional world coordinate system, according to following relational expression:
Figure FDA0000494798120000013
The corresponding three-dimensional world coordinate (x of the starting point of wherein queuing up (start_x, start_y) 0, y 0, 0) put knownly, can obtain accordingly point set (x equidistant on z=f (x, y) curve k, y k, 0), (x k-1, y k-1, 0) ... (x 1, y 1, 0), then basis
Figure FDA0000494798120000021
, looked like accordingly plane point set (m k, n k), (m k-1, n k-1) ... (m 0, n 0), according to these point sets, will be k the area-of-interest that physical length is L as the driveway partition to be detected in plane, the average length (comprising the length of vehicle itself and the spacing of its maintenance) of the vehicle that wherein L is actual road surface.
4. method according to claim 1, it is characterized in that, in environment classification unit, catch a two field picture every set time T, the average brightness value of computed image, and draw the average brightness value curve over time of the image that obtains in a day, if curve is in rising trend from plateau, be that slope is greater than zero, be judged as the transition period on night to daytime, switch to detection system on daytime; If curve is on a declining curve from plateau, slope is less than zero, is judged as the transition period at daytime to night, switches to detection system at night.
5. method according to claim 1, is characterized in that, in identifying unit, if testing environment is daytime, can calculate the area of vehicle ' s contour in area-of-interest and the ratio p of area-of-interest area, if p is greater than threshold value T in automobile storage 1, think and have automobile storage to exist; If testing environment is evening, can detect in area-of-interest whether have car light, if there is car light, think and have automobile storage to exist; In vehicle-state identifying unit, utilize three frames poor after in two width images the difference of vehicle movement pixel number and the ratio υ of time judge the motion state of vehicle.
6. system according to claim 1, is characterized in that, in vehicle queue's detecting unit, according to the existence of vehicle in area-of-interest and motion state, controls area-of-interest and moves, and the movement of described control area-of-interest is according to following principle:
1) if detect that l area-of-interest exists the vehicle of low speed driving, moves to l+1 area-of-interest;
2) if detect that l area-of-interest do not exist vehicle, to l-1 mobile area-of-interest;
3) if detect that l area-of-interest exists the vehicle in fast running, moves to l-1 area-of-interest.
7. system according to claim 1, is characterized in that, in output unit, the tail of the queue judgement of described queuing vehicle can be divided into four kinds of situations (supposing that n area-of-interest exists slow moving vehicle):
1) if detect that n+1 area-of-interest exists vehicle and in low vehicle speeds, do not find temporarily tail of the queue, move to n+1 surveyed area, proceed tail of the queue and detect;
2) if detect that n+1 area-of-interest do not exist vehicle, start to detect n+2 area-of-interest, if n+2 area-of-interest do not exist vehicle, find tail of the queue, tail of the queue region i.e. n surveyed area;
3) if detect that n+1 area-of-interest do not exist vehicle, start to detect n+2 area-of-interest, if there is vehicle in n+2 area-of-interest, and in low speed driving state, tail of the queue is not found in explanation, move to n+2 surveyed area, proceed tail of the queue and detect, this situation is the room phenomenon causing not in time due to vehicle reaction;
4) if detect that n+1 area-of-interest do not exist vehicle, start to detect n+2 area-of-interest, if n+2 area-of-interest exists vehicle, and in high-speed travel state, tail of the queue is not found in explanation, moves to n surveyed area, proceeds tail of the queue and detects.
8. system according to claim 1, is characterized in that, takes two kinds of modes to calculate vehicle queue length, Fuzzy Calculation and accurate Calculation;
Fuzzy Calculation account form: Length=n*L, wherein n is tail of the queue region.
Accurate Calculation mode: obtain the coordinate (x, y) of vehicle queue's tail of the queue, utilize computing formula
Figure FDA0000494798120000031
Figure FDA0000494798120000032
obtain queue length.
CN201410162991.3A 2014-04-22 2014-04-22 Vehicle queuing length detection method and system based on video Pending CN103903445A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410162991.3A CN103903445A (en) 2014-04-22 2014-04-22 Vehicle queuing length detection method and system based on video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410162991.3A CN103903445A (en) 2014-04-22 2014-04-22 Vehicle queuing length detection method and system based on video

Publications (1)

Publication Number Publication Date
CN103903445A true CN103903445A (en) 2014-07-02

Family

ID=50994746

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410162991.3A Pending CN103903445A (en) 2014-04-22 2014-04-22 Vehicle queuing length detection method and system based on video

Country Status (1)

Country Link
CN (1) CN103903445A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104766058A (en) * 2015-03-31 2015-07-08 百度在线网络技术(北京)有限公司 Method and device for obtaining lane line
CN105513342A (en) * 2015-11-25 2016-04-20 南京莱斯信息技术股份有限公司 Video-tracking-based vehicle queuing length calculating method
CN105809956A (en) * 2014-12-31 2016-07-27 大唐电信科技股份有限公司 Method and device for obtaining queuing length of vehicles
CN107153819A (en) * 2017-05-05 2017-09-12 中国科学院上海高等研究院 A kind of queue length automatic testing method and queue length control method
CN107464427A (en) * 2017-07-17 2017-12-12 东南大学 A kind of queuing vehicle length detecting systems and method
CN106128121B (en) * 2016-07-05 2018-08-17 中国石油大学(华东) Vehicle queue length fast algorithm of detecting based on Local Features Analysis
WO2018161889A1 (en) * 2017-03-07 2018-09-13 杭州海康威视数字技术股份有限公司 Queue information acquisition method, device and computer readable storage medium
CN111781600A (en) * 2020-06-18 2020-10-16 重庆工程职业技术学院 Vehicle queuing length detection method suitable for signalized intersection scene
CN112201056A (en) * 2019-07-08 2021-01-08 中国石油大学(华东) Vehicle queuing length detection method based on angular point characteristic analysis
CN113129595A (en) * 2021-04-23 2021-07-16 济南金宇公路产业发展有限公司 Traffic signal control method, equipment and medium for road intersection
CN113435370A (en) * 2021-06-30 2021-09-24 北京英泰智科技股份有限公司 Method and device for obtaining vehicle queuing length based on image feature fusion

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002183880A (en) * 2000-12-15 2002-06-28 Toyo Commun Equip Co Ltd Traffic situation providing method and device thereof
CN101469985A (en) * 2007-12-26 2009-07-01 河海大学常州校区 Single-frame image detection apparatus for vehicle queue length at road junction and its working method
CN102044151A (en) * 2010-10-14 2011-05-04 吉林大学 Night vehicle video detection method based on illumination visibility identification
CN102467821A (en) * 2010-11-04 2012-05-23 北京汉王智通科技有限公司 Road distance detection method based on video image and apparatus thereof
CN202841328U (en) * 2012-08-02 2013-03-27 东莞市南星电子有限公司 Monitoring camera with day-and-night dual apertures
CN103258425A (en) * 2013-01-29 2013-08-21 中山大学 Method for detecting vehicle queuing length at road crossing
CN103325246A (en) * 2013-07-11 2013-09-25 河北工业大学 Dynamic detection method for wagons of multiple vehicle types

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002183880A (en) * 2000-12-15 2002-06-28 Toyo Commun Equip Co Ltd Traffic situation providing method and device thereof
CN101469985A (en) * 2007-12-26 2009-07-01 河海大学常州校区 Single-frame image detection apparatus for vehicle queue length at road junction and its working method
CN102044151A (en) * 2010-10-14 2011-05-04 吉林大学 Night vehicle video detection method based on illumination visibility identification
CN102467821A (en) * 2010-11-04 2012-05-23 北京汉王智通科技有限公司 Road distance detection method based on video image and apparatus thereof
CN202841328U (en) * 2012-08-02 2013-03-27 东莞市南星电子有限公司 Monitoring camera with day-and-night dual apertures
CN103258425A (en) * 2013-01-29 2013-08-21 中山大学 Method for detecting vehicle queuing length at road crossing
CN103325246A (en) * 2013-07-11 2013-09-25 河北工业大学 Dynamic detection method for wagons of multiple vehicle types

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杨永辉等: "基于视频分析的车辆排队长度检测", 《计算机应用研究》, vol. 28, no. 03, 31 March 2011 (2011-03-31) *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105809956A (en) * 2014-12-31 2016-07-27 大唐电信科技股份有限公司 Method and device for obtaining queuing length of vehicles
CN105809956B (en) * 2014-12-31 2019-07-12 大唐电信科技股份有限公司 The method and apparatus for obtaining vehicle queue length
CN104766058A (en) * 2015-03-31 2015-07-08 百度在线网络技术(北京)有限公司 Method and device for obtaining lane line
CN104766058B (en) * 2015-03-31 2018-04-27 百度在线网络技术(北京)有限公司 A kind of method and apparatus for obtaining lane line
CN105513342A (en) * 2015-11-25 2016-04-20 南京莱斯信息技术股份有限公司 Video-tracking-based vehicle queuing length calculating method
CN106128121B (en) * 2016-07-05 2018-08-17 中国石油大学(华东) Vehicle queue length fast algorithm of detecting based on Local Features Analysis
US11158035B2 (en) * 2017-03-07 2021-10-26 Hangzhou Hikvision Digital Technology Co., Ltd. Method and apparatus for acquiring queuing information, and computer-readable storage medium thereof
WO2018161889A1 (en) * 2017-03-07 2018-09-13 杭州海康威视数字技术股份有限公司 Queue information acquisition method, device and computer readable storage medium
CN107153819A (en) * 2017-05-05 2017-09-12 中国科学院上海高等研究院 A kind of queue length automatic testing method and queue length control method
CN107464427A (en) * 2017-07-17 2017-12-12 东南大学 A kind of queuing vehicle length detecting systems and method
CN107464427B (en) * 2017-07-17 2019-09-10 东南大学 A kind of queuing vehicle length detecting systems and method
CN112201056A (en) * 2019-07-08 2021-01-08 中国石油大学(华东) Vehicle queuing length detection method based on angular point characteristic analysis
CN111781600A (en) * 2020-06-18 2020-10-16 重庆工程职业技术学院 Vehicle queuing length detection method suitable for signalized intersection scene
CN113129595A (en) * 2021-04-23 2021-07-16 济南金宇公路产业发展有限公司 Traffic signal control method, equipment and medium for road intersection
CN113129595B (en) * 2021-04-23 2022-06-10 山东金宇信息科技集团有限公司 Traffic signal control method, equipment and medium for road intersection
CN113435370A (en) * 2021-06-30 2021-09-24 北京英泰智科技股份有限公司 Method and device for obtaining vehicle queuing length based on image feature fusion
CN113435370B (en) * 2021-06-30 2024-02-23 北京英泰智科技股份有限公司 Method and device for acquiring vehicle queuing length based on image feature fusion

Similar Documents

Publication Publication Date Title
CN103903445A (en) Vehicle queuing length detection method and system based on video
Casas et al. Intentnet: Learning to predict intention from raw sensor data
JP7106664B2 (en) Intelligent driving control method and device, electronic device, program and medium
EP2549457B1 (en) Vehicle-mounting vehicle-surroundings recognition apparatus and vehicle-mounting vehicle-surroundings recognition system
CN104246821A (en) Device for detecting three-dimensional object and method for detecting three-dimensional object
CN102867414A (en) Vehicle queue length measurement method based on PTZ (Pan/Tilt/Zoom) camera fast calibration
CN103150908B (en) Average vehicle speed detecting method based on video
LU504084B1 (en) A non-rigid registration method of vehicle-borne LiDAR point clouds by fusing multiple road features
CN111259796A (en) Lane line detection method based on image geometric features
Zhang et al. A graded offline evaluation framework for intelligent vehicle’s cognitive ability
CN105426868A (en) Lane detection method based on adaptive region of interest
CN113807270A (en) Road congestion detection method and device and electronic equipment
Li et al. Adaptive road detection method combining lane line and obstacle boundary
CN106327880A (en) Vehicle speed identification method and system based on monitored video
Odeh Management of an intelligent traffic light system by using genetic algorithm
Behrendt et al. Deep learning lane marker segmentation from automatically generated labels
Cai et al. Measurement of vehicle queue length based on video processing in intelligent traffic signal control system
CN104504363A (en) Real-time identification method of sidewalk on the basis of time-space correlation
CN111160132B (en) Method and device for determining lane where obstacle is located, electronic equipment and storage medium
WO2020139456A1 (en) A method and apparatus to determine a trajectory of motion in a predetermined region
CN111477030A (en) Vehicle collaborative risk avoiding method, vehicle end platform, cloud end platform and storage medium
Zhu et al. A path planning algorithm based on fusing lane and obstacle map
Wei et al. Street object detection/tracking for AI city traffic analysis
Gupta et al. Concurrent visual multiple lane detection for autonomous vehicles
Cheng et al. Semantic segmentation of road profiles for efficient sensing in autonomous driving

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140702