CN103345618A - Traffic violation detection method based on video technology - Google Patents

Abstract

Disclosed is a traffic violation detection method based on a video technology. The traffic violation detection method includes the steps of 1) loading a video image of a current frame and conducting dynamic update on the background, 2) conducting filtering processing on a target image and further conducting background difference to obtain a foreground image, 3) carrying out binaryzation on the foreground image, 4) judging the binaryzation image and whether a vehicle exists or not in a set detection area, if no, finishing processing of the frame and transferring to the next frame, and if yes, calculating the mass center position M of the vehicle, and 5) judging whether the vehicle violates regulations or not according to the mass center position. The traffic violation detection method based on the video technology is excellent in real-time performance and good in accuracy.

Description

A kind of break in traffic rules and regulations detection method based on video technique

Technical field

The present invention relates to a kind of break in traffic rules and regulations detection technique, especially a kind of break in traffic rules and regulations detection method based on video technique.

Background technology

Along with vehicle possess amount increases rapidly, the incidence of traffic hazard is also improving constantly.Therefore, safeguard that road traffic order, the act of violating regulations of correcting vehicle, assurance traffic safety, minimizing traffic hazard are our vital tasks always.The break in traffic rules and regulations behavior is the main factor that traffic hazard takes place.Therefore, the incidence of the reduction traffic hazard that the behavior of minimizing break in traffic rules and regulations can be effective.The break in traffic rules and regulations detection system order that can regulate the traffic effectively provides objective and accurate foundation for traffic department handles act of violating regulations.The violator is punished and educates, improve the consciousness of automobile driver greatly, strengthen traffic safety consciousness, reduce the accident and the traffic disturbance that cause because of the vehicle peccancy behavior, guarantee The coast is clear, save police strength.

The defective that existing break in traffic rules and regulations detection method exists is: real-time is relatively poor, accuracy is relatively poor.

Summary of the invention

The deficiency relatively poor for the real-time that overcomes existing break in traffic rules and regulations detection method, that accuracy is relatively poor the invention provides that a kind of real-time is good, accuracy is preferably based on the break in traffic rules and regulations detection method of video technique.

The technical solution adopted for the present invention to solve the technical problems is:

A kind of break in traffic rules and regulations detection method based on video technique, described detection method may further comprise the steps:

1) is written into the video image of present frame, background is dynamically updated;

2) target image is carried out filtering and handle, and carry out the background subtraction branch, obtain foreground image;

3) binaryzation foreground image;

4) binary image is judged in the detection zone of setting, whether vehicle is arranged; If do not have, then finish the processing to this frame, be transferred to next frame; If vehicle is arranged, then calculate the centroid position M of vehicle;

5) judge the act of violating regulations of vehicle according to centroid position:

(5.1) if the speed of a motor vehicle is greater than preset threshold in the fixed range, overspeed of vehicle then;

(5.2) if barycenter M and 'STOP' line ahead less than setting threshold, and signal lamp is in red light phase, then vehicle makes a dash across the red light;

(5.3) if M and lane line coordinate difference less than threshold value, then vehicle is got over line;

(5.4) if the difference of the ordinate of M less than threshold value, then vehicle drives in the wrong direction;

(5.5) if M in the setting threshold scope, then vehicle peccancy stops;

(5.6) if vehicle is difficult behavior, then finish the processing to this frame.

Further, described detection method is further comprising the steps of: store car picture violating the regulations when 6) judging vehicle peccancy, and this violation information is presented at system interface.

Further, in the described step 1), it is as follows that background is carried out dynamic updating process: utilize weight coefficient, regulate the speed of context update

dst(x,y)=α·src(x,y)+(1-α)·dst(x,y)ifmask(x,y)≠0, (1)

Wherein, src (x, y) expression source image pixels, dst (x, the background image pixel after y) expression is upgraded; α is weight parameter, is used for adjusting the speed of context update, and photo current is updated in the background; (x y) is mask plate in the renewal process to mask, directly the prospect result who extracts is calculated as mask plate at this place;

Utilize wavelet transformation that background image is further handled.Two-dimensional discrete wavelet conversion can resolve into source images 1 ll channel, with level, vertical 3 the details subgraphs in diagonal angle that reach, carry out after the one-level wavelet transformation again, to level, vertical, diagonal angle 3 details subgraphs mean filter, carry out wavelet reconstruction with low frequency part again, obtain new background image.

Further again, in the described step 4), the process of the centroid position M of calculating vehicle is as follows:

4.1) in foreground image, set surveyed area, adopt edge detection method to detect the rectangular profile of moving vehicle, the definition area compares:

r=A _rect/A _roi, (2)

Wherein, A _RectAnd A _RoiThe area of representing the surveyed area of the area of detected rectangular profile and setting respectively is as r〉during predetermined threshold value, this rectangular profile is exactly the initial detecting frame;

4.2) calculate the color histogram of tracking target, namely calculate this image at the histogram of the H in HSV space component, with the every bit that obtains (x, the probability distribution I of color y) in object module (x, y);

4.3) calculate moving target barycenter M (X, Y)

$M_{00}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}I(x,y),$ $M_{10}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}\mathrm{xI}(x,y),$ $M_{01}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}\mathrm{yI}(x,y),---\left(3\right)$

$M(X,Y)=(\frac{M_{10}}{M_{00}},\frac{M_{01}}{M_{00}}),---\left(4\right)$

Wherein, M ₀₀, M ₁₀, M ₀₁Be respectively 0 rank distance and the 1 rank distance of search box, (X is Y) for calculating the target barycenter that obtains for M, repeat transfer to follow the tracks of whole window center to M (X, Y), up to window displacement less than threshold value T, obtain size and the position of new rectangle frame, as the initial detecting frame of next frame.

Beneficial effect of the present invention mainly shows: real-time is good, accuracy is better.

Description of drawings

Fig. 1 is dynamic trace flow figure.

Fig. 2 is the measuring ability frame diagram.

Fig. 3 is that function realizes simple and easy process flow diagram.

Fig. 4 is testing process figure violating the regulations.

Fig. 5 is different update speed design sketch.

Fig. 6 is the vehicle tracking design sketch.

Fig. 7 is the vehicle design sketch that makes a dash across the red light.

Embodiment

Below in conjunction with accompanying drawing the present invention is further described.

With reference to Fig. 1～Fig. 7, a kind of break in traffic rules and regulations detection method based on video technique, described detection method may further comprise the steps:

1) is written into the video image of present frame, background is dynamically updated;

2) target image is carried out filtering and handle, and carry out the background subtraction branch, obtain foreground image;

3) binaryzation foreground image;

4) binary image is judged in the detection zone of setting, whether vehicle is arranged; If do not have, then finish the processing to this frame, be transferred to next frame; If vehicle is arranged, then calculate the centroid position M of vehicle;

5) judge the act of violating regulations of vehicle according to centroid position:

(5.1) if the speed of a motor vehicle is greater than preset threshold in the fixed range, overspeed of vehicle then;

(5.2) if barycenter M and 'STOP' line ahead less than setting threshold, and signal lamp is in red light phase, then vehicle makes a dash across the red light;

(5.3) if M and lane line coordinate difference less than threshold value, then vehicle is got over line;

(5.4) if the difference of the ordinate of M less than threshold value, then vehicle drives in the wrong direction;

(5.5) if M in the setting threshold scope, then vehicle peccancy stops;

(5.6) if vehicle is difficult behavior, then finish the processing to this frame.

Further, described detection method is further comprising the steps of: store car picture violating the regulations when 6) judging vehicle peccancy, and this violation information is presented at system interface.

In the present embodiment, adopt the background subtraction point-score based on wavelet transformation, in conjunction with the tracing based on feature, realize the detection of moving vehicle.Mainly be divided into following four steps:

1) at first filtered video image is carried out the background subtraction point-score, can in time detect moving target efficiently.Because the background subtraction point-score is subjected to the influence of change of background easily, so the background that need upgrade in time.This paper has adopted a kind of dynamic background update algorithm, can be in real time background image updating effectively.This algorithm utilizes weight coefficient, regulates the speed of context update

dst(x,y)=α·src(x,y)+(1-α)·dst(x,y)ifmask(x,y)≠0, (1)

Wherein, src (x, y) expression source image pixels, dst (x, the background image pixel after y) expression is upgraded; α is weight parameter, is used for adjusting the speed of context update, and photo current is updated in the background; (x y) is mask plate in the renewal process to mask, directly the prospect result who extracts is calculated as mask plate at this place, has avoided the interference of the prospect in the context process of upgrading.

α chooses the direct accuracy that influences vehicle detection.Renewal speed is big, and serious cavity appears in vehicle; Renewal speed is slow, and the movement locus of vehicle has a strong impact on the detection effect.Therefore, utilize wavelet transformation that background image is further handled.Two-dimensional discrete wavelet conversion can resolve into source images 1 ll channel, level, vertically reach 3 the details subgraphs in diagonal angle, after carrying out the one-level wavelet transformation, to level, vertical, diagonal angle 3 details subgraphs mean filter, carry out wavelet reconstruction with low frequency part again, obtain new background image, efficiently solve the retention problems of track of vehicle in the background.

2) set surveyed area in foreground image, adopt edge detection method to detect the rectangular profile of moving vehicle, when the area of this profile reached a certain threshold value, the vehicle ' s contour in just should the zone was as the initial rectangular frame of vehicle tracking.Definition area ratio

r=A _rect/A _roi, (2)

Wherein, A _RectAnd A _RoiThe area of representing the surveyed area of the area of detected rectangular profile and setting respectively.As r〉1/2 the time, this rectangular profile is exactly the initial detecting frame.

3) calculate the color histogram of tracking target, namely calculate this image at the histogram of the H in HSV space component, with the every bit that obtains (x, the probability distribution I of color y) in object module (x, y).

4) calculate moving target barycenter M (X, Y)

$M_{00}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}I(x,y),$ $M_{10}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}\mathrm{xI}(x,y),$ $M_{01}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}\mathrm{yI}(x,y),---\left(3\right)$

$M(X,Y)=(\frac{M_{10}}{M_{00}},\frac{M_{01}}{M_{00}}),---\left(4\right)$

Wherein, M ₀₀, M ₁₀, M ₀₁Be respectively 0 rank distance and the 1 rank distance of search box, (X is Y) for calculating the target barycenter that obtains for M, repeat adjust to follow the tracks of window center to M (X, Y), up to window displacement less than threshold value T, obtain size and the position of new rectangle frame, as the initial ranging frame of next frame.So circulation has just reached the effect of following the tracks of.This process as shown in Figure 1.

The function of the detection system of present embodiment mainly comprises three modules: video image load-on module, vehicles peccancy detection module, violation information memory module.The vehicles peccancy detection module mainly is divided into: image pre-service, vehicles peccancy detect, context update, as shown in Figure 2.

The used software of system development has Visual Studio2010, OpenCV2.3.1, and successfully disposes according to the development environment configuration file.

The video load-on module is realized by the function of the DrawToHDC () among the MFC among the OpenCV.Because this function in the CvvImage class, needs manually to add such header file and code file.

Comprised the function that various images are handled in the OpenCV storehouse, as gaussian filtering function G aussianBlur (), image space mapping function cvtColor (), background difference function absdiff (), threshold function table threshold (), rim detection Canny operator function canny (), histogram calculation function calcHist common mathematical functions such as ().Fig. 3 is the simple and easy process flow diagram of system.

Wherein,

OnTimer (): be mainly used in loading video;

Processing (): be used for the image pre-service, do work such as filtering, background difference, extraction prospect;

LineDetect (): detect stop line and lane line;

LightDetect (): detect lights state;

Tracking (): do Image Edge-Detection, set the effective coverage, and in this zone, detect moving vehicle, return initial block information;

VehicleInfo (): show vehicle peccancy information;

TrackDetect (): pursuit movement vehicle, the motion barycenter of return movement vehicle;

DrawTrack (): draw pursuit path;

ShowDetectImg (): storage also shows the vehicles peccancy picture;

PlayVideo (): display video.

Testing process figure violating the regulations as shown in Figure 4.As seen from Figure 4, the function of this system comprises image processing, vehicle tracking, identification violating the regulations and information preservation.Wherein the gordian technique in the image processing process is exactly the context update problem.This paper adopts adaptive algorithm to realize the real-time update of background, improves the vehicle detection effect.The gordian technique of this system is exactly vehicle tracking, namely according to the vehicle centroid position that obtains, and movement locus, set corresponding threshold value, judge which kind of act of violating regulations vehicle belongs to.As gained vehicle center-of-mass coordinate (x _M, y _M) ordinate not at preset threshold y _TIn the scope, namely work as y _MY _TThe time, and when detecting the signal lamp state and being red light phase, the expression vehicle makes a dash across the red light.After detecting vehicle peccancy, system will preserve picture violating the regulations automatically, and is presented on system's panel, provides the user to consult real-time violation information.

Context update speed directly influences the motion target detection accuracy, and testing used video frame rate was 25 frame/seconds, and this paper compares at different context update speed, effect as shown in Figure 5, renewal rate is respectively α=0.01,0.03,0.05,0.1.As seen from Figure 5, effect is carried out when renewal rate reaches α=0.03.

Realize behind the vehicle tracking effect as shown in Figure 6, Fig. 7 has shown vehicle peccancy information (because video resource is limited, this situation is to serve as to detect foundation with the left-side signal lamp, judges whether vehicle makes a dash across the red light).

Claims (4)

1. break in traffic rules and regulations detection method based on video technique, it is characterized in that: described detection method may further comprise the steps:

1) is written into the video image of present frame, background is dynamically updated;

2) target image is carried out filtering and handle, and carry out the background subtraction branch, obtain foreground image;

3) binaryzation foreground image;

4) binary image is judged in the detection zone of setting, whether vehicle is arranged; If do not have, then finish the processing to this frame, be transferred to next frame; If vehicle is arranged, then calculate the centroid position M of vehicle;

5) judge the act of violating regulations of vehicle according to centroid position:

(5.1) if the speed of a motor vehicle is greater than preset threshold in the fixed range, overspeed of vehicle then;

(5.2) if barycenter M and 'STOP' line ahead less than setting threshold, and signal lamp is in red light phase, then vehicle makes a dash across the red light;

(5.3) if M and lane line coordinate difference less than threshold value, then vehicle is got over line;

(5.4) if the difference of the ordinate of M less than threshold value, then vehicle drives in the wrong direction;

(5.5) if M in the setting threshold scope, then vehicle peccancy stops;

(5.6) if vehicle is difficult behavior, then finish the processing to this frame.

2. a kind of break in traffic rules and regulations detection method based on video technique as claimed in claim 1, it is characterized in that: described detection method is further comprising the steps of:

Store car picture violating the regulations when 6) judging vehicle peccancy, and this violation information is presented at system interface.

3. a kind of break in traffic rules and regulations detection method based on video technique as claimed in claim 1 or 2 is characterized in that: in the described step 1), it is as follows that background is carried out dynamic updating process: utilize weight coefficient, regulate the speed of context update

dst(x,y)=α·src(x,y)+(1-α)·dst(x,y)ifmask(x,y)≠0, (1)

Wherein, src (x, y) expression source image pixels, dst (x, the background image pixel after y) expression is upgraded; α is weight parameter, is used for adjusting the speed of context update, and photo current is updated in the background; (x y) is mask plate in the renewal process to mask, directly the prospect result who extracts is calculated as mask plate at this place;

Utilize wavelet transformation that background image is further handled.Two-dimensional discrete wavelet conversion can resolve into source images 1 ll channel, with level, vertical 3 the details subgraphs in diagonal angle that reach, carry out after the one-level wavelet transformation again, to level, vertical, diagonal angle 3 details subgraphs mean filter, carry out wavelet reconstruction with low frequency part again, obtain new background image.

4. a kind of break in traffic rules and regulations detection method based on video technique as claimed in claim 1 or 2 is characterized in that: in the described step 4), the process of centroid position M of calculating vehicle is as follows:

4.1) in foreground image, set surveyed area, adopt edge detection method to detect the rectangular profile of moving vehicle, the definition area compares:

r=A _rect/A _roi, (2)

Wherein, A _RectAnd A _RoiThe area of representing the surveyed area of the area of detected rectangular profile and setting respectively is as r〉during predetermined threshold value, this rectangular profile is exactly the initial detecting frame;

4.2) calculate the color histogram of tracking target, namely calculate this image at the histogram of the H in HSV space component, with the every bit that obtains (x, the probability distribution I of color y) in object module (x, y);

4.3) calculate moving target barycenter M (X, Y)

$M_{00}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}I(x,y),$ $M_{10}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}\mathrm{xI}(x,y),$ $M_{01}=\underset{x}{\mathrm{\Σ}}\underset{y}{\mathrm{\Σ}}\mathrm{yI}(x,y),---\left(3\right)$

$M(X,Y)=(\frac{M_{10}}{M_{00}},\frac{M_{01}}{M_{00}}),---\left(4\right)$

Wherein, M ₀₀, M ₁₀, M ₀₁Be respectively 0 rank distance and the 1 rank distance of search box, (X is Y) for calculating the target barycenter that obtains for M, repeat transfer to follow the tracks of whole window center to M (X, Y), up to window displacement less than threshold value T, obtain size and the position of new rectangle frame, as the initial detecting frame of next frame.

Images