WO2016052837A1

WO2016052837A1 - Traffic monitoring system

Info

Publication number: WO2016052837A1
Application number: PCT/KR2015/006547
Authority: WO
Inventors: 김영모; 류지형; 이인원; 고기훈; 안종필
Original assignee: 주식회사 디아이랩
Priority date: 2014-09-30
Filing date: 2015-06-26
Publication date: 2016-04-07
Also published as: KR20160038944A

Abstract

A traffic monitoring system according to the present invention comprises: a first imaging device configured by multiple imaging units for imaging partitioned areas formed by dividing a predetermined area of interest on the road, respectively; a second imaging device configured by an imaging unit for imaging a front side of a vehicle entering a central part of the predetermined area of interest and a rear side of a vehicle escaping from the central part; and a control unit for generating and storing imaging information for tracking with respect to the predetermined area of interest on the road by merging imaging information from the first imaging device, sensing a vehicle by detecting a license plate of the vehicle from imaging information imaged by the second imaging device, tracking a movement of the sensed vehicle on the basis of the imaging information for tracking when the vehicle is sensed, and determining whether the vehicle has violated a traffic regulation on the basis of the movement of the vehicle, wherein the imaging units of the first imaging device and second imaging device are synchronized for operating, and the partitioned areas have an area in which the partitioned areas overlap on each other.

Description

Traffic monitoring system

The present invention relates to a traffic monitoring system, and more particularly, to detect a vehicle in violation of traffic laws by performing imaging for movement and number recognition of a vehicle, and to increase the success rate of the number recognition of the vehicle as well as in a wide range of areas. The present invention relates to a traffic monitoring system capable of minimizing an area where traffic law violations cannot be detected by blind spots by tracking vehicle movements.

As the industry develops, traffic volume on the road is increasing, and various traffic laws are in place to prevent traffic accidents and congestion on the road in this situation. These traffic laws include speed limits, stop line violations, signal violations, no parking stops, no interruptions, and no bites.

Conventionally, the vehicle is photographed on a road or traveling, and the motion of the vehicle is detected by using the imaging information, and whether the traffic laws are violated is determined based on the detected motion of the vehicle.

Such a conventional technology is disclosed in the Republic of Korea Patent Office Patent No. 1020120090471, the name of the interruption control system based on the image processing, which is installed at the start of the interruption interruption section, the first imaging information for passing vehicles First detection camera unit for providing a; A second detection camera unit installed at an end point of the interruption prohibiting section and providing second image information about passing vehicles; A vehicle tracking camera unit configured to provide a tracking image by photographing vehicles driving in the prohibition period; And a storage module, wherein the first imaging information provided from the first detection camera unit, the second imaging information provided from the second detection camera unit, and the tracking image provided from the vehicle tracking camera unit are stored in the storage module. A data storage unit for storing; An interlocking vehicle detection module for detecting an interrupting vehicle using the first imaging information and the second imaging information of the storage module, and a trace of the interrupting vehicle detected by the interrupting vehicle detection module in a backward direction in the tracking image And a control unit including an evidence image detection module for extracting and providing an evidence image of a moment at which the interrupting vehicle cuts in from the tracking image. The interruption control system is disclosed.

Patent No. 1010414960000, which is registered with the Korean Patent Office on the basis of image processing and its method, is registered in each lane and photographs vehicles passing through the stop line or intersection of each lane to pass through the vehicles. A vehicle detection camera unit providing vehicle detection images capable of detecting a vehicle number for the vehicle; A vehicle tracking camera unit for photographing vehicles traveling in an intersection and providing a tracking image; Intersection provided with a storage module, the traffic signal appearance information for each time provided from the traffic signal control panel, vehicle detection images for vehicles passing through the intersection provided from the vehicle detection camera unit, the intersection provided from the vehicle tracking camera unit A data storage unit which stores a tracking image of the vehicles driving in the storage module; A tail-vehicle detection module for detecting a tail-vehicle vehicle by using the time-sensitive traffic signal appearance information and vehicle detection images of the storage module, and an evidence image detection module for acquiring and providing a tail-vehicle evidence image for the tail-vehicle vehicle; And a control unit including a control unit, wherein the proof image detection module of the control unit receives an image capturing time for the vehicle detection image from which the tail car is detected, and corresponds to the image capturing time in the tracking image. Set the frame to be the start frame, detect the tail car at the start frame of the tracking image, and trace the movement trajectory of the detected tail car vehicle backward from the start frame of the tracking image. To start and provide a tailgate control system have.

As described above, although the vehicle movement is detected and interrupted by detecting the interruption or the tail bite, there is a problem that the imaging for tracking and number recognition of the vehicle movement is not performed efficiently.

That is, when the vehicle moves or parks close to each other, or fails to recognize the number from the imaging information captured by the imaging device for number recognition due to reflection or shadow by direct sunlight, traffic violation is detected by tracking the movement of the vehicle. Even if there was a problem that can not control the vehicle.

In addition, the tracking of the vehicle movement was made only in one direction, so that it was not possible to detect a wide range of traffic violations.

The present invention detects a vehicle that violates traffic laws by performing imaging for movement and number recognition of the vehicle, improves the success rate of the number recognition of the vehicle, and also tracks the movement of the vehicle in a wide area to provide traffic by blind spots. Its purpose is to provide a traffic monitoring system by forward and backward tracking that can minimize the areas where legal violations cannot be detected.

According to an aspect of the present invention, there is provided a traffic monitoring system comprising: a first imaging device comprising a plurality of imaging units each configured to segment divided regions of a predetermined region of interest on a road; A second imaging device comprising an image pickup unit for capturing a front surface of a vehicle entering a center portion of the predetermined region of interest and a rear surface of the vehicle leaving the center portion; And merging the imaging information from the first imaging device to generate and store tracking imaging information for a predetermined ROI on the road, and detect the license plate of the vehicle from the imaging information captured by the second imaging device. And a controller configured to track a movement of the detected vehicle based on the tracking image pickup information, and determine whether a traffic law is violated based on the movement of the vehicle, when the vehicle is detected. The apparatus and the image capturing unit of the second imaging apparatus are driven in synchronization with each other, and the divided regions have regions overlapping each other.

The present invention detects a vehicle that violates traffic laws by performing imaging for movement and number recognition of the vehicle, improves the success rate of the number recognition of the vehicle, and also tracks the movement of the vehicle in a wide area to provide traffic by blind spots. It has the effect of minimizing the area where the violation of the law can not be detected.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram showing an installation example of imaging devices of a traffic monitoring system by forward and backward tracking according to a first preferred embodiment of the present invention.

2 is a block diagram of a traffic monitoring system by forward and backward tracking according to a first embodiment of the present invention.

3 is a flowchart of a traffic monitoring method by forward and backward tracking according to a first preferred embodiment of the present invention.

4 to 6 show examples of image pickup information processing according to the first preferred embodiment of the present invention.

Fig. 7 is a diagram showing an example of installation of imaging devices according to the second and third embodiments of the present invention.

The present invention detects a vehicle that violates traffic laws by performing imaging for movement and number recognition of the vehicle, improves the success rate of the number recognition of the vehicle, and also tracks the movement of the vehicle in a wide area to provide traffic by blind spots. Minimize areas where legal violations cannot be detected.

The traffic monitoring system and the traffic monitoring method by forward and backward tracking according to the first preferred embodiment of the present invention will be described in detail.

A configuration of a traffic monitoring system by forward and backward tracking according to a first preferred embodiment of the present invention will be described with reference to FIGS. 1 and 2.

1 is a view showing an example of the installation of the image pickup apparatus of the traffic monitoring system by forward and backward tracking according to a first embodiment of the present invention, Figure 2 is a forward and backward tracking according to a first preferred embodiment of the present invention It is a block diagram of the traffic monitoring system.

The traffic monitoring system by forward and backward tracking includes a first imaging device 100, a second imaging device 200, and a control device 300.

The first image pickup device 100 includes first to third image pickup portions 310 to 314 installed on a support of a road, and each of the first to third image pickup portions 310 to 314 includes a wide-angle lens. The wide-angle imaging device is provided to capture the first to third imaging areas obtained by dividing a predetermined ROI on a road, and the first to third imaging areas are set so that a part of them overlaps. Imaging information obtained by capturing the first to third imaging areas is provided to the control device 300. Imaging information from the first imaging apparatus 100 is employed as a material for reverse tracking and forward tracking of movements of vehicles traveling on a road.

The second imaging device 200 includes a fourth imaging unit 316 installed at the center of the ROI near the installation position of the first imaging apparatus 100, and the fourth imaging unit 316. ) Photographs the front surface of the vehicles entering the installation position of the second imaging apparatus 200 and provides the imaging information accordingly to the control apparatus 300 and departs from the installation position of the second imaging apparatus 200. The back side of the image is captured and the resulting image information is provided to the control device (300). The imaging information from the second imaging apparatus 200 is used as a material for recognizing the front license plate or the rear license plate of the vehicle entering the installation position of the second imaging apparatus 200.

The control device 300 includes a control unit 302, a memory unit 304, a communication module 306, and a user interface 308. The control unit 302 not only controls each part of the traffic monitoring system by the forward and backward tracking, but also combines the sensing information from the first imaging apparatus 100 to generate tracking information for a wide area. In addition, by tracking the movement of the vehicle in the tracking image information in the forward or reverse direction to detect a traffic violation violation, the vehicle number for the vehicle is recognized from the image information of the second imaging device 200. To this end, the controller 302 synchronizes the imaging times of the imaging units of the first imaging apparatus 100 and the second imaging apparatus 200, and the imaging region and the first imaging apparatus 100 that are captured by the first imaging apparatus 100. As the imaging areas picked up by the two imaging devices 200 overlap, the vehicle detected by the second imaging device 100 can be detected in the imaging areas picked up by the first imaging device 200. The memory unit 304 stores various kinds of information including a processing program of the controller 302. The communication module 306 is responsible for communication between the control unit 302 and an external monitoring server. The user interface 308 is responsible for communication between a user and the controller 302.

The procedure of the traffic monitoring method by forward and backward tracking according to the present invention applicable to the above-described traffic monitoring system will now be described in detail with reference to FIG. 3.

The controller 302 of the control device 300 synchronizes and drives the first to fourth imaging units 310 to 316 of the first and

second imaging apparatuses

100 and 200 at predetermined intervals. The imaging information from the second imaging apparatus 100 (200) is received and stored (step 400).

In particular, the imaging information from the first to third imaging units 310 to 314 is merged to generate tracking imaging information for a wide area on the road. FIG. 4A shows the result of merging the imaging information from the first to third imaging units 310 to 314. Referring to FIG. 4A, imaging information of the first imaging region captured by the first imaging unit 310 and the second imaging region captured by the second imaging unit 312 are described. The imaging information and the imaging information for the third imaging area picked up by the third imaging unit 314 are merged to perform imaging for the long area of the road. In this case, the merged reference becomes a first overlapped region between the first and second imaging regions and a second overlapped region between the second and third imaging regions.

The imaging information from the fourth imaging unit 316 is an image of the front side of the vehicle as shown in FIG. 4B, and an image of the rear side of the vehicle as shown in FIG. 4C. .

The controller 302 receives the sensing information from the fourth image capturing unit 316 and detects the vehicle based on whether a license plate exists (step 402). As described above, the present invention detects the vehicle driving on the road by detecting the front license plate and the rear license plate of the vehicle traveling on the road based on the fourth imaging unit 316, which is used even when the vehicle travels adjacently. Not only makes it possible to recognize the license plate of the vehicle, but also to recognize the license plate of the vehicle even under the influence of direct sunlight or shadows. Here, the imaging information captured by the fourth image capturing unit 316 is as illustrated in FIG. 5C in the case of the front side of the vehicle, and as illustrated in FIG. 6C in the case of the rear side of the vehicle. .

As described above, when the vehicle is recognized from the image capturing information from the fourth image capturing unit 316, the control unit 302 merges the image capturing information from the first to third image capturing units 310 to 314. In operation 404, the movement of the vehicle is tracked forward and reverse. Forward and reverse tracking of the movement of the vehicle is as shown in FIGS. 5 and 6 (a) and (b).

More specifically, (a) of FIG. 5 illustrates tracking image pickup information at the time when the vehicle DC is detected, and (b) uses tracking image pickup information at previous times when the vehicle DC is detected. By detecting the position information (DCR1 ~ DCR4) of the detected vehicle (DC) is an example of tracking the movement of the vehicle.

6 (a) shows tracking image pickup information at the time when the vehicle DC is detected, and (b) shows detection information using tracking image pickup information at later points in time when the vehicle is detected. The example illustrates tracking the movement of the vehicle by detecting the location information DCF1 to DCF3 of the vehicle DC.

Based on the result of the forward reverse tracking of the detected movement of the vehicle, the controller 302 checks whether the vehicle violates the traffic law (step 406).

Then, if the detected vehicle violates the traffic laws, the control unit 302 generates control information including license plate information and forward and reverse tracking information of the vehicle and transmits the notification to the remote monitoring server (step 408). ).

Traffic laws that can be detected based on the forward and reverse tracking information as described above, such as stop line violations, signal violations, illegal parking stops, tail bites, insertion violations, and the like.

Second Embodiment

In the first preferred embodiment of the present invention, only three cameras are installed in one support, but the three cameras may be installed in a plurality of spaced installations. FIG. 7A illustrates the installation of three cameras according to the second preferred embodiment of the present invention.

Referring to FIG. 7A, the fifth to seventh cameras 900 to 902 and 906 are installed on three pillars spaced apart from each other, and the sixth camera 902 located in the middle is located in both directions of the road. An eighth camera 904 for performing imaging is located.

Third Embodiment

In the first preferred embodiment of the present invention, only three cameras are installed in one support, but the three cameras may use one ultra wide-angle camera. This is illustrated in FIG. 7B.

Referring to FIG. 7B, the ninth camera 908 photographs the road at an ultra wide angle, and the tenth camera 910 is configured to perform imaging in both directions of the road below the ninth camera 908. Is located.

In the above-described embodiment of the present invention, the vehicle is recognized and only the backward or forward tracking of the movement of the vehicle is illustrated. However, the movement path of the vehicle may be predicted based on the backward or forward tracking information. For example, if it is detected that a vehicle moves to a left turn lane, the vehicle may be predicted to turn left.

The traffic monitoring system according to the present invention can be widely used for road traffic control.

Claims

In the traffic monitoring system,

A first imaging device comprising a plurality of imaging units which respectively image the divided regions of the predetermined region of interest on the road;

A second imaging device comprising an image pickup unit for capturing a front surface of a vehicle entering a center portion of the predetermined region of interest and a rear surface of the vehicle leaving the center portion; And

Merge imaging information from the first imaging device to generate and store tracking imaging information for a predetermined ROI of a road;

Detecting the vehicle by detecting the license plate of the vehicle from the imaging information picked up by the second imaging device;

And a controller configured to track a movement of the detected vehicle based on the tracking image pickup information when the vehicle is detected, and determine whether a traffic law is violated based on the movement of the vehicle.

The imaging unit of the first imaging device and the second imaging device are driven in synchronization,

And the partitions overlap each other.
The method of claim 1, wherein the control unit,

The movement of the vehicle is a traffic monitoring system, characterized in that the vehicle tracking based on the center portion to the reverse tracking, the vehicle leaving the reference relative to the center tracking forward.
The traffic monitoring system according to claim 1, wherein the traffic law is any one or more of illegal parking, signal violation, traffic lane violation, speeding, interruption, and tailing.
According to claim 1, further comprising a communication module for performing communication between the control unit and the outside,

The control unit, if it is determined that the traffic law violations, the traffic monitoring system, characterized in that to generate the enforcement information including the vehicle number and tracking information of the vehicle and transmit it to the outside through the communication module.
The method of claim 1, wherein the control unit,

And a traffic route of the vehicle is predicted based on the vehicle number and tracking information of the vehicle.