KR102437697B1 - System of supervising illegal parking vehicle capable of tracking managing the vehicle - Google Patents

Abstract

An illegal parking enforcement system capable of tracking and managing a vehicle is disclosed, which comprises: a fixed closed circuit television (CCTV) camera generating and transmitting a CCTV image in real time to detect a vehicle entering a parking violation zone; a rotational (pan, tilt, zoom, or PTZ) CCTV camera generating and transmitting a CCTV image in real time for recognizing a license plate number of the vehicle detected through the CCTV image of the fixed CCTV camera; an illegal parking enforcement server individually receiving the CCTV images from the fixed CCTV camera and the rotational (PTZ) CCTV camera, detecting the vehicle entering the parking violation zone using the received CCTV images, tracking the detected vehicle and performing parking enforcement in real time in the parking violation zone; and a light-emitting display (LED) electronic notice board outputting a parking violation notification in real time according to a result of the parking enforcement performed in real time by the illegal parking enforcement server. According to the illegal parking enforcement system capable of tracking and managing a vehicle, when the vehicle enters the parking violation zone where parking is prohibited, the system is configured to recognize the license plate number of the vehicle and put a label on the vehicle to track a movement in the images, accordingly, there is an effect of accurately determining and enforcing illegal parking of the vehicle, even when the license plate number is covered during the illegal parking.

Description

Illegal parking and blocking enforcement system capable of tracking and managing vehicles {SYSTEM OF SUPERVISING ILLEGAL PARKING VEHICLE CAPABLE OF TRACKING MANAGING THE VEHICLE}

The present invention relates to an illegal parking enforcement system, and more particularly, to an illegal parking enforcement system capable of tracking and managing a vehicle.

In the illegal parking area, the enforcement of illegal parking is mainly using CCTV. It has the advantage of being able to crack down at all times and the cost of enforcement is low.

However, there is a disadvantage that it becomes difficult to crack down on illegal parking and parking when a situation in which the license plate cannot be recognized occurs.

1 and 2 are exemplary photos showing a situation in which a license plate cannot be recognized.

Referring to FIG. 1 , the illegally parked and stopped vehicles are parked and stopped in a line, so that the license plate is covered and the license plate number cannot be recognized. And Figure 2 exemplifies a situation in which the license plate is directly covered with a screen to obstruct the recognition of the license plate.

As such, in the case of an illegal parking and stopping system using CCTV, there is a problem in that the license plate is not recognized in a situation where it is useless.

Even when the license plate is intentionally or unintentionally covered, there is a need for a method to accurately determine and crack down on illegal parking.

Laid-Open Patent Publication No. 10-2013-0100615 Registered Patent Publication 10-23196627

It is an object of the present invention to provide an illegal parking enforcement system capable of tracking and managing a vehicle.

An illegal parking enforcement system capable of tracking and managing a vehicle according to the object of the present invention described above includes a fixed CCTV camera that generates and transmits a CCTV image in real time for detecting a vehicle entering a parking and stopping violation zone; a rotating type (PTZ) CCTV camera that generates and transmits a CCTV image for license plate recognition of a vehicle detected through the CCTV image of the fixed CCTV camera in real time; Each of the CCTV images is received from the fixed CCTV camera and the rotating (PTZ) CCTV camera, and a vehicle entering the parking violation zone is detected using the received CCTV image, and the detected vehicle is tracked to track the parking violation zone. Illegal parking and stopping enforcement server that performs real-time enforcement of parking and stopping within; It may be configured to include an LED display that outputs a notification of a parking and stopping violation in real time according to a result of the parking and stopping enforcement performed in real time by the illegal parking and stopping enforcement server.

Here, the illegal parking enforcement server includes: a CCTV image receiving module for receiving CCTV images in real time from the fixed CCTV camera and the rotating (PTZ) CCTV camera; a vehicle detection/tracking module for real-time detection and tracking of illegally parked and stopped vehicles in the parking and stopping violation zone using the CCTV image received in real time from the CCTV image receiving module; a parking violation zone entry determination module that determines whether a vehicle enters the parking violation zone using the real-time detection and tracking results of the vehicle detection/tracking module; a vehicle number recognition module for recognizing the vehicle number of a vehicle entering the parking and stopping violation zone in real time as a result of the determination of the parking violation zone entry determination module; It may be configured to include a vehicle number labeling module for real-time labeling of the vehicle number recognized in the vehicle number recognition module to the corresponding vehicle of the CCTV image in real time.

In addition, the illegal parking enforcement server includes: a parking violation zone parking and stopping determination module configured to determine in real time whether the vehicle labeled in real time in the license plate number labeling module parks or stops within the parking violation zone; a parking violation enforcement vehicle database in which vehicles parked and stopped in the parking violation zone are registered and stored; a parking violation enforcement vehicle registration module for registering a vehicle parked and stopped within the parking and stopping violation zone as a vehicle subject to enforcement in the parking violation zone in the parking violation enforcement vehicle database as a result of the real-time determination of the parking and stopping violation zone parking and stopping determination module; It may be configured to further include a parking violation notification module that transmits a parking and stopping violation notification for a vehicle to be subjected to enforcement of a parking and stopping violation zone registered by the parking violation enforcement vehicle registration module to the LED display board in real time.

And, as a result of the real-time determination of the parking violation zone parking and stopping determination module, it is determined whether the parking and stopping time of the vehicle subject to the enforcement of the parking violation zone has elapsed for a predetermined time. It may be configured to further include an illegally parked vehicle determining module for determining the vehicle.

The illegally parked and stopped enforcement server includes: an illegally parked and stopped image collection module for searching and collecting images of illegally parked and stopped vehicles determined by the illegally parked and stopped vehicle determining module; It may be configured to further include an illegal parking image database in which the parking violation image collected by the illegal parking image collection module is stored.

According to the illegal parking enforcement system capable of tracking and managing the above-described vehicle, when a vehicle enters a parking and stopping violation zone where parking is prohibited, it recognizes the vehicle number of the vehicle and labels the vehicle to track the movement in the image. Even if the license plate number is hidden while illegally parked, it has the effect of accurately determining and cracking down on illegal parking of the vehicle.

1 and 2 are exemplary photos showing a situation in which a license plate cannot be recognized.
3 is a block diagram of an illegal parking enforcement system capable of tracking and managing a vehicle according to an embodiment of the present invention.
4 is a schematic diagram of a vehicle tracking management operation according to an embodiment of the present invention.
5 is a schematic diagram illustrating a convolution operation of a CNN algorithm for vehicle detection according to an embodiment of the present invention.
6 is an exemplary diagram of a vehicle tracking management screen according to an embodiment of the present invention.
7 is a schematic diagram illustrating a vehicle license plate recognition and warning plate according to an embodiment of the present invention. As shown in the figure, the rotating camera can be composed of a speed dome type and a pan tilt type camera.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and will be described in detail in the detailed content for carrying out the invention. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It is to be understood that this does not preclude the possibility of the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

3 is a block diagram of an illegal parking enforcement system capable of tracking and managing a vehicle according to an embodiment of the present invention. And Figure 4 is a schematic diagram of a vehicle tracking management operation according to an embodiment of the present invention, Figure 5 is a schematic diagram showing a convolution operation of a CNN algorithm for vehicle detection according to an embodiment of the present invention, Figure 6 is It is an exemplary view of a vehicle tracking management screen according to an embodiment of the present invention, and Figure 7 is a schematic diagram showing a vehicle license plate recognition and warning plate according to an embodiment of the present invention.

3, the illegal parking enforcement system capable of tracking and managing a vehicle according to an embodiment of the present invention includes a fixed CCTV camera 100, a rotating (PTZ) CCTV camera 101, an illegal parking and parking enforcement server 200, It may be configured to include an LED billboard 300 .

Hereinafter, a detailed configuration will be described.

The fixed CCTV camera 100 may be configured to generate and transmit a CCTV image in real time for detecting a vehicle entering a parking and stopping violation zone. Here, the parking violation zone is a predetermined zone in which parking and stopping is prohibited, and may be a predetermined section on a road or a zone such as a plaza.

Rotational (PTZ) CCTV camera 101 may be configured to generate and transmit a CCTV image in real time for recognizing a license plate number at the location of the vehicle detected through the CCTV image of the fixed CCTV camera 100 .

4 shows a fixed CCTV camera 100 for monitoring a designated parking and stopping violation zone on the road. The fixed CCTV camera 100 may be configured to recognize a vehicle entering the parking violation zone. That is, it is possible to calculate the position of the vehicle in the image by detecting the vehicle entering.

Illegal parking enforcement server 200 may be configured to receive CCTV images from the fixed CCTV camera 100 and the rotating (PTZ) CCTV camera 101, respectively.

And the illegal parking enforcement server 200 detects and tracks the vehicle entering the parking violation zone using the CCTV image of the fixed CCTV camera 100, and uses the CCTV image of the rotating (PTZ) CCTV camera 101. By recognizing the license plate of the detected vehicle, it may be configured to perform parking and stopping enforcement in a parking and stopping violation zone in real time.

Illegal parking enforcement server 200 includes CCTV image receiving module 201, vehicle detection/tracking module 203, parking violation zone entry determination module 204, vehicle number recognition module 205, vehicle number labeling module 206 , parking violation zone parking and stopping determination module 207, parking violation enforcement target vehicle database 208, parking violation enforcement vehicle registration module 209, parking violation notification module 210, illegally parked vehicle determination module 211, illegal It may be configured to include a parked and stopped image collection module 212 and an illegally parked image database 213 .

Hereinafter, a detailed configuration will be described.

The CCTV image receiving module 201 may be configured to receive CCTV images in real time from the fixed CCTV camera 100 and the rotating (PTZ) CCTV camera 101 , respectively.

The vehicle detection/tracking module 203 may be configured to detect and track an illegally parked vehicle in a parking violation zone in real time using a CCTV image received in real time. For detection and tracking of the vehicle, a deep learning algorithm based on a convolutional neutral network (CNN) may be used.

The vehicle detection/tracking module 203 may perform a convolutiona operation to extract features of an image, and use the extracted information to find what kind of object, that is, the location of an object in the corresponding image.

As shown in FIG. 5 , the vehicle detection/tracking module 203 may perform a convolution operation while moving the filter one pixel at a time or at a predetermined pixel interval starting from the upper left of the input image. At this time, as shown in FIG. 5 , the input data is output as one pixel value through a 2X2 filter, and the 3X3 input image may be output as a 2X2 output image in 3X3. An object, that is, an object can be distinguished by using the feature value of the image.

The parking violation zone entry determination module 204 may be configured to determine whether the vehicle enters the parking violation zone using the real-time detection result of the vehicle detection/tracking module 203 . Specifically, it may be configured to detect the vehicle number and entry time of the vehicle entering the parking violation zone.

The vehicle number recognition module 205 may be configured to recognize the vehicle number of a vehicle entering the parking violation zone in real time as a result of the determination of the parking violation zone entry determination module 204 . When entering the parking violation zone, the license plate is rarely covered, so the license plate number of most entering vehicles can be recognized.

The vehicle number labeling module 206 may be configured to label the vehicle number recognized in real time by the vehicle number recognition module 205 to the corresponding vehicle of the CCTV image in real time. That is, at the time of entering the parking violation zone, it can be labeled and marked within the CCTV image of the vehicle. As shown in FIG. 6 , the corresponding vehicle may be labeled with the vehicle's vehicle number and configured to be marked in the image. Even when the vehicle moves within the image, the vehicle label is continuously displayed according to the detection and tracking results of the vehicle detection/tracking module 203 .

Parking and stopping violation zone parking and stopping determination module 207 may be configured to determine in real time whether the vehicle labeled in real time in the license plate number labeling module 206 parks or stops within the parking violation zone. Whether the vehicle is parked or stopped may be determined by whether an object in the CCTV image, that is, a state in which the vehicle does not move within the parking violation zone, continues. At this time, even if the license plate is covered by another vehicle or the driver intentionally covers it with the blanking plate, there is no problem in determining whether the vehicle is parked illegally or recognizing the number of the vehicle by tracking and labeling the vehicle.

If the license plate is obscured by other vehicles or the driver intentionally covers it with a screen, it may be regarded as illegal parking regardless of the parking time.

The parking violation enforcement target vehicle database 208 may be configured to register and store parking and stopping violation enforcement vehicles parked and stopped in a parking and stopping violation zone.

As a result of the real-time determination of the parking and stopping violation area parking and stopping determination module 207, the parking violation enforcement target vehicle registration module 209 converts the vehicle parked and stopped within the parking and stopping violation zone into the parking violation enforcement target vehicle database 208 as a parking violation zone enforcement vehicle. may be configured to register. That is, the corresponding vehicle may be registered as a vehicle subject to enforcement of the parking and stopping violation zone at the time when parking and stopping is started.

The parking violation notification module 210 may be configured to transmit in real time a parking and stopping violation notification for the vehicle to be subjected to enforcement of the parking and stopping violation area registered by the vehicle registration module 209 for the parking and stopping violation enforcement to the LED display board 300 . For example, if it is stipulated that parking and stopping time cannot exceed 5 minutes in the case of illegal parking, once it is registered as a vehicle subject to enforcement of parking and stopping violations, the parked and stopped vehicle must be in operation 5 minutes before. The parking violation notification module 210 may prevent parking and stopping by notifying whether the illegally parked or stopped vehicle is illegally parked or stopped through the LED display 300 .

The illegally parked vehicle determination module 211 may be configured to determine whether the parking and stopping time of the vehicle subject to the enforcement of the parking and stopping violation area has elapsed as a predetermined time as a result of the real-time determination of the parking and stopping violation zone parking and stopping determination module 207 .

If the predetermined time has elapsed as a result of the above determination, the illegally parked vehicle determining module 211 may be configured to determine the correspondingly parked and stopped vehicle to be cracked down on as an illegally parked vehicle.

The illegal parking image database 213 may be configured to store the parking violation image collected by the illegal parking image collection module 212 . These parking violation videos can be presented as evidence to drivers of illegally parked vehicles in the future.

The LED signboard 300 may be configured to output in real time a parking and stopping violation notification according to a result of the parking and stopping enforcement performed in real time by the illegal parking and stopping enforcement server 200 .

The LED signboard 300 may output a violation notification for a vehicle that is registered as a vehicle subject to enforcement of a parking and stopping violation area when parking is initiated in the parking and stopping violation zone. Even if the driver does not recognize whether his/her parking and stopping is illegal, he/she can immediately recognize it through the LED sign board 300 .

In addition, even when the illegal parking is confirmed, the LED display 300 is configured to output the illegal parking and stopping so that the driver can recognize it.

Although described with reference to the above embodiments, those skilled in the art can understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the following claims. There will be.

100: fixed CCTV camera 101: rotary (PTZ) CCTV camera
200: illegal parking enforcement server 201: CCTV image receiving module
203: vehicle detection / tracking module
204: parking violation zone entry determination module 205: vehicle number recognition module
206: license plate number labeling module
207: Parking and stopping violation zone parking and stopping judgment module
208: Database of vehicles subject to enforcement of parking and stopping violations
209: Vehicle registration module for enforcement of parking and stopping violations
210: Parking violation notification module
211: illegally parked vehicle confirmation module
212: illegal parking video collection module
213: illegal parking video database
300: LED signage

Claims (5)

A fixed CCTV camera 100 for generating and transmitting a CCTV image in real time for detecting a vehicle entering a parking violation zone;
A rotating type (PTZ) CCTV camera 101 for generating and transmitting a CCTV image for recognizing the vehicle number of the vehicle detected through the CCTV image of the fixed CCTV camera 100 in real time;
Each of the CCTV images is received from the fixed CCTV camera 100 and the rotating (PTZ) CCTV camera 101, and a vehicle entering the parking violation zone is detected using the received CCTV image, and the detected vehicle is detected. an illegal parking enforcement server 200 that tracks and enforces parking and stopping enforcement in the parking violation zone in real time;
and an LED signboard 300 for outputting a parking and stopping violation notification in real time according to the result of the parking and stopping enforcement performed in real time by the illegal parking and stopping enforcement server 200,
The illegal parking enforcement server 200,
CCTV image receiving module 201 for receiving CCTV images in real time from the fixed CCTV camera 100 and the rotating (PTZ) CCTV camera 101, respectively;
A vehicle detection/tracking module 203 for real-time detection and tracking of illegally parked and stopped vehicles in the parking and stopping violation zone using CCTV images from the CCTV image receiving module 201;
A parking violation zone entry determination module 204 that determines whether a vehicle enters the parking violation zone using the real-time detection result of the vehicle detection/tracking module 203;
A vehicle number recognition module 205 that recognizes the vehicle number of a vehicle entering the parking violation zone in real time as a result of the determination of the parking violation zone entry determination module 204;
A vehicle number labeling module 206 for real-time labeling of the vehicle number recognized in real time by the vehicle number recognition module 205 to the corresponding vehicle of the CCTV image,
The illegal parking enforcement server 200,
Parking and stopping violation zone parking and stopping determination module 207, which determines in real time whether the vehicle labeled in real time in the license plate number labeling module 206 parks or stops within the parking and stopping violation zone;
Parking and stopping violation enforcement vehicle database 208 in which vehicles parked and stopped in the parking violation zone are registered and stored;
As a result of real-time determination of the parking and stopping violation zone parking and stopping determination module 207, a vehicle parked and stopped within the parking violation zone is registered as a vehicle to be parked and stopped in the parking violation enforcement target vehicle database 208. module 209;
A parking violation notification module 210 that transmits a parking and stopping violation notification for a vehicle subject to enforcement of a parking and stopping violation zone registered by the parking violation enforcement target vehicle registration module 209 to the LED display board 300 in real time;
As a result of the real-time determination of the parking violation zone parking and stopping determination module 207, whether the parking and stopping time of the vehicle subject to enforcement of the parking and stopping violation zone has elapsed for a predetermined time, or the license plate is obscured by another vehicle, or the driver intentionally covers the case with a blanking plate The illegally parked vehicle determination module ( 211) further comprising,
The illegal parking enforcement server 200,
an illegally parked image collection module 212 that searches for and collects the parking violation image of the illegally parked vehicle determined by the illegally parked vehicle determination module 211;
and an illegal parking image database 213 in which the parking violation image collected by the illegal parking image collection module 212 is stored;
The vehicle detection/tracking module 203 uses a CNN-based deep learning algorithm to detect and track illegally parked and parked vehicles in the parking and stopping violation zone in the CCTV video in real time, starting with a 2X2 filter from the upper left of the input image. By performing a convolution operation while moving at a predetermined pixel interval, the feature value in the CCTV image is extracted, and the extracted feature value is used to detect and track illegally parked and parked vehicles in the CCTV image,
The parking violation zone entry determination module 204 detects the vehicle number and entry time of the vehicle that has entered the parking violation zone,
The vehicle number labeling module 206 labels the vehicle number in real-time from the point in time when the vehicle in the CCTV image enters the parking and stopping violation area to the vehicle entering the parking and stopping violation area,
The vehicle number labeling module 206 continuously labels the vehicle number in the CCTV image according to the detection and tracking result of the vehicle detection/tracking module 203 when the vehicle entering the parking and stopping violation zone is moved,
The LED signboard 300 is an illegal parking and stopping enforcement system capable of tracking and managing a vehicle, characterized in that it outputs a violation notification for a vehicle that is registered as a vehicle subject to enforcement in the parking and stopping violation area when parking is started in the parking and stopping violation zone.
delete delete delete delete

Images