KR101596896B1 - System for regulating vehicles using image from different kind camera and control system having the same - Google Patents

Abstract

Disclosed in the present invention are a regulation system for regulating illegal parking/stopping of a vehicle using images from heterogeneous cameras and a control system comprising the same. According to an embodiment of the regulation system, the system comprises: an image recognizing part which receives images from a CCTV of a first group including at least one CCTV from an external image management system, recognizes a first number included in the images by responding to a first recognizing request, thereby detecting at least one candidate area of a number plate, and recognizes the entire numbers in the candidate area of the number plate by responding to a second recognizing request; a regulation managing part which receives data related with the candidate area of a number plate detected by providing the first request to the image recognizing part, and controls a CCTV to photograph the center of the number plate based on the received data and at the same time, and provides coordinate data and/or zoom data to adjust the size of the photographed number plate; and a PTZ control part which receives coordinate data and/or zoom data from the regulation managing part and generates PTZ control data to control PTZ of at least one CCTV based on the received information.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for controlling illegal parking of an illegal parking space using images from a heterogeneous camera,

The present invention relates to an illegal parking intermittent intermittent system, and more particularly, to an intermittent intermittent system which performs illegal intermittent intermittent interception by using an image from a heterogeneous camera and a control system including the same.

2. Description of the Related Art Generally, a large number of cameras are installed for the purpose of managing a city or performing a crime prevention function in order to secure evidence against various crimes. As a type of camera installed, closed-circuit television (CCTV) is representative. The control center (or the control system) can perform the surveillance by monitoring by receiving and reproducing the images photographed from the CCTVs installed in the cities.

Along with the above-mentioned crime prevention, the installation of cameras for controlling an illegally parked vehicle in an area where an illegally parked car is prohibited is also increasing. Unlike the crime prevention function, in order to control illegal parking vehicles, it is necessary to check whether the vehicle has been parked in the illegal parking area for a predetermined time or more and also to accurately detect the license plate of the illegally parked car. It takes time.

Accordingly, the CCTV for the crime prevention function and the CCTV for the illegal parking regulation function are separately installed, and the CCTV which is controlled by the control system for crime prevention and the CCTV which is controlled by the system which carries out the illegal parking control are distinguished from each other. As a result, there is a problem in that crime prevention blind spots are generated in crime prevention, and there is a problem that it is only necessary to intercept illegal parking regulations and the areas where CCTV cameras of the interception system can shoot. In addition, there is a problem that integrated control is difficult in operating a control system of any one of the cities.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a CCTV system capable of integrally managing a plurality of CCTVs installed in a city, minimizing crime prevention crimes, System and a control system including the same.

According to an embodiment of the present invention, an intermittent system according to an exemplary embodiment of the present invention receives an image from a CCTV of a first group including at least one CCTV from an external video management system, An image recognition unit for recognizing a first number included in the image to detect one or more license plate candidate areas and recognizing all the numbers in the license plate candidate area in response to a second recognition request; And a controller for controlling the CCTV to photograph the center of the license plate based on the received information, and for controlling the size of the license plate to be photographed, And a control unit for receiving coordinate information and / or zoom information from the intermittance management unit, And a PTZ control unit for generating PTZ control information for controlling the PTZ of the at least one CCTV.

Preferably, the PTZ control information is provided to the CCTV of the first group through the external video management system, so that the PTZ of the CCTV of the first group is indirectly controlled.

Preferably, the intermittent system directly receives an image from a CCTV of a second group including at least one CCTV, and directly controls the PTZ of the CCTV of the second group according to the PTZ control information .

Preferably, the first number is a number associated with a license plate and is a four-digit number.

Preferably, the intermittent system performs a first intermittent operation based on information related to the at least one license plate candidate area received in response to the first recognition request and the second recognition request, The image recognition unit controls the image recognition unit to recognize the entire number again in the license plate candidate area and performs a second intermittent operation based on the recognition result, And the last unlawful driving vehicle is interrupted based on the result of the two-speed intermittent operation.

Further, preferably, the intermittent system receives the automatic intermittent mode and the manual intermittent mode selection input, controls the first group of CCTV to photograph the predetermined intermittent area when the automatic intermittent mode is selected, When the mode is selected, the CCTV of the first group is controlled to photograph an area corresponding to the drag input provided by the manager, and the license plate candidate area is detected from the photographed image, .

Also, preferably, the intermittent system receives M images from the CCTV of the first group for a predetermined time, recognizes a 4-digit number for each image as the first number, It is determined that the license plate of the same vehicle corresponds to a number plate of the same vehicle when three or more numbers among the four numbers recognized as the first numbers coincide with each other and whether or not the license plate of the same vehicle is included in at least N images among the M images And when the number plate of the same vehicle is included in at least N images, the area where the first number corresponding to the vehicle is recognized is determined as the license plate candidate area.

Also, preferably, the intermittent system recognizes the entire number only for the first number, which is determined as the license plate candidate area in response to the second request among the plurality of first numbers recognized and included in the image .

Meanwhile, a control system according to an embodiment of the present invention includes a video management system for receiving video from a first group of CCTVs including one or more CCTVs, and a video management system for receiving Or the PTZ of the at least one CCTV, wherein the intermittent system detects the license plate candidate area by recognizing the first number included in the image in response to the first request, and responds to the second request An image recognition unit for recognizing the entire number in the license plate candidate area, and a control unit for receiving the information related to the detected license plate candidate area by providing the first request to the image recognition unit, and based on the received information, And also provides coordinate information and / or zoom information so that the size of the license plate can be adjusted And a PTZ control unit for receiving coordinate information and / or zoom information from the intermittent management unit and generating control information for controlling the PTZ of the at least one CCTV based on the coordinate information and / or the zoom information.

According to the interception system and the control system including the interception system for performing illegal intermittent intermittent interception using the images from the heterogeneous camera of the present invention as described above, it is possible to perform interception and illegal intermittent interception using existing CCTVs, It also has the effect of minimizing the crime of crime prevention and enforcement of illegal parking regulations in various areas.

Further, according to the control system for performing the illegal parking control using the images from the heterogeneous camera of the present invention and the control system including the control system, even when CCTV for interception of crime prevention and illegal parking is added, There is an effect that it can be easily interlocked with the system.

In addition, according to the interception system and the control system including the intermittent intermittent intermittent vehicle interception system using the images from the heterogeneous camera of the present invention, image recognition, intermittent control, and PTZ control are performed in parallel, And thus it is possible to rapidly process images from a plurality of CCTVs.

1 is a diagram illustrating an embodiment of a control system including an intermittent system according to an embodiment of the present invention.
FIG. 2 is a block diagram showing an embodiment of the intermittent server of FIG. 1. FIG.
3 is a block diagram showing a more specific operation example of the intermittent server of FIG.
4 is a flowchart showing an operation method of a control system according to an embodiment of the present invention.
5A and 5B are views showing an example of an intermittent area setting and an automatic / manual intermittent operation in FIG.
6 is a flowchart showing an operation method of a control system according to another embodiment of the present invention.
FIG. 7 is a flowchart showing a specific example of the image processing method for the illegal preliminary parking regulation shown in FIG.
FIG. 8 is a conceptual diagram showing an example of calculating the position of a license plate candidate region in the embodiment of FIG. 7; FIG.
FIG. 9 is a block diagram illustrating an example of a specific function that may be added to the illegality parking control process according to the embodiment of the present invention.
FIG. 10 is a block diagram illustrating an embodiment of a PTZ controller included in the intermittent system according to an embodiment of the present invention.
11 is a block diagram illustrating an example of an integrated control system according to another embodiment of the present invention.

In order to fully understand the present invention, operational advantages of the present invention, and objects achieved by the practice of the present invention, reference should be made to the accompanying drawings and the accompanying drawings which illustrate preferred embodiments of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the preferred embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

1 is a diagram illustrating an embodiment of a control system including an intermittent system according to an embodiment of the present invention. As shown in FIG. 1, the control system 10 may include an intermittent system 100 and a video management system 200. The intermittent system 100 and the video management system 200 can receive images photographed from a plurality of CCTVs 101 and 102 and perform various management operations and intermittent intermittent intermittent operations.

1, the control system 10 may further include a video server (not shown) that receives and processes video from at least some of the plurality of CCTVs 101, 102. In one embodiment, a video server (not shown) is disposed at the front end of the intermittent system 100 and the video management system 200, and the signal processed video is transmitted to the intermittent system 100 and / 200).

Although not shown in FIG. 1, the control system 10 may further include an image storage system (not shown) for storing the signal processed image, and may also manage the overall network operation of the integrated control system 10 And a master server (not shown).

The plurality of CCTVs 101 and 102 may be classified into at least two groups. For example, a plurality of CCTVs 101 and 102 may include a first group of CCTVs (CCTV_A, 101) and a second group of CCTVs (CCTV_B, 102). The CCTVs 101 of the first group are CCTVs installed in various zones managed by the control system 10 and the images photographed from the CCTVs 101 of the first group are transmitted to the network inside the control system 10 And may be provided to the image management system 200. [ Accordingly, when the intermittent system 100 performs the illegal parking intermittent operation, images photographed by the CCTVs 101 of the first group can be provided to the intermittent system 100 through the image management system 200 have. The first group of CCTVs 101 may include two or more types of CCTVs that perform imaging in accordance with various video standards.

On the other hand, the image photographed from the CCTVs 102 of the second group can be directly provided to the intermittent system 100 without going through the image management system 200. That is, the intermittent system 100 can perform the intermittent intermittent interception from the image photographed from the separate CCTV in addition to the CCTV managed by the video management system 200. As an example, intermittent system 100 may process signals and perform intermittent operations on images provided from CCTVs 102 of a second group according to a predetermined standard, so that CCTVs 102 of the second group, May include the same kind of CCTV.

As an alternative embodiment, the intermittent system 100 and the video management system 200 may not be provided together in the control system 10 as separate systems. For example, the intermittent system 100 may be defined as a separate control system that receives an image of a direct CCTV or receives an image from an external image management system to perform an illegal intermittent intermittent interception.

Also, as a deformable embodiment, intermittent system 100 receives images directly from the second group of CCTVs 102 and performs illegal preliminary intermittent intermittent operations, and images from the second group of CCTVs 102 And may be provided together with the image management system 200. That is, the intermittent system 100 can perform the illegal parking intermittent operation using the directly received image for the CCTVs capable of receiving the direct image, while the intermittent system 100 can perform the intermittent intermittent intermittent operation using the image received directly from the video management system 200 It is possible to perform an illegal parking intermittent operation using an image. Accordingly, even if additional CCTV is installed in the area covered by the control system 10, the video from the additional CCTV can be provided to the interrupted system 100 through the video management system 200, Can be carried out against illegal parking regulations.

Meanwhile, the intermittent system 100 can control the panning, tilting, and zooming (PTZ) of a plurality of CCTVs 101 and 102 in association with the illegal parking intermittent operation. In one embodiment, the intermittent system 100 may control the PTZ of the first group of CCTVs 101 through the video management system 200. On the other hand, the interrupted system 100 can directly control the PTZ of the CCTVs 102 of the second group. As an alternative embodiment, the intermittent system 100 may control the PTZ of the CCTVs 102 of the second group through the video management system 200 as well.

The video management system 200 may include a plurality of VMS clients 210 and an operator who operates the video management system 200 may access the plurality of CCTVs 101 and 102 ) Can be confirmed. That is, under a predetermined condition, a plurality of CCTVs 101 and 102 can photograph images for performing crime prevention or images for performing illegal parking interception. In addition, the plurality of CCTVs 101 and 102 can photograph images for performing crime prevention and images for performing illegal parking intermittent interception.

Also, the intermittent system 100 according to the embodiment of the present invention may include a plurality of intermittent servers 110 that perform functions for illegal intermittent intermittent interception. Images from a plurality of CCTVs 101 and 102 can be processed in parallel by a plurality of enforcement servers 110. [ In addition, each of the enforcement server 110 has a separate apparatus for performing an operation of recognizing an image, an operation of interrupting illegal parking vehicles, and a PTZ control of a plurality of CCTVs 101 and 102, And an arrangement capable of improving the speed of intermittent intermittent driving.

According to the embodiment of the present invention, the CCTVs 101 of the first group are CCTVs managed by the video management system 200, and various kinds of CCTVs may be applied. The intermittent system 100 may directly receive It is possible to perform illegal parking interception using images from various kinds of CCTVs in addition to the CCTVs 102 of the second group. Accordingly, even if a CCTV is additionally installed in the area occupied by the control system 10, it is not necessary to construct a separate control system corresponding to the control system 10, and it is possible to control the illegal parking control through the existing control system.

A more specific operation of the embodiment of the present invention will be described as follows. 2 is a block diagram showing an embodiment of the interception server 110 of FIG.

2, the intermittent server 110 may include an image recognition unit 111, an intermittency management unit 112, a PTZ control unit 113, and a data storage unit 114.

Referring to FIGS. 1 and 2, the image recognition unit 111 receives an image photographed by a plurality of CCTVs 101 and 102, and recognizes the number of the vehicle included in the image through an image analysis operation . For example, the intermittance managing unit 112 may request the image recognizing unit 111 to recognize the 4-digit number included in the image. Also, the intermittent managing unit 112 may request the image recognizing unit 111 to recognize the four- The recognition unit 111 may request the recognition of the entire number of the license plate included in the image. Also, the intermittance management unit 112 can receive the recognition result from the image recognition unit 111. [

The intermittency management unit 112 may provide a request to the PTZ control unit 113 to adjust the PTZ of the plurality of CCTVs 101 and 102 according to the recognition result from the image recognition unit 111. [ As an example, if there is more than one four-digit number in the image, the intermittance managing unit 112 may select the position as the license plate candidate area. Also, the intermittance managing unit 112 calculates a position value of the selected one or more license plate candidate regions, calculates a zoom value for photographing the license plate candidate region, and provides the calculated information to the PTZ control unit 113 can do. The PTZ control unit 113 may generate PTZ control information for controlling the PTZ so that the CCTV capturing the license plate candidate region captures the center of the license plate and the size of the license plate is adjusted. The control information may be provided to the CCTV through the video management system 200 and may be controlled by the PTZ or directly provided by the CCTV, so that the PTZ may be controlled.

The illegally parked vehicle interruption process may be performed through a plurality of interrupting operations. An image of the license plate of the illegally parked vehicle may be stored in the data storage unit 114. The intermittent server 110 can provide various intermittent information stored in the data storage unit 114 in response to a request from the video management system 200. [

3 is a block diagram showing a more specific example of operation of the interception server 110 of FIG.

1 to 3, the image recognizing unit 111 receives CCTV images photographed from a plurality of CCTVs 101 and 102. As described above, the CCTV image may be an image provided through the image management system 200, or may be an image provided directly from the CCTV.

The intermittency management unit 112 provides the image recognition unit 111 with a recognition request a plurality of times for intermittent illegal parking. First, the intermittency management unit 112 provides a first recognition request to the image recognition unit 111 to check whether a vehicle exists in the CCTV image. The image recognizing unit 111 recognizes whether the vehicle exists by analyzing the image in response to the first recognition request. For example, the image recognizing unit 111 recognizes whether a 4-digit number exists in the CCTV image, (112). The image photographed for interrupting the illegally parked car may include two or more areas having four-digit numbers, and the image recognition unit 111 can recognize four-digit numbers in two or more areas.

The intermittency management unit 112 receives the result of recognizing the 4-digit number from the image recognition unit 111, and can determine the position of the 4-digit number in the CCTV photographed image. Based on the result of the position determination, the intermittency management unit 112 detects the entire license plate of the vehicle and calculates a CCTV movement value for recognizing the whole number. In one embodiment, the intermittance managing unit 112 calculates a coordinate information by which a CCTV moves by applying a calculation formula for converting a two-dimensional image coordinate to a three-dimensional spatial coordinate. In addition, the zoom information for adjusting the zoom of the CCTV can be calculated so that the size of the entire license plate area of the vehicle is a predetermined ratio of the entire image.

The PTZ control unit 113 may output PTZ control information for controlling the PTZ of the actual CCTV. For example, the PTZ control unit 113 outputs PTZ control information for controlling the PTZ of the CCTV based on preset preset information, thereby controlling the CCTV so that the predetermined intermittent area is photographed. In addition, the PTZ control unit 113 can output the CCTV control information based on the coordinate information and the zoom information from the intermittance management unit 112. [ Accordingly, it is possible to control the CCTV so that the entire license plate can be photographed in the license plate candidate area having the 4-digit number.

When the entire number plate is photographed, the photographed image can be provided to the image recognizing unit 111. [ The intermittance managing unit 112 recognizes the entire license plate that can be photographed in the license plate candidate area and also provides a second recognition request to the image recognition unit 111 to recognize the whole number of the license plate. In response to the second recognition request, the image recognition unit 111 can provide the interception management unit 112 with the total number recognized in the entire license plate through the image analysis as a total number recognition result.

The intermittency managing unit 112 may perform the first intermittent operation using the 4-digit number recognition result and / or the total number recognition result. In one embodiment, the first intermittent operation can be performed using only the result of the whole number recognition. As another example, the first intermittent operation can be performed according to the result of comparing the number recognized in the 4-digit number recognition result and the recognized number of the vehicle in the total number recognition result. That is, the first intermittent operation may be performed according to various methods using the results of the first and second recognition requests.

The information of the first interrupted vehicle (for example, the image of the illegally parked vehicle) may be stored in the data storage unit 114. As an example, an image including a 4-digit number may be stored in the data storage 114. In addition, as an example, an image of the entire license plate may be stored in the data storage unit 114.

The intermittent management unit 112 may perform the second intermittent operation after a predetermined time. As an example of operation, the intermittance managing unit 112 determines whether or not the position of the above-mentioned first interrupted vehicle (or the above-mentioned license plate candidate area) is photographed after a predetermined time in order to detect a vehicle that has been parked for a predetermined time in the illegal parking area It is possible to provide the coordinate information and the zoom information to the PTZ control unit 113 so that the position is photographed again. The intermittance managing unit 112 also provides the image recognizing unit 111 with a third recognition request for recognizing the entire license plate from the photographed image and for recognizing the entire number of the license plate. In response to the third recognition request, the image recognition unit 111 may provide the interception management unit 112 with the overall number recognized in the entire license plate of the vehicle through the image analysis as the overall number recognition result.

The intermittency managing unit 112 receives the total number recognition result according to the third recognition request, and can perform the second intermittent operation using the received total number recognition result. For example, the intermittency management unit 112 may perform the second intermittent operation using the information of the first interrupted vehicle stored in the data storage unit 114 and the overall number recognition result received according to the third identification request . That is, when the same number as the vehicle interrupted in the first intermittent operation is included in the second intermittent operation, the vehicle can be judged as the last illegal intermittent vehicle. The information of the vehicle judged as the final illegal parking space vehicle is stored in the data storage unit 114 and the information stored in the data storage unit 114 can be provided to the external system as the interrupted information.

FIG. 4 is a flowchart showing an operation method of a control system according to an embodiment of the present invention, and FIGS. 5A and 5B are views showing an example of an intermittent area setting and an automatic / manual interrupting operation in FIG. In Fig. 4, the control system may include an intermittent system and an image management system according to the above-described embodiments of the present invention. An example of the operation method of the control system will be described with reference to FIG. 4 and FIGS. 5A and 5B.

First, an intermittent area and a crime prevention area can be set for areas that can be photographed by a plurality of CCTVs. For example, if an area for carrying out illegal parking intermittent driving is set in advance, photographing for illegal parking intermittent driving can be automatically performed for the corresponding area, and an automatic intermittent area is set through the input of the user (S11) A crime prevention area may be set to perform a crime prevention function using the plurality of CCTVs while the CCTVs do not perform illegal parking intermittent interception (S12). For example, a separate crime prevention area is set between the intermittent areas And the crime scene is photographed periodically, so that the crime scene can be prevented from being generated.

On the other hand, a condition can be set as to whether to perform the illegal parking regulation or the crime prevention function (S13). For example, the illegal parking regulation can be performed only by some CCTVs capable of photographing the area where the illegal parking regulation is to be carried out. Accordingly, the condition for photographing the control zone and the conditions for shooting the security zone are different Can be set. In addition, even if some CCTVs perform illegal parking intermittently, the intermission may not be interrupted by date and time, and various conditions for interception and crime can be set. (S14).

Then, each CCTV captures the crime prevention area or captures the intermittent area according to the set conditions. As an example of operation, when the illegal parking condition is terminated, predetermined crime prevention areas can be automatically toured and photographed. Then, it can be confirmed whether the manual intermittent mode is selected according to the input of the user (S15). If the manual intermittent mode is not selected, automatic intermittent operation based on intermittent area shooting and number recognition will be performed according to the set value as described above.

Referring to FIG. 5A, FIG. 5A shows an example of a screen displayed on an administrator terminal that manages the intermittent system in the automatic intermittent mode. The administrator can confirm the screen as shown in FIG. 5A by executing the interconnection management program on the terminal. It is possible to confirm images captured in the intermittent area according to the automatic intermittent mode by a plurality of CCTVs, and intermittent information can be displayed on one side of the screen in accordance with the automatic intermittent operation. Further, on the other side of the screen, a control menu for inputting various control commands in association with the illegal parking regulation can be displayed.

Referring again to FIG. 4, when the manual intermittent mode is selected by the administrator, the intermittent management screen as shown in FIG. 5B is displayed, and the administrator can manually perform the intermittent intermittent intermittent driving. For example, as shown in FIG. 5B, when one of the images taken by one or more CCTVs is selected, the corresponding image is enlarged and a manual interrupted screen is displayed. Then, the manager can provide the drag input to the system so as to include the license plate of the vehicle that needs to be interrupted included in the enlarged image.

The position corresponding to the drag input provided by the manager can be calculated (S17), and the PTZ control information can be generated so that the image is captured corresponding to the position. Accordingly, the manual intermittent area is photographed through the PTZ control of the CCTV (S18), the 4-digit number is recognized from the photographed image according to the above-described embodiments, and the whole number can be recognized (S19). Although not shown in FIG. 5B, the manual intermittent screen may have two or more vehicles to be intercepted. In this case, two or more manual intermittent areas may be set in one manual intermittent screen. Also, in recognizing the entire number, PTZ control information for recognizing the entire license plate is generated, and CCTV can be controlled through the PTZ control information. If the 4-digit number and the total number are recognized according to the above-described operation, the illegally parked car may be manually interrupted (S20).

6 is a flowchart showing an operation method of a control system according to another embodiment of the present invention.

As shown in FIG. 6, the setting information related to the crime prevention area photographing and the intermittance area photographing is included in the control system, and by confirming the predetermined crime / intermittent conditions, each of the plurality of CCTVs photographs the crime prevention area or intermittent area (S21). According to one embodiment, some of the CCTVs capture the crime prevention area and some CCTV cameras capture the interception area.

If it is determined that the CCTV is a condition for photographing the intermittent area (S22), and if it is confirmed that the crime scene needs to be photographed, the PTZ is set so that the CCTV sequentially photographs one or more crime prevention areas (S23). PTZ control information may be pre-set and stored in the control system so that the CCTV points to one or more crime prevention areas. An image photographed by the CCTV is provided as a video management system (VMS) (S24).

On the other hand, if it is determined that the intermittent area is to be photographed as a result of the confirmation, the PTZ is controlled so that the CCTV captures at least one intermittent area for the intermittent area photographing (S25). PTZ control information for the intermittent area photographing may also be preset and stored in the system.

The video from the CCTV that captures the intermittent area may be provided as a video management system (VMS), and the intermittent system according to the embodiment of the present invention may receive the intermittent video from the video management system (VMS) (S26). The intermittent system can control the illegal parking vehicle based on the image analysis operation in the same or similar manner as in the above embodiment. For example, the intermittent system may include a device for recognizing an image, a device for controlling interruption, and a device for controlling the PTZ. A first recognition request is provided to a device for recognizing an image, and a first intermittent (S27). Further, based on the result of the first intermittent operation, a second recognition request may be provided to the apparatus for recognizing the image, and the second intermittent process may be performed (S28).

Various image analysis operations can be performed in accordance with the first and second recognition requests in the same or similar manner as described above. For example, the presence or absence of the vehicle in the image is confirmed according to the first recognition request, And the entire license plate of the vehicle can be recognized. Also, referring to the result of calculating the present location of the vehicle in response to the first recognition request according to the second recognition request, the entire number of the license plate of the vehicle can be recognized again. The final illegally parked vehicle may be determined by analyzing the results of the first and second interrupted times as described above, and illegally parked vehicle interception data may be stored (S29).

It is checked whether the current photographing condition corresponds to a condition for photographing the intermittent area, and the crime prevention area can be photographed or the intermittent area can be photographed according to the confirmation result.

FIG. 7 is a flowchart showing a specific example of the image processing method for the illegal preliminary parking regulation shown in FIG.

As shown in FIG. 7, the interception system for intermittent illegal parking interception receives an image of the intermittent area photographed from the heterogeneous CCTV through a video management system (VMS) (S31). The intermittent system requests image analysis by a video management system (VMS), and the image management system (VMS) performs various processing operations on the received image, thereby recognizing the 4-digit number or the whole number included in the image. For example, in order to improve the image processing speed, only a part of a plurality of frames (for example, I frame) can be selectively processed and the image analysis is performed through the distributed processing for a plurality of images based on the multi- (S32).

The sorting operation can be variously implemented, and the multithreading method can be applied to the intermittent system of the present invention in various ways. For example, an image from a CCTV may include I, P, and B frames, and the processing load of a processing unit occurring in an image processing process may be reduced through a sorting process such as decoding only I frames among them.

In addition, for a number of CCTVs, the video receiving thread and the video decoding thread are separately processed by the multi-thread for each CCTV channel, and a mutex and a memory queue buffer are used together as a method of synchronizing the threads So that individual threads can be processed without affecting each other.

An image from a video management system (VMS) is provided as an intermittent system according to an embodiment of the present invention, and the intermittent system performs an operation of interrupting an illegal driving vehicle based on the received image. For example, the intermittent system performs an operation of recognizing a four-digit number in an image to determine a license plate candidate region for the received image, and detects a license plate candidate region from the license plate region (S33). When a plurality of license plate candidate regions are included in one image, the plurality of license plate candidate regions may be detected.

Thereafter, the position and zoom values of the detected license plate candidate area are calculated (S34), and the entire license plate of the vehicle located in the license plate candidate area can be photographed by controlling the PTZ of the CCTV according to the calculated value (S35 ). When the number of the entire license plate is recognized, the vehicle of the recognized license number is firstly interrupted (S36).

The PTZ is controlled so that the CCTV again captures the license plate candidate area detected in the first intermittent process in order to detect the entire license plate after a predetermined period of time so that the CCTV moves to the position where the entire license plate is detected (S37). Accordingly, the entire number plate is again photographed, and the number of the entire number plate can be recognized (S38). If the vehicle whose number is recognized according to the result of the number recognition is secondarily interrupted, and the illegally parked vehicle is finally confirmed based on the results of the first intermittent and second intercept, the intercept data is stored (S39).

FIG. 8 is a conceptual diagram showing an example of calculating the position of a license plate candidate region in the embodiment of FIG. 7; FIG.

As shown in FIG. 8, when the 4-digit number is recognized and the license plate candidate region is detected, the PTZ control information may be generated to photograph the entire license plate and recognize the whole number. As an example, a coordinate value to be shifted so that the center of the license plate moves to the center of the image in the license plate candidate area can be generated. The coordinates (abs) to be moved can be calculated using the difference between the center coordinates of the detected number plate and the center coordinates of the entire image.

When a coordinate value (abs) to be moved is generated, a pan movement value can be calculated. For example, the pan shift value may be calculated by summing the current value of the pan with a predetermined calculated value. The predetermined calculated value may be calculated by multiplying the difference value between the center value of the X axis of the entire image and the center value of the X axis of the license plate area by the pan angle of view of the camera.

At the same time, a tilt movement value can be calculated and the tilt movement value can be calculated by summing the current value of the tilt with a predetermined calculation value. The predetermined calculated value may be calculated by multiplying the difference value between the Y-axis center value of the entire image and the Y-axis center value of the license plate area by a tilt angle of view angle of the camera.

On the other hand, as described above, a zoom movement value can be calculated so that the entire license plate has a predetermined size in the photographed image. If a zoom movement value is calculated such that the size of the entire plate is 1/6 of the image, a zoom movement value can be calculated by the equation as shown in FIG. For example, since the ratio value and the calculation formula for the PTZ calculation may be different for each CCTV manufacturer, the calculation condition needs to be set in consideration of this.

FIG. 9 is a block diagram illustrating an example of a specific function that may be added to the illegal parking control process according to the embodiment of the present invention.

In an embodiment of the present invention, one or more actions may be added in the primary and secondary intermittent processes for efficiency and accuracy of illegal parking intermittent vehicle interception. For example, the intermittent system can receive a plurality of (e.g., M) photographed images during a predetermined time period T1 (S41). Then, in the same manner as in the above-described embodiment, an operation of recognizing the 4-digit number for selecting the license plate candidate area for each photographed image can be performed (S42).

According to the embodiment of the present invention, the region where the 4-digit number sensed in the photographed image is located is determined as the license plate candidate region, and the PTZ control operation for photographing the entire license plate according to the embodiment described above can be performed. However, it is possible to detect a large number of regions where four-digit numbers are located in a plurality of images, thereby determining all detected regions as license plate candidate regions and performing a PTZ control operation for photographing the entire license plate The efficiency may be lowered, and there is room for increasing the resources consumed in image processing.

On the other hand, in comparison with the operation of recognizing the entire number through the recognition of the entire license plate, a plurality of license plate candidate regions can be detected in any one of the images, and accordingly, the accuracy of the recognition result of the 4-digit number may be lower . In consideration of this, in comparing the identities of the photographed vehicles in a plurality of images, it is possible to determine that the vehicles are the same vehicle even if one number is mistakenly recognized when three or more digits of the four digits are identical (S43).

On the other hand, when photographing the intermittent area, it is also possible to photograph a vehicle that is not in the illegal parking space while driving, and it is not necessary to detect the entire plate of the vehicle being driven. Accordingly, in one embodiment of the present invention, it is possible to determine whether a corresponding vehicle is included in N or more images through recognition of four digits among M images photographed during the predetermined time period. That is, when the vehicle is detected only in N or less images, it is determined that the vehicle is in operation, and the operation of detecting the entire number plate for the vehicle can be omitted.

After the filtering operation for judging the illegal driving vehicle, only a part of the area (the area where the 4-digit number is detected) satisfying the illegal driving restriction requirement is determined as the license plate candidate area (S45). The entire license plate photographing operation according to the above-described embodiment can be performed on the determined license plate candidate area.

On the other hand, the information on the interception of the illegally parked car must include the image of the license plate as a whole. At this time, when the position of the vehicle is relatively far, the entire plate can be photographed even if the zoom value is set to the maximum. At this time, after the primary and secondary intermittent operations are performed, in order to match the entire license plate photographing image to the primary intermittent size (for example, the license plate width is approximately 1/6 of the entire image width) The image size can be adjusted. For example, if the entire license plate image is photographed even if the maximum zoom value is set, the entire license plate area is extracted from the image including the vehicle, and the image corresponding to the entire license plate is set to 1 It can be adjusted to the size of the car intermittent.

FIG. 10 is a block diagram illustrating an embodiment of a PTZ controller included in the intermittent system according to an embodiment of the present invention.

As shown in FIG. 10, the PTZ control unit may generate a PTZ control signal for capturing an image for interrupting the illegal driving vehicle under various conditions. If it is determined that at least one CCTV satisfies the condition for photographing the security zone in the control system having the PTZ control unit, the PTZ control unit generates a PTZ control signal for controlling the CCTV of the PTZ control target to move to the security zone . On the other hand, if it is determined that one or more CCTVs satisfy the condition for photographing the intermittent area, the PTZ control unit may generate the PTZ control signal for controlling the CCTV of the PTZ control object to move to the intermittent area.

According to the above-described embodiment, an image captured by the CCTV in the intermittent area is analyzed, and one or more 4-digit numbers can be detected in the image according to the analysis result. The detected area is set as a license plate candidate area, and the position of the license plate candidate area can be calculated. The PTZ control unit may generate a PTZ control signal for controlling the CCTV to move to the center of the license plate so that the CCTV captures the center of the license plate included in the license plate candidate area. At the same time, the PTZ control unit can generate a PTZ control signal for controlling the zoom in / out for centering the entire license plate.

The PTZ control unit generates a PTZ control signal for controlling the CCTV to move to the position (or first intermittent position) at which the CCTV has photographed the entire number plate after the first intermittent speed has been achieved by photographing the entire number plate as described above can do. In addition, in the integrated control system having the PTZ control unit, general coordinate information can be generated by the input of a manager managing the video management system (VMS) or the intermittent system, and the general coordinate information can be provided to the PTZ control unit. The PTZ control unit may generate a PTZ control signal for controlling the PTZ of the CCTV according to the general coordinate information.

11 is a block diagram illustrating an example of an integrated control system according to another embodiment of the present invention.

11, the integrated control system 300 includes various systems (or servers) for providing various functions by using illegal parking intermittent interrupting results in addition to the video management system 310 and the intermittent system 320 . As an example, the integrated control system 300 may further include an information providing server 330, an intelligent search server 340, and a situation propagation server 350. The intermittent system 320 and the image management system 310 can receive images photographed from a plurality of CCTVs 301 and 302 according to the above embodiment and perform various management operations and illegal parking intermittent operation . Also, as described above, the integrated control system 300 may further include an image storage system (not shown) for storing the signal-processed image, and may also manage the overall network operation of the integrated control system 300 And a master server (not shown). The plurality of CCTVs 301 and 302 may include a first group of CCTVs (CCTV_A) 301 and a second group of CCTVs (CCTV_B) May be provided to the intermittent system 320 via the image management system 310. On the other hand, images photographed by the CCTVs (CCTV_B, 302) of the second group can be directly provided to the intermittent system 320. [

The intelligent search server 340 receives the vehicle number recognition result from the image management system 310 or the intermittent system 320 and receives various database information provided from the information providing server 330 and transmits From the recognition result of the existing vehicle number, it is possible to perform a search operation to determine whether the vehicle corresponds to a pick-up vehicle or a delinquent vehicle. The information providing server 330 may include various types of servers such as a police office server for providing information for real-time inquiry of a wanted vehicle, and a delinquent information server for providing information for real-time inquiry of a delinquent vehicle. The intelligent search server 340 receives the search operation through comparison between the recognized vehicle number and the information stored in the problem vehicle database, and outputs an event indicating the occurrence of an event such as the presence of the same vehicle number in the problem vehicle database, To the radio wave server 350.

The situation propagation server 350 propagates the situation according to the received event. In addition, information for predicting the travel path of the troubled vehicle can be established and established in the situation propagation server 350, and can be operated in conjunction with a GIS (not shown) for expressing the route on the map of the troubled vehicle have. The situation propagation server 350 can share the vehicle information of the tracking object with other systems according to a preset event scenario. For example, the situation propagation server 350 may provide an event to the video management system 310 and / or intermittent system 320 so that the problem vehicle can be captured by multiple CCTVs 301, The control system 310 and / or the intermittent system 320 can control the plurality of CCTVs 301 and 302.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (11)

Receiving an image from a first group of CCTVs including one or more CCTVs from an external image management system and detecting one or more license plate candidate regions by recognizing a first number contained in the image in response to a first recognition request An image recognition unit for recognizing the entire number in the license plate candidate area in response to a second recognition request;
The CCTV receiving unit receives the information related to the detected license plate candidate area by providing the first recognition request to the image recognition unit, controls the CCTV to photograph the center of the license plate based on the received information, An intermittance management unit for providing at least one of coordinate information and zoom information to be adjusted; And
And a PTZ control unit for receiving at least one of coordinate information and zoom information from the interruption management unit and generating PTZ control information for controlling the PTZ of the at least one CCTV based on the coordinate information and the zoom information,
Receiving M pictures from the CCTV of the first group for a predetermined time, recognizing a 4-digit number for each picture as the first number,
When it is determined that three or more numbers among the four-digit numbers recognized as the first numbers in the different images coincide with each other, it is determined that the license plate of the same vehicle corresponds to at least N Whether or not it is included in the above-
Wherein when the number plate of the same vehicle is included in at least N images, an area where the first number corresponding to the vehicle is recognized is determined as the license plate candidate area. The method according to claim 1,
Wherein the PTZ control information is provided to the first group of CCTVs through the external video management system, so that the PTZs of the CCTVs of the first group are indirectly controlled. The method according to claim 1,
Directly receives images from a second group of CCTVs including one or more CCTVs, and directly controls the PTZs of the second group of CCTVs according to the PTZ control information. The method according to claim 1,
Wherein the first number corresponds to a license plate number and corresponds to a four-digit number. The system according to claim 1,
Performing a first intermittent operation based on information related to the at least one license plate candidate region received in response to the first recognition request and the second recognition request,
The image recognition unit controls the image recognition unit to recognize the entire number again in the license plate candidate area and performs a second intermittent operation based on the recognition result by providing the third recognition request to the image recognition unit,
And interrupts the final illegal driving vehicle based on the results of the first and second intermittent operations. The method according to claim 1,
An automatic intermittent mode and a manual intermittent mode selection input,
When the automatic intermittent mode is selected, to control the CCTV of the first group to photograph a predetermined intermittent area,
When the manual intermission mode is selected, the CCTV of the first group captures an area corresponding to the drag input provided by the administrator, detects the license plate candidate area from the photographed image, And a control unit for controlling the control unit. delete The method according to claim 1,
And recognizes the entire number only for a first number of a part of the plurality of first numbers recognized as included in the image and determined as the number plate candidate area in response to the second recognition request. A video management system for receiving video from a first group of CCTVs comprising at least one CCTV; And
And an intermittent system for receiving an image from the at least one CCTV through the video management system or controlling the PTZ of the at least one CCTV,
The intermittent system includes:
An image recognition unit for detecting a license plate candidate area by recognizing a first number included in the image in response to a first request and recognizing an entire number in the license plate candidate area in response to a second request;
The first request to the image recognition unit to receive information related to the detected license plate candidate area, and to control the CCTV to photograph the center of the license plate based on the received information, An intermittance management unit for providing at least one of coordinate information and zoom information so as to be displayed; And
And a PTZ control unit for receiving at least one of coordinate information and zoom information from the interruption management unit and generating control information for controlling the PTZ of the at least one CCTV based on the coordinate information and the zoom information,
Receiving M pictures from the CCTV of the first group for a predetermined time, recognizing a 4-digit number for each picture as the first number,
When it is determined that three or more numbers among the four-digit numbers recognized as the first numbers in the different images coincide with each other, it is determined that the license plate of the same vehicle corresponds to at least N Whether or not it is included in the above-
Wherein when the number plate of the same vehicle is included in at least N images, the area in which the first number corresponding to the vehicle is recognized is determined as the license plate candidate area. 10. The method of claim 9,
The intermittent system includes:
Directly receives an image from a second group of CCTVs including one or more CCTVs and directly controls the PTZs of the second group of CCTVs according to the PTZ control information. 10. The method of claim 9,
At least one crime prevention area and an intermittent area are set, condition information related to the crime prevention area and the intermittent area photographing is stored,
Wherein the image management system controls each of the one or more CCTVs to capture the crime prevention area or the intermittent area by checking the condition information,
Wherein when the CCTV captures the intermittent area, the image management system provides the captured image of the CCTV to the intermittent system.

Images