KR101033237B1 - Multi-function detecting system for vehicles and security using 360 deg. wide image and method of detecting thereof - Google Patents

Abstract

PURPOSE: A multi-function detecting system for vehicles and security using 360 degrees wide image and a method of detecting thereof are provided to improve regulation efficiency by monitoring a surveillance zone by 360 degrees and obtaining real-time panoramic image. CONSTITUTION: In a multi-function detecting system for vehicles and security using 360 degrees wide image and a method of detecting thereof, regulation high resolution digital cameras(10) are installed within a housing of a dome by 90° interval between them. A control server combines four 90° images to display a real-time panoramic image. The control server is moved to a pixel through forensics zooming and high resolution image restoration method. A controller controls the high resolution digital cameras in a regulation area. The controller takes a picture of a regulation area and transmits it to the control server of a regulation center in wired/wireless communication method.

Description

BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a multi-function detection system, wide image and Method of < RTI ID = 0.0 >

More particularly, the present invention relates to a multi-function intermittent interception system and intermittent method using a 360-degree ultra-wide area image, Area monitoring, crime prevention, intermittent multifunctional multifunctional system, and intermittent method using a 360-degree ultra-wide-angle image that can be constantly monitored by a 360 ° real-time panoramic image.

CCTV cameras used for crime prevention and parking interception capture objects in a specific direction or a certain distance through control of fixed or passive pan, tilt, and the like. Accordingly, there is a demand for an automatic tracking camera system for capturing an object of interest automatically after a camera captures an image and automatically acquiring the shape of a stable object continuously according to changes in the position and behavior of the object.

Therefore, in the conventional CCTV system, after the image is captured at a specific camera position, the camera automatically adjusts the pan / tilt of the object of interest according to the position, thereby continuously tracking the object .

In addition, in a conventional camera pan / tilt adjustment method using object tracking, each pixel of two consecutive image frames is compared to detect movement of the two frames. In addition, a motion detection area composed of pixels in which the motion has occurred is set. At this time, a rectangular motion detection area is set with reference to the pixels of the outermost one of the pixels in which motion occurs. When the motion detection area is set as described above, the center coordinates of the set motion detection area and the center coordinates of the camera are set, and the center coordinates of the camera are shifted toward the center coordinates of the motion detection area to match the two coordinates. By moving the center coordinates of the camera toward the center coordinates of the motion detection area, the camera can be moved along the moving object.

However, the conventional surveillance camera method does not have the function of a wide area surveillance camera because the camera is fixed at a specific position and then the moving object is tracked by the pan / tilt adjustment of the camera when the moving object is detected. And has a function of stably monitoring an object. Therefore, it is impossible to monitor the wide area with one camera module. In addition, since a motion object is detected by comparing pixels of two consecutive image frames, if the object is detected and then stopped, a problem arises that it can not be continuously detected.

In addition, the conventional wide area surveillance system based on PTZ (Pan, Tilt, Zoom) camera is a passive surveillance system. In order to detect the surveillance target in real time in the surveillance area, There is a problem that a person has to control the PTZ camera individually in order to continuously obtain the enlarged image of the PTZ camera. Therefore, although the PTZ camera has various functions suitable for wide area surveillance, if the surveillance person sells a sight or vacates the position, such a function can not be utilized properly and effective surveillance can not be performed properly.

Recently, there has been an attempt to automate video surveillance through analyzing a camera projection by a computer in order to solve the problem of passive video surveillance by a person. However, most focuses on monitoring a specific area by a fixed camera. In order to perform effective wide-area surveillance through a PTZ camera, an automated monitoring method utilizing the characteristics of the PTZ camera is required.

An object of the present invention is to provide a camera module in which four camera modules are installed in a housing such as a speed dome camera to constantly monitor the surveillance area at 360 ° and each camera module captures a 90 ° view image and synthesizes four 90 ° images, A multifunctional interception system and a interception method using a wide-area image for expressing a panoramic image.

In addition, the present invention realizes a digital PTZ (Pan, Tilt, Zoom) function using a forensic zoom technique and a super resolution technique using a 360 ° real-time panoramic image to perform area surveillance, crime prevention, And to provide a multifunctional interconnection system.

The present invention also provides a correction method of a high-resolution digital PTZ camera and a license plate recognition algorithm in order to reduce errors.

In order to solve the above-described problems, an intermittent system according to the present invention comprises four intermittent field high-resolution digital cameras installed at 90 ° intervals in a dome-shaped housing for capturing a 90 ° view image, A control unit which captures the intermittent video and transmits it to the control server of the interception center through wired / wireless communication network, and the four 90 ° images taken at the interception site are synthesized and displayed as a real time panoramic image, and the resolution is reduced to a predetermined size When a violating vehicle is detected in the detection area for detecting the detection area, the moving object is moved or enlarged to the detected pixel position by a forensic zoom method and a super resolution method, Finds the position of the license plate and moves it to recognize the license number, And a control server configured to display and store a background image as a reference, wherein the control server is connected to the secondary inquiry server and the fine payment server by communication, and the intermittent video display unit of the control server is a mechanical drive using a camera motor A panning, tilting, and zooming function is implemented in software on the received intermittent video instead of pan, tilt, and zoom.

In a preferred embodiment of the present invention, the forensic zoom technique is to display and store an area of interest by clicking an intermittent position with a digital PTZ control cursor in a semi-automatic intermittent mode.

According to a preferred embodiment of the present invention, the high-resolution image restoration technique enlarges the vehicle when the size of the vehicle is small using the image processing model, and shrinks when the size of the vehicle is large.

As a preferred embodiment of the present invention, the correction of the high-resolution digital PTZ camera is performed by displaying a correction pattern window on the image screen of the intermittent scene, and using the direction key or the mouse of the computer, The tilt angle, and the focal distance of the camera so as to correspond to the lane of the road.

As a preferred embodiment of the present invention, license plate recognition in the intermittent image display unit is performed by performing image preprocessing of the interrupted original image for eliminating noise and color contrast defect, performing binarization, And a region boundary to generate a rectangular object value. The license plate area is extracted and corrected through a matching operation, and the vehicle number is extracted by the license plate subdivision operation and the recognition engine.

Meanwhile, the area monitoring, crime prevention, and intermittent interception by the digital PTZ is performed by setting a predetermined surveillance area to four intermittent site high resolution digital cameras installed at intervals of 90 degrees and photographing a 90 ° view image, Setting a shooting control information including an angle, a tilt angle, and a focal length in a control unit, the control unit photographing the surveillance region and transmitting the surveillance region to a control server of the interception center, and a detected video display unit of the control server, And displaying the detected 90 ° images as a real-time panoramic image, reducing the resolution to a predetermined size to set a detection area, and the intermittent video display unit of the control server performs mechanical driving using a camera motor Instead of performing pan, tilt, and zoom operations, the received intermittent video is panned, tilted, and zoomed in software When a violating vehicle is detected in the detection area, the camera moves to a pixel position detected by a forensic zoom technique and a super resolution technique, and then the position of the license plate is detected by a license plate recognition algorithm. A first intermittent step of recognizing the number and displaying and storing the background image based on the recognized position of the license plate; a step of judging the same vehicle as a vehicle with an illegality when the same vehicle number is recognized in the detection area after a predetermined management time after the first intermission The control server acquires the information of the borrower through the secondary inquiry server and sends the information to the fine paying server, and the fine paying server issues a notice of fined money violation to the borrower together with the received evidence data .

By using the multi-function intermittent interception system and intermittent method using the wide area image according to the present invention, it is possible to monitor the surveillance area at 360 degrees and obtain a real time panoramic image.

By using the digital PTZ technique, the present invention can quickly and accurately recognize a license plate of a vehicle to perform park interrupting, and can save the maintenance cost of the intermittent system more than the mechanical PTZ.

In addition, the present invention can increase the cracking efficiency because the cracking of the illegally parked vehicle by objective and definite evidence data does not cause unnecessary friction or rejection with the civil petitioner, and the cost of on-site trip control can be reduced.

Also, the enforcement system according to the present invention can be used for various purposes such as monitoring and security for industrial sites and residential facilities, as well as enforcement of illegal parking regulations, and various functions.

FIG. 1 is a block diagram of a multifunctional interception system
2 is a 360 degree wide-area camera perspective view.
FIG. 3 is a forensic zooming technique according to an embodiment of the present invention.
4 illustrates a high-resolution image restoration method according to an embodiment of the present invention.
5 illustrates an image transformation scheme according to an embodiment of the present invention.
6 is a photograph illustrating setting of a detection area in a detection image display unit of a control server according to an embodiment of the present invention;
7 is a photograph illustrating a license plate recognition process and a background image storing process in the intermittent image display unit of the control server according to an embodiment of the present invention.
8 is a license plate recognition algorithm according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. The drawings illustrate only the essential features for the sake of clarity of the invention and are not to be construed as limiting the drawings.

As shown in FIG. 1, the digital surveillance security monitoring system for digital surveillance by digital PTZ and the intermittent intermittent multifunctional interception system according to an embodiment of the present invention includes four high-resolution digital cameras 10 having a 90-degree view image of an intermittent field, 20 and the server unit 100 of the disconnection center are connected to each other through a communication network.

FIG. 2 is a perspective view illustrating a high-resolution digital camera 10 of a multi-function interception system using a wide-area image according to the present invention. The camera 12 includes a camera body 11 having a generally quadrangular pyramid shape, Four housings 13 are mounted in a dome-shaped housing 13. The cameras 12 are formed at intervals of 90 degrees, and preferably have a resolution of at least 5M pixels or more. Accordingly, the four cameras 11 constantly monitor the surveillance area at 360 °, and each camera 12 photographs a 90 ° view image and combines the four images to display a 360 ° real-time panoramic image. Of course, it is natural that the camera can be modified into various shapes in which four cameras are mounted at intervals of 90 degrees.

The controller 20 of the intermittent field sets an intermittent area, captures the intermittent area with the high-resolution digital camera 10, designates a coordinate value on the photographed image, and transmits the coordinate value to the server unit 100 of the intermittent center.

Since the conventional intermittent camera uses a plurality of camera devices such as a remote camera for photographing a large area around the camera and a short-range camera for photographing a license plate for use as circumstantial evidence, installation cost and control are complicated In the case of using a mechanical PTZ camera capable of taking horizontal, pan, tilt, and zoom photographs, the resolution is low. Since the motor driving device is used, There is a problem in that the viewing angle is small because the speed is slow and depends on the rotation radius of the motor.

Particularly, considering that the parking surveillance area is formed along both sides of the road, it is difficult for the camera to capture a clear and accurate image of a vehicle parked at a remote place or a vehicle parked just behind such a vehicle, It is also difficult to issue a notice of illegal parking violation based on unfamiliar images. That is, due to the limitations of the zoom function of the camera and the limitation of the tilting speed of the camera, it is difficult to obtain a uniform and quick image quality for a vehicle parked at a distance and a parked vehicle at a close distance. In the case of a vehicle parked at a remote location, a slight difference in position of about 1 meter is caused by only a slight tilting of the camera, it is not possible to quickly photograph a distance while photographing a close range, and it is difficult to quickly photograph a close range.

 In order to solve the above problems, the present invention solves the low resolution problem using four 5M-pixel high resolution digital cameras 10 having a 90 degree view image, uses the forensic zoom technique and the high resolution image restoration technique, The problem of slow reaction speed and viewing angle in camera is solved. In order to apply the forensic zoom technique and the high-resolution image restoration technique, a high-resolution image of at least 5M pixels is required.

Table 1 summarizes the differences between the conventional mechanical PTZ and the digital PTZ according to the present invention.

The forensic zoom method is a method for acquiring evidence from a photographed image. As shown in FIG. 3, when a user clicks an area of interest by the digital PTZ control cursor 200, live image) and stored in data storage. Since this function is controlled by moving the control cursor with the mouse, it is possible to display and store the image accurately and quickly. In case of using a conventional mechanical PTZ camera, it is slow and inaccurate to move to the area of interest due to the time of the motor gear moving and the time of position control. In case of semi-automatic intermittent intermittent mode by one click using mechanical PTZ camera, if intermittent intermittent mode is clicked, it moves to that position by motor, so it takes much intermittent time and intermittent position may be inaccurate due to coordinate mismatch However, since the present invention uses a software image processing rather than a mechanical operation, it is possible to quickly and accurately display an image and to store a proof image in a one-click semi-automatic intermittent mode.

As shown in FIG. 4, a high resolution image reconstruction (super resolution) technique converts a low resolution image into a high resolution image using a signal processing technique (warping, burring, down sampling) between a high resolution image and a low resolution image. Warping uses an interpolation method (bilinear or nearest neighbor) in which a part of an image is designated and transformed into a shape corresponding to a defined area.

According to the present invention, in order to secure a wider intermittent area, a focal length of a high-resolution camera lens is shortened to obtain a super-wide-area image, and then an intermittent image of the vehicle is acquired with a forensic zoom image. If the vehicle size is small, And if the size of the vehicle is large, it is reduced to a high-resolution image restoration technique.

In order to improve the reliability of vehicle detection in illegal parking interception system, accurate detection area information should be obtained. The accurate detection area information should be the focal distance, pan angle, and tilt angle of the camera. In addition, information on the real-time information of the regulatory field, such as the width of the actual road, is required. In other words, the camera parameters (pan angle, tilt angle, and focal length) are calculated by generating a specific pattern using the road width and the length, and the position and distance of the three- do.

FIG. 5 shows a flowchart of a geometric transformation for camera correction to improve the reliability of detection of a vehicle. When the three-dimensional real world coordinates (Xw, Yw, Zw) are inputted from the camera image, the three-dimensional camera coordinate system (x, y, Zw) is calculated by the rotation matrix R and the movement vector T in step 1 z). The camera's pan angle (θ) and tilt angle (φ) are calculated by the automatic camera adjustment function.

In step 2 (S20), the three-dimensional camera coordinate system (x, y, z) is converted into an image coordinate system (xt, zt) by Perspective projection having a pinhole lens geometric transformation. In step 1 (S10), a camera fitting by the automatic camera adjustment function of the control unit 20 in a state where the real world plane and the CCD sensor coordinate system of the camera are mutually converted symmetrically about the optical axis Zw, f) and calculates the image coordinate system (xt, zt). The camera coordinate system (x, y, z) may be a temporary image coordinate system, and the coordinate system (xt, zt) calculated by the focal length may be an actual camera image coordinate system. The image coordinate system (xt, zt) is calculated by the perspective transformation of equation (2).

In step 3 (S30), the image is converted into an image coordinate system to be processed on an actual computer. The image coordinate system (xt, zt) computes the computer coordinate system by the set x-axis CCD length, the y-axis CCD length, and the actual image size. Next, the focal distance, the pan angle, and the tilt angle of the camera are obtained by the automatic camera fitting function of the control unit 20. [

When a correction pattern window is displayed on an image screen of an intermittent scene and each line of the correction pattern window is moved to correspond to the lane of the road bottom centering on the camera pinhole by using a direction key or a mouse of the computer, The pan angle, tilt angle, and focal length of the camera are automatically generated by the rotary type, and the camera can be corrected through the control unit 20 based on the generated angle.

The server unit 100 of the enforcement center includes a control server, a secondary inquiry server, and a fine payment server, and the control server includes an intermittent image display unit having a detected image display unit and number recognition software installed therein.

When the vehicle enters the detection area, the control unit 20 of the intermittent scene picks up an image with a high resolution digital PTZ camera and designates time and coordinate values and transmits it to the control server of the server unit 100 of the interception center.

The control server exposes the transmitted high resolution original image 300 of 3648 x 2752 to the monitor as shown in FIG. 5, and the detection image display unit of the control server exposes the detection image 310 reduced in resolution of 640 x 480 The detection area 320 is set.

When the offending vehicle is detected in the set detection area 320, the intermittent video display part of the control server moves or enlarges the corresponding pixel position and size and displays it on the screen as shown in FIG. 7 (a). At this time, the forensic zoom technique is used for moving to the area of interest and the high resolution restoration technique is used for enlarging.

7 (b), the image is displayed and the license plate is recognized and stored as the first intermittent image.

In order to acquire the circumstantial evidence image, the right and left upper and lower image sizes are calculated on the basis of the recognized plate position, and the background image is displayed and stored as shown in FIG. 7 (c).

When the same license plate is recognized as shown in Fig. 7 (d) at a position of the first intermittent-speed image after a predetermined management time, the vehicle is judged to be an illegitimate vehicle and displayed and stored.

 If it is determined that the vehicle is a traffic violation vehicle, the control server obtains the information of the borrower through the secondary inquiry server and transmits the information to the fine paying server, and the fine paying server issues the pigeon fines to the borrower together with the received evidence.

8 is a flowchart illustrating a license plate recognition algorithm according to the present invention.

When a vehicle image is input to the intermittent image display unit of the control server (S100), image pre-processing is performed to remove image noise and contrast defects (S110). Image preprocessing techniques include smoothing, histogram equalization, and expansion or contraction morphology. For the night image, pre-processing such as low pass filtering, Gaussian filtering, and intermediate value filtering can be performed. For the daytime image, the input image can be processed without any preprocessing according to the histogram algorithm, the edge algorithm, the labeling algorithm, and so on. In the histogram algorithm, the lowest bit value that occurs frequently is allocated, and a larger bit value is assigned to analyze the image value as the frequency value becomes smaller. The edge algorithm is a method of recognizing the part of the image where the color or density changes rapidly as an edge. The labeling algorithm extracts the area that is expected to be the final vehicle based on the results analyzed above. Through such a process, the number of vehicles, the size of the vehicle, the color of the vehicle, and the vehicle coordinate values in the detection area can be known.

The original image and the preprocessed image are input and the image is binarized (S120). For image binarization, the Gaussian distribution is calculated as the average and variance of the image, and the threshold value is determined.

Next, a region boundary operation is performed on the plurality of binarized images by a four-direction (up, down, left, and right) chain coding technique (S130). An object rectangle value is generated by the local boundary operation.

When the rectangular object value is generated, the matching operation is performed according to the restriction condition according to the license plate standard, that is, the numerical height ratio, the interval distance, and the like (S140). Matching operations generate local candidates similar to plates.

When the license plate candidate areas are generated, the score is calculated by a matching score formula, and the license plate candidate area closest to the target value is extracted as the final single license plate area (S150).

If the extracted single plate area is inclined, the position of the plate area is corrected through up / down or left / right shearing operation (S160).

In the license plate segmentation, the old license plate and the new license plate are distinguished from each other, and a large number, a small number, and a Korean part area are distinguished (S170). For example, the type of license plate is' Busan 68 Nye 7609 'in case of old type, '88 la 6079' in case of new type, and there is no local name in latest type such as car, .

The license plate data is recognized by the recognition engine for each of the separated data (S180). The recognition engine uses neural network learning techniques or pattern feature techniques. For example, a four-digit serial number (e.g., '6079' in 88a6079), a two-digit number (e.g., (For example, '88' in 88-6079), the first-order application code (eg '88' in 6079), and if there is a character in the local name, It also recognizes local name characters.

 The digital surveillance zone monitoring and multi-function interception system with digital PTZ according to the present invention photographs a designated area when an automatic mode operation is performed, extracts a license plate of a vehicle when a vehicle with a disturbance is detected, If the same vehicle number is recognized again at the same place even if the allowed stop time has elapsed, it is determined that the vehicle is a violation vehicle and the related information is stored by photographing the vehicle as well as the background image.

The control system according to the present invention can be utilized for various purposes such as monitoring, security, and various functions in industrial sites, residential facilities, child protection areas, as well as the control of illegal parking regulations.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The scope of the claims of the present invention is obvious.

10: high resolution digital camera 20:
100: intermittent center server unit 200: digital PTZ control cursor
300: original image 310: detection image
320: detection area

Claims (10)

In the interception system for area surveillance, crime prevention and intermittent interception,
Four intermittent field high resolution digital cameras installed at 90 ° intervals in a dome shaped housing to capture 90 ° view images;
A controller for controlling the high-resolution digital camera at the interception site, capturing intermittent images, and transmitting the intermittent images to a control server of the interception center through a wired / wireless communication network; And
A detection image display unit for synthesizing four 90 ° images photographed at the interception site and displaying the image as a real time panorama image, reducing the resolution to a predetermined size to set the detection area, and a forensic zoom zooming method, and super resolution method. Then, the position of the plate is detected by moving the plate to the position of the detected pixel by the license plate recognition algorithm, and then the number is recognized. Then, And an intermittent image display unit for displaying and storing the intermittent image,
The control server is connected to the secondary inquiry server and the fine payment server by communication,
The intermittent video display unit of the control server implements pan, tilt, and zoom functions by software in response to received intermittent video instead of pan, tilt, and zoom by mechanical drive using a camera motor 360 degree multi-zone image monitoring, crime prevention and intermittent multi-function system. The method of claim 1, wherein the forensic zooming method displays and stores an area of interest by clicking an intermittent position with a digital PTZ control cursor in a semi-automatic intermittent mode, and performs area monitoring, crime prevention, Multifunctional system. The high resolution image restoration method according to claim 1, wherein the high resolution image restoration technique enlarges when the size of the vehicle is small using the image processing model and is reduced when the size of the vehicle is large, Multifunctional system. 2. The method according to claim 1, wherein the correction of the high resolution digital PTZ camera is performed by displaying a correction pattern window on an image screen of the intermittent field and using the direction key of a computer or a mouse to line each line of the correction pattern window, The tilt angle, and the focal distance of the camera are determined so as to coincide with the lane of the camera, so that the 360 degree ultra-wide-area image monitoring, crime prevention, and intermittent multifunctional system are performed. The method of claim 1, wherein the recognition of the license plate in the intermittent image display unit is performed by performing image preprocessing of the interrupted original image for eliminating noise and color contrast defect, performing binarization, (region boundary) to generate rectangular object values, extracts license plate area through matching operation, corrects license plate number, and car number is extracted by recognition engine and recognition engine. Multifunctional system for monitoring area, crime prevention and intermittent car driving. In the area monitoring by digital PTZ, crime prevention, and intermittent vehicle interception,
A photographing control information including a pan angle, a tilt angle and a focal distance with respect to the surveillance area is set in a control section by setting a predetermined surveillance area in four intermittent high-resolution digital cameras installed at intervals of 90 degrees and photographing a 90 ° view image ;
The control unit photographs the surveillance zone and transmits the surveillance zone to the control server of the interception center;
The detected image display unit of the control server synthesizes the four 90 ° images received from the interception scene and displays the synthesized image as a real time panorama image, sets the detection area by reducing the resolution to a predetermined size,
The intermittent video display unit of the control server is a means for panning, tilting and zooming the received intermittent video in software instead of pan, tilt and zoom by mechanical driving using a camera motor When a violating vehicle is detected in the detection area, the camera moves to or enlarges to the detected pixel position using a forensic zoom technique and a super resolution technique. Then, the position of the license plate is detected by the license plate recognition algorithm, And displaying and storing the background image on the basis of the recognized license plate position;
Determining that the vehicle is an illegal car when the same vehicle number is recognized in the detection area after a predetermined management time after the first intermission;
The control server acquires the information of the borrower through the secondary inquiry server and sends the information to the fine paying server, and the fine paying server issues a notice of fines for the parking allowance to the borrower together with the received evidence data And a 360 degree multi-zone image monitoring method, a crime prevention method, and an intermittent multi-function interception method. 7. The method of claim 6, wherein the forensic zooming method displays and stores an area of interest by clicking an intermittent position with a digital PTZ control cursor in a semi-automatic intermittent mode, and performs area surveillance, Multifunctional interconnection method. 7. The method of claim 6, wherein the high resolution image restoration technique enlarges the image when the size of the vehicle is small using the image processing model, and shrinks when the size of the vehicle is large. Multifunctional interconnection method. 7. The method of claim 6, wherein the correction of the high-resolution digital PTZ camera is performed by displaying a correction pattern window on an image screen of an intermittent field and moving each line of the correction pattern window around the camera pinhole using a direction key or a mouse, The tilt angle, and the focal distance of the camera are obtained by moving the camera so as to coincide with the lane of the lane. 7. The method of claim 6, wherein the license plate recognition in the intermittent image display unit is performed by performing image preprocessing of the interrupted original image in order to remove noise and color contrast defect, perform binarization, a region object is created by performing a region boundary operation, a license plate area is extracted and corrected through a matching operation, and a car number is extracted by a license plate subdivision operation and a recognition engine. Area Monitoring by Crime Prevention, Crime Prevention, and Multifunctional Interconnection Method.

Images