KR101236266B1 - Manage system of parking space information - Google Patents

Abstract

PURPOSE: A system for managing parking space information is provided to grasp a parking situation of a parking lot on a real time basis, thereby providing images to a driver by using a driver terminal before the driver arrives at the parking lot. CONSTITUTION: A camera(110) photographs a parking lot, thereby transmitting the images. An administrator system(120) generate-manages parking space information by using image data transmitted from the camera. The administrator system provides the parking space information on a real time basis. A mobile terminal(130) requests the parking space information from the administrator system. The mobile terminal displays the parking space information. [Reference numerals] (110) Camera in a parking lot; (130) Mobile application; (AA) Real-time image frame; (BB) Information request; (CC,EE) Parking lot information; (DD) Administrator program; (FF) Server and database

Description

Parking Space Information Management System {MANAGE SYSTEM OF PARKING SPACE INFORMATION}

The present invention relates to a parking space information management system, and more particularly, to a parking space information management system that can grasp the parking state of a parking lot in real time and provide the image through a driver terminal before the driver arrives at the parking lot.

According to the statistics of the Korea Automobile Manufacturers Association, domestic cars owned more than 18 million cars in 2011. On the other hand, many drivers have difficulty in parking because they cannot accurately grasp the parking condition there until they arrive at the parking lot to park.

As an example, a parking system as shown in FIG. 1 is provided at an entrance to an indoor parking lot such as a large mart or a department store. However, the driver can determine the parking state only when the driver arrives at the parking lot. Although the parking system as shown in FIGS. 2 and 3 has been developed to enhance driver convenience, there is a fundamental problem in the 'accessibility of information' for parking available information. As a solution to this problem, there are some indoor parking lots that adopt ubiquitous systems (based on wireless network sensors). However, the construction cost is not only high, but the parking system is not easy to change, there is an inefficient problem.

On the other hand, the conventional patent technology relates to a parking management system by transmitting information to a control center in real time automatically whether a vehicle parked or exited a predetermined area, that is, a parking area display section in a roadside public parking lot division line or a parking lot. By storing the registered parking partitions or parking area features in the MPU memory in the control center computer or the camera module and digitally capturing or photographing the corresponding area at a predetermined time, the entry and exit of the vehicle within the corresponding area is coded. A system for wirelessly transmitting to a control center, the system comprising: camera means for photographing an image in a predetermined area in real time; Vehicle position recognizing means for recognizing the presence or absence of a vehicle located within a predetermined area by analyzing the captured image through an image; Conversion means for converting the video into moving or still image compression data, if necessary; RF wireless transmission means for wirelessly transmitting the recognized code data and image compression data; An electronic confirmation payment means for billing and identification through electronic money or a wireless mobile phone for payment and identification of a parked vehicle; Determination means for collecting, comparing and analyzing data of the vehicle recognition means and the payment means; And an unmanned management parking management system including a notification means for automatically notifying a result to a manager's mobile phone, PDA or computer (see Patent Document 1).

Patent Document 1: Domestic Patent No. 10-0383870

Accordingly, the present invention is to solve the above problems, while grasping the parking state of the parking lot in real time to provide a video in advance through the driver terminal before the driver arrives in the parking lot, but the construction cost is reduced and the change of the parking system is Its purpose is to provide a parking space information management system that is relatively easy to operate efficiently.

Parking space information management system according to the present invention to achieve the above object, the camera is installed in the parking lot to shoot and transmit the parking lot image; A manager system configured to provide parking space information in real time when the parking space information is requested by the mobile terminal while generating and managing parking space information regarding a vehicle parking state of each parking area of the parking lot through the image data transmitted from the camera; And a mobile terminal for receiving the parking space information from the manager system and receiving and displaying the information. The manager system generates the parking space information, wherein the background data and the vehicle data of the image frame transmitted from the camera are provided. A background modeling and separation algorithm of a codebook structure according to time series analysis is applied to extract the data, and the background modeling and separation algorithm comprises: collecting and learning codebook information for each pixel by a set number of frames; Filtering for pixels that are outside the learning threshold through the learned background codebook element; Removing noise through morphology operations (open, close); Separating the vehicle data by ignoring a polygon set having a predetermined size or less by separating the polygons having a predetermined threshold value through the convex hull algorithm for the result frame; And obtaining a center coordinate of the separated vehicle data.

delete

delete

Further, the manager system generates a parking space information according to whether the center coordinates of the acquired vehicle data and the coordinate area of the parking block overlap by executing the parking determination algorithm, wherein the parking determination algorithm is a vehicle separated between frames. If the center coordinate of the data is acquired and the parking block state is overlapped while the center coordinate of the vehicle data overlaps with the parking area, the vehicle is recognized as entering the parking block and the parking block state is changed from OFF to ON. And when the parking block state is ON while the center coordinates of the vehicle data overlap with the coordinate area of the parking block, recognizing that the vehicle is going out of the parking block and changing the parking block state from ON to OFF; If the parking block state is changed, the background modeling and separation algorithm may be executed again.

According to the present invention, by processing the image information obtained through a real-time video camera (CCTV, etc.) installed in each parking lot to determine the presence of the parking space of the parking lot, and generate the parking space information on the parking state and then with the schematic parking area By providing the driver to the driver in advance before arriving at the parking lot through the mobile terminal (smartphone), the driver can accurately grasp the parking status (parking location and available parking information) of the intended parking lot before the driver arrives at the parking lot. There is a number.

1 to 3 is a photograph showing a conventional parking system.
4 is a conceptual diagram showing a parking space information management system according to the present invention.
5 is a screen showing an administrator program according to the present invention,
6 is a screen showing a display application example program according to the present invention.
Figure 7 is an example of checking the parking space available through the mobile terminal according to the present invention.
8 is an example application of a smartphone according to the present invention.
9 is a flow diagram of a background modeling and separation algorithm in accordance with the present invention.
10 is a camera output screen example of the manager program according to the present invention.
11 is a flowchart of a parking determination algorithm according to the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

4 is a conceptual diagram illustrating a parking space information management system according to the present invention, FIG. 5 is a screen showing a manager program according to the present invention, FIG. 6 is a screen showing a display application example program according to the present invention, and FIG. According to the parking available space confirmation example through the mobile terminal, Figure 8 is an application example of the smart phone according to the present invention, Figure 9 is a flow chart of the background modeling and separation algorithm according to the present invention, Figure 10 is a camera output of the manager program according to the present invention Screen example, Fig. 11 is a flowchart of a parking determination algorithm according to the present invention.

The parking space information management system according to the present invention is to grasp the parking state of the parking lot in real time, so that the driver can provide the parking state of the parking lot as an image through the driver terminal before arriving at the parking lot. . In other words, by processing the image information acquired through real-time video cameras (CCTV, etc.) installed in each parking lot to determine the space presence of the parking lot and the final information (available space location) to the driver through the mobile terminal along with the corresponding parking area where the parking space is plotted. To provide.

Through this, the driver can accurately grasp the parking state of the desired parking lot in advance, before arriving at the parking lot.

As shown in FIG. 4, the parking space information management system according to the present invention includes a camera 110, a manager system 120, and a mobile terminal 130.

The camera 110 is installed in a predetermined parking lot as a normal video camera such as CCTV, serves to shoot and transmit the image of the parking lot in real time.

The manager system 120 includes a manager program, a server, a database, and the like for operation, and generates parking space information regarding a vehicle parking state for each parking area of the parking lot through the image data transmitted from the camera 110. Manage the role.

In this case, the manager system 120 may generate parking space information together with the illustrated parking area, and provide the corresponding parking space information together with the illustrated parking area in real time when the parking space information is requested. When the mobile terminal 130 requests the parking space information, the mobile terminal 130 provides the corresponding parking space information in real time.

The mobile terminal 130 accesses the manager system 120 and requests parking space information of a desired parking lot and receives and displays corresponding information. The mobile terminal 130 may be a smartphone (Android OS based) so that drivers can obtain information on various platforms.

In the meantime, the manager system 120 generates parking space information. Specifically, the manager system 120 generates a codebook structure based on time series analysis for extracting a background and a foreground of an image frame transmitted from the camera 110. Background modeling and separation algorithms can be applied. For reference, the foreground refers to an object that is a focus of interest at any one time, which corresponds to a vehicle in the present invention. Background refers to an object that lies outside the main interest (foreground).

Specifically, referring to FIG. 9, the background modeling and separation algorithm is described. First, a codebook for each pixel by the set number of frames (average 30 frames) of image data transmitted in units of frames through the camera 110 is described. Background information is collected by collecting the information (S110). The background learning refers to a data set obtained by accumulating or accumulating data (average value of brightness intensity, etc.) for each pixel between predetermined frames.

Subsequently, the pixel that is outside the learning threshold is filtered through the background-learned codebook element (S120).

Then, the noise is removed through a morphology operation (open, close) (S130).

Subsequently, the set of polygons having a predetermined size (line length) or less is ignored through a Convex Hull algorithm for the resulting frame, and the foreground, that is, vehicle data is separated by separating only polygons having a variable threshold or more (S140). Through this step, it is possible to partially determine that the object size or more relative to the image is the foreground, that is, the vehicle. In general, the size of the vehicle is clearly distinguished because it differs from the size of the person.

Finally, the center coordinates of the separated foreground (vehicle data) are obtained (S150).

On the other hand, the manager system 120 may execute the parking determination algorithm to generate parking space information according to whether the center coordinates of the foreground (vehicle data) obtained above and the coordinate area of the parking block overlap. For example, if you press the 'Start Detection' button in the Administrator program, the parking judgment algorithm is executed through the center coordinates of the foreground (vehicle data) every frame.

Referring to FIG. 10, when the manager program is executed, the manager displays the parking state of the current screen by clicking the left and right buttons of the mouse. It is only tried once. Left mouse (green) and right mouse (red) indicate the presence of a vehicle on the parking block and no vehicle, respectively. In the figure, blue is a diagram showing the presence of a vehicle, and the center coordinate of a moving vehicle (separated foreground) is black. And, each parking block is numbered sequentially for convenience.

Specifically, referring to the parking determination algorithm, the manager system 120 generates the parking space information according to whether the center coordinates of the acquired vehicle data overlap with the coordinate area of the parking block by executing the parking determination algorithm.

In this case, the parking determination algorithm, if the parking block state is OFF when the center coordinates of the vehicle data and the coordinate area of the parking block overlap, the vehicle is recognized as entering the parking block, and the parking block state is changed from OFF to ON. do.

However, if the parking block state is ON while the center coordinates of the vehicle data and the coordinate area (1 to n) of the parking block overlap, the vehicle is recognized as going out of the parking block and the parking block state is changed from ON to OFF. do.

A more detailed description with reference to FIG. 11 is as follows.

The center coordinates of the foreground and the coordinate area (1 ~ n) of each parking block overlap.

: Vehicle is in parking block.

→ If the parking block status is OFF and count_off count is less than the threshold (default 50), increase count_off by 1.

: Vehicle is entering the parking block.

→ When count_off count reaches 50, initialize the data of the corresponding parking block (eg count_off = 0) and change the parking state from OFF to ON.

→ If the parking block status is ON and count_on count is less than the threshold (default 10), increase count_on by 1.

: The vehicle is going out of the parking block.

→ When count_on is 10, initialize the data of the corresponding parking block and change the parking state from ON to OFF.

For reference, Count is a variable used in the actual implementation to measure time during overlap, count_on and count_off are variables used according to the current parking block state (on / off), and each default threshold is Appropriate threshold through experimental analysis of the algorithm (32-bit operating system).

If the initial values of count_on and count_off are 0, and the coordinates of the parking block and the center coordinate determined by the vehicle overlap, the count_name variable corresponding to the current parking block state is increased by 1 according to the result of each frame. Each parking block has a member variable of count_on / off, and when the state is changed, both member variables are initialized to zero.

Each parking block has a logically connected data structure, and each parking block is composed of member variables that can contain attributes (or values).

The parking space information may include the total number of parking blocks shown in the image input from the camera and the ON or OFF state of each parking block to which the sequential ID is assigned.

ON is when the vehicle in the parking block is parked, and OFF is when there is no vehicle in the parking block.

On the other hand, if the parking block state is changed, the background modeling and separation algorithm is re-executed at a low frequency (default 10 frames).

As described above, when the parking space information management system according to the present invention is applied, the image information acquired through a real-time video camera (CCTV, etc.) installed in each parking lot is processed to determine the presence or absence of the parking space of the parking lot and the parking state. After creating the space information and providing the driver with the schematic parking area before the driver arrives at the parking lot, the parking location of the parking lot to be parked before the driver arrives at the parking lot. And parking status information such as parking available information can be accurately identified in real time. Therefore, the driver's parking convenience can be improved.

On the other hand, while the parking space information management system according to the present invention has been described according to a limited embodiment, the scope of the present invention is not limited to the specific embodiment, it is within the scope obvious to those skilled in the art with respect to the present invention. Many alternatives, modifications and changes can be made.

Accordingly, the embodiments disclosed in the present invention and the accompanying drawings are not intended to limit the technical spirit of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by the embodiments and the accompanying drawings. . The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

110: camera
120: manager system
130: mobile terminal

Claims (4)

delete delete A camera 110 installed in the parking lot to photograph and transmit a parking lot image;
The manager provides parking space information in real time when the parking space information is requested from the mobile terminal while generating and managing parking space information on the vehicle parking state of each parking area of the parking lot through the image data transmitted from the camera 110. System 120;
After requesting the parking space information to the manager system 120 is made including a mobile terminal 130 to receive and display the information,
The manager system 120 generates parking space information,
In order to extract the background data of the image frame transmitted from the camera 110 and the vehicle data, a background modeling and separation algorithm of a codebook structure based on time series analysis is applied.
The background modeling and separation algorithm,
Collecting codebook information on each pixel by a set number of frames and performing background learning;
Filtering for pixels that are outside the learning threshold through the learned background codebook element;
Removing noise through morphology operations (open, close);
Separating the vehicle data by ignoring a polygon set having a predetermined size or less through the convex hull algorithm for the resulting frame and separating only polygons having a variable above a predetermined threshold;
Parking space information management system comprising the step of obtaining the center coordinates of the separated vehicle data. The method according to claim 3,
The manager system 120 generates a parking space information according to whether the center coordinates of the obtained vehicle data and the coordinate area of the parking block overlap by executing a parking determination algorithm.
The parking judgment algorithm,
If the center coordinates of the vehicle data separated between frames are secured and the center area of the vehicle data overlaps with the coordinate area of the parking block and the corresponding parking block state is OFF, the vehicle is recognized as entering the parking block and the parking block state Change from OFF to ON,
Changing the parking block state from ON to OFF when the center block of the vehicle data overlaps with the coordinate area of the parking block and the parking block state is ON, recognizing that the vehicle is going out of the parking block;
Parking space information management system comprising the step of re-executing the background modeling and separation algorithm if the parking block state changes.

Images