KR20200084946A - Smart cctv apparatus for analysis of parking - Google Patents

Abstract

The present invention relates to an intelligent CCTV device for analyzing a parking surface of a vehicle. According to one embodiment of the present invention, the intelligent CCTV device comprises: a photographing unit photographing a parking lot in which a plurality of parking surfaces on which vehicles can park are arranged; and an operation unit using a database for extracting a video or an image photographed from the photographing unit and characteristics of the parking surface and the vehicle to train a detection model for the parking of the vehicle on the plurality of paring surfaces based on an artificial neural network, and operating to output a result for the parking of the vehicle in the plurality of parking surfaces in accordance with the learned result. According to the present invention, such as installing a detection sensor on each parking surface to check whether the vehicle is parked on the parking surface of the parking lot, even without large-scale construction, a user can check whether the parking surface is used by using the video photographed by CCTV, and the system is simple, so that the use of the parking surface can be checked.

Description

Intelligent CCTV device for analyzing the parking surface of a vehicle{SMART CCTV APPARATUS FOR ANALYSIS OF PARKING}

The present invention relates to an intelligent CCTV device for analyzing the parking surface of a vehicle, and more specifically, an intelligent CCTV device for analyzing the parking surface of a vehicle that performs analysis on a real-time parking area based on an image captured through CCTV. It is about.

Parking is a place for vehicles to park. When parking a vehicle in such a parking lot, it is not easy for the driver to find a location in the vehicle where the vehicle is not parked on the parking surface of the parking lot. Therefore, in order to guide the driver to park quickly in the parking lot, a service is provided to guide the location where the parking surface is empty.

As a service for guiding the empty position of the parking surface, a technology for detecting presence of a vehicle on the parking surface using a detection sensor such as a geomagnetic sensor or an ultrasonic sensor is used. However, there may be a case where a person is standing on the parking surface or water is standing, or when there are other objects, an error such as a vehicle being displayed on the parking surface may occur.

In addition, since it is necessary to install a detection sensor for each parking surface, in the case of a large parking lot, there is a problem that requires continuous management, such as installing a detection sensor on a large scale and also replacing a battery for continuously supplying power to the detection sensor. .

Republic of Korea Registered Patent No. 10-1846063 (2018.03.30.) Republic of Korea Registered Patent No. 10-1556076 (2015.09.21)

The problem to be solved by the present invention is to provide an intelligent CCTV device for analyzing the parking surface of a vehicle that can determine whether parking is possible in real time by analyzing the presence or absence of a vehicle on the parking surface by analyzing a video taken by photographing a parking lot. will be.

An intelligent CCTV device according to an embodiment of the present invention includes: a photographing unit for photographing a parking lot on which a plurality of parking surfaces on which a vehicle can be parked is disposed; And using a database for extracting features of the parking surface and the vehicle and the images or images photographed on the photographing unit to learn a detection model for parking of the vehicle on the plurality of parking surfaces based on an artificial neural network, It may include a calculation unit for outputting a result of whether the vehicle is parked on the plurality of parking surfaces according to the learned results.

The calculation unit extracts a category feature for whether or not the vehicle is parked on each of the plurality of parking surfaces using a database, learns a detection model for each parking surface using the extracted category feature, and the learned detection model It is possible to obtain an image or image of whether a vehicle is parked on each of the parking surfaces by using to calculate a result of whether the vehicle is parked on the plurality of parking surfaces.

The calculation unit may calculate whether a vehicle is parked on the plurality of parking surfaces using a restricted Boltzmann machine model.

The calculation unit learns a detection model for the type of the vehicle based on the artificial neural network by using a database for extracting features of the image or image captured by the photographing unit and the type of the vehicle, and the learned result Depending on the result of the vehicle type can be calculated.

The photographing unit may include one or more camera modules for photographing at least one of day and night.

According to the present invention, whether to use the parking surface by using a video captured by CCTV without large-scale construction, such as installing a detection sensor on each parking surface to check whether the vehicle is parked on the parking surface of the parking lot Since it can be checked, it is easy to check whether the parking surface is used or not.

In addition, through deep learning, it is possible to check the type of vehicle parked on the parking surface, so it is possible to guide and check the use of the parking surface according to the type of vehicle, so that the corresponding parking surface can be guided according to the type of vehicle. It is possible to guide the parking of the vehicle more accurately.

1 is a block diagram showing a CCTV system including an intelligent CCTV device according to an embodiment of the present invention.
2 is a view for explaining a concept for performing deep learning in a CCTV system according to an embodiment of the present invention.
3 is a view for explaining an example of performing deep learning in a CCTV system according to an embodiment of the present invention.
4 is a view for explaining an example of a vehicle parked in a parking lot in a CCTV system according to an embodiment of the present invention.
5 is a view for explaining the parking of the vehicle according to the type of parking lot in the CCTV system according to an embodiment of the present invention.

With reference to the accompanying drawings, a preferred embodiment of the present invention will be described in more detail.

1 is a block diagram showing a CCTV system including an intelligent CCTV device according to an embodiment of the present invention. 2 is a diagram for explaining a concept for performing deep learning in a CCTV system according to an embodiment of the present invention, and FIG. 3 is a diagram illustrating an example of performing deep learning in a CCTV system according to an embodiment of the present invention It is a drawing for.

Referring to FIG. 1, a CCTV system 100 including an intelligent CCTV device 110 according to an embodiment of the present invention includes a CCTV device 110 and an administrator terminal 120.

The CCTV device 110 photographs a plurality of parking surfaces of the parking lot 200 and analyzes the captured images to analyze whether a vehicle is parked on the parking surface. In addition, in this embodiment, the CCTV device 110 may analyze the type of vehicle parked on the parking surface, and may also perform analysis on the number of vehicles. To this end, the CCTV device 110 includes a photographing unit 111, a calculation unit 113, and a storage unit 115.

The photographing unit 111 may perform photographing during the day or at night. That is, the photographing unit 111 may include a camera for daytime shooting and an infrared camera for nighttime shooting.

In the present embodiment, the photographing unit 111 describes a fixed location of the CCTV device 110 fixed to one side of the parking lot 200 so as to photograph the parking surface of the parking lot 200 while fixing a specific location. , It is not limited thereto, and the CCTV device 110 may be configured to rotate or move, and the photographing unit 111 may continuously photograph while the CCTV device 110 rotates or moves.

The imaging unit 111 may include one or more camera modules to capture an image.

The calculation unit 113 performs analysis on the image photographed by the photographing unit 111. To this end, the calculation unit 113 is based on deep learning to recognize the parking surface of the parking lot 200, a parking surface learning model, vehicle information extracted from collected video images, and whether to use the parking surface in connection with the parking surface learning model. The analysis can be performed through a program capable of analyzing information that can discriminate.

Therefore, the operation unit 113 may be configured with hardware including computing resources (CPU, GPU, RAM, storage, etc.) to perform analysis through the above-described program. In addition, information on the type of the vehicle, a parking surface learning model, and an analysis program may be stored in the storage device included in the calculation unit 113.

The storage unit 115 stores the results calculated by the calculation unit 113. The storage unit 115 may be provided separately from the storage device of the calculation unit 113, and in some cases, may be a storage device of the calculation unit 113.

In the first step, the calculation unit 113 is constructed with a database for extracting features of the parking surface and the vehicle of the parking lot 200. Then, as a second step, for the learning based on the artificial neural network, a category feature of whether a vehicle is parked on a parking surface is extracted from a database. Then, in the third step, the detection model of the parking surface is trained using the category feature of whether the vehicle is parked. In the fourth step using the learned detection model, it is possible to extract whether the vehicle is parked on the parking surface. At this time, the learned detection model can secure an image or an image for a case where a vehicle is parked on a parking surface and a case where the vehicle is not parked.

At this time, in the third step, the process of learning the detection model of the parking surface includes various weather changes (for example, snow or rain) or time changes that may occur in the parking lot 200 (day and day as the time changes). You can learn the detection model for the parking surface through various images or videos of changes in the night.

And in the fourth step, it is detected whether the actual parking surface is used by using the video image of the actual parking lot 200, and if an error occurs, it is possible to reduce the error by repeating again from the second step. Accordingly, the calculation unit 113 can secure information on whether the vehicle is finally parked on the parking surface, and can also check information on the parked vehicle.

Here, the artificial neural network (ANN) used in the second step refers to a statistical learning algorithm inspired by a neural network of biology in machine learning and cognitive science. An artificial neural network may mean an entire model having a problem-solving ability by changing the intensity of synaptic binding through learning of artificial neurons (nodes) that form a network through synaptic coupling.

In this embodiment, a restricted Boltzmann machine model among artificial neural network models may be used. The limited Boltzmann machine model is a model proposed by Geoff Hinton as an algorithm that can be used for dimensionality reduction, classification, linear regression analysis, collaborative filtering, feature learning, and topic modeling.

The limited Boltzmann machine model consists of a visible layer and a hidden layer, the visible layer includes a number of visible nodes, and the hidden layer includes a number of hidden nodes. And, hidden nodes located in all hidden layers are connected to visible nodes located in the visible layer, and visible nodes in all visible layers are connected to hidden nodes in the hidden layer. That is, in the limited Boltzmann machine model, nodes on the same layer are not connected to each other, but to nodes on other layers.

The visible node of the visible layer makes a stochastic decision on how much the hidden data will be transmitted when the data is input. That is, it is displayed as 1 when it is determined that the input data is to be transmitted according to probability, and 0 when it is determined that the data is not to be transmitted.

Referring to FIG. 2, when input data v is input to the visible node i of the visible layer, a multiplication value of input data of the visible node and a weight wij is added to each other. Then, it is sampled as a value of 0 or 1 through an active function (eg, a sigmoid function), and an output value h is output to the hidden node j.

The limited Boltzmann machine model learns important features of the input data by adjusting weights through unsupervised learning. Here, the weight is input data (v), the output value (h) of the hidden node, the corrected input data (v') calculated through the reconstruction process, and the corrected output value (h) calculated through the regeneration process. It can be adjusted by calculating the error value (v'h'-vh) from').

Referring to FIG. 3, an example of adjusting the weight in the limited Boltzmann machine model will be described. As shown in (a) of FIG. 3, in the reconstruction process, the multiplication values of the output value (h) and the weight (w _ji ) of each hidden node (j) of the hidden layer are summed, and then pass through the active function to 0 or It is sampled with a value of 1 and output as input data v'corrected at the input node i.

As shown in (b) of FIG. 3, the multiplication value of the corrected input data (v') of the visible node (i) and the weight (w _ij ) in the reproducing process is summed with each other, and then passes through the active function to become 0 or 1 It is sampled as a value and output as the corrected output value (h') from the hidden node (j) again.

Accordingly, calculation of the output value h, the corrected input data v', and the corrected output value h'can be expressed as Equation 1, Equation 2, and Equation 3, respectively.

[Equation 1]

[Equation 2]

[Equation 3]

Here, P is the sampling function, h _cj is the output value of the hidden node (j) for the input case (c), N _v is the number of visible nodes, v _ci is the input case (c) input as the visible node (i) The input data of, w _ij is the weight between the visible node (i) and the hidden node (j), b ^h _j is the input bias value of the hidden node (j), σ is the active function (e.g., a logistic function) to be.

And N _h is the number of hidden nodes, h _cj is the output value of the input case (c) output from the hidden node (j), w _ji is the weight between the hidden node (j) and the visible node (i), b ^h _i Is the output bias value of the visible node (i), _h'cj is the corrected output value of the hidden node (j) for the input case (c).

The weight (w _ij ), output bias (b _h ), and input bias (b _v ) are input using the calculated output value (h), corrected input data (v'), and corrected output value (h'). It can be corrected to learn the characteristics of the data, and the correction of the weight, output bias and input bias can be corrected by Equation 4, Equation 5 and Equation 6.

[Equation 4]

[Equation 5]

[Equation 6]

Here, N _c is the number of input cases constituting the input arrangement, ε is the learning rate (learning rate). In order to increase computation time and learning efficiency in an artificial neural network, weight correction is performed based on an input batch, which is a set of input cases (c) composed of a plurality of input data.

In the present embodiment using the limited Boltzmann machine model as described above, as input data, an image or an image of an image photographed by the photographing unit 111 may be input. In addition, information about whether the vehicle is parked may be output by deep learning whether the vehicle is parked on the parking surface using the image or image input from the operation unit 113.

In other words, as an example, an image or image photographed by the photographing unit 111 is input to input data v input to the visible node i of the visible layer, and a vehicle is parked on the parking surface from the input image or image. When the value is 1, a value of 1 is output as the output value h of the hidden node j, and when the vehicle is not parked on the parking surface, a value of 0 can be output as the output value h of the hidden node j. And it can be learned while going through the process shown in Figure 3 (a) and 3 (b) to output the result of whether the vehicle is parked on the parking surface.

4 is a view for explaining an example of a vehicle parked in a parking lot in a CCTV system according to an embodiment of the present invention, and FIG. 5 is a vehicle according to the type of parking lot in a CCTV system according to an embodiment of the present invention It is a diagram for explaining the guidance of parking.

As shown in FIG. 4, the CCTV device 110 according to the present exemplary embodiment may distinguish between a case where the vehicle 300 is parked on a parking surface in the parking lot 200 and a case where the vehicle is not parked, and the CCTV device 110. ) Indicates that the vehicle 300 is parked on four of the six parking surfaces, and that the vehicle 300 is not parked on the two parking surfaces. In addition, the detected information may be transmitted to the manager terminal 120, and the manager terminal 120 may display information so that the driver of the vehicle 300 can check the information.

In addition, as shown in FIG. 5, when various vehicles 300 are separated in the parking lot 200, the CCTV device 110 checks information on the type of the vehicle 300 parked on the parking surface, and , It is possible to check information on the type of the vehicle 300 to be parked. That is, when the vehicle 300 entering the parking lot 200 is a general vehicle, it is possible to guide the general parking surface 210 where the general vehicle can park. In addition, when the vehicle 300 entering the parking lot 200 is an electric vehicle for electric charging, it is possible to guide the electric vehicle parking surface 220 for the electric vehicle.

In addition, when the vehicle 300 entering the parking lot 200 is a disabled vehicle, it is possible to guide the disabled parking surface 230 where the disabled vehicle can park.

That is, in this embodiment, the CCTV device 110 is input data (v) input to the gas node (i) of the visible layer through the deep learning process described in Figure 3 (a) and Figure 3 (b) An image or video captured by the CCTV device 110 is input, and the input image or video may be information about the vehicle 300. Therefore, an image or image of the vehicle 300 entering the parking lot 200 may be input as input data v to output a result of the type of the vehicle 300. Accordingly, the type of the corresponding vehicle 300 can be checked, and in this embodiment, the type of the vehicle 300 that can be checked is a light vehicle, a small sedan, a medium-sized sedan, a large sedan, a small SUV, a medium-sized SUV, and a large SUV. You can check the type of lamp, and whether it is an electric vehicle.

And in this embodiment, the CCTV device 110, it is possible to check whether the vehicle 300 is disabled registration certificate is exposed on the front of the vehicle 300. Accordingly, when it is detected that the disabled registration certificate is disposed on the front of the vehicle 300, it is determined that the vehicle is disabled and the corresponding information may be transmitted to the manager terminal 120 to guide the disabled parking surface 230.

As described above, the detailed description of the present invention has been made by the embodiments with reference to the accompanying drawings, but the above-described embodiments are only described as preferred examples of the present invention, and the present invention is limited to the above-described embodiments only. It should not be understood, and the scope of the present invention should be understood as the claims and the equivalent concept described below.

100: CCTV system
110: CCTV device
111: filming unit
113: operation unit
115: storage
120: administrator terminal
200: parking lot
210: normal parking
220: Electric vehicle parking surface
230: handicapped parking
300: vehicle

Claims (5)

A photographing unit for photographing a parking lot on which a plurality of parking surfaces capable of parking a vehicle are disposed; And
Learning and detecting a detection model for whether a vehicle is parked on the plurality of parking surfaces based on an artificial neural network by using an image or image photographed on the photographing unit and a database for extracting features of the parking surface and the vehicle. Intelligent CCTV device including a calculation unit to output a result of whether the vehicle is parked on the plurality of parking surfaces according to the result. The method according to claim 1,
The calculating unit extracts a category feature for whether or not the vehicle is parked on each of the plurality of parking surfaces using a database, learns a detection model for each parking surface using the extracted category feature, and the learned detection model An intelligent CCTV device that calculates the result of whether a vehicle is parked on the plurality of parking surfaces by securing an image or a video of whether the vehicle is parked on the respective parking surfaces by using. The method according to claim 1,
The calculation unit, an intelligent CCTV device for calculating whether a vehicle is parked on the plurality of parking surfaces using a restricted Boltzmann machine model. The method according to claim 1,
The calculation unit learns a detection model for the type of the vehicle based on the artificial neural network by using a database for extracting features of the type of the vehicle and the image or image photographed by the imaging unit, and the learned result Intelligent CCTV device to calculate the results for the type of vehicle according to. The method according to claim 1,
The photographing unit, an intelligent CCTV device including at least one camera module for shooting at least one of day and night.

Images