KR20220000226A - A system for providing a security surveillance service based on edge computing - Google Patents

Abstract

The present invention relates to a system for providing a security surveillance service based on edge computing. According to an embodiment of the present invention, the system, in a system for providing an intelligent security surveillance service, comprises: one or more camera devices and sensor devices; one or more intelligent security surveillance devices detecting one or more security surveillance events occurring in a security surveillance region based on image information and sensor information, and performing the surveillance service processing corresponding to the detected events; one or more deep learning dispersion processing devices placed for the one or more intelligent security surveillance devices, and connected for communication to be able to perform dispersion processing of information, and performing the deep learning-based object detection and object classification analysis on the data requested for deep learning dispersion processing from the intelligent security surveillance devices, and transmitting the deep learning analysis result to the relevant intelligent security surveillance device; a server relaying the image surveillance analysis data to a user terminal and a control service server; and the control service server performing the processing of various control services such as accident occurrence report, fire occurrence report, user alert, surveillance device control, and real-time monitoring based on the event detection data of each intelligent security surveillance device received through the relay server and the deep learning image analysis information received from each deep learning dispersion processing device, and transmitting the service execution information to the user terminal. The present invention aims to provide a system for providing a security surveillance service based on edge computing, which is capable of precisely detecting events.

Description

Edge computing-based intelligent security monitoring service providing system {A SYSTEM FOR PROVIDING A SECURITY SURVEILLANCE SERVICE BASED ON EDGE COMPUTING}

The present invention relates to a security service providing system. More specifically, the present invention relates to an edge computing-based intelligent security monitoring service providing system that improves monitoring performance and system efficiency by providing a security service based on edge (EDGE) computing.

With the development of current communication and video analysis technology, various security systems are provided that provide security for the area to be monitored through image analysis and object identification of images received from remote cameras for security in the area to be monitored. Through this, when an object is detected in the area to be monitored, various services are provided, such as notifying the manager whether there is a danger and recording an image according to the detection of the object, thereby increasing the convenience of managing the area to be monitored.

In general, a security monitoring system detects a monitoring target located in the monitoring target area through a sensor located in the monitoring target area, and when a monitoring target is detected, the monitoring target is captured by a camera in conjunction with the detection of the monitoring target. By providing the image, it is provided so that the monitoring target detected through the sensor can be confirmed through the image.

However, when an intrusion signal is generated according to the detection of a sensor for the monitoring target of the existing security monitoring system, an alarm is provided to the administrator separately from the confirmation through the video. There is a problem that misinformation constantly occurs.

To prevent this, a recent security monitoring system is set to operate so that an alarm is provided to the administrator when a monitoring target object corresponding to the monitoring target is identified in the image captured by the camera when an intrusion signal is generated through the sensor along with the detection of the sensor This is to minimize false information in the security system.

However, the area to be monitored generally has a low-light environment, and for this reason, even in recent security systems, when the sensor detects the object to be monitored, the object does not appear clearly in the image generated by the camera operating in the low-light environment, so the object is not the object to be monitored. Even when an alarm is provided or a monitoring target object appears, the report is frequently omitted because the monitoring target object is not identified through the video, so there is a problem in that the false information rate cannot be significantly improved.

Due to the above-mentioned problems, there is a problem that reliability and accuracy are lowered according to the intrusion detection report of the surveillance target area of the security monitoring system, and to solve this problem, an image analysis method based on deep learning analysis has been proposed.

However, since a lot of computing resources are consumed for deep learning analysis processing, a deep learning analysis device or server is often located in a separate remote location connected to an external network. Accordingly, object classification and accurate event detection are possible only after the image information is analyzed through the deep learning analysis server, so there is a problem that not only computing cost but also the most important time resource in the security monitoring system is consumed.

As a result, it delays the operation of the monitoring equipment installed in the field, and in reality, only the urgent alarm function based on a simple sensor has to be processed first before the deep learning analysis is completed, so there is a problem that the false alarm rate is still the same.

The present invention was devised to solve the above problems, and the security monitoring device installed in the field is configured as an intelligent security monitoring device to build an artificial intelligence-based local video monitoring system, but the tracking data requiring deep learning analysis is Edge computing-based security monitoring service providing device, system and An object of the present invention is to provide a method of operation thereof.

A system according to an embodiment of the present invention for solving the above problems is disposed in a security monitoring area and photographing the security monitoring area, or by sensing a detection signal generated in or around the security monitoring area, image information and one or more camera devices and sensor devices for acquiring sensor information; It is connected to the camera and sensor devices through a local monitoring network, collects, stores and manages image information and sensor information received from the camera device and sensor device, and based on the image information and sensor information, one or more generated in a security monitoring area. The security monitoring event is detected, but the deep learning distributed processing request data is generated for the first security monitoring event detected by basic information analysis and the image requiring complex deep learning analysis and delivered to the deep learning distributed processing device, an intelligent security monitoring device that receives and reflects the deep learning processing result information from the learning distributed processing device, detects a second security monitoring event, and performs monitoring service processing corresponding to the detected event; One or more of the one or more intelligent security monitoring devices are arranged and connected to enable distributed processing of information, and deep learning distributed processing requests that require more accurate analysis through accurate detection and classification of objects from the intelligent security monitoring devices A deep learning distributed processing device that receives data, performs deep learning-based object detection and object classification analysis, and transmits the deep learning analysis result to the corresponding intelligent security monitoring device to detect a security monitoring event that reflects the deep learning analysis information result information Wow; It collects, stores, and manages video monitoring analysis data from intelligent security monitoring devices installed in various places, and relays the deep learning video analysis results received from the deep learning distributed processing device and the video monitoring analysis data to user terminals and control service servers. server to; And based on the event detection data of each intelligent security monitoring device received through the relay server and the deep learning image analysis information received from each deep learning distributed processing device, accident occurrence report, fire occurrence report, user notification, monitoring device control, real-time It includes a control service server that performs various control service processing such as monitoring and transmits service performance information to a user terminal.

According to an embodiment of the present invention, there is provided a method for operating an intelligent security monitoring apparatus, the method comprising: collecting image information for security monitoring; acquiring tracking data for tracking an object of the image information according to an initial analysis process for the image information; generating deep learning distributed processing request data based on the tracking data and the image information; and transmitting the deep learning distributed processing request data to a deep learning distributed processing device.

In addition, the intelligent security monitoring apparatus includes: an image information collecting unit for collecting image information for security monitoring; an object tracking unit configured to acquire tracking data for tracking an object of the image information according to an initial analysis process for the image information; and a distributed data processing unit for generating deep learning distributed processing request data based on the tracking data and the image information, and transmitting the deep learning distributed processing request data to a deep learning distributed processing apparatus.

In addition, an apparatus according to an embodiment of the present invention for solving the above-described problems, an intelligent camera device, comprising: a camera unit for capturing a real-time image to obtain; an image information stabilization unit for stabilizing the real-time image received from the camera unit into image information for security monitoring; an object tracking unit configured to acquire tracking data for tracking an object of the image information according to an initial analysis process for the image information; and a distributed data processing unit for generating deep learning distributed processing request data based on the tracking data and the image information, and transmitting the deep learning distributed processing request data to one or more deep learning distributed processing devices.

On the other hand, the method according to an embodiment of the present invention for solving the above problems may be implemented as a program for executing the method in a computer and a recording medium in which the program is recorded.

According to an embodiment of the present invention, a security monitoring device installed in the field is configured as an intelligent security monitoring device to construct a primary AI-based video monitoring system, but only monitoring data requiring deep learning analysis is processed into distributed data. Provides an edge computing-based security monitoring service providing device, system, and operating method that can minimize system delay and error rate due to accurate event detection by requesting and processing analysis with an edge computing-based deep learning distributed processing device can do.

1 is a conceptual diagram schematically illustrating an entire system according to an embodiment of the present invention.
2 is a block diagram illustrating in more detail the configuration and connection relationship of an intelligent monitoring device and a deep learning distributed server according to an embodiment of the present invention.
3 is a block diagram illustrating a detection module of an event detection unit according to an embodiment of the present invention.
4 is a ladder diagram for explaining the overall system operation according to an embodiment of the present invention.
5 is a conceptual diagram illustrating an intelligent camera device-based system according to another embodiment of the present invention.
6 is a block diagram illustrating in more detail the configuration and connection relationship of a deep learning analysis system implemented with an intelligent camera device according to an embodiment of the present invention.

The following is merely illustrative of the principles of the invention. Therefore, those skilled in the art will be able to devise various devices that, although not explicitly described or shown herein, embody the principles of the present invention and are included within the spirit and scope of the present invention. Further, it is to be understood that all conditional terms and examples listed herein are, in principle, expressly intended solely for the purpose of enabling the concept of the present invention to be understood, and not limited to the specifically enumerated embodiments and states as such. should be

Moreover, it is to be understood that all detailed description reciting the principles, aspects, and embodiments of the invention, as well as specific embodiments, are intended to cover structural and functional equivalents of such matters. It should also be understood that such equivalents include not only currently known equivalents, but also equivalents developed in the future, i.e., all devices invented to perform the same function, regardless of structure.

Thus, for example, the block diagrams herein are to be understood as representing conceptual views of illustrative circuitry embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, etc. may be tangibly embodied on computer-readable media and be understood to represent various processes performed by a computer or processor, whether or not a computer or processor is explicitly shown. should be

In addition, the clear use of terms presented as processor, control, or similar concepts should not be construed as exclusively referring to hardware having the ability to execute software, and without limitation, digital signal processor (DSP) hardware, ROM for storing software. It should be understood to implicitly include (ROM), RAM (RAM) and non-volatile memory. Other common hardware may also be included.

The above objects, features and advantages will become more apparent through the following detailed description in relation to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the present invention pertains can easily implement the technical idea of the present invention. There will be. In addition, in the description of the present invention, if it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram schematically illustrating an entire system according to an embodiment of the present invention.

1 , the entire system according to an embodiment of the present invention includes an intelligent security monitoring device 100, a user terminal 200, a deep learning distributed processing device 300, a relay server 400, a control service server ( 500 ), one or more camera devices 600 , and one or more sensor devices 700 .

The camera device 600 and the sensor device 700 may be disposed in a security monitoring area, and may be connected to the intelligent security monitoring device 100 through a local monitoring network. The camera device 600 and the sensor device 700 each photograph a security monitoring area or sense a detection signal generated in or around the security monitoring area to obtain image information and sensor information, and obtain image information and a sensor The information is transmitted to the intelligent security monitoring device 100 .

The intelligent security monitoring device 100 may collect, store, and manage image information and sensor information received from the camera device 600 and the sensor device 700, and is generated in a security monitoring area based on the image information and sensor information It is possible to detect one or more security monitoring events, and perform monitoring service processing corresponding to the detected event.

Here, the monitoring service processing may be exemplified by an alarm message transmission service to the user terminal 200 corresponding to the generated event, an alarm notification function operation or cancellation service, a status information transmission service to the control service server 500 , and the like.

For this monitoring service processing, the intelligent security monitoring device 100 may be connected to the relay server 400, the control service server 500, or the user terminal 200 through a wired/wireless network, and the intelligent security monitoring device 100 is One or more wired/wireless communication modules for performing communication through the wired/wireless network may be provided. Various well-known communication methods may be applied to the wired/wireless communication network.

In addition, the intelligent security monitoring apparatus 100 may include one or more information processing modules and information analysis modules for detecting an event by analyzing image information and sensor information.

In addition, the intelligent security monitoring apparatus 100 may detect predetermined first monitoring events based on the initial analysis information according to information processing and analysis, but the second detection and classification of objects that require more accurate analysis For the monitoring event, separate deep learning analysis processing may be processed in conjunction with one or more deep learning distributed processing devices 300 .

Here, the first monitoring event and the second monitoring event may be grouped according to whether or not deep learning analysis is processed, and the first monitoring event is an intrusion event that is quickly detected according to the initial analysis of sensor information and image information, and an unauthorized camera change event. , fire occurrence event, etc. may be exemplified, and the second monitoring event is a dynamic object tracking event accompanied by accurate object detection and classification information according to deep learning analysis, a trip wire event, a wandering object detection event, a traffic direction violation detection event, Unauthorized object detection event, unauthorized moving object detection event, access counting and statistical event, crowd density detection event, unusual behavior detection event, etc. may be exemplified.

However, since this is an example, it may be possible to detect more various events according to monitoring criteria and object classification settings, and the first monitoring event and the second monitoring event may be complexly detected and used to provide a rapid composite monitoring service. For example, the intelligent security monitoring apparatus 100 transmits the initial analysis information according to the occurrence of the first monitoring event to the control service server 500 or the user terminal 200 through the relay server 400 first, and 1 According to the result of deep learning analysis of video information within a certain time range related to the monitoring event, a second monitoring event is detected as detailed analysis information for the first monitoring event, and a control service server ( 500) or the user terminal 200 may provide the second monitoring event information.

Accordingly, the intelligent security monitoring device 100 can not only quickly process the basic monitoring service processing according to the first monitoring event, but also deep dive of distributed data for the data initially analyzed and processed in the intelligent security monitoring device 100 . Since only the learning analysis processing is requested and processed by a separate specialized deep learning distributed processing device 300, the occurrence of the second monitoring event, which is provided only when more accurate object classification is possible, can also be quickly detected according to the distributed processing of data. there will be

To this end, the intelligent security monitoring device 100 configures distributed data corresponding to image information requiring deep learning analysis for the second event detection processing, and transmits a deep learning analysis processing request to the deep learning distributed processing device 300 . can

More specifically, the intelligent security monitoring device 100 processes the initial analysis information capable of detecting a first event on the collected image information, and tracking data for tracking an object corresponding to the image information from the initial analysis information. can be obtained

For example, the initial analysis processing may include at least one of image stabilization processing, background modeling processing, shape calculation processing, element connection processing, and object tracking processing, and the tracking data is, for example, from image information to a foreground pixel. may include object tracking data that is separated and filtered, and the connected component is labeled and processed into visual transformation.

The intelligent security monitoring device 100 may generate deep learning distributed processing request data based on the tracking data and the image information, and transmit the deep learning distributed processing request data to the deep learning distributed processing device.

The deep learning distributed processing device 300 may be composed of one or more devices connected through a network to perform edge computing, and according to the deep learning distributed processing request data, the tracking data and the image information Deep learning analysis can be processed, and deep learning analysis result information can be delivered to the intelligent security monitoring device 100 . More specifically, the deep learning analysis result information may include object detection information and object classification information corresponding to the tracked object.

Such object detection information and object classification information may be, for example, dynamic object information identified according to a pattern such as moving or operating in a specific direction from pre-accumulated image information, and the intelligent security monitoring device 100 . may detect a second monitoring event corresponding to the image information based on the object detection information, the object classification information, and the tracking data.

On the other hand, the deep learning distributed processing device 300 processes the deep learning image analysis according to the deep learning distributed processing request data received from the intelligent security monitoring device 100, and transmits the result information to the intelligent security monitoring device 100 It can be delivered, and further, the deep learning image analysis information can also be transmitted to the relay server 400 .

The deep learning distributed processing device 300, based on the deep learning distributed processing request data, generally operates in a low-illumination environment, and an image for a video generated when a monitoring target is detected through a sensing signal of a sensor Even when an object is detected during the analysis process, it is difficult to identify the object, so it generates and reports an event for an object other than the object to be monitored. Deep learning analysis can be processed to improve problems with an increase in false positives, such as when a report is omitted according to the detection of a target.

The deep learning distributed processing device 300 continuously learns the characteristics of the monitoring target object appearing in the environmental characteristics (environmental conditions) of the monitoring target area through deep learning to increase the identification accuracy of the monitoring target object, and at the same time, the monitoring target object By continuously learning the image characteristics of the identified image to determine the optimal image for easy object identification, and by selecting and providing an image in which the object to be monitored is accurately identified, the object to be monitored is accurately distinguished from other objects and supported to obtain deep learning analysis result information that lowers the false alarm rate and prevents the case of missing a report when a monitoring target is detected, and provides the analysis result information to the intelligent security monitoring device 100 or the relay server 400 have.

Here, the relay server 400 collects, stores and manages video surveillance analysis data from the intelligent security monitoring devices 100 installed in various places, and the deep learning image analysis result received from the deep learning distributed processing device 300 . and a server that relays the video monitoring analysis data to the user terminal 200 and the control service server 500 .

When the event detection data of the intelligent security monitoring device 100 is received, the relay server 400 indexes the deep learning image analysis information corresponding to the event detection data in response to the intelligent security monitoring device 100. It may be a server that transmits deep learning image analysis information corresponding to the event detection data to the pre-registered user terminal 200 .

In addition, the event detection data and deep learning image analysis information may be transmitted to the control service server 500 , and the control service server 500 reports an accident occurrence based on the event detection data and deep learning image analysis information, fire occurrence Various control service processing such as reporting, user notification, monitoring device control, and real-time monitoring may be performed, and service performance information may be transmitted to the user terminal 200 .

2 is a block diagram illustrating in more detail the configuration and connection relationship of an intelligent monitoring device and a deep learning distributed server according to an embodiment of the present invention.

Referring to FIG. 2 , the intelligent security monitoring apparatus 100 according to an embodiment of the present invention includes an image information collection unit 110 , a background modeling unit 120 , a shape calculation processing unit 130 , and an element connection processing unit 140 . , may include an object tracking unit 150, a 3D viewpoint transformation unit 160, an object classification processing unit 170, an event detection unit 180, a distributed data processing unit 190 and a monitoring service processing unit 185, and distributed The data processing unit 190 may be connected to the deep learning distributed processing apparatus 300 .

In addition, the deep learning distributed processing apparatus 300 may include a deep learning-based image information analysis unit 310 , an object detection unit 320 , and an object classification processing unit 330 .

First, the image information collecting unit 110 collects the security monitoring area sensing information received from the sensor device 700 and the security monitoring area captured image data received from the camera device 600, and includes the image data captured by the camera. When there is shake in the frame, image information stabilization according to shake correction can be processed. Here, the stabilization process may be exemplified by dividing an image captured by the camera into blocks, extracting feature points, and obtaining a stable image by correcting image shake by calculating a motion vector of the feature points.

In addition, the background modeling unit 120 may model the background region corresponding to the image information that has been stabilized. A plurality of camera devices 600 may be provided, and the background modeling unit 120 may model a background of an image for each image area captured by each camera device 600 . The background modeling unit 120 may identify an object corresponding to the foreground according to the background modeling and calculate background area data to be tracked.

The background modeling unit 120 may generate a background probabilistic model based on a well-known Gaussian Mixutre Model from image data so as to accurately detect an object in a complex environment. This makes it possible to create background area data by reflecting many variables such as changes in lighting, objects added or removed to the background, backgrounds with motion such as swaying branches or fountains, and areas with high traffic.

More specifically, when successive image frames are input from image information of the camera device 600 , the background modeling unit 120 may construct a background model per pixel according to a statistical probability for time t through background subtraction processing. The background modeling unit 120 subtracts the background information constructed according to the Gaussian mixture model from the image information of the current frame, and accumulates and updates the background information to the background model per pixel according to the MOG (Mixtrue of Guassians) method. Subtraction processing may be performed.

According to the background subtraction process of the background modeling unit 120, foreground pixel information remains in the image information from which the background is subtracted. This may be referred to as a blob image, and the blob image is binary map data corresponding to the foreground pixel. It can also be said that

The shape calculation processing unit 130 may perform shape calculation processing to determine shape region information from binary map data of foreground pixel information that is subtracted and output according to the background modeling by the background modeling unit 120 . The shape region information may be grouping information for grouping a plurality of pixels into one or more shape structure elements.

For example, the shape calculation processing unit 130 may determine the shape region information by applying one or more morphological calculation filters to the binary map data of the foreground pixel information. Here, the one or more morphological operation filters may include a binary erosion operation filter and a binary dilation operation filter, where each filter determines the size of a bright region in the binary map data and information on the size of a predetermined morphological structure element. It is possible to perform arithmetic processing of expanding or reducing in proportion to . When the expansion operation filter is applied, dark areas smaller than the shape structure element are removed, and when the erosion operation filter is applied, the bright areas smaller than the shape structure element can be removed, and at the same time, the size of large areas that are not removed is also reduced or increased. can be

And, in order to detect an object of a pre-specified size, the shape operation processing unit 130 uses a binary open filter and a closed filter to remove only small areas while maintaining the size of a larger area than the shape structure element. can also be performed.

Then, the element connection processing unit 140 acquires image information corresponding to the shape structure element specified by the shape operation processing unit 130 , and classifies the shape structure elements into independent object connection regions by linking and classifying them. Connection component labeling processing of allocating unique label values corresponding to the connected object connection region may be performed. This connection component labeling process can be effectively used especially for binary map data.

The element connection processing unit 140 may classify the classified object connection regions by unique label values, determine and output characteristic values of the regions, such as the size, position, direction, and circumference of each object region. The element connection processing unit 140 may apply a cyclic algorithm or a sequential algorithm to perform connection component labeling processing and classify object connection regions.

For example, the sequential algorithm may be an algorithm for determining the label of the current pixel by searching the labels of the upper pixel and the left pixel of the pixel data of each foreground pixel. The neighboring pixels including the upper pixel and the left pixel may be pixels that have already been processed in the labeling process.

Here, when the neighboring pixels are not all foreground pixels, the element connection processing unit 140 may allocate a new label value to the current pixel. In addition, when only one of the two neighboring pixels is a foreground pixel, the element connection processing unit 140 may assign the label value of the pixel to the current pixel. Also, when both neighboring pixels are foreground pixels and have the same label value, the element connection processing unit 140 may assign the same label value to the current pixel.

However, when two pixels are foreground pixels but have different label values, these two regions are connected to each other by the current pixel, so they must be merged with the same label value. Accordingly, the element connection processing unit 140 may allocate the smaller of the label values of the two pixels as the label value of the current pixel, and register the two labels as equivalent labels in the equality table. When the first labeling process is completed, information on labels to be merged into the same area may be stored in the equivalence table. The element connection processing unit 140 may assign the same label to all pixels of each object connection area in the second labeling process using the equivalence table.

Accordingly, the element connection processing unit 140 may output object connection region information according to the connection component labeling process together with blob image data including the foreground pixel data, and the object connection region information is for each object connection region. may include characteristic information (position information, size information, direction information, circumference information, etc.) corresponding to the .

In addition, the object tracking unit 150 may acquire tracking data for tracking object information in the image information, based on the blob image data and the object connection region information. The tracking data may include list information of objects found and tracked in the image. More specifically, the object tracking unit 150 may cumulatively match the blob image at time t and the blob image at t-1 to identify and process the object corresponding to the object connection area, and may be included in the list, Tracing processing using a Kalman filter method may be exemplified. The Kalman filter is a filter that detects the state of a linear dynamic system by recursively accumulating input data based on measurements performed over time.

Accordingly, the object tracking unit 150 may output object tracking data identified in the image information. The object tracking data may include size information and movement speed information of each identified object along with list information of the object.

Then, the viewpoint converting unit 160 converts the size information and movement speed information of each object in the above-described object tracking data into actual values according to the 3D viewpoint conditions for each camera device. That is, the tracking data of the object tracking unit 150 has information on the size and speed of the object, but since it is a relative value between pixels, the viewpoint converting unit 160 can convert the pixel coordinates of the image into coordinates in real space. , conversion processing using camera characteristic information such as angle of view and height specified in advance through calibration may be performed.

Accordingly, the viewpoint converting unit 160 may convert size information and speed information of objects listed in the object tracking data into size information and speed information in real space.

Meanwhile, the object classification processing unit 170 may perform a process of allocating classification information to the object identified in the object tracking data based on a preset classification criterion. However, the process of setting the classification criterion itself or accurately determining whether it corresponds to the classification criterion is processed in a separate deep learning distributed processing device 300 rather than the intelligent security monitoring device 100 installed in the local monitoring network. It could be more efficient.

That is, in order to accurately classify and detect an object even in a low-illumination environment through the cumulative learning of various external image information, the object classification processing unit 170 uses the distributed data processing unit 190 to process the tracking data for object classification processing. and transmits a deep learning analysis processing request including image information to the deep learning distributed processing apparatus 300 , receives analysis result information from the deep learning distributed processing apparatus 300 , and object classification processing using the received analysis result information can be performed.

The distributed data processing unit 190 generates deep learning distributed processing request data based on the tracking data and the image information according to the initial analysis obtained through the viewpoint converting unit 160, and the deep learning distributed processing request data may be transmitted to the deep learning distributed processing device, and the deep learning-based image information analysis result received from the deep learning distributed processing device 300 may be received and transmitted to the object classification processing unit 170 .

The deep learning distributed processing apparatus 300 responds to the distributed processing request data using the deep learning-based image information analysis unit 310 that builds neural network data from pre-trained image information according to the deep learning method, and the neural network data It may include an object detection unit 320 that detects object information to be used, and an object classification processing unit 330 that determines classification information of the detected object information.

In the deep learning-based image information analysis unit 310, for example, a neural network according to a deep learning algorithm based on DNN (Deep Neural Network) is set, and the neural network is an input layer and one or more hidden layers (Hidden). Layers) and an output layer (Output Layer) may be configured. Here, as the deep learning algorithm, a neural network other than DNN may be applied, for example, a neural network such as a Convolution Neural Network (CNN) or a Recurrent Neural Network (RNN) may be applied.

Here, the deep learning-based image information analysis unit 310 of the deep learning distributed processing device 300 analyzes one or more normal images obtained from the image information through a deep learning-based neural network to identify a monitoring target object and a normal image in which the monitoring target object is identified may be stored.

More specifically, for example, the deep learning-based image information analysis unit 310 may identify a monitoring target object from one or more specific images obtained from the learning image information, and a specific object other than the monitoring target object is identified. If the similarity between the specific image and the one or more normal images is calculated, if the similarity is greater than or equal to a preset reference value, the error between the output value and object information processed based on the neural network for the specific image Error information may be generated, and parameters configuring the neural network may be adjusted based on the error information through a preset back propagation algorithm.

Here, the similarity comparison method between images is histogram matching.

matching), template matching assigned to an object identified in the image, or comparing the similarity using a feature point comparison extracted from the image through the neural network may be exemplified.

And, the deep learning-based image information analysis unit 310 based on the error information through the back-propagation algorithm to the weight of the connection strength between the input layer, one or more hidden layers, and the output layer constituting the neural network through the weight (weight) Alternatively, by varying the bias of the units configured in the input layer, the hidden layer, and the output layer, the learning process may be performed so that the identification error of the monitoring target object is minimized.

In addition, the deep learning-based image information analysis unit 310 can update the object information by repeatedly learning the image continuously received from the intelligent security monitoring device 100 or other various imaging devices through the neural network, and The object corresponding to the parameter for each object characteristic included in the object information in the image by adapting to the change in the object characteristic appearing in the image according to the environmental change (environmental condition change (eg, illuminance, obstacle)) of the monitoring target area through the can be accurately identified.

In addition, the object detection unit 320 may detect one or more objects identified from tracking data and image information obtained from deep learning distributed processing request data based on the learned neural network (or neural network) data, and classify the object The processing unit 330 may generate object classification information including parameters for various object characteristics, such as size, color distribution, outline, etc. for each location on an image for each object, and use the generated object classification information to intelligent security monitoring device 100 can be transmitted to the distributed data processing unit 190 of

The deep learning distributed processing apparatus 300 may include a separate user input unit or a communication unit, and the deep learning distributed processing apparatus 300 includes control information related to user input through the user input unit or received from the outside through the communication unit. Any one of the one or more objects classified by the object classification processing unit 330 based on the control information may be set as a monitoring target object, and setting information thereof may be stored.

Through this processing, the intelligent security monitoring device 100 receives only the processing result of the high-performance deep learning operation through the analysis processing of the distributed data provided from the deep learning distributed processing device 300 and quickly the event detection unit 180 high-performance analysis equipment to the intelligent security monitoring device 100 by distributing only the data that requires complex deep learning analysis along with the rapid data processing of the intelligent security monitoring device 100 itself through separate data processing. It is possible to secure the advantages of deep learning image analysis and the speed of data processing without mounting it.

This distributed data processing can be processed by an edge computing method in which the intelligent security monitoring device 100 and the deep learning distributed processing device 300 are interlocked, and the deep learning distributed processing device 300 is a distributed data processing unit ( 190) can be an edge device that can provide fast service processing by collecting and analyzing only the minimum data to minimize the data processing delay time, and can be built with a distributed open architecture that can provide it.

In addition, deep learning-based image analysis can increase the accuracy of the identification of the monitored object through repeated learning of the monitored object, as well as the change in the characteristics of the monitored object appearing in the video or image reflecting the environmental characteristics of the monitored area. Based on this, the deep learning algorithm is optimized according to the characteristics of the monitored object appearing in the surveillance target area to accurately identify the surveillance target photographed through the camera generally operated in low-light environments due to the operational characteristics of the security system. Object identification accuracy can be improved, and through this, it is possible to accurately classify objects other than the monitoring target object, thereby supporting the prevention of misinformation by erroneously judging the non-monitoring object as the monitoring target.

And, the event detection unit 180 is one obtained according to at least one of the collected sensor information, the tracking data of the image information, and the object classification information transmitted from the distributed data processing unit 190 through the object classification processing unit 170 . An abnormal event is detected, and the detected event information may be transmitted to the monitoring service processing unit 185 . The monitoring service processing unit 185 may perform a predetermined monitoring service process according to each event information, which will be described in more detail with reference to FIG. 3 .

3 is a block diagram illustrating a detection module of an event detection unit according to an embodiment of the present invention.

Referring to FIG. 3 , the event detection unit 180 according to an embodiment of the present invention more accurately classifies moving objects in an image into a person performing a specific action, a vehicle of a specific type, etc. by the deep learning distributed processing device 300 . As it becomes possible, more various types of event detection can be performed, and the monitoring service processing unit 185 processes and controls a notification service to the user terminal 200 suitable for each event detection or a transmission service to the relay server 400 . Request service processing, etc. may be performed.

Accordingly, the event detection unit 180 performs dynamic object tracking in the image information from the tracking data and object classification information, and detects or detects one or more events according to the dynamic object tracking information. can do.

That is, the event detection unit 180 maps the tracking data of the object tracking unit 150 and the deep learning-based object classification information received from the distributed data processing unit 190, and uses it within the camera viewable area (Filed of View). By tracking all moving objects individually, it is possible to identify the moment of passage of a trip wire or an area of interest, and further, by analyzing the movement trajectory for each object, detection or statistical information used for analysis of customer flow in the store is output. You may.

More specifically, the event detection unit 180 may include a trip wire detection unit. The trip wire detection unit may set a virtual boundary line and process intrusion detection for perimeter detection or intrusion detection within a specific area through the dynamic object tracking.

The trip wire detection unit can also process object counting that passes (intrudes) the boundary line, and detects when there is an object (person, vehicle, or other object) passing on the ground based on the trip wire, but the It is possible to determine whether an event has occurred by checking whether the trip wire has passed (intruded) while moving from the first direction to the second direction through tracking the direction of movement (bidirectional or unidirectional).

In addition, the event detection unit 180 may include an intrusion detection unit. The intrusion detection unit may perform a region-of-interest-based intrusion detection process such as detecting a boundary-based intrusion using the trip wire detector or detecting an intrusion when an object movement corresponding to a preset region of interest is detected. . The trip wire method is preferable for a perimeter, sea or coast, air (sky), and entrance, and it may be desirable to detect intrusion using an area of interest in a building. In addition, the chip detection unit may simultaneously perform intrusion detection processing based on the trip wire and the region of interest.

Also, the event detection unit 180 may include a wandering object detection unit. The wandering object detection unit may detect a wandering object, such as a person or a vehicle, to obtain information on the wandering object event, and transmit the wandering object event information to the monitoring service processing unit 185 .

For example, the wandering object detection unit may be used to observe major security facilities, security boundary areas, high-value storage facilities, and the like. The event detection unit 180 detects whether an object such as an outsider or an external vehicle has wandered around the restricted access area for more than a certain period of time through the wandering object detection unit, and the object wandering for more than a certain amount of time can be detected as a wandering object. . A wandering person or vehicle has the potential to cause an accident, so it becomes a subject of intensive monitoring, and through this, an accident can be prevented in advance.

Meanwhile, the event detection unit 180 may include a traffic direction violation detection unit. The Wrong Directions detection unit may detect a traffic violation object in a traffic direction observance area, such as an airport. The event detection unit 180 may detect a passage direction violation object, and such a passage direction violation object detection unit may operate even with respect to a theater or a performance hall in which incoming and outgoing directions are designated differently. When applied to a vehicle, the traveling direction violation object detection unit may process reverse traveling detection and the like to detect the reverse traveling vehicle object as a traveling direction violation object.

In addition, the event detection unit 180 may include an unauthorized object detection unit. The Unattended Object unit detects unattended objects that remain stationary even after the specified time has elapsed after an object (package, bag, cart, etc.) left unattended by someone within a preset area of interest appears and , the detected unauthorized object object information may be transmitted to the monitoring service processing unit 185 . This makes it possible to detect and prevent the arbitrariness of leaving explosives for terrorism, particularly in airports, terminals, station platforms, and major event venues.

In addition, the event detection unit 180 may include an unauthorized moving object detection unit. The unauthorized moving object detection unit detects the event information obtained by detecting the disappearance of the pre-designated objects from the video object in places where theft frequently occurs, such as museums, exhibitions, high-end displays, airports, stores, and warehouses, etc. The monitoring service processing unit 185 ) can be passed as

In addition, the event detection unit 180 may include an access counting and statistics unit. Access counting (Object Counting) and the statistical unit may acquire statistical information on the number of visitors and exits of public facilities such as department stores and shopping centers, museums, exhibitions, and theaters, and transmit it to the monitoring service processing unit 185 . The monitoring service processing unit 185 may provide real-time counting and occupant statistical information for each time period to the control service device 500 through the user terminal 200 or the relay server 400, and the user manages the statistical information It can be used as basic information necessary for store customer management and store layout management. In addition, the user terminal 200 may output statistical information for comparing the sales compared to the number of visitors obtained based on the visitor statistics information. Furthermore, the access counting and statistics unit may perform a process of automatically calculating the number of vehicles passing by lane on a specific road, and the monitoring service processing unit 185 may transmit statistical data of the number of vehicles passing by time to the user terminal 200 or a relay server. It may be provided to 400 or the control service server 500 .

Meanwhile, the event detection unit 180 may include a crowd density detection unit. The crowd density detection unit may detect an event that develops to an overcrowd scale exceeding a designated crowd density within a preset region of interest.

To this end, the event detection unit 180 may check the current density state in real time from the object tracking data and classification information, and may transmit event information corresponding to the density state to the monitoring service processing unit 185 . The monitoring service processing unit 185 may transmit the density information based on the event information to the user terminal 200 or the relay server 400 or the control service server 500 . For example, the manager can check the crowding information and decide whether to open additional doors or checkout counters when the crowd becomes overcrowded at stores, airports, and theaters, and defend in places where protests and assemblies are frequent. You may decide to deploy additional agents. Crowd density counting may use a method of counting all people classified within the region of interest at a certain time.

In addition, the event detection unit 180 may include a specific behavior detection unit. The Suspicious Behavior detection unit may detect a person performing an unusual behavior, such as a person who slipped or tripped, a person who is fighting, a person who is running.

In order to detect such a specific behavior, the event detection unit 180 may utilize the deep learning analysis information and object classification information of the deep learning distributed processing device 300, and the deep learning distributed processing device 300 is a neural network learning of image information. Through this, classification processing for specific actions such as slip and fall detection, fighting person detection, and running person detection (Running) may be possible.

In particular, the event detection unit 180 can process the occurrence of an event through detection of a slipping or tripping person, and transmit it to the monitoring service processing unit 185, which can be effectively used for monitoring the elderly in a silver town or a nursing home. In addition, the monitoring service processing unit 185 may be in danger of life after an elderly person falls if a person who can help does not come immediately. Therefore, notification request information or control to the user terminal 200 or the control service server 500 corresponding thereto Request information can be transmitted.

Meanwhile, the event detection unit 180 may include a camera unauthorized change detection unit. The camera tampering detection unit detects short circuiting of the camera cable by a third party, defocusing due to unauthorized lens manipulation, when the camera lens is covered with a hand or other object, or when the lens is arbitrarily rotated in a different direction. It is possible to detect tampering with the camera, and the deep learning distributed processing device 300 may pre-process image learning for each situation for detecting tampering with the camera and build it as neural network data.

4 is a ladder diagram for explaining the overall system operation according to an embodiment of the present invention.

Referring to FIG. 4 , the user terminal 200 according to an embodiment of the present invention performs pre-user registration processing in the intelligent security monitoring apparatus 100 and the control service server 500 ( S101 ).

User registration processing, for example, user information as an administrator using the intelligent security monitoring device 100 and mobile phone information registration processing may be exemplified, and the user terminal 200 is the processing information of the intelligent security monitoring device 100 And as an input/output device for receiving and outputting the control service processing information of the control service server 500, or transmitting input information of the user terminal 200 to the intelligent security monitoring device 100 or the control service server 500, a computer , various electronic devices such as smartphones, tablet PCs, and navigation devices may be exemplified.

Then, the intelligent security monitoring device 100 collects and stabilizes image information collected from one or more camera devices (S103).

Thereafter, the intelligent security monitoring device 100 performs a background modeling process of the image information that has been stabilized (S105), and performs a shape calculation process for detecting a shape element region of the foreground binary data from which the background image is subtracted according to the background modeling process. (S107), element connection processing for labeling by connecting shape element regions to object connection regions is performed (S109), and object tracking processing for composing an object list corresponding to object connection regions is performed (S111).

And, the intelligent security monitoring device 100, the object tracking information including the object list in the image information obtained according to the initial analysis of steps S103 to S111 as described above, and processing the image information into deep learning distributed processing request data Thus, it is transmitted to the deep learning distributed processing device 300 .

Thereafter, the deep learning distributed processing device 300 applies the object tracking information and image information of the deep learning distributed processing request data to the pre-built neural network data, performs deep learning analysis-based object detection processing (S115), and detection A classification process is performed by identifying the pattern of the object that has been changed (S117).

Then, the deep learning distributed processing apparatus 300 responds to the object detection information and classification information according to the deep learning-based analysis to the intelligent security monitoring apparatus 100 (S119).

Here, the object detection information and classification information may include information used for event detection by the above-described event detection unit 180, for example, the type and pattern of the object passing through the trip wire, and the intrusion detection of the object. Types and patterns, types and patterns of wandering objects, types and patterns of objects that violate the direction of passage, types and patterns of unauthorized objects, types and patterns of unauthorized moving objects, types and patterns of objects used for counting access and statistical calculation, crowds It may include various detection information and classification pattern information, such as the type and pattern of objects that are the basis of the detection of the dense state, the types and behavior patterns of objects corresponding to the specific behavior, and the types and patterns of objects indicating unauthorized camera change detection. .

Based on the object detection information and classification information, and the object tracking information, the intelligent security monitoring apparatus 100 determines event detection (S123). The sensor information of the above-described sensor device 700 may also be used for event detection determination.

When an event is detected, the intelligent security monitoring apparatus 100 may transmit an event notification message to the user terminal 200 (S125) or may transmit event detection data to the relay server 400 (S127).

On the other hand, the deep learning distributed processing device 300 transfers the image analysis information to the relay server 400 to be stored and managed in advance (S121), which is a deep learning corresponding to the event detection data to the user terminal 200 (S121). It may be used to provide running image analysis information (S129).

Accordingly, the user terminal 200 may output a notification interface including the event analysis information based on deep learning together with the event notification message (S131). The user may input processing information of the intelligent security monitoring device 100 appropriate for alert, release, alarm, etc. according to the type of event (133), and the input processing information is the intelligent security monitoring device 100 or the control service server. (500).

Then, the intelligent security monitoring apparatus 100 performs processing according to the user input information, and transmits the processing result information to the user terminal 200 (S135).

On the other hand, the relay server 400 receives the control service request information according to the user input of the intelligent security monitoring device 100 or the user terminal 200 (S137), and the control service request based on the received request information and event detection data may be transmitted to a pre-specified control service server 500 (S139).

And, in the control service server 500, emergency dispatch service to the location of the intelligent security monitoring device 100 according to the control service request, fire or intrusion report service, real-time video monitoring service, surrounding notification service, intelligent security monitoring device 100 Processes a control service, such as a control service of the (S141), and transmits the control processing data including the processing result information to the intelligent security monitoring device 100 or the user terminal 200 (S143, S145).

5 is a conceptual diagram for explaining an intelligent camera device-based system according to another embodiment of the present invention, and FIG. 6 is a configuration and connection relationship of a deep learning analysis system implemented with an intelligent camera device according to an embodiment of the present invention. It is a block diagram showing in more detail.

5 and 6 , the intelligent security monitoring device 100 according to another embodiment of the present invention may be an intelligent camera device connected to a security network, and the camera unit 105 is directly built-in security. It can function as a camera. Therefore, the intelligent security monitoring device 100 according to an embodiment of the present invention may be an intelligent IP camera that performs edge computing, and image information stabilization, background modeling, shape calculation processing, and background modeling of the intelligent security monitoring device 100 described above. It may be a first intelligent camera device 100 having an analysis module for performing one or more of element connection processing, object tracking, viewpoint transformation, object classification processing, and event detection processing, and the remaining analysis module is another second intelligent The camera device 300 may be distributed and provided.

In particular, the second intelligent camera device 300 may be another security camera in which a separate camera unit 305 is directly embedded, and the above-described deep learning-based image information analysis unit 310 and object detection unit 320 . And it may include at least one of the configuration of the deep learning distributed processing apparatus 300 including the object classification processing unit (330).

Therefore, the security monitoring system according to an embodiment of the present invention can be built as an edge computing network including the first intelligent camera device 100 and the second intelligent camera device 300 as an intelligent IP camera that performs edge computing. As a result, it is possible to build a security monitoring network that is superior to the existing intelligent video monitoring device and minimizes the cost of building a computing network and equipment while being superior to that of the existing intelligent video monitoring device.

The method according to the present invention described above may be produced as a program to be executed by a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape. , floppy disks, and optical data storage devices.

The computer-readable recording medium is distributed in a network-connected computer system, so that the computer-readable code can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the method can be easily inferred by programmers in the art to which the present invention pertains.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims Various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Claims (12)

one or more camera devices and sensor devices disposed in the security monitoring area to photograph the security monitoring area or sensing a detection signal generated in or around the security monitoring area to obtain image information and sensor information;
It is connected to the camera and sensor devices through a local monitoring network, collects, stores and manages image information and sensor information received from the camera device and sensor device, and based on the image information and sensor information, one or more generated in a security monitoring area. The security monitoring event is detected, but the deep learning distributed processing request data is generated for the first security monitoring event detected by basic information analysis and the image requiring complex deep learning analysis and delivered to the deep learning distributed processing device, An intelligent security monitoring device that receives and reflects the deep learning processing result information from the learning distributed processing device, detects a second security monitoring event, and performs monitoring service processing corresponding to the detected event;
One or more of the one or more intelligent security monitoring devices are arranged and connected to enable distributed processing of information, and deep learning distributed processing requests that require more accurate analysis through accurate detection and classification of objects from the intelligent security monitoring devices A deep learning distributed processing device that receives data, performs deep learning-based object detection and object classification analysis, and transmits the deep learning analysis result to the corresponding intelligent security monitoring device to detect a security monitoring event that reflects the deep learning analysis information result information ;
It collects, stores, and manages video monitoring analysis data from intelligent security monitoring devices installed in various places, and relays the deep learning video analysis results received from the deep learning distributed processing device and the video monitoring analysis data to user terminals and control service servers. server to; and
Event detection data of each intelligent security monitoring device received through the relay server and accident occurrence report, fire occurrence report, user notification, monitoring device control, real-time monitoring based on deep learning image analysis information received from each deep learning distributed processing device A control service server that performs various control service processing such as, and transmits service performance information to a user terminal,
Intelligent security monitoring service provision system.
According to claim 1,
The intelligent security monitoring device,
The security monitoring area sensing information received from the sensor device and the security monitoring area captured image data received from the camera device are collected, and when there is frame shake in the captured image of the camera in the image data, stabilization of image information according to shake correction an image information collection unit for processing;
a background modeling unit for modeling a background area corresponding to the image information subjected to stabilization;
a shape calculation processing unit that performs shape calculation processing to determine shape area information from binary map data of foreground pixel information that is subtracted and output according to background modeling;
The shape operation processing unit acquires image information corresponding to the specified shape structure element, connects and processes each shape structure element to classify them into independent object connection areas, and generates unique label values corresponding to the classified object connection area. an element concatenation processing unit that performs assignment concatenated component labeling processing;
an object tracking unit configured to acquire tracking data for tracking object information in image information based on blob image data and object connection region information;
a 3D viewpoint converting unit converting size information and movement speed information of each object in the object tracking data into actual values according to 3D viewpoint conditions for each camera device;
an object classification processing unit that performs a process of allocating classification information to the object identified in the object tracking data based on a preset classification criterion and reflecting the deep learning distributed processing result of the deep learning distributed processing device;
Based on the tracking data and the image information according to the initial analysis obtained through the viewpoint conversion unit, deep learning distributed processing request data is generated, transmitted to the deep learning distributed processing device, and received from the deep learning distributed processing device a distributed data processing unit that receives the deep learning-based image information analysis result and transmits it to the object classification processing unit;
an event detection unit configured to detect one or more events obtained according to at least one of the collected sensor information, the tracking data of the image information, and the object classification information transmitted from the distributed data processing unit through the object classification processing unit;
A monitoring service processing unit that performs a predetermined monitoring service process including at least one of a notification service to a corresponding user terminal, a transmission service processing to a relay server, and a control request service processing according to each event information; including;
Intelligent security monitoring service provision system.
3. The method of claim 2,
The event detection unit performs dynamic object tracking in image information from tracking data and object classification information, and detects or detects one or more events according to the dynamic object tracking information.
Intelligent security monitoring service provision system.
3. The method of claim 2,
The event detection unit,
It includes a trip wire detector that sets a virtual boundary in the image and processes intrusion detection for perimeter detection or intrusion detection within a specific area through dynamic object tracking,
Detects when there is an object (person, vehicle, or other object) passing on the ground based on the trip wire, and moves from the first direction to the second direction through tracking the direction (bidirectional or unidirectional) of the movement and passes the trip wire (intrusion) to determine whether an event has occurred
Intelligent security monitoring service provision system.
4. The method of claim 3,
The event detection unit,
an intrusion detection unit that detects a boundary-based intrusion using the trip wire detector or performs an ROI-based intrusion detection process for detecting an intrusion when an object movement corresponding to a preset ROI is detected;
a loitering object detection unit that detects a loitering object such as a person or a vehicle, obtains loitering object event information, and transmits the loitering object event information to a monitoring service processing unit;
a traffic direction violation detection unit for detecting a traffic violation object in a traffic direction observance area;
After an object (package, bag, cart, etc.) left unattended by someone appears within a preset area of interest, it detects an unattended object that continues to remain stationary even after a specified time has elapsed, and detects unattended object information an unauthorized object detection unit that transmits to the monitoring service processing unit;
an unauthorized moving object detection unit that detects and transmits the acquired event information to the monitoring service processing unit when the pre-designated objects disappear from the video object;
an access counting and statistics unit for acquiring statistical information on the number of entering and leaving visitors and transferring it to the monitoring service processing unit to provide real-time counting and time-based visitor statistics information; or
a crowd density detection unit configured to detect an event that develops to a crowd size exceeding a specified crowd density within a preset area of interest;
A specific behavior detection unit for detecting a person performing a specific action including any one of a slipping or tripping person, a fighting person, and a running person; including any one or more of
Intelligent security monitoring service provision system.
4. The method of claim 3,
The event detection unit,
Camera tamper detection, which detects tampering with the camera, such as shorting of the camera cable by a third party, defocusing due to tampering with the lens, covering the camera lens with a hand or other object, or arbitrarily rotating the lens in a different direction more wealth,
The deep learning distributed processing device pre-processes image learning for each specific situation for camera unauthorized change detection and builds it as neural network data.
Intelligent security monitoring service provision system.
According to claim 1,
The deep learning distributed processing device,
a deep learning-based image information analysis unit for constructing neural network data from image information learned in advance according to a deep learning method;
an object detection unit detecting object information corresponding to the distributed processing request data using the neural network data;
Including; an object classification processing unit that determines classification information of the detected object information
Intelligent security monitoring service provision system.
8. The method of claim 7,
The deep learning-based image information analysis unit,
A neural network according to any one of Deep Neural Network (DNN), Convolution Neural Network (CNN), or Recurrent Neural Network (RNN) is applied.
Intelligent security monitoring service provision system.
8. The method of claim 7,
The deep learning distributed processing device,
It includes a separate user input unit or communication unit, and the deep learning distributed processing device is one classified by the object classification processing unit based on user input related control information through the user input unit or control information received from the outside through the communication unit. Set any one of the above objects as the object to be monitored and store the setting information
Intelligent security monitoring service provision system.
According to claim 1,
The intelligent security monitoring device,
A first monitoring event detected by the basic analysis processing performed through the information processing module and the information analysis module and a second monitoring event detected by reflecting the result of the deep learning analysis processing are detected,
The first monitoring event and the second monitoring event may be grouped according to whether deep learning analysis is processed,
The first monitoring event includes at least one of an intrusion event quickly detected according to an initial analysis of sensor information and image information, an unauthorized camera change event, and a fire occurrence event,
The second monitoring event is a dynamic object tracking event accompanied by accurate object detection and classification information according to deep learning analysis, a trip wire event, a wandering object detection event, a traffic direction violation detection event, an unauthorized object detection event, an unauthorized moving object At least one of a detection event, an access counting and statistical event, a crowd detection event, and an unusual behavior detection event
Intelligent security monitoring service provision system.
According to claim 1,
The intelligent security monitoring device,
First, the initial analysis information according to the occurrence of the first monitoring event is transmitted to the control service server or the user terminal through the relay server,
By detecting a second monitoring event as detailed information of the first monitoring event according to the deep learning analysis result of the deep learning distributed processing device for image information within a predetermined time range related to the first monitoring event, the relay server to provide the second monitoring event information to the control service server or user terminal through
An intelligent security monitoring service provider.
According to claim 1,
The deep learning distributed processing device,
An apparatus for obtaining object classification information corresponding to the deep learning distributed processing request data using a deep learning-based neural network, and transmitting the object classification information to the intelligent security monitoring device,
In order to construct a deep learning-based neural network, one or more normal images obtained from learning image information are analyzed to identify a monitoring target object, a normal image in which the monitoring target object is identified is stored, and one or more obtained from the training image information When a specific object other than the monitoring target object is identified in the process of identifying the monitoring target object from the specific image, a similarity between the specific image and one or more of the normal images is calculated, and when the similarity is greater than or equal to a preset reference value, the specific Generates error information about an error between an image-processed output value and object information based on the neural network for an image, and configures the neural network based on the error information through a preset back propagation algorithm A device that adjusts parameters
Intelligent security monitoring service provision system.

Images