KR102690657B1 - Intelligent monitoring system capable of repurposing general cctv cameras - Google Patents

Abstract

An intelligent monitoring system is launched that helps detect risk factors in the surveillance area by analyzing images captured through regular CCTV cameras, even if regular CCTV cameras without video analysis functions are used. For this purpose, a communication terminal installed with a video sharing app that generates video data by sharing surveillance video captured from a pre-installed surveillance camera and transmits the video data to the outside through a communication network, and analyzes the video data provided from the communication terminal. An intelligent monitoring system is provided that includes an operation server that monitors the occurrence of events under preset conditions, generates notification information when the occurrence of the event is read, and transmits the notification information to a pre-registered recipient. According to the present invention, instead of disposing of existing surveillance cameras and unused smartphones that did not provide intelligent surveillance functions, a video sharing app is installed on the smartphone and surveillance videos captured from the surveillance cameras are provided to an operation server via the Internet. An intelligent monitoring system can be built.

Description

Intelligent monitoring system that can recycle general CCTV cameras {INTELLIGENT MONITORING SYSTEM CAPABLE OF REPURPOSING GENERAL CCTV CAMERAS}

The present invention relates to an intelligent monitoring system using general CCTV cameras that can detect risk factors by analyzing images captured through general CCTV cameras. More specifically, even if general CCTV cameras without video analysis functions are used as is, general CCTV cameras are used. It is about an intelligent monitoring system that helps detect risk factors in the surveillance area by analyzing video captured through cameras.

[R&D project that supported this invention]

[Assignment number] 2023004

[Ministry name] Gyeonggi-do

[Research management agency] Gyeonggi Province Economic and Science Promotion Agency

[Research Project Name] Data Industry Development Support Project

[Research project title] Smart ship accident detection solution

[Contribution rate] 1/1

[Host organization] Vectorsys Co., Ltd.

[Research period] 2023. 5. 1. ~ 2023.11.30.

In general, various types of security systems are installed in designated spatial areas such as specific workplaces for technical security to protect the assets of companies and research institutes, and various methods are used to check the movements of individuals entering and leaving the workplace. .

For example, an intelligent monitoring system, a type of security system, collects videos by independently filming the area or part covered by each surveillance camera, and arranges these multiple videos in a checkerboard shape as shown in Figure 1. It is output through multiple monitors.

In this way, the conventional intelligent monitoring system only displays and stores images of the space captured by image acquisition devices such as surveillance cameras that are installed only in spaces essential for security among the surveillance area, so the captured images have no properties in the space. It is difficult to determine which part it belongs to, and whether there is a space where a surveillance camera is installed adjacent to the space being filmed, so it is impossible to intuitively recognize the security situation, so early warning of intrusion incidents and accurate and rapid response are provided. It is not enough to perform.

In order to solve this problem, the manager must directly remember the surveillance camera's identification information and what location space in the entire crime prevention area each surveillance camera is filming based on the surveillance camera's identification information.

Therefore, the manager of a conventional intelligent monitoring system must memorize which location each surveillance camera is filming, or remember which area of the entire crime prevention area the space captured by each surveillance camera is, along with the objects in that space, which is cumbersome. , there was a problem that in an emergency situation, the corresponding space, or area, of the image captured by a random surveillance camera did not appear quickly, which could lead to a delay in response.

Additionally, the conventional intelligent monitoring system has limitations in determining where the intruder is when the intruder leaves the viewing area. In other words, if an intruder leaves the surveillance area captured by the surveillance camera, further tracking is impossible, and the direction and path of subsequent movements cannot be tracked.

Accordingly, even if an intruder is discovered by a surveillance camera and a security company is contacted, there is a high possibility that the intruder has already escaped during the dispatch time, and the location to which the security company dispatches has no choice but to focus on the location of the surveillance camera, so the actual intruder is There is bound to be a big difference from the location of . Therefore, there is a disadvantage that it is difficult to detect or arrest intruders.

Recently, in order to improve the problems of the above-mentioned intelligent monitoring system, technology is being developed to capture images of objects entering the surveillance area, process the images of the objects into 2D images, and output 2D images of the objects in virtual space. am.

However, in the case of 2D video, objects are observed as lines depending on the administrator's observation point, so there is a disadvantage that objects that enter the surveillance area cannot be smoothly monitored.

Republic of Korea Patent Publication No. 10-2022-0126934 (published on September 19, 2022) Republic of Korea Patent No. 10-2581233 (announced on September 21, 2023) Republic of Korea Patent No. 10-2555938 (announced on July 17, 2023) Republic of Korea Patent Publication No. 10-2019-0078688 (published on July 5, 2019)

Therefore, the purpose of the present invention is to provide an intelligent monitoring system that can provide an intelligent surveillance function by recycling old general CCTV cameras and spare smartphones without an intelligent surveillance function.

In order to achieve the purpose of the present invention described above, in one embodiment of the present invention, video data is generated by sharing surveillance video captured from a pre-installed surveillance camera (general CCTV camera), and the video data is transmitted through a communication network. A communication terminal installed with a video sharing app that transmits externally, and video data provided from the communication terminal are analyzed to monitor the occurrence of an event under preset conditions, and when the occurrence of the event is read, notification information is generated, and the notification information is sent. It provides an intelligent monitoring system that includes an operation server that transmits data to a pre-registered administrator terminal.

According to the present invention, instead of disposing of existing general CCTV cameras and unused smartphones that did not provide intelligent surveillance functions, a video sharing app is installed on the smartphone and surveillance images captured from general CCTV cameras are operated through the Internet. Since it is possible to build an intelligent monitoring system provided by

In addition, the present invention uploads surveillance video captured by an existing general CCTV camera that does not provide an intelligent surveillance function to the Internet using an extra smartphone, and analyzes the surveillance video through an operation server connected to a communication network instead of a person to provide an event event. Occurrence can be automatically read.

In addition, the present invention allows AI to determine the occurrence of an event for images captured from a surveillance camera selected for management and quickly notify the manager, making it possible to effectively respond to emergency situations without omission.

1 is a configuration diagram for explaining an intelligent monitoring system according to a first embodiment of the present invention.
Figure 2 is a configuration diagram for explaining an intelligent monitoring system according to a second embodiment of the present invention.
Figure 3 is a configuration diagram for explaining an intelligent monitoring system according to a third embodiment of the present invention.

Hereinafter, an intelligent monitoring system (hereinafter abbreviated as 'intelligent monitoring system') that can recycle general CCTV cameras according to preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a configuration diagram for explaining an intelligent monitoring system according to a first embodiment of the present invention, and FIG. 2 is a configuration diagram for explaining an intelligent monitoring system according to a second embodiment of the present invention.

Referring to Figures 1 and 2, the intelligent monitoring system according to the present invention includes a surveillance camera 100 pre-installed to monitor the surveillance area, and shares the surveillance video captured from the surveillance camera 100 to provide wireless and wired information such as the Internet. A communication terminal 200 installed with a video sharing app 210 that is transmitted externally through a communication network (hereinafter abbreviated as 'communication network'), and the occurrence of an event by analyzing the surveillance video provided from the communication terminal 200 It includes an operation server 300 that monitors and generates notification information when the above event occurs and transmits it to a pre-registered recipient, and an administrator terminal 400 that selectively outputs alarm information provided from the operation server 300, and an operation It may further include an event server 500 that temporarily stores surveillance images in which an event occurs among the surveillance images provided to the server 300 so that the administrator can check them. Here, the communication network includes all types of wired/wireless networks such as Local Area Network (LAN), Wide Area Network (WAN), mobile radio communication network, Wibro (Wireless Broadband Internet), etc. It can be implemented.

Hereinafter, each component will be described in more detail with reference to the drawings.

1 and 2, the intelligent monitoring system according to the present invention includes a surveillance camera 100.

The surveillance camera 100 is pre-installed in the space to be monitored to photograph the surveillance area and obtain surveillance images. CCTV cameras or home cameras installed for various purposes such as facility surveillance, methods, and security can be used.

This surveillance camera 100 may be any camera installed as long as it is installed to photograph the surveillance area. For example, the surveillance camera 100 can be a general CCTV camera or an IP camera each having an IP address.

1 and 2, the intelligent monitoring system according to the present invention includes a communication terminal 200.

The communication terminal 200 connects the existing surveillance camera 100 to the operation server 300 through a communication network so that existing general CCTV cameras without an intelligent surveillance function can be used as an intelligent surveillance camera. The video sharing app (210), which can be connected to the operation server (300), is installed and used on an unused spare smartphone.

For this purpose, the communication terminal 200 generates video data by sharing surveillance video captured from a surveillance camera 100, such as a pre-installed general CCTV camera, and sends the video data to an external operation server 300 through a communication network. The provided video sharing app (210) is installed.

Since the surveillance camera 100, which is pre-installed to monitor the surveillance area, is connected to the local network and assigned an IP address, the video sharing app 210 uses the surveillance camera to register the surveillance camera 100 that shares the surveillance video. You can save it by entering the IP address of (100).

In addition, since the communication terminal 200 with the video sharing app 210 installed is connected to the same local network as the surveillance camera 100, it receives the surveillance video generated from the surveillance camera 100 and generates video data.

If necessary, the video sharing app 210 can generate video data with the background image removed from the surveillance video shared from the surveillance camera 100.

In addition, since the communication terminal 200 with the video sharing app 210 installed has its own storage space, video data can be stored directly for a predetermined period of time without using cloud storage, which incurs additional costs.

In one embodiment, the general terminal 200 on which the video sharing app 210 according to the present invention is installed stores video data at a quality selected by the administrator according to the internal storage space regardless of the operating server 300, and then stores the video data for a predetermined time. It can provide a continuous recording function that saves data for a long period of time.

In another embodiment, the general terminal 200 with the video sharing app 210 according to the present invention installed can provide an event recording function to store video data by itself when a recording request signal is received from the operation server 300. there is. At this time, the video sharing app 210 records the time when the video data was saved in the video data.

As such, the present invention allows a smartphone with its own storage space to be used as the communication terminal 200, so the communication terminal 200 can store and manage video data even without using cloud storage, which incurs additional costs. At this time, when there are multiple registered surveillance cameras 100, the video sharing app 210 preferably generates video data with an identification symbol so that the source of the surveillance video can be confirmed.

Meanwhile, the communication terminal 200 with the video sharing app 210 installed can receive customer information from the user and transmit it to the operation server 300 in order to distinguish users who are provided with the intelligent video surveillance service. Such customer information includes one or more of the customer's name, date of birth or resident registration number, address, phone number, ID and password for login, etc.

In a specific aspect, the video sharing app 210 according to the present invention may be configured to extract and edit video data stored at the event occurrence time from among its own stored video data and output it to the screen when an event occurrence time zone is input from the administrator. .

Referring to Figures 1 and 2, the intelligent monitoring system according to the present invention includes an operation server 300.

The operation server 300 analyzes video data provided from the communication terminal 200 through an artificial intelligence (AI) engine and monitors the occurrence of events under preset conditions. When the occurrence of an event is read, it generates notification information, The notification information is transmitted to a pre-registered destination.

This operation server 300 receives an observation object selected from the communication terminal 200, analyzes video data provided from the communication terminal 200 based on the observation object, performs monitoring, and generates notification information and various analysis information. can do. In addition, the operation server 300 can provide the generated notification information and analysis information to a pre-registered recipient or administrator terminal 400, and depending on the type of event, the notification information and analysis information can be sent to government office terminals such as police stations and fire stations. It can be provided as .

In addition, the operation server 300 can extract basic information such as a person's posture and behavior from video data through an AI engine-based video analysis model. For example, the operation server 300 can extract a person's posture information through an AI engine-based posture recognition model and extract human behavior information through an AI engine-based action recognition model.

In addition, the operation server 300 generates notification information including text and a URL link address where the event video is stored, and can provide the notification information to a pre-registered recipient or the administrator terminal 400. If event video is included in such notification information, a higher fee may be charged when using a telecommunication company text service or SNS text service than if the notification information includes only text, so the notification information may be configured not to include event video.

More specifically, the operation server 300 includes a communication unit that receives video data provided from the communication terminal 200, a video monitoring unit that analyzes the video data received by the communication unit and reads the occurrence of an event, and the video monitoring unit. It includes a notification unit that generates notification information according to the type of event read and provides notification information to the administrator's registered recipient or the manager terminal 400, and optionally further includes a terminal management unit that manages information on the communication terminal 200. It can be included.

The terminal management unit is configured to manage information on the surveillance cameras 100 managed by the operation server 300, and includes a hardware management module that manages device information of each surveillance camera 100, and a hardware management module that manages the device information of each surveillance camera 100. It may include a video environment management module that manages environmental information of shared video data.

The hardware management module is configured to manage device information of the surveillance camera 100 registered in the operation server 300, including an identification number or serial number that can identify each surveillance camera 100, installation location, surveillance target, Basic information such as the management entity and identification information such as IP address and MAC information of the wireless relay device connected to the surveillance camera 100 are provided and managed by the communication terminal 200.

The video environment management module is configured to receive, store, and manage video environment information related to video data transmitted from the surveillance camera 100 from the communication terminal 200. Here, the video environment information includes a reference video that can determine the occurrence of an event by comparing it with the video data transmitted from the communication terminal 200, and optionally includes background information of the surveillance video generated by the surveillance camera 100, and surveillance video. Additional object information that can enter the area may be included.

For example, the video environment management module may extract and store the first video obtained from video data provided from the communication terminal 200 as a reference video.

The communication unit receives video data, device information, destination, etc. provided from the communication terminal 200, and is programmed so that video data transmitted from the same communication terminal 200 has the same identification unit in order to distinguish the source of the video data. It can be stored only for a pre-specified time and then deleted.

The video monitoring unit analyzes the video data received through the communication unit and reads the occurrence of an event. It reads the occurrence of an event by comparing the surveillance video of the video data with the reference video, or independently analyzes the surveillance video of the video data to determine the event occurrence. Interpret the occurrence.

This video monitoring unit extracts an object image from the surveillance video and analyzes the object's movement path, object motion, and object type from the object video to read event occurrence.

Additionally, when the video monitoring unit determines that an event has occurred, it generates event occurrence information and provides it to the notification unit. More specifically, the video surveillance unit may generate event occurrence information when an event starts and provide it to the notification unit, and may generate event end information and provide it to the notification unit when the event ends.

If necessary, the video monitoring unit classifies the video data read as an event occurring as an event video and stores it in the event server 500 for a predetermined time, and generates a URL link address through which the event video can be checked externally. can do.

Through this, when an event occurs, the administrator can access the event server 500 through the URL link address and check the event video in real time, or check the event video with a delay of about 1 to 60 seconds compared to the actual event.

In addition, the video monitoring unit generates object analysis information including the movement path of the object, and stores it in the event server 500 for a predetermined time along with video data read as if an event has occurred, and stores the object analysis information and event video for a predetermined time. You can create a URL link address that can be checked externally.

In addition, the video monitoring unit can generate event occurrence time information by memorizing the time zone in which the event occurred when the event is completed after the event has occurred.

This URL link address may be included in event occurrence information, and event occurrence time information may be included in event end information.

The notification unit generates notification information when an event occurrence signal is received from the video detection unit and provides it to a previously received recipient. It extracts pre-registered text according to the type of event and generates notification information containing the text. .

When event occurrence information is received from the video surveillance unit, this notification unit generates notification information including a URL link address and transmits it to the recipient or administrator terminal 400. When event end information is received from the video surveillance unit, event occurrence time information is generated. The included notification information is generated and transmitted to the recipient or administrator terminal 400.

With this event occurrence time information, the administrator can identify the time zone when the event occurred, so even if the administrator does not use external cloud storage, among the video data stored in the self-storage space of the surveillance camera 100, the video data stored at the event occurrence time zone Helps you check.

Referring to Figure 2, the intelligent monitoring system according to the present invention may further include an administrator terminal 400.

The manager terminal 400 outputs the notification information when it is received from the operation server 300. The notification information is received as a text message through a telecommunication company text service, or is installed and operated on the manager terminal 400. It can be received as an app linked to the server 300, or as an SNS message through an SNS text service such as KakaoTalk linked to the operation server 300.

Additionally, the administrator terminal 400 can connect to the event server 500 through the URL link address included in the notification information and then output the event video matched with the URL link address.

The manager terminal 400 may be a smartphone, laptop, desktop, tablet PC, etc., but is not limited thereto and may include all types of devices equipped with computing and communication functions.

Figure 3 is a configuration diagram for explaining an intelligent monitoring system according to a third embodiment of the present invention.

Referring to FIG. 3, the intelligent monitoring system according to the present invention includes an event server 500.

The event server 500 stores and manages video data in which an event occurs as an event video. When an event video is provided from the operation server 300, it stores the event video and allows the event video to be accessed and viewed from outside. A URL link address that can be used is generated, and the URL link address is provided to the operation server 300.

Additionally, when the administrator terminal 400 accesses the event server 500 through a URL link address, the event server 500 provides the administrator terminal 400 with an event video matching the URL link address.

If necessary, the event server 500 may store the event video for a predetermined period of time and then delete it to efficiently manage the space where the event video is stored.

Although the present invention has been described above with reference to preferred embodiments, those skilled in the art can make various modifications and changes to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that it is possible.

100: surveillance camera 200: communication terminal
210: Video sharing app 300: Operation server
400: Administrator terminal 500: Event server

Claims (12)

A communication terminal installed with a video sharing app that receives surveillance video captured from a pre-installed surveillance camera, generates video data, and transmits the video data to the outside through a communication network; and
An operation server that analyzes video data provided from the communication terminal to monitor the occurrence of an event under preset conditions, generates notification information when the occurrence of the event is read, and transmits the notification information to a pre-registered recipient,
The video sharing app generates video data with the background image removed from the surveillance video shared from the surveillance camera, and stores the IP address of the surveillance camera to register the surveillance camera sharing the surveillance video.
The operation server is an intelligent monitoring system characterized in that an observation object is selected from the communication terminal, and image data provided from the communication terminal is analyzed based on the observation object to generate notification information. According to claim 1,
An intelligent monitoring system further comprising an administrator terminal that outputs the notification information when the notification information is received from the operation server. delete The method of claim 1, wherein the communication terminal
An intelligent monitoring system that stores video data for a predetermined period of time. The method of claim 1, wherein the video sharing app
An intelligent monitoring system characterized in that when a recording request signal is received from the operation server, video data is stored and stored in a communication terminal. The method of claim 1, wherein the video sharing app
The video data is stored and stored in the communication terminal for a pre-specified time, and when the event occurrence time zone is input from the administrator, the video data stored in the event occurrence time zone among the video data stored in the communication terminal is extracted and edited and displayed on the screen. Intelligent monitoring system. According to claim 1,
An intelligent monitoring system, wherein the operation server further includes an event server that stores and manages video data in which an event occurs as an event video. According to clause 7,
The operation server generates notification information including the URL link address where the text and event video are stored,
The event server is an intelligent monitoring system characterized in that it provides event images to an administrator terminal connected to a URL link address. The method of claim 1, wherein the surveillance camera
An intelligent monitoring system characterized by being a CCTV camera or a home camera. The method of claim 2, wherein the operating server is
a communication unit that receives video data provided from the communication terminal;
A video monitoring unit that analyzes the video data received by the communication unit and reads the occurrence of an event, and
An intelligent monitoring system comprising a notification unit that generates notification information according to the type of event read by the video monitoring unit and provides the notification information to a receiver or terminal registered by the manager. The method of claim 10, wherein the video monitoring unit
After classifying the video data that has been read as an event occurring as an event video, it is stored on the event server for a pre-specified time, a URL link address that allows the event video to be viewed externally is generated, and an event containing the URL link address is generated. An intelligent monitoring system that generates occurrence information and provides it to a notification unit. The method of claim 10, wherein the video monitoring unit
After an event occurs, when the event ends, the time zone in which the event occurred is memorized to generate event occurrence time information, and event termination information including the event occurrence time information is generated and provided to the notification unit. system.