KR102028147B1 - Integrated control system, video analysis device and local control server for controlling event - Google Patents

Abstract

The present invention relates to an integrated control system which comprises: an image analysis device for receiving image data from a plurality of cameras installed in a plurality of monitoring zones and analyzing the received image data; a sensor information managing device for collecting sensed sensor information from a plurality of sensors installed in the monitoring zones; a local control server for receiving an image analysis value for the image data from the image analysis device, receiving the sensed sensor information from the sensor information managing device, determining whether a predetermined event situation occurs on the basis of an image analysis value and the sensed sensor information, generating data related to the event situation in accordance with a determination result, and transmitting the same to a central control server; and a central control server for requesting the image analysis device for the image data corresponding to the event situation on the basis of the data related to the event situation received from the local control server and receiving the image data corresponding to the event situation from the image analysis device.

Description

INTEGRATED CONTROL SYSTEM, VIDEO ANALYSIS DEVICE AND LOCAL CONTROL SERVER FOR CONTROLLING EVENT}

The present invention relates to an integrated control system, an image analysis device, and a local control server for controlling an event situation.

CCTV control system plays a very important role in crime prevention and crime investigation through CCTV cameras and is installed and managed by central government or local government. The CCTV control system is operated by monitoring CCTV images stored in a local control server installed in a certain regional unit, and then transmitting all data to the central control server for monitoring in a control room (also called a situation room) of the central control server.

For example, a local government (hereinafter referred to as “local government”) establishes a central control server for each local government, and at the same time, divides the local area into several subunits (administrative units such as wards and counties, and facility units such as waterworks and sewerage). The local control server is installed in each sub-unit, and each local control server receives and stores the video data from CCTV linked to each local control server, and transmits the stored video data back to the central control server. .

In the conventional CCTV control system, the video data photographed from a plurality of CCTVs interlocked with the local control server is transmitted to the central control server server without filtering, and the video data is simultaneously displayed through a plurality of monitors of the central control server server. Even if there are several guards on duty, it's never easy to detect an accident.

In addition, since all the CCTV video data installed in the surveillance zone in charge of the local control server transmits to the central control server server to transmit a large amount of data, and thus the transmission network occupies the optical bandwidth.

Due to the limitation of capacity size and transmission bandwidth for video data transmitted to the central control server, CCTV camera pixels have to be installed and operated with low resolution. If the pixels of CCTV cameras are replaced with pixels of high resolution (eg, 1 million pixels or more), the resolution will be better, making it a much more useful surveillance system, but there is a burden of increasing the amount of data.

On the other hand, in the conventional CCTV control system, the video data transmitted to the actual central control server occupies most of the video data does not occur.

Korean Registered Patent Publication No. 0990362 (registered October 21, 2010)

The present invention is to solve the above-mentioned problems of the prior art, it is determined whether or not the occurrence of a predetermined event situation based on the image analysis value for the image data of the surveillance zone photographed from the local control server and the sensor information of the detection zone; Then, the image data corresponding to the event situation generated according to the determination result is to be transmitted to the central control server.

In addition, the present invention, the central control server requests the image data corresponding to the event situation to the image analysis device based on the data related to the event situation received from the local control server, and the image data corresponding to the event situation from the image analysis device Receiving to provide a more efficient control system.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, the integrated control system according to the first aspect of the present invention receives image data from a plurality of cameras installed in a plurality of surveillance zones, and analyzes the received image data Device; A sensor information management device that collects sensor information from a plurality of sensors installed in the plurality of monitoring zones; Receiving an image analysis value for the image data from the image analysis device, receiving the sensor information from the sensor information management device, whether a predetermined event situation occurs based on the image analysis value and the sensor information Determine, and generate the data related to the event situation according to the determination result and transmit the data to the central control server based on the data related to the event situation received from the local control server and the local control server. The apparatus may include a central control server for requesting image data corresponding to a situation and receiving image data corresponding to the event situation from the image analyzing apparatus.

An image analyzing apparatus according to a second aspect of the present invention includes an image data receiving unit for receiving image data from a plurality of cameras installed in a plurality of surveillance zones; An image storage unit for storing the received image data; An analyzer for analyzing the received image data and transmitting an image analysis value of the analyzed image data to a local control server; And a transmission unit which transmits the image data corresponding to the event situation to the central control server when the transmission request for the image data related to the event situation is received from the central control server. The data may be generated by the local control server according to whether or not a predetermined event situation occurs based on the image analysis value of the image data and the detection sensor information transmitted from the sensor information management devices installed in the plurality of monitoring zones. .

The local control server according to the third aspect of the present invention receives an image analysis value for image data photographed by a plurality of cameras installed in a plurality of surveillance zones from an image analysis device, and receives a plurality of detection sensors from the sensor information management device. Receiving unit for receiving the sensor information; A determination unit determining whether a predetermined event situation occurs based on the image analysis value and the sensor information; And a transmission unit configured to transmit data related to the event situation generated according to the determination result to a central control server, wherein image data corresponding to the event situation may be transmitted from the image analysis device to the central control server.

The above-mentioned means for solving the problems are merely exemplary, and should not be construed to limit the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the problem solving means of the present invention described above, the present invention stores all the video data in a non-centralized video analysis server, where all the video data is transmitted and stored in the central control server, and by the local control server By only transmitting the detected event situation to the central control server through the image analysis server, the amount of transmission for the image data can be greatly reduced.

Since the video analysis server adjusts and transmits a transmission frame of video data transmitted to the central control server 100 per unit time according to an event situation for disaster or crime prevention, it is possible to transmit high resolution video data without requiring expansion of network bandwidth. Low resolution of the conventional video can solve the problem of the substantial contribution of CCTV, and almost all of the video data transmitted from the control room of the central control server is significant and can significantly improve the control efficiency.

In addition, the present invention can configure the number of pixels of the camera installed in the plurality of surveillance zones in a high resolution, and can provide a useful image information and also provide a significant image to the central control room management personnel.

1 is a block diagram of an integrated control system according to an embodiment of the present invention.
FIG. 2 is a block diagram of the image analyzing apparatus shown in FIG. 1 according to an embodiment of the present invention.
3 is a flowchart illustrating a method of controlling an event situation through an image analyzing apparatus according to an embodiment of the present invention.
4 is a block diagram of the regional control server shown in FIG. 1, according to an embodiment of the invention.
5A to 5B are flowcharts illustrating a method of controlling an event situation according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

In the present specification, the term 'unit' includes a unit realized by hardware, a unit realized by software, and a unit realized by both. In addition, one unit may be realized using two or more pieces of hardware, and two or more units may be realized by one piece of hardware.

Some of the operations or functions described as being performed by a terminal or a device in the present specification may instead be performed in a server connected to the terminal or device. Similarly, some of the operations or functions described as being performed by the server may be performed by a terminal or a device connected to the server.

Hereinafter, with reference to the accompanying configuration diagram or processing flow chart, it will be described in detail for the practice of the present invention.

1 is a block diagram of an integrated control system according to an embodiment of the present invention.

Referring to FIG. 1, the integrated control system may include a central control server 100, a local control server 110, an image analysis device 120, and a sensor information management device 130. However, since the integrated control system of FIG. 1 is only one embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1 and may be configured differently from FIG. 1 according to various embodiments of the present invention.

In general, each component of the integrated control system of FIG. 1 is connected through a network (not shown). A network refers to a connection structure capable of exchanging information between nodes such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World). Wide Web), wired / wireless data communication network, telephone network, wired / wireless television communication network, and the like. Examples of wireless data networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, Infrared communication, Ultrasound Communication, visible light communication (VLC), liFi (LiFi), and the like, but are not limited thereto.

The sensor information management device 130 may collect a plurality of pieces of sensor information from a plurality of sensors installed in the plurality of monitoring zones, and determine a danger sign for a disaster or a method based on the collected pieces of sensor information. . For example, the sensor information management apparatus 130 may detect a situation in a surveillance area or a dangerous situation in a method when the number of sensing sensor information collected from a plurality of sensing sensors exceeds a preset number per unit time. Judging by In addition, the sensor information management device 130 may transmit the sensor information determined as a danger sign to the local control server 110.

For example, the sensor information management device 130 may collect a plurality of detection sensor information from a plurality of detection sensors for detecting whether a monitoring zone is fired or not. Here, the plurality of detection sensors may include, for example, a temperature sensor, a humidity sensor, a smoke sensor, a flame sensor, and the like.

The sensor information management device 130 collects, in real time, the temperature information, humidity information, and smoke amount information of the monitoring zone measured by the composite detection sensor from the composite detection sensor installed in the monitoring zone, and collects the collected temperature information, humidity information, and smoke. Signs of fire can be determined based on volume information. For example, the sensor information management apparatus 130 may increase the collected temperature information of the monitoring area continuously every predetermined time (for example, 1 minute) or exceed predetermined fire occurrence temperature information (for example, 40 degrees or more). In other cases, it may be determined that a fire has occurred in the monitoring area.

The sensor information management device 130 may determine that a fire has occurred in the monitoring area when the collected smoke amount information of the monitoring area continuously increases at a predetermined time or exceeds a predetermined fire occurrence smoke information (eg, 300 or more). Can be.

The sensor information management device 130 collects the temperature sensing information received from the temperature sensing sensor installed in the monitoring area, and the temperature sensing information of the monitoring area exceeds a predetermined temperature (eg, 90 degrees in the kitchen). If it is determined that the fire can be judged.

The sensor information management device 130 may determine a fire occurrence indication based on the flame occurrence information collected from the flame detection sensor installed in the monitoring area.

The sensor information management device 130 may transmit the collected temperature information, the smoke amount information, the quietness detection information, and the flame occurrence information of the monitoring area determined as the fire occurrence indication to the local control server 110.

The sensor information management device 130 may collect detection sensor information from a water level measurement sensor that measures a water level of a river, a river, a reservoir dam, or the like. For example, the sensor information management device 130 may continuously increase the real time water level information collected from the water level measurement sensor installed in the monitoring area (for example, 0.5 m or more per minute) or preset dangerous water level information (eg, If the risk level exceeds 80%), it may be determined as a suspected flood sign, and the water level information determined as suspected flood sign may be transmitted to the local control server 110. In addition, when the collected real-time water level information is less than predetermined low water level information (for example, 20% of water level), the sensor information management device 130 determines that the low water level is suspected and indicates the water level information determined as the low water level suspected area control server. May transmit to 110.

The sensor information management device 130 may collect detection sensor information from an intrusion detection sensor, theft detection sensor, and the like, which detects an invasion of an outsider into the monitoring area. For example, the sensor information management device 130 may include a first intrusion detection sensor (eg, an infrared sensor for detecting a horizontal plane, a laser sensor for detecting a vertical plane, and a radar sensor for detecting a three-dimensional space) for monitoring an outer area of the monitoring area. And the like, based on a plurality of detection sensor information collected through the second intrusion detection sensor (eg, an infrared sensor and a radar sensor) that monitors an interior area of the monitoring zone, and determines whether an outsider is invaded. When the suspicious suspicious signal is detected, detection sensor information indicating the suspicious suspicious signal may be transmitted to the local control server 110. For example, the sensor information management device 130 may be configured to detect sensor information collected from a burglar detection sensor (eg, a vibration sensor that detects vibrations when moving an object or a magnetic sensor that detects magnetic blockage when moving an object). On the basis of this, it is possible to detect whether the object placed in the surveillance area is stolen. The sensor information managing apparatus 130 may transmit the sensor information indicating the suspected theft suspect to the local control server 110 when theft of the object is detected.

The image analyzing apparatus 120 may receive image data from a plurality of cameras installed in the plurality of surveillance zones and store the received image data. Here, the plurality of cameras may include, for example, a fixed general camera, an infrared camera, a thermal camera, a PTZ camera (a camera capable of rotating up, down, left and right, and zooming in and out of an image) including a high resolution camera of 1 million pixels or more. Can be. The plurality of cameras may include an indoor camera photographing the inside of the surveillance zone and an outdoor camera photographing the outside of the surveillance zone. The plurality of cameras may include, for example, a fixed general camera, an infrared camera, a thermal imaging camera, a PTZ camera, and the like.

The image analyzing apparatus 120 stores the image data transmitted from the plurality of cameras to the second frame in the general image DB as the first frame, and for a predetermined period of time (eg, 15 seconds before the received image data is captured). ) May be temporarily stored in the temporary image DB as a second frame. Here, the second frame is a frame set as the maximum transmission frame of each camera and may be different for each camera. The first frame may be a frame obtained by compressing the second frame in a predetermined compression unit (eg, 1/2).

The image analyzing apparatus 120 analyzes image data received from a plurality of cameras to detect an event situation or crime (eg, intrusion, theft, kidnapping, abduction, arson, etc.) for a disaster (eg, fire, flooding, earthquake, rockfall, etc.). It is possible to determine whether an event situation for a vehicle accident, etc.) has occurred. The image analyzing apparatus 120 may detect an unexpected situation in the image when an event of a disaster or a crime occurs in the image data based on the average image data.

If it is determined that an event situation for a disaster or a crime occurs in the surveillance zone based on the received image data, the image analysis device 120 outputs an image analysis value for the related image data at which the event situation has occurred. ) Can be sent. For example, the image analyzing apparatus 120 may transmit the first image analysis value for the image data determined as the event situation for the disaster to the local control server 110. The image analyzing apparatus 120 may transmit a second image analysis value of the image data determined as the event situation for crime prevention to the local control server 110.

The local control server 110 may receive an image analysis value of the image data from the image analysis device 120 and receive sensor information from the sensor information management device 130.

The local control server 110 may classify and store the surveillance sensor information determined as a danger symptom in the surveillance area by a predetermined category, and set a criterion for determining an event situation for a disaster or a crime by using the previously stored surveillance sensor information. have.

The local control server 110 stores the monitoring sensor information received from the sensor information management device 130 for a predetermined period (for example, daily, monthly, etc.), and based on the average value of the monitoring sensor information stored for each predetermined period, The reference value for crime occurrence can be set. For example, the local control server 110 may be configured such that the temperature according to the occurrence of a fire in the monitoring zone is set at a predetermined temperature interval (for example, 0.5 degrees) from a normal room temperature (for example, a temperature between 30 and 40 degrees). When the temperature rises above a predetermined number of times (eg, three times or more) or rises above a predetermined number of times (eg, 50 degrees) or more, the temperature reference for determining a fire occurrence situation may be set. The local control server 110 may set a different temperature reference (for example, 30 degrees) for a winter fire occurrence and a temperature reference (for example, 40 degrees) for a summer fire occurrence, and determine a degree of temperature rise according to the fire occurrence. The criteria may be set differently according to the season.

For example, the local control server 110 may increase or preset the smoke generation amount according to the fire occurrence in the monitoring area by a preset smoke generation amount (eg, 50) per unit time or more (eg, three or more times). When the total amount of smoke generation (for example, 400) or more that is set more than the number of times increases, it may be set as the smoke generation criteria for determining the fire occurrence situation.

For example, the local control server 110 may set the case where the number of times of reception of the flame occurrence information received from the sensor information management device 130 exceeds a preset number as the flame generation criteria for determining the fire occurrence situation.

For example, the local control server 110 may set the case where the number of times of reception of the temperature sensing information received from the sensor information management device 130 exceeds a preset number as a temperature standard for determining the fire occurrence situation.

For example, the local control server 110 may set a reference value for flood generation based on river water level information stored for a predetermined period (eg, daily, monthly, etc.) and rainfall prediction information collected from the meteorological office server. For example, the regional control server 110 may determine whether or not the water level of the river continues to rise at a predetermined water level interval (for example, 0.5 m) per unit time or when the highest water level exceeds the risk level. Can be set with

For example, the local control server 110 is dangerous for determining the crime situation when the number of times of receiving the sensor information on the intrusion into the monitoring area collected from the sensor information management device 130 exceeds a preset number. Can be set as a reference.

The local control server 110 may determine whether an event situation related to a predetermined disaster or crime prevention occurs based on the image analysis value and the sensor information. For example, the local control server 110, if the image analysis value is a result associated with the fire occurrence of the monitoring zone, and the monitoring sensor information includes the temperature information, smoke amount information and flame occurrence information of the monitoring zone, the corresponding monitoring It may be determined that a fire has occurred in the area.

The local control server 110 may determine whether an event situation related to a disaster or a crime occurs by comparing the image analysis value, the detection sensor information, and a preset risk criterion. For example, the local control server 110 may determine whether the monitoring zone has a fire based on the image analysis value and whether the temperature information, the smoke amount information, and the flame occurrence information of the monitoring zone exceed a predetermined risk criterion related to the fire. You can judge.

The local control server 110 may determine whether an event situation related to a disaster or a crime occurs by comparing at least one of an image analysis value and detection sensor information with a preset risk criterion.

The local control server 110 may generate data related to the event situation for the disaster or crime prevention, and transmit the data related to the generated event situation to the central control server 100 according to the determination result. The local control server 110 may further transmit data related to the event situation to the mobile control terminal. Here, the data related to the event situation is, for example, the type of events occurring in the monitoring area, the information on the local control server 110 that determines the event situation (for example, the regional information, the local control server 110 jurisdiction jurisdiction) Identification information of the control server 110), and the identification information of the image analysis apparatus 120 interworking with the local control server 110. The data related to the event situation may include, for example, location information of the surveillance zone where the event situation occurred and information on a camera photographing the surveillance zone (eg, sensor information management for managing a plurality of detection sensors installed in the surveillance zone). Identification information of the camera associated with the device 130).

The local control server 110 may transmit data related to the event situation to the central control server 100 when at least one of the image analysis value and the sensor information exceeds a preset risk criterion.

When at least one of the image analysis value and the detection sensor information exceeds a preset risk criterion, the local control server 110 may receive a report on an event situation to a related authority.

When the at least one of the image analysis value and the detection sensor information exceeds a preset risk criterion, the local control server 110 may warn a warning device (eg, a warning light, a siren speaker, etc.) of the monitoring area linked with the sensor information management device 130. ) Can send a drive command to alert you to a dangerous situation in the watch area.

When the local control server 110 determines that an event related to a disaster or a crime has occurred through an image analysis value received from the image analysis device 120, the local control server 110 sends a confirmation message of occurrence of a disaster or crime to the image analysis device 120. I can deliver it.

When the video analysis device 120 receives a confirmation message of the occurrence of a disaster or a crime for an image analysis value from the local control server 110, the video analysis device 120 may recover the video data determined as an event situation for the disaster by the local control server 110. The image data may be stored in the image DB, and the image data determined as an event situation for the crime prevention by the local control server 110 may be stored in the crime prevention image DB. At this time, the image analyzing apparatus 120 stores the image data determined as the event situation for the disaster in the disaster image DB in the first frame unit, and the image data determined as the event situation for the crime in the second frame unit. Can be stored in the image DB. Here, the first frame unit may correspond to a basic frame unit (eg, 30 frames), and the second frame unit may correspond to a high frame unit (eg, 60 frames, 120 frames, etc.) compared to the first frame.

When the central control server 100 receives data related to an event situation for a disaster or crime prevention from the local control server 110, an image corresponding to the event situation is provided to the image analyzing apparatus 120 based on the data related to the event situation. You can request data.

The image analyzing apparatus 120 may adjust a transmission frame of image data transmitted to the central control server 100 per unit time according to an event situation.

When the image analyzing apparatus 120 receives a request for image data corresponding to an event situation for a disaster from the central control server 100, the image analysis device 120 displays the image data corresponding to the event situation for a disaster as a first frame. 100). In the event of a disaster, it is necessary to check the change of the entire screen rather than a specific part of the video screen, so that transmitting the high resolution video data in the first frame is sufficient to identify the disaster.

The image analyzing apparatus 120 may further transmit image data corresponding to a predetermined time (for example, 15 seconds) from the time at which the event situation for the disaster occurs to the central control server 100 in the first frame.

When the image analyzing apparatus 120 receives a request for image data corresponding to an event situation for crime prevention from the central control server 100, the image analysis device 120 displays image data corresponding to an event situation for crime prevention as a second frame. 100). In the event of crime prevention, it is important to identify a specific part of the video screen (e.g., to identify the suspect's appearance, identify the suspect's moving line, identify the vehicle number, etc.). By transmitting, the central control server 100 can quickly and accurately analyze images taken at various angles.

The image analyzing apparatus 120 may transmit image data corresponding to a predetermined time before the preset time from the time when the event situation of crime prevention occurs to the central control server 100 as a second frame.

As such, when the frame unit of the image data transmitted from the image analyzing apparatus 120 to the central control server 100 is adjusted according to the type of event situation, the central control server 100 generates an event according to the type of event situation. By calibrating the cause more accurately, central control can be improved.

Since the image data corresponding to the event situation transmitted from the image analyzing apparatus 120 to the central control server 100 is an eventual image, it is a meaningful image that needs to be concentratedly monitored. This image is carefully observed by the monitoring personnel through a monitor installed in the control room of the central control server 100.

The image data (the image data corresponding to the time before the preset time from the time of occurrence of the event situation) additionally transmitted from the image analysis device 120 to the central control server 100 may be used to determine the occurrence of the event situation. have.

The central control server 100 may store and store image data corresponding to an event situation received from the image analyzing apparatus 120. For example, the central control server 100 together with image data includes event situation-related index information (the recording date of the image data, the type of event situation, the location of the local control server 110, and the location information of the camera that captured the image data). ) Can be stored. The monitoring personnel of the central control server 100 may quickly check the event situation image through the event situation related index information.

The central control server 100 may include image data (image data received from the image analyzing apparatus 120) corresponding to an event situation selected by the local control server 110, types of event situations, and location information on which event situations are generated. Is displayed on the monitor, and the monitoring personnel monitor and take action by notifying the occurrence of the event situation through an alarm device (eg, a siren speaker, etc.). For example, the monitoring agent may determine the event situation occurred through the image data corresponding to the event situation. Surveillance personnel can use the image data corresponding to the event situation to identify the appearance and movement of outsiders who have entered the surveillance area.

The central control server 100 may output information (eg, a contact point of a related agency, a contact point of contact, etc.) of a related organization (eg, a police station) that processes the event situation so that the central control server 100 may act on the event situation. have.

If necessary, the central control server 100 may load the image data so that the image data related to the event situation may be further confirmed through interworking with a plurality of cameras photographing the monitoring area where the event situation occurs.

In another embodiment, the local control server 110 may be a memory for storing all the images taken by the plurality of cameras installed in the plurality of surveillance zones and the image database accordingly. Such a local control server 110 has a NVR (Network Video Recorder) function, it can detect and select the event (event) situation by analyzing the captured image of the surveillance area by itself. When an event is found by monitoring whether there is an eventual image while reproducing an image in real time by a streaming method, only the corresponding eventual image may be selected and transmitted to the central control server 100. Since the image is high resolution, the amount of data per scene is larger than that of the existing low resolution image, but since only the eventual image is selected, the overall data transmission amount is reduced, so that the existing network system (bandwidth) can be maintained. Despite the high resolution video data, the number of video channels to be transmitted can be reduced so that valid video can be transmitted regardless of the transmission limit of the network.

Here, the image transmitted from the local control server 110 to the central control server 100 is an eventful image, so it is a meaningful image that needs to be monitored centrally, and the monitoring agent is provided to the monitoring personnel through a monitor installed in the control room of the central control server 100. Is carefully observed by. Since only event-like video is transmitted in this manner, it is not necessary to install a large number of monitors as in the prior art, and thus only a small number of monitors may be installed.

The central control server 100 can be called for observation through the communication module and the search module of the CCTV camera for the image data that needs to be observed among the untransmitted data, and visits the local control server 110 to view the image. You can also search and display. In such a case, the local control system does not need to configure a separate server can further simplify the equipment.

The local control server 110 stores all the video data at regular time intervals, makes it easy to search by marking the recording time, and requests and responds to each time zone even when a call is requested from the central control server 100. .

Meanwhile, the local control server 110 may receive a backup through the web hard storage device by connecting the web hard storage device for automatic backup. In this case, it is preferable to place the web hard storage device at a considerable distance in order to safely store the backup data in the event of a fire that may occur at the local control server 110.

By doing the above, it is possible to effectively monitor video without effectively monitoring the meaningless image data in the control room of a large screen, and to transmit high quality video without burden for network transmission. do.

Hereinafter, the operation of each component of the integrated control system of FIG. 1 will be described in more detail.

FIG. 2 is a block diagram of the image analyzing apparatus 120 shown in FIG. 1, according to an exemplary embodiment.

Referring to FIG. 2, the image analyzing apparatus 120 may include an image data receiving unit 200, an image storing unit 210, an analyzing unit 220, and a transmitting unit 230. The image storage unit 210 may include a general image storage unit 212, a temporary image storage unit 214, a disaster image storage unit 216, and a security image storage unit 218. However, the image analyzing apparatus 120 shown in FIG. 2 is only one implementation example of the present invention, and various modifications may be made based on the components shown in FIG. 2.

The image data receiver 200 may receive image data from a plurality of cameras installed in the plurality of surveillance zones. Here, the plurality of cameras may include, for example, a fixed general camera, an infrared camera, a thermal camera, a PTZ camera (a camera capable of rotating up, down, left and right, and zooming in and out of an image) including a high resolution camera of 1 million pixels or more. Can be.

The image storage unit 210 may store image data received from a plurality of cameras.

The general image storage unit 212 may store image data received from a plurality of cameras as a first frame. For example, the general image storage unit 212 may compress and store image data transmitted from a plurality of cameras to a second frame into a first frame. Here, the second frame is a frame set as the maximum transmission frame of each camera and may be different for each camera. The first frame is a frame in which the second frame is compressed in a predetermined compression unit (for example, 1/2). For example, when the second frame is 60 frames per second (FPS), the first frame is 30 FPS, If the second frame is 30 FPS, the first frame may be 15 FPS.

The temporary image storage unit 214 may temporarily store image data corresponding to the second frame for a predetermined period (for example, 15 seconds) from the time when the received image data is captured. Here, the image data temporarily stored as the second frame (eg, image data corresponding to 15 seconds before the occurrence of the event situation) may be used by the central control server 100 to determine the occurrence of the event situation.

The analyzer 220 may analyze the received image data and transmit the image analysis value of the analyzed image data to the local control server 110.

In detail, the analysis unit 220 analyzes the received image data to detect an event situation or a crime (eg, intrusion, theft, abduction, kidnapping, arson, vehicle accident) for a disaster (eg, fire, flooding, earthquake, rockfall, etc.). Etc.), it may be determined whether an event situation has occurred. For example, the analyzer 220 may detect an unexpected situation in the image when an event of a disaster or a crime occurs in the image data based on the average image data.

For example, the analysis unit 220 is dangerous in the surveillance zone when the behavior of an external object (such as invading into the surveillance zone or stealing an object) related to a predetermined unacceptable behavior pattern in the surveillance zone is detected in the image data. It can be determined that a situation has occurred. Alternatively, the analysis unit 220 may determine whether a disaster has occurred by comparing image data captured by a plurality of cameras in real time on a time series basis and confirming an image change between previous image data and current image data.

When it is determined that an event situation for a disaster or a crime occurs in the surveillance zone based on the received image data, the analysis unit 220 outputs an image analysis value for the related image data at which the event situation has occurred, the local control server 110. Can be sent to. For example, the analyzer 220 may transmit the first image analysis value to the local control server 110 with respect to the image data determined as the event situation for the disaster. The analyzer 220 may transmit the second image analysis value to the local control server 110 with respect to the image data determined as the event situation for the crime prevention.

When the disaster image storage unit 216 receives the event occurrence confirmation message of the disaster for the image analysis value from the local control server 110, the disaster image storage unit 216 stores the image data determined as the event situation for the disaster by the local control server 110. Can be. At this time, the disaster image storage unit 216 may store the image data determined as the event situation for the disaster by the local control server 110 in the first frame.

When the crime prevention image storage unit 218 receives a confirmation message of the occurrence of the crime for the image analysis value from the local control server 110, it may store the image data determined as the event situation for the crime by the local control server 110. have. At this time, the security image storage unit 218 may store the image data determined as the event situation for the crime by the local control server 110 as a second frame.

When receiving the transmission request for the image data related to the event situation from the central control server 100, the transmitter 230 may transmit the image data corresponding to the event situation to the central control server 100. Here, the image data related to the event situation is an image analysis value (value for the image data determined as the event situation for the disaster or method transmitted from the image analysis device 120 to the local control server 110) and detection sensor information ( The data may be generated by the local control server 110 based on information transmitted from the sensor information management device 130 installed in the plurality of monitoring zones to the local control server 110. In addition, the image data related to the event situation may be data generated by the local control server 110 according to whether a predetermined event situation occurs.

When the transmission unit 230 receives a request for video data corresponding to an event situation for a disaster from the central control server 100, the transmitter 230 extracts video data corresponding to an event situation for a disaster from the disaster image storage unit 216. The first frame can be transmitted to the central control server 100. In addition, the transmitter 230 extracts the image data corresponding to the time before the preset time from the time when the event situation for the disaster occurs from the temporary image storage unit 214 and further to the central control server 100 in the first frame. Can transmit For example, the transmitter 230 may further transmit image data corresponding to 15 seconds before an event situation for a disaster occurs to the central control server 100.

When the transmission unit 230 receives a request for the image data corresponding to the event situation for the crime prevention from the central control server 100, extracts the image data from the crime prevention image storage unit 218 to the central control server in the second frame 100 can be sent. In addition, the transmitter 230 extracts the image data corresponding to the time before the preset time from the time when the event situation for the crime occurred from the temporary image storage unit 214 and further to the central control server 100 as a second frame. Can transmit For example, the transmitter 230 may further transmit image data corresponding to 15 seconds before the event situation for the crime is generated to the central control server 100.

On the other hand, those skilled in the art, the general image storage unit 212, the temporary image storage unit 214, the disaster image storage unit 216 and the crime prevention image storage unit 218 is implemented separately, or one or more of them are integrated It will be appreciated that it can be implemented.

3 is a flowchart illustrating a method of controlling an event situation through the image analyzing apparatus 120 according to an embodiment of the present invention.

Referring to FIG. 3, in operation S301, the image analyzing apparatus 120 may receive image data from a plurality of cameras installed in a plurality of surveillance zones.

In operation S303, the image analyzing apparatus 120 may store the received image data.

In operation S305, the image analyzing apparatus 120 may analyze the received image data and transmit the image analysis value of the analyzed image data to the local control server 110.

In operation S307, when the image analyzing apparatus 120 receives a transmission request for the image data related to the event situation from the central control server 100, the image analyzing apparatus 120 may transmit the image data corresponding to the event situation to the central control server 100. .

In the above description, steps S301 to S307 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between the steps may be changed.

4 is a block diagram of the regional control server 110 shown in FIG. 1, in accordance with an embodiment of the present invention.

Referring to FIG. 4, the local control server 110 may include a receiver 400, a determiner 410, a transmitter 420, and an event status reporter 430. However, the local control server 110 shown in FIG. 4 is just one embodiment of the present invention, and various modifications are possible based on the components shown in FIG. 4.

The receiver 400 may receive an image analysis value from the image analysis device 120 and receive sensor information from the sensor information management device 130. Here, the image analysis value is an image analysis value of image data captured by a plurality of cameras installed in the plurality of surveillance zones, and the sensor information is an event among the sensor sensors collected from the plurality of sensing sensors installed in the plurality of surveillance zones. It may include the detection sensor information determined to occur.

The determination unit 410 may classify and store the surveillance sensor information determined as a danger sign in the surveillance zone for each preset category, and set a criterion for determining an event situation for a disaster or a crime by using the previously stored surveillance sensor information. .

The determination unit 410 may set a reference value for disaster or crime occurrence based on the average value of the monitoring sensor information stored for each period. For example, the determination unit 410 may be a preset temperature interval (for example, 0.5 degrees) from a normal room temperature (for example, a temperature between 30 degrees and 40 degrees) in accordance with the occurrence of a fire in the monitoring zone When the temperature rises more than the number of times (eg, three times or more) or rises more than the predetermined number of times (eg, 50 degrees) or more, the temperature reference for determining the fire occurrence situation may be set.

The determination unit 410 may determine whether an event situation related to a preset disaster or crime prevention occurs based on the image analysis value and the sensor information. For example, when the image analysis value is a result value related to a fire occurrence in the monitoring zone, and the monitoring sensor information includes temperature information, smoke amount information, and flame generation information of the monitoring zone, the corresponding monitoring zone. A fire can be determined at.

The determination unit 410 may determine whether an event situation related to a disaster or a crime occurs by comparing the image analysis value, the sensor information, and the preset risk criteria. For example, the determination unit 410 determines whether the image analysis value of the fire is the same as at least one of the reference values classified as the preset event situation, and the temperature information, the smoke amount information, and the flame occurrence information of the monitoring area are related to the fire. It is possible to determine whether a fire has occurred in the monitoring area based on whether or not a predetermined risk criterion is exceeded.

Alternatively, the determination unit 410 may determine whether an event situation related to a disaster or crime prevention occurs by comparing at least one of the image analysis value and the sensor information with a preset risk criterion. For example, if the image analysis value for the fire is the same as at least one of the reference values classified as the preset event situation, the determination unit 410 determines that the fire event situation occurs, or detects sensor information (temperature information, smoke amount). Information and flame occurrence information) may exceed the pre-determined risk criteria associated with the fire.

The transmitter 420 may transmit data related to the event situation generated according to the determination result to the central control server 100. In addition, the transmitter 420 may further transmit data related to the event situation to the mobile control terminal.

The transmitter 420 may transmit data related to the event situation to the central control server 100 when at least one of the image analysis value and the sensor information exceeds a preset risk criterion.

Here, the data related to the event situation is, for example, the type of events occurring in the monitoring area, the information on the local control server 110 that determines the event situation (for example, the regional information, the local control server 110 jurisdiction jurisdiction) Identification information of the control server 110), and the identification information of the image analysis apparatus 120 interworking with the local control server 110. The data related to the event situation may include, for example, location information of the surveillance zone where the event situation occurred and information on a camera photographing the surveillance zone (eg, sensor information management for managing a plurality of detection sensors installed in the surveillance zone). Identification information of the camera associated with the device 130).

If at least one of the image analysis value and the detection sensor information exceeds a preset risk criterion, the event situation reporting unit 430 may receive a report on the event situation to a related authority.

Meanwhile, those skilled in the art will fully understand that each of the receiver 400, the determiner 410, the transmitter 420, and the event status reporter 430 may be implemented separately, or one or more of them may be integrated and implemented. will be.

5A to 5B are flowcharts illustrating a method of controlling an event situation according to an embodiment of the present invention.

Event situation control method according to the embodiment shown in Figures 5a to 5b is the central control server 100, the local control server 110, the image analysis device 120 and the sensor according to the embodiment shown in Figs. It includes the steps that are processed in time series in the information management device 130. Therefore, although omitted below, contents described with respect to the central control server 100, the local control server 110, the image analysis device 120, and the sensor information management device 130 of FIGS. 1 to 4 are illustrated in FIG. 5A. It may also be applied to the event situation control method according to the embodiment shown in the to 5b.

5A through 5B, in operation S501, the image analyzing apparatus 120 may receive image data from a plurality of cameras installed in a plurality of surveillance zones.

In operation S503, the image analyzing apparatus 120 stores the received image data as a first frame in the general image storage unit 212, and stores the image data corresponding to the second frame for a predetermined period from the time when the image data was captured. The temporary image storage unit 214 may be temporarily stored.

In operation S505, the image analysis apparatus 120 may analyze the received image data, and transmit the image analysis value for the image data analyzed in operation S507 to the local control server 110.

In operation S509, the local control server 110 may receive sensing sensor information from the sensor information management device 510. Here, the sensing sensor information may include sensing sensor information determined as an event occurrence state among the sensing sensor information collected from the plurality of sensing sensors installed in the plurality of monitoring zones.

In operation S511, the local control server 110 may determine whether an event situation for a disaster or a crime occurs based on the image analysis value and the sensor information.

In operation S513, the image analysis device 120 may receive a notification message of occurrence of a disaster or crime event situation for the image analysis value from the local control server 110.

In operation S515, when the image analyzing apparatus 120 receives a notification message of occurrence of an event situation of a disaster for an image analysis value, the image analyzing apparatus 120 stores image data determined by the local control server 110 as an event situation of a disaster. The unit 216 may store the first frame. When the image analysis device 120 receives a notification message of occurrence of an event of crime prevention for an image analysis value, the image analysis device 120 stores the image data determined as an event situation of crime by the local control server 110. ) As a second frame.

In operation S517, when it is determined that the event situation for disaster or crime occurs based on the image analysis result value and the detection sensor information, the local control server 110 sends an event for disaster or crime prevention to the central control server 100. You can send data related to the situation. Here, the data related to the event situation may include, for example, location information of the surveillance zone where the event situation occurred and information about a camera photographing the surveillance zone.

In operation S519, when the central control server 100 receives data related to the event situation for the disaster from the local control server 110, the central control server 100 requests image data corresponding to the event situation for the disaster to the image analysis device 120. Can be.

In operation S521, when the image analysis apparatus 120 receives a request for image data corresponding to an event situation for a disaster from the central control server 100, the image analysis device 120 may receive image data corresponding to an event situation for a disaster. 216 may be extracted and transmitted to the central control server 100 in the first frame.

In operation S523, the image analyzing apparatus 120 extracts image data corresponding to a preset time from a time when an event situation for a disaster occurs, from the temporary image storage unit 214, and the central control server 100 as a first frame. Can be sent further.

In step S525, when the central control server 100 receives data related to the event situation for crime prevention from the local control server 110, requests the image data corresponding to the event situation for crime prevention to the image analysis device 120. Can be.

In operation S527, when the image analyzing apparatus 120 receives a request for the image data corresponding to the event situation for the crime prevention from the central control server 100, the image analysis device 120 stores the image data corresponding to the event situation for the crime prevention. 218 may be extracted and transmitted to the central control server 100 in a second frame.

In operation S529, the image analysis apparatus 120 extracts image data corresponding to a preset time from the time when the event situation for crime is generated from the temporary image storage unit 214, and the central control server 100 as a second frame. Can be sent further.

In the above description, steps S501 to S529 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between the steps may be changed.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. .

100: central control server
110: regional control server
120: video analysis device
130: sensor information management device

Claims (18)

In the integrated control system,
An image analysis device configured to receive image data from a plurality of cameras installed in a plurality of surveillance zones and to analyze the received image data;
A sensor information management device that collects sensor information from a plurality of sensors installed in the plurality of monitoring zones;
Receiving an image analysis value for the image data from the image analysis device, receiving the sensor information from the sensor information management device, whether a predetermined event situation occurs based on the image analysis value and the sensor information And a local control server generating data related to the event situation according to the determination result and transmitting the data to a central control server;
A center for requesting image data corresponding to the event situation to the image analyzing apparatus based on data related to the event situation received from the local control server, and receiving image data corresponding to the event situation from the image analyzing apparatus; Control server
Including,
The image analyzing apparatus stores a general image storing unit storing the received image data as a first frame and a temporary image storing unit temporarily storing the received image data as a second frame for a predetermined period from a time at which the image data is captured. Integrated control system, comprising a wealth.
The method of claim 1,
The local control server
And comparing the image analysis value and the detection sensor information with a preset risk criterion to determine whether the event situation occurs.
The method of claim 2,
The local control server
And transmitting data related to the event situation to a central control server when at least one of the image analysis value and the sensor information exceeds a preset risk criterion.
The method of claim 2,
The local control server
And if the at least one of the image analysis value and the detection sensor information exceeds a preset risk criterion, reporting the event situation to a related authority.
The method of claim 1,
And the data related to the event situation includes location information of the surveillance zone where the event situation occurred and information about a camera photographing the surveillance zone.
The method of claim 1,
The image analysis device
Analyzing the image data received from the plurality of cameras to determine the occurrence of the event situation for disaster or crime prevention,
If it is determined that the event situation for the disaster or crime, the integrated control system for transmitting the video analysis value for the relevant video data generated the event situation to the local control server.
The method of claim 6,
The image analysis device
Storing image data determined as an event situation of the disaster by the local control server as a first frame,
And storing the image data determined as the event situation for the crime prevention by the local control server as a second frame.
The method of claim 7, wherein
The image analysis device
And when the request for the image data corresponding to the event situation for the disaster is received from the central control server, the image data is transmitted to the central control server in the first frame.
The method of claim 7, wherein
The image analysis device
And when the request for the image data corresponding to the event situation for the crime prevention is received from the central control server, the image data is transmitted to the central control server in the second frame.
In the image analysis device,
An image data receiver configured to receive image data from a plurality of cameras installed in the plurality of surveillance zones;
An image storage unit for storing the received image data;
An analyzer for analyzing the received image data and transmitting an image analysis value of the analyzed image data to a local control server; And
When receiving a transmission request for the image data related to the event situation from the central control server, including a transmission unit for transmitting the video data corresponding to the event situation to the central control server,
The image data related to the event situation may be controlled according to whether or not a predetermined event situation occurs based on an image analysis value of the image data and detection sensor information transmitted from sensor information management devices installed in the plurality of monitoring zones. Data generated by the server,
The image storage unit
A general image storage unit storing the received image data as a first frame;
And a temporary image storage unit which temporarily stores the received image data as a second frame for a predetermined period from the time when the image data is photographed.
delete The method of claim 10,
The image storage unit
Disaster image storage unit for storing the image data determined as the event situation for the disaster by the local control server as a first frame and
And a security image storage unit storing image data determined as an event situation for crime prevention by the local control server as a second frame.
The method of claim 12,
The transmission unit
When receiving a request for video data corresponding to the event situation for the disaster from the central control server,
Extracting the image data from the disaster image storing unit and transmitting the extracted image data to the central control server in the first frame;
And extracting image data corresponding to a predetermined time from the time at which the event situation for the disaster occurs, from the temporary image storage unit and further transmitting the image data to the central control server in the first frame.
The method of claim 12,
The transmission unit
When the request for the image data corresponding to the event situation for the crime prevention from the central control server,
Extracting the image data from the security image storage unit and transmitting the image data to the central control server in the second frame;
And extracting image data corresponding to a preset time from the time when the event situation for crime prevention occurs from the temporary image storage unit and further transmitting the image data to the central control server in the second frame.
Local control server,
A receiver configured to receive an image analysis value of the image data photographed by the plurality of cameras installed in the plurality of surveillance zones from the image analysis apparatus and to receive sensing sensor information of the plurality of sensing sensors from the sensor information management apparatus;
A determination unit determining whether a predetermined event situation occurs based on the image analysis value and the sensor information; And
Including a transmission unit for transmitting the data related to the event situation generated in accordance with the determination result to the central control server,
Image data corresponding to the event situation is transmitted from the image analysis device to the central control server,
The photographed image data is stored by the image analyzing apparatus, and the image analyzing apparatus is configured to store the photographed image data as a first frame and a predetermined image period for a predetermined period from a time at which the image data is photographed. Local control server, comprising a temporary video storage for temporarily storing in two frames.
The method of claim 15,
The determination unit
And comparing the image analysis value and the detection sensor information with a preset risk criterion to determine whether the event situation occurs.
The method of claim 16,
The transmission unit
And transmitting data related to the event situation to a central control server when at least one of the image analysis value and the sensor information exceeds a preset risk criterion.
The method of claim 16,
If the at least one of the image analysis value and the detection sensor information exceeds a predetermined risk criterion, the local control server further comprises an event situation reporting unit for receiving a report on the event situation to the relevant authority.

Images