KR102165276B1 - Integrated server for remote controlling and method thereof - Google Patents

Abstract

The present invention relates to a method of remotely monitoring and controlling various facilities in a control system. For this, an integrated control system uses a dual network, compresses, stores, and transmits images based on international standard protocols and displays events. The method includes the steps of: performing communication between at least one user and at least one control server through a first network; allowing each of the at least one control server to communicate with a plurality of at least one video recording device, at least one equipment, at least one sensor, and ROS in the control system connected to the control server through the second network by at least one network IP; and allowing a user to communicate with the control server through a first network to control at least one of at least one video recording device, at least one equipment, at least one sensor, and ROS in the control system connected to the control server through the second network by one network IP.

Description

Integrated server for remote controlling and method thereof {Integrated server for remote controlling and method thereof}

The present invention relates to a method of remotely monitoring and controlling various facilities in a control system.

Various high-risk production facilities installed in the control system monitor the situation around the production facilities using video recording systems such as CCTV, DVR, and NVR. However, in order to control various production facilities that use independent systems, there is a problem in that different clients must be used, and different IPs must be allocated and controlled by connecting to different networks. This incurs high installation costs and maintenance costs, and because users can directly connect to each control system, there is a weakness in management and security.

In addition, when a problem occurs in one control system among various production facilities, there is a problem that affects the entire network. For example, in the case of a large-capacity Network Video Recorder (NVR) system that stores and transmits images of hundreds of cameras, if a problem occurs in the NVR system, the entire production facility system is affected.

KR 10-1682982 B1

In the present invention, in order to solve the problems of the prior art, it is intended to control and control various production facilities by assigning a single IP through a remote integrated control system and remote integrated control method that provides image transmission and event display functions based on international standard protocols. .

In a preferred embodiment of the present invention, the control server comprises: a first communication unit for performing communication with a user through a first network; A second communication unit for performing communication with the control system through a second network; An authentication unit for authenticating a user performing communication through the first communication unit; A surveillance image receiver configured to receive image data stored in ONVIF and RTSP protocol formats after the surveillance image captured by at least one image recording device installed inside the control system is compressed; A facility data receiver configured to receive facility data stored in ONVIF and RTSP protocol formats after data received from at least one display connected to at least one facility installed in the control system is compressed; A sensor data processing unit for generating a first reconstructed image by adding sensing data received by at least one sensor installed in the control system to the image data or to the facility data and then recompressing it; An integrated image generator configured to collect at least one of the image data, the facility data, and the first reconstructed image and recompress it into a second reconstructed image to be displayed on one display; The integrated image generator provides a notification to the user when an event is detected in at least one of the image data, the facility data, and the first reconstructed image, and when the user receives the notification, the image data corresponding to the detected event, A selection interface unit configured to select at least one of the facility data and the first reconstructed image; and at least one of the image data, the facility data, and the first reconstructed image corresponding to a detected event selected through the selection interface Including, a monitoring image receiving unit, a facility data receiving unit, a sensor data processing unit, an integrated image generating unit, a selection interface unit, and a transmitting unit, characterized in that the communication is performed by one network IP within the second network. Control server.

In yet another embodiment of the present invention, a method for integrated control of a facility from a remote location includes performing communication between at least one user and at least one control server through a first network; Each of the at least one control server includes at least a plurality of at least one video recording device, at least one facility device, at least one sensor, and ROS (Remote Operating System, remote control system) connected to the control server through a second network. Performing communication with one network IP; And by performing communication with the control server through the first network, the user at least one video recording device connected to the control server through a second network, at least one equipment, Controlling and controlling with at least one sensor, at least one of ROS (Remote Operating System, remote control system) and one network IP; Including, the image received from the at least one image capturing device or the at least one The data received from the display connected to the equipment of the device is compressed and then stored in ONVIF and RTSP protocol formats and transmitted to the control server, and the sensing data sensed by the at least one sensor is received from the at least one image recording device It is added to an image or data received from a display connected to the at least one equipment and is used to generate a first reconstructed image, and an image received from the at least one image capturing device and received from a display connected to the at least one equipment A second reconstructed image that can be displayed on a single display is generated based on one data or at least one of the first reconstructed image, and the first reconstructed image and the second reconstructed image are recompressed to form ONVIF and RTSP protocols. Is stored as a control server and transmitted to the control server, and the control server is connected to the control server through the second network communication only after authentication from the control server and the user performing communication through the first network. At least one of an image received from one imaging device, data received from a display connected to the at least one equipment, and the first reconstructed image and the second reconstructed image A method comprising controlling or receiving a selection and controlling the at least one facility device or a device connected to the at least one facility device through wired or wireless communication through the ROS.

As a preferred embodiment of the present invention, when the second reconstructed image includes N images or data, a network load generated when a user performing communication through the first network controls the second reconstructed image is 1 /N.

In a preferred embodiment of the present invention, the first network is an external network, the second network is an internal network, and the user is restricted from direct access to the second network, and the control server is connected only after authentication is performed. Control and control of at least one image capture device, at least one equipment, at least one sensor, and ROS capable of communicating within the second network using the one network IP allocated from the second network through It is possible, and the control server uses the one network IP to communicate at least one image capture device, at least one equipment, at least one sensor, and the image and data collected from the ROS. A method comprising storing a history and providing an alarm to a user when an event is detected from the collected image or data.

As a preferred embodiment of the present invention, the second reconstructed image is an image received from the at least one image capturing device connected to the control server, data received from a display connected to the at least one equipment, or the first reconstructed image When an event is detected in at least one of the images, the detected event information is displayed.

As another preferred embodiment of the present invention, the integrated control server includes at least one of an IP camera, an SDI camera, an AHD camera, a digital video recorder (DVR), a network video recorder (NVR), and a CCTV installed inside the control system. A surveillance image receiver configured to receive image data stored by compressing surveillance images in various formats captured by the image capturing apparatus and converting them into ONVIF and RTSP protocol formats; A facility data receiving unit for compressing data received from at least one display connected to at least one facility installed inside the control system and receiving facility data stored in ONVIF and RTSP protocol formats; A sensor data processing unit for generating a first reconstructed image by adding sensing data received from at least one sensor installed in the control system to the image data or to the facility data and then recompressing it in ONVIF and RTSP protocol formats; A ROS unit for controlling at least one of the image photographing apparatus, the at least one equipment, and at least one sensor installed inside the control system; An integrated image generator configured to collect at least one of the image data, the facility data, and the first reconstructed image according to ONVIF and RTSP protocol formats, and recompress and generate a second reconstructed image to be displayed on one display; An event display unit for displaying an event on the second reconstructed image when an event occurs in at least one of the image data, the facility data, and the first reconstructed image; A first communication unit for performing communication with a user through an external network; And a second communication unit for performing communication with the control system through an internal network; Including, the surveillance image receiving unit, the facility data receiving unit, the sensor data processing unit and The integrated image generator is characterized in that the communication is performed through one network IP within the second network.

As a preferred embodiment of the present invention, the integrated image generator provides a notification to the user when an event is detected in at least one of the image data, the facility data, and the first reconstructed image, and the user notifies the user. Upon reception, a transmission unit for selecting and transmitting at least one of the image data, the facility data, and the first reconstructed image corresponding to the detected event.

As a preferred embodiment of the present invention, a user accesses an integrated control server through the first communication unit, and an IP camera, SDI camera, AHD camera, DVR (Digital Video Recorder) installed inside the control system through the integrated control server. ), a video recording apparatus including at least one of a network video recorder (NVR), and a CCTV, and controlling and controlling at least one of the at least one equipment.

As a preferred embodiment of the present invention, the method for integrated control of facilities from a remote location and the integrated control server uses only one client, using the international standard Onvif and RTSP protocols for camera information and equipment screens input in various formats. Therefore, there is an effect of implementing to enable monitoring and control. In addition, environmental information such as various images and sensor information is received in one system, converted into an international standard, and stored and transmitted to ensure effective operation of a specific function between all devices supporting the international standard. In addition, when using multiple control systems such as cameras and sensors, as well as security enhancement through dual networks, one single IP is used in the external network, which has advantages in reducing network installation costs and maintaining maintenance.

1 shows a system diagram in which a method for integrated control of facilities in a remote location is implemented as a preferred embodiment of the present invention.
2 to 3 shows an example of an integrated control system as a preferred embodiment of the present invention.
Figure 4 is a preferred embodiment of the present invention, showing a flow chart of a method for integrated control of facilities in a remote location.
5 is a preferred embodiment of the present invention, and shows an example of a first reconstructed image.

Hereinafter, it will be described with reference to the drawings.

1 shows a system diagram in which a method for integrated control of facilities in a remote location is implemented as a preferred embodiment of the present invention. 2 to 3 shows an example of an integrated control system as a preferred embodiment of the present invention. It will be described with reference to FIGS. 1 to 3 as follows.

As a preferred embodiment of the present invention, the integrated control system 100 uses a dual network. The integrated control system 100 communicates with the first network through the user 120 and the first communication unit 130, and connects various facilities and a second network in the control system 110 through the second communication unit 132. Communication through In this case, all of the various facilities in the control system 110 use the same network IP.

As a preferred embodiment of the present invention, the user 120 can only access the integrated control system 100 from an external network through the first communication unit 130, and the user 120 is external to the integrated control system 100. By limiting the ability to control various facilities in the control system 110 directly through the internal network without being connected through a network, facilities in the control system 110 can be protected from external users.

As a preferred embodiment of the present invention, in order to perform control of facilities in the control system 110, the user can control the integrated control system 100 only after receiving authentication from the authentication unit 131 in the integrated control system 100. By accessing the internal network through the second communication unit 132 of the control system 110, it is possible to control various facilities, image recording devices, and sensors inside the control system 110.

As a preferred embodiment of the present invention, the integrated control system 100 can be implemented in the form of a control server or a single device, and the user accesses the control server or the integrated control system 100 implemented in the form of a single device. It is possible to control various facilities, sensors, and image recording devices inside the control system 110.

As a preferred embodiment of the present invention, a user only needs to connect to one integrated control system 100 to control various facilities in the control system 110. In addition, since a separate NVR is connected to the external network and the external network does not store image information, the network load of the internal network (FIGS. 2, 210a or 3, 300a) in which the control system 110 is installed is applied to the external network (FIG. 3). , 300b).

Referring to an example of the integrated control system shown in Figs. 2 to 3, the control system (Figs. 2, 210a, 300a of Fig. 3) includes at least one image recording device (335A, 335B), at least one equipment, At least one sensor 339, and ROS (Remote Operating System, remote control system) 250 are installed.

The integrated control system 100 can control or control at least one of at least one image recording device, at least one facility device, at least one sensor, and ROS in the control system 110 using one network IP. . In addition, the ROS 150 may be used to control at least one of an image photographing apparatus installed in the control system 110, at least one equipment, and at least one sensor.

Referring to FIG. 1 again, the integrated control system 100 includes at least one image in the first communication unit 130, the second communication unit 132, the authentication unit 131, the storage unit 133, and the control system 110. From a surveillance image receiving unit 135 receiving a surveillance image from a photographing device, a facility data receiving unit 137 receiving facility data from a display connected to at least one facility in the control system 110, and a sensor installed in the control system 110 It includes a sensor data receiving unit 139 for receiving sensor data. In addition, a sensor data processing unit 140 that generates a first reconstructed image using the monitoring image, facility data, and sensor data, generates a second reconstructed image using the monitoring image, facility data, and the first reconstructed image, and event And an integrated image generation unit 142 that displays or provides a notification, and a transmission unit 144 that transmits a surveillance image, facility data, and a first reconstructed image selected by the user.

The surveillance image receiving unit 135 to the facility data receiving unit 137 may each receive images or facility data compressed and stored in ONVIF and RTSP protocol formats from at least one image capturing device and a display connected to at least one facility. Alternatively, the surveillance image receiving unit 135 to the facility data receiving unit 137 receive and compress the raw-data format image data and facility data received from at least one image capturing device and a display connected to at least one facility, respectively. And it can be stored in the storage unit 133 by storing in ONVIF and RTSP protocol format.

As a preferred embodiment of the present invention, at least one video recording device includes at least one of an IP camera, an SDI camera, an AHD camera, a digital video recorder (DVR), a network video recorder (NVR), and a CCTV, and After compressing the surveillance video in the format, it can be converted to ONVIF/RTSO protocol format and saved.

In a preferred embodiment of the present invention, each of at least one facility is connected to each monitor or a plurality of facilities are connected to one monitor or display to display facility data (FIG. 2, 237A or 510 of FIG. 5). I can.

Facility data includes PC video in the form of VGA, DVI, and HDMI, and also displays the processing process of Lot A, Lot B, Lot C, etc. installed in the control system, and other PM1, PM2, PM3, ,, It may also include information on the processing process such as PM5. The facility data shown in FIG. 5 is only a preferred embodiment of the present invention, and is not limited thereto, and may include all of various types of facility data.

The sensor data receiving unit 139 receives sensing data from various types of sensors installed inside or around the facility installed in the control system 110. Examples of sensors (Figs. 3 and 339) include smoke sensor 339a, flame sensor, leak sensor, leakage current sensor, current sensor, complex weather sensor, intrusion sensor, infrared sensor, carbon dioxide sensor, carbon monoxide sensor, temperature sensor 339b. , A humidity sensor 339b, and the like, and various sensors may be included.

The sensor data processing unit 140 receives the sensing data received from the sensor data receiving unit 139 from the integrated image generating unit 142 and the monitoring image received from the monitoring image receiving unit 135 or the facility data received from the facility data receiving unit 137 The first reconstructed image is generated by mapping to be added to (Fig. 5, 520) or overlayed.

As an embodiment, the sensor data processing unit 140 images the sensing data information on the screen of the facility data as shown in FIG. 5 and inserts it into a specific location (FIGS. After being compressed, it can be stored using ONVIF/RTSP protocol (Fig. 5, 500) and then transmitted.

As a preferred embodiment of the present invention, the sensor data processing unit 140 may use a Building Automation System (BAS) technology to map the sensing data to be overlaid on a surveillance image. As an example, when sensing data of "FAN:10rpm" and "Power:60kW" is received by the sensor data receiving unit 139, the sensor data processing unit 140 determines the location of the FAN and outlet in the image by the integrated image generation unit 142. The sensing data and the corresponding object in the image may be mapped to display the received sensing data by overlaying the image.

As another preferred embodiment of the present invention, the sensor data processing unit 140 determines that an event has occurred when the received sensing data is compared with a past history or deviates from a preset criterion, and receives information indicating that the event has occurred. It may be provided to the event display unit 142 and the notification unit 146.

For example, the sensed data is "temperature: 35˚C, humidity _{50%, CO 2: 40ppm,} FAN: 10rpm, and the power: 60kW" If the received as such, the sensor data processor 140, the speed of 10rpm FAN When it is determined that an event has occurred, event occurrence information may be provided to the event display unit 142 and the notification unit 146.

The integrated image generation unit 142 is a monitoring image received from the monitoring image receiving unit 135 (Figs. 2, 237A) The second reconstructed image (FIGS. 2 and 242) may be generated by integrating at least one of the image and the first reconstructed image (FIGS. 2 and 240) received from the sensor data processing unit 140. The second reconstructed image may be displayed in a form in which the display is divided into N, and a surveillance image, a facility data image, and a first reconstructed image are allocated to each of the N divided screens. The second reconstructed image may also provide an indication 242a that an event has occurred or an alarm 242a when event occurrence information is received from the sensor data processing unit 140. In this case, when the second reconstructed image (FIGS. 2, 242) includes N images or data, a user performing communication through an external network or the first network controls the second reconstructed image (FIGS. 2, 242). The network load that occurs is reduced to 1/N.

In a preferred embodiment of the present invention, the integrated image generation unit 142 collects images received from multiple image capturing devices connected to the internal network, equipment data of facilities connected to the internal network, and sensor data After recompression into an image of, it may be transmitted to a user of an external network through the transmission unit 144 using the ONVIF/RTSP protocol. Accordingly, the user can control the entire facility in the control system 110 without a separate network load on the external network used. The transmission unit 144 is also capable of interworking with the ONVIF/RTSP server 260 provided in the internal network (FIGS. 2 and 210a) as in the embodiment of FIG. 2.

The user (Figs. 2, 220) can simultaneously check N images through the second reconstructed image displayed on the display of the terminal used by the user, and when an alarm occurs in at least one of the N images, the alarm generated image is individually displayed. At least one selection may be made through the selection interface 145, and the transmission unit 144 may transmit at least one image selected by the user to the user.

In addition, when the user (Fig. 2, 220) checks the transmitted image and needs to control the equipment in the control system 110, at least one equipment inside the control system 110 or the It is possible to control a device connected to at least one equipment and wired or wirelessly.

The server connected to the external network 300b used by the user can analyze and store the integrated control system 100 accessed for each user and the event information checked for each user, and based on this, the user can provide a response plan for the event, etc. I can suggest.

Figure 4 is a preferred embodiment of the present invention, showing a flow chart of a method for integrated control of facilities in a remote location.

In a preferred embodiment of the present invention, a method for integrated control of facilities from a remote location performs communication between at least one user and at least one control server through a first network (S410). And, each of the at least one control server communicates with at least a plurality of at least one video recording device, at least one equipment, at least one sensor, and ROS connected to the control server through a second network and one network IP. Do (S420). In this case, at least one control server may include the integrated control system 100 shown in FIG. 1.

The user communicates with the control server through the first network, so that at least one of at least one video recording device, at least one equipment, at least one sensor, and ROS connected to the control server through the control server through the second network. Control and control with one and one network IP (S430).

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include a computer storage medium. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Although the methods and systems of the present invention have been described in connection with specific embodiments, some or all of their components or operations may be implemented using a computer system having a general-purpose hardware architecture.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

Claims (7)

Performing communication between at least one user and at least one control server through a first network;
Each of the at least one control server is one of at least one image recording device, at least one equipment, at least one sensor, and ROS (Remote Operating System, remote control system) in the control system connected to the control server through the second network. Performing communication with at least a plurality of and one network IP; And
By performing communication with the control server through the first network, the user is selected from among at least one image recording device, at least one equipment, at least one sensor, and ROS in the control system connected to the control server through the second network. Including; controlling and controlling with at least one and one network IP,
The sensing data sensed by the at least one sensor is imaged and inserted into a specific position on the screen of the uncompressed facility data on which the facility data received from the at least one facility device inside the control system is displayed, and then compressed. It is generated as a reconstructed image, and the facility data includes information on a processing process of a plurality of facility devices installed inside the control system,
When the sensor data processor determines that the sensing data sensed by the at least one sensor is compared with the past history or deviates from a preset criterion, the second reconstructed image is displayed by indicating that an event has occurred in the first reconstructed image. And the second reconstructed image may further include a monitoring image received from the at least one image capturing device or the facility data image. The method of claim 1,
In a remote location, characterized in that, when the second reconstructed image includes N images or data, the network load generated when a user performing communication through the first network controls the second reconstructed image is 1/N. How to control the facility. The method of claim 1,
The first network is an external network, the second network is an internal network, and a user is restricted from direct access to the second network, and the user is assigned from the second network through the control server only after authentication is performed. It is possible to control and control at least one image capture device, at least one equipment, at least one sensor, and ROS capable of communicating within the second network using one network IP,
The control server stores at least one image capturing device capable of communicating within the second network, at least one equipment, images collected from at least one sensor, and ROS, and data history using the one network IP. And providing an alarm to a user when an event is detected from the collected video and data. The method of claim 1, wherein the second reconstructed image is
In a remote location, characterized in that, when an event is detected in an image received from the at least one image capturing device connected to the control server or data received from a display connected to the at least one facility device, the detected event information is further displayed. How to control the facility. After compressing the surveillance images of various formats recorded by the video recording device including at least one of IP camera, SDI camera, AHD camera, DVR (Digital Video Recorder), NVR (Network Video Recorder), CCTV installed inside the control system A surveillance video receiving unit converting the ONVIF and RTSP protocol formats and receiving the stored video data;
A facility data receiving unit for compressing data received from at least one display connected to at least one facility installed inside the control system and receiving facility data stored in ONVIF and RTSP protocol formats;
A sensor data processing unit for generating a first reconstructed image by adding sensing data received from at least one sensor installed in the control system to the image data or to the facility data and then recompressing it in ONVIF and RTSP protocol formats;
A ROS unit for controlling at least one of the image photographing apparatus, the at least one equipment, and at least one sensor installed inside the control system;
An integrated image generator configured to collect at least one of the image data, the facility data, and the first reconstructed image according to ONVIF and RTSP protocol formats, and recompress and generate a second reconstructed image to be displayed on one display;
An event display unit for displaying an event on the second reconstructed image when an event occurs in at least one of the image data, the facility data, and the first reconstructed image;
A first communication unit for performing communication with a user through an external network; And
Including; a second communication unit for performing communication with the control system through the internal network,
The surveillance image receiving unit, the facility data receiving unit, the sensor data processing unit, and the integrated image generating unit communicate with one network IP within a second network,
The sensing data sensed by the at least one sensor is converted into an image, and the facility includes information on the processing of a plurality of facility devices installed inside the control system received by the at least one facility device inside the control system The integrated control server, characterized in that the uncompressed facility data on which the data is displayed is inserted into a specific position on the screen and then compressed to generate the first reconstructed image. The method of claim 5,
The integrated image generator provides a notification to the user when an event is detected in at least one of the image data, the facility data, and the first reconstructed image, and when the user receives the notification, the image data corresponding to the detected event, And a transmission unit for selecting and transmitting at least one of the facility data and the first reconstructed image. The method of claim 5,
The user connects to the integrated control server through the first communication unit, and through the integrated control server, the IP camera, SDI camera, AHD camera, DVR (Digital Video Recorder), NVR (Network Video Recorder), are installed inside the control system. An integrated control server, characterized in that for controlling and controlling at least one of the video recording apparatus including at least one of CCTVs and the at least one equipment.

Images