KR20230139359A - Intelligent Integrated Visual monitoring and System Operation of which Operation methods for remote control works - Google Patents

Abstract

The present invention relates to an integrated operation center system and operating method for intelligent integrated visualization monitoring and remote control. According to one embodiment, the integrated operation center system for intelligent integrated visualization monitoring and remote control is Onvif (Open Network Video Interface Forum). Or, a transmitting device that transmits multistreaming to multiple receiving devices at the same time using at least one method among RTSP (real-time streaming protocol), and video collection, event video display, and structured data for the transmitted multimedia stream. It may include a receiving device that controls the transmitting device for display, remote control, and display of sensor linkage results.

Description

{Intelligent Integrated Visual monitoring and System Operation of which Operation methods for remote control works}

The present invention relates to an integrated operation center system and operating method for intelligent integrated visualization monitoring and remote control. More specifically, the present invention relates to an integrated operation center system and operating method for intelligent integrated visualization monitoring and remote control. It concerns the configuration of an advanced visualization system and equipment selection that adds video surveillance and equipment control for system advancement by presenting an efficient method for operating and managing multiple network-based video equipment deployed at the end.

For example, IP cameras, which are currently representative equipment for video surveillance, are generally adopted as products with high-resolution image sensors of 2M Pixel (1920×1080) or more and are used in various fields. In storage servers, technology that performs the function of receiving and decoding video and storing and processing video is common. Recently, in order to be able to check real-time event situations that are as important as video in real time, the Onvif (Open Network Video Interface Forum) protocol, known as a standard protocol, is used to maximize interoperability and additional efficiency between network video products. In an effort to deliver basic alarm information to operators, standardization technology is being adopted across the industry and its scope of use is expanding.

In addition, although it is not a dedicated video equipment, there is a demand to remotely monitor other videos such as PCs/servers in addition to IP cameras. The existing method is to install a remote access program on the relevant PC/server, etc. and access it remotely from the operator's PC. At this time, there is a technology to display and monitor various video contents by displaying the video on multiple monitors through IPWALL and MATRIX equipment, or on the operator's monitor.

Database-centered control technology is being used in a variety of fields. In particular, as network-type video equipment is rapidly increasing, intelligent video analysis technology and sensor information are collected in the fields of public safety, factory automation, and large-scale plant facility safety. The technology to manage it in a database, display it as a visualization video, and transmit a broadcast through TTS to give an alarm to the operator and monitor it is used in many business fields and exists.

The demand for intelligent video analysis is increasing, and video security, smart factories, unmanned vehicles, unmanned robots, wireless equipment, etc. are used to collect and analyze video to prepare for various incidents, prevent disasters, or increase productivity. For this reason, the demand for introducing various sensor information in the form of a solution that links video information and alarm signals is also rapidly increasing.

Korean Patent No. 2339691 “Intelligent integrated disaster control platform server for industrial complexes” Korean Patent Publication No. 1780320 “Intelligent Multi-functional Video Surveillance System”

The purpose of the present invention is to consider the security of video transmission and the stability of bandwidth by adopting a method of independently acquiring images obtained from cameras and PCs/servers, instead of the existing method of processing them in a back-end server.

The present invention allows the administrator to use a variety of server equipment such as front-end servers, intelligent servers, middleware, alarm servers, and access control servers to enable efficient system operation according to video surveillance by quickly and accurately analyzing and extracting failure situations. The purpose is to configure video monitoring and control to be possible.

The present invention is effective in server control because it can be displayed not only as a remote video but also in the form of a web template. While the existing method relies on a 1:1 method, the invention system aims for a differentiated 1:N method and can display multiple remote videos. The purpose is to provide a structure that allows immediate recognition and remote entry by preparing the control authority through event expression.

The present invention is a system that occurs in a configuration where dedicated KVM transmission equipment is placed in a remote location and individually connected to the front-end/middleware, which can put a load on remote facility PCs and servers and have a fatal impact on failures and security. The purpose is to present an alternative to stability as a visualization system that completely eliminates the load and enables integrated control.

An integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment utilizes at least one of Onvif (Open Network Video Interface Forum) or RTSP (real-time streaming protocol) to simultaneously connect multiple receiving devices. A transmitting device that transmits multistreaming, and a receiving device that controls the transmitting device for video collection, event video display, structured data (analysis data) display, remote control, and sensor linkage result display for the transmitted multimedia stream. May include side equipment.

According to one embodiment, the transmitting device not only performs general remote program installation, but also considers environments in which program installation is impossible and deploys a dedicated KVM transmission device to control the video at the control center and the front panel from the operator monitor. You can acquire video by directly connecting to the end system, and acquire video and control rights to IPWALL devices and KVM receivers at the same time to configure a system that allows keyboard/mouse control.

The transmitting device according to one embodiment may include an IP camera, a PC/server, a sensor data collection server, encoding software, and a KVM transmitting device.

According to one embodiment, in order to control the transmitting device, the receiving device uses a standard protocol of Onvif (Open Network Video Interface Forum) or RTSP (real-time streaming protocol) to collect video, and transmits the video. Among side devices, images acquired from video devices can be collected and operated directly by receiving video and control signals.

According to one embodiment, the receiving device may run an operating program to search the device list of all connectable transmitting devices, register all management target devices, and selectively display them on the screen in connection with an alarm event. .

According to one embodiment, the receiving device does not display all front-end images that are bandwidth issues at the same time, but holds the list list and event list in preset form and displays them only when an event occurs as a result of video analysis and sensor linkage. The video can be displayed in a pop-up.

The receiving device according to one embodiment analyzes problems occurring around a specific camera through video analysis, and displays the analysis results and alarm events by combining them with the video through linkage with sensors located around the specific camera. You can.

The receiving device according to one embodiment has a screen splitting function, a preset storage function, and an event linking function built into the monitor screen, and includes a layout split display performance capable of simultaneous division of up to 64 screens on a single monitor screen. , The KVM receiving side may include a KVM structured to acquire control rights by directly/indirectly connecting the output of HMDI, which is a physical terminal, to the keyboard/mouse.

The receiving device according to one embodiment includes a receiving side IP KVM and an IPWALL system, and the receiving side IP KVM and IPWALL system supports high resolution, so that the control center operator receives information from all video devices and sensor interconnection servers. It can be converted and displayed as high-resolution graphs and 3D maps.

According to one embodiment, the receiving device operates by integrating a visualization template or arranging it independently in a multi-monitor split window to display all alarm events, and displays the event in a preset layout with unlimited screen arrangement methods. It can operate as a structure that can be automatically displayed by calling the corresponding layout when it occurs.

According to one embodiment, the receiving device includes remote IP camera video and control, remote PC/server video and control, wireless video and control of body cameras and drones, wireless robot video and control, and wireless disinfection device video. At least one control may be performed among the structured data template and control that analyzes the status information expressed by the middleware.

According to one embodiment, the transmitting device corresponds to all devices that use the standard video transmission protocol, the receiving device receives and displays data from the transmitting device, and the IPWALL device directly connected to the multi-monitor device includes a KVM receiving card. It is equipped and operated and is characterized by a structure that is used by connecting to a standalone KVM terminal that is directly connected to the operator monitor.

According to one embodiment, when an alarm event occurs, the transmitting device may display in at least one of the following methods: IPWALL only display, KVM only display, IPWALL and KVM simultaneous display, and simultaneous display of multiple KVMs.

According to one embodiment, the transmitting device transmits the standard video signal and the control signal through an IP network using different IP addresses, and the receiving device can simultaneously monitor video even if there are multiple KVMs using the different IP addresses. , the control right is given priority to the KVM that initially executed the control, and other receiving KVMs can see a message saying that they are under remote control.

A method of operating an integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment is at least one of Onvif (Open Network Video Interface Forum) or RTSP (real-time streaming protocol) through a transmitting device. Transmitting multistreaming to a plurality of receiving devices simultaneously using and controlling the transmitting device.

The step of controlling the transmitting device according to one embodiment is a multi-monitor system that controls video at the control center by placing a dedicated KVM transmitting device in consideration of an environment in which program installation is not possible, as well as in the case of general remote program installation. and controlling the operator monitor to acquire video by directly connecting to the front-end system, and controlling the IPWALL device and KVM receiver to simultaneously acquire video and control rights to configure a system capable of keyboard/mouse control. can do.

The step of controlling the receiving device according to one embodiment includes searching the device list of all connectable transmitting devices, registering all management target devices, and running an operating program to selectively display them on the screen in connection with an alarm event. It may include a driving step.

The step of controlling the receiving device according to one embodiment is to hold the list list and event list in preset form without simultaneously displaying all front-end images that are bandwidth problems, and then display the results of image analysis and sensor linkage. It may include a step of popping up and displaying the video only when an event occurs.

According to one embodiment, the security of video transmission and the stability of bandwidth can be taken into consideration by adopting a method of acquiring images independently from the existing method of collecting and processing images from a back-end server for images acquired from cameras and PCs/servers, etc. there is.

According to one embodiment, an administrator can install various server equipment such as a front-end server, intelligent server, middleware, alarm server, and access control server to enable efficient system operation according to video surveillance by quickly and accurately analyzing and extracting failure situations through a single KVM. It can be configured to enable video monitoring and control with equipment and programs.

According to one embodiment, it is effective in server control because it can display not only remote images but also web templates, and while the existing method relies on a 1:1 method, the invented system aims for a differentiated 1:N method and supports multiple Remote video and control rights can be prepared through event display, providing a structure that allows immediate recognition and remote entry.

According to one embodiment, problems that could put a load on remote facility PCs and servers and have a fatal impact on failures and security can be solved in a configuration where dedicated KVM transmission equipment is placed in a remote location and individually connected to the front-end/middleware. As a visualization system that completely eliminates system load and allows integrated control, it can provide an alternative to stability.

FIG. 1A is a diagram illustrating the structure of an integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment.
Figure 1b is a diagram showing screen division through video wall management for receiving and displaying data from a transmitting device.
FIG. 1C is a diagram illustrating a screen displayed in several divisions on a receiving device according to an embodiment.
Figure 2 is a diagram illustrating an integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment.
Figure 3 is a diagram illustrating a method of operating an integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment.
FIG. 4A is a diagram illustrating an embodiment of arranging maps, graphs, images, and structured data on a single high-resolution screen.
Figure 4b is a diagram illustrating another embodiment of arranging maps, graphs, images, and structured data on a single high-resolution screen.

Specific structural or functional descriptions of the embodiments according to the concept of the present invention disclosed in this specification are merely illustrative for the purpose of explaining the embodiments according to the concept of the present invention. They may be implemented in various forms and are not limited to the embodiments described herein.

Since the embodiments according to the concept of the present invention can make various changes and have various forms, the embodiments will be illustrated in the drawings and described in detail in this specification. However, this is not intended to limit the embodiments according to the concept of the present invention to specific disclosed forms, and includes changes, equivalents, or substitutes included in the spirit and technical scope of the present invention.

Terms such as first or second may be used to describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another component, for example, a first component may be named a second component, without departing from the scope of rights according to the concept of the present invention, Similarly, the second component may also be referred to as the first component.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between. Expressions that describe the relationship between components, such as “between”, “immediately between” or “directly adjacent to”, should be interpreted similarly.

The terminology used herein is only used to describe specific embodiments and is not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to designate the presence of a described feature, number, step, operation, component, part, or combination thereof, and one or more other features or numbers, It should be understood that this does not exclude in advance the possibility of the presence or addition of steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms as defined in commonly used dictionaries should be interpreted as having meanings consistent with the meanings they have in the context of the related technology, and unless clearly defined in this specification, should not be interpreted in an idealized or overly formal sense. No.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, the scope of the patent application is not limited or limited by these examples. The same reference numerals in each drawing indicate the same members.

FIG. 1A is a diagram illustrating the structure 100 of an integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment.

The network switch 101 in FIG. 1A can handle a large number of packets, and is a communication device that connects network units, and has improved transmission speed compared to a hub for small-scale communication. It is often simply called a switch, and can also be interpreted as a bridging hub, MAC bridge, switching hub, or port switching hub.

The purpose of use of the network switch 101 is similar to that of a hub, but the switch provides much improved network speed. This is possible because the data exchanged between each computer is not transmitted to all other computers like a hub, but only to the computer that needs the data. Therefore, bottlenecks do not occur as easily as in hubs. Additionally, most switches support full duplex communication, providing much improved speeds when transmission and reception occur simultaneously.

To perform this function, the switch must remember the unique MAC address of each computer and use this address to determine what data should be sent where.

Meanwhile, reference numeral 102 refers to IPWALL 102, which allows control with all devices on the network.

The remote PC/server 103 not only uses a video transmission method for general remote program installation at a remote location, but also deploys dedicated KVM transmission equipment to obtain video and control rights at the same time in consideration of an environment in which program installation is impossible. Acquire video by directly connecting to the front end system from the multi-monitor system and operator monitor that controls the video, and acquire video and control rights to IPWALL (102) and KVM receiving equipment at the same time to configure a system capable of keyboard/mouse control. This is possible.

The core technology to be solved in the present invention is to connect IP cameras, PCs/servers, and sensor data collection servers, which can be considered remote front-end equipment, to collect images, display event videos, display structured data, remote control, and display sensor linkage results. Throughout the entire process, efficient visual and video display and remote control can be perfectly handled by the back-end system.

IP CAMERA (104) is a camera used by connecting to the Internet. It can be used as a tool for user-generated content and home networks.

*The operator desk (105) is implemented to handle overall surveillance work, and overall surveillance work is also possible in a portable environment through the tablet (106).

The wireless router 107 is a router that operates wirelessly. In this specification, a router (or a router with a routing function) is a network device that transmits data packets between computer networks. The location of the packet is extracted, the optimal path to that location is designated, and the data packet is delivered to the next device along this path. At this time, the optimal path is generally the path that allows for the fastest communication, so it may generally be the shortest distance, but even if it returns, it may be transmitted through a high-speed transmission path. Simply put, it is a device that acts as a relay between different networks.

The wireless robot 108 may refer to a robot 108 that is communicatively connected to the wireless router 107, and the body cam 109 may be capable of acquiring images according to the movement of the human body.

Even when using switches, they are inevitably vulnerable to large-scale broadcasting or data flows exceeding the switch's processing capacity, so in the case of large networks, VLANs, VPN switches or routers are used.

FIG. 1B is a diagram illustrating screen division 110 through video wall management for receiving and displaying data from a transmitting device.

As indicated by reference numeral 110, a split screen can be implemented through an HD network decoder, and the screen can be split through data input at various screen splits and resolutions.

FIG. 1C is a diagram 120 illustrating a screen displayed in several divisions on a receiving device according to an embodiment.

As shown in reference numeral 120, in the present invention, split-screen images can be output and played at various locations where the receiving device is placed.

The present invention is a field of intelligent video security for public safety in the field of a system that connects unlimited video to various types of network-based video equipment and automatically displays and controls an immediate alarm screen on the operator's monitoring screen upon receipt of an alarm. , it can be used in smart factory systems, smart teaching advancement fields, etc.

The present invention combines IP-based network image collection and analysis with technology to link various sensor information with images and remotely control them. It proposes an efficient equipment selection and system management method, allowing a small number of operators to manage large-scale facilities and monitor real-time situations. We would like to present an innovative way to deal with this.

For example, IP cameras, which are currently representative equipment for video surveillance, are generally adopted as products with high-resolution image sensors of 2M Pixel (1920×1080) or more and are used in various fields. In storage servers, technology that performs the function of receiving and decoding video and storing and processing video is common. Recently, in order to be able to check real-time event situations that are as important as video in real time, the Onvif (Open Network Video Interface Forum) protocol, known as a standard protocol, is used to maximize interoperability and additional efficiency between network video products. In an effort to deliver basic alarm information to operators, standardization technology is being adopted across the industry and its scope of use is expanding.

In addition, although it is not a dedicated video equipment, there is a demand to remotely monitor other videos such as PCs/servers in addition to IP cameras. The existing method is to install a remote access program on the relevant PC/server, etc. and access it remotely from the operator's PC. There is a technology to display and monitor various video contents by displaying the video on multiple monitors through IPWALL and MATRIX equipment, or on the operator's monitor.

Database-centered control technology is being used in a variety of fields. In particular, as network-type video equipment is rapidly increasing, intelligent video analysis technology and sensor information are collected in the fields of public safety, factory automation, and large-scale plant facility safety. The technology to manage it in a database, display it as a visualization video, and transmit a broadcast through TTS to give an alarm to the operator and monitor it is used in many business fields and exists.

The demand for using intelligent video analysis is increasing, and video security, smart factories, unmanned vehicles, unmanned robots, wireless equipment, etc. are used to collect and analyze video to prepare for various incidents, prevent disasters, or increase productivity. For this reason, the demand for introducing various sensor information in the form of a solution that links video information and alarm signals is also rapidly increasing.

In the present invention, it must be a method that enables efficient upgrading while maintaining the existing standard video information transmission method, and performance improvement must be achieved through systematic advancement and systematic direct control while ensuring economic benefits for users. It can be said that the invention focuses on the advancement of video display methods and remote control.

Fields where the present invention can be used include all airports, roads, railways, military bases, tunnels, educational facilities, workplaces, residential complexes, unmanned stores, wireless equipment, robot equipment, network-based camera equipment, and various sensors. The core value of the present invention is the visualization and remote control method that can maximize the operator's efficiency through the advancement of data conversion and presentation methods through analysis results of equipment, etc.

Through the above-mentioned business fields and function implementation, IPWALL and KVM equipment enable general video display, event screen display, structured data display, and It is a system that integrates four elements called direct control together.

The IPWALL and KVM equipment designed as a result of the present invention can be said to be specialized equipment for displaying analysis results from various front-end equipment.

In particular, in IPWALL and KVM equipment, it is possible to directly load source code such as API/SDK used to develop/operate the underlying intelligent analysis server equipment as well as video display using the video standard protocols RTSP and ONVIF, which are the core of control. It is possible to display unlimited images. The screen display layout for displaying all images is also optimized using a simple preset method to display images and store and use unlimited formats in the layout for immediate remote control.

Existing visualization systems can use cameras and intelligent servers as a medium for alarms, so they simply display images from cameras that generate alarms. However, as a result of the invention, not only are existing images displayed, but also the results directly analyzed by cameras and intelligent servers are displayed. The point is that the data server can immediately display the analysis results as structured metadata.

For example, when a person is photographed with a camera, structured data refers to analyzing the person's gender, color of clothing worn, walking speed, whether the person is wearing a mask, whether the person is wearing a hat, glasses, or a helmet, etc., and then structuring and expressing the metadata. it means. In other words, the results analyzed by the subsystem are expressed as structured results, so that when an important event occurs, the results for the event are converted into a pop-up and specific layout through IPWALL and KVM so that the operator does not have to search for it, allowing multi-monitor and individual monitor operators Visualization methods can be advanced, and even peripheral devices can be controlled through direct control of the camera.

For example, in various industrial fields, in connection with a database server where sensor information, which is a subsystem, is collected, the collected information can be immediately received as a 2D or 3D graph, and only the core information is converted and expressed in the form of structured data. This means that when an alarm occurs by exceeding the threshold, the corresponding graph and related information are immediately popped up or the layout is changed, and the visualization method is advanced by placing it in a state where immediate control is possible, and servers connected to the center are directly You can control it.

As in the two cases mentioned above, all analysis results can be immediately recognized in IPWALL and KVM, which are the visualization display equipment that the operator ultimately monitors, and the screen display layout is changed to a form that can be immediately controlled by the system operator. , it refers to an efficient system that displays structured data and switches to a state where the equipment itself can control a remote system.

The device of the invention implements direct display of visual images instead of the method in which existing systems simply display and monitor images. IPWALL is used for multi-monitor (videowall) equipment, and KVM equipment is used for operator monitors to monitor all situations that occur remotely. It allows for monitoring and direct control, and both devices have a connection method that allows direct connection of the keyboard and mouse.

As a top-level visualization video display and remote control system, it is a system that can change the operation method. By presenting a differentiated control method, the existing control system can be used as a high-value business model, and its application areas include public safety and productivity. Remote control technology linked to efficiency is of key value, not just displaying pre-set images, such as improving the environment, improving the quality of education, etc.

In the past, multiple cameras installed in areas and facilities subject to video surveillance were placed and used only for the purpose of video security in major facilities or public places. Video was acquired through the cameras and the operator directly monitored the received video. For this reason, even if it is a live video, the backend system must go through VMS/DVR/NVR/storage server. In addition, as the number of video equipment users rapidly increases, the fatigue/concentration caused by multiple operators monitoring an average of 30 or more cameras for a long time cannot last more than an hour, so a technology called intelligent video analysis has been used recently. The monitoring method had no choice but to depend on the backend system where all images were collected. However, as a result of the present invention, additional use is possible by directly connecting the relevant equipment to acquire images, control cameras, and even directly control peripheral devices.

Previously, the integrated monitoring center that acquires video and collects, stores, and manages video information only displays live video on multiple display devices at all times or displays video of final disasters, disasters, etc. linked from the event server, thereby ensuring public safety. If there were limitations in achieving safety accidents and advancement of production activities due to the complex structure of direct control in the field and industrial accident prevention field, the present invention allows core equipment to be configured to respond to situations by directly connecting to the relevant PC/server. It presents the most efficient way to directly control it.

Recently, in the field of public safety, the pace of increase in the deployment of equipment related to the handling of the coronavirus has exceeded expectations, and in the industrial field, interest in worker safety has increased in the field of factory automation following the funding of the Serious Accident Punishment Act, leading to efficient video surveillance and disaster prevention. Interest in and demand for prevention systems are rapidly increasing, and the reality is that the technical demand for visualization systems that can implement real-time response and remote control functions rather than post-processing is increasing.

Conventional integrated control center technology connects network-based video equipment, and the central equipment must be VMS/DVR/NVR/storage server, etc., as a back-end system and connected to the gateway that must be passed to acquire video.

If there were multiple remote operators, additional distribution servers had to be deployed. This was a lack of bandwidth that occurred as a result of a large number of unnecessary videos being monitored, and it was also a negative effect of the current method of implementing the system that focuses on simultaneously monitoring the videos collected on the storage server. If a problem occurs in the back-end equipment, the entire system is blocked. The reality is that it has a serious problem of outages, and the advanced visualization system proposed as a result of the invention is a system that connects directly to all remote equipment, directly collects and displays analysis results, and directly performs remote control. Its special advantage is that it collects and displays images independently, enabling uninterrupted operation, unlimited access, and smart screen display, enabling integrated monitoring and independent control by multiple operators regardless of system size. The best way to achieve organic connection can also be derived.

FIG. 2 is a diagram illustrating an integrated operation center system 200 for intelligent integrated visualization monitoring and remote control according to an embodiment.

The integrated operation center system 200 according to one embodiment may include a transmitting device 210 and a receiving device 220.

The receiving device 220 utilizes the standard protocol of Onvif (Open Network Video Interface Forum) or RTSP (real-time streaming protocol) to control the transmitting device 210, from the video device among the transmitting devices. The acquired images can be collected and operated directly by receiving image and control signals.

Meanwhile, the receiving device 220 is an intelligent integrated visualization monitoring device that searches the device list of all accessible transmitting devices, registers all management target devices, and runs an operating program to selectively display them on the screen in connection with alarm events. and remote control can be performed.

For example, instead of displaying all front-end videos that are bandwidth issues at the same time, the list list and event list are held in preset form and the video is displayed in a pop-up only when an event occurs as a result of video analysis and sensor linkage. It is characterized by

In addition, the receiving device 220 analyzes problems occurring around a specific camera through video analysis, and displays the analysis results and alarm events by combining them with the video through linkage with sensors located around the specific camera. .

The receiving device 220 has a built-in screen splitting function, preset storage function, and event linkage function on the monitor screen, and includes a layout splitting performance that allows up to 64 simultaneous divisions on a single monitor screen, and the KVM receiving side has a physical It may include a KVM with a structure that acquires control rights by directly/indirectly connecting the terminal HMDI output and keyboard/mouse.

In addition, the receiving side device 220 includes the receiving side IP KVM and IPWALL system, and the receiving side IP KVM and IPWALL system support high resolution, so that the control center operator can receive high-resolution graphs from all video devices and sensor interconnection servers. And it can be converted into a 3D map and displayed.

In addition, the receiving device 220 is operated by integrating the visualization template or arranging it independently in a multi-monitor split window and displaying it as an alarm event. It has a preset layout with unlimited screen arrangement method, so when an event occurs, it is operated by displaying it as an alarm event. It can operate as a structure that can be automatically displayed by calling the layout.

Meanwhile, the receiving device 220 provides remote IP camera video and control, remote PC/server video and control, wireless video and control of body cameras and drones, wireless robot video and control, and wireless disinfection device video and control. , and structured data template and control that analyze the status information expressed by the middleware.

The present invention is intended to solve the negative effects caused by the problem of the method in which the conventional control and monitoring system is operated centered on a storage server. For direct video transmission, the standard protocol Onvif (Onvif) is used to receive video from an existing IP camera. It utilizes the Open Network Video Interface Forum (RTSP) and real-time streaming protocol (RTSP) methods, and utilizes a multi-streaming function that transmits to multiple backends simultaneously from existing equipment. In this way, compatibility and usability are faithfully considered without affecting the existing system.

For existing remote PC/server equipment, in addition to the video transmission method of general remote program installation, dedicated KVM transmission equipment is deployed as a method to obtain video and control rights at the same time, considering environments where program installation is not possible. Images can be acquired by directly connecting to the front end system from the multi-monitor system and operator monitor that controls the system.

In addition, it is possible to implement a function that simultaneously acquires video and control rights to IPWALL equipment and KVM receiving equipment to configure a system capable of keyboard/mouse control.

Therefore, the core technology to be solved in the present invention is to connect IP cameras, PCs/servers, and sensor data collection servers, which can be considered remote front-end equipment, to collect images, display event images, display structured data, remote control, and display sensor linkage results. Throughout the entire process, efficient visual and video display and remote control can be perfectly handled by the back-end system.

As a result, the operator develops a system that can independently process the entire process without affecting or being affected by the existing back-end system while connecting all equipment in the front-end for multiple monitor systems and individual monitors, thereby developing the concept of uninterrupted operation and internal management. By considering methods to minimize network bandwidth, control center operators can provide management efficiency.

The video collection method uses the two standard protocols described above to directly collect and operate the video acquired from the video equipment by receiving video and control signals from the video display equipment at the end. The operation program lists all accessible devices. By registering all equipment subject to search and management, you can selectively display them on the screen in connection with alarm events.

In addition, even if all front-end videos that are bandwidth issues are not displayed at the same time, the list list and event list are held in preset form, and the only function is to pop up and display the video only when an event occurs as a result of video analysis and sensor linkage. In addition, the network load is minimized by configuring structured data to be displayed.

In general, the control center video display method is a system designed as a storage server, and a back-end system that implements video collection, storage, distribution, and display functions on the server must be connected to a single or multiple servers to collect video in a centralized configuration. Bandwidth issues arising during the distribution process had to be resolved.

However, the present invention collects images directly from the front-end camera for display on a multi-monitor device and provides a complex way to receive and process events that can be linked to a database, alarm event server, and intelligent analysis server, which can be called middleware. By breaking away from the physical structure, it is possible to directly express the results of the analysis and obtain direct control, making it possible to operate independently from the existing system.

According to the present invention, it is possible to display directly on a multi-monitor device, and the operator can develop a visualization system that can be linked to the event server just by registering in the target list without monitoring, thereby achieving the operator's goal of improving the system.

Video analysis and sensor linkage is a method of combining analysis results with alarm events and video, quickly and accurately analyzing problems that occur around a specific camera and processing the results as events, enabling more efficient system operation for video surveillance and requiring only a small number of operators. It provides a smart video surveillance system and method that can realize economic value by allowing a large amount of video data to be managed.

The present invention is a system that enables implementation of integrated operation functions and remote control functions in a single device without the need for existing complex server configuration. Regardless of the number and type of connected equipment, a single operator can perform video surveillance, remote control, video analysis linkage, and sensor Functions such as linkage can be implemented.

Figure 3 is a diagram illustrating a method of operating an integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment.

A method of operating an integrated operation center system for intelligent integrated visualization monitoring and remote control according to an embodiment may transmit multistreaming to a plurality of receiving devices at the same time using at least one method among Onvif or RTSP (step 301). .

Next, the operating method of the integrated operation center system for intelligent integrated visualization monitoring and remote control according to one embodiment includes image collection for transmitted multimedia streams, event image display, structured data display, remote control, and sensor interconnection result display. The transmitting device can be controlled.

A multi-monitor system and an operator monitor that control the transmitting device that explains the multimedia content, but also control the video in the control center by placing a dedicated KVM transmission device considering not only general remote program installation but also environments in which program installation is not possible. It can be controlled to acquire video by directly connecting to the front-end system, and can be controlled to acquire video and control rights to IPWALL devices and KVM receivers at the same time to configure a system capable of keyboard/mouse control.

According to one embodiment, the security of video transmission and the stability of bandwidth can be taken into consideration by adopting a method of independently acquiring images obtained from cameras and PCs/servers, instead of the existing method of processing them in a back-end server.

In addition, administrators can use a single KVM device and program to run various server devices such as front-end servers, intelligent servers, middleware, alarm servers, and access control servers that enable efficient system operation according to video surveillance by quickly and accurately analyzing and extracting failure situations. It can be configured to enable video monitoring and control.

In addition, it is effective in server control because it can display not only remote images but also web templates. While the existing method relies on a 1:1 type, the invented system aims for a differentiated 1:N method and provides multiple remote images and control rights. can be prepared as an event expression, providing a structure that allows immediate recognition and remote entry.

4A and 4B are diagrams illustrating an embodiment of arranging maps, graphs, images, and structured data on a single high-resolution screen.

In Figure 4a, maps, graphs, images, and structured data are arranged on a single high-resolution screen as reference numerals 411 to 414, and in Figure 4b, they are arranged as reference numbers 421 to 424 to monitor only a single image, and when an alarm event occurs, the layout is immediately changed. The event can be changed to enable remote control on the visualization screen or at the operator's desk.

Specifically, the receiving device searches the device list of all accessible transmitting devices and registers all management target devices as high-resolution visualization images on a single or multiple screen, so that the operator can display electronic maps, 2D images as numerous video information and status information. /3D graphs, system circuit diagrams, etc. are deployed. At this time, the remote control function is deployed as a default, so that in situations where the threshold value set in advance in the status information is exceeded, the operator can respond immediately on a selectively displayed screen.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described with limited drawings as described above, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims (2)

A transmitting device that transmits multistreaming to multiple receiving devices at the same time using at least one of Onvif (Open Network Video Interface Forum) or RTSP (real-time streaming protocol); and
It includes a receiving device that controls the transmitting device for video collection, event video display, structured data display, remote control, and sensor linkage result display for the transmitted multimedia stream,
The receiving device runs an operating program to register the device list of all accessible transmitting devices and all management target devices and selectively display them on the screen in connection with alarm events, but all front-end video that is a bandwidth problem is registered. Instead of displaying them at the same time, the list list and event list are held in preset form, and the corresponding video is displayed as a pop-up only when an event occurs as a result of video analysis and sensor linkage, and video analysis is performed for problems that occur around a specific camera. In order to analyze and display analysis results and alarm events by combining them with video through linkage with sensors located around the specific camera, and to control the transmitting device, the video collection method is Onvif (Open Network Video Interface Forum) or Utilizing the standard protocol of RTSP (real-time streaming protocol), video and control signals are received and directly collected for video acquired from video devices among the transmitting devices, and the screen split function and preset are stored on the monitor screen. Function and event linkage functions are built-in, and it includes layout division performance that allows up to 64 simultaneous divisions on a single monitor screen. On the KVM receiving side, control rights are provided by directly/indirectly connecting the physical terminal HMDI output and keyboard/mouse. It includes a KVM with an acquisition structure, and includes an IP KVM and IPWALL system on the receiving side. The IP KVM and IPWALL system on the receiving side supports high resolution, so that the control center operator receives high-resolution graphs from all video devices and sensor interconnection servers. and converted to a 3D map and displayed, integrated with a visualization template or placed independently in a multi-monitor split window and displayed as an alarm event. When an event occurs, there is no limit to the way the screen is placed, with a preset layout. It operates in a structure that can call and automatically display the layout, remote IP camera video and control, remote PC/server video and control, wireless video and control of body cameras and drones, wireless robot video and control, At least one control is performed among the video and control of the wireless disinfection device and the structured data template and control that analyzes the status information expressed by the middleware,
The transmitting device is used not only in cases of general remote program installation, but also in consideration of environments where program installation is not possible. A dedicated KVM transmission device is placed to control the video to the control center, and the front-end system is directly connected to the operator monitor. acquire video and control rights to IPWALL devices and KVM receivers simultaneously to configure a system capable of keyboard/mouse control, IP camera, PC/server, sensor data collection server, encoding software, and KVM transmitter. It includes all devices that use the standard video transmission protocol. The receiving device receives and displays data from the transmitting device, and the IPWALL device that connects directly to the multi-monitor device is equipped with a KVM receiving card. It has a structure that is used by connecting to a stand-alone KVM terminal directly connected to the operator monitor, and when an alarm event occurs, it is displayed in at least one of the following methods: IPWALL only display, KVM only display, IPWALL, KVM simultaneous display, and multiple KVM display simultaneously. , standard video signals and control signals are transmitted through an IP network using different IP addresses, and the receiving device can monitor video simultaneously even if there are multiple KVMs using the different IP addresses, and control rights are given to the KVM that initially performed control. An integrated operation center system for intelligent integrated visualization monitoring and remote control, which has this priority and allows other receiving KVMs to see a message indicating that they are being remotely controlled. In the method of operating the integrated operation center system for intelligent integrated visualization monitoring and remote control according to claim 1,
Transmitting multistreaming to a plurality of receiving devices simultaneously through a transmitting device using at least one method of Onvif (Open Network Video Interface Forum) or RTSP (real-time streaming protocol); And controlling the transmitting device to collect images, display event video, display structured data, remote control, and display sensor linkage results for the transmitted multimedia stream through the receiving device.
The step of controlling the receiving device involves registering the device list of all connectable transmitting devices and all managed devices and running an operating program to selectively display them on the screen in connection with an alarm event, but if there is a problem with bandwidth, Instead of displaying all front-end videos at the same time, holding the list list and event list in preset form, and popping up and displaying the video only when an event occurs as a result of video analysis and sensor linkage,
The step of controlling the transmitting device is not only carried out in the case of general remote program installation, but also in consideration of environments in which program installation is not possible, a dedicated KVM transmission device is placed to control the video at the control center, and the front panel is connected to the operator monitor. Controlling to acquire images by directly connecting to the end system; and
Controlling the IPWALL device and the KVM receiver to simultaneously acquire video and control rights to configure a system capable of keyboard/mouse control;
Method of operation of an integrated operation center system for intelligent integrated visualization monitoring and remote control including.