KR20120059479A - The system and method of real time multiple image sharing and displaying based on the network and broadcast - Google Patents

Abstract

PURPOSE: A network and broadcast based real-time multiple image sharing and displaying system and method thereof are provided to offer integrated functions by constituting of multi-sharing environment and exhibition environment by channelizing images. CONSTITUTION: A relay apparatus(500) acquires one or more images. The relay apparatus constitutes of broadcast channels for the acquired image. The relay apparatus transmits images composed of the broadcast channel to a client or discharges the images through a physical cable. The client selectively discharges the transmitted image. A management computer(900) monitors, manages, or controls information which is necessary for operating the relay apparatus through network communication.

Description

The system and method of real time multiple image sharing and displaying based on the network and broadcast}

The present invention is based on the concept of relay equipment based on the broadcast concept, the image in real time from various sources (computer, CCTV, Video Camera, medical devices, etc.) that need to share and display based on network communication and physical connection in the relay equipment The present invention relates to a system and a method for acquiring a broadcast channel, configuring a broadcast channel, and sharing the same through a network to multiple users in real time.

Recently, due to the development of software technology, network, and hardware, a remote sharing system based on a computer (desktop, laptop, etc.) is widely used as shown in FIG. 1. In the present specification, the environment as shown in FIG. 1 is referred to as a "remote sharing system".

In the case of a remote sharing system, as shown in FIG. 1, the most common is a structure in which a remote server program 11 is built in a remote computer 10 and shared one-to-one through a remote client program 13 installed in a client computer 12. It is used as a sharing system. Each device 10, 12 of the remote sharing system is connected by network communication.

Through the structure as shown in FIG. 1, when a plurality of client computers 12 wish to share a single remote computer 10, the load of computer resources is applied to the remote computers as many as the number of client computers 12 connected to the remote computer 10. Many restrictions occur in sharing the remote computer 10. In addition, in terms of network communication line load, the use of TCP-based communication generally increases bandwidth usage by the number of client computers 12 connected. In addition, it is impossible to share a screen other than a computer (CCTV, Video Camera, etc.).

Next, in order to selectively display and multi-display a plurality of images (computer, CCTV, video camera, etc.) in multiple displays (multicube, etc.) such as a conference room and a situation room, the wall controller 16 and the video matrix as shown in FIG. A multi-display system using a technology such as a switch 17 is constructed and operated. In this specification, the environment as shown in FIG. 2 is referred to as a “multi-display system”.

In the case of a multi-display system, as shown in FIG. 2, an image is received from the plurality of graphic sources 14 via the video cable 15 at the wall controller 16, the video matrix switch 17 and via the video cable 18. Optionally or multiplexed to multiple monitors / displays 20, or to remote monitors 19 at remote locations via video cables. Each piece of equipment 14, 15, 16, 17, 19, 20 of the multi-display system is connected by a video cable 15, 18.

As shown in FIG. 2, the multi-display system is operated based on a hardware-based technology for receiving and displaying images and transmitting remote images through a plurality of video cables 15 and 18. There are many problems such as limitation of sharing area due to distance limitation, increase of management requirements due to complex configuration of the wall controller 16 and the video matrix switch 17, and limitation on scalability when increasing the sharing target by the hardware equipment based configuration method. .

An object of the present invention is to construct and operate a relay device based on a broadcast concept and a network communication concept. The relay equipment constitutes a broadcast channel with a plurality of computer screen images received through network communication and a plurality of devices received through a video cable-computers and non-computer equipment (CCTV, Video Camera, etc.). The relay equipment displays the configured channels to multiple monitors / displays, or at the same time, shares the channels through multicast network communication. As described above, the present invention focusing on relay equipment is intended to overcome the limitations and limitations of cost, technology, convenience, and scalability as well as providing integrated functions of existing remote sharing system and multiple display system.

By constructing the relay equipment and relaying the remote computer and the client computer to share it by using the broadcasting concept, multi-sharing (many-to-many sharing) according to the increase of computer resources / network load of the existing remote sharing system by direct connection of the remote computer Overcome the constraints to provide an efficient multi-sharing environment. By physically connecting video cable to the relay equipment, images are acquired from various devices and propagated by network communication when transmitting, thereby eliminating the limitation of the existing remote sharing system, which cannot share images other than the computer screen. . In addition, by configuring the relay equipment based on the software and network, the problems of the existing multiple exhibition system based on the hardware equipment-hardware configuration management, expansion limitation, screen sharing distance limitation through video cable-have been drastically improved. The purpose is to make it easy to share the screen of multiple users.

In order to achieve the above object, the present invention relates to a system and method for sharing and displaying information through a broadcast concept, network communication, and physical connection-based relay device configuration. An agent program for transmitting; Receives images from multiple agent programs over a network, acquires images from multiple devices through physical cable connections, forms channels based on broadcast concepts, and transmits them to clients through multiple monitors / displays and network communication. Relay equipment and relay programs; A client program for receiving the channelized image information transmitted from the relay device and the relay program through a network and selectively displaying and viewing the image information; Monitor, manage and control channel information, frame rate information, image quality information, image source connection status, client transmission on / off, relay equipment performance information, total on / off, etc. necessary for the operation of relay equipment and relay program. Characterized in that it includes a management program that can be.

The present invention includes a step of logging in to a relay program for screen transmission, screen reception and display, and relay device management and control by an agent program, a client program, and a management program, respectively, after the relay equipment and the relay program are driven; Inputting and managing channel information and control information necessary for operating a relay device by a management program; The agent program mirroring (copying) the image from the graphic output device of the agent computer, encoding and encrypting the image, and transmitting the image to the relay device through network communication; In the repeater and relay program, the channel is composed, encoded and encrypted from the images received from the agent over the network and from the physical video cable, and then selected and displayed on multiple monitors / displays through multiple graphic output devices. And transmitting it in real time in a multicast manner; And displaying a desired channel by receiving, from the client program, an image transmitted from the relay device to the network, channel listing, and decoding.

The present invention focuses on the construction of relay equipment and relay programs based on the concept of broadcasting, software and network communication technology. Based on this, multiple shared and exhibition environments can be channelized by channelizing multiple and multiple images acquired in real time, providing integrated functions covering existing remote sharing systems and multiple exhibition systems and overcoming the limitations of existing systems. have.

In the present invention, in an environment requiring multiple sharing and exhibition such as a situation room, a conference room, and a training ground, the present invention can be freely shared and displayed only by configuring a network centered on relay equipment. It can provide economy, convenience of maintenance and expansion.

1 is an exemplary remote desktop sharing according to the prior art.
Figure 2 is an exemplary configuration of a multi-exhibition environment, such as a situation room, a conference room according to the prior art.
3 is a block diagram illustrating a concept of sharing and displaying real-time multiple images on a network and broadcast basis according to the present invention.
4 is a schematic block diagram of an agent computer and an agent program according to the present invention.
5 is a schematic block diagram of a relay and a relay program according to the present invention.
6 is a schematic block diagram of a client computer and client program in accordance with the present invention.
7 is a schematic block diagram of a management computer and a management program according to the present invention.
8 is a flowchart illustrating a process of sharing and displaying a real-time multiple image based on a network and a broadcast based on a relay device according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

As shown in FIG. 3, the present invention includes an agent computer 100 and an agent program 110, a graphic source 200, a relay device 500, and a relay program 510, a client computer 800, and a client program 810. ), A management computer 900, a management program 910, and a multi-monitor / display 1000.

4, 5, 6, and 7 will be described in detail the configuration and operation principle of each component of the present invention.

4 is a block diagram of an agent program 110 that transmits its own screen to the relay device 500 and the relay program 510 via a network.

Referring to FIG. 4, the agent program 110 logs in to the relay device 500 and the relay program 510 through the first user authentication module 115, and the driver mirror module 111 is the agent computer 100. By mirroring the graphic output device 21 mounted in the image to the image using a memory replication method to generate an image while minimizing the use of system resources (CPU, memory) of the agent computer 100. The image processing module 112 compresses and encodes the mirrored image, and then encrypts and encrypts the mirrored image, and then, through the network 300 as shown in FIG. 3 in the network communication module 114, the relay device ( 500) and the relay program 510 continuously transmits the entire image at the first time and the failure time according to the frame rate and the image quality determined by the management program 910, and usually only the changed image to minimize the network bandwidth.

5 is a block diagram of the relay equipment 500 and the relay program 510 serving as the core of the present invention.

Referring to FIG. 5, the relay device 500 is a computer device including a network card 22, a capture card 23, and a graphic output device 24. When the relay program 510 is driven in the relay device 500, the image receiving module 511 receives and captures images transmitted by the plurality of agent programs 110 through the network 300 as shown in FIG. 3. An image is received via a video cable 400 from a plurality of graphics sources 200 connected to a card 23. The broadcast channel configuration module 512 is configured to broadcast the image received by the image receiving module 511, the image processing module 513 compresses and encodes each image composed of the channel. Afterwards, for multiple exhibitions, the image display module 514 displays the channelized image on the multiple monitor / display device 1000 through the graphic output device 24, and displays overlapping images such as PIP (Picture in Picture), It will be exhibited through functions such as simultaneous display of multiple monitors. In addition, the encryption and decryption module 515 is encrypted in order to multi-share the screened channel through the network to many users, the network communication module 517 through the network 700 as shown in FIG. This is sent to the 800 and the client program 810, and the channel selection, frame rate, and image quality to be sent are sent out according to the value set in the manager program 910. The user access control module 516 serves to authenticate the user of the agent program 110, the client program 810, and the management program 910 accessing the relay device 500 and the relay program 510.

FIG. 6 is a block diagram of a client program 810 for selectively displaying and viewing channelized image information transmitted from a relay device 500 and a relay program 510 to a network.

Referring to FIG. 6, the client program 810 logs in to the relay device 500 and the relay program 510 through the initial user authentication module 813, and the network communication module 811 is the relay device 500. And receiving the channelized image transmitted by the relay program 510, and the encryption / decoding module 812 decodes the received image. The broadcast channel processing module 814 classifies and lists the decoded images for each channel, the image processing module 815 decodes the received encoded image, and the image display module 816 controls the graphic output device 25. The decoded image on the monitor 26 mounted on the client computer 800 is displayed through a specific monitor selection display, overlapping display such as picture in picture (PIP), simultaneous display of multiple monitors, and the like.

7 is a block diagram of a management program 910 for performing setting, management, and control of information necessary for the operation of the relay equipment 500 and the relay program 510.

Referring to FIG. 7, the management program 910 logs in to the relay device 500 and the relay program 510 through the first user authentication module 913, and the management program (in the encryption / decryption module 912). 910 and decrypts various settings, management, and control information for the broadcast channel transmitted and received between the relay program 510, and transmits and receives this information to the network 700 as shown in FIG. 3 through the network communication module 911. do. The broadcast / exhibition management module 914 manages various information (channel information, frame rate information, image quality information, image source connection status information, client transmission on / off information, relay equipment performance information) necessary for relay equipment operation, The broadcast / exhibition control module 915 performs various types of control (real-time frame rate control, image quality control, client transmission on / off control, and total transmission stop / start) during the operation of the relay device 500 and the relay program 510 in real time. Make it applicable. The user management module performs management of the user ID, password, etc. for the agent program 110, the client program 810, and the management program 910 connected to the relay device 500 and the relay program 510.

8 is a process flow diagram showing the flow of the entire component for achieving the object of the present invention.

Referring to FIG. 8, after the administrator drives the relay equipment and the relay program (S501), drives the management program and logs in to the relay equipment (S901), various setting information necessary for operating the relay equipment and the relay program (channel information , Frame rate information, image quality information, image source connection status information, client transmission On / Off information, and relay equipment performance information) are input (S902), and the relay equipment and the relay program configure a broadcast channel according to this setting information ( S502), the initial setting of the relay equipment and the relay program is completed.

When the control program (real time frame rate control, image quality control, client transmission on / off control, total transmission stop / start) is input from the management program during the operation of the relay equipment and the relay program (S903), this is reflected in real time. It is reflected in the program.

Next, the relay device receives images from two image input sources, the agent computer 100 and the graphic source 200. The flow is as follows.

First, the process of receiving the image from the agent computer through the network is performed by the user when the user runs the agent program and logs in to the relay device (S101). Mirror (S102), the screen image is generated (S103), and encoded and encrypted (S104), and transmitted to the relay equipment through the network, at this time the entire image is transmitted only when the initial transmission and failure, and constantly changed in normal Only the image is transmitted, and the transmission period and the transmission quality are transmitted according to the value set in the management program (S105).

Next, in the process of receiving the image from the graphic source through the video cable, the relay device transmits the image to the capture card of the relay device through the video cable (S201).

When the relay device and the relay program receive images from the above two sources (S503), they encode these images (S504).

The encoded image undergoes two processes to achieve multi-display, multi-sharing, which is an object of the present invention.

First of all, the image channels received for multi display are displayed through the graphic output device attached to the repeater, and the specific monitor is selected for multi monitor / display, the overlapping display such as PIP (Picture in Picture), and the simultaneous display of multiple monitors. S506).

Next, the encoded channel images are encoded for multi-sharing and transmitted to the client through a network in a multicast manner. The channel selection, frame rate, and image quality of the transmission are determined according to the values set in the manager program 910. It transmits (S505).

When the client computer user runs the program and logs in to the relay device (S801), the relay device and the image transmitted from the relay program are received through the network (S802), the encrypted image is decrypted (S803) and the relay device is sent out. After creating a channel list (S804), decoding the encoded image (S805), selecting a channel for each channelized list to display a specific monitor on the monitor connected to the client computer, displaying overlapping pictures such as picture in picture (PIP), multiple monitors This is expressed through simultaneous exhibition (S806).

The present invention focuses on the construction of relay equipment and relay programs based on the concept of broadcasting, software and network communication technology. Based on this, multiple shared and exhibition environments can be channelized by channelizing multiple and multiple images acquired in real time, providing integrated functions covering existing remote sharing systems and multiple exhibition systems and overcoming the limitations of existing systems. have.

In the present invention, in an environment requiring multiple sharing and exhibition such as a situation room, a conference room, and a training ground, the present invention can be freely shared and displayed only by configuring a network centered on relay equipment. It can provide economy, convenience of maintenance and expansion.

10: Remote Computer 11: Remote Server Program
12, 800: client computer 13, 810: remote client program
14, 200: graphics source 15, 18, 400: video cable
16: Wall controller 17: Video matrix switch
19: Remote monitor 20, 1000: Multiple monitors / display
100: agent computer 110: agent program
300,700: network 500: relay equipment
510: relay program 900: management computer
910: management program 21, 24, 25: graphics output device
111: driver mirror module 112: image processing module
113,515,812,912: Encryption / decryption module 114,517,811,911: Network communication module
115, 813, 913: User Authentication Module 22: Network Card
23: capture card 26: monitor
511: image receiving module 512: broadcast channel configuration module
513, 815: image processing module 514, 816: image display module
516: user access control module 814: broadcast channel processing module
914: broadcast / exhibition management module 915: broadcast / exhibition control module
916: user management module

Claims (10)

At least one agent mirroring at least one image and transmitting the same to the relay device through network communication according to preset information including frame rate information or image quality information;
An image composed of the broadcast channel by acquiring at least one image from at least one kind and number of image devices connected to the relay device through the agent or a physical cable, and configuring a broadcast channel with respect to the acquired image Relay equipment to display to multiple monitors or displays through a physical cable or to a client through a network communication;
At least one client for selectively displaying and viewing broadcast channelized images transmitted from the relay device through network communication; And
A management computer for monitoring, managing or controlling information necessary for the operation of the relay device through network communication; System for sharing and displaying multiple images, characterized in that configured to include.
The method according to claim 1,
The sharing of the multiple images is not performed by directly connecting the computer equipped with the agent and the computer equipped with the client, but by configuring the relay equipment, many-to-many multiple image sharing is possible through broadcast relaying through network communication. A system for sharing and displaying multiple images.
The method according to claim 1,
When the relay device receives an image from the agent through network communication and only performs image transmission through the network communication to the client, a desktop computer or a notebook computer equipped with an operating system and network communication without an exclusive device for relaying may be used. System for sharing and displaying multiple images, characterized in that to install and operate the software to perform the functions of the relay device in a single board computer or a device equivalent to them.
The method according to claim 1,
When the agent transmits an image to the relay device, it performs an image mirror through a memory copy method of a graphic output device, and transmits the entire image when the first transmission starts or fails, and only a constantly changed image is networked. A system for sharing and displaying multiple images, characterized by transmitting via communication.
The method according to claim 1,
A system for sharing and displaying multiple images, wherein the agent and the client may be installed on a single computer to simultaneously perform a role of transmitting an image and receiving an image.
The method according to claim 1,
The relay equipment is a system for sharing and displaying multiple images, characterized in that to classify and list a plurality of images of a plurality of channels to selectively view them, such as broadcast.
The method according to claim 1 or 6,
The relay device and the client may include at least one of a monitor selection display, a picture in picture (PIP) overlap display, multiple monitor simultaneous display, or a combination thereof in displaying a channelized image. A system for sharing and displaying images.
The method according to claim 1,
The management computer has various information and operations, including channel selection information, frame rate information, image quality information, client transmission on / off operation, and total channel on / off operation, which are applied to the relay device through network communication. A system for sharing and displaying multiple images, characterized by being reflected in equipment so that they can be changed in real time.
A first step of inputting information necessary for the operation of the relay equipment by the management program through network communication;
Transmitting at least one image mirrored by at least one agent to the relay device through network communication according to preset information including frame rate information or image quality information;
A third step of configuring a broadcast channel on at least one or more images received from the agent through network communication at the relay device and at least one or more images obtained through a physical cable from at least one or more types and numbers of image devices; ;
A fourth step of expressing an image composed of a broadcast channel in the relay device to multiple monitors or exhibitors through a physical cable, or transmitting the image to at least one client through network communication; And
A fifth step of receiving the transmitted image from the client and selectively or multiplying the image; How to share and display multiple images, characterized in that comprises a.
The method according to claim 2,
And said network communication is based on at least one of wired and wireless.

Images