CN115333810A

CN115333810A - Multi-network signal source interactive system

Info

Publication number: CN115333810A
Application number: CN202210915863.6A
Authority: CN
Inventors: 谭登峰; 其他发明人请求不公开姓名
Original assignee: Beijing Zen Ai Technology Co ltd
Current assignee: Beijing Zen Ai Technology Co ltd
Priority date: 2022-08-01
Filing date: 2022-08-01
Publication date: 2022-11-11

Abstract

The invention relates to a multi-network signal source interactive system, which comprises: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment; the first signal source unidirectionally transmits a first interface to the video processing and computing equipment, and the second signal source unidirectionally transmits a second interface to the video processing and computing equipment; the video processing and computing device outputs the first interface and the second interface to the first display device; the method comprises the steps that an instruction one-to-two device receives an input first instruction and transmits the first instruction to a video processing and computing device and an instruction distribution device in a one-way mode; the video processing and computing equipment is used for determining a target interface acted by the first instruction and transmitting interface information and a window position of the target interface to the instruction distribution equipment in a one-way mode; the instruction distribution equipment converts the first instruction into a second instruction in the target window, and performs unidirectional control on a target signal source from which the target interface originates according to the second instruction. The invention can ensure that the interaction process does not introduce any new network exposure risk to the signal source.

Description

Multi-network signal source interactive system

Technical Field

The invention relates to the technical field of signal source interaction, in particular to a multi-network signal source interaction system.

Background

In the prior art, in order to view a plurality of signal sources, a plurality of signal sources are usually accessed to a specific network to realize network access to the signal sources, but since the signal sources are exposed to the specific network, and the security level of the signal sources themselves is different, therefore, the network exposure risk of the signal source in the new network and the data leakage risk between different security-level signal sources are increased, for example, the underlying data file of the signal source is stolen by the network, or some content of the signal source A is leaked to the signal source B.

Disclosure of Invention

In view of the above problem, a first aspect of the present invention provides a multi-network signal source interactive system, which includes: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment;

a first signal source in a first network unidirectionally transmits a first interface to the video processing and computing device, and a second signal source in a second network unidirectionally transmits a second interface to the video processing and computing device;

the video processing and computing equipment is used for acquiring the first interface and the second interface and outputting the first interface and/or the second interface to the first display equipment;

the instruction one-to-two device is used for receiving an input first instruction and transmitting the first instruction to the video processing and computing device and the instruction distribution device in a one-way mode respectively;

the video processing and computing equipment is used for determining a target interface acted by the first instruction and transmitting the interface information and the window position of the target interface to the instruction distribution equipment in a one-way mode;

the instruction distribution equipment is used for converting the first instruction into a second instruction in the window through coordinate conversion according to the position of the window and carrying out unidirectional control on a target signal source from which the target interface originates according to the second instruction.

A second aspect of the present invention provides a multi-network signal source interactive system, where the multi-network signal source interactive system includes: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment;

the first instruction output box and the second instruction output box are connected to an instruction network;

the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box are all connected to a video network;

a first signal source in a first network unidirectionally transmits a first interface to a first interface acquisition box; a second signal source in a second network unidirectionally transmits a second interface to a second interface acquisition box;

the first interface acquisition box is used for acquiring the first interface, encoding the first interface into a network stream signal and then acquiring the network stream signal by video processing and computing equipment through a video network; the second interface acquisition box is used for acquiring the second interface, encoding the second interface into a network stream signal and then acquiring the network stream signal by video processing and computing equipment through a video network;

the video processing and computing equipment is used for acquiring the first interface and/or the second interface through a video network and outputting the first interface and/or the second interface to the first display equipment;

the instruction one-to-two equipment is used for receiving an input first instruction and respectively transmitting the first instruction to the video processing and computing equipment and the instruction distribution equipment in a one-way mode;

the video processing and computing equipment is used for determining a target interface acted by the first instruction and transmitting interface information and a window position of the target interface to the instruction distribution equipment in a one-way mode;

the instruction distribution equipment is used for converting the first instruction into a second instruction in the window through coordinate conversion according to the position of the window, sending the second instruction to a target instruction output box corresponding to the target interface through an instruction network, and performing unidirectional control on a target signal source from which the target interface originates by the target instruction output box.

The third aspect of the present invention provides a multi-network signal source interactive system, which includes: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment;

the first instruction output box and the second instruction output box are both connected to an instruction network;

the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;

the first client is used for unidirectionally transmitting a first interface to the first interface acquisition box, and the first interface comprises interfaces of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for transmitting a second interface to the second interface acquisition box in a one-way mode, and the second interface comprises interfaces of one or more signal sources accessed and obtained by the second client from the second virtual machine pool;

the instruction distribution equipment is used for converting the first instruction into a second instruction in the window through coordinate conversion according to the position of the window, sending the second instruction to a target instruction output box corresponding to the target interface through an instruction network, and performing one-way control on a corresponding target client by the target instruction output box so as to enable the target client to control a target signal source from which the target interface originates.

By the embodiment, interaction of each signal source in a plurality of networks can be realized, meanwhile, new network exposure risk cannot be introduced to each signal source in the interaction process, and meanwhile, the interaction end is prevented from being maliciously attacked by the interaction signal source.

Drawings

FIG. 1a shows a schematic block diagram of a multi-network signal source interactive system according to some embodiments of the present invention;

FIG. 1b illustrates a plurality of signal sources on a client interface;

FIG. 1c schematically illustrates interfaces formed by fusing interfaces with a pre-stored ui interface;

FIG. 1d illustrates a video processing and computing device according to some embodiments of the inventions;

FIG. 2a shows a partial view of an interactive system according to further embodiments of the present invention;

FIG. 2b illustrates a video processing and computing device according to some embodiments of the inventions;

FIG. 3a shows a schematic block diagram of a multi-network signal source interactive system according to still further embodiments of the present invention;

FIG. 3b schematically illustrates the fused output of interfaces and a pre-stored ui interface;

FIG. 4a shows a schematic block diagram of a multi-network signal source interactive system according to still further embodiments of the present invention;

FIG. 4b shows a schematic block diagram of a multi-network signal source interaction system in accordance with further embodiments of the present invention;

fig. 5a, 5b, and 5c respectively illustrate multi-network signal source interaction flow diagrams in accordance with further embodiments of the present invention.

Detailed Description

In the present application, the nature of the description related to the implementation through the network is intended to cover both the wired or wireless network connection implemented through the necessary firmware or software of the switch, the router, etc., and the wired or wireless network connection implemented through the intermediary of some servers or other computers, etc., and the description of the router/switch is sometimes omitted when describing the network connection for the sake of simplifying the description and highlighting the invention point. In the present application, the networks involved may include Wi-fi networks, bluetooth networks, private Area Networks (PAN), local Area Networks (LAN), wide Area Networks (WAN), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), general Packet Radio Service (GPRS), cdmaOne, CDMA1600, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), universal Mobile Telecommunications System (UMTS), digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), integrated digital enhanced network (iDEN), wiMAX, LTE advanced, mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be publicly accessible, private, virtual private, such as a VPN.

In the present application, the unidirectional transmission line may include various devices for achieving unidirectional transmission or unidirectional control, and the device for achieving unidirectional transmission or unidirectional control may be a unidirectional control device, or a unidirectional transmission device such as a unidirectional transmission cable (unidirectional control may be achieved by a unidirectional transmission line), or an integral body composed of a control device and a transmission cable, etc., when achieving the unidirectional transmission or unidirectional control as a whole, the present application does not limit that each control device or connection cable in the integral body must be operated unidirectionally, for example, some connection cables between devices or devices may have bidirectional or multidirectional paths, but may still achieve unidirectional transmission or unidirectional control as a whole, and for example, the unidirectional transmission line may involve network connections (pieces), but when the network connections are combined with other devices, the combined integral body may still achieve the unidirectional purpose, as will be further described below, and such cases are also contemplated by the scope and claimed in the present invention.

In the present application, the use of the connection lines such as the optical fiber and the serial port is related to, in order to match these connection lines, a conversion module may need to be used in a supporting manner, for example, when a signal is converted from a network to the optical fiber, a network light conversion module is needed, but in the case that the computer network port itself is an optical port, an additional network light conversion module may be omitted, since whether such a module is necessary or not may be determined according to an actual application scenario and is well known to those skilled in the art, for the sake of simplicity, the description is not given one by one, but the omission of the necessary conversion module is not indicated. The components, such as the video processing and computing device, the instruction distribution device, and the instruction-in-two device, which are respectively independent in the drawings of the present application, may exist as a part of a computing processing device such as a computer, a tablet computer, and the like.

In this application, an interface refers to a signal output externally through a display card or a signal representing a current interface realized through other devices without a display card, and the interface is not an underlying original data file.

The invention will now be described, by way of example, with reference to the accompanying drawings, in connection with which it is to be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.

FIG. 1a illustrates a schematic block diagram of a multi-network signal source interactive system according to some embodiments.

The multi-network signal source interactive system shown in fig. 1a includes a video processing and computing device 1403, an instruction distribution device 1404 (or proxy instruction distribution device), and an instruction-to-two device 1405. According to some embodiments of the present invention, the multi-network signal source interactive system may further include two interface acquisition boxes (the illustrated interface acquisition box 1,2) and two instruction output boxes (the illustrated instruction output box 3,4). The multi-network signal source interactive system may further include a display device 1302 and a control instruction generating device 1301 (such as a keyboard, a mouse, and a touch device).

The illustrated video processing and computing device 1403 and interface capture box 1,2 establish network connectivity through the illustrated video network cable and video network switch 1400. The illustrated instruction dispatch device 1404 and instruction output box 3,4 establish a network connection through the illustrated instruction net line and instruction net switch 1400'. In the present application, only for the convenience of clearly distinguishing and establishing the corresponding relationship, a video network cable (corresponding to a video transmission part) and an instruction network cable (corresponding to a transmission instruction part) are introduced when describing the network cable, and a video network switch (corresponding to a video transmission part) and an instruction network switch (corresponding to a video transmission part) are introduced when describing the switches.

The multi-network signal source interactive system may further include a unidirectional transmission line for realizing unidirectional video transmission, which is also referred to as a unidirectional video line in this application. Each unidirectional transmission line for realizing unidirectional video transmission illustrated includes a cable for realizing unidirectional video transmission, or when unidirectional transmission is realized by an accessory included on the cable, the unidirectional transmission line includes the cable and the accessory. The multi-network signal source interactive system can further comprise a device for realizing unidirectional control, wherein the device for realizing unidirectional control comprises a unidirectional transmission line and/or all equipment capable of realizing unidirectional control, the unidirectional transmission line comprises a cable for realizing unidirectional control, or when unidirectional transmission is realized by accessories contained on the cable, the unidirectional transmission line comprises the cable and the accessories.

According to some embodiments of the present invention, the multi-network signal source interactive system may further include illustrated thin clients (or clients) 1 and F, and include illustrated clients 1 'and F'. Clients 1 and F are networked to a pool of virtual machines (or virtual machines) within the illustrated network 1; the client terminals 1 'and F' are connected with a virtual machine pool network G in the network G; the networks 1 and G may be isolated from each other, and the isolation may include a situation where the networks cannot access each other, or may include a partition implemented by network measures. The client can be installed with a program, and can interact with a virtual signal source (a signal source for short, such as a virtual computer, a virtual server) in a virtual machine pool, including obtaining the content of each signal source in each virtual machine pool through network access, and also including displaying the content of a plurality of signal sources in one virtual machine pool on the same client interface, for example, drawing the interface of one or more signal sources obtained from the access of a first virtual machine pool in each window, and each window is distributed with the interface according to a first layout.

According to some embodiments of the present invention, the multi-network signal source interactive system may further include illustrated virtual machine pools.

The following describes the parts and the interactive process of the multi-network signal source interactive system with reference to fig. 1 a. As shown in fig. 1a, the client 1 is connected to a virtual machine pool (server) 1 in the network 1 through a network cable, so that the client 1 can draw the content of each signal source in each window by accessing the content of a plurality of signal sources in the virtual machine pool through the network, and as shown in fig. 1b, four windows in the interface of the client 1 can respectively draw a corresponding signal source a, b, c, d.

The client 1 outputs the current interface of the client 1 to the interface collecting box 1 through the unidirectional video line instead of the bottom layer data (e.g., folder data), for example, the current interface may be output externally through a display card on the device where the client 1 is located, the content of the interface is output to the interface collecting box 1 through the unidirectional video line, and at this time, the display card may also be regarded as a part of the unidirectional video line. The client F ' outputs the current interface of the client F ' to the interface collecting box 2 through the unidirectional video line, instead of bottom layer data (e.g., folder data), for example, the current interface may be output externally through a display card on the device where the client F ' is located, and the content of the interface is output to the interface collecting box 2 through the unidirectional video line.

The video processing and computing device 1403 can acquire the interfaces acquired in the interface acquisition boxes 1 and 2 through the video network switch 1400 and the illustrated video network cable, for example, the interface acquisition box 1 can acquire the interface output by the client 1 and encode the interface into a network stream signal for the video processing and computing device 1403 to acquire through the network, and the interface acquisition box 2 can acquire the interface output by the client F' and encode the interface into a network stream signal for the video processing and computing device 1403 to acquire through the network. Thus, the video processing and computing device 1403 may obtain interfaces output on clients 1 and F' within different networks 1 and G, i.e., may obtain interfaces for one or more of the virtual machine pools 1 and G. The video processing and computing device 1403 may draw the acquired interfaces on the client 1 (comprised of the illustrated a, b, c, d target interfaces) and F '(comprised of the illustrated a', b ', c', d target interfaces) within windows distributed in a second layout, or may merge the interfaces and the pre-stored ui interface in a third layout for output, as shown in fig. 1 c. The second layout also comprises the steps of presenting each interface in a page mode, and more interfaces can be viewed by clicking the next page.

After the video processing and computing device 1403 obtains the interface collected in the interface collection box 1 and/or 2, the interface is output to the display device 1302 through the HDMI cable or other video cable. The user can view the screen of the display device 1302 and perform a corresponding input operation on the control instruction generation device 1301. The control command generating device 1301 may be a touch screen that captures operations in various manners such as electric induction, magnetic induction, thermal induction, force induction, optical induction, and acoustic induction, or other control command generating devices such as a keyboard and a mouse. According to some embodiments of the present invention, the control instruction generating device 1301 may be a transparent touch device, which may be spatially superimposed on the display device 1302, and the display device 1302 provides a picture of a control object, and by referring to the picture of the display device 1302 below the transparent touch device, a visual touch may be implemented on the control instruction generating device. The control instruction generation device 1301 and the display device 1302 may be integrated into one body, for example, existing as a touch display screen.

The control command generating device 1301 transmits the command to the command-two-in-one device 1405 through the USB cable in a single direction, and according to some embodiments of the present invention, the command may correspond to a simple click touch action, so the command includes coordinate information and action information. According to some embodiments of the invention, the instruction may also be generated by a shortcut key input. According to some embodiments of the invention, the instruction may also include user identity information, for example by typing in a specific key or by entering account information.

The instruction two-in-one device 1405 receives the instruction input from the control instruction generation device and unidirectionally transmits the instruction to the video processing and computing device and the instruction distribution device, respectively, for example, the instruction two-in-one device 1405 divides the instruction into the same two parts, e.g., by instruction backup, or by physical hardware to change one physical input into two parts, and then unidirectionally transmits the instruction to the video processing and computing device and the instruction distribution device, respectively, so that the instruction two-in-one device 1405 unidirectionally controls the video processing and computing device 1403 to respond.

Upon receipt of the command, the video processing and computing device 1403 determines the action location of the command according to the current layout (e.g., the layout shown in fig. 1 c), and thus determines the target interface (or target display interface) or ui interface to which the command is applied. If the command is determined to be a command to control the ui interface, the video processing and computing device 1403 may control the ui interface to respond directly according to the command. If the command is a command for controlling the target interface, the video processing and computing device 1403 unidirectionally transmits interface information (such as an interface ID) and a window position of the target interface to the command distribution device 1404, for example, transmits an interface ID corresponding to an interface (composed of target interfaces a, b, c, and d shown in the figure) on the client 1 shown in fig. 1c and a position in the screen where the black bold window is located to the command distribution device 1404. The instruction distributing device 1404 converts the instruction into a second instruction in the target window through coordinate conversion according to the window position of the black bold window (i.e. the target window), for example, converts the mouse coordinate position of the dot O in the upper left corner of the screen in fig. 1c into the coordinate position of the dot E in the upper left corner of the target window, and sends the second instruction to the client 1 corresponding to the target interface through a unidirectional transmission line (such as various unidirectional transmission lines mentioned in detail below in this application). When the video processing and computing device enables the target interface to be displayed in a full screen mode in the first display device, the coordinate spaces of the first instruction and the second instruction are the same, and therefore the video processing and computing device can transmit the target interface ID to the instruction distribution device in a single direction without sending the window position to the instruction distribution device. According to some embodiments of the present invention, the unidirectional transmission line between the video processing and computing device 1403 and the instruction distribution device 1404 includes a unidirectional serial port line, and the video processing and computing device 1403 sends information such as interface ID to the instruction distribution device 1404 through the unidirectional serial port line, and since the unidirectional serial port line has very limited transmission capability, it is possible to prevent video from being transmitted from the video processing and computing device 1403 on the left side of fig. 1 to the instruction distribution device 1404 on the right side of the video during the interaction process, and therefore, it is possible to further improve the security of the signal source during the interaction process from the visitation and prevent others from transmitting video through the transmission line between the video processing and computing device 1403 and the instruction distribution device 1404 by tampering with various settings.

According to some embodiments of the invention, the video processing and computing device and the instruction distribution device pre-store interface information; alternatively, the video processing and computing device stores interface information (including pre-storage or real-time storage), and the instruction distribution device acquires the interface information in the video processing and computing device in a non-contact synchronous manner (including acquiring only a part of the interface information in the video processing and computing device). According to some embodiments of the invention, the video processing and computing device and the instruction distribution device pre-store interface information and user identity information implementing said input; or the video processing and computing equipment stores the interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment and the user identity information for implementing the input in a non-contact synchronous mode. The interface information comprises an interface ID, and in addition, the interface information can also comprise client information from which the interface originates, one or more of an instruction output box corresponding to the interface and access authority information of a user to the interface. According to some embodiments of the present invention, the interface ID may also be directly defined by one or more of client information from which the interface originates, an instruction output box corresponding to the interface, and access right information of the user to the interface, such as a first part in the interface ID being a client address, a second part being a corresponding instruction output box address, and a third part being an access right related assignment (0 or 1). The video processing and computing device may determine whether to output a first instruction input by a user to the instruction distribution device (or determine whether to perform a further action) based on user access right information therein (e.g., only a certain interface is accessible by a certain user identity). According to some embodiments of the present invention, information or portions of information in the video processing and computing devices may be copied to instruction distribution device 1404 via a removable medium (e.g., an optical disc) for synchronization, which may be in the form of periodic copies, periodic copies according to actual needs, or copies in the presence of new interface signal sources. In this application, such a synchronization method implemented by a moving medium is referred to as a non-contact synchronization method. The non-contact type synchronization mode can avoid network connection between the video network switch and the instruction network switch.

As described above, after the instruction distributing device 1404 converts the instruction into the second instruction in the target window through coordinate conversion, the second instruction is sent to the client 1 corresponding to the target interface through the unidirectional transmission line. The instruction distribution device 1404 may unidirectionally transmit the aforementioned related information to the client 1 in the following manner. The instruction distributing device 1404 outputs the instruction to the instruction output box 3 corresponding to the client 1 through the instruction network switch 1400' and the instruction network line, and the instruction output box 3 performs unidirectional control on the corresponding client 1, for example, the instruction output box 3 transmits the instruction to the corresponding client 1 through a unidirectional transmission line, and the client 1 receives the instruction and responds according to the instruction, including controlling the target signal source a in the virtual machine pool to respond according to the instruction.

According to some embodiments of the present invention, the instruction distributing device 1404 may store in advance the corresponding relationship between each client or each interface ID and each instruction output box, so that, when the interface of the client 1 shown in fig. 1b is sent to the video processing and computing device 1403 through the path shown in fig. 1a and is fused with the interfaces from other clients (such as the interfaces composed of a ', b', c ', d' in the figure) at the video processing and computing device 1403 to form the interface shown in fig. 1c, if a user clicks a play button on the window where a is located, the video processing and computing device 1403, when determining that the action object is the interface from the client 1 (such as by analyzing the distribution layout of the mouse action position and each interface capture box output interface), unidirectionally transmits the interface ID (which may also contain information of the client from which the interface originates) and the window position to the instruction distributing device 1404, according to the corresponding relationship between each interface ID and each instruction output box, the instruction is sent to the corresponding instruction output box 3 of the client 1 through the path shown in the figure, and further sends the instruction output box 3 to the corresponding client 1 (the corresponding signal source of the corresponding mouse signal source) as the target signal source, the instruction output box a corresponding to the client 1). Accordingly, at this time, the video processing and computing device 1403 only needs to send a simple interface ID and a window position to the instruction distributing device 1404 instead of complex interface information, and the instruction distributing device 1404 can send the instruction sent by the instruction distributing device 1404 to the instruction output box corresponding to the client from which the interface originates according to the sent interface ID in combination with the interface ID information synchronized by itself in the aforementioned physical isolation manner, and further send the instruction to the client corresponding to the signal source by the instruction output box, or determine whether to send the instruction sent by the instruction distributing device 1404 to the instruction output box corresponding to the client from which the interface originates in combination with the access authority information (or the user identity information) of the user to the interface, which is stored or synchronized in advance. In this way, the amount of data to be unidirectionally transmitted by the video processing and computing device 1403 to the instruction distribution device 1404 can be further reduced, thereby making it possible to adopt a narrow-band transmission medium for data transmission and to avoid a large amount of video data from being accidentally leaked to the instruction distribution device 1404 on the right. According to some embodiments of the present invention, one or more monitoring devices may be added to a unidirectional transmission path from the video processing and computing device to the command distribution device (or to a command unidirectional transmission device that unidirectionally transmits the interface information and the window position of the target interface to the command distribution device) for monitoring the passing data in real time, so that only data with low transmission frequency, small data amount, or fixed data format (the expression herein also covers the case where only data with two or three of the attributes of low transmission frequency, small data amount, or fixed data format can be passed), so as to avoid that this channel is used for transmitting other information. In the case where the foregoing number of all the clients, the number of the clients, the client and the instruction output box, and the correspondence between the clients and the interface capture box are not changed, it is also possible to store the relevant interface information and the user identification information for performing the operation in advance directly on the video processing and computing device 1403 and the instruction distribution device 1404, and to omit the synchronization operation. According to some embodiments of the present invention, when user identity information is included in the user-input instruction, the video processing and computing device 1403 and the instruction distribution device 1404 may decide whether to perform further actions, such as whether to send an interface ID to the instruction distribution device 1404 by the video processing and computing device 1403 and whether to send an instruction to the instruction output box, based on stored user access right information for the interface (e.g., certain users do not have the right to operate certain signal sources).

The signal source a responds according to the instruction, and outputs a response result to the interface capture box 1 through the network cable, the client 1 and the unidirectional video cable, and the interface capture box 1 outputs the response result to the video processing and computing device 1403 through the video network switch 1400 and the video network cable.

According to still other embodiments of the present invention, the multi-network signal source interactive system may further include an interface web server 1401 and an instruction web server 1402. The interface web server 1401 and the instruction web server 1402 may be configured to perform some functions (such as various authority controls, interface information storage, user identity information storage, etc.) of the video processing and computing devices and the instruction distribution devices, respectively, and other further functions.

The illustrative interface web server 1401, video processing and computing device 1403, and interface capture box 1,2 establish network connections through the illustrative video network cable and video network switch 1400. The illustrated instruction net server 1402, instruction dispatch device 1404, and instruction output box 3,4 establish network connections via the illustrated instruction net lines and instruction net switch 1400'.

The interface web server 1401 acquires the interfaces captured in the interface capture boxes 1 and 2 through the video web switch 1400 and the illustrated video network lines. The interface web server 1401, having acquired the interfaces output from the clients 1 and F' in the different networks 1 and G, may output the interfaces to the video processing and computing device 1403. Alternatively, according to some embodiments of the present invention, the interfaces captured in the interface capture boxes 1 and 2 may also be obtained by the video processing and computing device 1403 and the interface web server 1401 via the video web switch 1400 and the illustrated video network cable, respectively.

After the video processing and computing device 1403 obtains the interface collected in the interface collection box 1 and/or 2, the interface is output to the display device 1302 through the HDMI cable or other video cable. The user can view the screen of the display device 1302 and perform a corresponding input operation on the control instruction generation device 1301.

The control instruction generation device 1301 transmits the instruction to the instruction-two-in-one device 1405 in a single direction through the USB cable, and the instruction-two-in-one device 1405 divides the instruction into the same two parts, for example, by instruction backup, or by changing one physical input into two parts by means of physical hardware.

The instruction-two-in-one device 1405 then transmits each instruction unidirectionally to the video processing and computing device 1403 and the instruction distribution device 1404, respectively. As will be discussed below, it may also be referred to herein as instructing the two-in-one device 1405 to control the video processing and computing device 1403 in a single direction in response.

Upon receipt of the instruction, the video processing and computing device 1403 determines the location at which the instruction acts based on the current interface layout, and thus the target interface or ui interface to which the instruction acts. If the command is determined to be a command to control the ui interface, the video processing and computing device 1403 may respond by controlling the ui interface directly according to the command. If the command is a command for controlling the target interface, the video processing and computing apparatus 1403 unidirectionally transmits the interface information (such as an interface ID) and the window position of the target interface to the command distributing apparatus 1404.

According to some embodiments of the present invention, the interface web server and the instruction web server may pre-store interface information; or the interface web server stores the interface information (including pre-storage or real-time storage), and instructs the web server to acquire the interface information of the interface web server in a non-contact synchronization mode; the interface information includes an interface ID. According to some embodiments of the invention, the interface web server and the instruction web server pre-store interface information and user identity information implementing said input; or the interface web server stores the interface information and the user identity information for implementing the input, and instructs the web server to acquire the interface information in the interface web server and the user identity information for implementing the input in a non-contact synchronous mode. The interface information comprises an interface ID, and in addition, the interface information can also comprise one or more of client information from which the interface originates, an instruction output box corresponding to the interface and access authority information of a user to the interface. According to some embodiments of the present invention, the interface ID may also be directly defined by one or more of client information from which the interface originates, an instruction output box corresponding to the interface, and access right information of the user to the interface. The interface network server can control whether the video processing and computing equipment outputs the first instruction to the instruction distribution equipment or not according to the user access authority information; and/or the instruction network server determines whether to output the second instruction to the instruction output box according to the user access authority information.

The instruction distributing device 1404 sends the instruction to (or under the authorization of the instruction web server) convert the instruction into a second instruction in the target window, and then sends the second instruction to the client 1 corresponding to the target interface through the unidirectional transmission line. The instruction distribution device 1404 may unidirectionally transmit the aforementioned related information to the client 1 in the following manner. The instruction distributing device 1404 outputs the instruction to the instruction output box 3 corresponding to the client 1 through the instruction network switch 1400' and the instruction network line, and the instruction output box 3 performs unidirectional control on the corresponding client 1, for example, the instruction output box 3 transmits the instruction to the corresponding client 1 through a unidirectional transmission line, and the client 1 receives the instruction and responds according to the instruction, including controlling the target signal source a in the virtual machine pool to respond according to the instruction.

The signal source a responds according to the instruction, and outputs a response result to the interface acquisition box 1 through the network cable, the client 1 and the unidirectional video cable, the interface acquisition box 1 outputs the response result to the video processing and computing device 1403 through the video network switch 1400 and the video network cable, or outputs the response result to the interface network server, and the interface server outputs the response result to the video processing and computing device; or the interface acquisition box outputs the response result to the interface network server and the video processing and computing equipment through the video network switch and the video network cable.

According to some embodiments of the present invention, when the number of clients accessed increases, the interface web server 1401 may update the relevant information, such as the interface information, the user identity information for performing the operation, and the like, in real time.

Furthermore, according to some embodiments of the present invention, interface acquisition boxes 1 and 2 may be integrated as one acquisition box with multiple acquisition ports; the command output box 3 or 4 may be integrated as a command output box having a plurality of command output ports, and is configured to convert a network command input by a command network line into a format suitable for outputting to a unidirectional transmission line (e.g., a unidirectional serial port line), for example, convert the network command into a serial command format, and output the command to the unidirectional serial port line through one of corresponding output ports connected to a client according to the client indicated in the command, and transmit the command to the client through the unidirectional serial port line.

According to some embodiments of the invention, the video processing and computing device 1403 may pre-store and set a ui interface to be operated (i.e., to be used) and respond to the instruction (e.g., upon detecting an instruction input, or when the instruction corresponds to a call-up ui interface).

According to some embodiments of the invention, the ui interface may include save, plot, delete, screen-recording, undo, clear, etc. interactive tabs, outline distribution, mouse patterns, etc. Each different ui interface may have a different label, outline distribution, etc. The plotting means drawing lines, adding geometric structure diagrams, flow charts, marking, adding characters, coloring and the like.

According to some embodiments of the invention, the instructions to control the ui interface may include, for example, clicking a pull-down menu, moving, zooming in or out of the position of the display window of the signal source, and the like.

According to some embodiments of the invention, the instruction for controlling the target interface may include, for example, clicking and changing the video content of the signal source, and the like.

The video processing and computing device 1403 may also be configured to retransmit the interface ID (or other interface information), and the window position, after the interface ID, and window position have changed, so that the amount and frequency of transmissions may be reduced, according to some embodiments of the present invention.

According to some embodiments of the present invention, outputting the interface ID, and the window location (collectively, the content to be transmitted) to instruction distribution device 1404 via a unidirectional transmission line comprises transmitting the interface ID, and the window location to instruction distribution device 1404 by: the content to be transmitted is transmitted to instruction distribution apparatus 1404 through a unidirectional optical fiber as a unidirectional transmission line.

In this case, the unidirectional transmission line includes a unidirectional optical fiber. Other means for implementing unidirectional transmission, including unidirectional transmission formed by a network fabric, are also contemplated by the present invention.

In the present application, the first network and the second network are only concepts used for describing the two networks distinctively, and have no other specific meaning.

According to some embodiments of the present invention, the unidirectional controlling of a signal source in the virtual machine pool to respond includes responding to a signal source in the virtual machine pool through a command network line and a command network switch, and a unidirectional transmission device, a client, a network line, or a unidirectional transmission device of one of the following e) -h), or may also be implemented by unidirectional transmitting a command to a signal source:

e) A combination of a network-to-serial device (the instruction output box can be the network-to-serial device) and a unidirectional serial port line;

f) The combination of the network light conversion equipment and the unidirectional optical fiber;

g) The combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;

h) The combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment and unidirectional serial port lines.

According to some embodiments of the present invention, the responding by the signal source in the pool of unidirectional control virtual machines includes responding by the command network cable and the command network switch, the unidirectional control device, the client, and the network cable. The one-way control device is connected with the instruction network switch and the client, and acquiring the instruction from the instruction network switch, and controlling the client in a one-way mode.

According to some embodiments of the present invention, the video network switch is isolated from a network in which the command network switch is located; the video network switch and the instruction network switch are both isolated from the network where each client is located, and the networks where each client is located can also be isolated from each other, namely, the video network, the instruction network and each network where each client is located are isolated from each other.

By the embodiment, interaction of each signal source in virtual machine pools in a plurality of networks can be realized, meanwhile, no new network exposure risk is introduced into the virtual machine pools in the interaction process, and meanwhile, the malicious attack of an interacted object (a virtual machine Chi Duan) on an interaction initiating end is ensured.

FIG. 1d illustrates a video processing and computing device 1403 according to some embodiments of the invention.

The video processing and computing device 1403 includes an instruction receiving unit 321, a response computing unit 322, and a data distribution unit 323. The various units may also be combined with each other or subdivided in different ways to achieve the same overall functionality of the video processing and computing device 1403, according to some other embodiments of the invention.

The instruction receiving unit 321 is configured to receive an instruction and send the signal to the response calculating unit 322.

The response calculation unit 322 is configured to analyze the instruction sent by the instruction receiving unit 321 to determine an instruction for controlling the ui interface and an instruction for controlling the target interface corresponding to the input. The response calculation unit controls the ui interface to respond according to the instruction for controlling the ui interface, sends the target interface information and the window position to the data distribution unit 323 according to the instruction for controlling the target interface, and then the data distribution unit transmits the target interface information and the window position to the instruction distribution equipment 1404 through a unidirectional transmission line in a unidirectional mode.

According to some embodiments of the present invention, the response calculation unit 2322 may determine the instruction for controlling the target interface in the instruction or the instruction for controlling the ui in the instruction according to the position information in the instruction and the distribution of each target interface and the ui interface (or the control therein) in the current interface. Or for shortcut key input, the instruction for controlling the target interface or the instruction for controlling ui in the instruction can be directly determined according to the preset corresponding relation.

In addition, according to the technical details described in the foregoing fig. 1a to 1c, related functions may be supplemented in the corresponding units, or new units may be added to implement various technical details described in the foregoing fig. 1a to 1c, which are not described herein again for the sake of simplicity.

Fig. 2a shows a partial view of an interactive system according to another embodiment of the present invention, which only shows the video network switch 1400, the components above the command network switch 1400 'and their connection, and the video network switch 1400, the components below the command network switch 1400' and their connection have been omitted for simplicity, and reference may be made to the above description with reference to fig. 1 a. Fig. 2a differs from fig. 1a in that: the interface of the video processing and computing device 1403 (e.g., captured by the display card therein and output by the display card) is transmitted to the interface display control device 1801 in a unidirectional manner, and the one-to-two device 1405 receives a command (shown as a unidirectional command) transmitted in a unidirectional manner from the interface display control device 1801. The interface display control device 1801 encodes the acquired interface into a network flow signal, and the interactive terminal 1300 ″ may acquire the network flow information by using the network switch 1800 according to the instruction of the control instruction generation device 1301 ″ so as to output a corresponding interface to the display device 1302 ″. For simplicity, in some descriptions of the present application, descriptions of video encoding and/or decoding processes involved in network transmission processes are omitted.

The user can input instructions by means of the control instruction generation device 1301 "with reference to the interface displayed by the display device 1302". The interactive terminal 1300 ″ receives the instruction, and transmits the instruction to the interface display and control device 1801 through the network. The sending of the command may be implemented, for example, by illustrating a network cable and sending the command to the interface display and control device 1801 using the network switch 1800, or sending the command to the interface display and control device 1801 using an additional server and network device. The interactive terminal 1300 ″ may also send the instruction to the server, so that the server stores the relevant records, or performs unified management, or before the interactive terminal sends the instruction, the interactive terminal sends a corresponding request to the server, and the server performs the sending of the instruction after authorization.

The interface display and control device 1801 transmits the instruction to the instruction two-in-one device 1405 in a unidirectional manner, and the instruction two-in-one device 1405 continues to respond to the instruction, including outputting the instruction to the instruction distribution device 1404 and the video processing and computing device 1403, as described above, which is not repeated here, and the corresponding signal source outputs the response result to the video processing and computing device 1403, as also described above with reference to fig. 1a, and the video processing and computing device 1403 outputs the interface (abbreviated as response interface) formed after the signal source responds to the interface display and control device 1801. According to some embodiments of the present invention, the interface display and control device 1801 may include a network string converting device, and the network string converting device further implements the instruction unidirectional transmission through a unidirectional serial port line.

In addition to sending the interface to the interactive terminal in real time, according to some embodiments of the present invention, the interface display and control device may temporarily store the interface, and send the interface to the interactive terminal at a future time according to actual needs or network conditions, or encode a plurality of interfaces for a period of time into a video, and then encode the video into a network stream and send the network stream to the interactive terminal. According to some embodiments of the present invention, the interface display and control device may further temporarily store the interface or the video to a server or a cloud, and send the interface or the video to the interactive terminal at a future time according to actual needs or network conditions. The interface includes the interface from the video processing and computing device 1403 received by the interface display and control device mentioned above.

And the interactive terminal acquires the response interface from the interface display and control equipment through the network and outputs the response interface to the display equipment. For example, the interactive terminal may obtain, through the network device, a response interface from the video processing and computing device 1403 received by the interface display and control device, or obtain, through a server and the network device, a response interface from the video processing and computing device 1403 received by the interface display and control device.

According to some embodiments of the present invention, the interface display and control device 1801 may further have all functions of the interactive terminal 1300 ″, including being capable of collecting instructions input by a user, or further having a corresponding control instruction generation device and a corresponding display device.

According to some embodiments of the invention, the interactive system may include a plurality of interactive terminals, each interactive terminal is connected through network communication, and content sharing may be performed between the interactive terminals through a network, where the content sharing includes sharing respective interface screenshots or sharing respective contents acquired from the respective interface display and control devices.

The interactive terminal 1300 ″ may also be a web page version of the interactive terminal, as long as it has the function of sending the instruction to other interface display and control devices, and the interactive terminal includes one of a personal computer, a handheld or laptop computer, a tablet computer, a cellular phone, a mobile device, an electronic device, a smart phone, and a smart television, or a combination thereof.

Through the embodiment, on one hand, interaction of each signal source in a plurality of networks can be realized, meanwhile, new network exposure risk cannot be introduced to each signal source in the interaction process, and meanwhile, the interaction end is ensured not to be attacked maliciously by the interaction signal source. On the other hand, free, flexible and light-weight safe interaction can be achieved in a network mode independently of the huge video processing and the equipment with the dotted line frame where the computing equipment is located.

Figure 2b illustrates a video processing and computing device 2403 according to some embodiments of the invention.

The video processing and computing device 2403 includes an instruction receiving unit 2321, a response computing unit 2322, a data distribution unit 2323, and a video distribution unit 2324. The various units may also be combined with each other or subdivided in different ways to also implement the overall functionality of the video processing and computing device 2403, according to some other embodiments of the invention.

The video distribution unit 2324 is configured to distribute the video to the interface display and control device 1801.

The instruction receiving unit 2321 receives the instruction and sends the signal to the response calculating unit 2322.

The response calculation unit 2322 analyzes the instruction transmitted by the instruction receiving unit 2321 to determine an instruction for controlling the ui interface and an instruction for controlling the target interface corresponding to the input. The response calculation unit controls the ui interface to respond according to the instruction for controlling the ui interface, sends the interface ID and the window position to the data distribution unit 2323, and then the data distribution unit transmits the interface ID and the window position to the instruction distribution equipment 2404 through a unidirectional transmission line in a unidirectional mode.

According to some embodiments of the present invention, the response calculating unit 2322 may determine the instruction for controlling the target interface in the instruction or the control instruction for controlling ui in the instruction according to the position information in the instruction and the distribution of the signal sources and the ui interface (or the controls therein) in the current interface. Or for shortcut key input, the instruction for controlling the ui in the instruction or the instruction for controlling the ui in the instruction can be directly determined according to the preset corresponding relation.

In addition, according to the technical details described in the foregoing fig. 2a, related functions may be supplemented in the corresponding units, or new units may be added, which are not described herein again for the sake of simplicity.

Fig. 3a shows a schematic block diagram of a multi-network signal source interactive system according to further embodiments of the present invention.

The difference between fig. 3a and fig. 1a is that the client and virtual machine pool portions therein are replaced by the illustrated signal source a and signal source b. The various signal sources are located in different networks.

As shown, the multi-network signal source interactive system includes a video processing and computing device 3403, an instruction distribution device 3404, and an instruction-to-two device 3405. According to some embodiments of the present invention, the multi-network signal source interactive system may further include two interface acquisition boxes (illustrated interface acquisition boxes 31, 32) and two instruction output boxes (illustrated instruction output boxes 33, 34). The multi-network signal source interactive system can further comprise a display device 3302 and a control instruction generating device 3301' (such as a keyboard, a mouse and a touch device). The illustrated video processing and computing device 3403 and interface capture boxes 31, 32 establish network connections through the illustrated video network cable and video network switch 3400. The illustrated instruction distribution device 3404 and instruction output cassettes 33, 34 establish network connections through the illustrated instruction net line and instruction net switch 3400'.

The following describes the parts and interaction process of the multi-network signal source interactive system with reference to fig. 3 a. As shown in fig. 3a, signal source a outputs the current interface of signal source a, rather than the underlying data (e.g., folder data), to interface capture box 31 via a unidirectional video line. Signal source b outputs the current interface of signal source b, rather than the underlying data (e.g., folder data), to interface capture box 32 via a unidirectional video line. The video processing and computing device 3403 may obtain the interfaces captured in the interface capture boxes 31 and 32 through the video network switch 3400 and the illustrated video network cable.

After the video processing and computing device 3403 acquires the interface captured in the interface capture box 31 and/or 32, it outputs the interface to the display device 3302 through the HDMI cable or other video cable. The user can view the screen of the display device 3302 and perform a corresponding input operation on the control instruction generating device 3301. The control instruction generating apparatus 3301 transmits the instruction unidirectionally to the instruction one-to-two apparatus 3405 through the USB line. The instruction-one-by-two device 3405 receives the instruction input from the control instruction generation device and unidirectionally transmits the instruction to the video processing and computing device and the instruction distribution device, respectively.

After receiving the instruction, the video processing and computing device 3403 determines the instruction acting position according to the current layout, thereby determining a target interface (or called target interface or target display interface) or ui interface to which the instruction acts. If the command is determined to be a command to control the ui interface, the video processing and computing device 3403 may respond by controlling the ui interface directly according to the command. If the command is a command for controlling the target interface, the video processing and computing device 3403 unidirectionally transmits interface information (such as an interface ID) and a window position of the target interface to the command distribution device 3404, for example, the interface ID of the target interface corresponding to the signal source a (set as the target signal source) shown in fig. 3b and a position in the screen where the black bold window is located are transmitted to the command distribution device 3404. The instruction distribution device 3404 is configured to convert the first instruction into a second instruction in the target window through coordinate conversion according to the window position, send the second instruction to a target instruction output box corresponding to the target interface through an instruction network, and perform unidirectional control on a target signal source from which the target interface originates by the target instruction output box.

According to some embodiments of the invention, the video processing and computing device and the instruction distribution device pre-store interface information; or the video processing and computing device stores the interface information (including pre-storage or real-time storage), and the instruction distribution device acquires the interface information in the video processing and computing device in a non-contact synchronous mode. According to some embodiments of the invention, the video processing and computing device and the instruction distribution device pre-store interface information and user identity information implementing said input; or the video processing and computing equipment stores the interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment and the user identity information for implementing the input in a non-contact synchronous mode. According to some embodiments of the present invention, the interface information includes an interface ID, and further includes one or more of signal source information (such as a signal source name) from which the interface originates, an instruction output box (control information) corresponding to the interface, and access right information of a user to the interface. According to some embodiments of the present invention, the video processing and computing device may decide whether to output the first instruction to the instruction distribution device according to user access right information therein, and/or the instruction distribution device may decide whether to output the second instruction to the instruction output box according to user access right information stored therein or synchronously acquired from the video processing and computing device in a non-contact manner.

According to some embodiments of the invention, the instruction distribution device 3404 may unidirectionally transmit the aforementioned related information to the signal source a in the following manner. The instruction distributing apparatus 3404 outputs an instruction to the instruction output cassette 33 corresponding to the target signal source a through the instruction net switch 3400' and the instruction net line, and the corresponding signal source a is unidirectionally controlled by the instruction output cassette 33.

According to some embodiments of the present invention, the instruction distribution device 3404 may store the corresponding relationship between each signal source (or each interface) and each instruction output box in advance, so that, when the interface of the signal source a is sent to the video processing and computing device 3403 through the path shown in fig. 3a and is fused with other interfaces (such as the interface of the signal source b) at the video processing and computing device 3403 to form the interface shown in fig. 3b, if a user clicks a play button on a window where a is located, the video processing and computing device 3403 unidirectionally transmits the interface ID and the window position to the instruction distribution device 3404 when determining that an acting object is the interface from the signal source a (for example, by analyzing the mouse acting position and the distribution layout of the output interfaces of each interface capture box), the instruction distribution device 3404 sends an instruction to the instruction output box 33 corresponding to the corresponding signal source a through the illustrated path according to the corresponding relationship between each interface and each instruction output box, and the instruction output box 33 further sends the instruction to the signal source a.

The signal source a responds according to the instruction, and outputs a response result to the interface acquisition box 31 through the network cable, the signal source a and the unidirectional video cable, and the interface acquisition box 31 outputs the response result to the video processing and computing device 3403 through the video network switch 3400 and the video network cable.

According to still other embodiments of the present invention, the multi-network signal source interactive system may further include an interface web server 3401 and an instruction web server 3402. The interface web server and the instruction web server may be configured to perform some functions (such as various authority controls, interface information storage, user identity information storage, and the like) of the video processing and computing device and the instruction distribution device, respectively, and other further functions.

The illustrated interface web server 3401, video processing and computing device 3403, and interface capture boxes 31, 32 establish network connections through the illustrated video network cable and video network switch 3400. The illustrated instruction net server 3402, instruction distribution apparatus 3404, and instruction output cassettes 33, 34 establish network connections through the illustrated instruction net line and instruction net switch 3400'.

The interface web server 3401 acquires the interfaces captured in the interface capture boxes 31 and 32 through the video web switch 3400 and the illustrated video web. After the interface web server 3401 obtains the interfaces output on the signal sources a and b in different networks 1 and G, the interfaces may be output to the video processing and computing device 3403. Alternatively, according to some embodiments of the present invention, the captured interfaces in the interface capture boxes 31 and 32 may also be acquired by the video processing and computing device 3403 and the interface web server 3401 through the video web switch 3400 and the illustrated video web.

After the video processing and computing device 3403 acquires the interface captured in the interface capture box 31 and/or 32, it outputs the interface to the display device 3302 through the HDMI cable or other video cable. The user can view the screen of the display device 3302 and perform a corresponding input operation on the control instruction generating device 3301. The control instruction generating apparatus 3301 transmits the instruction unidirectionally to the instruction one-to-two apparatus 3405 through the USB line.

The instruction-two-in-one device 3405 then transmits each instruction unidirectionally to the video processing and computing device 3403 and the instruction distribution device 3404, respectively.

After receiving the instruction, the video processing and computing device 3403 determines the instruction action location according to the current interface layout, thereby determining the target interface or ui interface to which the instruction acts. If the instruction is determined to be an instruction to control the ui interface, the video processing and computing device 3403 may respond by controlling the ui interface directly according to the instruction. If the command is a command for controlling the target interface, the video processing and computing device 3403 unidirectionally transmits the interface information and the window position of the target interface to the command distribution device 3404, for example, the interface ID of the interface corresponding to the signal source a (set as the target signal source) shown in fig. 3a and the window position in the screen where the black bold window (fig. 3 b) is located are transmitted to the command distribution device 3404.

According to some embodiments of the present invention, interface information may be pre-stored at the interface web server and the instruction web server; or the interface web server stores the interface information (including pre-storage or real-time storage), and instructs the web server to acquire the interface information of the interface web server in a non-contact synchronous mode. According to some embodiments of the present invention, the interface web server and the instruction web server pre-store interface information and user identity information implementing the input; or the interface web server stores the interface information and the user identity information for implementing the input, and instructs the web server to acquire the interface information in the interface web server and the user identity information for implementing the input in a non-contact synchronous mode. According to some embodiments of the present invention, the interface information includes an interface ID, and in addition, the interface information may further include one or more of client information from which the interface originates, an instruction output box corresponding to the interface, and access right information of the user to the interface. According to some embodiments of the present invention, the interface ID may also be directly defined by one or more of signal source information from which the interface originates, an instruction output box corresponding to the interface, and access right information of the user to the interface. The interface network server can control whether the video processing and computing equipment outputs the first instruction to the instruction distribution equipment or not according to the user access authority information; and/or the instruction network server determines whether to output the second instruction to the instruction output box according to the user access authority information.

The instruction distribution device 3404 converts the first instruction into a second instruction in the target window through coordinate conversion according to the position of the target window, and sends the second instruction to a target instruction output box corresponding to the target interface (or under the authorization of an instruction network server) through an instruction network, and the target instruction output box performs unidirectional control on a target signal source from which the target interface originates. According to some embodiments of the invention, the instruction distribution device 3404 unidirectionally controls the signal source a in the following manner. The instruction distribution device 3404 outputs the instruction to the instruction output box 33 corresponding to the target signal source a through the instruction network switch 3400' and the instruction network cable, and the instruction output box 33 performs unidirectional control on the corresponding signal source a, for example, the instruction output box 33 transmits the instruction to the corresponding signal source a through a unidirectional transmission line in a unidirectional manner, and the signal source a receives the instruction and responds according to the instruction, including controlling the target signal source a in the virtual machine pool to respond according to the instruction.

The signal source a responds according to the instruction, and outputs a response result to the interface acquisition box 31 through a one-way video cable, the interface acquisition box 31 outputs the response result to the interface network server 3401 through the video network switch 3400 and the video network cable, and the interface server outputs the response result to the video processing and computing device 3403; or the interface capture box 31 outputs the response result to the interface web server 3401 and the video processing and computing device 3403 through the video web switch 3400 and the video web.

According to some embodiments of the present invention, when the number of signal sources connected to the network increases, the interface web server 3401 may update and store related information, such as interface information, user identity information for performing the operation, and the like, in real time.

The various details described previously with respect to the previous figures of fig. 3a may be applied to the embodiment of fig. 3a and 3b, or may be applied with suitable modifications, and for the sake of simplicity, are not described again here.

Through the embodiment, on one hand, interaction of each signal source in a plurality of networks can be realized, meanwhile, new network exposure risk cannot be introduced to each signal source in the interaction process, and meanwhile, the interaction end is ensured not to be attacked maliciously by the interaction signal source.

In addition, as shown in fig. 2a, the multi-network signal source interactive system of fig. 3a may also include an interface display and control device; the video processing and computing equipment is also used for transmitting the first interface and/or the second interface to the interface display and control equipment in a one-way mode; the interface display and control equipment is used for transmitting the first interface and/or the second interface to the interaction terminal through the use network; the interface display control equipment is also used for receiving a third instruction input by the interactive terminal and unidirectionally transmitting the third instruction to the instruction one-to-two equipment; the instruction one-to-two equipment is used for receiving a third instruction and respectively transmitting the third instruction to the video processing and computing equipment and the instruction distribution equipment in a one-way mode; the video processing and computing equipment is used for determining a target interface acted by the third instruction and transmitting the interface information and the window position of the target interface to the instruction distribution equipment in a one-way mode; the instruction distribution equipment is used for converting the third instruction into a fourth instruction in the target window through coordinate conversion according to the window position, sending the fourth instruction to a target instruction output box corresponding to the target interface through an instruction network, and performing unidirectional control on a target signal source from which the target interface originates by the target instruction output box.

In addition, the content related to the interface display and control device described above with reference to fig. 2a is also applicable here, and for the sake of simplicity, the description thereof is omitted here.

Fig. 4a shows a schematic block diagram of a multi-network signal source interactive system according to still further embodiments of the present invention.

The multi-network signal source interactive system comprises a video processing and computing device 4403, an instruction distribution device 4404 and an instruction one-to-two device 4405.

The multi-network signal source interactive system can also comprise a display device 4302 and a control instruction generating device 4301' (such as a keyboard, a mouse and a touch device).

A first signal source a in a first network unidirectionally transmits a first interface to the video processing and computing device 4403; a second signal source b within the second network transmits a second interface uni-directionally to the video processing and computing device 4403.

The video processing and computing device 4403 is configured to obtain the first interface and the second interface, and output the first interface and/or the second interface to the display device 4302;

the instruction one-in-two device 4405 is configured to receive the first instruction input from the control instruction generating device 4301, and transmit the first instruction to the video processing and computing device and the instruction distributing device 4404 in a unidirectional manner, respectively.

The video processing and computing device determines the target interface to which the first instruction acts and transmits interface information and window position of the target interface to the instruction distribution device 4404 in a single direction.

The instruction distributing apparatus 4404 converts the first instruction into a second instruction in the target window through coordinate conversion according to the position of the target window, and performs unidirectional control on a target signal source (set as the signal source a) from which the target interface originates according to the second instruction.

According to some embodiments of the present invention, the instruction distribution device 4404 may store the corresponding relationship between each signal source (or each interface) and each unidirectional control path in advance, so that, when the interface of the signal source a is sent to the video processing and computing device 4403 through the illustrated path and is fused with other interfaces at the video processing and computing device 4403 to form an interface shown in fig. 1c, if a user clicks a play button on a window where a is located, the video processing and computing device 4403 unidirectionally transmits an interface ID (the interface ID may include information of the signal source from which the interface is derived) and a window position to the instruction distribution device 4404 when determining that an acting object is an interface from the signal source a (for example, by analyzing a distribution layout of a mouse acting position and output interfaces of each interface capture box), and the instruction distribution device 4404 sends an instruction to the corresponding signal source a through the illustrated path according to the corresponding relationship between each signal source and each unidirectional control path. The signal source a responds according to the instruction, and outputs a response result to the video processing and computing device 4403 through a unidirectional video line.

According to some embodiments of the present invention, relevant interface information, user identity information for implementing the operation, and the like may be stored at the video processing and computing device 4403, where the interface information includes an interface ID, information about a signal source from which the interface originates (for example, a signal source name, a video stream address, and the like, and a video stream of the signal source corresponding to the address may be obtained through the video stream address), a unidirectional control path corresponding to the interface, information about access rights of a user to the interface, and the like, and the storing may include pre-storing and real-time storage and update. The same information may be stored on the instruction distribution device or only a part thereof, such as an interface ID, user access right information for the interface, etc., may be stored as necessary. According to some embodiments of the present invention, information or part of information may be copied to the instruction distribution device 4404 through a removable medium (e.g., an optical disc) to achieve information synchronization, and the information may be copied periodically, or periodically according to actual needs, or when a new interface signal source appears. Accordingly, at this time, the video processing and computing device 4403 only needs to send a simple interface ID and a window position to the instruction distribution device 4404 instead of complex interface information, and the instruction distribution device 4404 may send the instruction sent by the instruction distribution device 4404 to a unidirectional control path corresponding to a signal source from which the interface originates according to the sent interface ID in combination with the interface ID information synchronized by itself in the aforementioned physical isolation manner, and send the instruction to the signal source by the unidirectional control path, or determine whether to send the instruction sent by the instruction distribution device 4404 to the signal source from which the interface originates in combination with consideration of the access right information of the user to the interface. In this way, the amount of data to be transmitted from the video processing and computing device 4403 to the instruction distribution device 4404 in a single direction can be further reduced, so that a narrow-band transmission medium can be adopted for data transmission, and a large amount of video data is prevented from being accidentally leaked to the instruction distribution device 4404 on the right. According to some embodiments of the present invention, one or more monitoring devices may be added to a unidirectional transmission path from the video processing and computing device to the instruction distribution device (or alternatively, to a unidirectional command transmission device that unidirectionally transmits the interface information and the window position of the target interface to the instruction distribution device) for monitoring the passing data in real time, so that only data with low transmission frequency, small data amount, or fixed data format (the expression herein also covers the case where only data with two or three of the attributes of low transmission frequency, small data amount, or fixed data format) can be passed, so as to avoid the channel being used for transmitting other information. Under the condition that the number of all the signal sources and the corresponding relationship between the signal sources and the unidirectional control paths are not changed, the related interface information and the user identity information for implementing the operation may be directly stored in advance on the video processing and computing device 4403 and the instruction distribution device 4404, and the synchronization operation may be omitted. According to some embodiments of the present invention, when the instruction input by the user includes user identity information, the video processing and computing device 4403 and the instruction distribution device 4404 may determine whether to perform further actions, such as whether to send an interface ID to the instruction distribution device 4404 by the video processing and computing device 4403, and whether to send an instruction to the instruction output box by the instruction distribution device 4404, according to the stored information about the access authority of the user to the interface (for example, some users do not have authority to operate some signal sources).

In addition, the contents described in the previous figures with respect to fig. 4a are also applicable here or are appropriately modified to be applicable here, and for the sake of simplicity, the details are not described here again.

In addition, as shown in fig. 2a, the system shown in fig. 4a may further include an interface display and control device; the video processing and computing equipment is also used for transmitting the first interface and/or the second interface to the interface display and control equipment in a one-way mode; the interface display and control equipment is used for transmitting the first interface and/or the second interface to the interaction terminal through the use network; the interface display control equipment is also used for receiving a third instruction input by the interactive terminal and unidirectionally transmitting the third instruction to the instruction one-to-two equipment; the instruction one-to-two equipment is used for receiving a third instruction and respectively transmitting the third instruction to the video processing and computing equipment and the instruction distribution equipment in a one-way mode; the video processing and computing equipment is used for determining a target interface acted by the third instruction and unidirectionally transmitting interface information and a window position of the target interface to the instruction distribution equipment; the instruction distribution equipment is used for converting the third instruction into a fourth instruction in the target window through coordinate conversion according to the window position, sending the fourth instruction to a target instruction output box corresponding to the target interface through an instruction network, and carrying out unidirectional control on a target signal source from which the target interface originates by the target instruction output box.

In addition, the content described above with reference to fig. 2a is also applicable here or adapted to this point as appropriate, and for the sake of simplicity, the description thereof is omitted here.

Fig. 4b shows a schematic block diagram of a multi-network signal source interactive system according to further embodiments of the present invention.

In fig. 4b, the video processing and computing device 4403 is further configured to transmit the first and/or second interface to the interface display and control device 4302 in a single direction (for example, in various manners mentioned in the foregoing embodiments of the present application, including using an interface acquisition box, a single-direction transmission line, etc.); the interface display and control device 4801 transmits the first and/or second interface to the interaction terminal 4300 "through the use of the network; the interface display control device 4801 receives a third instruction from the interactive terminal 4300 ″ and unidirectionally transmits the third instruction to the instruction one-to-two device 4405; the instruction-to-two device 4405 is configured to receive the third instruction, and transmit the third instruction to the video processing and computing device 4403 and the instruction distribution device 4404 in a single direction; the video processing and computing device 4403 determines a target interface to which the third instruction acts, and unidirectionally transmits target interface information and a target window position to the instruction distribution device 4404; the instruction distributing apparatus 4405 converts the third instruction into a fourth instruction in the target interface through coordinate conversion according to the position of the target window, and performs unidirectional control on the target signal source from which the target interface originates according to the fourth instruction.

According to some embodiments of the present invention, the multi-network signal source interactive system further comprises a unidirectional video line for unidirectional transmission of each interface.

According to some embodiments of the invention, the unidirectional video lines each include a respective display card.

According to some embodiments of the present invention, the multi-network signal source interactive system further comprises one or more of means for achieving the unidirectional control purpose, means for achieving the unidirectional transmission purpose, a first display device, and a control instruction generating device generating the first instruction.

According to some embodiments of the present invention, unidirectionally transmitting the interface information and the window position of the target interface to the instruction distribution apparatus includes transmitting the interface information and the window position of the target interface to the instruction distribution apparatus through a unidirectional serial port line, and the multi-network signal source interactive system includes the unidirectional serial port line.

According to some embodiments of the invention, the control instruction generating device comprises a transparent touch device spatially superimposed on the first display device.

According to some embodiments of the invention, the multi-network signal source interactive system further comprises an interactive server, and the interactive terminal sends the third instruction to the interface display and control device through the interactive server and the use network.

According to some embodiments of the invention, the interface display and control device temporarily stores the acquired interfaces and sends the interfaces to the interactive terminal at a future moment according to actual needs or network conditions; or the interface display and control equipment encodes the collected interface for a period of time into a video, encodes the video into a network stream and sends the network stream to each interactive terminal; or each interface display and control device also temporarily stores the acquired interface or the video to a server or a cloud, and sends the interface or the video to the interactive terminal at a future moment according to actual needs or network conditions.

According to some embodiments of the present invention, the video processing and computing device renders the interfaces within windows, the windows being distributed according to a second layout.

According to some embodiments of the invention, the video processing and computing device merges the interfaces and the ui interface in a third layout for output.

According to some embodiments of the present invention, the video processing and computing device determines a target interface or ui interface to which the first instruction acts according to the third layout; if the first instruction is determined to be an instruction for controlling the ui interface, the video processing and computing equipment directly controls the ui interface to respond according to the first instruction; if the first instruction is determined to be an instruction for controlling the target interface, the video processing and computing device transmits interface information and window positions of the target interface to the instruction distribution device in a one-way mode.

According to some embodiments of the invention, the first network and the second network are isolated.

According to some embodiments of the invention, the video processing and computing device and the instruction distribution device pre-store interface information; or the video processing and computing equipment stores interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment in a non-contact synchronous mode; the interface information includes an interface ID.

According to some embodiments of the invention, the video processing and computing device and the instruction distribution device pre-store interface information and user identity information implementing said input; or the video processing and computing equipment stores the interface information and the user identity information for implementing the input, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment and the user identity information for implementing the input in a non-contact synchronous mode; the interface information includes an interface ID.

According to some embodiments of the present invention, the interface information further includes one or more of signal source information from which the interface originates, a one-way control path corresponding to the interface, and access right information of a user to the interface.

According to some embodiments of the invention, for a first instruction in the form of a shortcut key input, the video processing and computing device determines a target interface or ui interface to which the first instruction acts according to a preset correspondence; if the first instruction is determined to be an instruction for controlling the ui interface, the video processing and computing device directly controls the ui interface to respond according to the first instruction; if the first instruction is determined to be an instruction for controlling the target interface, the video processing and computing device transmits interface information and window positions of the target interface to the instruction distribution device in a one-way mode.

According to some embodiments of the invention, when the video processing and computing device causes the target interface corresponding to each instruction to be displayed in a full screen mode in the first display device, the video processing and computing device transmits only the interface information of the target interface and the interface information of the target interface in the window position to the instruction distribution device in a single direction.

The various details described previously with respect to the previous figures of fig. 4a may be applied to the embodiment of fig. 4a and 4b, or may be applied with suitable modifications, and for the sake of simplicity, are not described again here.

By the embodiment, interaction of each signal source in a plurality of networks can be realized, meanwhile, new network exposure risk cannot be introduced to each signal source in the interaction process, and the interaction end is further ensured not to be attacked maliciously by the interaction signal source. In addition, independent of the huge video processing and the device with the dotted line frame where the computing device is located, free, flexible and light-weight safe interaction can be achieved in a network mode.

Fig. 5a illustrates a flow diagram of a multi-network signal source interaction method of a multi-network signal source interaction system according to some embodiments of the invention.

The multi-network signal source interactive system comprises: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment; the first instruction output box and the second instruction output box are both connected to an instruction network; the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box are all connected to a video network; the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool; the first client is used for unidirectionally transmitting a first interface to the first interface acquisition box, and the first interface comprises interfaces of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for transmitting a second interface to the second interface acquisition box in a one-way mode, and the second interface comprises interfaces of one or more signal sources accessed and obtained by the second client from the second virtual machine pool; the first interface acquisition box is used for acquiring the first interface, encoding the first interface into a network stream signal and then providing the network stream signal for video processing and computing equipment to acquire through a video network; the second interface acquisition box is used for acquiring the second interface, encoding the second interface into a network stream signal and then acquiring the network stream signal by video processing and computing equipment through a video network; the video processing and computing device is used for acquiring the first interface and/or the second interface through the video network and outputting the first interface and/or the second interface to the first display device.

In response to a first instruction input by a user through the control instruction generating device, the multi-network signal source interactive system executes the following steps:

s1, instructing one-to-two equipment to receive an input first instruction, and respectively transmitting the first instruction to video processing and computing equipment and instruction distribution equipment in a one-way mode;

s2, the video processing and computing device determines a target interface acted by the first instruction, and transmits interface information and window positions of the target interface to the instruction distribution device in a one-way mode;

and S3, converting the first instruction into a second instruction in the target window through coordinate conversion according to the position of the target window by the instruction distribution equipment, and performing unidirectional control on a target signal source from which the target interface originates according to the second instruction.

Fig. 5b illustrates a flow diagram of a multi-network signal source interaction method of a multi-network signal source interaction system according to some embodiments of the invention.

The multi-network signal source interactive system comprises: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment; the first instruction output box and the second instruction output box are both connected to an instruction network; the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box are all connected to a video network; a first signal source in a first network unidirectionally transmits a first interface to a first interface acquisition box; a second signal source in a second network unidirectionally transmits a second interface to a second interface acquisition box; the first interface acquisition box is used for acquiring the first interface, encoding the first interface into a network stream signal and then acquiring the network stream signal by video processing and computing equipment through a video network; the second interface acquisition box is used for acquiring the second interface, encoding the second interface into a network stream signal and then providing the network stream signal for video processing and computing equipment to acquire through a video network; the video processing and computing device is used for acquiring the first interface and/or the second interface through the video network and outputting the first interface and/or the second interface to the first display device.

s21, instructing one-to-two equipment to receive an input first instruction, and respectively transmitting the first instruction to video processing and computing equipment and instruction distribution equipment in a one-way manner;

s22, the video processing and computing equipment determines a target interface acted by the first instruction, and transmits interface information and window positions of the target interface to the instruction distribution equipment in a one-way mode;

and S23, the instruction distribution equipment converts the first instruction into a second instruction in the target window through coordinate conversion according to the position of the target window, sends the second instruction to a target instruction output box corresponding to the target interface through an instruction network, and the target instruction output box performs unidirectional control on a target signal source from which the target interface originates.

Fig. 5c illustrates a flow diagram of a multi-network signal source interaction method of a multi-network signal source interaction system according to some embodiments of the invention.

The multi-network signal source interactive system comprises: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment; a first signal source in a first network unidirectionally transmits a first interface to video processing and computing equipment; a second signal source in a second network unidirectionally transmits a second interface to the video processing and computing device; the video processing and computing device is used for acquiring the first interface and the second interface and outputting the first interface and/or the second interface to the first display device.

s31, the instruction one-to-two device receives an input first instruction and transmits the first instruction to the video processing and computing device and the instruction distribution device in a one-way mode respectively;

s32, the video processing and computing device determines a target interface acted by the first instruction, and transmits interface information and window positions of the target interface to the instruction distribution device in a one-way mode;

and S33, the instruction distribution equipment converts the first instruction into a second instruction in the target window through coordinate conversion according to the position of the target window, sends the second instruction to a target instruction output box corresponding to the target interface through an instruction network, and controls the corresponding target client in a one-way mode through the target instruction output box so that the target client controls a target signal source from which the target interface originates.

In addition, reference may be made to the above description with reference to fig. 1a to 4b for further details regarding the above-described method embodiments, which are not described herein again.

While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention.

Claims

1. The multi-network signal source interactive system comprises: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment;

2. The multi-network signal source interactive system according to claim 1, further comprising an interface display and control device;

the video processing and computing equipment is also used for transmitting the first interface and/or the second interface to the interface display and control equipment in a one-way mode;

the interface display and control equipment transmits the first interface and/or the second interface to the interaction terminal through a use network;

the interface display control equipment receives a third instruction input by the interactive terminal and transmits the third instruction to the instruction one-to-two equipment in a one-way mode;

the instruction one-to-two equipment is used for receiving a third instruction and respectively transmitting the third instruction to the video processing and computing equipment and the instruction distribution equipment in a one-way manner;

the video processing and computing equipment is used for determining a target interface acted by the third instruction and unidirectionally transmitting interface information and a window position of the target interface to the instruction distribution equipment;

the instruction distribution equipment is used for converting the third instruction into a fourth instruction in the window through coordinate conversion according to the position of the window and carrying out unidirectional control on a target signal source from which the target interface originates according to the third instruction.

3. The multi-network signal source interactive system comprises: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment;

a first signal source in a first network transmits a first interface to a first interface acquisition box in a one-way mode; a second signal source in a second network unidirectionally transmits a second interface to a second interface acquisition box;

the first interface acquisition box is used for acquiring the first interface, encoding the first interface into a network stream signal and then providing the network stream signal for video processing and computing equipment to acquire through a video network; the second interface acquisition box is used for acquiring the second interface, encoding the second interface into a network stream signal and then acquiring the network stream signal by video processing and computing equipment through a video network;

4. The multi-network signal source interactive system according to claim 3, further comprising an interface display and control device;

the interface display and control equipment is used for transmitting the first interface and/or the second interface to the interaction terminal through the use network;

the interface display control equipment is also used for receiving a third instruction input by the interactive terminal and unidirectionally transmitting the third instruction to the instruction one-to-two equipment;

the instruction one-to-two equipment is used for receiving a third instruction and respectively transmitting the third instruction to the video processing and computing equipment and the instruction distribution equipment in a one-way mode;

the instruction distribution equipment is used for converting the third instruction into a fourth instruction in the window through coordinate conversion according to the position of the window, sending the fourth instruction to a target instruction output box corresponding to the target interface through an instruction network, and carrying out unidirectional control on a target signal source from which the target interface originates by the target instruction output box.

5. The multi-network signal source interactive system comprises: video processing and computing equipment, instruction distribution equipment and instruction one-to-two equipment;

the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool;

the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;

6. The multi-network signal source interactive system according to claim 5, further comprising an interface display and control device;

the instruction distribution equipment is used for converting the third instruction into a fourth instruction in the window through coordinate conversion according to the position of the window, sending the fourth instruction to a target instruction output box corresponding to the target interface through an instruction network, and performing one-way control on a corresponding target client by using the target instruction output box so as to enable the target client to control a target signal source from which the target interface originates.

7. The multi-network signal source interactive system according to one of claims 3 to 6, further comprising: the interface acquisition box comprises a first interface acquisition box and a first instruction output box, and/or a second interface acquisition box and a second instruction output box.

8. The multi-network signal source interactive system according to one of claims 1 to 6, further comprising a unidirectional video line for unidirectional transmission of each interface.

9. The multi-network signal source interactive system of claim 8, wherein the respective unidirectional video lines comprise respective corresponding video cards.

10. The multi-network signal source interactive system according to claim 5 or 6, further comprising respective clients.

11. The system of claim 10, further comprising a virtual machine pool corresponding to each client.

12. The multi-network signal source interactive system according to one of claims 1-6, further comprising one or more of means for achieving said unidirectional control purpose, means for achieving said unidirectional transmission purpose, a first display device and a control instruction generating device generating a first instruction.

13. The multi-network signal source interactive system according to one of claims 1 to 6, wherein the unidirectional transmission of the interface information and the window position of the target interface to the instruction distribution device comprises the unidirectional serial port line transmission of the interface information and the window position of the target interface to the instruction distribution device, and the multi-network signal source interactive system comprises the unidirectional serial port line.

14. The multi-network signal source interactive system according to one of claims 3 to 6, wherein said obtaining the first and/or second interface through the video network comprises obtaining the first and/or second interface through a video network cable and a video network switch; and/or the second instruction is sent to the target instruction output box corresponding to the target interface through the instruction network, including the second instruction is sent to the target instruction output box corresponding to the target interface through the instruction network cable and the instruction network switch.

15. The multi-network signal source interaction system of claim 12, wherein the control command generation device comprises a transparent touch device spatially superimposed on the first display device.

16. The multi-network signal source interaction system according to claim 2, 4 or 6, further comprising an interaction server, wherein the interaction terminal sends the third instruction to the interface display and control device through the interaction server and the use network.

17. The multi-network signal source interaction system of claim 2, 4 or 6, wherein the interface display and control device temporarily stores the collected interfaces and transmits the interfaces to the interaction terminal at a future time according to actual needs or network conditions; or the interface display and control equipment encodes the collected interface for a period of time into a video, encodes the video into a network stream and sends the network stream to each interactive terminal; or each interface display and control device also temporarily stores the acquired interface or the video to a server or a cloud, and sends the interface or the video to the interactive terminal at a future moment according to actual needs or network conditions.

18. The multi-network signal source interaction system of claim 5 or 6, wherein the first client plots interfaces of the one or more signal sources obtained from the first virtual machine pool access within windows, the windows being distributed according to a first layout.

19. The multi-network signal source interactive system as recited in any one of claims 1-6, wherein the video processing and computing device renders the interfaces within windows, the windows being distributed according to a second layout.

20. The multi-network signal source interactive system as claimed in one of claims 1 to 6, wherein the video processing and computing device outputs the interfaces and the ui interface after merging the interfaces and the ui interface according to a third layout.

21. The multi-network signal source interactive system of claim 19, the video processing and computing device determining a target interface or ui interface to which the first command acts based on the third layout; if the first instruction is determined to be an instruction for controlling the ui interface, the video processing and computing device directly controls the ui interface to respond according to the first instruction; if the first instruction is determined to be an instruction for controlling the target interface, the video processing and computing device transmits interface information and window positions of the target interface to the instruction distribution device in a one-way mode.

22. The multi-network signal source interaction system of claim 1 or 2, wherein the first network and the second network are isolated from each other.

23. The multi-network signal source interactive system according to claim 3 or 5, wherein the first network, the second network, the video network and the command network are network isolated from each other.

24. The multi-network signal source interactive system according to claim 4 or 6, wherein the first network, the second network, the video network, the instruction network and the usage network are network-isolated from each other.

25. The multi-network signal source interactive system according to claim 1 or 2, wherein the video processing and computing device and the instruction distribution device pre-store interface information; or the video processing and computing equipment stores interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment in a non-contact synchronous mode; the interface information includes an interface ID.

26. The multi-network signal source interactive system of claim 1, the video processing and computing device and the instruction distribution device pre-storing interface information and user identity information implementing said input; or the video processing and computing equipment stores the interface information and the user identity information for implementing the input, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment and the user identity information for implementing the input in a non-contact synchronous mode; the interface information includes an interface ID.

27. The system of claim 26, wherein the interface information further includes one or more of signal source information from which the interface originates, a one-way control path corresponding to the interface, and access right information of a user to the interface.

28. The multi-network signal source interactive system according to claim 3 or 4, the video processing and computing device and the instruction distribution device pre-storing interface information; or the video processing and computing equipment stores interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment in a non-contact synchronous mode; the interface information includes an interface ID.

29. The multi-network signal source interactive system as claimed in claim 3, the video processing and computing device and the instruction distribution device pre-storing interface information and user identity information for implementing said input; or the video processing and computing equipment stores the interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment and the input user identity information in a non-contact synchronous mode; the interface information includes an interface ID.

30. The multi-network signal source interactive system according to claim 29, wherein the interface information further includes one or more of signal source information from which the interface originates, an instruction output box corresponding to the interface, and access right information of a user to the interface.

31. The multi-network signal source interactive system according to claim 5 or 6, the video processing and computing device and the instruction distribution device pre-storing interface information; or the video processing and computing equipment stores interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment in a non-contact synchronous mode; the interface information includes an interface ID.

32. The multi-network signal source interactive system as claimed in claim 5, the video processing and computing device and the instruction distribution device pre-storing interface information and user identification information for implementing said input; or the video processing and computing equipment stores the interface information, and the instruction distribution equipment acquires the interface information in the video processing and computing equipment and the input user identity information in a non-contact synchronous mode; the interface information includes an interface ID.

33. The multi-network signal source interactive system according to claim 32, wherein the interface information further includes one or more of client information from which the interface originates, an instruction output box corresponding to the interface, and access right information of the user to the interface.

34. The multi-network signal source interactive system according to one of claims 3 to 6, further comprising an interface web server and an instruction web server; the interface network server, the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box establish network connection through a video network switch; the instruction network server, the instruction distribution equipment, the first instruction output box and the second instruction output box establish network connection through the instruction network switch;

the interface network server acquires the first and/or second interfaces acquired by the first and/or second interface acquisition boxes through the video network switch, and outputs the first and/or second interfaces to the video processing and computing equipment; or the video processing and computing device and the interface network server respectively acquire the first and/or second interfaces acquired by the first and/or second interface acquisition boxes through the video network switch.

35. The multi-network signal source interactive system according to claim 3 or 4, further comprising an interface web server and an instruction web server; the interface network server, the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box establish network connection through a video network switch; the instruction network server, the instruction distribution equipment, the first instruction output box and the second instruction output box establish network connection through the instruction network switch;

the interface network server and the instruction network server pre-store interface information; or the interface network server stores the interface information and instructs the network server to acquire the interface information of the interface network server in a non-contact synchronous mode; the interface information includes an interface ID.

36. The multi-network signal source interactive system according to claim 3, further comprising an interface web server and an instruction web server; the interface network server, the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box establish network connection through a video network switch; the instruction network server, the instruction distribution equipment, the first instruction output box and the second instruction output box establish network connection through the instruction network switch;

the interface web server and the instruction web server pre-store interface information and the user identity information for implementing the input; or the interface web server stores the interface information and the user identity information for implementing the input, and instructs the web server to acquire the interface information in the interface web server and the user identity information for implementing the input in a non-contact synchronous mode; the interface information includes an interface ID.

37. The multi-network signal source interactive system according to claim 36, wherein the interface information further includes one or more of signal source information from which the interface originates, an instruction output box corresponding to the interface, and access right information of a user to the interface.

38. The multi-network signal source interactive system according to claim 5 or 6, further comprising an interface web server and an instruction web server; the interface network server, the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box establish network connection through a video network switch; the instruction network server, the instruction distribution equipment, the first instruction output box and the second instruction output box establish network connection through the instruction network switch;

39. The multi-network signal source interactive system according to claim 5, further comprising an interface web server and an instruction web server; the interface network server, the video processing and computing equipment, the first interface acquisition box and the second interface acquisition box establish network connection through a video network switch; the instruction network server, the instruction distribution equipment, the first instruction output box and the second instruction output box establish network connection through the instruction network switch;

40. The system of claim 39, wherein the interface information further includes one or more of client information from which the interface originates, an instruction output box corresponding to the interface, and access right information of the user to the interface.

41. The multiple network signal source interactive system, video processing and computing device of claim 27, 30 or 33, wherein the video processing and computing device determines whether to output the first command to the command issuing device based on the user access right information, and/or wherein the command issuing device determines whether to output the second command to the command output box based on the user access right information.

42. The multi-network signal source interactive system of claim 37 or 40, wherein the interface web server controls whether the video processing and computing device outputs the first command to the command distributing device according to the user access right information; and/or the instruction network server determines whether to output the second instruction to the instruction output box according to the user access authority information.

43. The multi-network signal source interaction system according to one of claims 1 to 6, wherein for the first instruction in the form of a shortcut key input, the video processing and computing device determines a target interface or ui interface to which the first instruction acts according to a preset correspondence; if the first instruction is determined to be an instruction for controlling the ui interface, the video processing and computing equipment directly controls the ui interface to respond according to the first instruction; if the first instruction is determined to be an instruction for controlling the target interface, the video processing and computing device transmits interface information and window positions of the target interface to the instruction distribution device in a one-way mode.

44. The multi-network signal source interaction system according to one of claims 1 to 6, wherein when the video processing and computing device causes the target interface corresponding to each instruction to be displayed in a full screen in the first display device, the video processing and computing device transmits only the interface information of the target interface and the interface information of the target interface in the window position to the instruction distribution device in a single direction.

45. The multi-network signal source interaction system according to one of claims 1 to 6, wherein the interface ID is defined by one or more of client information from which the interface originates, an instruction output box corresponding to the interface, and access right information of a user to the interface.

46. The multi-network signal source interaction system of claim 25,28,31,35,38, wherein the first instruction comprises coordinate information and motion information, and/or the first instruction is generated by a shortcut key input; and/or; the first instruction includes user identity information.

47. The multi-network signal source interaction system according to one of claims 1 to 6, further comprising an instruction unidirectional transmission device for unidirectional transmission of interface information and window position of the target interface to the instruction distribution equipment, wherein the instruction unidirectional transmission device further comprises one or more monitoring devices for real-time monitoring of passing data, so that only data with low transmission frequency, small data amount or fixed data format can pass.

48. The multi-network signal source interactive system of claim 26 or 27, wherein the signal source information from which the interface originates comprises a signal source name and a video stream address.