CN115297362A - Signal source parallel interaction system based on network - Google Patents
Signal source parallel interaction system based on network Download PDFInfo
- Publication number
- CN115297362A CN115297362A CN202210926277.1A CN202210926277A CN115297362A CN 115297362 A CN115297362 A CN 115297362A CN 202210926277 A CN202210926277 A CN 202210926277A CN 115297362 A CN115297362 A CN 115297362A
- Authority
- CN
- China
- Prior art keywords
- interface
- display
- network
- signal source
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 71
- 230000004927 fusion Effects 0.000 claims abstract description 145
- 230000002452 interceptive effect Effects 0.000 claims abstract description 72
- 230000005540 biological transmission Effects 0.000 claims abstract description 65
- 230000004044 response Effects 0.000 claims description 80
- 239000013307 optical fiber Substances 0.000 claims description 20
- 238000002955 isolation Methods 0.000 claims description 9
- 230000009977 dual effect Effects 0.000 description 41
- 238000006243 chemical reaction Methods 0.000 description 9
- 230000009471 action Effects 0.000 description 8
- 238000000034 method Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 6
- 230000006698 induction Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- IRLPACMLTUPBCL-KQYNXXCUSA-N 5'-adenylyl sulfate Chemical compound C1=NC=2C(N)=NC=NC=2N1[C@@H]1O[C@H](COP(O)(=O)OS(O)(=O)=O)[C@@H](O)[C@H]1O IRLPACMLTUPBCL-KQYNXXCUSA-N 0.000 description 1
- 241000700605 Viruses Species 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1441—Countermeasures against malicious traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4627—Rights management associated to the content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/633—Control signals issued by server directed to the network components or client
- H04N21/6332—Control signals issued by server directed to the network components or client directed to client
- H04N21/6334—Control signals issued by server directed to the network components or client directed to client for authorisation, e.g. by transmitting a key
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45587—Isolation or security of virtual machine instances
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a signal source parallel interactive system based on a network, which comprises: the system comprises first and second interaction devices, first and second double-link devices, first and second interface acquisition boxes, and first and second instruction output boxes; the first dual-link equipment comprises a first ui interface, a signal source control device and a first fusion device; the second dual-link equipment comprises a second ui interface, a signal source control device and a second fusion device; the first and second ui interface and signal source control devices, the first and second instruction output boxes are connected to the instruction network; the first thin client establishes network connection with the first virtual machine pool through a first network; the second thin client establishes network connection with the second virtual machine pool through a second network; the first thin client outputs a first display interface to the first interface acquisition box through a first unidirectional transmission line; and the second thin client outputs a second display interface to the second interface acquisition box through a second unidirectional transmission line. The invention can realize the safe parallel interaction of a plurality of signal sources in the virtual machine pool.
Description
Technical Field
The invention relates to a signal source interaction technology, in particular to a network-based signal source parallel interaction system.
Background
In the prior art, when a plurality of interactive terminals access a plurality of objects through a network, in order to ensure the security of the objects, a specific interactive terminal can only access a specific object through a specific network, usually through a permission setting and/or a network setting, which results in low interaction efficiency.
Disclosure of Invention
In order to solve the above problem, a first aspect of the present application provides a network-based signal source parallel interaction system, where the system includes: the system comprises first and second interaction devices, first and second double-link devices, first and second interface acquisition boxes, and first and second instruction output boxes; the first dual-link equipment comprises a first ui interface, a signal source control device and a first fusion device; the second dual-link equipment comprises a second ui interface, a signal source control device and a second fusion device;
the first and second ui interface and signal source control devices, the first and second instruction output boxes are connected to the instruction network;
the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;
the first client is used for outputting a first display interface to the first interface acquisition box through a first one-way video line, wherein the first display interface comprises the display interface of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for outputting a second display interface to the second interface acquisition box through a second one-way video line, and the second display interface comprises the display interfaces of one or more signal sources accessed and obtained by the second client from the second virtual machine pool;
the first interface acquisition box is used for acquiring the first display interface, encoding the first display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network; the second interface acquisition box is used for acquiring the second display interface, encoding the second display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network;
the first fusion device is used for acquiring the first display interface and/or the second display interface through a video network and outputting the first display interface and/or the second display interface to first display equipment of the first interaction equipment; the second fusion device is used for acquiring the first display interface and/or the second display interface through the video network and outputting the first display interface and/or the second display interface to second display equipment of the second interaction equipment;
the first ui interface and signal source control device is used for receiving a first control instruction input by the first interaction equipment; the second ui interface and signal source control device is used for receiving a second control instruction input by the second interaction equipment; the first ui interface and signal source control device and the second ui interface and signal source control device can respectively send the first control instruction and the second control instruction to the first instruction output box and/or the second instruction output box corresponding to the target client through the instruction network, and the first instruction output box and/or the second instruction output box carry out unidirectional control on the corresponding target client.
In a second aspect, the present application provides a network-based signal source parallel interactive system, where the system includes: the system comprises a first interactive terminal, a second interactive terminal, a first interface display and control device, a second interface display and control device, a first double-link device, a second double-link device, a first interface acquisition box, a second interface acquisition box, a first instruction output box and a second instruction output box; the first dual-link equipment comprises a first ui interface, a signal source control device and a first fusion device; the second dual-link equipment comprises a second ui interface, a signal source control device and a second fusion device;
the first and second ui interface and signal source control devices, the first and second instruction output boxes are connected to the instruction network;
the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;
the first client is used for outputting a first display interface to the first interface acquisition box through a first one-way video line, wherein the first display interface comprises the display interfaces of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for outputting a second display interface to the second interface acquisition box through a second one-way video line, and the second display interface comprises the display interfaces of one or more signal sources accessed and obtained by the second client from the second virtual machine pool;
the first interface acquisition box is used for acquiring the first display interface, encoding the first display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network; the second interface acquisition box is used for acquiring the second display interface, encoding the second display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network;
the first fusion device is used for acquiring the first display interface and/or the second display interface through a video network, outputting the first display interface and/or the second display interface to the first interface display and control equipment through a third one-way video line, and continuously outputting the first display and control equipment to the first interaction terminal or the second interaction terminal through a use network; the second fusion device is used for acquiring the first display interface and/or the second display interface through the video network, outputting the first display interface and/or the second display interface to the second interface display and control equipment through a fourth one-way video line, and continuously outputting the first display interface and/or the second display interface to the first interaction terminal or the second interaction terminal through the use network by the second interface display and control equipment;
the first ui interface and signal source control device is used for receiving a first control instruction which is unidirectionally input from the first interface display and control equipment, wherein the first control instruction is a control instruction which is input to the first interface display and control equipment by the first interactive terminal or the second interactive terminal through a use network; the second ui interface and signal source control device of the second dual-link device is used for receiving a second control instruction which is input unidirectionally from the second interface display and control device, wherein the second control instruction is a control instruction which is input to the first interface display and control device by the first interactive terminal or the second interactive terminal through the network; the first ui interface, the second ui interface and the signal source control device can send the first control instruction and the second control instruction to the first instruction output box and/or the second instruction output box corresponding to the target client through the instruction network, and the first instruction output box and/or the second instruction output box carry out unidirectional control on the corresponding target client.
In a third aspect of the present application, a network-based signal source parallel interaction system is provided, where the system includes: the system comprises a first interactive terminal, a second interactive terminal, a first double-link device, a second double-link device, a first interface acquisition box, a second interface acquisition box, first to fourth interface display and control devices and first to fourth instruction output boxes; the first dual-link equipment comprises a first ui interface, a signal source control device and a first fusion device; the second dual-link equipment comprises a second ui interface, a signal source control device and a second fusion device;
the first and second ui interface and signal source control devices, the first and second instruction output boxes are connected to the instruction network;
the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;
the first client is used for outputting a first display interface to the first interface acquisition box through a first one-way video line, wherein the first display interface comprises the display interfaces of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for outputting a second display interface to the second interface acquisition box through a second one-way video line, and the second display interface comprises the display interfaces of one or more signal sources accessed and obtained by the second client from the second virtual machine pool;
the first interface acquisition box is used for acquiring the first display interface, encoding the first display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network; the second interface acquisition box is used for acquiring the second display interface, encoding the second display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network;
the first fusion device is used for acquiring the first display interface and/or the second display interface through a video network, outputting the first display interface and/or the second display interface to the first interface display and control equipment through a third one-way video line, and continuously outputting the first display and control equipment to the first interaction terminal or the second interaction terminal through a use network; the second fusion device of the second dual-link device acquires the first and/or second display interface through the video network, outputs the first and/or second display interface to the second interface display and control device through the fourth unidirectional video line, and the second interface display and control device continuously outputs the first and/or second display and control interface to the first or second interactive terminal through the use network;
the first ui interface and signal source control device receives a first control instruction which is unidirectionally input from third interface display and control equipment, wherein the first control instruction is a control instruction which is input to the third interface display and control equipment by the first interactive terminal or the second interactive terminal through a use network; the second ui interface and signal source control device receives a second control instruction which is input unidirectionally from the fourth interface display control equipment, wherein the second control instruction is a control instruction which is input to the fourth interface display control equipment by the first interactive terminal or the second interactive terminal through the use network; the first ui interface and signal source control device and the second ui interface and signal source control device can respectively send the first control instruction and the second control instruction to the first instruction output box and/or the second instruction output box corresponding to the target client through the instruction network, and the first instruction output box and/or the second instruction output box carry out unidirectional control on the corresponding target client.
Through the embodiment, the safe parallel interaction of each signal source in the virtual machine pools in the multiple networks can be realized through the two interactive devices, meanwhile, no new network exposure risk is introduced into the virtual machine pools in the interaction process, the additional network exposure risk of signal source data (such as folder data) in the virtual machine pools is not increased, and meanwhile, the malicious attack of an interactive object (the virtual machine pool end) on the interactive device end and the double-link device is also ensured.
Drawings
FIG. 1a illustrates a network-based signal source parallel interaction system according to some embodiments of the present invention;
FIG. 1b illustrates a plurality of signal sources depicted on a thin client;
FIG. 1c schematically illustrates an interface formed by the fusion of two link devices;
FIG. 2a illustrates the dual link apparatus of FIG. 1a and its connection to surrounding components according to some embodiments of the invention;
FIG. 2b illustrates a ui interface and signal source control device according to some embodiments of the invention;
FIG. 2c illustrates a fusion device according to some embodiments of the inventions;
FIG. 3a illustrates the dual link apparatus of FIG. 1a and its connection to surrounding components according to further embodiments of the present invention;
FIG. 3b illustrates a ui interface and signal source control device according to further embodiments of the present invention;
FIG. 3c illustrates a fusion device according to further embodiments of the present invention;
FIG. 4 illustrates a partial view of an interactive system according to further embodiments of the present invention;
FIG. 5a illustrates an alternative implementation of FIG. 4 according to some embodiments of the invention;
fig. 5b illustrates the implementation of fig. 5a, according to some embodiments of the invention.
Detailed Description
In the present application, the nature of the description related to the implementation through the network is intended to cover both the wired or wireless network connection implemented through the necessary firmware or software of the switch, the router, etc., and the wired or wireless network connection implemented through the intermediary of some servers or other computers, etc., and the description of the router/switch is sometimes omitted when describing the network connection for the sake of simplifying the description and highlighting the invention point. In the present application, the networks involved may include Wi-fi networks, bluetooth networks, private Area Networks (PAN), local Area Networks (LAN), wide Area Networks (WAN), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), general Packet Radio Service (GPRS), cdmaOne, CDMA1600, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), universal Mobile Telecommunications System (UMTS), digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), integrated digital enhanced network (iDEN), wiMAX, LTE advanced, mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, such as a VPN.
In the present application, the unidirectional transmission line may include various devices for achieving unidirectional transmission or unidirectional control, and the device for achieving unidirectional transmission or unidirectional control may be a unidirectional control device, or a unidirectional transmission device such as a unidirectional transmission cable, or an integral body composed of a control device and a transmission cable, etc., when achieving the unidirectional transmission or unidirectional control as a whole, the present application does not limit that each control device or connection cable in the integral body must be operated unidirectionally, for example, some connection cables between devices or devices may have bidirectional or multidirectional paths, but may still achieve unidirectional transmission or unidirectional control as a whole, and for example, the unidirectional transmission line may involve a network connection (member), but when the network connection member is combined with other devices, the combined integral body may still achieve the unidirectional purpose, as will be described below, and such cases are also contemplated within the scope and claimed scope of the present invention.
In the technical field of the invention, the ui data is data describing information of each component and the position of each component of a ui interface, such as interactive labels for storing, plotting, deleting, recording screen, canceling, clearing and the like, and the position of a pointer. The control instruction for controlling the virtual ui interface may include, for example, clicking a pull-down menu, moving, enlarging or reducing the position of the display window, and the like, that is, the virtual ui interface may change under the control of the control instruction, for example, the display window moves, enlarges or reduces, and the change result is the response result of the virtual ui interface, and in the present application, the ui data corresponding to the changed virtual ui interface is represented by the ui data corresponding to the response result of the virtual ui interface.
In the present application, the use of the connection lines such as the optical fiber and the serial port is related to, in order to match these connection lines, a conversion module may need to be used in a supporting manner, for example, when a signal is converted from a network to the optical fiber, a network light conversion module is needed, but in the case that the computer network port itself is an optical port, an additional network light conversion module may be omitted, since whether such a module is necessary or not may be determined according to an actual application scenario and is well known to those skilled in the art, for the sake of simplicity, the description is not given one by one, but the omission of the necessary conversion module is not indicated. In the drawings of the present application, the fusion device, the ui interface, the signal source control device, and the interaction device are independent from each other, and according to some embodiments of the present invention, these devices may exist as part of a computing processing device such as a computer or a tablet computer.
In the present application, the interface acquisition box acquires an interface, and the interface (or a display interface or an interface image) refers to a signal output externally through a display card in the present application or a signal representing the current interface realized through other devices under the condition that the display card is not present, and the interface is not a bottom layer original data file.
The invention will now be described, by way of example, with reference to the accompanying drawings, in connection with which it is to be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
In this application, the double-link apparatus is a term conveniently introduced by the applicant for the description, the specific function of which is as indicated in its context.
Fig. 1a illustrates a schematic block diagram of a network-based signal source parallel interaction system according to some embodiments.
The interactive system shown in fig. 1a comprises two interactive apparatus 1300 and 1300 ', two (or more) dual link apparatus 1500 and 1500', two interface acquisition cartridges (illustrating interface acquisition cartridges 1, N) and two command output cartridges (illustrating command output cartridges 1 ', N'). Still further, the system may further include a unidirectional transmission line for realizing unidirectional video transmission, which is also referred to as a unidirectional video line in this application.
The illustrated interaction device 1300 includes a control instruction generation device 1301 and a corresponding display device 1302. The illustrated interaction device 1300 ' includes a control instruction generation device 1301 ' and a corresponding display device 1302 '.
The two illustrated dual link devices 1500, 1500' and the interface capture boxes 1, n establish network connections via the illustrated video network cable and the video network switch 1400.
Two dual-link devices 1500, 1500 'are shown and a command output box 1', N 'establishes a network connection through a command network line and a command network switch 1400' as shown. In the present application, only for the convenience of clearly distinguishing and establishing the corresponding relationship, a video network cable (corresponding to a video transmission part) and an instruction network cable (corresponding to a transmission instruction part) are introduced when describing the network cable, and a video network switch (corresponding to a video transmission part) and an instruction network switch (corresponding to a video transmission part) are introduced when describing the switches.
Each unidirectional transmission line for realizing unidirectional video transmission illustrated includes a cable for realizing unidirectional video transmission, or when unidirectional transmission is realized by an accessory included on the cable, the unidirectional transmission line includes the cable and the accessory; each unidirectional transmission line implementing unidirectional control illustrated includes a cable implementing unidirectional control or, when unidirectional transmission is implemented by an accessory included on the cable, the unidirectional transmission line includes a cable and an accessory.
According to some embodiments of the invention, the interactive system may further include illustrated thin clients (or clients) 1 and F, and including illustrated thin clients 1 'and F'. Thin clients 1 and F and the illustrated virtual machine pool (or virtual machine) network connection within the network 1; thin clients 1 'and F' are connected to a virtual machine pool network G within the illustrated network G; the networks 1 and G may be isolated from each other, and the isolation may include a situation where the networks cannot access each other, or may include a partition implemented by network measures. The thin client is provided with a program which can interact with a virtual signal source (a signal source for short, such as a virtual computer and a virtual server) in a virtual machine pool, and comprises the steps of obtaining the content of each signal source in each virtual machine pool through network access and displaying the content of a plurality of signal sources in one virtual machine pool on the same thin client interface.
According to some embodiments of the invention, the interactive system may further comprise illustrated virtual machine pools.
An exemplary interaction process for the system is described below in conjunction with FIG. 1a. As shown in fig. 1a, the thin client 1 is connected to a virtual machine pool (server) 1 in the network 1 through a network cable, so that the thin client 1 can draw the content of each signal source in each window by accessing the content of a plurality of signal sources in the virtual machine pool through the network, and as shown in fig. 1b, four windows in the interface of the thin client 1 can respectively draw one corresponding signal source a, b, c, d.
The thin client 1 outputs the current interface of the thin client 1 to the interface collecting box 1 through a unidirectional video line instead of the bottom layer data (such as folder data), for example, the current interface can be output to the outside through a display card on the device where the thin client 1 is located, and the interface content is output to the interface collecting box 1 through the unidirectional video line.
The thin client F ' outputs the current interface of the thin client F ' to the interface collecting box N through the unidirectional video line instead of the underlying data (e.g., folder data), for example, the current interface may be externally output through a display card on the device where the thin client F ' is located, and the content of the interface is output to the interface collecting box N through the unidirectional video line.
The dual-link device 1500 may acquire the interfaces acquired in the interface acquisition boxes 1 and N through the video network switch 1400 and the illustrated video network lines, for example, the interface acquisition box 1 may acquire the interface output by the thin client 1, encode the interface into a network stream signal, and then provide the dual-link device 1500 with the network to acquire the interface, and the interface acquisition box N may acquire the interface output by the thin client F', encode the interface into a network stream signal, and provide the dual-link device 1500 with the network to acquire the interface. Therefore, the dual link apparatus 1500 can acquire the interfaces output on the thin clients 1 and F' in the different networks 1 and G, that is, can acquire the interfaces (display interfaces or interface images) of one or more signal sources in the virtual machine pools 1 and G.
Similarly, the dual link device 1500 'may acquire the interfaces acquired by the interface acquisition boxes 1 and N through the video network switch 1400 and the illustrated video network cable, for example, the interface acquisition box 1 may acquire the interface output by the thin client 1, encode the interface into a network stream signal, and then acquire the network stream signal by the dual link device 1500', and the interface acquisition box N may acquire the interface output by the thin client F ', encode the interface into a network stream signal, and then acquire the network stream signal by the dual link device 1500'. Thus, the dual link apparatus 1500 'can acquire the interfaces output on the thin clients 1 and F' in the different networks 1 and G, that is, the interfaces (interface screenshots or interface images) of one or more signal sources in the virtual machine pool.
After acquiring the interface acquired in the interface acquisition box 1 and/or N, the dual-link device 1500 outputs the interface to the display device 1302 in the interaction device 1300 through the HDMI cable or other video cable. After acquiring the interface collected in the interface collection box 1 and/or N, the dual-link device 1500 ' outputs the interface to the display device 1302 ' in the interactive device 1300 ' through the HDMI cable or other video cable.
The user can view the screen of the display device 1302 and/or 1302 'and perform a corresponding input operation on the control instruction generation device 1301 and/or 1301', which will be described below by taking as an example that the control instruction generation device 1301 inputs a control instruction to the dual link device 1500. The control instruction generating device 1301 may be a touch screen that captures operations in various manners such as electric induction, magnetic induction, thermal induction, force induction, light induction, and sound induction, or a control instruction generating device that controls other actions such as a keyboard and a mouse. According to some embodiments of the present invention, the control instruction generating device 1301 may be a transparent touch device, which may be spatially superimposed on the display device 1302, the display device 1302 provides a picture of a control object, and by referring to the picture of the display device 1302 below the transparent touch device, visual touch may be implemented on the control instruction generating device. The control instruction generation device 1301 and the display device 1302 may be integrated, for example, present as a touch display screen, or may both be integrated on the interaction device 1300.
The dual-link device 1500 receives a control instruction transmitted by a USB cable, and outputs the instruction to the instruction output box 1 'and/or N' through the instruction network switch 1400 'and the instruction network cable, the instruction output box 1' and/or N 'performs unidirectional control on the corresponding thin client 1 and/or F', for example, the instruction output box 1 'outputs the control instruction to the corresponding thin client 1 in a unidirectional manner through a unidirectional transmission line, the instruction output box N' outputs the control instruction to the corresponding thin client F 'in a unidirectional manner through a unidirectional transmission line, and the thin client 1 or F' receives the control instruction and responds according to the instruction, including controlling a signal source in a virtual machine pool to respond according to the instruction.
Similarly, if a user inputs a control command (the same applies below) to the dual link apparatus 1500 ' through the control command generating apparatus 1301 ', the dual link apparatus 1500 ' receives the control command and outputs the command to the command output box 1 ' and/or N ' through the command network switch 1400 ' and the command network line, and the command output box 1 ' and/or N ' performs unidirectional control on the corresponding thin client 1 or F '. The instruction output box can be used for receiving the control instruction, analyzing and converting the control instruction to form an HID standard device protocol, converting the instruction into a mouse click action for example, and outputting the mouse click action to the thin client.
According to some embodiments of the present invention, the interface acquisition boxes 1 and N may be integrated as one acquisition box with multiple acquisition ports; the command output box 1 'or N' may be integrated as one command output box having a plurality of command output ports, and converts a network command inputted through a command network line into a format suitable for outputting to a unidirectional transmission line (e.g., unidirectional serial line), for example, converts the network command into a serial command form, and outputs the command to the unidirectional serial line through one of the corresponding output ports connected to the thin client according to a thin client indicated in the command, and transmits the command to the thin client through the unidirectional serial line.
Through the embodiment, the safe parallel interaction of each signal source in the virtual machine pools in the multiple networks can be realized through the two interactive devices, meanwhile, no new network exposure risk is introduced into the virtual machine pools in the interaction process, the additional network exposure risk of signal source data (such as folder data) in the virtual machine pools is not increased, and meanwhile, the malicious attack of an interactive object (the virtual machine pool end) on the interactive device end and the double-link device is also ensured. In addition, through the embodiment, the control instruction is converted into the HID standard device protocol through the instruction output box, for example, the instruction is converted into the mouse click action and output to the thin client, so that other control instruction identification software can be prevented from being installed on the thin client, and the virus risk possibly introduced by the installation action is also avoided.
The thin clients F and 1 'may be connected to other components in a similar manner to the thin clients 1 and F', which are not shown for simplicity.
Fig. 2a illustrates the dual link apparatus of fig. 1a and its connection relationship with surrounding components according to some embodiments of the present invention, wherein various components below the video net switch 1400 and the instruction net switch 1400' of fig. 1a are omitted for simplicity and clarity.
The dual-link apparatus 1500 and its response procedure will be described below.
The dual link apparatus 1500 includes: a ui interface and signal source control device 102; a first unidirectional transmission line 1501; a fusion device 108.
The ui interface and signal source control device 102 is configured to receive and analyze the control instruction sent by the control instruction generation device 1301, and determine a control instruction for controlling the virtual ui interface and a control instruction for controlling a signal source, which correspond to the control instruction; controlling the virtual ui interface to respond according to the control instruction for controlling the virtual ui interface, and outputting ui data corresponding to the virtual ui interface response result to the fusion device 108 through the first unidirectional transmission line 1501; the ui interface and signal source control device 102 further performs unidirectional control (for example, by using the command network cable, the command network switch 1400 ', the command output box 1 ', the thin client 1, and various connection lines therebetween as shown in fig. 1a, or by using the command output box 1 ', or by using various combinations thereof, which will be described in detail later) according to the control command (assuming that the signal source a is to be controlled) for controlling a signal source (for example, one of the signal sources in the virtual machine pool), and allows the signal source a to output the response result to the interface collection box 1 through the network cable, the thin client 1, and the unidirectional video cable, and the interface collection box 1 outputs the response result to the fusion device 108 through the video network switch 1400 and the video network cable, as shown in fig. 1a and 2 a. The ui interface and signal source control device may pre-store the corresponding relationship between each thin client and each instruction output box, so that when the interface of the thin client 1 shown in fig. 1b is sent to the dual-link device 1500 and the interface shown in fig. 1c is formed after the fusion at the dual-link device 1500, if a user clicks a play button on a window where a is located, the dual-link device 1500 sends a control instruction to the instruction output box 1 'corresponding to the thin client 1 corresponding to the interface acquisition box 1 when determining that an acting object is a signal source on the interface acquisition box 1 corresponding to the thin client 1 (for example, by analyzing the acting position of the mouse and the distribution layout of the output interfaces of each interface acquisition box), the instruction output box 1' further sends the control instruction to the thin client 1, and the thin client 1 sends the control instruction to the signal source a corresponding to the position according to the position of the mouse in the initial output interface.
The fusion device 108 is configured to parse the ui data, merge the parsing result and the signal source response result (the signal source response result includes a single signal source response result or is the entire thin client interface including the single signal source response result and other non-responsive signal source interfaces, and the signal source response result may be output to the fusion device through the link from the virtual machine pool to the dual link device shown in fig. 1a, as described above), and output the merged result to the display device 1302. The fusion is, for example, drawing the signal source content to a corresponding position according to the position and size for signal source display in the analysis result, and drawing the ui icon button and the like to the corresponding position.
According to some embodiments of the present invention, the ui interface and signal source control device 102 may store and set a virtual ui interface as a virtual ui interface to be operated (i.e., a virtual ui interface to be used), and in response to the control instruction (for example, once a control instruction is detected to be input or the control instruction corresponds to a ui interface to be called), output ui data corresponding to the virtual ui interface to be operated to the fusion device through the first unidirectional transmission line 1501, analyze the ui data corresponding to the virtual ui interface to be operated by the fusion device, and output the analysis result to the display device 1302.
According to some embodiments of the invention, the content of the virtual ui interface may include interactive labels such as save, plot, delete, screen-recording, undo, clear, etc., a box line distribution, a mouse pattern, and the like. Each different virtual ui interface may have a different label, outline distribution, etc. The plotting means drawing lines, adding geometric structure diagrams, flow charts, and performing actions such as labeling, adding characters, coloring, and the like.
According to some embodiments of the present invention, the control instruction for controlling the virtual ui interface may include, for example, clicking a pull-down menu, moving, enlarging, or reducing the position of a display window of the signal source, and the like.
According to some embodiments of the invention, the control instruction for controlling the signal source may include, for example, clicking and changing video content of the signal source, and the like.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface to be operated and the ui data corresponding to the virtual ui interface response result include pointer position data, that is, data corresponding to the distribution positions of the pointers on the virtual ui interface. Since the ui data may contain pointer position data, the display contents displayed on the display device 1302 also include a pointer in real time, thereby enabling efficient control of the interface.
According to some embodiments of the present invention, the ui interface and signal source control device 102 may further store the virtual ui interface response result for updating the virtual ui interface stored in advance as the virtual ui interface to be called next time.
According to some embodiments of the present invention, the ui interface and signal source control device 102 may be further configured to transmit only the ui data related to the changed portion of the virtual ui interface when transmitting the ui data corresponding to the virtual ui interface response result to the fusion device through the first unidirectional transmission line 1501, whereby the transmission amount can be saved.
According to some embodiments of the invention, outputting the ui data corresponding to the virtual ui interface response result to the fusion device 108 via the first unidirectional transmission line 1501 includes transmitting the ui data corresponding to the virtual ui interface response result to the fusion device by:
and transmitting the ui data corresponding to the virtual ui interface response result to the fusion device through a unidirectional optical fiber serving as a first unidirectional transmission line 1501.
And the first unidirectional transmission line comprises a unidirectional optical fiber. Other means for achieving unidirectional transmission are also within the contemplation of the invention.
According to some embodiments of the invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the fusion device by:
and transmitting the ui data corresponding to the virtual ui interface response result to the fusion device sequentially through a first network (such as an exchanger and the like), the network light conversion equipment and the unidirectional optical fiber. The fusion device decodes and analyzes the network flow signal from the optical fiber signal.
According to some embodiments of the invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the fusion device by:
transmitting the ui data corresponding to the virtual ui interface response result to the fusion device sequentially through the first network, the first unidirectional transmission device and the second network of one of c) to d) below:
c) A unidirectional optical fiber;
d) The combination of network optical switching equipment, unidirectional optical fiber and optical switching network equipment.
According to some embodiments of the invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the fusion device by:
and transmitting the ui data corresponding to the virtual ui interface response result to the fusion device sequentially through the first unidirectional transmission device and the second network which are one of the following e) -f):
e) A unidirectional optical fiber;
f) And (3) a combination of unidirectional optical fibers and optical network switching equipment.
In the present application, the first network and the second network are only concepts used for describing the two networks distinctively, and have no other specific meaning.
According to some embodiments of the present invention, the one-way controlling of the signal source in the virtual machine pool comprises responding through a second one-way transmission device of one of an instruction net wire and an instruction net switch (both referred to as a first network) and e) -h) below, the thin client, the net wire, the one-way controlling of the signal source in the virtual machine pool:
e) A combination of a net-to-string device (the instruction output box may be the net-to-string device) and a unidirectional serial port line;
f) The combination of the network light conversion equipment and the unidirectional optical fiber;
g) The combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;
h) The combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment and unidirectional serial port lines;
according to some embodiments of the present invention, unidirectionally controlling a signal source in the virtual machine pool comprises unidirectionally controlling a signal source in the virtual machine pool by the instruction net wire and the instruction net switch, the unidirectional control device, the thin client, and the net wire. The one-way control equipment is connected with the instruction network switch and the thin client, acquires an instruction from the instruction network switch and controls the thin client in a one-way mode.
The convergence device 108 ', the ui interface and signal source control device 102', and the unidirectional transmission line 1501 'of the dual link apparatus 1500' are similar to the corresponding parts of the dual link apparatus 1500 and will not be described in detail herein.
Further, as shown in fig. 1a, the fusion devices 108 and 108 ' in the two-link apparatuses 1500 and 1500 ' are connected to the video net exchange 1400 through video net lines, and the ui interface and signal source control devices 102 and 102 ' in the two-link apparatuses 1500 and 1500 ' are connected to the command net exchange 1400 ' through command net lines. In other words, the video signal obtained by the fusion device 108 in the dual link apparatus 1500 via the video network switch 1400 may also be obtained by the fusion device 108 'in the dual link apparatus 1500', and the ui interface and the signal source control device 102 in the dual link apparatus 1500 are sent to the command network switch 1400 'and then used for controlling the command of the corresponding signal source, or sent to the command network switch 1400' by the ui interface and the signal source control device 102 'in the dual link apparatus 1500'. Therefore, the two link devices 1500 and 1500' can view the signal sources which can be viewed by each other and operate the signal sources which can be operated by each other, and can still realize network security interaction of a plurality of accessed signal sources in the virtual machine pool in the network access process, and can not cause additional network exposure risk of the signal sources.
According to some embodiments of the present invention, the video network switch is isolated from a network in which the command network switch is located; the video network switch and the instruction network switch are both isolated from the network where each thin client is located, and the networks where the thin clients are located can also be isolated from each other.
The illustrated dashed box 101 may also be directed to multiple computers (instead of a thin client and virtual machine pool therein), each of which may be located within a different network.
Fig. 2b illustrates the ui interface and signal source control device 102 according to some embodiments of the invention, and fig. 2c illustrates the fusion device 108 according to some embodiments of the invention.
The ui interface and signal source control apparatus 102 includes an instruction receiving unit 321, a ui interface and signal source response calculating unit 322, a ui data distributing unit 323, and a control data distributing unit 324. According to some other embodiments of the present invention, the various elements of the ui interface and signal source control device can also be combined with each other or subdivided in different ways to achieve the overall functionality of the ui interface and signal source control device 102 as well.
The instruction receiving unit 321 receives a control instruction and sends the signal to the ui interface and signal source response calculating unit 322.
The ui interface and signal source response calculating unit 322 analyzes the control instruction transmitted from the instruction receiving unit 321 to determine a virtual ui interface to be operated, a control instruction for controlling the virtual ui interface, and a control instruction for controlling the signal source, which correspond to the input. The ui interface and signal source response calculation unit sends the ui data corresponding to the virtual ui interface to be operated to the ui data distribution unit 323, the ui data distribution unit sends the ui data to the ui data analysis unit 382 through the first unidirectional transmission line, the ui data analysis unit 382 sends the analysis result to the video decoding and display unit 381, and the video decoding and display unit 381 receives the analysis result and outputs the analysis result (interface) to the display device 1302.
The ui interface and signal source response calculation unit 322 continues to analyze the control instruction sent by the instruction receiving unit 321, and determines a control instruction for controlling the virtual ui interface 325 and a control instruction for controlling the signal source; and controlling the virtual ui interface to respond according to the control instruction for controlling the virtual ui interface 325, sending the ui data (for example, information including an enlarged display window) corresponding to the responded virtual ui interface to the ui data distribution unit 123, and sending the responded ui data to the fusion device 108 by the ui data distribution unit through the first unidirectional transmission line. Meanwhile, the ui interface and signal source response calculating unit 322 further sends control data (or control command) for controlling the signal source 1001 to the control data distributing unit 324, and the control data distributing unit 324 finally sends the control command to the signal source a in the virtual machine pool according to the control command for controlling the signal source (e.g. one of the signal sources a in the virtual machine pool 1), for example, by illustrating the command network cable, the command network switch 1400 ', the command output box 1', the thin client 1, and the connection lines therebetween, so as to unidirectionally control the response of the signal source a in the virtual machine pool 1, and make the signal source a output the response result (display interface) to the interface collecting box 1 through the network cable, the thin client 1, and the unidirectional video cable, and the interface collecting box 1 outputs the response result to the fusion device 108 through the video network switch 1400 and the video network cable, as shown in fig. 1a and 2 a.
According to some embodiments of the present invention, the ui interface and signal source response calculation unit 322 may determine the control instruction for controlling the signal source in the control instruction or the control instruction for controlling the ui in the control instruction according to the position information in the control instruction and the distribution of the signal sources and the ui interface (or the controls therein) in the current interface (the dual link device output interface or the virtual interface). Or for shortcut key input, a control instruction for controlling the signal source or a control instruction for controlling ui in the control instruction can be directly determined according to the preset corresponding relation.
The fusion device 108 is configured to receive and analyze the ui data, and output a result of the analysis of the ui data and a signal source a response result (the signal source response result includes a single signal source response result or is the entire thin client interface including the single signal source response result and other non-responding signal source interfaces, and the signal source response result may be output to the fusion device through the link from the virtual machine pool to the dual link device shown in fig. 1a, as described above), and output a fusion result (interface) to the display device 1302. According to the illustrated embodiment, the fusion apparatus 108 may comprise a video decoding and display unit 381 and a ui data parsing unit 382. The ui data parsing unit 382 is configured to receive and parse the ui data sent from the ui data distribution unit 323, and send the parsing result to the video decoding and display unit 381. The video decoding and displaying unit 381 receives the foregoing parsing result on one hand and also receives the interface content of the signal source a on the other hand, and merges the received results and outputs the result (interface) to the display device 1302, and the content finally presented on the display device 1302 includes an interface after responding to the control instruction and the content of the signal source a after responding to the control instruction displayed in the interface.
Fig. 3a-3c show a schematic diagram of a dual link device 1500 "and 1500" "according to further embodiments of the invention, and their connections to other components, the remaining omitted parts being referred to in fig. 1a.
For simplicity, parts in the figures that are the same or similar to parts in figures 2a-2c are given the same or similar reference numerals.
The ui interface and signal source control device 102 ″ of fig. 3a may receive and analyze the control command, determine the control command for controlling the virtual ui interface and the control command for controlling the signal source (assuming that the controlled signal source is the signal source B in the virtual machine pool G), control the virtual ui interface to respond according to the control command for controlling the virtual ui interface, draw the ui interface according to the virtual ui interface response result, and output the drawn ui interface to the fusion device 108 ″ through the unidirectional transmission line 1507. The ui interface and signal source control device 102 ″ is further configured to output the initial signal source display window information and the mouse position information, and the subsequent signal source display window information (or display window information for short) and the mouse position information after responding to the control command, to the fusion device 108 ″ through the unidirectional transmission line 1508. The ui interface and signal source control device 102 ″ can determine the change of the ui interface and corresponding signal source display window information and mouse position information in real time through the virtual ui interface and the control instruction for controlling the virtual ui interface.
The fusion device 108 ″ is configured to receive the ui interface (i.e., the ui interface frame), receive the signal source display window information and the mouse position information, receive the signal source response result, perform fusion, and output the fusion result to the display device 1302, where the fusion includes displaying the signal source response result in the signal source display window on the ui interface and giving a mouse indication at a corresponding position according to the mouse position information. As one of the fusion methods, for example, there may be included: and outputting the ui interface, displaying a signal source response result in a signal source display window of the ui interface, and outputting a mouse pattern at a mouse position on the ui interface.
The ui interface and signal source control device 102 ″ further sends a control command for controlling the signal source B to the control data distribution unit 324 'according to the control command for controlling the signal source (the controlled signal source is the signal source B in the virtual machine pool), the control data distribution unit 324' finally sends the control command to the signal source B in the virtual machine pool according to the control command for controlling the signal source, for example, the signal source B in the virtual machine pool is unidirectionally controlled to respond by the illustrated command network cable, the command network switch 1400 ', the command output box N', the thin client F ', and the connection lines therebetween, the signal source B in the virtual machine pool is outputted by the signal source B to the interface collection box N through the network cable, the thin client F', and the unidirectional video cable, and the interface collection box N outputs the response result to the fusion device 108 through the video network switch 1400 and the video network cable.
The difference between fig. 3a and fig. 2a is that the ui interface and signal source control device 102 "in fig. 3a further draws a ui interface according to the virtual ui interface response result and outputs the drawn ui interface to the fusion device 108" through the unidirectional transmission line 1507, some ui data (such as signal source display window information and mouse position information, signal source display window information is abbreviated as display window information) is transmitted to the fusion device 108 "through the unidirectional transmission line 1508, and the fusion device 108" fuses the received parts accordingly, as described above. Other descriptions surrounding fig. 2a-2c, including various descriptions for unidirectional transmission lines, also apply to the embodiment of fig. 3a, e.g., descriptions for unidirectional transmission of ui data to the fusion device, unidirectional control of the signal source, unidirectional output of the signal source response results, etc. For the sake of simplicity, no further description is given.
Fig. 3b illustrates the ui interface and signal source control device 102", according to some embodiments of the invention; fig. 3c illustrates the fusion device 108 "according to some embodiments of the invention.
The ui interface and signal source control apparatus 102 ″ may include a command receiving unit 321 ', a ui interface drawing and event responding unit 322 ', a layout data distributing unit 323 ', a ui interface video output unit 320 ', and a control data processing and distributing unit 324 '.
The instruction receiving unit 321 'receives a control instruction signal and transmits the signal to the ui interface drawing and event responding unit 322'.
The ui interface drawing and event responding unit 322 ' receives and analyzes the control instruction transmitted from the instruction receiving unit 321 ', determines a control instruction for controlling the virtual ui interface and a control instruction for controlling the signal source, controls the virtual ui interface to respond and draw the ui interface according to the control instruction for controlling the virtual ui interface, and transmits the control instruction for controlling the signal source to the control data processing and distributing unit 324 '. According to some embodiments of the present invention, the ui interface and signal source response calculating unit 322' may determine the control command for controlling the signal source in the control command or the control command for controlling ui in the control command according to the position information in the control command and the distribution of the signal sources and the ui interface (or the controls therein) in the current interface (the dual link device output interface or the virtual interface). Or for shortcut key input, a control instruction for controlling the signal source or a control instruction for controlling ui in the control instruction can be directly determined according to the preset corresponding relation.
The ui interface drawing and event responding unit 322 'also sends the drawn ui interface to the ui interface video outputting unit 320', and is sent by it to the fusion device 108 ″ through a unidirectional transmission line, which outputs the ui interface to the display device 1302.
The ui interface drawing and event responding unit 322 'also determines the signal source display window information and the mouse position information in the ui interface, and sends the signal source display window information and the mouse position information to the layout data distributing unit 323', which sends the data to the fusion device 108 "through a unidirectional transmission line, so that the fusion device 108" outputs the video content of the relevant signal source to the signal source display window, and performs mouse pointing at the corresponding position. When the signal source display window is dragged and amplified by a user, the position of the signal source display window and the position of a mouse are changed, the ui interface drawing and event response unit 322 'sends the changed position of the signal source display window and the position information of the mouse to the layout data distribution unit 323' in real time, and the layout data distribution unit sends the data to the fusion device 108 'through the one-way transmission line, so that the fusion device 108' outputs the video content of the related signal source to the changed signal source display window and performs mouse indication at the corresponding new position.
According to some embodiments of the present invention, some functions of the ui interface drawing and event response unit 322 'may be distributed to the ui interface video output unit 320', the layout data distribution unit 323 'and the control data processing and distribution unit 324', and for example, information of the signal source display window may be determined by the layout data distribution unit according to a result of the ui drawing by the ui interface drawing and event response unit.
According to some embodiments of the invention, the fusion device 108 "may include: a ui interface video receiving unit 381 'for receiving the ui interface output by the ui interface video output unit 320'; a layout data receiving unit 382 'for receiving the signal source display window information and the mouse position information transmitted by the layout data distributing unit 323'; a video decoding unit 383' for receiving the signal source response result and decoding according to actual needs; the fusion unit 380' is configured to fuse the received ui interface, the received signal source display window information and mouse position information, and the received signal source-responded interface, so as to form a fusion interface, and transmit the fusion interface to the interface display and control device in a single direction, where the fusing includes: and outputting the drawn ui interface, displaying a signal source response result in a corresponding signal source display window according to the signal source display window information, and performing mouse indication in a final output picture according to the mouse position information. The fused result (interface) will be output to the display device 1302.
According to some other embodiments of the present invention, the various units of the fusion device may also be combined with each other or subdivided in different ways to achieve the overall functionality of the fusion device as well. According to some other embodiments of the present invention, the units may also be implemented by hardware implementing the corresponding functions.
In addition, various details of the signal source acquisition and control processes described previously with respect to fig. 2a-2c may be applied thereto, or may be suitably adapted to be applied thereto. For the sake of simplicity, no further description is provided herein.
According to further embodiments of the invention, it is possible to not introduce any ui-related technical details in the double link device part and to disregard the mouse position and display, in which case the transmission lines 1501,1507 and 1508 in fig. 2a and 3a can be eliminated and, correspondingly, the steps associated with these transmission line parts can be omitted in the above-described embodiments.
The convergence device 108"" in the dual link apparatus 1500"", the unidirectional transmission lines 1507' and 1508 ", and the ui interface and signal source control device 102" "are similar to the corresponding components in the dual link apparatus 1500" ", and therefore, will not be described again.
For clarity, only the thin clients 1 and F ' are shown in the drawings as connected to other components, and the thin clients F and 1 ' are similar to the thin clients 1 and F ', respectively. For example, the thin client F may be connected to an additional interface capture box that is in turn connected to the video network switch 1400. Similarly, the thin client F may be connected to an additional command output box that is connected to the command network switch 1400'. According to some embodiments of the present invention, the additional interface acquisition box may also be integrated with the acquisition box 1, or one acquisition box may be used to realize the acquisition of multiple input signals.
Fig. 4 shows a partial view of an interactive system according to further embodiments of the present invention, in which only the components and their connections of the parts above the double link devices 4500, 4500' are shown, and for the sake of simplicity, the components and connections of the parts below the double link devices are omitted, and reference may be made to what has been described above with reference to fig. 1a. Fig. 4 differs from fig. 1a in that:
the display interface of the dual link device 4500 (for example, the display interface is output by the display card after being collected by the display card therein) is output to the interface display and control device 1 through the unidirectional video line, and the dual link device 4500 receives unidirectional control from the interface display and control device 1. According to some embodiments of the present invention, the fusion device in the dual link device 4500 outputs the fused content to the interface display and control device 1 through the unidirectional transmission line, and the ui interface and signal source control device in the dual link device 4500 receives unidirectional control from the interface display and control device 1, and with respect to the fusion device and the ui interface and signal source control device, reference may be made to fig. 2b and 2c and fig. 3b and 3c.
Similarly, the display interface of the dual link device 4500' (e.g., the display card is collected by the display card therein and then output outwards) is output to the interface display and control device N through the unidirectional video line, and is subjected to unidirectional control from the interface display and control device N. According to some embodiments of the present invention, the fusion device in the dual link device 4500 'outputs the fused content to the interface display and control device N through the unidirectional transmission line, and the ui interface and signal source control device in the dual link device 4500' receives unidirectional control from the interface display and control device N, and with respect to the fusion device and the ui interface and signal source control device, reference may be made to fig. 2a to 3c. According to actual needs, the dual link device 4500' may be connected to the display device and the control instruction generating device directly as shown in fig. 2a and 3a without being connected to the network switch 1800.
The interface display and control devices 1 and N encode the acquired interfaces into network stream signals, and the interactive terminal 1300 ″ can acquire network stream information corresponding to each interface by using the network switch 1800 according to the interactive instruction of the control instruction generation device 1301 ″ so as to output the corresponding interface to the display device 1302 ″. For simplicity, in some descriptions of the present application, descriptions of video encoding and/or decoding processes involved in network transmission processes are omitted.
The user can input a control instruction by means of the control instruction generation device 1301 "with reference to the interface displayed by the display device 1302". The interactive terminal 1300 ″ receives the control instruction, and transmits the control instruction to the interface display and control device 1 or N through the network. The control command can be sent to the interface display and control device 1 or N by illustrating a network cable and using the network switch 1800, or sent to the interface display and control device 1 or N by an additional server and a network device. The interactive terminal 1300 ″ may also send the control instruction to the server, so that the server stores the relevant records, or performs unified management, or the interactive terminal sends a corresponding request to the server before sending the control instruction, and executes sending of the control instruction after being authorized by the server.
The interface display and control device 1 or N sends the control command to the dual link device 4500, 4500', and the dual link device continues to respond to the control command, including outputting the control command to the command output box, as described above, and will not be repeated here.
In addition to sending the interface to the interactive terminal in real time, according to some embodiments of the present invention, the interface display and control device may temporarily store the interface, and send the interface to the interactive terminal at a future time according to actual needs or network conditions, or encode a plurality of interfaces for a period of time into a video, and then encode the video into a network stream and send the network stream to the interactive terminal. According to some embodiments of the present invention, the interface display and control device may further temporarily store the interface or the video to a server or a cloud, and send the interface or the video to the interactive terminal at a future time according to actual needs or network conditions. The interface comprises the interface received by the interface display and control equipment from the double-link equipment.
And the interactive terminal acquires the response interface from the interface display and control equipment through the network and outputs the response interface to the display equipment. For example, the interactive terminal may obtain, through the graphic network device, a response result from the dual link device received by the interface display and control device, or obtain, through one server and the network device, a response result from the dual link device received by the interface display and control device.
According to some embodiments of the present invention, the aforementioned unidirectional transmission line for implementing unidirectional transmission may include a unidirectional optical fiber and/or a unidirectional serial port line. The above unidirectional transmission line may further include necessary protocol conversion modules, such as an optical-to-electrical module, an electrical-to-optical module, and the like.
According to some embodiments of the present invention, the interface display and control device may further have all functions of the interactive terminal 1300 ″, including being capable of collecting control instructions input by a user, or further having a corresponding control instruction generation device and a corresponding display device.
According to some embodiments of the invention, the interactive system may include a plurality of interactive terminals, each interactive terminal is connected through network communication, and content sharing may be performed between the interactive terminals through a network, where the content sharing includes sharing respective interface screenshots or sharing respective contents acquired from the respective interface display and control devices.
The interactive terminal 1300 ″ may also be a web page version of interactive terminal, as long as it has the function of sending the control instruction to other interface display and control devices, and the interactive terminal includes one of a personal computer, a handheld or laptop computer, a tablet computer, a cellular phone, a mobile device, an electronic device, a smart phone, and a smart television, or a combination thereof.
The above description of the dual link apparatus 4500 of fig. 4 applies equally to the dual link apparatus 4500' of fig. 4.
Through the embodiment, free, flexible and lightweight safe interaction can be realized in a network mode independently of huge double-link equipment.
Fig. 5a shows an alternative implementation of fig. 4 according to some embodiments of the present invention, but for simplicity, fig. 5a only shows an alternative implementation of the left half of fig. 4, where the fusion apparatus 1905 outputs a display interface to the interface display and control device 1907 in a single direction, and the interface display and control device 1907 converts the display interface into a network flow signal and uploads the network flow signal to the network switch 1800. According to some embodiments of the present invention, the interactive terminal 1300 ″ transmits the control command to the interface display and control device 1908 by using the network switch 1800, and the interface display and control device 1908 transmits the command to the ui interface and signal source control apparatus 1902, wherein the interface display and control devices 1907 and 1908 implement unidirectional transmission in the x direction and the y direction on their respective paths. The description of the double strand apparatus 1500, 1500 ', 1500 "and 1500" "applies equally to the double strand apparatus 4500, 4500', 5500.
Fig. 5b illustrates the implementation of fig. 5a, especially the implementation of the interface display and control device according to some embodiments of the present invention, as shown in the figure, the fusion device 1905 outputs a display interface to the interface isolation box 1904, a unidirectional optical fiber may be included in the interface isolation box 1904, so as to implement unidirectional transmission of the interface, and the display interface is then transmitted to the interface collection module 1903, which is converted into a network flow signal and uploaded to the network switch 1800. According to some embodiments of the present invention, the interactive terminal 1300 ″ transmits the control command to the trans-serial device 1900 by using the network switch 1800, and a unidirectional serial line and/or a unidirectional optical fiber may be included in the trans-serial device 1900 to implement unidirectional transmission of the command. According to some embodiments of the present invention, the web string device 1900 outputs the command to the command output box 1901, which includes a serial port and a USB port, and is configured to receive the control command in the form of the serial port input by the web string device 1900, analyze and convert the control command to form a control command under the HID standard device protocol, for example, convert the command into a mouse click action, and output the mouse click action to the ui interface and signal source control device 1902.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention.
Claims (23)
1. A network-based signal source parallel interaction system, the system comprising: the system comprises first and second interaction devices, first and second double-link devices, first and second interface acquisition boxes, and first and second instruction output boxes; the first dual-link equipment comprises a first ui interface, a signal source control device and a first fusion device; the second dual-link equipment comprises a second ui interface, a signal source control device and a second fusion device;
the first and second ui interface and signal source control devices, the first and second instruction output boxes are connected to the instruction network;
the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;
the first client is used for outputting a first display interface to the first interface acquisition box through a first one-way video line, wherein the first display interface comprises the display interfaces of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for outputting a second display interface to the second interface acquisition box through a second unidirectional video line, and the second display interface comprises the display interface of one or more signal sources accessed and obtained by the second client from the second virtual machine pool;
the first interface acquisition box is used for acquiring the first display interface, encoding the first display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network; the second interface acquisition box is used for acquiring the second display interface, encoding the second display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network;
the first fusion device is used for acquiring the first display interface and/or the second display interface through a video network and outputting the first display interface and/or the second display interface to first display equipment of the first interaction equipment; the second fusion device is used for acquiring the first display interface and/or the second display interface through the video network and outputting the first display interface and/or the second display interface to second display equipment of the second interaction equipment;
the first ui interface and signal source control device is used for receiving a first control instruction input by the first interaction equipment; the second ui interface and signal source control device is used for receiving a second control instruction input by second interaction equipment; the first ui interface and signal source control device and the second ui interface and signal source control device can respectively send the first control instruction and the second control instruction to the first instruction output box and/or the second instruction output box corresponding to the target client through the instruction network, and the first instruction output box and/or the second instruction output box carry out unidirectional control on the corresponding target client.
2. The network-based signal source parallel interaction system according to claim 1, wherein the first ui interface and signal source control device controls the virtual ui interface to respond according to a control instruction for controlling the virtual ui interface in the first control instruction, and unidirectionally transmits ui interface response data as a response result to the first fusion device; the first fusion device fuses the ui interface response data and the first display interface and/or the second display interface according to the ui interface response data, and transmits the interface formed by fusion to the first display equipment of the first interaction equipment in a single direction;
the second ui interface and signal source control device controls the virtual ui interface to respond according to a control instruction used for controlling the virtual ui interface in the second control instruction, and transmits ui interface response data serving as a response result to the second fusion device in a one-way mode; and the second fusion device fuses the ui interface response data and the first display interface and/or the second display interface according to the ui interface response data, and transmits the interface formed by fusion to the second display equipment of the second interaction equipment in a one-way mode.
3. The network-based signal source parallel interaction system of claim 1, wherein the first ui interface and signal source control device controls the virtual ui interface to respond according to a control instruction for controlling the virtual ui interface in the first control instruction, draws the ui interface according to a virtual ui interface response result, and unidirectionally transmits the drawn ui interface to the first fusion device; the first ui interface and signal source control device also determines display window information and mouse position information corresponding to the virtual ui interface response result, and unidirectionally transmits the display window information and the mouse position information to the first fusion device; the first fusion device performs fusion according to the ui interface, the display window information, the mouse position information and the first display interface and/or the second display interface, and transmits the interface formed by fusion to the first display equipment of the first interaction equipment in a one-way mode;
the second ui interface and signal source control device controls the virtual ui interface to respond according to a control instruction used for controlling the virtual ui interface in the second control instruction, draws the ui interface according to a virtual ui interface response result, and transmits the drawn ui interface to the second fusion device in a single direction; the second ui interface and signal source control device also determines signal source display window information and mouse position information corresponding to the virtual ui interface response result, and unidirectionally transmits the signal source display window information and the mouse position information to the second fusion device; and the second fusion device performs fusion according to the ui interface, the display window information, the mouse position information and the first display interface and/or the second display interface, and transmits the interface formed by fusion to the second display equipment of the second interaction equipment in a one-way mode.
4. A network-based signal source parallel interaction system, the system comprising: the system comprises a first interactive terminal, a second interactive terminal, a first interface display and control device, a second interface display and control device, a first double-link device, a second double-link device, a first interface acquisition box, a second interface acquisition box, a first instruction output box and a second instruction output box; the first dual-link equipment comprises a first ui interface, a signal source control device and a first fusion device; the second dual-link equipment comprises a second ui interface, a signal source control device and a second fusion device;
the first and second ui interface and signal source control devices, the first and second instruction output boxes are connected to the instruction network;
the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;
the first client is used for outputting a first display interface to the first interface acquisition box through a first one-way video line, wherein the first display interface comprises the display interfaces of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for outputting a second display interface to the second interface acquisition box through a second unidirectional video line, and the second display interface comprises the display interface of one or more signal sources accessed and obtained by the second client from the second virtual machine pool;
the first interface acquisition box is used for acquiring the first display interface, encoding the first display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network; the second interface acquisition box is used for acquiring the second display interface, encoding the second display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network;
the first fusion device is used for acquiring the first display interface and/or the second display interface through a video network, outputting the first display interface and/or the second display interface to the first interface display and control equipment through a third one-way video line, and continuously outputting the first display and control equipment to the first interaction terminal or the second interaction terminal through a use network; the second fusion device is used for acquiring the first display interface and/or the second display interface through the video network, outputting the first display interface and/or the second display interface to second interface display and control equipment through a fourth one-way video line, and continuously outputting the first display interface and/or the second display interface to the first interaction terminal or the second interaction terminal through the use network by the second interface display and control equipment;
the first ui interface and signal source control device is used for receiving a first control instruction which is unidirectionally input from the first interface display and control equipment, wherein the first control instruction is a control instruction which is input to the first interface display and control equipment by the first interactive terminal or the second interactive terminal through a use network; the second ui interface and signal source control device of the second dual-link device is used for receiving a second control instruction which is unidirectionally input from the second interface display and control device, wherein the second control instruction is a control instruction which is input to the first interface display and control device by the first or second interactive terminal through a network; the first ui interface, the second ui interface and the signal source control device can send the first control instruction and the second control instruction to the first instruction output box and/or the second instruction output box corresponding to the target client through the instruction network, and the first instruction output box and/or the second instruction output box carry out unidirectional control on the corresponding target client.
5. A network-based signal source parallel interaction system, the system comprising: the system comprises a first interactive terminal, a second interactive terminal, a first double-link device, a second double-link device, a first interface acquisition box, a second interface acquisition box, first to fourth interface display and control devices and first to fourth instruction output boxes; the first dual-link equipment comprises a first ui interface, a signal source control device and a first fusion device; the second dual-link equipment comprises a second ui interface, a signal source control device and a second fusion device;
the first and second ui interface and signal source control devices, the first and second instruction output boxes are connected to the instruction network;
the first client establishes network connection with the first virtual machine pool through a first network and can access one or more signal sources in the first virtual machine pool; the second client establishes network connection with the second virtual machine pool through a second network and can access one or more signal sources in the second virtual machine pool;
the first client is used for outputting a first display interface to the first interface acquisition box through a first one-way video line, wherein the first display interface comprises the display interfaces of one or more signal sources accessed and obtained by the first client from the first virtual machine pool; the second client is used for outputting a second display interface to the second interface acquisition box through a second one-way video line, and the second display interface comprises the display interfaces of one or more signal sources accessed and obtained by the second client from the second virtual machine pool;
the first interface acquisition box is used for acquiring the first display interface, encoding the first display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network; the second interface acquisition box is used for acquiring the second display interface, encoding the second display interface into a network stream signal and then acquiring the network stream signal by the first fusion device and the second fusion device through a video network;
the first fusion device is used for acquiring the first display interface and/or the second display interface through a video network, outputting the first display interface and/or the second display interface to the first interface display and control equipment through a third one-way video line, and continuously outputting the first display and control equipment to the first interaction terminal or the second interaction terminal through a use network; the second fusion device of the second dual-link device acquires the first and/or second display interface through the video network, outputs the first and/or second display interface to the second interface display and control device through the fourth unidirectional video line, and the second interface display and control device continuously outputs the first and/or second display and control interface to the first or second interactive terminal through the use network;
the first ui interface and signal source control device receives a first control instruction which is unidirectionally input from third interface display and control equipment, wherein the first control instruction is a control instruction which is input to the third interface display and control equipment by the first interactive terminal or the second interactive terminal through a use network; the second ui interface and signal source control device receives a second control instruction which is unidirectionally input from the fourth interface display and control equipment, wherein the second control instruction is a control instruction which is input to the fourth interface display and control equipment by the first interactive terminal or the second interactive terminal through a use network; the first ui interface and signal source control device and the second ui interface and signal source control device can respectively send the first control instruction and the second control instruction to the first instruction output box and/or the second instruction output box corresponding to the target client through the instruction network, and the first instruction output box and/or the second instruction output box carry out unidirectional control on the corresponding target client.
6. The network-based signal source parallel interaction system of claim 5, wherein the first interface display and control device comprises a first interface isolation box and a third interface acquisition box, the first interface isolation box comprises a unidirectional optical fiber, the first interface isolation box receives the first display interface and/or the second display interface and transmits the first display interface and/or the second display interface to the third interface acquisition box through the unidirectional optical fiber, and the third interface acquisition box converts the first display interface and/or the second display interface into a network flow signal and uploads the network flow signal to the user network;
the second interface display and control equipment comprises a second interface isolation box and a fourth interface acquisition box, the second interface isolation box comprises a unidirectional optical fiber, the second interface isolation box receives the first display interface and/or the second display interface and transmits the first display interface and/or the second display interface to the fourth interface acquisition box through the unidirectional optical fiber, and the fourth interface acquisition box converts the first display interface and/or the second display interface into a network flow signal and uploads the network flow signal to a use network;
the third interface display and control device comprises a first network string converting device and a third instruction output box, wherein the first network string converting device is used for converting the first control instruction into a serial port form and outputting the first control instruction to the third instruction output box;
the fourth interface display control device comprises a second network string converting device and a fourth instruction output box, the second network string converting device is used for converting the second control instruction into a serial port form and outputting the second control instruction to the fourth instruction output box, the fourth instruction output box comprises a serial port and a USB port and is used for receiving the control instruction of the serial port form input by the second network string converting device, analyzing and converting the control instruction, and outputting the control instruction to the second ui interface and the signal source control device after the control instruction under the HID standard device protocol is formed.
7. The network-based signal source parallel interaction system according to claim 5, wherein the third instruction output box converts the control instruction in the serial port format input by the first network-to-serial device into a control instruction under an HID standard device protocol and outputs the control instruction to the first ui interface and the signal source control device;
and the fourth instruction output box converts the control instruction in the serial port form input by the second network-to-serial device into a control instruction under the HID standard device protocol and outputs the control instruction to the second ui interface and the signal source control device.
8. The network-based signal source parallel interactive system according to one of claims 1 to 7, further comprising respective unidirectional video lines.
9. The network-based signal source parallel interaction system according to any one of claims 4 to 7, wherein the first ui interface and signal source control means controls the virtual ui interface to respond according to a control instruction for controlling the virtual ui interface in the first control instruction, and unidirectionally transmits ui interface response data as a result of the response to the first fusion means; the first fusion device fuses the ui interface response data and the first display interface and/or the second display interface according to the ui interface response data, and transmits the interface formed by fusion to the first interface display and control equipment in a one-way mode;
the second ui interface and signal source control device controls the virtual ui interface to respond according to a control instruction used for controlling the virtual ui interface in the second control instruction, and transmits ui interface response data serving as a response result to the second fusion device in a one-way mode; and the second fusion device fuses the ui interface response data and the first display interface and/or the second display interface according to the ui interface response data, and transmits the interface formed by fusion to the second interface display and control equipment in a one-way mode.
10. The network-based signal source parallel interaction system according to any one of claims 4 to 7, wherein the first ui interface and signal source control means controls the virtual ui interface to respond according to a control instruction for controlling the virtual ui interface in the first control instruction, draws a ui interface according to a result of the virtual ui interface response, and unidirectionally transmits the drawn ui interface to the first fusion means; the first ui interface and signal source control device also determines display window information and mouse position information corresponding to the virtual ui interface response result, and unidirectionally transmits the display window information and the mouse position information to the first fusion device; the first fusion device performs fusion according to the ui interface, the display window information, the mouse position information and the first display interface and/or the second display interface, and transmits the interface formed by fusion to the first interface display control equipment in a one-way mode;
the second ui interface and signal source control device controls the virtual ui interface to respond according to a control instruction used for controlling the virtual ui interface in the second control instruction, draws the ui interface according to a virtual ui interface response result, and transmits the drawn ui interface to the second fusion device in a single direction; the second ui interface and signal source control device also determines signal source display window information and mouse position information corresponding to the virtual ui interface response result, and unidirectionally transmits the signal source display window information and the mouse position information to the second fusion device; and the second fusion device performs fusion according to the ui interface, the display window information, the mouse position information and the first display interface and/or the second display interface, and transmits the interface formed by fusion to the second interface display control equipment in a one-way mode.
11. The network-based signal source parallel interaction system of any of claims 1-7, wherein the unidirectional video lines comprise respective video cards.
12. The network-based signal source parallel interaction system of any of claims 1-7, further comprising respective clients.
13. The network-based signal source parallel interaction system of claim 12, further comprising a virtual machine pool for each client.
14. The network-based signal source parallel interaction system of any of claims 1-7, wherein the first client renders the display interface of the one or more signal sources obtained from the first virtual machine pool access within windows, the windows being distributed according to a layout.
15. The network-based signal source parallel interactive system according to one of claims 1 to 7, wherein the first and second ui interfaces and the signal source control means prestore the correspondence relationship between each client and each instruction output box.
16. The network-based signal source parallel interaction system according to any of claims 1 to 7, wherein the first and second command output boxes are configured to parse and convert the received first control command and/or second control command to form a control command under the HID standard device protocol, and output the control command to the corresponding target client.
17. The network-based signal source parallel interaction system of any of claims 1-7, wherein the first and second instruction output boxes are each connected to a corresponding client via a corresponding unidirectional serial line.
18. A network-based signal source parallel interaction system according to any of claims 1 to 7, wherein the first network, the second network, the video network, the instruction network and the usage network are network isolated from each other.
19. A network-based signal source parallel interaction system according to any of claims 1 to 7, wherein said obtaining the first and/or second display interface via a video network comprises obtaining the first and/or second display interface via a video network cable and a video network switch.
20. A network-based signal source parallel interaction system according to any of claims 1-7, further comprising means for achieving said unidirectional control purpose and means for achieving said unidirectional transmission purpose.
21. The signal source parallel interaction system according to one of claims 4 to 7, further comprising an additional server, wherein the first and/or second interaction terminal sends the first and/or second control command to the first and/or second interface display and control device through the additional server and the use network.
22. The signal source parallel interactive system according to one of claims 4 to 7, further comprising an additional server, to which the first and/or second interactive terminals send the first and/or second control commands for the server to keep related records or for unified management; and/or the first and/or second interactive terminal sends a corresponding request to the additional server before sending the first and/or second control instruction, and the request is sent after being authorized by the server.
23. The signal source parallel interaction system according to one of claims 4 to 7, wherein each interface display and control device temporarily stores each display interface collected by each interface display and control device, and sends the display interfaces to each interaction terminal at a future moment according to actual needs or network conditions; or, each interface display control device encodes the acquired interface for a period of time into a video, encodes the video into a network stream and sends the network stream to each interactive terminal; or each interface display and control device also temporarily stores the acquired interface or the video to a server or a cloud end, and sends the interface or the video to each interactive terminal at a future moment according to actual needs or network conditions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210926277.1A CN115297362A (en) | 2022-08-03 | 2022-08-03 | Signal source parallel interaction system based on network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210926277.1A CN115297362A (en) | 2022-08-03 | 2022-08-03 | Signal source parallel interaction system based on network |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115297362A true CN115297362A (en) | 2022-11-04 |
Family
ID=83826875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210926277.1A Pending CN115297362A (en) | 2022-08-03 | 2022-08-03 | Signal source parallel interaction system based on network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115297362A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160274736A1 (en) * | 2015-03-16 | 2016-09-22 | Microsoft Technology Licensing, Llc | Synchronized multi-window interaction with hierarchical data on thin-client |
| US20180113719A1 (en) * | 2015-05-11 | 2018-04-26 | The Commonwealth Of Australia | Cross domain desktop compositor |
| CN110851063A (en) * | 2019-09-18 | 2020-02-28 | 丁建华 | Method for carrying out safe fusion interaction on multi-network and multi-system application interface |
| CN111459393A (en) * | 2020-03-13 | 2020-07-28 | 中天智领（北京）科技有限公司 | Method, system and equipment for realizing multi-signal-source interactive control |
| CN113448622A (en) * | 2021-01-20 | 2021-09-28 | 北京仁光科技有限公司 | Multi-signal-source interface interaction system |
| CN114423079A (en) * | 2022-03-30 | 2022-04-29 | 中国科学技术大学 | Method, device, equipment and medium for positioning wireless signal source |
-
2022
- 2022-08-03 CN CN202210926277.1A patent/CN115297362A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160274736A1 (en) * | 2015-03-16 | 2016-09-22 | Microsoft Technology Licensing, Llc | Synchronized multi-window interaction with hierarchical data on thin-client |
| US20180113719A1 (en) * | 2015-05-11 | 2018-04-26 | The Commonwealth Of Australia | Cross domain desktop compositor |
| CN110851063A (en) * | 2019-09-18 | 2020-02-28 | 丁建华 | Method for carrying out safe fusion interaction on multi-network and multi-system application interface |
| CN111459393A (en) * | 2020-03-13 | 2020-07-28 | 中天智领（北京）科技有限公司 | Method, system and equipment for realizing multi-signal-source interactive control |
| CN113448622A (en) * | 2021-01-20 | 2021-09-28 | 北京仁光科技有限公司 | Multi-signal-source interface interaction system |
| CN114423079A (en) * | 2022-03-30 | 2022-04-29 | 中国科学技术大学 | Method, device, equipment and medium for positioning wireless signal source |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3293955A1 (en) | Information processing device, information processing method and information processing program | |
| CN105493621B (en) | Terminal, server and terminal control method | |
| CN112462931B (en) | Signal source calling and controlling method and system | |
| US20140098247A1 (en) | Home Automation And Smart Home Control Using Mobile Devices And Wireless Enabled Electrical Switches | |
| CN204795335U (en) | KVM matrix system | |
| CN111263127B (en) | Signal source calling and controlling method and system | |
| US20240036774A1 (en) | Printing method and apparatus, and electronic device | |
| CN113448622B (en) | Multi-signal-source interface interaction system | |
| CN103581265A (en) | Remote access method and system | |
| US20140310420A1 (en) | System and method of identifying networked device for establishing a p2p connection | |
| CN112073307B (en) | Mail processing method, mail processing device, electronic equipment and computer readable medium | |
| CN114726838B (en) | System and method for remote secure interaction of multiple signal sources | |
| CN114389764B (en) | Method and system for remotely interacting multiple signal sources based on multiple double-link devices | |
| CN114726904A (en) | System and method for remote secure interaction of signal sources | |
| CN115277810B (en) | Signal source parallel interaction system | |
| CN115297362A (en) | Signal source parallel interaction system based on network | |
| KR102485592B1 (en) | How to improve learning effectiveness by providing video content in realistic format | |
| CN110519205B (en) | Apparatus and method for interacting computers within at least two subnets | |
| CN115333810A (en) | Multi-network signal source interactive system | |
| CN114449182A (en) | Signal source calling and controlling method and system | |
| CN114727033A (en) | Signal source calling and controlling method and system | |
| CN114727034A (en) | Signal source calling and controlling method and system | |
| CN114579996B (en) | Mobile disk data interaction system and method | |
| CN113641439A (en) | Text recognition and display method, device, electronic equipment and medium | |
| CN213934850U9 (en) | Multi-signal source interface interaction device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |