CN111263127B - Signal source calling and controlling method and system - Google Patents

Signal source calling and controlling method and system Download PDF

Info

Publication number
CN111263127B
CN111263127B CN202010102884.7A CN202010102884A CN111263127B CN 111263127 B CN111263127 B CN 111263127B CN 202010102884 A CN202010102884 A CN 202010102884A CN 111263127 B CN111263127 B CN 111263127B
Authority
CN
China
Prior art keywords
unidirectional
signal source
network
interface
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010102884.7A
Other languages
Chinese (zh)
Other versions
CN111263127A (en
Inventor
谭登峰
其他发明人请求不公开姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zen Ai Technology Co ltd
Original Assignee
Beijing Zen Ai Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zen Ai Technology Co ltd filed Critical Beijing Zen Ai Technology Co ltd
Priority to CN202010102884.7A priority Critical patent/CN111263127B/en
Publication of CN111263127A publication Critical patent/CN111263127A/en
Application granted granted Critical
Publication of CN111263127B publication Critical patent/CN111263127B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/22—Adaptations for optical transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network

Abstract

The invention relates to a signal source calling and controlling method, which comprises the steps of receiving and analyzing user input, determining a virtual ui interface to be operated, outputting corresponding ui data through a first one-way transmission path, analyzing the ui data, and outputting an analysis result to a display device; receiving and analyzing further input of a user, determining a corresponding control command for controlling the virtual ui interface and a corresponding control command for controlling the signal source, controlling the virtual ui interface to respond according to the control command and outputting ui data corresponding to a response result through a first one-way transmission path; controlling the signal source to respond through a second unidirectional transmission path according to the control command for controlling the signal source; outputting the response result through a third unidirectional transmission path; and fusing the ui data analysis result corresponding to the response result with the signal source response result and outputting the fused result to the display device. The invention can ensure the safety of the signal source calling and controlling process.

Description

Signal source calling and controlling method and system
Technical Field
The present invention relates to the field of signal source invoking and controlling, and more particularly, to a method, system, device, and computer program product for safely invoking and controlling a signal source.
Background
In the prior art, when a person with low security level authority wants to operate a high-security level signal source and transfer the high-security level signal source to a screen for being viewed by multiple persons, the person needs to obtain corresponding authorization first so that the person can access the high-security level signal source and can send a signal transfer command to the high-security level signal source, however, the following risks are caused by the operation of artificial authorization and the following operation process: the data of the high-security signal source to be called is intercepted in the calling process, or other data of the high-security signal source is stolen in the operation process.
Disclosure of Invention
In view of the above problems, an aspect of the present invention provides a signal source retrieving and controlling method, which includes:
receiving and analyzing user input, determining a virtual ui interface to be operated according to a pre-stored corresponding relation between the input and the virtual ui interface, outputting ui data corresponding to the virtual ui interface to be operated through a first one-way transmission path, analyzing the ui data corresponding to the virtual ui interface to be operated, and outputting an analysis result of the ui data corresponding to the virtual ui interface to be operated to a display device;
receiving and analyzing further input of a user, and determining a control command for controlling the virtual ui interface and a control command for controlling a signal source corresponding to the further input according to a pre-stored corresponding relation between the input and the control command;
controlling the virtual ui interface to respond according to the control command for controlling the virtual ui interface, and outputting ui data corresponding to the virtual ui interface response result through a first unidirectional transmission path; controlling the signal source to respond through a second unidirectional transmission path according to the control command for controlling the signal source;
outputting a signal source response result through a third unidirectional transmission path;
and analyzing the ui data corresponding to the virtual ui interface response result output through the first unidirectional transmission path, fusing the analysis result of the ui data corresponding to the virtual ui interface response result with the signal source response result output through the third unidirectional transmission path, and outputting the fused result to the display device.
The embodiment of the invention can improve the safety of the interaction process and avoid the flowing of high-security information to low-security interaction equipment caused by the interaction process. Moreover, the ui virtual ui interface is introduced, and when the signal source is called, the response result of the virtual ui interface and the content of the signal source to be called are separately transmitted to the screen, so that the information security is further ensured, and even if one of the virtual ui interface and the content of the signal source to be called is accidentally stolen on a transmission path, the whole information has certain security to some extent.
In addition, by introducing a plurality of virtual ui interfaces and the relevance of the virtual interfaces and the input, the safety and the unpredictability of information can be further ensured at each operation.
Drawings
FIG. 1 illustrates a signal source commissioning and control system according to some embodiments of the present invention;
FIG. 2 illustrates a signal source commissioning and control system according to still further embodiments of the present invention;
FIG. 3 illustrates a signal source commissioning and control system according to still further embodiments of the present invention;
fig. 4 schematically illustrates a flow diagram of a signal source invocation and control method, according to some embodiments of the present invention.
Detailed Description
In the present application, the nature of the description related to the implementation through the network is intended to cover both the wired or wireless network connection implemented through the necessary firmware or software of the switch, the router, etc., and the wired or wireless network connection implemented through the intermediary of some servers or other computers, etc., and the description of the router/switch is sometimes omitted when describing the network connection for the sake of simplifying the description and highlighting the invention point. In the present application, the networks involved may include Wi-fi networks, Bluetooth networks, Private Area Networks (PAN), Local Area Networks (LAN), Wide Area Networks (WAN), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), Integrated digital enhanced network (iDEN), WiMAX, LTE advanced, Mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, such as a VPN.
The invention will now be described, by way of example, with reference to the accompanying drawings, in connection with which it is to be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. Additionally, the described embodiments are intended to be illustrative of some, but not all embodiments of the invention.
FIG. 1 illustrates a signal source dispatch and control system schematic according to some embodiments of the inventions.
The signal source retrieval and control system comprises: a ui interface and signal source control device 102; associated devices on the first unidirectional transmission path 104; a display analysis device 108; associated devices on the second unidirectional transmission path 1061; and associated devices on the third unidirectional transmission path 1063.
In the present application, the first, second and third unidirectional transmission paths may include various unidirectional transmission or unidirectional control devices, and the unidirectional transmission or unidirectional control device may be a unidirectional transmission device such as a unidirectional control device or a unidirectional transmission cable, or an integral body composed of a control device and a transmission cable, etc., when the unidirectional transmission or unidirectional control is implemented as a whole, the present application does not limit that each null control device or connection cable in the integral body must be operated unidirectionally, for example, some connection cables between devices or devices may have bidirectional or multidirectional paths, but still implement unidirectional transmission or unidirectional control as a whole, and for example, the path may involve network connection (member), but when the network connection is combined with other devices, the combined integral body can implement unidirectional purpose, as will also be described below, such cases are also within the intended scope and protection of the present invention.
The ui interface and signal source control device 102 is configured to receive and analyze user input, and determine a control command for controlling the virtual ui interface 1025 and a control command for controlling a signal source, which correspond to the input, according to a pre-stored correspondence between the input and the control command; controlling the virtual ui interface to respond according to the control command for controlling the virtual ui interface 1025, and outputting ui data corresponding to the response result of the virtual ui interface to the display analysis device 108 through the first unidirectional transmission path 104; the ui interface and signal source control device 102 further controls the signal source 1 to respond through the second unidirectional transmission path 1061 according to the control command for controlling the signal source, and enables the signal source 1 to output a response result to the display analysis device 108 through the third unidirectional transmission path 1063.
The display analysis device 108 is configured to analyze the ui data, fuse an analysis result and a signal source response result, and output the fusion result to the screen 100. The fusion is, for example, to draw the signal source content to a corresponding position according to the position and size for signal source display in the analysis result, and to draw the ui icon button and the like at the corresponding position. Such as where the content from the signal source is displayed in figure 1, labeled "signal source 1".
According to some embodiments of the present invention, the ui interface and signal source control device 102 may store and set a virtual ui interface as a virtual ui interface to be operated (i.e., a virtual ui interface to be used), and in response to the input (for example, upon detecting that there is a signal source invoking and control related input), output ui data corresponding to the virtual ui interface to be operated to the display analysis device through the first unidirectional transmission path, analyze the ui data corresponding to the virtual ui interface to be operated by the display analysis device, and output the analysis result to the display device.
By finally outputting the virtual ui interface to be operated to the screen 100, the user can perform input operations with reference to the display content on the screen in subsequent interactive actions, for example, moving a local mouse, tapping a local keyboard, inputting a shortcut key, and the like, so as to change the virtual ui interface, and finally, the display interface of the signal source on the screen is changed accordingly.
According to some embodiments of the invention, the content of the virtual ui interface may include interactive labels such as save, plot, delete, screen-recording, undo, clear, etc., a box line distribution, a mouse pattern, and the like. Each different virtual ui interface may have a different label, outline distribution, etc. The plotting means drawing lines, adding geometric structure diagrams, flow charts, and performing actions such as labeling, adding characters, coloring, and the like.
According to some embodiments of the present invention, the control command for controlling the virtual ui interface may include, for example, clicking a pull-down menu in a square in which the signal source 1 is located in the figure, moving, enlarging or reducing the position of the display window of the signal source 1, and the like.
According to some embodiments of the invention, the control command for controlling the signal source may comprise, for example, changing the video content of the signal source, or the like.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface to be operated and the ui data corresponding to the virtual ui interface response result include pointer position data, that is, data corresponding to the distribution positions of the pointers on the virtual ui interface. Because the ui data can contain pointer position data, the display content displayed on the screen also includes the pointer position in real time, so that the control of a local mouse, a keyboard and the like can be richer, and the corresponding control efficiency of the interface on the screen is also improved.
According to some embodiments of the present invention, the signal source invocation and control system may also include an input generation device 101. Referring to fig. 1, the input generating device 101 may be an input device such as a keyboard, a mouse, or the like. In some embodiments, the ui interface and signal source control device 102 may be triggered by an input of the input generating device to output the ui data corresponding to the virtual ui interface to be operated to the display analysis device through the first unidirectional transmission path, analyze the ui data corresponding to the virtual ui interface to be operated by the display analysis device, and output the analysis result to the screen 100. To input a virtual ui interface for triggering the invocation of the desired operation. According to some embodiments of the present invention, a control command for controlling the signal source and a control command for controlling the virtual ui interface may be input through the input generating means.
According to some embodiments of the present invention, the ui interface and signal source control device 102 may further store the virtual ui interface response result for updating the virtual ui interface stored in advance as the virtual ui interface to be called next time.
According to some embodiments of the present invention, the ui interface and signal source control device 102 may be further configured to transmit only the ui data related to the changed portion of the virtual ui interface when the ui data corresponding to the virtual ui interface response result is transmitted to the display resolution device through the first unidirectional transmission path. Therefore, the transmission amount can be saved, and the display speed of the virtual ui interface on the screen can be improved.
According to some embodiments of the invention, outputting the ui data corresponding to the virtual ui interface response result to the display resolution device 108 via the first unidirectional transmission path comprises transmitting the ui data corresponding to the virtual ui interface response result to the display resolution device by:
transmitting the ui data corresponding to the virtual ui interface response result to the display analysis device through a first one-way transmission device of one of the following a) -b):
a) a unidirectional optical fiber;
b) a unidirectional video line;
at this time, the first unidirectional transmission path includes a unidirectional optical fiber or a unidirectional connector such as a unidirectional video line. Other means for achieving unidirectional transmission are also within the contemplation of the invention. Accordingly, the signal source retrieving and controlling system according to some embodiments of the present invention may further include the first unidirectional transmission device, and similarly, the following description is not repeated.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the display resolution device by:
and transmitting the ui data corresponding to the virtual ui interface response result to a display analysis device through the first network, the network light conversion equipment and the unidirectional optical fiber in sequence. The display analysis device decodes and analyzes the network stream signal from the optical fiber signal.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the display resolution device by:
and transmitting the ui data corresponding to the virtual ui interface response result to a display analysis device through a first network, a first unidirectional transmission device and a second network which are one of c) to d) in sequence:
c) a unidirectional optical fiber;
d) the combination of network optical switching equipment, unidirectional optical fiber and optical switching network equipment.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the display resolution device by:
and transmitting the ui data corresponding to the virtual ui interface response result to a display analysis device through a first one-way transmission device and a second network in one of the following e) to f):
e) a unidirectional optical fiber;
f) the combination of unidirectional optical fibers and optical switching network equipment.
In the present application, the first network and the second network are only concepts used for describing the two networks distinctively, and have no other specific meaning; in some figures and descriptions, a network in which a control network switch or a video network switch is located may be used to refer to a first network and a second network.
According to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by controlling the signal source by a second unidirectional transmission means of one of the following a) -d):
a) a unidirectional optical fiber;
b) a unidirectional serial port line;
c) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
d) the combination of the unidirectional optical fiber, the optical serial conversion equipment and the unidirectional serial port line;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by controlling the signal source via the first network and the second unidirectional transport means in one of the following e) -h) in sequence:
e) the combination of network-to-serial equipment and a unidirectional serial port line;
f) the combination of the network light conversion equipment and the unidirectional optical fiber;
g) the combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;
h) the combination of network light conversion equipment, one-way optical fibers, light conversion serial equipment and one-way serial port lines;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by controlling the signal source sequentially through the first network, the second unidirectional transmission device of one of the following i) -m) and a third network in which the signal source is located:
i) a unidirectional optical fiber;
j) a combination of a network-to-serial device, a unidirectional serial port line and a serial-to-network device;
k) the combination of the network light conversion equipment, the unidirectional optical fiber and the optical network conversion equipment;
l) combination of network to serial equipment, unidirectional serial port line, serial to optical equipment, unidirectional optical fiber and optical network to conversion equipment;
m) combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment, unidirectional serial port lines and serial-to-network equipment;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by a second unidirectional transmission device of one of the following n) -r) and a third network control signal source where the signal source is located in sequence:
n) a unidirectional optical fiber;
o) a combination of unidirectional optical fibers, optical serial-to-serial equipment, unidirectional serial-to-port lines, and serial-to-network equipment;
p) a combination of unidirectional optical fibers and optical switching network equipment;
q) a combination of unidirectional serial port lines and serial-to-network equipment;
r) combination of unidirectional serial port line, serial-to-optical device, unidirectional optical fiber and optical network switching device;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
the signal source is controlled to respond by the unidirectional control device.
According to some embodiments of the invention, said responding by controlling the signal source via the second unidirectional transmission path comprises:
transmitting said control command for controlling the signal source to the control means via second unidirectional transmission means of one of the following a) -d), the signal source being controlled by the control means in response to:
a) a unidirectional optical fiber;
b) a unidirectional serial port line;
c) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
d) the combination of the unidirectional optical fiber, the optical serial conversion equipment and the unidirectional serial port line;
according to some embodiments of the invention, said responding by controlling the signal source via the second unidirectional transmission path comprises:
transmitting said control command for controlling the signal source to the control means, sequentially via the first network and via second unidirectional transmission means of one of the following e) -h), the signal source being controlled by the control means in response:
e) the combination of network-to-serial equipment and a unidirectional serial port line;
f) the combination of the network light conversion equipment and the unidirectional optical fiber;
g) the combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;
h) the combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment and unidirectional serial port lines.
According to some embodiments of the invention, said responding by controlling the signal source via the second unidirectional transmission path comprises:
transmitting said control command for controlling the signal source to the control means via the first network, the control means responding by controlling the signal source via a second unidirectional transmission means of one of the following i) -l):
i) a unidirectional optical fiber;
j) a unidirectional serial port line;
k) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
l) a combination of unidirectional optical fibers, optical cross-talk devices and unidirectional serial port lines.
According to some embodiments of the present invention, the signal source response result is output to the display resolution device through a third unidirectional transmission path by:
1) causing the signal source to transmit the response result to the display resolution means via a third unidirectional transmission means of one of the following a) -b):
a) a unidirectional optical fiber;
b) a unidirectional video line;
according to some embodiments of the present invention, the signal source response result is output to the display resolution device through a third unidirectional transmission path by:
enabling the signal source to transmit the response result to the video coding device through a third unidirectional transmission device of one of the following c) -d), enabling the video coding device to code the response result of the signal source into a network stream signal, sending the network stream signal to the display analysis device through a second network, enabling the display analysis device to decode the network stream signal into video stream data, fusing the video stream data and the analysis result of the ui data corresponding to the virtual ui interface response result, and outputting the fusion result to the display device:
c) a unidirectional optical fiber;
d) a unidirectional video line.
According to some embodiments of the invention, the first network and the second network are isolated; the second network and a third network are isolated; the first network and the third network are isolated.
In the above description, various transmissions and controls achieved through the first path, various transmissions and controls achieved through the second path, and various transmissions and controls achieved through the third path may be combined without conflict to achieve the object of the present invention. For example, from the foregoing description and the combination of the various paths, the following signal source invocation and control system can be obtained, which includes:
the ui interface and signal source control device, the first one-way transmission device, the display analysis device, the second one-way transmission device and the third one-way transmission device;
the ui interface and signal source control device is used for receiving and analyzing user input, and determining a control command for controlling the virtual ui interface and a control command for controlling a signal source, which correspond to the input, according to a pre-stored corresponding relation between the input and the control command; the ui interface and signal source control device is also used for controlling the virtual ui interface to respond according to the control command for controlling the virtual ui interface, outputting ui data corresponding to the response result of the virtual ui interface to the display analysis device through the first unidirectional transmission device, controlling the signal source through the second unidirectional transmission device, responding according to the control command for controlling the signal source, and transmitting the response result to the display analysis device through the third unidirectional transmission device;
and the display analysis device is used for analyzing the ui data, fusing the analysis result and the signal source response result and outputting the fused result to the display device.
Furthermore, from the foregoing description and the combination of the various paths, it is also possible to obtain a signal source pickup and control system comprising:
the ui interface and signal source control device, the first one-way transmission device, the display analysis device, the one-way control equipment and the third one-way transmission device;
the ui interface and signal source control device is used for receiving and analyzing user input, and determining a control command for controlling the virtual ui interface and a control command for controlling a signal source, which correspond to the input, according to a pre-stored corresponding relation between the input and the control command; the ui interface and signal source control device is also used for controlling the virtual ui interface to respond according to the control command for controlling the virtual ui interface, outputting ui data corresponding to the response result of the virtual ui interface to the display analysis device through the first unidirectional transmission device, sending the control command for controlling the signal source to unidirectional control equipment by the ui interface and signal source control device, controlling the signal source by the unidirectional control equipment, responding according to the control command for controlling the signal source, and transmitting the response result to the display analysis device through the third unidirectional transmission device;
and the display analysis device is used for analyzing the ui data, fusing the analysis result and the signal source response result and outputting the fused result to the display device.
The unidirectional control device is further described below.
The above is merely an example, and for the sake of simplicity, the combination of the unidirectional paths is not listed.
Fig. 2 illustrates a signal source commissioning and control system schematic according to still further embodiments of the present invention.
The signal source retrieval and control system comprises: ui interface and signal source control means 12; a unidirectional transmission device 14; a display analysis device 18; a one-way control device 161; a control network switch 13; a video network switch 15; a video encoding device 163, and a unidirectional transmission means (not shown) connected between the signal source and the video encoding device 163. According to some embodiments of the present invention, the ui interface and signal source control means 12 may further comprise an input generating means 11.
The ui interface and signal source control device 12 is configured to receive and analyze user input, and determine a control command for controlling the virtual ui interface 125 and a control command for controlling a signal source, which correspond to the input, according to a pre-stored correspondence between the input and the control command; and according to the control command for controlling the virtual ui interface 125, controlling the virtual ui interface to respond, and outputting ui data corresponding to the virtual ui interface response result to the display analysis device 18 through the control network switch 13, the unidirectional transmission device 14 and the video network switch 15; the ui interface and signal source control device 12 further sends a control command for controlling the signal source to the unidirectional control equipment 161 through the control network switch 13, and the unidirectional control equipment 161 controls the signal source 1 to respond according to the control command for controlling the signal source and outputs a response result to the display analysis device 18 through a third unidirectional transmission device.
The display analysis device 18 is used for analyzing the ui data, fusing the analysis result and the signal source response result and outputting the fused result to the screen 10.
The fusion is, for example, to draw the signal source content to the corresponding position according to the position and size for signal source display in the analysis result, and to draw the ui icon button and the like at the corresponding position. Such as where the content from the signal source is displayed in the figure, labeled "signal source 1".
Further exemplary embodiments of the above-described signal retrieval and control system are given below.
The ui interface and signal source control device 12 includes an event acquisition unit 121, a ui interface and signal source response calculation unit 122, a ui data distribution unit 123, and a control data distribution unit 124. According to some other embodiments of the present invention, the various elements of the ui interface and source control device 12 may also be combined with each other or subdivided in different ways to achieve the overall functionality of the ui interface and source control device 12 as well.
The event acquisition unit 121 receives the input of the input generating means and sends the signal to the ui interface and signal source response calculation unit 122.
The ui interface and signal source response calculation unit 122 analyzes the user input sent by the event collection unit 121 to determine a control command for controlling the virtual ui interface and a control command for controlling the signal source corresponding to the input. The ui interface and signal source response calculating unit controls the virtual ui interface to respond (for example, enlarge the display window of the signal source 1) according to the control command for controlling the ui interface, sends the corresponding ui data (for example, information including the enlarged display window) after the virtual ui interface responds to the ui data distributing unit 123, and sends the ui data after responding to the display analyzing unit 18 through a first unidirectional transmission path formed by the control network switch 13, the unidirectional transmission device 14 and the video network switch 15. Meanwhile, the ui interface and signal source response calculating unit 122 also transmits control data (or control command) for controlling the signal source 1 to the control data distributing unit 124, and the control data distributing unit 124 transmits the control data (or control command) to the signal source 1 through the second unidirectional transmission path, so as to control the signal source 1. The second unidirectional transmission path includes, for example, a control network switch 13 and a unidirectional control device 161. The unidirectional control device 161 receives control data from the ui interface and signal source control apparatus 12 (from the control data distribution unit 124 therein), and controls the signal source 1 according to the control data, the signal source 1 responds to the control of the unidirectional control device 161, performs corresponding operations such as keyboard, mouse, touch, and the like, and unidirectionally transmits the content of the signal source 1 (such as video content in the form of video stream data) corresponding to the operation result or response result to the video encoding device 163 through a third unidirectional transmission device such as a video cable or a unidirectional optical fiber, the video encoding device encodes the video stream data into a network stream signal and transmits the video content in the form of the network stream signal to the display analysis device 18 via the video network switch 15. The ui interface and signal source response calculating unit 122 can also call up the ui data corresponding to the virtual ui interface to be operated on the screen 10 in a similar manner when receiving the input signal.
According to some embodiments, the unidirectional transmission device 14 may comprise a unidirectional fiber, and the ui data passes through the control network switch, and then reaches the video network switch, and is transmitted to the display resolution device 18 by the video network switch.
According to some embodiments, the composition of the unidirectional control device 161 and its manner of action on the signal source may vary accordingly, depending on the signal source. For example, in the case where the signal source is a computer, control data in the form of a protocol may be sent to the signal source through the unidirectional control device 161 to perform unidirectional control on the signal source, and the content of the signal source is not transmitted back to the unidirectional control device. In the case that the signal source is a camera or the like, the unidirectional control apparatus may include a unidirectional transmission device and a control device, the control device is configured to control the camera according to the control data, and the unidirectional transmission device may block the content of the camera from flowing out in a reverse direction toward the unidirectional control apparatus. For example, the unidirectional control device may include a unidirectional transmission apparatus and a usb controller, where the usb controller is a standard usb-hid device and is connected to the signal source through the usb, and can control the signal source through a keyboard and a mouse.
The display analysis device 18 is configured to receive and analyze the ui data, receive a network stream signal from the video network switch, decode the network stream signal into video stream data, merge the video stream data with an analysis result of the ui data, and output a result of the merging on the screen. According to the illustrated embodiment, the display parsing means 18 may comprise a video decoding and display unit 181 and a ui data parsing unit 182. The ui data parsing unit 182 is configured to receive and parse the ui data sent by the ui data distribution unit 123, and send the parsing result to the video decoding and display unit 181. The video decoding and displaying unit 181 receives the analysis result, on the one hand, and also receives the video content in the form of the network stream signal from the signal source 1 of the video network switch, decodes it into video stream data, and merges the video stream data with the ui data analysis result sent by the ui data analyzing unit, and outputs the result of the merging onto the screen 10, and the content finally presented on the screen 10 includes an interface in response to the input of the input generating apparatus and the content of the signal source 1 displayed in the interface in response to the input.
Depending on the need or lack thereof for the network environment in the operating environment, in some other embodiments of the present invention, the constituent elements of the system described above may be varied, such as by having components therein associated with network access present or omitted. For example, 1) if a video network switch is not needed, only a control network switch is needed, and ui data can be transmitted to the display analysis device through the control network switch and the unidirectional transmission device; 2) if the network switch does not need to be controlled, only the video network switch is needed, and the ui data can be transmitted to the display analysis device through the one-way transmission device and the video network switch; 3) if the video network and the control network environment are not needed, the ui data can be directly transmitted to the display analysis device through the one-way transmission device. Corresponding to 1) above, the control data may be transmitted to the unidirectional control device via the control network switch. Corresponding to the above 2 and 3), the control data may be transmitted directly to the unidirectional control device. Corresponding to the above 1) and 3), the response result of the signal source is transmitted to the display analysis device through a unidirectional optical fiber or a unidirectional video line. Corresponding to the above 2), the response result of the signal source is encoded by the video encoding device, and the encoded result is transmitted to the video network switch through the unidirectional optical fiber or the unidirectional video line, and further transmitted to the display analysis device 18 by the video network switch. The unidirectional optical fiber or the unidirectional video cable can be replaced by other unidirectional transmission devices.
Further, various details of the signal source acquisition and control process described previously with respect to fig. 1 may be applied herein, or may be applied thereto with appropriate adaptation. For the sake of simplicity, no further description is provided herein.
Through the embodiment of the invention, the user can have experience and efficiency similar to the operation of a local computer when calling and controlling the signal source, and simultaneously, the safety of the interaction process is ensured, and the high-security information is prevented from flowing into the low-security interaction equipment caused by the interaction process, for example, the content of the high-security signal source shown in the figure is prevented from flowing to the ui interface and the signal source control device or flowing to the low-security interaction end where the input generation device is positioned. Moreover, by introducing the virtual ui interface and separately transmitting the response result of the virtual ui interface and the content of the signal source to be called to the screen when the signal source is called and controlled, the information on one hand is lost or stolen on the transmission path, so that the whole information (including the interface and the signal source content) finally presented on the screen cannot be lost or stolen, namely the whole information presented on the screen still has safety.
For example, assume that the interface presented on the screen includes two boxes, one of which is red, representing an alert box, and the other of which is green, representing a security box, and that the content of all emergency signal sources is to be displayed in the red box of the interface, while the content of non-emergency signal sources is to be displayed in the green box. If the signal source content is intercepted separately during the signal source calling and controlling process, the interceptor still cannot determine the core information of the signal source, i.e. the signal source is an emergency signal source or a non-emergency signal source, because the light-dependent intercepting part cannot determine whether the signal source is finally placed in a red frame or a green frame.
Fig. 3 illustrates a signal source commissioning and control system schematic according to still further embodiments of the present invention.
The signal source retrieval and control system comprises: ui interface and signal source control 32; a unidirectional transmission device 34; a display analyzer 38; a unidirectional control device 361; a control network switch 33; a video network switch 35; the video coding device (363, 364; 373, 374) and the unidirectional transmission device which is connected between the signal source (signal source 1, signal source 2; signal source n, signal source m) and the video coding device (363, 364; 373, 374). According to some embodiments of the invention, the ui interface and signal source control means 32 may further comprise an input generating means 31.
The ui interface and the signal source control device are stored with a plurality of virtual ui interfaces in advance. Fig. 3 shows two virtual ui interfaces (325 and 326) with id 1 and id x, and it can be seen that the layouts of the two interfaces are not the same. The ui interface and signal source control apparatus may also pre-store the correspondence between each virtual ui interface and each signal source (e.g., the virtual ui interface 325 is configured to be used for signal sources 1 and 2; the virtual ui interface 326 is configured to be used for signal sources n and m), so that it may determine the corresponding virtual ui interface according to the signal source to be called; or, the corresponding relationship between each virtual ui interface and each login information is pre-stored, so that the corresponding virtual ui interface can be determined according to the login information, for example, when a user logs in through different accounts, the ui interface and the signal source control device receive and analyze the input (account) of the user, and the ui interface of the corresponding id can be called according to the input (account). In addition, the ui interface and signal source control device may further store a correspondence between the virtual ui interface and a screen (i.e., a screen for playing a called signal source), or a correspondence between login information and a screen, so that after the virtual ui interface is determined, the corresponding screen may be determined, or the corresponding screen may be determined according to the login information. In addition, different permissions can be set for different accounts so that when some accounts log in, only a specific ui interface can be used.
According to some embodiments of the present invention, if the ui interface and signal source control device receives and analyzes the input login account number and then determines that the operation corresponds to the virtual ui interface 325 and corresponds to the screen 301 and the signal source 1, the ui data and the corresponding screen id (id is 1) related to the virtual ui interface 325 are sent to the display analysis device through the unidirectional transmission path, and the screen id is output by the display analysis device to the screen, so that the user can see the interface corresponding to the virtual ui interface 325 to be operated on the screen; in fig. 3, the ui interface and signal source control device transmits the ui data and screen id related to the virtual ui interface 325 to the display analysis device via the control network switch 33, the unidirectional transmission device 34, and the video network switch 35. The user may then refer to the on-screen interface 301 for further operations.
When the virtual ui interface 325, the corresponding screen 301 and the signal source 1 are determined, the ui interface and signal source control device 32 further receives and analyzes the user input, and determines a control command for controlling the virtual ui interface 325 and a control command for controlling the signal source 1, which correspond to the input, according to a pre-stored correspondence between the input and the control command; controlling the virtual ui interface to respond according to the control command for controlling the virtual ui interface, and outputting ui data and screen id corresponding to the virtual ui interface response result to a display analysis device 38 through a control network switch 33, a one-way transmission device 34 and a video network switch 35; the ui interface and signal source control device 32 further sends a control command for controlling the signal source 1 to the corresponding unidirectional control device 361 through the control network switch 33, and the unidirectional control device 361 controls the signal source 1 to respond according to the control command for controlling the signal source 1 and outputs a response result to the display analysis device 38 through a unidirectional transmission path.
The display analysis device 18 is configured to analyze the ui data, fuse the analysis result and the signal source response result, and output the fusion result to the corresponding screen 301.
According to some embodiments of the present invention, the corresponding relationship between the virtual ui interface and the screen, or the corresponding relationship between the signal source and the screen, and other corresponding relationships may also be stored in the display analysis device. Therefore, once the display analysis device determines the virtual ui interface id in the ui data, the screen id to which the corresponding virtual interface is output can be determined according to the virtual ui interface id, or the screen id to which the corresponding virtual interface is output can be determined according to the id of the transmitted incoming call signal source.
Further exemplary embodiments of the above-described signal retrieval and control system are given below.
The ui interface and signal source control device 32 includes an event acquisition unit 321, a ui interface and signal source response calculation unit 322, a ui data distribution unit 323, and a control data distribution unit 324. According to some other embodiments of the present invention, the various elements of the ui interface and source control device 32 may also be combined with each other or subdivided in different ways to achieve the overall functionality of the ui interface and source control device 32 as well.
The event acquisition unit 321 receives the input of the input generating means and sends the signal to the ui interface and signal source response calculation unit 322.
The ui interface and signal source response calculating unit 322 analyzes the user input transmitted by the event collecting unit 321 to determine a virtual ui interface and screen id to be operated, a control command for controlling the virtual ui interface, and a control command for controlling the signal source, which correspond to the input. The ui interface and signal source response calculation unit sends the ui data and the screen id corresponding to the virtual ui interface to be operated to the ui data distribution unit 323, the ui data distribution unit sends the ui data and the screen id to the ui data analysis unit 382 through a first unidirectional transmission path formed by the control network switch 33, the unidirectional transmission device 34 and the video network switch 35, the ui data analysis unit 382 sends the analysis result to the video decoding and display unit 381, and the latter receives the analysis result and the screen id and outputs the analysis result (interface) to the screen 301 corresponding to the screen id (id is 1).
The ui interface and signal source response calculation unit 322 analyzes further user input sent by the event acquisition unit 321, and determines a control command for controlling the virtual ui interface 325 and a control command for controlling the signal source 1 corresponding to the input according to a pre-stored correspondence between the input and the control command; and according to the control command for controlling the virtual ui interface 325, controlling the virtual ui interface to respond, and sending the ui data (e.g., information including an enlarged display window) corresponding to the virtual ui interface after responding to the ui interface to the ui data distribution unit 123, and then sending the ui data after responding to the display analysis device 38 by the ui data distribution unit through a first unidirectional transmission path composed of the control network switch 33, the unidirectional transmission device 34 (e.g., unidirectional optical fiber), and the video network switch 35. Meanwhile, the ui interface and signal source response calculating unit 322 also sends control data (or control command) for controlling the signal source 1 to the control data distributing unit 324, and the control data distributing unit 324 sends the control data (or control command) to the signal source 1 through the second unidirectional transmission path, so as to control the signal source 1. The second unidirectional transmission path includes, for example, the illustrated control network switch 33 and a unidirectional control device 361. The unidirectional control device 361 receives the control data from the ui interface and signal source control device 32 (from the control data distribution unit 324 therein), controls the signal source 1 according to the control data, the signal source 1 responds to the control of the unidirectional control device 361, executes corresponding operations such as keyboard, mouse, touch and the like, and transmits the content of the signal source 1 (such as video content in the form of video stream data) corresponding to the operation result or response result to the video encoding device 363 in a unidirectional manner through a third unidirectional transmission device such as a video line or a unidirectional optical fiber, the video encoding device encodes the video stream data into a network stream signal and transmits the video content in the form of the network stream signal to the display analysis device 38 via the video network switch 35.
The display analysis device 38 is configured to receive and analyze the ui data, receive a network stream signal from the video network switch, decode the network stream signal into video stream data, merge the video stream data with an analysis result of the ui data, and output a result of the merging on the screen. According to the illustrated embodiment, the display parsing means 38 may comprise a video decoding and display unit 381 and a ui data parsing unit 382. The ui data parsing unit 382 is configured to receive and parse the ui data sent from the ui data distribution unit 323, and send the parsing result to the video decoding and display unit 381. The video decoding and displaying unit 381 receives the foregoing analysis result on the one hand, and also receives the video content in the form of the network stream signal from the signal source 1 of the video network switch on the other hand, decodes it into video stream data, and merges the video stream data with the ui data analysis result sent by the ui data analyzing unit, and outputs the result of the merging onto the screen 301, and the content finally presented on the screen 301 includes an interface in response to the input of the input generating apparatus and the content of the signal source 1 displayed in the interface in response to the input.
Further, various details of the signal source acquisition and control processes described previously with respect to fig. 1 and 2 may be applied herein, or may be suitably adapted to be applied herein. For the sake of simplicity, no further description is provided herein.
Through the embodiment of the invention, the user can have experience and efficiency similar to the operation of a local computer when calling and controlling the signal source, and simultaneously, the safety of the interaction process is ensured, and the high-security information is prevented from flowing into the low-security interaction equipment caused by the interaction process, for example, the content of the high-security signal source shown in the figure is prevented from flowing to the ui interface and the signal source control device or flowing to the low-security interaction end where the input generation device is positioned. For example, assume that the interface presented on the screen includes two boxes, one of which is red, representing an alert box, and the other of which is green, representing a security box, and that the content of all emergency signal sources is to be displayed in the red box of the interface, while the content of non-emergency signal sources is to be displayed in the green box. If the signal source content is intercepted separately during the signal source calling and controlling process, the interceptor still cannot determine the core information of the signal source, i.e. the signal source is an emergency signal source or a non-emergency signal source, because the light-dependent intercepting part cannot determine whether the signal source is finally placed in a red frame or a green frame.
In addition, by introducing a plurality of virtual ui interfaces and the relevance of the virtual interfaces and the input, the safety and the unpredictability of information can be further ensured at each operation. For example, if a user knows the interface parameters corresponding to the signal source 1 when calling the signal source 1, but cannot pre-determine whether there are other interface parameters around the signal source n when calling the signal source n, it is impossible to pre-determine the point where the signal source n is focused.
Fig. 4 illustrates a flow diagram of a signal source invocation and control method in accordance with some embodiments of the present invention. The method includes S1, S2, S3, S4, and S5:
s1, receiving and analyzing user input, determining a virtual ui interface to be operated according to a pre-stored corresponding relation between the input and the virtual ui interface, outputting ui data corresponding to the virtual ui interface to be operated through a first one-way transmission path, analyzing the ui data corresponding to the virtual ui interface to be operated, and outputting an analysis result to a display device.
According to some embodiments of the present invention, a corresponding relationship between a virtual ui interface and a display device may be pre-stored, a user input may be received and analyzed, a virtual ui interface to be operated and a display device id to be output may be determined according to the pre-stored corresponding relationship between the input and the virtual ui interface and the corresponding relationship between the virtual ui interface and the display device, ui data corresponding to the virtual ui interface to be operated and the corresponding display device id may be output to a display analysis device through a unidirectional transmission path, the ui data corresponding to the virtual ui interface to be operated may be analyzed by the display analysis device, and an analysis result may be output to a display device corresponding to the display device id.
And S2, receiving and analyzing further input of the user, and determining a control command for controlling the virtual ui interface and a control command for controlling the signal source, which correspond to the further input, according to the pre-stored corresponding relation between the input and the control command.
The control command for controlling the virtual ui interface may include, for example, clicking a pull-down menu in a square cell in which the signal source 1 of fig. 1 is located, moving, enlarging or reducing the position of the display window of the signal source 1, and the like. The control command for controlling the signal source may for example comprise changing the video content of the signal source, etc.
S3, controlling the virtual ui interface to respond according to the control command for controlling the virtual ui interface, and outputting ui data corresponding to the virtual ui interface response result through a first one-way transmission path; and controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source.
S4, outputting a signal source response result through a third one-way transmission path;
and S5, analyzing the ui data corresponding to the virtual ui interface response result output through the first unidirectional transmission path, fusing the analysis result and the signal source response result output through the third unidirectional transmission path, and outputting the fused result to the display device.
According to some embodiments of the present invention, ui data corresponding to the virtual ui interface response result is output to the display resolution device through a first unidirectional transmission path; outputting the signal source response result to the display analysis device through a third unidirectional transmission path; and analyzing the ui data corresponding to the virtual ui interface response result through the display analysis device, fusing the analysis result and the signal source response result, and outputting the fused result to the display device.
According to some embodiments of the present invention, the signal source may be controlled to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and the signal source may output its response result through the third unidirectional transmission path, that is, the limitation of the output of the response result of the signal source is completed through the control command.
According to some embodiments of the present invention, the manner of outputting the ui data corresponding to the ui interface to be operated and the ui data corresponding to the virtual ui interface response result to the display resolution device through the first unidirectional transmission path may further include transmitting the ui data to the display resolution device by:
transmitting the ui data to the display analysis device through a first unidirectional transmission means of one of the following a) -b):
a) a unidirectional optical fiber;
b) a unidirectional video line;
at this time, the first unidirectional transmission path includes a unidirectional optical fiber or a unidirectional connector such as a unidirectional video line.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the display resolution device by:
and transmitting the ui data to a display analysis device through the first network, the network light conversion equipment and the unidirectional optical fiber in sequence. The display analysis device decodes and analyzes the network stream signal from the optical fiber signal.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the display resolution device by:
transmitting the ui data to the display analysis device sequentially through the first network, the first unidirectional transmission device of one of c) -d) below, and the second network:
c) a unidirectional optical fiber;
d) the combination of network optical switching equipment, unidirectional optical fiber and optical switching network equipment.
According to some embodiments of the present invention, the ui data corresponding to the virtual ui interface response result may be transmitted to the display resolution device by:
transmitting the ui data to the display analysis device sequentially through the first unidirectional transmission device and the second network of one of the following e) -f):
e) a unidirectional optical fiber;
f) the combination of unidirectional optical fibers and optical switching network equipment.
In the present application, the first network and the second network are only concepts used for describing the two networks distinctively, and have no other specific meaning; in some figures and descriptions, a network in which a control network switch or a video network switch is located may be used to refer to a first network and a second network.
According to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by controlling the signal source by a second unidirectional transmission means of one of the following a) -d):
a) a unidirectional optical fiber;
b) a unidirectional serial port line;
c) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
d) the combination of the unidirectional optical fiber, the optical serial conversion equipment and the unidirectional serial port line;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by controlling the signal source via the first network and the second unidirectional transport means in one of the following e) -h) in sequence:
e) the combination of network-to-serial equipment and a unidirectional serial port line;
f) the combination of the network light conversion equipment and the unidirectional optical fiber;
g) the combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;
h) the combination of network light conversion equipment, one-way optical fibers, light conversion serial equipment and one-way serial port lines;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by controlling the signal source sequentially through the first network, the second unidirectional transmission device of one of the following i) -m) and a third network in which the signal source is located:
i) a unidirectional optical fiber;
j) a combination of a network-to-serial device, a unidirectional serial port line and a serial-to-network device;
k) the combination of the network light conversion equipment, the unidirectional optical fiber and the optical network conversion equipment;
l) combination of network to serial equipment, unidirectional serial port line, serial to optical equipment, unidirectional optical fiber and optical network to conversion equipment;
m) combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment, unidirectional serial port lines and serial-to-network equipment;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
responding by a second unidirectional transmission device of one of the following n) -r) and a third network control signal source where the signal source is located in sequence:
n) a unidirectional optical fiber;
o) a combination of unidirectional optical fibers, optical serial-to-serial equipment, unidirectional serial-to-port lines, and serial-to-network equipment;
p) a combination of unidirectional optical fibers and optical switching network equipment;
q) a combination of unidirectional serial port lines and serial-to-network equipment;
r) combination of unidirectional serial port line, serial-to-optical device, unidirectional optical fiber and optical network switching device;
according to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:
the signal source is controlled to respond by the unidirectional control device.
According to some embodiments of the invention, said responding by controlling the signal source via the second unidirectional transmission path comprises:
transmitting said control command for controlling the signal source to the control means via second unidirectional transmission means of one of the following a) -d), the signal source being controlled by the control means in response to:
a) a unidirectional optical fiber;
b) a unidirectional serial port line;
c) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
d) the combination of the unidirectional optical fiber, the optical serial conversion equipment and the unidirectional serial port line;
according to some embodiments of the invention, said responding by controlling the signal source via the second unidirectional transmission path comprises:
transmitting said control command for controlling the signal source to the control means, sequentially via the first network and via second unidirectional transmission means of one of the following e) -h), the signal source being controlled by the control means in response:
e) the combination of network-to-serial equipment and a unidirectional serial port line;
f) the combination of the network light conversion equipment and the unidirectional optical fiber;
g) the combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;
h) the combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment and unidirectional serial port lines.
According to some embodiments of the invention, said responding by controlling the signal source via the second unidirectional transmission path comprises:
transmitting said control command for controlling the signal source to the control means via the first network, the control means responding by controlling the signal source via a second unidirectional transmission means of one of the following i) -l):
i) a unidirectional optical fiber;
j) a unidirectional serial port line;
k) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
l) a combination of unidirectional optical fibers, optical cross-talk devices and unidirectional serial port lines.
According to some embodiments of the present invention, the signal source response result is output to the display resolution device through a third unidirectional transmission path by:
1) causing the signal source to transmit the response result to the display resolution means via a third unidirectional transmission means of one of the following a) -b):
a) a unidirectional optical fiber;
b) a unidirectional video line;
according to some embodiments of the present invention, the signal source response result is output to the display resolution device through a third unidirectional transmission path by:
enabling the signal source to transmit the response result to the video coding device through a third unidirectional transmission device of one of the following c) -d), enabling the video coding device to code the response result of the signal source into a network stream signal, sending the network stream signal to the display analysis device through a second network, enabling the display analysis device to decode the network stream signal into video stream data, fusing the video stream data and the analysis result of the ui data corresponding to the virtual ui interface response result, and outputting the fusion result to the display device:
c) a unidirectional optical fiber;
d) a unidirectional video line.
According to some embodiments of the invention, the first network and the second network are isolated; the second network and a third network are isolated; the first network and the third network are isolated.
In the above description, various transmissions and controls achieved through the first path, various transmissions and controls achieved through the second path, and various transmissions and controls achieved through the third path may be combined without conflict to achieve the object of the present invention.
According to some embodiments of the invention, the first network and the second network are isolated; the second network and a third network are isolated; the first network and the third network are isolated.
In addition, the signal source retrieving process or method involved in the signal source retrieving and controlling system described above with reference to fig. 1 to 3 is also applicable here, i.e. also within the scope of the present invention, and for the sake of simplicity, will not be described here again.
Through the embodiment of the invention, the user can have experience and efficiency similar to the operation of a local computer when calling and controlling the signal source, and simultaneously, the safety of the interaction process is ensured, and the high-security information is prevented from flowing into the low-security interaction equipment caused by the interaction process, for example, the content of the high-security signal source shown in the figure is prevented from flowing to the ui interface and the signal source control device or flowing to the low-security interaction end where the input generation device is positioned. Moreover, by introducing the virtual ui interface and separately transmitting the response result of the virtual ui interface and the content of the signal source to be called to the display device when the signal source is called and controlled, the information on one hand is lost or stolen on the transmission path, so that the whole information (including the interface and the signal source content) finally presented on the display device is not lost or stolen, namely the whole information presented on the display device still has safety.

Claims (10)

1. The signal source calling and controlling method comprises the following steps:
receiving and analyzing user input, determining a virtual ui interface to be operated according to a pre-stored corresponding relation between the input and the virtual ui interface, outputting ui data corresponding to the virtual ui interface to be operated through a first one-way transmission path, analyzing the ui data corresponding to the virtual ui interface to be operated, and outputting an analysis result of the ui data corresponding to the virtual ui interface to be operated to a display device;
receiving and analyzing further input of a user, and determining a control command for controlling the virtual ui interface and a control command for controlling a signal source corresponding to the further input according to a pre-stored corresponding relation between the input and the control command;
controlling the virtual ui interface to respond according to the control command for controlling the virtual ui interface, and outputting ui data corresponding to the virtual ui interface response result through a first unidirectional transmission path; controlling the signal source to respond through a second unidirectional transmission path according to the control command for controlling the signal source;
outputting a signal source response result through a third unidirectional transmission path;
and analyzing the ui data corresponding to the virtual ui interface response result output through the first unidirectional transmission path, fusing the analysis result of the ui data corresponding to the virtual ui interface response result with the signal source response result output through the third unidirectional transmission path, and outputting the fused result to the display device.
2. The method of claim 1, comprising:
outputting the ui data corresponding to the virtual ui interface to be operated to a ui display analysis device through a first one-way transmission path, analyzing the ui data by the display analysis device, and outputting an analysis result to a display device; outputting the ui data corresponding to the virtual ui interface response result to the display analysis device through a first one-way transmission path; outputting the signal source response result to the display analysis device through a third unidirectional transmission path; and analyzing the ui data corresponding to the virtual ui interface response result through the display analysis device, fusing the analysis result of the ui data corresponding to the virtual ui interface response result and the signal source response result, and outputting the fused result to the display device.
3. The method according to claim 2, further comprising receiving and analyzing a user input, and determining the display device to which the analysis result of the ui data corresponding to the virtual ui interface to be operated is to be output, based on a pre-stored correspondence between the input and the virtual ui interface and a correspondence between the virtual ui interface and the display device.
4. The method of claim 3, wherein the ui data corresponding to the virtual ui interface to be operated and the ui data corresponding to the virtual ui interface response result comprise pointer position data.
5. The method according to claim 2, comprising outputting the ui data corresponding to the virtual ui interface to be operated and the ui data corresponding to the virtual ui interface response result to the display resolution device by one of the following 1), 2), 3), and 4):
1) transmitting the ui data corresponding to the virtual ui interface response result to the display analysis device through a first one-way transmission device of one of the following a) -b):
a) a unidirectional optical fiber;
b) a unidirectional video line;
2) transmitting the ui data corresponding to the virtual ui interface response result to the display analysis device through the first network, the network light conversion equipment and the unidirectional optical fiber in sequence;
3) transmitting the ui data corresponding to the virtual ui interface response result to the display analysis device sequentially through a first network, a first unidirectional transmission device and a second network of one of c) to d) below:
c) a unidirectional optical fiber;
d) the combination of the network light conversion equipment, the unidirectional optical fiber and the optical network conversion equipment;
4) transmitting the ui data corresponding to the virtual ui interface response result to the display analysis device sequentially through the first one-way transmission device and the second network of one of the following e) to f):
e) a unidirectional optical fiber;
f) the combination of unidirectional optical fibers and optical switching network equipment.
6. The method of claim 5, responding to the control command for controlling the signal source via the second unidirectional transmission path, comprising one of the following 1), 2), 3), 4), 5):
1) responding by controlling the signal source by a second unidirectional transmission means of one of the following a) -d):
a) a unidirectional optical fiber;
b) a unidirectional serial port line;
c) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
d) the combination of the unidirectional optical fiber, the optical serial conversion equipment and the unidirectional serial port line;
2) responding by controlling the signal source via the first network and the second unidirectional transport means in one of the following e) -h) in sequence:
e) the combination of network-to-serial equipment and a unidirectional serial port line;
f) the combination of the network light conversion equipment and the unidirectional optical fiber;
g) the combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;
h) the combination of network light conversion equipment, one-way optical fibers, light conversion serial equipment and one-way serial port lines;
3) responding by controlling the signal source sequentially through the first network, the second unidirectional transmission device of one of the following i) -m) and a third network in which the signal source is located:
i) a unidirectional optical fiber;
j) a combination of a network-to-serial device, a unidirectional serial port line and a serial-to-network device;
k) the combination of the network light conversion equipment, the unidirectional optical fiber and the optical network conversion equipment;
l) combination of network to serial equipment, unidirectional serial port line, serial to optical equipment, unidirectional optical fiber and optical network to conversion equipment;
m) combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment, unidirectional serial port lines and serial-to-network equipment;
4) responding by a second unidirectional transmission device of one of the following n) -r) and a third network control signal source where the signal source is located in sequence:
n) a unidirectional optical fiber;
o) a combination of unidirectional optical fibers, optical serial-to-serial equipment, unidirectional serial-to-port lines, and serial-to-network equipment;
p) a combination of unidirectional optical fibers and optical switching network equipment;
q) a combination of unidirectional serial port lines and serial-to-network equipment;
r) combination of unidirectional serial port line, serial-to-optical device, unidirectional optical fiber and optical network switching device;
5) the signal source is controlled to respond by the unidirectional control device.
7. The method of claim 5, wherein responding by controlling the signal source via the second unidirectional transmission path comprises performing the following steps 1) to 3):
1) transmitting said control command for controlling the signal source to the control means via second unidirectional transmission means of one of the following a) -d), the signal source being controlled by the control means in response to:
a) a unidirectional optical fiber;
b) a unidirectional serial port line;
c) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
d) the combination of the unidirectional optical fiber, the optical serial conversion equipment and the unidirectional serial port line;
2) transmitting said control command for controlling the signal source to the control means, sequentially via the first network and via second unidirectional transmission means of one of the following e) -h), the signal source being controlled by the control means in response:
e) the combination of network-to-serial equipment and a unidirectional serial port line;
f) the combination of the network light conversion equipment and the unidirectional optical fiber;
g) the combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;
h) the combination of network light conversion equipment, one-way optical fibers, light conversion serial equipment and one-way serial port lines;
3) transmitting said control command for controlling the signal source to the control means via the first network, the control means responding by controlling the signal source via a second unidirectional transmission means of one of the following i) -l):
i) a unidirectional optical fiber;
j) a unidirectional serial port line;
k) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;
l) a combination of unidirectional optical fibers, optical cross-talk devices and unidirectional serial port lines.
8. The method of claim 5, 6 or 7, comprising outputting the signal source response result to the display resolution device via a third unidirectional transmission path by one of the following 1) and 2):
1) causing the signal source to transmit the response result to the display resolution means via a third unidirectional transmission means of one of the following a) -b):
a) a unidirectional optical fiber;
b) a unidirectional video line;
2) enabling the signal source to transmit the response result to the video coding device through a third unidirectional transmission device of one of the following c) -d), enabling the video coding device to code the response result of the signal source into a network stream signal, sending the network stream signal to the display analysis device through a second network, enabling the display analysis device to decode the network stream signal into video stream data, fusing the video stream data and the analysis result of the ui data corresponding to the virtual ui interface response result, and outputting the fusion result to the display device:
c) a unidirectional optical fiber;
d) a unidirectional video line.
9. The method of claim 8, wherein the first network and second network are isolated; the second network and a third network are isolated; the first network and the third network are isolated.
10. The method of claim 2, wherein outputting the ui data corresponding to the virtual ui interface response result to the display resolution device via a first unidirectional transmission path comprises: and outputting the ui data related to the changed part of the virtual ui interface.
CN202010102884.7A 2020-02-19 2020-02-19 Signal source calling and controlling method and system Active CN111263127B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010102884.7A CN111263127B (en) 2020-02-19 2020-02-19 Signal source calling and controlling method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010102884.7A CN111263127B (en) 2020-02-19 2020-02-19 Signal source calling and controlling method and system

Publications (2)

Publication Number Publication Date
CN111263127A CN111263127A (en) 2020-06-09
CN111263127B true CN111263127B (en) 2020-10-09

Family

ID=70951307

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010102884.7A Active CN111263127B (en) 2020-02-19 2020-02-19 Signal source calling and controlling method and system

Country Status (1)

Country Link
CN (1) CN111263127B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114449182A (en) * 2021-01-20 2022-05-06 北京仁光科技有限公司 Signal source calling and controlling method and system
CN113448622B (en) * 2021-01-20 2022-05-06 北京仁光科技有限公司 Multi-signal-source interface interaction system
CN114389764B (en) * 2022-01-24 2022-08-30 北京仁光科技有限公司 Method and system for remotely interacting multiple signal sources based on multiple double-link devices
CN114579996B (en) * 2022-03-04 2022-08-30 北京仁光科技有限公司 Mobile disk data interaction system and method

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09284747A (en) * 1996-04-19 1997-10-31 Sony Corp System and method for two-way information transmission
JP2006050292A (en) * 2004-08-05 2006-02-16 Sumitomo Electric Ind Ltd Digital video signal interface module
JP5271532B2 (en) * 2007-12-07 2013-08-21 株式会社日立製作所 Video transmission system
CN106507148B (en) * 2015-09-06 2019-06-21 杭州海康威视数字技术股份有限公司 Display control method and device
JP7131383B2 (en) * 2016-05-31 2022-09-06 ソニーグループ株式会社 Information processing device, television receiver, information processing system and information processing program
CN108366285B (en) * 2017-07-06 2019-12-06 新华三云计算技术有限公司 Video data display method and device
CN109451281B (en) * 2018-12-20 2020-09-22 西南大学 Video monitoring system

Also Published As

Publication number Publication date
CN111263127A (en) 2020-06-09

Similar Documents

Publication Publication Date Title
CN111263127B (en) Signal source calling and controlling method and system
CN112462931B (en) Signal source calling and controlling method and system
JP4382654B2 (en) Message processing apparatus and method using avatar in portable terminal
CN102395012B (en) Using the method for the shared video screen RTV remote television of mobile phone, system and mobile phone
US8295862B2 (en) Method and system to enable communication through SMS communication channel
US20240036774A1 (en) Printing method and apparatus, and electronic device
WO2014200163A1 (en) Information encryption system and information encryption method using optical character recognition
CN107071551A (en) Applied to the multi-screen interactive screen response method in intelligent television system
CN103596027A (en) Method and device for retrieving keyboards under different scenes of intelligent television
CN105301978A (en) Connection method and mobile terminal
CN114389764B (en) Method and system for remotely interacting multiple signal sources based on multiple double-link devices
CN114726838B (en) System and method for remote secure interaction of multiple signal sources
CN114726904A (en) System and method for remote secure interaction of signal sources
CN114727032A (en) Signal source calling and controlling method and system
CN110531881A (en) The centralized kvm system of mouse calling OSD menu
CN111277670A (en) Remote control system and method
Clifton What every engineer should know about data communications
CN107346197A (en) A kind of method for information display and device
CN115277810B (en) Signal source parallel interaction system
CN114449182A (en) Signal source calling and controlling method and system
CN114727034A (en) Signal source calling and controlling method and system
CN114727033A (en) Signal source calling and controlling method and system
CN107870752A (en) Wall method, terminal, video wall and system on terminal window
US8041838B2 (en) Content display device and content display method
CN115297362A (en) Signal source parallel interaction system based on network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant