CN114449182A

CN114449182A - Signal source calling and controlling method and system

Info

Publication number: CN114449182A
Application number: CN202110076667.XA
Authority: CN
Inventors: 不公告发明人
Original assignee: Beijing Zen Ai Technology Co ltd
Current assignee: Beijing Zen Ai Technology Co ltd
Priority date: 2021-01-20
Filing date: 2021-01-20
Publication date: 2022-05-06

Abstract

The invention relates to a signal source calling and controlling method, which comprises the following steps: receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling the signal source, controlling the ui interface to respond, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface to the picture superposition and fusion device through the one-way video transmission device; determining ui data corresponding to the ui interface response result, and outputting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first one-way transmission path; and controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and enabling the signal source to output a signal source response result to the image superposition and fusion device through the third unidirectional transmission path. The invention can ensure the safety of the signal source calling and controlling process.

Description

Signal source calling and controlling method and system

Technical Field

The present invention relates to the field of signal source invoking and controlling, and in particular, to a signal source invoking and controlling method, system, device, and computer program product for performing secure invoking and secure controlling on a signal source.

Background

In the prior art, when a person with low security level authority wants to operate a high-security level signal source and transfer the high-security level signal source to a screen for being viewed by multiple persons, the person needs to obtain corresponding authorization first so that the person can access the high-security level signal source and can send a signal transfer command to the high-security level signal source, however, the following risks exist in the artificial authorized operation and the subsequent operation process: the data of the high-security signal source to be called is intercepted in the calling process, or other data of the high-security signal source is stolen in the operation process.

Disclosure of Invention

In view of the above problems, a first aspect of the present invention provides a signal source retrieving and controlling method, which includes:

receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface to the picture superposition and fusion device through the one-way video transmission device;

determining ui data corresponding to the ui interface response result, and outputting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first one-way transmission path;

controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and enabling the signal source to output a signal source response result to the picture superposition and fusion device through the third unidirectional transmission path;

the image superposition and fusion device receives the ui interface, receives ui data corresponding to the ui interface response result, determines signal source display window information and mouse position information in the ui data, receives the signal source response result, performs fusion and outputs the fusion result to the display device; and the fusion comprises the steps of displaying a signal source response result in a signal source display window on the ui interface and giving a mouse indication at a corresponding position according to the mouse position information.

A second aspect of the present invention provides a signal source retrieving and controlling system, including:

the system comprises a ui interface, a signal source control device, a first one-way transmission device, a one-way video transmission device, a picture superposition and fusion device, a second one-way transmission device and a third one-way transmission device.

The ui interface and signal source control device is used for receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing an interface according to a ui interface response result, and outputting the drawn ui interface to the picture superposition and fusion device through the one-way video transmission device;

the ui interface and signal source control device is also used for outputting ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first unidirectional transmission device, controlling the signal source through the second unidirectional transmission device, enabling the signal source to respond according to the control command for controlling the signal source and transmitting the signal source response result to the picture superposition and fusion device through the third unidirectional transmission device;

A third aspect of the present invention provides a signal source retrieving and controlling system, including:

the system comprises a ui interface, a signal source control device, a one-way video transmission device, a first one-way transmission device, a picture superposition and fusion device, one-way control equipment and a second one-way transmission device;

the ui interface and signal source control device is used for receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface through the one-way video transmission device; the ui interface and signal source control device is also used for determining ui data corresponding to the ui interface response result and outputting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first one-way transmission device;

the ui interface and signal source control device is also used for sending the control command for controlling the signal source to the unidirectional control equipment, and the unidirectional control equipment controls the signal source to respond according to the control command for controlling the signal source and transmit a signal source response result to the picture superposition and fusion device through the second unidirectional transmission device;

A fourth aspect of the present invention provides a signal source retrieving and controlling system, including:

the system comprises a ui interface, a signal source control device, a one-way video transmission device, a first one-way transmission device, a picture superposition and fusion device, one-way control equipment, a control network switch, a video network switch, video coding equipment and a second one-way transmission device;

the ui interface and signal source control device is also used for determining ui data corresponding to the ui interface response result and outputting the ui data to the picture superposition and fusion device through the first unidirectional transmission device;

the ui interface and signal source control device also sends a control command for controlling the signal source to the control network switch, the control network switch sends the control command to the unidirectional control equipment, and the unidirectional control equipment controls the signal source to respond according to the control command for controlling the signal source and enables the unidirectional control equipment to output a response result to the video coding equipment through the second unidirectional transmission device;

the video coding equipment is used for coding the signal source response result into a network stream signal, transmitting the network stream signal to the video network switch, and transmitting the network stream signal to the picture superposition and fusion device through the video network switch;

the image superposition and fusion device receives a ui interface, receives ui data corresponding to the ui interface response result, determines signal source display window information and mouse position information in the ui data, receives the network stream signal, decodes the network stream signal into video stream data, takes the video stream data as a signal source response result, performs fusion and outputs the fusion result to a display device; and the fusion comprises the steps of displaying a signal source response result in a signal source display window on the ui interface and giving a mouse indication at a corresponding position according to the mouse position information.

A fifth aspect of the present invention provides an apparatus for signal source invocation and control, characterized in that the apparatus comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface to the picture superposition and fusion device through the one-way video transmission device; determining ui data corresponding to the ui interface response result, and outputting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first unidirectional transmission path; and controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and enabling the signal source to output a signal source response result to the image superposition and fusion device through the third unidirectional transmission path.

A sixth aspect of the present invention provides a computer-readable storage medium storing a computer program, the computer program when executed by a processor implementing the steps of:

By the embodiment of the invention, the user can have experience and efficiency similar to those of operating a local computer when calling and controlling the signal source, and simultaneously, the safety of the interaction process is ensured, and the high-security information is prevented from flowing into the low-security interaction equipment caused by the interaction process, for example, the content of the high-security signal source is prevented from flowing to the ui interface and the signal source control device or flowing to the low-security interaction end where the input generating device is positioned.

Drawings

FIG. 1 illustrates a schematic diagram of a signal source dispatch and control system in accordance with some embodiments of the present invention;

FIG. 2a shows a schematic diagram of a signal source invocation and control system according to some embodiments of the present invention;

FIG. 2b shows a schematic diagram of a signal source invocation and control system according to some embodiments of the present invention;

FIG. 2c illustrates a cascaded schematic of a signal source modulation and control system according to still further embodiments of the invention;

FIG. 3 illustrates a signal source dispatch and control system schematic according to some embodiments of the inventions;

FIG. 4 illustrates a variation of a signal source display window during signal source invocation and control processes in accordance with some embodiments of the invention;

FIG. 5 schematically illustrates a flow diagram of a signal source invocation and control method, in accordance with some embodiments of the invention;

FIG. 6 schematically illustrates a flow diagram of a signal source invocation and control method, in accordance with some embodiments of the present invention;

fig. 7 schematically illustrates a schematic diagram of an apparatus for signal source invocation and control, according to some embodiments of the present invention.

Detailed Description

In the present application, the nature of the description related to the implementation through the network is intended to cover both the wired or wireless network connection implemented through the necessary firmware or software of the switch, the router, etc., and the wired or wireless network connection implemented through the intermediary of some servers or other computers, etc., and the description of the router/switch is sometimes omitted when describing the network connection for the sake of simplifying the description and highlighting the invention point. In the present application, the networks involved may include Wi-fi networks, Bluetooth networks, Private Area Networks (PAN), Local Area Networks (LAN), Wide Area Networks (WAN), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), Integrated digital enhanced network (iDEN), WiMAX, LTE advanced, Mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, such as a VPN.

The invention will now be described, by way of example, with reference to the accompanying drawings, in connection with which it is to be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. Additionally, the described embodiments are intended to be illustrative of some, but not all embodiments of the invention.

In the present application, the use of the connection lines such as the optical fiber and the serial port is related to, in order to match these connection lines, a conversion module may need to be used in a supporting manner, for example, when a signal is converted from a network to the optical fiber, a network light conversion module is needed, but in the case that the computer network port itself is an optical port, an additional network light conversion module may be omitted, since whether such a module is necessary or not may be determined according to an actual application scenario and is well known to those skilled in the art, for the sake of simplicity, the description is not given one by one, but the omission of the necessary conversion module is not indicated.

FIG. 1 illustrates a signal source dispatch and control system schematic according to some embodiments of the inventions.

The signal source fetching and controlling system comprises a ui interface and signal source control device 102, a related device on the first unidirectional transmission path 104, a unidirectional video transmission device 1041, a picture overlaying and fusing device 108, a related device on the second unidirectional transmission path 1061 and a related device on the third unidirectional transmission path 1063.

In this application, the first, second and third unidirectional transmission paths may include various unidirectional transmission or unidirectional control destination devices, and the unidirectional transmission or unidirectional control destination device may be a unidirectional transmission device such as a unidirectional control device or a unidirectional transmission cable, or an integral body composed of a control device and a transmission cable, etc., when the unidirectional transmission or unidirectional control destination is achieved as a whole, the application does not limit that each control device or connection cable itself in the integral body must be operated unidirectionally, for example, some connection cables between devices or devices may have bidirectional or multidirectional paths, but the unidirectional transmission or unidirectional control destination device as a whole can still be achieved; as another example, the path may involve a network connection (member), but when the network connection is combined with other devices, the combined entity may achieve a one-way objective, as will be described below, and such cases are within the intended scope and protection scope of the present invention.

The ui interface and signal source control device may store a plurality of ui interfaces and correspondence between each ui interface and an input in advance. For example, the correspondence between each ui interface and each login information is stored, so that the corresponding ui interface can be determined according to the login information: when a user logs in through different accounts, the ui interface and signal source control device receives and analyzes the input (account) of the user, and calls the ui interface with the corresponding id according to the input (account). In addition, in the case where the screen 100 is formed by splicing a plurality of screens, the ui interface and signal source control apparatus may further store a correspondence relationship between the ui interface and the screen, or a correspondence relationship between the login information and the screen, so that the corresponding screen may be determined after the ui interface is determined, or the corresponding screen may be determined according to the login information. In addition, different permissions can be set for different accounts so that when some accounts log in, only a specific ui interface can be used.

According to some embodiments of the invention, the content of the ui interface may comprise interactive labels of save, plot, delete, screen recording, undo, clear, etc., display window distribution, mouse, etc. Each different ui interface may have a different label, outline distribution, etc. The plotting means drawing lines, adding a geometric structure diagram and a flow chart, labeling, adding characters, coloring and the like; the ui data is data describing information of each component of a ui interface, such as interactive tags for saving, plotting, deleting, recording, canceling, emptying, etc., a display window, a mouse, etc., and the position where each component is located.

The ui interface and signal source control device 102 may receive and analyze user input, determine a ui interface to be called, a control command for controlling the ui interface 1025, a control command for controlling a signal source (the controlled signal source is the signal source 1) according to a pre-stored correspondence between the input and the control command, control the ui interface to respond according to the control command for controlling the ui interface 1025, draw the ui interface according to a result of the ui interface response, and output the drawn ui interface to the picture overlaying and fusing device 108 through the one-way video transmission device 1041.

According to some embodiments of the present invention, when only one ui interface exists, the ui interface and signal source control device 102 will not need to separately determine the ui interface to be called, and in response to the input (for example, once the input related to signal source calling and control is detected), output the screen corresponding to the ui interface to the screen overlay fusion device 108 through the unidirectional video transmission device 1041, and output the ui interface to the screen 100 through the screen overlay fusion device 108. By outputting the ui interface to be operated to the screen 100, the user can perform input operations with reference to the display content on the screen in subsequent interaction, for example, moving a local mouse, tapping a local keyboard, inputting a shortcut key, etc., so as to change the ui interface or control the signal source, and finally, the display interface on the screen of the signal source is changed correspondingly or the output content of the signal source is changed.

According to some embodiments of the invention, the control commands for controlling the ui interface may comprise, for example, clicking a drop-down menu in a grid of the figure in which the signal source 1 is located, moving, zooming in or out the position of the display window of the signal source 1, and the like.

According to some embodiments of the present invention, the control command for controlling the signal source may include, for example, a control command for playing, pausing, turning off the signal source, and the like.

The ui interface and signal source control device 102 is further configured to output the ui data corresponding to the initial ui interface response result and the ui data corresponding to the ui interface response result after the subsequent response control command to the image superimposition and fusion device 108 through the first unidirectional transmission path 104. The ui interface and signal source control device 102 may determine the change of the ui interface and corresponding ui data in real time through the ui interface and the control command for controlling the ui interface.

According to other embodiments of the invention, only the mouse position information and the signal source display window information in the ui data corresponding to the ui interface response result are transmitted to the picture overlaying and fusing device. The mouse position information includes pointer position data.

The ui interface and signal source control device 102 further controls the signal source 1 to respond through the second unidirectional transmission path 1061 according to the control command for controlling the signal source, and enables the signal source 1 to output a response result to the image overlaying and fusing device 108 through the third unidirectional transmission path 1063.

The image superposition and fusion device 108 is configured to receive a ui interface (i.e., a ui interface frame), receive ui data corresponding to a ui interface response result, determine signal source display window information and mouse position information therein, receive a signal source response result, perform fusion, and output a fusion result to a screen, where the fusion includes displaying the signal source response result in a signal source display window on the ui interface, and giving a mouse instruction at a corresponding position according to the mouse position information. For example, the content from the signal source 1 is displayed at the position marked with the word "signal source 1" on the ui interface in fig. 1, and a mouse indication is given at the corresponding position. As one of the fusion methods, for example, there may be included: and outputting the ui interface, displaying a signal source response result in a signal source display window of the ui interface, and outputting a mouse pattern at a mouse position on the ui interface. Since the fusion of other information into an interface is known to those skilled in the art, it is not described in detail herein, and such fusion is also within the scope of the present invention.

According to some embodiments of the present invention, the signal source invocation and control system may also include an input generation device 101. Referring to fig. 1, the input generating device 101 may be an input device such as a keyboard, a mouse, or the like. In some embodiments, the ui interface and signal source control device 102 may be triggered by the input of the input generation device to output the ui interface to be operated to the frame overlaying and fusing device 108 through the unidirectional video transmission device. According to some embodiments of the present invention, a control command for controlling the signal source and a control command for controlling the ui interface may be input through the input generating means.

The input generating device may also be an infrared frame touch input device, or a capacitive touch device, for example. The input generating device may capture touch or other control actions in various ways, such as electric induction, magnetic induction, thermal induction, and optical induction. In addition, the control instructions may also be generated via a network approach. According to some embodiments of the present invention, the input generating device may be spatially superimposed on the screen 100, as will be further described below, the screen 100 may provide a picture of a control object, and when the input generating device is a transparent touch device, by superimposing the touch device on the screen, a visual touch may be implemented on the input generating device by referring to the picture of the screen below the transparent touch device. The connection of the screen 100 and the input generating device throughout the device is shown in fig. 1.

The input generating device may also be, for example, an infrared light curtain type touch screen based on the screen 100, wherein an infrared light curtain is arranged on the surface of the screen. The infrared light curtain may be formed on the surface of the screen by an infrared laser or a laser array above the screen, and when a user acts on the screen 100 on which the infrared light curtain is disposed by a finger or the like, a touch input of the user in the screen is captured by the infrared camera. For example, when a touch is performed on the screen, the light distribution of the infrared light curtain at the touch point X changes due to the touch behavior, e.g., part of infrared light at the touch point is diffusely reflected off the screen by a touch finger and is further captured by an infrared camera located in front of the screen; or part of the infrared light at the touch point is transmitted through the screen due to the action of the touch finger (for example, when the screen is a DLP screen with semi-transparent and reflective), and then is shot by the infrared camera positioned behind the screen. Touch control can be recognized by recognizing the position of the infrared contact in the shooting result.

According to some embodiments of the present invention, the ui interface and signal source control device 102 may further store the ui interface response result for updating the ui interface stored in advance as the ui interface to be called next time.

According to some embodiments of the present invention, the ui interface and signal source control device 102 outputs the ui data of the ui interface to the screen overlay fusion device 108 through the first unidirectional transmission path 104, including outputting the ui data to the screen overlay fusion device 108 by:

outputting the ui data to the picture overlaying and fusing device 108 through a first unidirectional transmission device of one of the following a) -b):

a) a unidirectional optical fiber;

b) a unidirectional serial port line;

at this time, the first unidirectional transmission path includes a unidirectional optical fiber or a unidirectional connector such as a unidirectional video line. The unidirectional optical fiber comprises an optical fiber and an optical fiber isolator. In addition, in the present application, for the sake of simplifying the description, the unidirectional optical fiber is intended to cover accessories such as an optical transceiver (converting an optical signal into an electrical signal or converting an electrical signal into an optical signal) which may need to be used with the unidirectional optical fiber, and in the case that the above-mentioned accessories are used or not, the above description is not made one by one, since the above description is obvious in the context of the present invention. In addition, other means for achieving unidirectional transmission are also within the contemplation of the invention. Accordingly, the signal source retrieving and controlling system according to some embodiments of the present invention may further include the first unidirectional transmission device, and similarly, the following description is not repeated.

According to some embodiments of the present invention, the ui data may be output to the screen overlay fusion device 108 by:

and transmitting the ui data to the picture superposition and fusion device through the first network, the network light conversion equipment and the unidirectional optical fiber in sequence.

According to some embodiments of the present invention, the ui data may be output to the screen superimposition fusing device by:

sequentially outputting the ui data to the picture superposition and fusion device through the first network, the first unidirectional transmission device and the second network which are one of the following c) -d):

c) a unidirectional optical fiber;

d) a combination of a network optical switch device, a unidirectional optical fiber and an optical network switch device.

outputting the ui data to a picture superposition and fusion device through a first one-way transmission device and a second network in one of the following e) to f):

e) a unidirectional optical fiber;

f) the combination of unidirectional optical fibers and optical switching network equipment.

In the present application, the first network and the second network are only concepts used for describing the two networks distinctively, and have no other specific meaning; in some figures and descriptions, a network in which a control network switch or a video network switch is located may be used to refer to a first network and a second network.

According to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source comprises:

responding by controlling the signal source by a second unidirectional transmission means of one of the following a) -d):

a) a unidirectional optical fiber;

b) a unidirectional serial port line;

c) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;

d) the combination of the unidirectional optical fiber, the optical serial conversion equipment and the unidirectional serial port line;

responding by controlling the signal source via the first network and the second unidirectional transport means in one of the following e) -h) in sequence:

e) the combination of network-to-serial equipment and a unidirectional serial port line;

f) the combination of the network light conversion equipment and the unidirectional optical fiber;

g) the combination of network-to-serial equipment, unidirectional serial port lines, serial-to-optical equipment and unidirectional optical fibers;

h) the combination of network light conversion equipment, one-way optical fibers, light conversion serial equipment and one-way serial port lines;

responding by controlling the signal source sequentially through the first network, the second unidirectional transmission device of one of the following i) -m) and a third network in which the signal source is located:

i) a unidirectional optical fiber;

j) a combination of a network-to-serial device, a unidirectional serial port line and a serial-to-network device;

k) the combination of the network light conversion equipment, the unidirectional optical fiber and the optical network conversion equipment;

l) combination of network to serial equipment, unidirectional serial port line, serial to optical equipment, unidirectional optical fiber and optical network to conversion equipment;

m) combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment, unidirectional serial port lines and serial-to-network equipment;

responding by a second unidirectional transmission device of one of the following n) -r) and a third network control signal source where the signal source is located in sequence:

n) a unidirectional optical fiber;

o) a combination of unidirectional optical fibers, optical serial-to-serial equipment, unidirectional serial-to-port lines, and serial-to-network equipment;

p) a combination of unidirectional optical fibers and optical switching network equipment;

q) a combination of unidirectional serial port lines and serial-to-network devices;

r) combination of unidirectional serial port line, serial-to-optical device, unidirectional optical fiber and optical network switching device;

the signal source is controlled to respond by the unidirectional control device.

According to some embodiments of the invention, said responding by controlling the signal source via the second unidirectional transmission path comprises:

transmitting said control command for controlling the signal source to the control means via second unidirectional transmission means of one of the following a) -d), the signal source being controlled by the control means in response to:

a) a unidirectional optical fiber;

b) a unidirectional serial port line;

transmitting said control command for controlling the signal source to the control means, sequentially via the first network and via second unidirectional transmission means of one of the following e) -h), the signal source being controlled by the control means in response:

h) the combination of network light conversion equipment, unidirectional optical fibers, light conversion serial equipment and unidirectional serial port lines.

transmitting said control command for controlling the signal source to the control means via the first network, the control means responding by controlling the signal source via a second unidirectional transmission means of one of the following i) -l):

i) a unidirectional optical fiber;

j) a unidirectional serial port line;

k) the combination of a unidirectional serial port line, a serial light conversion device and a unidirectional optical fiber;

l) a combination of unidirectional optical fibers, optical cross-talk devices and unidirectional serial port lines.

According to some embodiments of the present invention, the signal source response result is output to the picture overlaying and fusing device through a third unidirectional transmission path by:

1) causing the signal source to transmit the signal source response result to the picture superposition and fusion device through a third unidirectional transmission device of one of the following a) to b):

a) a unidirectional optical fiber;

b) a unidirectional video line;

causing the signal source to transmit a signal source response result to the video encoding device through a third unidirectional transmission device of one of the following c) -d), encoding the signal source response result into a network stream signal by the video encoding device, and transmitting the network stream signal to the picture overlaying and fusing device through the second network, decoding the network stream signal into video stream data by the picture overlaying and fusing device, performing the fusion by using the video stream data as the signal source response result, and outputting the fusion result to the corresponding screen 100:

c) a unidirectional optical fiber;

d) a unidirectional video line.

According to some embodiments of the invention, the first network and the second network are isolated; the second network and a third network are isolated; the first network and the third network are isolated.

In the above description, various transmissions and controls achieved through the first path, various transmissions and controls achieved through the second path, and various transmissions and controls achieved through the third path may be combined without conflict to achieve the object of the present invention. The unidirectional control device is further described below.

Figure 2a shows a schematic diagram of a signal source commissioning and control system according to still further embodiments of the present invention. The difference from fig. 1 is that a dotted line portion is illustrated, and a portion outside the dotted line is similar to fig. 1, and thus the reference numeral of fig. 1 is used.

In fig. 2a, the ui interface and signal source control device 102 sends a control command for controlling a signal source to the unidirectional control apparatus 161 through the control network switch 13, the unidirectional control apparatus 161 receives the control command from the ui interface and signal source control device 12, and controls the signal source 1 according to the control command, the signal source 1 responds to the control of the one-way control device 161 to execute the corresponding operations of keyboard, mouse, touch control and the like, and transmits the content of the signal source 1 (e.g., video content in the form of video stream data) corresponding to the operation result or response result to the video encoding apparatus 163 in one direction through a unidirectional transmission device such as a unidirectional video cable or a unidirectional optical fiber, the video encoding apparatus encodes the video stream data into a network stream signal and transmits the video content in the form of the network stream signal to the picture overlaying and fusing device 18 via the video network switch 15.

According to some embodiments, the composition of the unidirectional control device 161 and its manner of action on the signal source may vary accordingly, depending on the signal source. For example, in the case where the signal source is a computer, control data in the form of a protocol may be sent to the signal source through the unidirectional control device 161 to perform unidirectional control on the signal source, and the content of the signal source is not transmitted back to the unidirectional control device. In the case that the signal source is a camera or the like, the unidirectional control apparatus may include a unidirectional transmission device and a control device, the control device is configured to control the camera according to the control data, and the unidirectional transmission device may block the contents of the camera from flowing out in the reverse direction toward the unidirectional control apparatus. For example, the unidirectional control device may include a unidirectional transmission apparatus and a usb controller, where the usb controller is a standard usb-hid device and is connected to the signal source through the usb, and can control the signal source through a keyboard and a mouse.

The image superposition and fusion device 18 receives video content in a network stream signal form from the signal source 1 of the video network switch and decodes the video content into video stream data, and is used for receiving a ui interface, receiving the ui data, determining signal source display window information and mouse position information in the ui data, receiving video content in a network stream signal form from the signal source 1 of the video network switch, decoding the video content into a video stream data signal source response result, carrying out fusion and outputting the fusion result to a corresponding screen, wherein the fusion comprises displaying the signal source response result in the signal source display window on the ui interface and giving a mouse indication at a corresponding position according to the mouse position information.

According to some embodiments of the present invention, the control command for controlling the signal source is encrypted to further improve the interaction security; the encryption may be performed before the control command for controlling the signal source is sent, or may be performed on the second unidirectional transmission path, for example, an encryption device may be introduced on the second unidirectional transmission path (e.g., after the deserializer device) to encrypt it, or encryption software may be introduced in some hardware on the second unidirectional transmission path (e.g., the deserializer device, etc.) to encrypt it. Accordingly, the source of the signal that received the control command decrypts the control command and responds, or a decryption device may be introduced in proximity to the source of the signal to decrypt it.

According to some embodiments of the present invention, the method may further include encrypting the signal source response result before transmitting the signal source response result to the picture overlaying and fusing apparatus, or encrypting it on a third unidirectional transmission path; accordingly, the picture superimposition and fusion apparatus that receives the signal source response result decrypts the encrypted content, or a decryption device may be introduced in the vicinity of the picture superimposition and fusion apparatus to decrypt it. The same applies to the following embodiments.

Figure 2b shows a schematic diagram of a signal source deployment and control system according to still further embodiments of the present invention. The difference from fig. 2a is that the first unidirectional transmission path 104 is located between the control network switch and the video network switch, and the ui data is output to the frame overlaying and merging device through the control network switch, the first unidirectional transmission path (or unidirectional transmission device), and the video network switch. The rest is similar to fig. 2a and therefore will not be described again for the sake of simplicity.

Depending on the need or lack thereof for the network environment in the operating environment, in some other embodiments of the present invention, the constituent elements of the system described above may be varied, such as by having components therein associated with network access present or omitted. For example, 1) if a video network switch is not needed, only a control network switch is needed, and ui data can be output to the picture superposition and fusion device through the control network switch and the unidirectional transmission device; 2) if the network switch does not need to be controlled, only the video network switch is needed, and the ui data can be output to the picture superposition and fusion device through the one-way transmission device and the video network switch; 3) if the video network and the control network environment are not needed, the ui data can be directly output to the picture superposition and fusion device through the one-way transmission device. Corresponding to 1) above, the control data may be transmitted to the unidirectional control device via the control network switch. Corresponding to the above 2 and 3), the control data may be transmitted directly to the unidirectional control device. Corresponding to the above 1) and 3), the response result of the signal source is output to the picture superimposition and fusion device through the unidirectional optical fiber or the unidirectional video line. Corresponding to the above 2), the response result of the signal source is encoded by the video encoding device, and the encoded result is transmitted to the video network switch through a unidirectional optical fiber or other unidirectional transmission line (such as a cable), and further transmitted to the image superposition and fusion device by the video network switch.

Further, various details of the signal source acquisition and control process described previously with respect to fig. 1 may be applied herein, or may be applied thereto with appropriate adaptation. For the sake of simplicity, no further description is provided herein.

Figure 2c illustrates a cascaded schematic of a signal source modulation and control system according to still further embodiments of the present invention.

Dashed

frame portions

1112 and 1113 are the same as the portion 1111 shown in the figure, and the description of portion 1111 can be referred to in fig. 2 a. Fig. 2c further includes a cascade server 1110 networked to the plurality of ui interfaces and signal source control devices to cascade the respective ui interfaces and signal source control devices, e.g., as a server to store information of the plurality of ui interfaces and signal source control devices and to coordinate inter-invocation, access and control between the plurality of ui interfaces and signal source control devices. For example, one ui interface and signal source control device can control the other ui interface and signal source control device through the cascade server 1110, thereby indirectly controlling an object controlled by the other ui interface and signal source control device.

According to some embodiments of the present invention, fig. 2c may also include a cascading server 1114 that is networked to connect a plurality of screen overlay fusion display devices to cascade the respective screen overlay fusion display devices, for example, as a server to store information of the plurality of screen overlay fusion display devices and to coordinate inter-invocation, access and control between the plurality of screen overlay fusion display devices. In addition, referring to the foregoing description, since one ui interface and signal source control device can control the other ui interface and signal source control device through the cascade server 1110, the control of the object controlled by the other ui interface and signal source control device and the control of the corresponding display result are indirectly achieved. Thus, the cascade server 1114 may also be omitted in this case.

According to some embodiments of the present invention, (the functionality of) the above tandem servers 1110 and 1114 may be integrated into a control network switch and a video network switch, respectively.

According to some embodiments of the present invention, (the functions of) the above cascade servers 1110 and 1114 may also be integrated into the ui interface and signal source control device and the screen overlay fusion display device, respectively.

The above cascading server application is also applicable to other embodiments, for example, it can be used in fig. 2b and fig. 3 below, and is not described again.

FIG. 3 illustrates a signal source dispatch and control system schematic according to some embodiments of the inventions.

The signal source calling and controlling system comprises a multi-network security using device 300, a control network switch 33, a video network switch 35, unidirectional control equipment (361, 362; 371, 372), video coding equipment (363, 364; 373, 374) and a unidirectional transmission device connected between a signal source (signal source 1, signal source 2; signal source n, signal source m) and the video coding equipment (363, 364; 373, 374). According to some embodiments of the invention, the ui interface and signal source control means 32 may further comprise an input generating means 31.

The multi-network security device 300 includes: ui interface and signal source control device 32, unidirectional transmission device 34, unidirectional video transmission device 341 (such as unidirectional hdmi video line or vga video line), and frame overlay fusion device 38.

The ui interface and signal source control device receives and analyzes user input (such as login account number), determines the ui interface 325 corresponding to the operation and an operation object (signal source 1), draws the ui interface according to ui data related to the ui interface 325, sends the ui interface to the image superposition and fusion device 38 through the one-way video transmission device 341, and outputs the ui interface to the screen 301 through the image superposition and fusion device 38, so that the user can see the ui interface 325 to be operated on the screen. The user may then refer to the interface 305 on the screen 301 for further operations.

The ui interface and signal source control device 32 may receive and analyze further inputs from the user, and determine a control command for controlling the ui interface 325 and a control command for controlling the signal source 1 corresponding to the inputs according to a pre-stored correspondence between the inputs and the control commands; and controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to the ui interface response result, and outputting the drawn ui interface to the picture superposition and fusion device 38 through the one-way video transmission device. The ui interface and signal source control device 32 also determines real-time ui data from the original ui data and the control command for controlling the ui interface, and outputs the ui data to the screen superimposition and fusion device 38 via the unidirectional transmission device 34. The ui interface and signal source control device 32 further sends a control command for controlling the signal source 1 to the corresponding unidirectional control device 361 through the control network switch 33, the unidirectional control device 361 controls the signal source 1 to respond according to the control command for controlling the signal source 1, and a response result is output to the video encoding device 363 through a unidirectional transmission device; the video encoding device 363 is configured to encode the signal source response result into a network stream signal, transmit the network stream signal to the video network switch, and further transmit the network stream signal to the image overlaying and fusing device through the video network switch.

The image superposition and fusion device 38 is configured to receive the ui interface, receive the ui data, determine signal source display window information and mouse position information therein, receive a signal source response result, perform fusion, and output a fusion result to the corresponding screen 301, where the fusion includes displaying the signal source response result in the signal source display window on the ui interface and giving a mouse instruction at a corresponding position according to the mouse position information.

According to some embodiments of the present invention, as described above, the screen may also be formed by splicing a plurality of screens, and if the ui interface and signal source control device receives and analyzes the input login account number, and then determines that the operation corresponds to the ui interface 325 and corresponds to one of the screen and the signal source 1, the ui interface and signal source control device sends the screen id, the mouse position information and the signal source display position information together to the image overlaying and fusing device, so that the image overlaying and fusing device outputs the final image to the target screen.

According to some embodiments of the present invention, the control network switch 33, the video network switch 35, the unidirectional control device (361, 362; 371, 372), the video coding device (363, 364; 373, 374), and the unidirectional transmission device connecting the signal source (signal source 1, signal source 2; signal source n, signal source m) and the video coding device (363, 364; 373, 374) may all be integrated into the multi-network security device 300.

According to some embodiments of the present invention, the ui interface and signal source control device 32 may include an event collecting unit 321, a ui interface drawing and event responding unit 322, a layout data distributing unit 323, a ui interface video output unit 320, and a control data processing and distributing unit 324.

The event acquisition unit 321 receives an input signal input to the input generation apparatus and transmits the signal to the ui interface drawing and event response unit 322.

The ui interface drawing and event responding unit 322 receives and analyzes the user input sent from the event collecting unit 321, determines a control command for controlling the ui interface and a control command for controlling the signal source, controls the ui interface to respond and draw the ui interface according to the control command for controlling the ui interface, and sends the control command for controlling the signal source to the control data processing and distributing unit 324. According to some embodiments of the invention, the ui interface rendering and event response unit 322 may also analytically determine an initial ui interface corresponding to the input, for example, when there are multiple ui interfaces available for invocation.

And the step of drawing the ui interface comprises drawing an initial ui interface and also drawing the ui interface which responds in real time according to the control command. The ui interface drawing and event response unit 322 also sends the drawn ui interface to the ui interface video output unit 320, from which it is sent to the screen superimposition and fusion device 38 via the unidirectional video transmission device 341, and the screen superimposition and fusion device 38 outputs the ui interface to the screen. As shown in fig. 4, the ui interface rendering and event response unit 322 renders an initial ui interface, analyzes a mouse drag action of the user (e.g., changes a signal source display window in the ui interface from a solid line frame a to a position of a dashed line frame b of the drawing accordingly), and renders the rendering accordingly, and sends the rendering result to the ui decoding video output unit 320, which sends the rendering result to the picture overlay fusion device 38, which presents the real-time ui interface on the screen.

The ui interface drawing and event response unit 322 analyzes and determines that the control command for controlling the signal source may include, for example, a control command for playing, pausing, and turning off the signal source, or a control command for inputting text in a window corresponding to the signal source, and the like. The control data processing and distributing unit 324 receives the control command for controlling the signal source, sends the control command to the control network switch 33, the control network switch 33 sends the data to the unidirectional control device, and the unidirectional control device controls the signal source 1 to perform the corresponding action, as described above. The control data processing and distributing unit can also perform encoding and encryption processing on the data format before distribution of the control command in addition to receiving and distributing the control command, so as to be suitable for further transmission and information confidentiality.

The ui interface drawing and event responding unit 322 also determines the signal source display window information and the mouse position information in the ui interface, and sends the signal source display window information and the mouse position information to the layout data distributing unit 323, which sends the data to the picture overlaying and fusing device 38 through the unidirectional transmission device 34, so that the picture overlaying and fusing device 38 outputs the video content of the relevant signal source to the signal source display window, and performs mouse pointing at the corresponding position. When the signal source display window is dragged and amplified by a user, the position of the signal source display window and the position of a mouse are changed, a ui interface drawing and event response unit 322 sends the changed ui data to a layout data distribution unit 323, the layout data distribution unit sends the data to a picture superposition and fusion device 38 through a one-way transmission device 34, the picture superposition and fusion device 38 determines mouse position information and signal source display window information according to the ui data, the picture superposition and fusion device 38 outputs video content of a related signal source to the changed signal source display window, and mouse indication is carried out at a corresponding new position.

According to some other embodiments of the present invention, the various elements of the ui interface and source control device 32 may also be combined with each other or subdivided in different ways to achieve the overall functionality of the ui interface and source control device 32 as well. For example, some functions of the ui interface drawing and event response unit 322 may be distributed to the ui interface video output unit 320, the layout data distribution unit 323, and the control data processing and distribution unit 324.

According to some embodiments of the present invention, the frame overlay fusion device 38 may include: a ui interface video receiving unit 381 for receiving the ui interface output by the ui interface video output unit 320; a layout data receiving unit 382 configured to receive the ui data sent by the layout data distributing unit 323, and determine signal source display window information and mouse position information therein; a video decoding unit 382, configured to receive the signal source response result, including receiving a network stream signal corresponding to the signal source response result from the video network switch 35, and decode the network stream signal into video stream data; and the fusion unit 380 is configured to output the drawn ui interface, display a signal source response result in a corresponding signal source display window according to the signal source display window information, and perform mouse pointing in a final output picture according to the mouse position information. The output result will be displayed on the screen 301.

According to some other embodiments of the present invention, the units of the image overlay fusion device 38 can be combined with each other or subdivided in different ways to achieve the whole function of the image overlay fusion device 38.

Further, various details of the signal source acquisition and control processes described previously with respect to fig. 1 and 2 may be applied herein, or may be suitably adapted to be applied herein. For the sake of simplicity, no further description is provided herein.

Fig. 5 illustrates a flow diagram of a signal source invocation and control method in accordance with some embodiments of the present invention. The method comprises the following steps:

s1, receiving and analyzing user input, determining a control command for controlling a ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface to a picture superposition and fusion device through a one-way video transmission device;

s2, determining ui data corresponding to the ui interface response result, and outputting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first one-way transmission path;

and S3, controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and enabling the signal source to output a signal source response result to the picture superposition and fusion device through the third unidirectional transmission path.

Still further, the method may further comprise: the image superposition and fusion device receives the ui interface, receives the ui data, determines signal source display window information and mouse position information in the ui data, performs fusion and outputs a fusion result to a corresponding screen; and the fusion comprises the steps of displaying a signal source response result in a signal source display window on the ui interface and giving a mouse indication at a corresponding position according to the mouse position information.

Fig. 6 illustrates a flow diagram of a signal source invocation and control method in accordance with still other embodiments of the invention. The method comprises the following steps:

s11, receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface to the picture superposition and fusion device through the one-way video transmission device;

s12, determining ui data corresponding to the ui interface response result, and outputting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first one-way transmission path;

s13, a control command for controlling the signal source is sent to the one-way control device through the control network switch, the one-way control device controls the signal source according to the control command, the signal source responds to the control of the one-way control device, a response result is sent to the video coding device through the one-way transmission device in a one-way mode, the video coding device codes video stream data into a network stream signal and sends video content in the form of the network stream signal to the picture superposition and fusion device through the video network switch.

Still further, the method may further comprise:

the image superposition and fusion device receives a ui interface, receives the ui data, determines signal source display window information and mouse position information in the ui data, receives video content in a network stream signal form of a signal source from a video network switch, decodes the video content into a video stream data signal source response result, performs fusion and outputs the fusion result to a corresponding display device, wherein the fusion comprises displaying the signal source response result in the signal source display window on the ui interface and giving a mouse indication at a corresponding position according to the mouse position information.

1-4 are also suitable for use herein, e.g., according to some embodiments of the present invention, the method may further include determining an initial ui interface corresponding to the input. For example, when a plurality of ui interfaces are available for calling, determining the ui interface to be operated according to the pre-stored corresponding relation between the input and the ui interface; and drawing the ui interface comprises drawing an initial ui interface and drawing the ui interface which responds in real time according to the control command. For the sake of simplicity, no further description is provided herein.

The application also provides a device for signal source calling and controlling. According to some embodiments of the invention, the apparatus comprises a memory, a processor, and a computer program stored in the memory, the processor implementing the following steps when executing the computer program:

receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting (outputting to a picture superposition and fusion device) the drawn ui interface through the one-way video transmission device;

outputting ui data through a first unidirectional transmission path (to a picture superposition and fusion device);

and controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and enabling the signal source to output a signal source response result to the image superposition and fusion device through the third unidirectional transmission path.

In addition, the signal source retrieving process or method involved in the signal source retrieving and controlling system described above with reference to fig. 1 to 4 is also applicable here, i.e. also within the scope of the present invention, and for the sake of simplicity, will not be described here again.

Fig. 7 shows an exemplary device for signal source invocation and control, which includes a processor 51, a memory 52, and a bus 53.

In some instances, the device may also include an input device 501, an input port 502, an output port 503, and an output device 504. The input port 502, the processor 51, the memory 52, and the output port 503 are connected to each other via the bus 53, and the input device 501 and the output device 504 are connected to the bus 53 via the input port 502 and the output port 503, respectively, and further connected to other components of the device scheduled by the multiple signal sources. It should be noted that the output interface and the input interface can also be represented by I/O interfaces. Specifically, the input device 501 receives input information from the outside and transmits the input information to the processor 51 through the input port 502; processor 51 processes the input information based on computer-executable instructions stored in memory 52 to generate output information, temporarily or permanently stores the output information in memory 52, and then transmits the output information to output device 504 via output port 503; the output device 503 outputs the output information to the outside of the device.

The memory 52 includes mass storage for data or instructions. By way of example, and not limitation, memory 52 may include an HDD, a floppy disk drive, flash memory, an optical disk, a magneto-optical disk, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Memory 52 may include removable or non-removable (or fixed) media, where appropriate. The memory 52 may be internal or external to the device, where appropriate. In a particular embodiment, the memory 52 is a non-volatile solid-state memory. In particular embodiments, memory 52 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.

The bus 53 comprises hardware, software, or both, coupling the components of the multi-signal source scheduling apparatus to each other. By way of example, and not limitation, the bus 53 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus, or a combination of two or more of these. Although specific buses have been described and shown in the embodiments of the invention, any suitable buses or interconnects are contemplated by the invention.

The processor 51 receives and analyzes user input based on a computer program stored in the memory 52, determines a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored correspondence between the input and the control commands, controls the ui interface to respond according to the control command for controlling the ui interface, draws the ui interface according to a ui interface response result, and outputs the drawn ui interface to the picture overlaying and fusing device through the one-way video transmission device; outputting ui data to the picture superposition and fusion device through a first one-way transmission path; and controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and enabling the signal source to output a signal source response result to the image superposition and fusion device through the third unidirectional transmission path.

In addition, the signal source retrieving process or method involved in the signal source retrieving and controlling system described above with reference to the drawings may also be incorporated herein as one of the execution steps of the processor, i.e., also within the scope of the present invention, and for the sake of simplicity, the detailed description is omitted here.

According to still other embodiments of the invention, the computer program may be divided into one or more units in various ways, stored in the memory, and executed by the processor to accomplish the invention. The one or more units may be a series of computer program instruction segments capable of performing certain functions, which are used to describe the execution of the computer program in the apparatus. The computer program may be divided into a plurality of units according to the functions of the respective units in the respective embodiments described above with reference to the respective drawings, or include the respective units in the respective embodiments described above with reference to fig. 3. For the sake of simplicity, this will not be repeated here.

The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is the control center for the device and that connects the various parts of the overall device using various interfaces and lines. The device may be a part of or a computing device such as a desktop computer, a notebook, a palm top, and a cloud server. The apparatus may include, but is not limited to, a processor and a memory. It will be understood by those skilled in the art that the schematic illustrations are merely examples of devices and do not constitute a limitation on the devices.

The corresponding detailed description made above with reference to the figures is hereby incorporated by reference and will not be repeated here.

The present application also proposes a computer-readable storage medium storing a computer program, characterized in that the computer program, when executed by a processor, implements the steps of:

receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface to the picture superposition and fusion device through the one-way video transmission device; outputting ui data to the picture superposition and fusion device through a first one-way transmission path; and controlling the signal source to respond through the second unidirectional transmission path according to the control command for controlling the signal source, and enabling the signal source to output a signal source response result to the image superposition and fusion device through the third unidirectional transmission path.

The computer program comprises computer program code which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.

Through the embodiment of the invention, the user can have experience and efficiency similar to the operation of a local computer when calling and controlling the signal source, and simultaneously, the safety of the interaction process is ensured, and the high-security information is prevented from flowing into the low-security interaction equipment caused by the interaction process, for example, the content of the high-security signal source is prevented from flowing to the ui interface and the signal source control device or flowing to the low-security interaction end where the input generating device is positioned.

Claims

1. The signal source calling and controlling method comprises the following steps:

2. The method according to claim 1, comprising outputting the ui data corresponding to the ui interface response result to the picture overlaying and fusing device by one of the following modes 1), 2), 3) and 4):

1) transmitting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through a first one-way transmission device which is one of the following a) -b):

a) a unidirectional optical fiber;

b) a unidirectional serial port line;

2) sequentially transmitting the ui data corresponding to the ui interface response result to a picture superposition and fusion device through a first network, a network light conversion device and a unidirectional optical fiber;

3) sequentially transmitting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first network, the first unidirectional transmission device and the second network which are one of c) to d) below:

c) a unidirectional optical fiber;

d) the combination of the network light conversion equipment, the unidirectional optical fiber and the optical network conversion equipment;

4) and transmitting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first unidirectional transmission device and the second network in one of the following e) -f) in sequence:

e) a unidirectional optical fiber;

3. The method of claim 2, responding to the control command for controlling the signal source via the second unidirectional transmission path, comprising one of the following 1), 2), 3), 4), 5):

1) responding by controlling the signal source by a second unidirectional transmission means of one of the following a) -d):

a) a unidirectional optical fiber;

b) a unidirectional serial port line;

2) responding by controlling the signal source via the first network and the second unidirectional transport means in one of the following e) -h) in sequence:

3) responding by controlling the signal source sequentially through the first network, the second unidirectional transmission device of one of the following i) -m) and a third network in which the signal source is located:

i) a unidirectional optical fiber;

m) a combination of network light conversion equipment, a unidirectional optical fiber, light conversion serial equipment, a unidirectional serial port line and serial-to-network equipment;

4) responding by a second unidirectional transmission device of one of the following n) -r) and a third network control signal source where the signal source is located in sequence:

n) a unidirectional optical fiber;

q) a combination of unidirectional serial port lines and serial-to-network equipment;

5) the signal source is controlled to respond by the unidirectional control device.

4. The method of claim 2, wherein responding by controlling the signal source via the second unidirectional transmission path comprises performing the following steps 1) to 3):

1) transmitting said control command for controlling the signal source to the control means via second unidirectional transmission means of one of the following a) -d), the signal source being controlled by the control means in response to:

a) a unidirectional optical fiber;

b) a unidirectional serial port line;

2) transmitting said control command for controlling the signal source to the control means, sequentially via the first network and via second unidirectional transmission means of one of the following e) -h), the signal source being controlled by the control means in response:

3) transmitting said control command for controlling the signal source to the control means via the first network, the control means responding by controlling the signal source via a second unidirectional transmission means of one of the following i) -l):

i) a unidirectional optical fiber;

j) a unidirectional serial port line;

5. The method according to claim 2, 3 or 4, comprising outputting the signal source response result to the picture overlay fusion apparatus through a third unidirectional transmission path by one of the following 1) and 2):

a) a unidirectional optical fiber;

b) a unidirectional video line;

2) causing a signal source to transmit a signal source response result to a video coding device through a third unidirectional transmission device of one of the following c) -d), coding the signal source response result into a network stream signal by the video coding device, and sending the network stream signal to the picture overlaying and fusing device through a second network, decoding the network stream signal into video stream data by the picture overlaying and fusing device, performing the fusion by using the video stream data as the signal source response result, and outputting the fusion result to a display device:

c) a unidirectional optical fiber;

d) a unidirectional video line.

6. The method of claim 5, wherein the first network and second network are isolated; the second network and a third network are isolated; the first network and the third network are isolated.

7. A signal source commissioning and control system comprising:

8. A signal source commissioning and control system comprising:

the ui interface and signal source control device is used for receiving and analyzing user input, determining a control command for controlling the ui interface and a control command for controlling a signal source according to a pre-stored corresponding relation between the input and the control command, controlling the ui interface to respond according to the control command for controlling the ui interface, drawing the ui interface according to a ui interface response result, and outputting the drawn ui interface through the unidirectional video transmission device; the ui interface and signal source control device is also used for determining ui data corresponding to the ui interface response result and outputting the ui data corresponding to the ui interface response result to the picture superposition and fusion device through the first one-way transmission device;

9. A signal source commissioning and control system comprising:

the image superposition and fusion device receives a ui interface, receives ui data corresponding to the ui interface response result, determines signal source display window information and mouse position information in the ui data, receives the network stream signal, decodes the network stream signal into video stream data, uses the video stream data as the signal source response result, performs fusion and outputs the fusion result to a display device; and the fusion comprises the steps of displaying a signal source response result in a signal source display window on the ui interface and giving a mouse indication at a corresponding position according to the mouse position information.

10. A system according to claim 7, 8 or 9, further comprising input generating means for generating the user input;

the input generating device comprises a transparent touch control device which is superposed on the display device; alternatively, the first and second electrodes may be,

the input generating device comprises an infrared light curtain type touch screen based on the display device.

11. The system of claim 9, further comprising a first cascading server and a plurality of ui interfaces and signal source control devices, the first cascading server network connecting the plurality of ui interfaces and signal source control devices to cascade the respective ui interfaces and signal source control devices; and/or the system further comprises a second cascade server and a plurality of image superposition fusion display devices, wherein the second cascade server is connected with the plurality of image superposition fusion display devices through a network so as to cascade each image superposition fusion display device.

12. The system of claim 11, the first cascading server is integrated into the control net switch, or into the ui interface and signal source control device; and/or the second cascade server is integrated into a video network switch or a picture superposition fusion display device.

13. An apparatus for signal source invocation and control, characterized in that the apparatus comprises a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the processor, when executing the computer program, implements the steps of:

14. A computer-readable storage medium storing a computer program, the computer program when executed by a processor implementing the steps of: