CN113448622A - Multi-signal-source interface interaction system - Google Patents
Multi-signal-source interface interaction system Download PDFInfo
- Publication number
- CN113448622A CN113448622A CN202110076668.4A CN202110076668A CN113448622A CN 113448622 A CN113448622 A CN 113448622A CN 202110076668 A CN202110076668 A CN 202110076668A CN 113448622 A CN113448622 A CN 113448622A
- Authority
- CN
- China
- Prior art keywords
- instruction
- control instruction
- signal source
- unidirectional
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims description 39
- 238000002955 isolation Methods 0.000 claims abstract description 33
- 230000002452 interceptive effect Effects 0.000 claims abstract description 32
- 230000004044 response Effects 0.000 claims abstract description 19
- 239000013307 optical fiber Substances 0.000 claims description 56
- 230000005540 biological transmission Effects 0.000 claims description 37
- 230000003287 optical effect Effects 0.000 claims description 37
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 230000008859 change Effects 0.000 claims description 6
- 238000000034 method Methods 0.000 abstract description 7
- 230000008569 process Effects 0.000 abstract description 4
- 230000009471 action Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000006698 induction Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/30094—Condition code generation, e.g. Carry, Zero flag
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
- G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/3017—Runtime instruction translation, e.g. macros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/38—Concurrent instruction execution, e.g. pipeline or look ahead
- G06F9/3836—Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/0002—Serial port, e.g. RS232C
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a multi-signal source interface interactive system, which comprises: the system comprises an interactive service and instruction acquisition device, a safety instruction service box, a safety interface isolation box, an image processing and display device and an instruction one-way isolation box; the interactive service and instruction acquisition equipment receives the first control instruction, judges and sends the first control instruction to a corresponding safety instruction service box; the safety command service box enables the first control command to be transmitted to a signal source to be controlled in a one-way mode; the safety interface isolation box is used for enabling the signal source response result to be transmitted to the image processing and displaying equipment in a one-way mode; the instruction unidirectional isolation box is used for receiving a second control instruction generated on the signal source and enabling the second control instruction to be transmitted to the image processing and display equipment in a unidirectional mode; and the image processing and display equipment controls the layout of each signal source on the display screen according to the second control instruction. The invention can realize the safe calling of the signal source in each network and the active control of the signal source to the interactive process.
Description
Technical Field
The invention relates to an interaction device and an interaction method, in particular to a system for interacting with a multi-signal-source interface.
Background
Because of the need of security, network environment isolation is needed among a plurality of subnets, most of the existing interaction technologies cannot perform secure interaction on a plurality of computers through a unified interaction terminal, even if some interaction technologies can solve the interaction control problem, the computers and the interaction terminal are uniformly exposed in the same network environment, the security is sacrificed, and meanwhile, the interacted computers are only limited to passive interaction and cannot participate in interaction, and the secure interaction on the interaction result cannot be realized.
Disclosure of Invention
In view of the above problems, a first aspect of the present invention provides a multi-signal-source interface interactive system, which includes:
the system comprises an interactive service and instruction acquisition device, a safety instruction service box, a safety interface isolation box, an image processing and display device and an instruction one-way isolation box;
the interactive service and instruction acquisition equipment is used for receiving a first control instruction, judging a safety instruction service box to which the first control instruction is sent, and sending the first control instruction to the safety instruction service box;
the safety instruction service box is used for receiving a first control instruction, enabling the first control instruction to be transmitted to a signal source to be controlled in a one-way mode, and enabling the signal source to respond according to the first control instruction;
the safety interface isolation box is used for enabling the signal source response result to be transmitted to the image processing and displaying equipment in a one-way mode;
the instruction unidirectional isolation box is used for receiving a second control instruction generated on the signal source and enabling the second control instruction to be transmitted to the image processing and display equipment in a unidirectional mode;
the image processing and display equipment is used for receiving the signal source response result and a second control instruction and controlling the layout of each signal source on the display screen according to the second control instruction.
According to some embodiments of the present invention, the interactive service and instruction acquisition device is connected to the image processing and display device, and is configured to acquire real-time layout information of each signal source on the display screen from the image processing and display device, determine, according to the real-time layout information, a signal source to be controlled by the first control instruction and a safety instruction service box corresponding to the signal source, and send the first control instruction to the safety instruction service box.
According to some embodiments of the present invention, the safety instruction service box includes an instruction distribution server, and one or more groups of first transmission links, where the first transmission links are composed of a first serial optical device, a unidirectional optical fiber, a first optical serial device, and a first unidirectional serial port line, which are sequentially connected to the instruction distribution server, and the number of the groups of the first transmission links is the same as the number of the signal sources; the instruction distribution server is used for converting the first control instruction in the form of the network signal into a first control instruction in the form of a serial port signal, and distributing the first control instruction in the form of the serial port signal to the corresponding first transmission link, so that the first control instruction is transmitted to the signal source to be controlled through the corresponding first transmission link.
According to some embodiments of the present invention, the instruction unidirectional isolation box comprises one or more groups of second transmission links consisting of a second unidirectional serial port line, a second serial-to-optical device, a second unidirectional optical fiber, a second optical-to-serial device, and a third unidirectional serial port line, which are sequentially connected to the signal source; the second transmission link is used for enabling the second control instruction to be transmitted to the image processing and display device in a unidirectional manner.
According to some embodiments of the invention, the security interface isolation box comprises one or more sets of third transmission links, each set of third transmission links is composed of a first video line, a viewing and light converting device, a third unidirectional optical fiber, a light converting device and a video line, and each set of third transmission links is used for enabling the signal source response result to be transmitted to the image processing and display device in a unidirectional mode.
According to some embodiments of the present invention, the safety instruction service box includes an instruction distribution server and a plurality of fourth unidirectional optical fibers, where the instruction distribution server is configured to distribute the first control instruction to the corresponding fourth unidirectional optical fibers, so that the first control instruction is transmitted to the signal source to be controlled in a unidirectional manner through the corresponding fourth unidirectional optical fibers;
the instruction unidirectional isolation box comprises a plurality of fifth unidirectional optical fibers, and each fifth unidirectional optical fiber is used for receiving a second control instruction generated on a corresponding signal source and enabling the second control instruction to be transmitted to the image processing and display equipment in a unidirectional mode through the corresponding fifth unidirectional optical fiber;
the safety interface isolation box comprises a plurality of sixth unidirectional optical fibers, and each sixth unidirectional optical fiber is used for receiving a corresponding signal source response result and transmitting the response result to the image processing and display equipment in a unidirectional mode through the corresponding sixth unidirectional optical fiber.
According to some embodiments of the present invention, the safety instruction service box includes an instruction distribution server and a plurality of seventh unidirectional optical fibers, and the instruction distribution server is configured to convert the first control instruction in the form of a network signal into the first control instruction in the form of an optical signal, and distribute the control instruction in the form of the optical signal to the corresponding seventh unidirectional optical fibers, so that the first control instruction is transmitted to the signal source to be controlled in a unidirectional manner through the corresponding seventh unidirectional optical fibers.
According to some embodiments of the invention, the system comprises a display device and a control instruction generating device, the display device is connected with the image processing and display device and is used for displaying the same content as the display screen; the control instruction generating equipment is used for generating the first control instruction and sending the first control instruction to the interactive service and instruction acquisition equipment;
the control instruction generating equipment is a transparent touch device which is superposed on the display equipment; or, the control instruction generating device comprises an infrared light curtain type touch screen based on the display device or the display screen.
According to some embodiments of the invention, the system further comprises one or more instruction output boxes; the instruction output box comprises a serial port and a USB port, and is used for converting the control instruction transmitted by the first transmission link into an HID standard equipment protocol and outputting the control instruction to a corresponding signal source through the USB port; the number of the instruction output boxes is the same as that of the signal sources.
According to some embodiments of the invention, the signal sources are respectively located in different subnets of a network isolation; the signal source includes: a web cam, a web sensing device, a web smart display and/or control device, a web computing device, a mobile device, or a combination thereof.
According to some embodiments of the invention, the image processing and display device analyzes a second control instruction sent by the signal source, and refuses any response to the second control instruction if the second control instruction is determined to be a non-layout control instruction.
According to some embodiments of the invention, the interactive service and instruction acquisition device is further configured to determine whether the first control instruction corresponds to a global operation instruction; if yes, the first control instruction is not forwarded to a safety instruction service box, and if not, the interactive service and instruction acquisition equipment executes corresponding operation according to the global operation instruction; the global operation instruction includes an instruction to control the image processing and display device to change a layout of the signal sources on the screen.
According to some embodiments of the present invention, the signal source includes a GIS map system, and the second control instruction includes a function of calling a hotspot camera on the map and displaying content shot by the hotspot camera on a display screen; the hot spot camera is connected with image processing and display equipment; the instruction unidirectional isolation box is used for receiving the second control instruction, enabling the second control instruction to be transmitted to the image processing and displaying device in a unidirectional mode, and controlling the image processing and displaying device to display the content shot by the hot spot camera on a display screen.
According to some embodiments of the present invention, the image processing and displaying device includes a splicing controller, and the interactive service and instruction acquisition device is connected to the splicing controller, and is configured to acquire real-time layout information of each signal source on the display screen from the splicing controller, and determine, according to the real-time layout information, a signal source to be operated by touch in combination with a touch position indicated in the control instruction.
By the embodiment of the invention, the safe calling of each signal source and the control of the signal source to the interaction process can be realized.
Drawings
FIG. 1 illustrates a schematic block diagram of a multi-signal source interface interaction system in accordance with some embodiments of the invention;
FIG. 2 illustrates a schematic diagram of a secure instruction service box according to some embodiments of the invention;
FIG. 3 illustrates a schematic diagram of a security interface isolation box, according to some embodiments of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention.
In the present application, the use of the connection lines such as the optical fiber and the serial port is related to, in order to match these connection lines, a conversion module may need to be used in a supporting manner, for example, when a signal is converted from a network to the optical fiber, a network light conversion module is needed, but in the case that the computer network port itself is an optical port, an additional network light conversion module may be omitted, since whether such a module is necessary or not may be determined according to an actual application scenario and is well known to those skilled in the art, for the sake of simplicity, the description is not given one by one, but the omission of the necessary conversion module is not indicated. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
FIG. 1 illustrates a schematic block diagram of a multi-signal source interface interaction system according to some embodiments of the inventions.
The connection line types corresponding to the figures are as follows: 1. a network cable; usb line; 3. a bi-directional serial port line; 4, a one-way serial port line; 5. a unidirectional optical fiber; 6. and (5) video lines.
The illustrated multi-signal-source interface interaction system includes an interaction service and instruction acquisition device 9, a switch 10, a security instruction service box 11, a security interface isolation box 15, an image processing and display device 16, and an instruction unidirectional isolation box 11'. According to some embodiments of the present invention, the apparatus may further include one or more of the command output box 12, the tiled screen 17, the display device 8', the control command generating device 8, and the wiring between the components. The display screen 17 may also be a non-tiled screen.
The control instruction generating device 8 may be, for example, an infrared frame touch input device, and may also be a capacitive touch device. The control instruction generating device may capture touch or other control actions by various methods such as electric induction, magnetic induction, thermal induction, and optical induction, or may generate other control instructions, such as a mouse and a keyboard. In addition, the control instructions may also be generated via a network approach. The control command generating device 8 can generate a gesture command, a keyboard, mouse control command, or a touch command. According to some embodiments of the present invention, the control instruction generating apparatus may be spatially superimposed on the display apparatus 8', and as will be further described below, the display apparatus 8' may provide a screen of a control object, and when the control instruction generating apparatus is a transparent touch device, by superimposing the touch device on the display apparatus, visual touch may be implemented on the control instruction generating apparatus by referring to the screen of the display apparatus 8' below the transparent touch device. The display device 8' and the control instruction generating device 8 are connected in the overall apparatus as shown in fig. 1.
The control instruction generating device can also be an infrared light curtain type touch screen based on the display device 8 'or the spliced screen 17, wherein an infrared light curtain is arranged on the surface of the display device 8' or the spliced screen 17. The infrared light curtain may be formed on the screen surface by an infrared laser or a laser array above the screen, and when the user acts on the display device 8' in which the infrared light curtain is arranged or the tiled screen 17 by a finger or the like, the touch input of the user in the screen is captured by the infrared camera. For example, when a touch is performed on the display device 8' or the tiled screen 17, the light distribution of the infrared light curtain at the touch point X will change due to the touch behavior, e.g., part of the infrared light at the touch point is diffusely reflected by the touch finger off the display device 8' or the tiled screen 17 and is captured by the infrared camera located in front of the display device 8' or the tiled screen 17; or part of the infrared light at the touch point is transmitted through the screen due to the action of the touch finger (for example, when the screen is a transflective DLP screen), and then is shot by the infrared camera positioned behind the screen. Touch control can be recognized by recognizing the position of the infrared contact in the shooting result.
The image processing and display device 16 is used for processing and outputting the input video signals, for example, after the signals are spliced with each other, or after the input signals are partially cut, the signals are displayed on a spliced screen in a certain layout. The layout comprises the window distribution size and position of each signal source on the screen. The image processing and display device 16 may be, for example, a stitching controller. The mosaic controller may also output the content output onto the mosaic screen to the display device 8' such that the content displayed thereon is the same as the content on the mosaic screen.
The interactive service and instruction acquisition device is used for receiving the control instruction from the control instruction generation device, reading real-time layout information on a screen from the image processing and display device, such as the splicing controller, judging a signal source to be operated by touch according to the layout information and the touch position indicated in the control instruction, determining an output port (or a transmission link) of a safety instruction service box corresponding to the signal source by reading the configuration file, and sending the determination results to the safety instruction service box. For example, the interactive service and instruction acquisition device reads a real-time layout from the splicing controller, determines distribution positions of each signal source on the screen, and can determine that a position to which touch is applied corresponds to the signal source 14 by analyzing touch information in the control instruction, and then the interactive service and instruction acquisition device sends the related control instruction to a safety instruction service box corresponding to the signal source 14, and the safety instruction service box further sends the control instruction to the signal source, so that the interactive service and instruction acquisition device responds to the control instruction. The signal source may convert the touch coordinates in the control command into coordinates of a signal source program space in response to the control command, for example, by converting the touch coordinates (touch coordinates on the control command generating device) into screen coordinates and converting the screen coordinates into coordinates of the signal source program space), and thereby correspondingly convert the control command into an operation in the signal source program space.
According to some embodiments of the present invention, the interactive service and instruction collection device may further determine whether the control instruction corresponds to a global operation instruction; and if the control command corresponds to the global operation command, the control command is not forwarded to a signal source or a safety command service box. The global operation instruction refers to an operation instruction which is not used for controlling each specific signal source, and the global operation instruction may include, for example, an instruction for controlling an image processing and display apparatus to change a layout of each signal source on a screen, the changing including: displaying the content of other signal sources on the screen (or called switching window) to which the current touch is applied; or, the content on the screen acted by the current touch is displayed on the whole combined spliced screen in a full screen mode (or called full screen display); or changing the size of a display window on the screen acted by the current touch; or changing the size of a display window of the display content of each signal source on the screen; or changing the position of the display window of the display content of each signal source on the screen; or pushing the content on the screen used by the current touch to other screens or screens; or switching various pre-stored layout manners, for example, a plurality of layout manners may be pre-stored, in each layout manner, the same or different signal sources (1 or more) are displayed on the screen according to a certain manner or layout, and when the touch action of the user corresponds to switching various pre-stored layout manners, the layout of the whole screen is switched every touch operation. According to some embodiments, some touches may be set to correspond to global operation instructions and other touches may be set to correspond to non-global operation instructions according to operation habits. For touches corresponding to non-global operational instructions, the corresponding touch information is sent to the corresponding signal source as described above. The touches corresponding to the global operation instruction may include, for example, O, M, C, touch gestures such as < >, or one or more fingers or a pointer sliding on the screen in some other manner, or directional touch actions (e.g., left, right, front left, front right, etc. touches corresponding to pushing a picture displayed on the screen in front of the eye to the screen on the left, the screen on the right, the screen in front of the left, the screen in front of the right, etc., respectively). The touch corresponding to the non-global operation instruction may include, for example, a double-click, a single-click, or the like touch action on the screen. According to some embodiments, some touch actions may also be introduced as boundaries for global or non-global operation instructions. For example, after one W is applied, all touches will correspond to global operation commands, and after one M is applied, all touches will correspond to non-global operation commands. For example, the interactive service and instruction acquisition device may receive the touch input gesture W, control the stitching controller to enter a screen layout adjustment mode (or called a display layout adjustment mode), and then control the stitching controller according to the movement direction and the movement distance of the gesture, so that the stitching controller responds to the instruction corresponding to the gesture to change the predetermined signal source layout mode or the size and/or position of the signal source display window. According to some embodiments, some touch actions may also be introduced as global operation instructions, and the global operation instructions are corresponding to boundaries of the global operation instructions and the non-global operation instructions. For example, after one W is applied, all touches will correspond to global operation commands, and after one M is applied, all touches will correspond to non-global operation commands. For example, the interactive service and instruction acquisition device may receive the touch input gesture W, control the stitching controller to enter a screen layout adjustment mode (or called a display layout adjustment mode), and then control the stitching controller according to the movement direction and the movement distance of the gesture, so that the stitching controller responds to the instruction corresponding to the gesture to change the predetermined signal source layout mode or the size and/or position of the signal source display window.
According to other embodiments of the present invention, the interactive service and instruction collecting device determines the signal source to be controlled by the control instruction and the output port of the corresponding safety instruction service box according to the information carried by the control instruction and related to the signal source to be controlled, for example, determines the signal source to be controlled and the output port of the corresponding safety instruction service box according to some fields in the control instruction. In addition, the interactive service and instruction acquisition equipment can also pre-store the corresponding relation between the control instruction and the signal source to be controlled, judge the signal source to be controlled by the control instruction and the output port of the corresponding safety instruction service box according to the corresponding relation, and then send the control instruction and the output port information of the corresponding safety instruction service box to the safety instruction service box; when signal sources of different networks need to be called, the interactive service and instruction acquisition equipment can send the control instruction and the output port information of the corresponding safety instruction service box to the safety instruction service box of the subnet where the signal source to be controlled is located. According to other embodiments of the present invention, the signal source to be controlled by the control command and the output port of the corresponding safety command service box (as described below) may also be determined by the safety command service box itself.
The safety instruction service box 11 comprises an instruction distribution server 21, a serial port optical transceiver transmitting end 22, a serial port optical transceiver receiving end 24, optical fibers connecting the serial port optical transceiver receiving end and the transmitting end, an optical fiber isolator 23 in the optical fibers, and a one-way serial port line connecting the transmitting end. In the present application, the optical fiber and the fiber isolator are collectively referred to as a unidirectional optical fiber for simplicity of description. The transmitting end and the receiving end of the serial optical transceiver can also be called serial optical equipment or optical serial equipment. The instruction distribution server 21 is configured to convert the control instruction in the form of the network signal into a control instruction in the form of a serial port, and output the control instruction along a corresponding serial port optical transceiver transmitting end, a corresponding unidirectional optical fiber, and a corresponding serial port optical transceiver receiving end, such as along the transmission link in line 1 of fig. 2 or along the transmission link in line 2. Two sets of transmission links are shown in the figure, and the transmission links of the corresponding sets can be configured according to the number of actual signal sources. Under the condition that the network end connection line is an optical fiber, the safety instruction service box 11 may include an instruction distribution server 21 and a plurality of unidirectional optical fibers, where the instruction distribution server 21 is configured to distribute the control instruction to the corresponding unidirectional optical fibers, so that the control instruction is transmitted to the signal source to be controlled in a unidirectional manner through the corresponding unidirectional optical fibers, that is, at this time, it is not necessary to convert the network signal into an optical signal separately. According to some embodiments of the present invention, in a case that the network end is connected by a cable, the instruction distribution server is configured to convert the control instruction in the form of the network signal into the control instruction in the form of the optical signal, and distribute the control instruction in the form of the optical signal to the corresponding unidirectional optical fiber, so that the control instruction is transmitted to the signal source to be controlled in a unidirectional manner through the corresponding unidirectional optical fiber.
According to some embodiments of the present invention, after the safety instruction service box 11 obtains the control instruction, the instruction distribution server determines the signal source to be controlled by the control instruction, and may determine which output port of the safety instruction service box the control instruction is to be sent to by reading the configuration file. The configuration file defines the correspondence of each signal source (ID) to an output port (or transmission link). According to some embodiments of the invention, the functionality of the instruction distribution server may also be integrated into the interaction service and instruction collection device 9.
The safety interface isolation box 15 includes a video optical transceiver transmitting end 31, a video optical transceiver receiving end 32, optical fibers connecting the video optical transceiver receiving end and the video optical transceiver transmitting end, an optical fiber isolator 33 in the optical fibers, and a video cable connecting the video optical transceiver transmitting end, and is used for implementing unidirectional transmission in the x direction shown in the figure, as shown in fig. 3. The transmitting end and the receiving end of the video optical transceiver may also be called an electrical-to-optical device or an optical-to-electrical device, or a visual-to-optical device or an optical-to-visual device according to the difference of the converted objects. Two sets of transmission links are shown in the figure, and the transmission links of the corresponding sets can be configured according to the number of actual signal sources. Each transmission link comprises a video optical transceiver transmitting end, a video optical transceiver receiving end, optical fibers connecting the video optical transceiver receiving end and the video optical transceiver transmitting end, and an optical fiber isolator in the optical fibers.
The instruction unidirectional isolation box 11' comprises a unidirectional serial port line connected with a signal source, a serial light conversion device 18, a unidirectional optical fiber, a light conversion serial device 19 and a unidirectional serial port line connected with an image processing and display device. The instruction unidirectional isolation box is used for receiving the control instruction generated on the signal source and enabling the control instruction to be transmitted to the image processing and display equipment in a unidirectional mode.
The following further describes a security interface interaction process or method of the multi-signal source interface interaction system.
As shown in fig. 1, the control instruction generating device 8 transmits a control instruction to the interactive service and instruction collecting device 9 through a usb cable (or other transmission device).
The interactive service and instruction acquisition device 9 receives the control instruction and judges the control object of the control instruction: when the control instruction is directed to the image processing and display device, the interactive service and instruction acquisition device 9 may directly control the illustrated image processing and display device 16 according to the control instruction, for example, to make the image processing and display device control the layout manner of the output image on the mosaic screen according to the control instruction. When the control command is directed to a signal source, the interactive service and command acquisition device 9 sends the control command to the safety command service box 11 through a network (such as a switch 10 in the figure).
The instruction distribution server 21 in the safety instruction service box 11 receives the control instruction, converts the control instruction in the form of network signal into a control instruction in the form of serial port signal, and transmits the control instruction to the serial port optical transceiver transmitting terminal 22, the unidirectional optical fiber, and the serial port optical transceiver receiving terminal 24, and directly transmits the control instruction to the signal source (13, 14) to be controlled through the unidirectional serial port line 4 (without involving the instruction output box 12 shown by the dotted line in the figure), so that the signal source responds and outputs the response result through the video line.
The safety interface isolation box 15 receives the video response result, and outputs the video response result to the image processing and display device 16 in a unidirectional manner through the video optical transmitter and receiver, the unidirectional optical fiber, the video optical transmitter and receiver, and the video cable.
The image processing and display device 16 receives the video response result and outputs it to the tiled screen 17 and/or the display device 8'.
The image processing and display device 16 also monitors control instructions from a signal source (e.g., signal source 14): when a user operates directly on the signal source to input control instructions related to controlling the layout of the signal source or other signal sources on the tiled screen, the control instructions will be transmitted unidirectionally to the image processing and display device 16 by instructing the unidirectional isolation box (i.e., unidirectional serial port line, serial-to-optical device 18, unidirectional optical fiber, optical serial-to-serial device 19, and unidirectional serial port line), and the layout of the signal source or other signal sources on the tiled screen is controlled by the image processing and display device 16. And if the image processing and display equipment analyzes the control instruction sent by the signal source and determines that the control instruction is a non-layout control instruction, refusing to respond to the control instruction. In the present application, the non-layout control instruction refers to a control instruction that is not used for controlling the layout of the signal sources on the screen.
According to some embodiments of the present invention, the apparatus may further include an instruction output box 12, which has a serial port and a USB port, and is configured to analyze an input control instruction (such as a control mouse, a keyboard, and a multi-touch instruction) in the form of a serial port, and finally form an HID standard device protocol, so as to implement multi-touch, mouse, and keyboard control on the signal source. The functionality of this portion may also be integrated into the secure command service box 11 according to some embodiments of the invention.
According to some embodiments of the invention, the signal source may comprise: a web cam, a web sensing device, a web smart display and/or control device, a web computing device, a mobile device, or a combination thereof.
According to some embodiments of the present invention, the signal sources may be respectively located in different subnets, and each subnet is isolated from each other by a network, and at this time, according to some embodiments of the present invention, the interactive service and instruction acquisition device may transmit the control instruction and the output port information of the corresponding safety instruction service box to the safety instruction service box of the subnet where the signal source to be controlled is located.
According to some embodiments of the invention, the response of the signal source to be controlled to the control instruction may comprise, for example: opening a file, closing a file, receiving text input and the like. And then, the opened folder interface in the signal source to be controlled is directly output to the safety interface isolation box through a video line connected with the folder interface. According to some embodiments of the present invention, other unidirectional transmission devices may be used to replace the above-mentioned unidirectional optical fiber devices according to actual needs.
According to some embodiments of the invention, the signal source may include a GIS map system, and the user's operation of the GIS map system includes retrieving a hotspot camera on the map and displaying the camera content on the tiled screen. The splicing controller receives a control command transmitted along the graphic path from the signal source, and outputs and displays the monitoring content of the camera as an input signal on a screen. Alternatively, according to some embodiments of the present invention, the stitching controller displays the monitoring content of the camera as an input signal on the screen along the layout prompted by the control instruction (if the control instruction contains this layout information). And when the splicing processor receives the control instruction sent by the signal source and analyzes and determines that the control instruction is a non-layout control instruction, refusing to respond to the control instruction.
According to some embodiments of the present invention, encryption measures may be introduced in each of the above links to further ensure the security of the interaction process. According to some embodiments of the present invention, the encrypting may be encrypting the control command for controlling the signal source before sending the control command, or encrypting the control command on the unidirectional transmission path, or introducing encryption software in some hardware (such as a network switching device) on the unidirectional transmission path to encrypt the control command. Accordingly, the signal source that receives the control command decrypts the control command and responds thereto, or a decryption device may be introduced in the vicinity of the signal source to decrypt it.
Claims (14)
1. A multi-signal-source interface interactive system, comprising:
the system comprises an interactive service and instruction acquisition device, a safety instruction service box, a safety interface isolation box, an image processing and display device and an instruction one-way isolation box;
the interactive service and instruction acquisition equipment is used for receiving a first control instruction, judging a safety instruction service box to which the first control instruction is sent, and sending the first control instruction to the safety instruction service box;
the safety instruction service box is used for receiving a first control instruction, enabling the first control instruction to be transmitted to a signal source to be controlled in a one-way mode, and enabling the signal source to respond according to the first control instruction;
the safety interface isolation box is used for enabling the signal source response result to be transmitted to the image processing and displaying equipment in a one-way mode;
the instruction unidirectional isolation box is used for receiving a second control instruction generated on the signal source and enabling the second control instruction to be transmitted to the image processing and display equipment in a unidirectional mode;
the image processing and display equipment is used for receiving the signal source response result and a second control instruction and controlling the layout of each signal source on the display screen according to the second control instruction.
2. The multi-signal-source interface interaction system according to claim 1, wherein the interaction service and instruction acquisition device is connected to the image processing and display device, and is configured to acquire real-time layout information of each signal source on the display screen from the image processing and display device, determine, according to the real-time layout information, a signal source to be controlled by the first control instruction and a safety instruction service box corresponding to the signal source, and send the first control instruction to the safety instruction service box.
3. The multi-signal-source interface interaction system of claim 2, wherein the secure command service box comprises a command distribution server, and one or more sets of first transmission links, wherein the first transmission links are composed of a first serial-to-optical device, a unidirectional optical fiber, a first optical serial-to-serial device, and a first unidirectional serial-to-port line, which are sequentially connected to the command distribution server, and the number of the sets of the first transmission links is the same as the number of the signal sources; the instruction distribution server is used for converting the first control instruction in the form of the network signal into a first control instruction in the form of a serial port signal, and distributing the first control instruction in the form of the serial port signal to the corresponding first transmission link, so that the first control instruction is transmitted to the signal source to be controlled through the corresponding first transmission link.
4. The multi-signal-source interface interaction device of claim 2, wherein the command unidirectional isolation box comprises one or more sets of second transmission links, and the second transmission links are composed of a second unidirectional serial line, a second serial-to-optical apparatus, a second unidirectional optical fiber, a second optical serial-to-serial apparatus, and a third unidirectional serial line, which are sequentially connected to the signal source; the second transmission link is used for enabling the second control instruction to be transmitted to the image processing and display device in a unidirectional manner.
5. The multi-signal-source interface interaction device according to claim 2, wherein the security interface isolation box comprises one or more sets of third transmission links, each set of third transmission links is composed of the first video line, the viewing and light conversion device, the third unidirectional optical fiber, the optical viewing device and the video line, and each set of third transmission links is used for enabling the signal source response result to be transmitted to the image processing and display device in a unidirectional manner.
6. The multi-signal-source interface interaction system of claim 2, wherein the safety instruction service box comprises an instruction distribution server and a plurality of fourth unidirectional optical fibers, and the instruction distribution server is configured to distribute the first control instruction to the corresponding fourth unidirectional optical fibers, so that the first control instruction is transmitted to the signal source to be controlled in a unidirectional manner through the corresponding fourth unidirectional optical fibers;
the instruction unidirectional isolation box comprises a plurality of fifth unidirectional optical fibers, and each fifth unidirectional optical fiber is used for receiving a second control instruction generated on a corresponding signal source and enabling the second control instruction to be transmitted to the image processing and display equipment in a unidirectional mode through the corresponding fifth unidirectional optical fiber;
the safety interface isolation box comprises a plurality of sixth unidirectional optical fibers, and each sixth unidirectional optical fiber is used for receiving a corresponding signal source response result and transmitting the response result to the image processing and display equipment in a unidirectional mode through the corresponding sixth unidirectional optical fiber.
7. The multi-signal-source interface interaction system of claim 2, wherein the safety command service box comprises a command distribution server and a plurality of seventh unidirectional optical fibers, and the command distribution server is configured to convert the first control command in the form of a network signal into the first control command in the form of an optical signal and distribute the control command in the form of the optical signal to the corresponding seventh unidirectional optical fibers, so that the first control command is transmitted to the signal source to be controlled in a unidirectional manner through the corresponding seventh unidirectional optical fibers.
8. The multi-signal source interface interaction system according to claim 2, wherein the system comprises a display device and a control instruction generation device, wherein the display device is connected with the image processing and display device and is used for displaying the same content as the display screen; the control instruction generating equipment is used for generating the first control instruction and sending the first control instruction to the interactive service and instruction acquisition equipment;
the control instruction generating equipment is a transparent touch device which is superposed on the display equipment; or, the control instruction generating device comprises an infrared light curtain type touch screen based on the display device or the display screen.
9. The multiple-signal-source interface interaction system of claim 3, wherein the system further comprises one or more instruction output boxes; the instruction output box comprises a serial port and a USB port, and is used for converting the control instruction transmitted by the first transmission link into an HID standard equipment protocol and outputting the control instruction to a corresponding signal source through the USB port; the number of the instruction output boxes is the same as that of the signal sources.
10. The multi-signal source interface interaction system of claim 2, wherein the signal sources are respectively located in different subnets isolated from the network; the signal source includes: a web cam, a web sensing device, a web smart display and/or control device, a web computing device, a mobile device, or a combination thereof.
11. The multi-signal source interface interaction system of claim 2, wherein the image processing and display device analyzes a second control command sent by the signal source and rejects any response to the second control command if it is determined that the second control command is a non-layout control command.
12. The multi-signal source interface interaction system of claim 2, wherein the interaction service and instruction collection device is further configured to determine whether the first control instruction corresponds to a global operation instruction; if yes, the first control instruction is not forwarded to a safety instruction service box, and if not, the interactive service and instruction acquisition equipment executes corresponding operation according to the global operation instruction; the global operation instruction includes an instruction to control the image processing and display device to change a layout of the signal sources on the screen.
13. The multi-signal source interface interaction system of claim 2, wherein the signal source comprises a GIS map system, and the second control instruction comprises a function of calling a hotspot camera on the map and displaying content captured by the hotspot camera on a display screen; the hot spot camera is connected with image processing and display equipment; the instruction unidirectional isolation box is used for receiving the second control instruction, enabling the second control instruction to be transmitted to the image processing and displaying device in a unidirectional mode, and controlling the image processing and displaying device to display the content shot by the hot spot camera on a display screen.
14. The multi-signal-source interface interaction system of claim 2, wherein the image processing and display device comprises a stitching controller, and the interaction service and instruction acquisition device is connected to the stitching controller, and configured to acquire real-time layout information of each signal source on the display screen from the stitching controller, and determine, according to the real-time layout information, the signal source to be operated by touch in combination with the touch position indicated in the control instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110076668.4A CN113448622B (en) | 2021-01-20 | 2021-01-20 | Multi-signal-source interface interaction system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110076668.4A CN113448622B (en) | 2021-01-20 | 2021-01-20 | Multi-signal-source interface interaction system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113448622A true CN113448622A (en) | 2021-09-28 |
| CN113448622B CN113448622B (en) | 2022-05-06 |
Family
ID=77808789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110076668.4A Active CN113448622B (en) | 2021-01-20 | 2021-01-20 | Multi-signal-source interface interaction system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113448622B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114389764A (en) * | 2022-01-24 | 2022-04-22 | 北京仁光科技有限公司 | Method for remotely interacting multiple signal sources based on multiple double-link devices |
| CN114579996A (en) * | 2022-03-04 | 2022-06-03 | 北京仁光科技有限公司 | Mobile disk data interaction system and method |
| CN114625417A (en) * | 2022-01-07 | 2022-06-14 | 北京仁光科技有限公司 | Multi-signal-source interface safety interaction device |
| CN114726904A (en) * | 2022-01-24 | 2022-07-08 | 北京仁光科技有限公司 | System and method for remote secure interaction of signal sources |
| CN115297362A (en) * | 2022-08-03 | 2022-11-04 | 北京仁光科技有限公司 | Signal source parallel interaction system based on network |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102239674A (en) * | 2008-08-19 | 2011-11-09 | 高赛科实验室公司 | Isolated multi-network computer system and apparatus |
| CN102929903A (en) * | 2012-07-04 | 2013-02-13 | 北京中盾安全技术开发公司 | Rapid video retrieval method based on layered structuralized description of video information |
| CN105611388A (en) * | 2015-12-29 | 2016-05-25 | 康佳集团股份有限公司 | Multi-image preview realization method and system |
| CN105611246A (en) * | 2015-12-23 | 2016-05-25 | 广东中星电子有限公司 | Information display method and video monitoring platform |
| CN109451281A (en) * | 2018-12-20 | 2019-03-08 | 西南大学 | A kind of video monitoring system of high confidentiality |
| CN109582182A (en) * | 2017-10-20 | 2019-04-05 | 北京仁光科技有限公司 | Multi signal window touch control method, equipment, system and computer readable storage medium |
| CN110134358A (en) * | 2019-05-27 | 2019-08-16 | 中天智领（北京）科技有限公司 | A kind of multi-screen control method and device |
| CN110362259A (en) * | 2018-04-10 | 2019-10-22 | 北京仁光科技有限公司 | Command dispatching system, method, equipment and computer readable storage medium |
| CN110515574A (en) * | 2018-05-21 | 2019-11-29 | 北京仁光科技有限公司 | Device, method and system for being interacted at least one computer |
| CN110519205A (en) * | 2018-05-21 | 2019-11-29 | 北京仁光科技有限公司 | Device and method for being interacted to the computer at least two subnets |
| CN110618780A (en) * | 2018-06-20 | 2019-12-27 | 北京仁光科技有限公司 | Interaction device and interaction method for interacting multiple signal sources |
| CN110851063A (en) * | 2019-09-18 | 2020-02-28 | 丁建华 | Method for carrying out safe fusion interaction on multi-network and multi-system application interface |
| CN110933291A (en) * | 2019-06-06 | 2020-03-27 | 北京仁光科技有限公司 | Cross-network interaction system and cross-network interaction method |
| CN111050125A (en) * | 2019-11-21 | 2020-04-21 | 北京仁光科技有限公司 | Photoelectric return partition interaction system for interacting signal sources in each subnet |
| CN111263127A (en) * | 2020-02-19 | 2020-06-09 | 北京仁光科技有限公司 | Signal source calling and controlling method and system |
| CN111435983A (en) * | 2019-11-21 | 2020-07-21 | 北京仁光科技有限公司 | Photoelectric return partition interaction system for interacting signal sources in each subnet |
| CN111901688A (en) * | 2020-09-03 | 2020-11-06 | 北京金数信数码科技有限公司 | Unidirectional security data transmission structure and method for internal and external network isolation |
-
2021
- 2021-01-20 CN CN202110076668.4A patent/CN113448622B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102239674A (en) * | 2008-08-19 | 2011-11-09 | 高赛科实验室公司 | Isolated multi-network computer system and apparatus |
| CN102929903A (en) * | 2012-07-04 | 2013-02-13 | 北京中盾安全技术开发公司 | Rapid video retrieval method based on layered structuralized description of video information |
| CN105611246A (en) * | 2015-12-23 | 2016-05-25 | 广东中星电子有限公司 | Information display method and video monitoring platform |
| CN105611388A (en) * | 2015-12-29 | 2016-05-25 | 康佳集团股份有限公司 | Multi-image preview realization method and system |
| CN109582182A (en) * | 2017-10-20 | 2019-04-05 | 北京仁光科技有限公司 | Multi signal window touch control method, equipment, system and computer readable storage medium |
| CN110362259A (en) * | 2018-04-10 | 2019-10-22 | 北京仁光科技有限公司 | Command dispatching system, method, equipment and computer readable storage medium |
| CN110519205A (en) * | 2018-05-21 | 2019-11-29 | 北京仁光科技有限公司 | Device and method for being interacted to the computer at least two subnets |
| CN110515574A (en) * | 2018-05-21 | 2019-11-29 | 北京仁光科技有限公司 | Device, method and system for being interacted at least one computer |
| CN110618780A (en) * | 2018-06-20 | 2019-12-27 | 北京仁光科技有限公司 | Interaction device and interaction method for interacting multiple signal sources |
| CN109451281A (en) * | 2018-12-20 | 2019-03-08 | 西南大学 | A kind of video monitoring system of high confidentiality |
| CN110134358A (en) * | 2019-05-27 | 2019-08-16 | 中天智领（北京）科技有限公司 | A kind of multi-screen control method and device |
| CN110933291A (en) * | 2019-06-06 | 2020-03-27 | 北京仁光科技有限公司 | Cross-network interaction system and cross-network interaction method |
| CN110851063A (en) * | 2019-09-18 | 2020-02-28 | 丁建华 | Method for carrying out safe fusion interaction on multi-network and multi-system application interface |
| CN111050125A (en) * | 2019-11-21 | 2020-04-21 | 北京仁光科技有限公司 | Photoelectric return partition interaction system for interacting signal sources in each subnet |
| CN111435983A (en) * | 2019-11-21 | 2020-07-21 | 北京仁光科技有限公司 | Photoelectric return partition interaction system for interacting signal sources in each subnet |
| CN111263127A (en) * | 2020-02-19 | 2020-06-09 | 北京仁光科技有限公司 | Signal source calling and controlling method and system |
| CN111901688A (en) * | 2020-09-03 | 2020-11-06 | 北京金数信数码科技有限公司 | Unidirectional security data transmission structure and method for internal and external network isolation |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114625417A (en) * | 2022-01-07 | 2022-06-14 | 北京仁光科技有限公司 | Multi-signal-source interface safety interaction device |
| CN114625417B (en) * | 2022-01-07 | 2024-08-02 | 北京仁光科技有限公司 | Multi-signal source interface safety interaction device |
| CN114389764A (en) * | 2022-01-24 | 2022-04-22 | 北京仁光科技有限公司 | Method for remotely interacting multiple signal sources based on multiple double-link devices |
| CN114726904A (en) * | 2022-01-24 | 2022-07-08 | 北京仁光科技有限公司 | System and method for remote secure interaction of signal sources |
| CN114726904B (en) * | 2022-01-24 | 2024-06-25 | 北京仁光科技有限公司 | System and method for remote secure interaction of signal sources |
| CN114579996A (en) * | 2022-03-04 | 2022-06-03 | 北京仁光科技有限公司 | Mobile disk data interaction system and method |
| CN114579996B (en) * | 2022-03-04 | 2022-08-30 | 北京仁光科技有限公司 | Mobile disk data interaction system and method |
| CN115297362A (en) * | 2022-08-03 | 2022-11-04 | 北京仁光科技有限公司 | Signal source parallel interaction system based on network |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113448622B (en) | 2022-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113448622B (en) | Multi-signal-source interface interaction system | |
| US10552518B2 (en) | Administration of web page | |
| CN204795335U (en) | KVM matrix system | |
| US20120229509A1 (en) | System and method for user interaction | |
| CN110618780A (en) | Interaction device and interaction method for interacting multiple signal sources | |
| US20160246365A1 (en) | Interfacing via heads-up display using eye contact | |
| WO2020190082A1 (en) | Method for providing navigation service using mobile terminal, and mobile terminal | |
| CN110851063A (en) | Method for carrying out safe fusion interaction on multi-network and multi-system application interface | |
| KR20140080726A (en) | Apparatus and Method for Remote Control using Dynamic Script | |
| CN112527170A (en) | Equipment visualization control method and device and computer readable storage medium | |
| CN213934850U9 (en) | Multi-signal source interface interaction device | |
| CN114727032A (en) | Signal source calling and controlling method and system | |
| KR20180052439A (en) | Set-top box | |
| TW201706825A (en) | Apparatus and method for integrating smart mobile device and touch device, and electronic device and display control method | |
| CN114727034A (en) | Signal source calling and controlling method and system | |
| CN114625417B (en) | Multi-signal source interface safety interaction device | |
| CN110515574B (en) | Apparatus, method and system for interacting with at least one computer | |
| CN114726838B (en) | System and method for remote secure interaction of multiple signal sources | |
| KR20090060698A (en) | Interface apparatus and its control method using by virtual multi touch screen | |
| CN114389764B (en) | Method and system for remotely interacting multiple signal sources based on multiple double-link devices | |
| CN114726904B (en) | System and method for remote secure interaction of signal sources | |
| KR100739774B1 (en) | Display apparatus and method thereof, and information processing apparatus and method thereof for providing PIP function | |
| CN114449182A (en) | Signal source calling and controlling method and system | |
| CN115167742A (en) | Barrage display method, device, equipment and storage medium | |
| CN115333810B (en) | Multi-network signal source interaction system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |