CN114371899A - Multi-signal-source interface interaction system - Google Patents

Multi-signal-source interface interaction system Download PDF

Info

Publication number
CN114371899A
CN114371899A CN202210018498.9A CN202210018498A CN114371899A CN 114371899 A CN114371899 A CN 114371899A CN 202210018498 A CN202210018498 A CN 202210018498A CN 114371899 A CN114371899 A CN 114371899A
Authority
CN
China
Prior art keywords
interface
signal source
interface processing
instruction
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210018498.9A
Other languages
Chinese (zh)
Other versions
CN114371899B (en
Inventor
谭登峰
其他发明人请求不公开姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zen Ai Technology Co ltd
Original Assignee
Beijing Zen Ai Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zen Ai Technology Co ltd filed Critical Beijing Zen Ai Technology Co ltd
Priority to CN202210018498.9A priority Critical patent/CN114371899B/en
Publication of CN114371899A publication Critical patent/CN114371899A/en
Application granted granted Critical
Publication of CN114371899B publication Critical patent/CN114371899B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/40Bus structure
    • G06F13/4063Device-to-bus coupling
    • G06F13/4068Electrical coupling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/42Bus transfer protocol, e.g. handshake; Synchronisation
    • G06F13/4282Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2213/00Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F2213/0042Universal serial bus [USB]

Abstract

The invention relates to a multi-signal-source interface interactive system, wherein a first interactive instruction generating device is used for generating an interactive instruction; the first interface processing equipment acquires the interactive instruction, determines a target signal source to be controlled by the interactive instruction according to the current signal source layout in the interface processing equipment and an interactive position indicated by the interactive instruction, transmits the interactive instruction to second interface processing equipment corresponding to the target signal source through a network, acquires the interactive instruction, transmits the interactive instruction to the target signal source, enables the target signal source to respond according to the interactive instruction, and receives a response result of the target signal source by the second interface processing equipment; and the first interface processing equipment acquires a response result through a network and draws the response result according to the current signal source layout. The invention can realize the content safe sharing and interaction among the signal sources without installing any program for each signal source.

Description

Multi-signal-source interface interaction system
Technical Field
The invention relates to an interactive device, in particular to a multi-signal-source interface interactive system.
Background
In the prior art, in order to interact with other signal sources, a corresponding program, such as teamview, needs to be installed on the corresponding signal source, so that the labor cost is relatively consumed, and viruses may be introduced in the installation process; furthermore, there is also a need to directly access the signal source to a given network, thereby adding additional network exposure risk (although the signal source may have been accessing other networks). Therefore, from installation to interaction, the whole process is labor-intensive, and many unsafe factors are easily introduced.
Disclosure of Invention
In order to solve the above problems, the present invention provides a multi-signal-source interface interactive system, which includes:
the system comprises first interaction instruction generating equipment, first interface processing equipment and first display equipment; and a second interface processing device;
the first interactive instruction generating device is used for generating an interactive instruction;
the first interface processing equipment is connected with the first interactive instruction generating equipment and is used for acquiring the interactive instruction, determining a target signal source to be controlled by the interactive instruction according to the current signal source layout in the interface processing equipment and the interactive position indicated by the interactive instruction, and transmitting the interactive instruction to second interface processing equipment corresponding to the target signal source through a network;
the second interface processing equipment acquires the interactive instruction and sends the interactive instruction to the target signal source through the instruction transmission line, so that the target signal source responds according to the interactive instruction, and the second interface processing equipment receives a response result of the target signal source through the video transmission line;
and the first interface processing equipment acquires the response result received by the second interface processing equipment from the target signal source through the network, draws the response result according to the current signal source layout and outputs the drawn result to the first display equipment.
According to some embodiments of the present invention, the video transmission line comprises an HDMI line, and the command transmission line comprises a usb line.
According to some embodiments of the invention, the system further comprises a server, and the first interface processing device and the second interface processing device establish a communication connection through the server.
According to some embodiments of the present invention, the first interface processing device transmits the interactive instruction to the second interface processing device corresponding to the target signal source through the server; and/or the first interface processing equipment acquires the response result received by the second interface processing equipment from the target signal source through the server.
According to some embodiments of the present invention, the target signal source includes a PC, and the main screen content and the auxiliary screen content of the target signal source are each output to the interface processing device through one HDMI line and identified as the main screen signal source and the auxiliary screen signal source as two independent signal sources; the auxiliary screen content is the expanded content of the main screen content or the copied content of the main screen content.
According to some embodiments of the present invention, a first interface processing device stores one or more signal source layouts in advance, and uploads a current signal source layout to a server, so that the server stores the signal source layout as being associated with an account, so that the signal source layout can be obtained by logging in the account on the first interface processing device, a second interface processing device, or other interface processing devices; and/or the first interface processing equipment is also used for pre-storing or generating a ui interface, fusing the ui interface and the target signal source content, then drawing, and outputting the drawing result to the first display equipment; and the first interface processing equipment uploads the current ui interface to the server, so that the server stores the signal source layout as being associated with an account number, and the ui interface can be acquired by logging in the account number on the first interface processing equipment and the second interface processing equipment.
According to some embodiments of the present invention, a server stores a plurality of signal source layouts in advance for a first interface processing device and a second interface processing device to obtain through a network; and/or the server stores the ui interface in advance, the first interface processing device and the second interface processing device acquire the ui interface from the server, the ui interface and the response result are fused and then drawn, and the drawing result is output to the first display device.
According to some embodiments of the present invention, the interactive instructions further include a layout adjustment instruction for adjusting a layout of the signal source and an interface operation instruction for operating the ui interface; and before the first interface processing equipment executes the interactive instruction, sending a corresponding execution request to a server, and executing the interactive instruction after the server authorizes the interactive instruction.
According to some embodiments of the present invention, the first interface processing device determines, according to the current signal source layout, the ui interface, and the interaction position indicated by the interaction instruction, a target signal source to be controlled by the interaction instruction or a control on the ui interface, and transmits the interaction instruction to the second interface processing device corresponding to the target signal source or the control on the ui interface through the server to respond according to the interaction instruction.
According to some embodiments of the invention, the interactive instruction generating device comprises a keyboard, a mouse or a touch screen; or the interactive instruction generating equipment is a transparent touch device which is superposed on the display equipment; or the interactive instruction generating device comprises an infrared curtain type touch screen based on the display device.
According to some embodiments of the invention, the system further comprises an additional display device, the first interface processing device being capable of selectively outputting content of one of the signal sources to the additional display device in response to a user operation; the signal source comprises a personal computer, a handheld or laptop computer, a tablet computer, a cellular telephone, a mobile device, an electronic device, a smart phone, a smart television, or a camera; the additional display device and/or the first display device comprises a tiled screen; the command transmission line comprises a unidirectional transmission line; the signal source is connected to another network; the first interface processing equipment is configured to be provided with a login interface, and when the server cannot be accessed, the login interface is skipped, and a local signal source control mode is entered, so that the interactive instruction generating equipment can directly control a signal source corresponding to the first interface processing equipment; the first interface processing equipment also comprises an instruction conversion module, wherein the instruction conversion module is used for converting the interactive instruction transmitted to the signal source into an HID standard equipment protocol and outputting the HID standard equipment protocol to the corresponding signal source through the USB port.
By the embodiment of the invention, the content can be safely shared and interacted among the signal sources without installing any program on each signal source.
Drawings
FIG. 1 illustrates a schematic block diagram of a multi-signal source interface interaction system according to some embodiments of the inventions.
FIG. 2 illustrates a schematic block diagram of a multi-signal source interface interaction system according to further embodiments of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
FIG. 1 illustrates a schematic block diagram of a multi-signal source interface interaction system according to some embodiments of the inventions.
The illustrated multi-signal-source interface interactive system includes an interactive instruction generating apparatus 10, an interface processing apparatus 13, a display apparatus 11, and an interface processing apparatus 13'. According to some embodiments of the present invention, the apparatus may further include the illustrated components and connection lines between the components, such as the illustrated USB line (1, 1', 1 ") and HDMI line (3, 3', 3"), e.g., the interactivity instruction generation equipment 10 ', the display equipment 11', the switch 17, the server 18. The display device 11 may be a tiled screen or a non-tiled screen.
The interactive instruction generating device 10 may be a touch screen for capturing touch control by various methods such as electric induction, magnetic induction, thermal induction, optical induction, or the like, or an interactive instruction generating device for controlling other actions such as a keyboard, a mouse, or the like. According to some embodiments of the present invention, the interactive instruction generating apparatus 10 may be a transparent touch device, the transparent touch device may be spatially superimposed on the display apparatus 11, the display apparatus 11 provides a picture of a control object, and by referring to the picture of the display apparatus 11 below the transparent touch device, a visual touch may be implemented on the interactive instruction generating apparatus.
The interactive instruction generating device may also be, for example, an infrared light curtain type touch screen based on the display device 11 or the tiled screen 12, where an infrared light curtain is arranged on the surface of the display device 11 or the tiled screen 12. The infrared light curtain may be formed on the surface of the screen by an infrared laser or a laser array above the screen, and when a user acts on the display device 11 or the tiled screen 12 on which the infrared light curtain is disposed by a finger or the like, a touch input of the user in the screen is captured by the infrared camera. For example, when a touch is performed on the display device 11 or the tiled screen 12, the light distribution of the infrared light curtain at the touch point X changes due to the touch behavior, e.g., part of the infrared light at the touch point is diffusely reflected off the screen by the touch finger and is captured by the infrared camera located in front of the screen; or part of the infrared light at the touch point is transmitted through the screen due to the action of the touch finger (for example, when the screen is a transflective DLP screen), and then is shot by the infrared camera positioned behind the screen. Touch control can be recognized by recognizing the position of the infrared contact in the shooting result.
The interface processing device 13 may store a plurality of signal source layouts in advance. The layout includes the window distribution size and position of each signal source on the display device.
The interface processing device 13 may receive the interactive instruction of the interactive instruction generating device 10 through the instruction transmission line 2 (e.g., usb line), and determine the signal source to be operated according to the pre-stored layout information and the interactive position (e.g., touch or mouse position) indicated in the interactive instruction. For example, the interface processing device 13 determines the distribution positions of the signal sources on the display device according to the layout, and determines that the position to which the touch is applied corresponds to the signal source 15' instead of the signal source 15 or 19 by analyzing the interaction position information in the interaction instruction. The interface processing device 13 sends the relevant interactive command to the interface processing device 13 'corresponding to the signal source 15' through a network, for example, the interactive command may be sent to the interface processing device 13 'corresponding to the signal source 15' through the illustrated switch 17, or the interactive command may be sent to the interface processing device 13 'corresponding to the signal source 15' through the illustrated server 18 and switch 17, or the interactive command may be sent through another form of network (e.g., a direct network connection). The correspondence relationship between each signal source and the interface processing device may be stored in the interface processing device 13 in advance, or in the case where the server 18 is present, may be stored in the server 18.
The interface processing device 13 'sends the interactive instructions to the signal source 15' to be responsive to the interactive instructions. The signal source 15' may convert coordinates in the interactive instructions to coordinates in the signal source program space in response to the interactive instructions. The signal source comprises a personal computer, a handheld or laptop computer, a tablet computer, a cellular telephone, a mobile device, an electronic device, a smart phone, a smart television, or a camera; the additional display device and/or the first display device comprises a tiled screen. The response of the signal source to the interaction instruction may include, for example: opening a file, closing a file, receiving text input and the like. The signal source response result can be directly outputted to the interface processing device 13' through a video line connected thereto.
According to some embodiments of the invention, the interface processing device 13 'may also determine to which output port the interactive command is to be sent by reading the configuration file after determining the signal source 15' to which the interactive command is to be controlled. The configuration file defines a correspondence of each signal source (ID) to an output port.
The interface processing apparatus 13 acquires the response result from the signal source 15 'received by the interface processing apparatus 13' via the network, and draws the response result according to the current signal source layout, and outputs the drawn result to the display apparatus 11. The result of the response from the signal source 15 'received by the interface processing apparatus 13' can be acquired by the illustrated switch 17, or the result of the response from the signal source 15 'received by the interface processing apparatus 13' can be acquired by the illustrated server 18 and switch 17, for example. According to some embodiments of the invention, the interface processing device 13 may comprise a plurality of output interfaces, each output interface being connected to one display device.
According to some embodiments of the present invention, the interface processing device 13 may be further configured to pre-store or generate the ui interface, blend the ui interface and the response result, perform drawing, and output the drawing result to the display device. The interface processing device 13 may also upload the current ui interface to the server, causing the server to store the signal source layout as being associated with an account number, so that the ui interface can be obtained by logging in the account number on the interface processing device 13 and the interface processing device 13'. Various controls may be included on the Ui interface. According to some embodiments of the present invention, the ui interface may be stored in advance by the server 18 for the interface processing device 13 (and 13') to acquire a specific or selected ui interface from the server, and to merge the ui interface and the response result into a drawing, and to output the drawing result to the display device 11. According to some embodiments of the present invention, the ui interface may also be stored in advance by the server 18 for the interface processing device 13 to acquire the ui interface from the server, to perform drawing after merging the ui interface and the response result, and to output the drawing result to the display device 11.
According to some embodiments of the present invention, the interface processing device 13 may also pre-store one or more signal source layouts, and upload the current signal source layout to the server 18, so that the server 18 stores the signal source layout as being associated with an account number, so that the signal source layout can be obtained by logging in the account number at the interface processing devices 13 and 13'. Alternatively, a plurality of signal source layouts are stored in advance by the server 18 for the interface processing apparatuses 13 and 13 'to acquire via the network, and at this time, signal source layout information may not be stored in advance on the interface processing apparatuses 13 and 13'.
According to some embodiments of the present invention, the interactive instruction includes, in addition to a control instruction for controlling the signal source, a layout adjustment instruction for adjusting a layout of the signal source and an interface operation instruction for operating the ui interface, and other various interactive instructions. The exchange instruction may be sent to the server 18 by the interface processing device, so that the server stores relevant records, or performs unified management, or before the interface processing device executes the exchange instruction, the interface processing device sends a corresponding execution request to the server 18, and executes the exchange instruction after being authorized by the server 18. The interactive instructions may include, for example, changing the position, size, stacking order, newly opening or closing windows, etc. of the display window of the signal source; requesting to share the content of one signal source to another signal source, requesting to display another signal source on a window of the interface processing device corresponding to the current signal source (the server can distribute and manage the sharing and requesting authority to each interface processing device), performing screen capture or requesting screen capture content on other signal sources, or operating part of screen capture content, or storing a layout thumbnail formed by each signal source as a scene plan.
According to some embodiments of the present invention, the interface processing device 13 determines, according to the current signal source layout, the ui interface, and the interaction position indicated by the interaction instruction, a target signal source to be controlled by the interaction instruction or a control on the ui interface, and transmits the interaction instruction to the interface processing device corresponding to the target signal source or the control on the ui interface through the server, where the interface processing device controls the ui interface to respond according to the interaction instruction. For example, when the interactive command is judged to be a command for controlling the signal source 15' to open a certain folder, the command is a command for controlling the target signal source, and when the interactive command is for expanding the folding directory on the ui interface, the command controls the folding control to expand the relevant directory. According to some embodiments of the invention, the control may correspond to a layout adjustment button. According to some embodiments of the invention, a particular shortcut may be set up for calling a certain layout.
According to some embodiments of the present invention, the usb transmission line, such as the usb line (1, 1', 1 "), may also be changed into a unidirectional transmission line (e.g., introducing unidirectional optical fiber and/or unidirectional serial port line, and necessary protocol conversion modules, such as a serial-to-serial protocol module, an optical serial module, a serial-to-optical module, etc.), so as to further improve the security of the unidirectional and interactive processes of instruction transmission. According to some embodiments of the present invention, the signal source itself may be connected to another network, so that the signal source itself may realize the internet access requirement through the keyboard and mouse connected thereto. According to some embodiments of the present invention, the interface processing device 13 may be further configured to have a login interface, and when the user logs in through the login interface, the server 18 will confirm whether the login account is correct and call up the relevant layout or ui interface. According to some embodiments of the present invention, the interface processing device 13 is configured to skip the login interface and directly enter the local signal source control mode when the server 18 cannot be accessed due to a reason, and in the local signal source mode, the signal source corresponding to the interface processing device 13, such as the illustrated signal source 15, can be controlled by the keyboard and the mouse.
According to some embodiments of the present invention, the interface processing device 13 may further include an instruction conversion module (or HID module), where the instruction conversion module is configured to convert the interactive instruction transmitted to the signal source into an HID standard device protocol, and output the HID standard device protocol to the corresponding signal source through the USB port.
FIG. 2 illustrates a schematic block diagram of a multi-signal source interface interaction system according to further embodiments of the present invention.
The difference between fig. 2 and fig. 1 is that the signal source 15 'of fig. 2 is connected to a main screen 20 and an auxiliary screen 21, and the signal source 15' is connected to the interface processing device 13 'through two HDMI lines (3' and 22). For the sake of simplicity, parts other than the main screen 20, the sub screen 21, and the HDMI line 22 in the figure are denoted by the same numerals as in fig. 1, and the description is not repeated.
The main screen content of the signal source 15 ' is output to the interface processing device 13 ' through the HDMI line 3 ', and the auxiliary screen content of the signal source 15 ' is output to the interface processing device 13 ' through the HDMI line 22, and is identified as the main screen signal source and the auxiliary screen signal source as two independent signal sources (for other interface processing devices, it is equivalent to call two different target signal sources), where the auxiliary screen content is the extension content of the main screen content or the copy content of the main screen content. The interface processing device 13 can independently obtain the contents of the main screen signal source and the auxiliary screen signal source respectively through a network (such as the illustrated server 18), and the contents of the main screen signal source and the auxiliary screen signal source can be transmitted to the interface processing device 13' as independent signal sources and then respectively encoded into two independent network video stream signals for being obtained by other interface processing devices.
An exemplary security interface interaction process of the multiple signal source interface interaction system is further described below with reference to fig. 1.
When the interactive instruction generating device 10 transmits an interactive instruction to the interface processing device 13 through the usb cable (or other transmission device), the interface processing device 13 receives the interactive instruction, and determines a control object of the interactive instruction according to the current layout, and when it is determined that the interactive instruction is directed to the signal source 15 ', the interface processing device 13 transmits the interactive instruction to the interface processing device 13 ' corresponding to the signal source 15 ' through a network (such as the interactive machine 17, or the switch 17 and the server 18).
The interface processing device 13 'receives the transmitted interactive instructions and transmits them to the signal source 15'.
The signal source 15 ' receives the interactive instruction transmitted from the interface processing apparatus 13 ', and in response, outputs the result of the response to the interface processing apparatus 13 '.
The interface processing device 13' sends the response result to the interface processing device 13 through the network, and the interface processing device receives the response result, draws the response result according to the corresponding layout, and outputs the drawn result to the display device 11. When the layout corresponds to a full screen display of the current signal source 15 ', only the current signal source 15' is drawn at this time, and the drawing result is output to the display apparatus 11.
The description of the interface processing device 13 in this application applies equally to the interface processing device 13 'and its corresponding signal source (15', 19), the display device 11 ', the interactivity instruction generation device 10', the USB cable and the HDMI cable, and likewise, the interface processing device 13 may also be connected to two or more local signal sources. For the sake of simplicity, no further description is given.
By the embodiment of the invention, the content can be safely shared and interacted among the signal sources without installing any program on each signal source.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (12)

1. A multi-signal source interface interaction system, comprising:
the system comprises first interaction instruction generating equipment, first interface processing equipment and first display equipment; and a second interface processing device;
the first interactive instruction generating device is used for generating an interactive instruction;
the first interface processing equipment is connected with the first interactive instruction generating equipment and is used for acquiring the interactive instruction, determining a target signal source to be controlled by the interactive instruction according to the current signal source layout in the interface processing equipment and the interactive position indicated by the interactive instruction, and transmitting the interactive instruction to second interface processing equipment corresponding to the target signal source through a network;
the second interface processing equipment acquires the interactive instruction and sends the interactive instruction to the target signal source through the instruction transmission line, so that the target signal source responds according to the interactive instruction, and the second interface processing equipment receives a response result of the target signal source through the video transmission line;
and the first interface processing equipment acquires the response result received by the second interface processing equipment from the target signal source through the network, draws the response result according to the current signal source layout and outputs the drawn result to the first display equipment.
2. The multi-signal source interface interaction system of claim 1, wherein the video line comprises an HDMI line and the command line comprises a usb line.
3. The multiple-signal-source interface interaction system of claim 1, further comprising a server, wherein the first interface processing device and the second interface processing device establish a communication connection via the server.
4. The multi-signal-source interface interaction system of claim 3, wherein the first interface processing device transmits the interaction instruction to the second interface processing device corresponding to the target signal source through the server; and/or the first interface processing equipment acquires the response result received by the second interface processing equipment from the target signal source through the server.
5. The multi-signal-source interface interaction system of claim 3, wherein the target signal source comprises a PC, and the main screen content and the auxiliary screen content of the target signal source are output to the interface processing device through one HDMI line and identified as the main screen signal source and the auxiliary screen signal source as two independent signal sources; the auxiliary screen content is the expanded content of the main screen content or the copied content of the main screen content.
6. The multi-signal-source interface interaction system of claim 3, wherein the first interface processing device pre-stores one or more signal source layouts and uploads a current signal source layout to the server, so that the server stores the signal source layout as being associated with an account, so that the signal source layout can be obtained by logging in the account on the first interface processing device, the second interface processing device, or another interface processing device; and/or the first interface processing equipment is also used for pre-storing or generating a ui interface, fusing the ui interface and the target signal source content, then drawing, and outputting the drawing result to the first display equipment; and the first interface processing equipment uploads the current ui interface to the server, so that the server stores the signal source layout as being associated with an account number, and the ui interface can be acquired by logging in the account number on the first interface processing equipment and the second interface processing equipment.
7. The multi-signal-source interface interaction system of claim 3, wherein the server pre-stores a plurality of signal source layouts for the first interface processing device and the second interface processing device to obtain via a network; and/or the server stores the ui interface in advance, the first interface processing device and the second interface processing device acquire the ui interface from the server, the ui interface and the response result are fused and then drawn, and the drawing result is output to the first display device.
8. The multi-signal-source interface interaction system of claim 6, wherein the interaction instructions further comprise a layout adjustment instruction for adjusting the layout of the signal sources and an interface operation instruction for operating the ui interface; and before the first interface processing equipment executes the interactive instruction, sending a corresponding execution request to a server, and executing the interactive instruction after the server authorizes the interactive instruction.
9. The multi-signal-source interface interaction system of claim 7, wherein the interaction instructions further comprise a layout adjustment instruction for adjusting the signal source layout and an interface operation instruction for operating the ui interface; and before the first interface processing equipment executes the interactive instruction, sending a corresponding execution request to a server, and executing the interactive instruction after the server authorizes the interactive instruction.
10. The multi-signal-source interface interaction system according to claim 6 or 7, wherein the first interface processing device determines a target signal source to be controlled by the interaction instruction or a control on the ui interface according to the current signal source layout, the ui interface and the interaction position indicated by the interaction instruction, and transmits the interaction instruction to the second interface processing device corresponding to the target signal source or the control on the ui interface through the server to respond according to the interaction instruction.
11. The multi-signal source interface interaction system of claim 1, wherein the interaction command generating device comprises a keyboard, a mouse, or a touch screen; or the interactive instruction generating equipment is a transparent touch device which is superposed on the display equipment; or the interactive instruction generating device comprises an infrared curtain type touch screen based on the display device.
12. The multiple-signal-source interface interaction system of claim 1, further comprising an additional display device, wherein the first interface processing device is capable of selectively outputting content of one of the signal sources to the additional display device in response to a user operation; the signal source comprises a personal computer, a handheld or laptop computer, a tablet computer, a cellular telephone, a mobile device, an electronic device, a smart phone, a smart television, or a camera; the additional display device and/or the first display device comprises a tiled screen; the command transmission line comprises a unidirectional transmission line; the signal source is connected to another network; the first interface processing equipment is configured to be provided with a login interface, and when the server cannot be accessed, the login interface is skipped, and a local signal source control mode is entered, so that the interactive instruction generating equipment can directly control a signal source corresponding to the first interface processing equipment; the first interface processing equipment also comprises an instruction conversion module, wherein the instruction conversion module is used for converting the interactive instruction transmitted to the signal source into an HID standard equipment protocol and outputting the HID standard equipment protocol to the corresponding signal source through the USB port.
CN202210018498.9A 2022-01-07 2022-01-07 Multi-signal-source interface interaction system Active CN114371899B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210018498.9A CN114371899B (en) 2022-01-07 2022-01-07 Multi-signal-source interface interaction system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210018498.9A CN114371899B (en) 2022-01-07 2022-01-07 Multi-signal-source interface interaction system

Publications (2)

Publication Number Publication Date
CN114371899A true CN114371899A (en) 2022-04-19
CN114371899B CN114371899B (en) 2022-11-04

Family

ID=81144655

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210018498.9A Active CN114371899B (en) 2022-01-07 2022-01-07 Multi-signal-source interface interaction system

Country Status (1)

Country Link
CN (1) CN114371899B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109582182A (en) * 2017-10-20 2019-04-05 北京仁光科技有限公司 Multi signal window touch control method, equipment, system and computer readable storage medium
CN110221797A (en) * 2019-05-28 2019-09-10 上海寰视网络科技有限公司 The control method and system of signal source equipment in multi-screen splicing system
CN110618780A (en) * 2018-06-20 2019-12-27 北京仁光科技有限公司 Interaction device and interaction method for interacting multiple signal sources
CN110851063A (en) * 2019-09-18 2020-02-28 丁建华 Method for carrying out safe fusion interaction on multi-network and multi-system application interface
CN110933291A (en) * 2019-06-06 2020-03-27 北京仁光科技有限公司 Cross-network interaction system and cross-network interaction method
CN111459393A (en) * 2020-03-13 2020-07-28 中天智领(北京)科技有限公司 Method, system and equipment for realizing multi-signal-source interactive control
CN111913677A (en) * 2020-07-31 2020-11-10 北京仁光科技有限公司 Method and system for controlling spliced screen
CN112462931A (en) * 2020-02-19 2021-03-09 北京仁光科技有限公司 Signal source calling and controlling method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109582182A (en) * 2017-10-20 2019-04-05 北京仁光科技有限公司 Multi signal window touch control method, equipment, system and computer readable storage medium
CN110618780A (en) * 2018-06-20 2019-12-27 北京仁光科技有限公司 Interaction device and interaction method for interacting multiple signal sources
CN110221797A (en) * 2019-05-28 2019-09-10 上海寰视网络科技有限公司 The control method and system of signal source equipment in multi-screen splicing system
CN110933291A (en) * 2019-06-06 2020-03-27 北京仁光科技有限公司 Cross-network interaction system and cross-network interaction method
CN110851063A (en) * 2019-09-18 2020-02-28 丁建华 Method for carrying out safe fusion interaction on multi-network and multi-system application interface
CN112462931A (en) * 2020-02-19 2021-03-09 北京仁光科技有限公司 Signal source calling and controlling method and system
CN111459393A (en) * 2020-03-13 2020-07-28 中天智领(北京)科技有限公司 Method, system and equipment for realizing multi-signal-source interactive control
CN111913677A (en) * 2020-07-31 2020-11-10 北京仁光科技有限公司 Method and system for controlling spliced screen

Also Published As

Publication number Publication date
CN114371899B (en) 2022-11-04

Similar Documents

Publication Publication Date Title
CN110417992B (en) Input method, electronic equipment and screen projection system
US9445054B2 (en) Information providing apparatus, transmission system, information providing method, and recording medium storing information providing program
US20110066971A1 (en) Method and apparatus for providing application interface portions on peripheral computing devices
CN113448622B (en) Multi-signal-source interface interaction system
US20140340344A1 (en) Display processor and display processing method
CN104270662A (en) System of terminal equipment for controlling intelligent television through browser
KR102203757B1 (en) Closed caption-supported content receiving apparatus and display apparatus, system having the same and closed caption-providing method thereof
CN112073762B (en) Information acquisition method based on multi-system display equipment and multi-system display equipment
CN113784200B (en) Communication terminal, display device and screen projection connection method
US20210126915A1 (en) Device and system for screen sharing
US20130312085A1 (en) Information processing apparatus, information processing system, and computer program product
CN114371899B (en) Multi-signal-source interface interaction system
CN112507329A (en) Safety protection method and device
CN114415866A (en) Multi-signal-source interface safety interaction device
CN110519205B (en) Apparatus and method for interacting computers within at least two subnets
CN111818368B (en) Method for managing display device authority, mobile terminal and server
CN114625417A (en) Multi-signal-source interface safety interaction device
CN114579996B (en) Mobile disk data interaction system and method
CN213934850U (en) Multi-signal source interface interaction device
KR20140029049A (en) Display apparat and input signal processing method using the same
CN115348475B (en) Display equipment and channel display method
US20120066743A1 (en) Information processing apparatus, screen transmitting method, and non-transitory computer-readable recording medium encoded with screen transmitting program
CN115514998B (en) Display equipment and network media resource switching method
WO2018117956A1 (en) Method and system for displaying data
JP7046338B1 (en) Screen sharing device, screen sharing method, and computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant