CN106210665B - Remote host control method and system based on video acquisition - Google Patents
Remote host control method and system based on video acquisition Download PDFInfo
- Publication number
- CN106210665B CN106210665B CN201610781422.6A CN201610781422A CN106210665B CN 106210665 B CN106210665 B CN 106210665B CN 201610781422 A CN201610781422 A CN 201610781422A CN 106210665 B CN106210665 B CN 106210665B
- Authority
- CN
- China
- Prior art keywords
- hid
- remote host
- host
- event
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a remote host control method and system based on video acquisition, relates to the field of computer remote control, and can realize high-efficiency real-time control of a remote host under the application scenes of high requirements on picture quality and limited network bandwidth. The invention comprises the following steps: the local host is provided with a video acquisition card, and the video acquisition card is connected with a video interface of the remote host through a cable and is used for acquiring a video signal output by the remote host; the local host is connected with an output display device, and the output display device is used for displaying the video signal which is acquired by the video acquisition card and output by the remote host; and the control signal sent by the HID input device connected with the local host is transmitted to the signal input interface of the remote host through the signal output interface of the HID gadget device and is received by the HID input device enumerated in the remote host. The invention is suitable for the application scenes with higher requirements on the quality of the picture and limited network bandwidth, and can realize the high-efficiency real-time control of the remote host.
Description
Technical Field
The invention relates to the field of computer remote control, in particular to a remote host control method and system based on video acquisition.
Background
At present, in the occasions of school teaching, office meetings, PPT, code demonstration and the like, the contents of a plurality of computers are mainly displayed by adopting a computer remote control technology, wherein the plurality of computers are mutually connected by mainly adopting a current mature networking mode such as a local area network or an internet, and the like, and the image display of a remote host and the transmission of keyboard and mouse events are carried out based on the current network protocol.
The image display of the remote host and the transmission scheme of the keyboard and mouse events based on the existing Internet communication protocol and the local area network communication protocol have low requirements on image definition and real-time performance of remote control in the mature technology, and the problem of displaying the image of the remote host in a high-definition mode is not considered too much. However, many special application scenarios exist, such as: for the real-time description and analysis of a complicated structure drawing from the overall perspective, the display of massive codes in the code checking process and the like, a remote host picture needs to be displayed in a high-definition manner, so that the detail definition of the displayed content can be ensured.
However, the existing solutions have high requirements on network bandwidth and performance of the remote host, and when the performance of the network and the remote host is poor, the phenomenon of control delay occurs. If the performance of the remote host is improved, the expense cost is increased, and the expense expenses of many teaching and scientific research institutions and small and medium enterprises are increased.
Disclosure of Invention
The embodiment of the invention provides a remote host control method and system based on video acquisition, which can realize high-efficiency real-time control of a remote host under the application scenes with higher requirements on picture quality and limited network bandwidth.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
the remote host comprises a video interface for outputting a video signal; a video capture card is configured in the local host, is connected with a video interface of the remote host through a cable and is used for capturing a video signal output by the remote host; the local host is connected with an output display device, and the output display device is used for displaying the video signal which is acquired by the video acquisition card and output by the remote host; configuring a hid gadget device in the local host, wherein the hid gadget device is a hid gadget device connected with the remote host through a USB; the local host is connected with HID input equipment, the HID input equipment corresponding to the HID input equipment is enumerated in the remote host, a control signal sent by the HID input equipment connected with the local host is transmitted to a signal input interface of the remote host through a signal output interface of the HID gadget equipment and is received by the enumerated HID input equipment in the remote host, and the HID input equipment at least comprises HID mouse keyboard equipment;
the method comprises the following steps: the local host acquires the video signal output by the remote host through the video acquisition card and synchronously displays the picture corresponding to the acquired video signal on the output display equipment; the local host computer obtains the HID event generated by the HID input device, filters the generated HID event and sends the filtered HID event to the remote host computer, so that the remote host computer executes corresponding operation according to the received HID event.
The synchronous display of the picture corresponding to the acquired video signal on the output display device comprises: displaying a display interface of the local host through the output display equipment, and dividing a designated display window in the display interface of the local host; and after the collected video signal is received, displaying a picture corresponding to the collected video signal in the appointed display window.
The screening and filtering the generated HID event comprises the following steps: determining the position of a user of the local host computer for operating in a display interface of the local host computer through the HID input device according to the HID event; detecting whether the operation-performing position is captured by the specified display window; if yes, reserving the HID event; and if not, filtering the HID event, and executing corresponding operation by the local host according to the HID event.
According to the remote host control method and system based on video acquisition provided by the embodiment of the invention, the video acquisition card is configured in the local host, and the video acquisition card is connected with the video interface of the remote host through a cable and is used for acquiring the video signal output by the remote host. The local host is connected with the HID input device, the HID input device corresponding to the HID input device is enumerated in the remote host, and a control signal sent by the HID input device connected with the local host is transmitted to the signal input interface of the remote host through the signal output interface of the HID gadget device and is received by the enumerated HID input device in the remote host. Therefore, the interactive process between the local host and the remote host can directly acquire the display output of the remote host by using a video acquisition card through VGA, DVI or HDMI and other standard video interfaces and USB interfaces without occupying the network bandwidth of the Internet or a local area network, and the control of the remote host is realized through an HID event filtering and forwarding mechanism. Compared with the picture display of the remote host and the transmission scheme of the keyboard and mouse events which need to occupy the network bandwidth in the prior art, the video output of the remote host is directly collected, so that the remote host does not need to perform compression coding and network transmission on the video signal, and the requirements on the network bandwidth and the performance of the remote host are greatly reduced; in addition, in the embodiment, the control event generated by the HID such as the mouse and the keyboard is filtered by software and then directly forwarded to the remote host through the USB, so that the delay of the control event in the network transmission process is avoided, and the real-time responsiveness of remote control is improved. Under the application scenes of high requirements on picture quality and limited network bandwidth, the remote host can be efficiently controlled in real time.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a remote host control system based on video capture according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a remote host control method based on video capture according to an embodiment of the present invention;
fig. 3 is a schematic diagram of an embodiment provided in the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the present invention will be described in further detail with reference to the accompanying drawings and specific embodiments. Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention. As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or coupled. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The embodiment of the invention provides a remote host control system based on video acquisition, as shown in fig. 1, comprising: a remote host and a local host, wherein:
the remote host includes a video interface for outputting a video signal.
And the local host is internally provided with a video acquisition card, and the video acquisition card is connected with a video interface of the remote host through a cable and is used for acquiring a video signal output by the remote host.
The local host is connected with an output display device, and the output display device is used for displaying the video signal which is acquired by the video acquisition card and output by the remote host. And configuring a hid gadget device in the local host, wherein the hid gadget device is a hid type gadget device connected with the remote host through a USB. For example: the HID-type USB gadget device is virtually realized by software on a local host, the HID-type USB gadget device is connected with a remote host through a USB, and the HID-type USB gadget device can be specifically understood as an HID-type USB slave device virtually realized by software.
The local host is connected with an HID (Human Interface Device, a Device which directly interacts with a person) input Device, the HID input Device corresponding to the HID input Device is enumerated in the remote host, a control signal sent by the HID input Device connected with the local host is transmitted to a signal input Interface of the remote host through a signal output Interface of the HID gadget Device and is received by the HID input Device enumerated in the remote host, and the HID input Device at least comprises an HID mouse and keyboard Device, such as a mouse and a keyboard which are commonly connected with the local host through a USB Interface.
The video interface comprises a VGA, DVI or HDMI standard interface. Specifically, the signal output interface of the local host and the signal input interface of the remote host are connected by a USB cable, and the signal output interface and the signal input interface are of a USB system. The local host can collect the Video signal output by the remote host to the local host through a Video acquisition card through a VGA (Video Graphics Array), a DVI (Digital Visual Interface) or an HDMI (High Definition Multimedia Interface). And the application layer of the local host draws the collected picture to the application window. The hid gadget device created by the local host is connected to the remote host through a USB line, and is enumerated as the hid keyboard and mouse device at the remote host end.
The remote host and the local host disclosed in the present invention may be implemented as a single Computer device, or may be integrated into various Computer devices capable of implementing human-Computer interaction through input/output devices, such as a desktop Computer, a Tablet Personal Computer (Tablet Personal Computer), a Laptop Computer (Laptop Computer), and a server device having a human-Computer interaction interface.
According to the remote host control system based on video acquisition provided by the embodiment of the invention, the video acquisition card is configured in the local host, and the video acquisition card is connected with the video interface of the remote host through a cable and is used for acquiring the video signal output by the remote host. The local host is connected with the HID input device, the HID input device corresponding to the HID input device is enumerated in the remote host, and a control signal sent by the HID input device connected with the local host is transmitted to the signal input interface of the remote host through the signal output interface of the HID gadget device and is received by the enumerated HID input device in the remote host. Therefore, the interactive process between the local host and the remote host can directly acquire the display output of the remote host by using a video acquisition card through VGA, DVI or HDMI and other standard video interfaces and USB interfaces without occupying the network bandwidth of the Internet or a local area network, and the control of the remote host is realized through an HID event filtering and forwarding mechanism. Compared with the picture display of the remote host and the transmission scheme of the keyboard and mouse events which need to occupy the network bandwidth in the prior art, the video output of the remote host is directly collected, so that the remote host does not need to perform compression coding and network transmission on the video signal, and the requirements on the network bandwidth and the performance of the remote host are greatly reduced; in addition, in the embodiment, the control event generated by the HID such as the mouse and the keyboard is filtered by software and then directly forwarded to the remote host through the USB, so that the delay of the control event in the network transmission process is avoided, and the real-time responsiveness of remote control is improved. Under the application scenes of high requirements on picture quality and limited network bandwidth, the remote host can be efficiently controlled in real time.
An embodiment of the present invention further provides a remote host control method based on video capture, where the method is used in the system shown in fig. 1 and including a remote host and a local host, and as shown in fig. 2, the method includes:
and S1, the local host acquires the video signal output by the remote host through the video acquisition card, and synchronously displays the picture corresponding to the acquired video signal on the output display equipment.
S2, the local host computer acquires the HID event generated by the HID input device.
And S3, screening and filtering the generated HID event, and sending the screened and filtered HID event to the remote host.
So that the remote host executes corresponding operation according to the received HID event.
In this embodiment, the implementation means of S1 for synchronously displaying the picture corresponding to the acquired video signal on the output display device specifically includes:
and displaying the display interface of the local host through the output display equipment, and dividing a designated display window in the display interface of the local host. And after the collected video signal is received, displaying a picture corresponding to the collected video signal in the appointed display window.
Specifically, the filtering the generated HID events includes:
and determining the position of the user of the local host computer operating in the display interface of the local host computer through the HID input device according to the HID event.
Detecting whether the operation-performed position is captured by the specified display window. And if so, retaining the HID event. And if not, filtering the HID event, and executing corresponding operation by the local host according to the HID event. For example: as shown in fig. 3, the local host acquires the display image of the remote host through video capture. When the application layer of the local host receives the local HID event, the local host filters the local HID event such as a mouse and a keyboard according to the event target host, judges whether the event needs to be forwarded to the remote host according to the current focus window, and forwards the event to the remote host through the HID gadget device if the event needs to be forwarded. The HID event may be a keyboard and mouse event, and the keyboard and mouse event may be understood as a keyboard and mouse event that a local host generates a corresponding keyboard and mouse event as the HID event according to an operation of a user when the user operates the local host through HID input devices such as a keyboard and a mouse. If the HID input device is a touch screen, a joystick or other input device, the local host may also generate the HID event by using a corresponding existing method.
The embodiment further provides a specific determination method of whether the event needs to be forwarded to the remote host, including: the local host judges whether the event needs to be forwarded to the remote host according to the current focus window, and the event is processed by the local host when the mouse and keyboard events are captured by the window. When the mouse and keyboard events are captured by the window, they are forwarded to the remote host for processing, thereby implementing remote control. Thus, the control of the remote host is realized through HID event forwarding.
According to the remote host control method based on video acquisition provided by the embodiment of the invention, the video acquisition card is configured in the local host, and the video acquisition card is connected with the video interface of the remote host through a cable and is used for acquiring the video signal output by the remote host. The local host is connected with the HID input device, the HID input device corresponding to the HID input device is enumerated in the remote host, and a control signal sent by the HID input device connected with the local host is transmitted to the signal input interface of the remote host through the signal output interface of the HID gadget device and is received by the enumerated HID input device in the remote host. Therefore, the interactive process between the local host and the remote host can directly acquire the display output of the remote host by using a video acquisition card through VGA, DVI or HDMI and other standard video interfaces and USB interfaces without occupying the network bandwidth of the Internet or a local area network, and the control of the remote host is realized through an HID event filtering and forwarding mechanism. Compared with the picture display of the remote host and the transmission scheme of the keyboard and mouse events which need to occupy the network bandwidth in the prior art, the video output of the remote host is directly collected, so that the remote host does not need to perform compression coding and network transmission on the video signal, and the requirements on the network bandwidth and the performance of the remote host are greatly reduced; in addition, in the embodiment, the control event generated by the HID such as the mouse and the keyboard is filtered by software and then directly forwarded to the remote host through the USB, so that the delay of the control event in the network transmission process is avoided, and the real-time responsiveness of remote control is improved. Under the application scenes of high requirements on picture quality and limited network bandwidth, the remote host can be efficiently controlled in real time.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus embodiment, since it is substantially similar to the method embodiment, it is relatively simple to describe, and reference may be made to some descriptions of the method embodiment for relevant points. The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (5)
1. A remote host control method based on video capture, the method being used in a system comprising a remote host and a local host, wherein: the remote host comprises a video interface for outputting a video signal; a video capture card is configured in the local host, is connected with a video interface of the remote host through a cable and is used for capturing a video signal output by the remote host; the local host is connected with an output display device, and the output display device is used for displaying the video signal which is acquired by the video acquisition card and output by the remote host; configuring a hid gadget device in the local host, wherein the hid gadget device is a hid gadget device connected with the remote host through a USB; the local host is connected with HID input equipment, the HID input equipment corresponding to the HID input equipment is enumerated in the remote host, a control signal sent by the HID input equipment connected with the local host is transmitted to a signal input interface of the remote host through a signal output interface of the HID gadget equipment and is received by the enumerated HID input equipment in the remote host, and the HID input equipment at least comprises HID mouse keyboard equipment;
the method comprises the following steps:
the local host acquires the video signal output by the remote host through the video acquisition card and synchronously displays the picture corresponding to the acquired video signal on the output display equipment;
the local host acquires the HID event generated by the HID input device, screens and filters the generated HID event, and sends the screened and filtered HID event to the remote host, so that the remote host executes corresponding operation according to the received HID event;
wherein the HID event comprises a keyboard and mouse event; and the local host filters the HID event according to an event target host, then judges whether the HID event needs to be forwarded to the remote host according to the current focus window, and forwards the HID event to the remote host through the HID gadget device if the HID event needs to be forwarded to the remote host.
2. The method according to claim 1, wherein the synchronously displaying the picture corresponding to the captured video signal on the output display device comprises:
displaying a display interface of the local host through the output display equipment, and dividing a designated display window in the display interface of the local host;
and after the collected video signal is received, displaying a picture corresponding to the collected video signal in the appointed display window.
3. The method of claim 2, wherein the filtering the generated HID events comprises:
determining the position of a user of the local host computer for operating in a display interface of the local host computer through the HID input device according to the HID event;
detecting whether the operation-performing position is captured by the specified display window;
if yes, reserving the HID event; and if not, filtering the HID event, and executing corresponding operation by the local host according to the HID event.
4. The method of claim 1, wherein the video interface comprises a VGA, DVI, or HDMI standard interface.
5. The method according to claim 1, wherein the signal output interface of the local host and the signal input interface of the remote host are connected by a USB cable, and the signal output interface and the signal input interface are in a USB format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610781422.6A CN106210665B (en) | 2016-08-31 | 2016-08-31 | Remote host control method and system based on video acquisition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610781422.6A CN106210665B (en) | 2016-08-31 | 2016-08-31 | Remote host control method and system based on video acquisition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106210665A CN106210665A (en) | 2016-12-07 |
| CN106210665B true CN106210665B (en) | 2022-04-12 |
Family
ID=58087247
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610781422.6A Active CN106210665B (en) | 2016-08-31 | 2016-08-31 | Remote host control method and system based on video acquisition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210665B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108055267A (en) * | 2017-12-15 | 2018-05-18 | 联想(北京)有限公司 | A kind of data sharing method and terminal |
| CN111182000A (en) * | 2020-01-10 | 2020-05-19 | 北京首翼弘泰科技有限公司 | Method for remotely controlling computer through video acquisition and USB signal transmission |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6356968B1 (en) * | 1997-09-03 | 2002-03-12 | Cirrus Logic, Inc | Apparatus and method for transparent USB-to-1394 bridging and video delivery between a host computer system and a remote peripheral device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100030853A1 (en) * | 2008-07-09 | 2010-02-04 | Aten International Co., Ltd. | Remote desktop control system using usb interface and method thereof |
| US20130007224A1 (en) * | 2011-06-30 | 2013-01-03 | Yuanjie Yang | Lightweight Method for Out-Of-Band Management of a Remote Computer with a Mirror of Remote Software Resources |
-
2016
- 2016-08-31 CN CN201610781422.6A patent/CN106210665B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6356968B1 (en) * | 1997-09-03 | 2002-03-12 | Cirrus Logic, Inc | Apparatus and method for transparent USB-to-1394 bridging and video delivery between a host computer system and a remote peripheral device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210665A (en) | 2016-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9049341B2 (en) | Method and apparatus for video resource management in video conference | |
| US9197853B2 (en) | Switching between views using natural gestures | |
| WO2015070694A1 (en) | Screen splicing system and video data stream processing method | |
| US9288438B2 (en) | Communication control system and control device | |
| JP7084450B2 (en) | Systems and methods for distributed media interaction and real-time visualization | |
| WO2017101440A1 (en) | Remote annotation synchronization method and system | |
| KR20130091765A (en) | Virtual video capture device | |
| JP5695597B2 (en) | Screen display device and screen display system | |
| CN106210665B (en) | Remote host control method and system based on video acquisition | |
| US11120768B2 (en) | Frame drop processing method and system for played PPT | |
| US20170185269A1 (en) | Display management solution | |
| CN111045770A (en) | Method, first terminal, device and readable storage medium for remote exhibition | |
| CN110727485A (en) | Screen interface selectable sharing method and system | |
| US11500605B2 (en) | Image transmission device, image display system capable of remote screenshot, and remote screenshot method | |
| CN103593046A (en) | Information processing apparatus, projecting apparatus, information processing method, and projecting method | |
| US11348264B1 (en) | Capturing content on writing surfaces using depth and image sensing | |
| CN107870752B (en) | Terminal window wall-mounting method, terminal, television wall and system | |
| CN103686149A (en) | Browser fault message acquisition method and system | |
| CN111090488B (en) | Linkage display method and system for spliced screen | |
| US10645330B2 (en) | Visual control of a video conference | |
| CN206060993U (en) | A kind of distance host control system based on video acquisition | |
| WO2024082803A1 (en) | Screen-mirroring control method and apparatus, electronic device, and computer-readable storage medium | |
| JP6606251B2 (en) | SENDING COMPUTER, RECEIVING COMPUTER, METHOD EXECUTED BY THE SAME, AND COMPUTER PROGRAM | |
| JP2015023466A (en) | Distribution system, distribution method and program | |
| JP6485352B2 (en) | Receiving apparatus, method, computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |