CN107948567B

CN107948567B - USB wired screen transmission method and device

Info

Publication number: CN107948567B
Application number: CN201611043037.8A
Authority: CN
Inventors: 贺欣
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2016-10-12
Filing date: 2016-11-21
Publication date: 2021-05-18
Anticipated expiration: 2036-11-21
Also published as: WO2018090721A1; CN107948567A

Abstract

The invention relates to a USB wired screen transmission method and device. The method comprises the following steps: the method comprises the steps that a plurality of communication protocol ports are provided for first equipment through a first USB interface of a home terminal, the communication protocol ports can be identified by a general driver of the first equipment, and USB communication connection between the home terminal and the first equipment is established through the communication protocol ports and the first USB interface; instructing the first device to switch system sound to a virtual sound card simulated at the home terminal through a port of the virtual sound card, wherein the virtual sound card is not connected with any power amplifier device; detecting that the first USB interface has information from first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; and forwarding the audio and video data to the second device through a second USB interface of the local terminal. The invention can overcome the problem that the display source end and the display equipment end sound at the same time.

Description

USB wired screen transmission method and device

Technical Field

The invention relates to the technical field of data transmission, in particular to a USB wired screen transmission method and device.

Background

The current screen transmission implementation manner is that, as shown in fig. 1, two ends of a screen transmission device are respectively connected to a display source PC and a display terminal, the display source PC intercepts a screen page and sound data of a system and sends the intercepted screen page and sound data to the display terminal through the screen transmission device, and the display terminal displays and plays a picture and sound sent by the screen transmission device, so as to achieve the purpose of screen transmission.

In order to intercept the sound, the sound is required to be output at the PC end, so that the display source PC and the display terminal can make sound through respective power amplifiers in the screen transmission process; however, when the display source PC and the display terminal are in the same room, there is a mutual interference in such a case. Therefore, in many cases, the sound is selected to be turned off, and only the screen transmission of the display screen is performed, but it is difficult to achieve the intended effect.

Disclosure of Invention

Therefore, the method and the device for transmitting the USB wired screen, provided by the embodiment of the invention, can overcome the problem that the display source equipment and the display terminal generate sound simultaneously and have interference.

The invention provides a USB wired screen transmission method on one hand, which comprises the following steps:

providing a plurality of communication protocol ports for first equipment through a first USB interface of a local terminal, wherein the communication protocol ports can be identified by a universal driver of the first equipment; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port of the simulated virtual sound card;

establishing a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface; instructing the first device to switch system sound to a virtual sound card simulated at the home terminal through a port of the virtual sound card, wherein the virtual sound card is not connected with any power amplifier device;

detecting that the first USB interface has information from first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; and forwarding the audio and video data to second equipment through a second USB interface of the local terminal, and indicating the second equipment to play corresponding audio and video after receiving the audio and video data.

The invention also provides a USB wired screen transmission method, which comprises the following steps:

identifying a communication protocol port provided by USB equipment accessed to a USB interface of first equipment through a pre-installed universal driver; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port of the simulated virtual sound card; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;

switching system sound of first equipment to a virtual sound card simulated by the USB equipment through a port of the identified virtual sound card, wherein the virtual sound card is not connected with any power amplifier equipment;

capturing a picture and audio played by first equipment; and sending the intercepted audio and video data to a first USB interface of the USB equipment through the USB interface of the first equipment.

The invention also provides a USB wired screen transmission device, which comprises:

a port simulation module, configured to provide a plurality of communication protocol ports to a first device through a first USB interface of a local terminal, where the communication protocol ports are identifiable by a generic driver of the first device, and the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol ports at least include: the port used for transmitting audio and video data and the port of the virtual sound card;

the connection establishing module is used for establishing the USB communication connection between the local terminal and the first equipment through the communication protocol port and the first USB interface; instructing the first device to switch system sound to a virtual sound card simulated at the home terminal through a port of the virtual sound card, wherein the virtual sound card is not connected with any power amplifier device;

the audio and video data forwarding module is used for detecting that the first USB interface has information from the first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; and forwarding the audio and video data to second equipment through a second USB interface of the local terminal, and indicating the second equipment to play corresponding audio and video after receiving the audio and video data.

the USB identification module is used for identifying a communication protocol port provided by the USB equipment accessed to the USB interface of the first equipment through the pre-installed universal driver; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port of the virtual sound card; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;

the sound switching module is used for switching the system sound of the first equipment to the virtual sound card simulated by the USB equipment through the identified port of the virtual sound card, and the virtual sound card is not connected with any power amplifier equipment;

the audio and video capture module is used for capturing the picture and the audio played by the first equipment;

and the audio and video transmitting module is used for transmitting the intercepted audio and video data to a first USB interface of the USB equipment through the USB interface of the first equipment.

According to the technical scheme, a virtual sound card is simulated through the screen transmission equipment, and after the screen transmission equipment is connected with the display source equipment through a USB (universal serial bus), system sound of the display source equipment is switched to the virtual sound card simulated by the screen equipment; and meanwhile, the intercepted audio and video data of the display source equipment is forwarded to the corresponding display equipment through the USB interface of the screen transmission equipment. The display source device end can not play sound through the power amplifier any longer, and the problem that the display source device and the display device generate sound simultaneously and have interference when the screen transmission related to the sound is overcome.

Drawings

FIG. 1 is a schematic diagram of a system environment for implementing a USB cable screen transmission method according to the present invention;

FIG. 2 is a schematic flow chart diagram of a USB cable screen transfer method according to an embodiment;

FIG. 3 is a detailed flowchart of a USB cable screen transmission method according to an embodiment;

FIG. 4 is a schematic flow chart of a USB cable screen transmission method according to a second embodiment;

FIG. 5 is a detailed flowchart of a method for displaying a USB cable screen of a source device according to a second embodiment;

FIG. 6 is a schematic flow chart of a USB cable screen transmission method according to a third embodiment;

FIG. 7 is a detailed flowchart of a method for displaying a USB cable screen of a device according to a third embodiment;

FIG. 8 is a schematic block diagram of a USB cable screen device according to an embodiment;

FIG. 9 is a schematic configuration diagram of a USB cable screen apparatus of the second embodiment;

fig. 10 is a schematic configuration diagram of a USB cable screen apparatus according to a third embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Fig. 1 is a schematic diagram of a system environment for implementing the method for wired screen transmission according to the present invention. As shown in fig. 1, the system environment of the embodiment of the present invention includes a display source device (i.e., a first device), a screen transfer device (i.e., an analog USB device), and a display device (i.e., a second device). The display source device can be a device or a system such as a PC (personal computer), a mobile phone and the like running with an operating system, and the system is provided with at least one pre-installed universal driver which provides a universal communication protocol for communication between the first device and the standard USB device. The display source device is also provided with at least one USB interface (namely a USB interface D/a third USB interface), and the attribute of the USB interface is set as a USB host. The display device is a device or system running an operating system, such as a large-screen electronic whiteboard, and is further provided with at least one USB interface (i.e., a USB interface a/a fourth USB interface), and the attribute of the USB interface is set as a USB host.

The screen transmission equipment is provided with a USB interface, a memory and a processor. The USB interfaces comprise a USB interface C and a USB interface B (namely a first USB interface and a second USB interface), and the attributes of the two USB interfaces are USB devices which are respectively used for being connected with the display source equipment and the display equipment. An embedded operating system can be operated in the screen transmission equipment and is connected with the display source equipment through a USB interface C; the USB interface B may be a common USB interface, and is used for being connected to a display device such as an intelligent tablet (or other large-screen device), and is driven and identified by a system of the display device. The screen transmission equipment can be combined with the USB wire to form a customized special USB wire, and can also exist in a mode of combining the USB dongle with the screen transmission equipment and the standard USB wire. One of the purposes of the memory is a downloader required for storing a specific program or programs required for the display source device or the display device. The screen transmission device can directly obtain power supply through the USB interface of the display source device or the USB interface of the display device.

Based on the system environment diagram shown in fig. 1, fig. 2 is a schematic flow chart of a USB wired screen transmission method according to an embodiment; in this embodiment, the method is applied to a screen transmission device as an example, where the screen transmission device includes a first USB interface and a second USB interface, and the first USB interface and the second USB interface are respectively used for accessing a display source device and a display device.

As shown in fig. 2, the method for transmitting a USB cable screen in this embodiment includes the steps of:

s11, providing a plurality of communication protocol ports for the first equipment through the first USB interface of the local terminal, wherein the communication protocol ports can be identified by the universal driver of the first equipment, and the universal driver provides a universal communication protocol for communication between the first equipment and the standard USB equipment;

in this embodiment, the first device is a display source device, and the local terminal refers to a screen transmission device. The screen transmission equipment can be simulated into a plurality of types of standard USB equipment and provides corresponding communication protocol ports, and the communication protocol ports at least comprise: the port used for transmitting audio and video data and the port of the virtual sound card. Correspondingly, at the display source device end, the pre-installed universal driver is also provided with a corresponding communication protocol port. The display source device is preinstalled with a universal driver which can independently drive different types of standard USB devices, the screen transmission device is simulated into the standard USB device, and the display source device can recognize the standard USB device without driving (namely, the display source device can recognize the standard USB device through the universal driver without a specific universal driver).

In this embodiment, the USB interface is a physical concept, and the communication protocol ports provided through the USB interface are abstract concepts facing the USB connection service, and different communication protocol ports can be distinguished through corresponding port identifiers, for example, through port numbers. In this embodiment, the port identifier of each communication protocol port can be identified by the universal USB driver, and the processor in the screen transmission device also receives and transmits various types of information (including audio/video data or control signals) through the port identifier of the communication protocol port, so as to realize the reception and transmission of various types of information through the same physical interface.

Correspondingly, the screen transmission device can be simulated into a plurality of types of standard USB devices, which means that the screen transmission device can enumerate a plurality of standard USB communication protocol ports based on a universal standard USB communication protocol, and different USB communication protocol ports are distinguished by adopting different port identifiers.

S12, establishing a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface;

preferably, the communication protocol port further includes: and a port for transmitting connection information. When the screen transmission equipment confirms that the USB communication connection between the screen transmission equipment and the first equipment is established, a connection success instruction can be generated; and adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first equipment through the first USB interface.

S13, instructing the first device to switch the system sound to a virtual sound card simulated at the home terminal through a port of the virtual sound card, wherein the virtual sound card is not connected with any power amplifier device;

in this embodiment, a virtual USB sound card is simulated in advance through the first USB interface of the screen transmission device, and after the screen transmission device is connected to the display source device in a USB manner, the display source device can automatically identify the virtual USB sound card and switch the system sound to the local simulated virtual sound card. For a display source device (such as a PC), when a USB interface is plugged into a screen transmission device, a virtual sound card, which is simulated by the screen transmission device, is automatically detected by the system, so that the display source device can switch its system sound to the virtual sound card. Because the virtual USB sound card is not connected with an actual power amplifier, the mode can not cause system sound abnormity of the display source equipment, and the display source equipment can not sound, which is similar to a mute effect.

S14, detecting that the first USB interface has information from the first device, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; the audio and video data are forwarded to second equipment through a second USB interface of the local terminal, and the second equipment is instructed to play corresponding audio and video after receiving the audio and video data;

in this embodiment, the second device is a display device.

In this embodiment, the display source device is installed with corresponding client software for receiving a screen transmission operation of a user. The communication protocol port further comprises: a port for accessing a memory space. After the display source equipment is successfully connected with the screen transmission equipment, if a software program for intercepting a currently played display picture and audio is installed in advance in the display source equipment, the currently played display picture and audio are intercepted through the software program, and are sent to the screen transmission equipment after being packaged (in this case, the screen transmission equipment is equivalent to simulated USB equipment); if the display source device is not provided with the software program for intercepting the currently played display picture and audio, the data or the software program for intercepting the currently played display picture and audio stored in the memory of the screen transmission device can be read by accessing the memory (storage space) of the screen transmission device, and the software program is packaged (in this case, the screen transmission device is equivalent to an external USB (universal serial bus) disk), and then the packaged audio and video data is sent to the screen transmission device (in this case, the screen transmission device is equivalent to a simulated USB device). The second mode has lower requirements on the display source device, and can realize related functions by accessing the memory of the screen transmission device even if corresponding programs are not pre-installed, for the display source device (such as a PC), when the USB interface is inserted into the screen transmission device, a 'movable disk' can be seen in the root directory of the 'my computer', namely, the pre-simulated storage space of the screen transmission device, so that the display source device can run pre-stored application programs from the 'movable disk', and further realize the plug-and-play effect. And after the audio and video data are received by the screen transmission equipment from the USB interface C, the audio and video data are forwarded to the display equipment through the USB interface B, so that the screen transmission display of the audio and video data is realized.

The execution sequence of steps S13 and S14 is not limited to the above sequence, and the execution sequence of the two parts may be switched or may be executed simultaneously.

In a traditional screen transmission mode based on a touch screen display device, if an operation signal of a first device detected by the display device needs to be fed back to a computer terminal, a connecting line for transmitting a control signal needs to be added between the computer and the display device. Therefore, two or more connecting wires (HDMI cable + USB cable/RS 232 cable, VGA cable + audio cable + USB cable or RS232 cable, etc.) are required between the computer and the display device. The problem that the wiring is complex and the requirement on the professional level of a user is high exists. To further solve the problem, as a preferred embodiment, the communication protocol port further includes a port for transmitting a manipulation signal; further, the USB wired screen transmission method of the present embodiment further includes the steps of: and when detecting that the second USB interface of the screen transmission equipment has the control signal from the second equipment, adapting the control signal to a port for transmitting the control signal, sending the control signal to the first equipment through the first USB interface of the screen transmission equipment, and indicating the first equipment to execute an action corresponding to the control signal after receiving the control signal.

Therefore, in this embodiment, the screen transfer device may further receive a control signal of the display device from the USB interface B, the display device and the screen transfer device may send the control signal based on the predetermined port information, and the screen transfer device adapts the control signal of the display device to the port for transmitting the manipulation signal after receiving the control signal, so that the manipulation signal of the display device may be transmitted back to the display source device through the USB interface C, so that the display source device converts the manipulation signal into a corresponding manipulation event and executes a corresponding manipulation action. For example: the touch event is converted into the HID touch event by the touch screen device, the HID touch event is simulated into the HID touch device, the HID touch event is submitted to the display source device system through the USB interface C, and for the display source device system, the touch event of the HID touch device is processed in a conventional mode. The types of the manipulation signal include: touch control signals, infrared remote control signals or mouse/keyboard control signals and the like; the action corresponding to the control signal can be any action which can be executed at the display source device.

Based on the USB wired screen transmission method, on one hand, various USB communication protocol ports required to be used can be provided for common display source equipment, the display source equipment can recognize the USB wired screen transmission method without driving, and the corresponding audio and video data interception function can be completed according to data information stored in the screen equipment, so that the plug and play effect is realized; the transmission screen connection between the display source equipment and the display equipment can be realized only by one connecting line, and the transmission of control signals of the display equipment can be realized, so that the wiring of transmission screen display is simplified; more importantly, a virtual sound card is simulated through the screen transmission equipment, and after the screen transmission equipment is connected with the display source equipment through a USB, system sound of the display source equipment is switched to the virtual sound card simulated by the screen equipment; and meanwhile, the intercepted audio and video data of the display source equipment is forwarded to the corresponding display equipment through the USB interface of the screen transmission equipment. The display source device end can not play sound through the power amplifier any longer, and the problem that the display source device and the display device generate sound simultaneously and have interference when the screen transmission related to the sound is overcome.

It is understood that, in the present embodiment, the port for transmitting connection information and the port for transmitting audio/video information may be an HID1 port and an HID2 port, respectively; the port for transmitting the memory access instruction may be a Mac type port. In other words, in this embodiment, the screen transmission device may be simulated as multiple types of communication protocol ports capable of being identified by the display source terminal without driving through the USB interface C according to actual needs, and can be driven by the general driver of the display source terminal respectively and independently, and respectively used for transmitting different types of data information.

FIG. 3 is a detailed flowchart of a USB cable screen transmission method according to an embodiment; referring to fig. 3, the screen transmitting device detects that the USB interface C has information from the display source device, detects a communication protocol port for transmitting the information, and identifies the information as a return request command if the port is a port for transmitting a return request; and forwarding the return request instruction to the display equipment through the USB interface B so that the display equipment returns the detected control signal. Specifically, the screen transmission device needs to execute the following steps:

s101, after a screen transmission device processor program starts to run, simulating the screen transmission device processor program into a virtual USB sound card through a USB interface C, wherein the virtual USB sound card can be identified by display source equipment provided with a universal drive in a drive-free mode.

S102, detecting whether the USB interface C has the display source equipment which meets the requirement;

and detecting whether the USB interface C is connected with equipment, and if so, further detecting whether the equipment is display source equipment meeting the requirements. And if the display source equipment meets the requirements, the display source equipment is instructed to switch the system sound of the display source equipment to a local-end simulated virtual sound card through a port of the virtual sound card, and the virtual sound card is not connected with any power amplifier equipment.

S103, detecting whether the USB interface B has the display equipment which meets the requirement to be accessed;

and detecting whether the USB interface B is connected with equipment, and if so, further detecting whether the equipment is display equipment meeting the requirements.

It is understood that the execution sequence of steps S102 and S103 is not limited to the example in the figure, and step S103 may be executed first, and then step S102 may be executed; or both parts may be performed simultaneously.

S104, generating a connection success instruction and confirming that the screen transmission connection is successful;

in this embodiment, the connection success instruction is adapted to a port for transmitting connection information, and is sent to the first device through the USB interface C; meanwhile, based on the protocol rule preset with the display device, a connection success instruction is sent to the display device through the USB interface B.

S105, detecting whether the USB interface C has audio and video file streams from the display source equipment;

in this embodiment, after detecting that the USB interface C has information from the display source device, the screen transmission device further detects a communication protocol port for transmitting the information, and if the port is a port for transmitting audio/video data, the information may be identified as the audio/video data.

In this embodiment, the screen transmission device further provides a port for accessing the storage space to the display source device. Before the step, if the screen transmission device detects that the USB interface C has information from the display source device, a communication protocol port for transmitting the information is further detected, if the port is used for accessing the storage space, the information is identified as a storage space access instruction, and the screen transmission device displays content information of a preset storage space to the display source device, so that a system interface of the display source device can be used for intercepting and capturing pictures and audio played by the display source device by operating a program of the storage space. An exe executable program for intercepting audio and video data or download information of a corresponding program is stored in a storage space of the screen transmission device. Therefore, the display source device is used for capturing the currently played picture or audio by accessing the information of the storage space of the screen transmission device.

And S106, forwarding the audio and video file stream received by the USB interface C to the display equipment through the USB interface B.

In this embodiment, after the audio and video data is received by the screen transmission device, the received audio and video data can be identified according to the communication protocol port adopted by the screen transmission device, and the audio and video data is directly forwarded to the second device through the USB interface B.

As a preferred embodiment, after recognizing that the received audio and video data is received, the screen transmission device also monitors whether a preset trigger control signal for indicating information forwarding exists, and if the trigger control signal is monitored, forwards the audio and video data to the second device through the USB interface B. The trigger control signal may be an operation signal that a preset button of the screen transmission device is pressed, or may be a specific touch control signal generated on a human-computer interaction interface provided by the screen transmission device, that is, a user may control the forwarding of audio and video data by the screen transmission device in a hardware trigger mode/a software trigger mode, so as to flexibly control the effect of the screen transmission display.

S107, detecting whether the USB interface C has a return request instruction from the display source equipment;

in this embodiment, if the screen transmission device detects that the USB interface C has information from the display source device, a communication protocol port for transmitting the information is detected, and if the port is a port for transmitting the return request, the information may be identified as the return request instruction.

And S108, forwarding the received return request instruction to the display equipment through the USB interface B.

It can be understood that the above-mentioned trigger mechanism for forwarding audio and video data is also suitable for triggering the screen transmission device to forward the return request instruction, that is, the screen transmission device can also be controlled to forward the return request instruction by a hardware trigger mode/a software trigger mode.

In this embodiment, the screen transmitting device sends the received return request command to the display device through the USB interface B according to the protocol rule agreed between the screen transmitting device and the display device.

It is understood that the execution sequence of steps S105 and S106 and steps S107 and S108 is not limited to the example in the figure, and steps S107 and S108 may be executed first, and then steps S105 and S106 may be executed; or both parts are executed in parallel according to respectively set time intervals.

S109, detecting whether the USB interface B has a control signal from the display equipment;

in this embodiment, the screen transmission device may detect whether the information received by the USB interface B from the display device is a control signal according to a protocol rule agreed with the display device.

S110, the control signal is adapted to a corresponding port which is provided by the screen transmission device for the display source device and used for transmitting control information, and the control signal is sent to the display source device through the USB interface C, so that the display source device executes an action corresponding to the control signal, and the effect of controlling the display source device at the display device end is achieved.

It can be understood that the above-mentioned trigger mechanism for forwarding audio and video data is also suitable for triggering the screen transmission device to forward the control signal, that is, the screen transmission device can also be controlled to forward the control signal in a hardware trigger mode/software trigger mode, so as to flexibly control the effect of remote control.

In the wired screen transmission method of the embodiment, the virtual USB sound card and the standard USB device are simulated in advance, and the port of the virtual sound card indicates the display source device to switch the system sound to the virtual sound card simulated at the local terminal, so that the display source device does not sound and the sound abnormality of the display source device is not caused, thereby overcoming the interference problem that the display source terminal and the display device terminal sound at the same time; providing a plurality of communication protocol ports required by the display source equipment through the simulated standard USB equipment so as to establish wired screen transmission connection between the display source equipment and the display equipment through the simulated USB equipment; when detecting that a first USB interface of the simulated USB equipment has information from display source equipment, detecting a communication protocol port for transmitting the information, and if the port is used for transmitting audio and video data, identifying the information as the audio and video data; the audio and video data are forwarded to display equipment through a second USB interface of the local terminal, so that corresponding audio and video are played on the display equipment; when the second USB interface of the simulated USB equipment is detected to have the control signal from the display equipment, the control signal is adapted to the port for transmitting the control signal and is sent to the display source equipment through the first USB interface, so that the display source equipment executes the action corresponding to the control signal, and the effect of controlling the display source equipment at the display equipment end is achieved. Based on the simulation USB device, the display source device and the display device can realize the screen transmission display of audio and video data only by one connecting wire, and meanwhile, the back transmission of control signals of the display device can also be realized, so that the wiring for screen transmission display is simplified, and the wiring difficulty of a user is reduced.

FIG. 4 is a schematic flow chart of a USB cable screen transmission method according to a second embodiment; the present embodiment is applicable to a display source device. As shown in fig. 4, the method for USB wired screen transmission in this embodiment includes the following steps.

Step S21, identifying a communication protocol port provided by a currently accessed USB device (screen transfer device) through a pre-installed generic driver of a first device (display source device), where the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol port at least includes: the port used for transmitting audio and video data and the port of the simulated virtual sound card; the USB equipment is provided with a first USB interface, the USB equipment is connected with the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;

in the embodiment, a USB interface C of the screen transmission device is in butt joint with a USB interface D of the display source device, and the attribute of the USB interface D is a USB host; the display source device refers to a device serving as a display source.

Step S22, switching the system sound of the first device to the virtual sound card simulated by the USB device through the identified port of the virtual sound card, wherein the virtual sound card is not connected with any power amplifier device;

in this embodiment, the pre-installed general driver of the display source device can automatically identify the virtual sound card simulated by the USB device, and after identifying the virtual sound card, the port of the virtual sound card provided by the USB device instructs the display source device to switch the system sound to the virtual sound card simulated at the local end, so that the display source device does not sound and the sound abnormality of the display source device is not caused.

Step S23, capturing the picture and audio played by the first device; and sending the intercepted audio and video data to a first USB interface of the USB equipment through the USB interface of the first equipment.

In this embodiment, the communication protocol port further includes: a port for accessing a memory space. The way of capturing the picture and audio played by the display source device may be: the method is realized by running a program stored in the screen transmission device, and specifically includes the following steps: generating a storage space access instruction according to user operation of a display source device, adapting the access instruction to a port for accessing a storage space, sending the access instruction to a USB interface C of the USB device so as to access a preset storage space of the USB device, and operating a program of the preset storage space through a system interface of the display source device so as to intercept and capture pictures and audio played by the display source device. Therefore, the corresponding program does not need to be installed in the display source equipment in advance, and convenience is provided for the user.

Preferably, the program of the preset storage space of the USB device can be run through a system interface of the display source device to compress and/or encode the captured audio and video data, so as to facilitate transmission.

The execution sequence of steps S22 and S23 is not limited to the above sequence, and the execution sequence of the two parts may be switched or may be executed simultaneously.

In a preferred embodiment, the communication protocol port further includes a port for transmitting a manipulation signal; correspondingly, the USB wired screen transmission method further comprises the following steps: the display source equipment receives information from a first USB interface of the USB equipment and detects a communication protocol port for transmitting the information; and if the terminal is a port for transmitting the control signal, identifying the information as the control signal, and enabling the display source equipment to execute the action corresponding to the control signal.

Preferably, the user of the display source device may select whether to start the back transmission function of the control signal according to actual needs, and if so, after the connection is successfully established, the user may send a back transmission request to the display device through the screen transmission device, and the communication protocol port further includes: a port for transmitting backhaul requests. The specific mode is as follows: acquiring return request identification bit information preset by display source equipment, and determining whether a return request function of the display source equipment is in an open state or not according to the return request identification bit information; if yes, generating a return request instruction; and adapting the return request instruction to a port for transmitting the return request, sending the return request instruction to a USB interface C of the screen transmission equipment, and sending the return request instruction to the display equipment through a USB interface B of the screen transmission equipment.

FIG. 5 is a detailed flowchart of a USB cable screen transmission method according to a second embodiment; referring to fig. 5, the steps to be performed by the source device are shown as follows:

s201, running a general driver of a display source device, and detecting whether a USB device (namely a screen transmission device) with a specific ID (PID/VID) meeting the characteristics of the screen transmission device is accessed in a system background;

in this embodiment, the screen transmission device is virtually modeled into a virtual sound card through a USB interface connected to the display source device, and the virtual sound card can be automatically identified by a general driver pre-installed in the display source device.

S202, if the virtual sound card exists, switching system sound of display source equipment to the virtual sound card simulated by the USB equipment through the identified port of the virtual sound card, wherein the virtual sound card is not connected with any power amplifier equipment; whether a connection success instruction sent by the screen transmission equipment is received or not is confirmed;

in this embodiment, the universal driver of the display source device detects information received by the USB interface D of the display source device from the USB interface C of the screen transfer device, detects a communication protocol port for transmitting the information, and if the port is used for transmitting connection information, can identify whether the information is a connection success instruction according to the content of the signal.

S203, if the video and/or audio are received, the currently played picture and/or audio of the display source equipment are intercepted, then the video and/or audio are compressed or coded into a specific file format, and then the video and audio are sent to the connected screen transmission equipment;

preferably, the port for accessing the storage space can be obtained from a communication protocol port provided by the screen transmission device to the display source device; and generating a storage space access instruction according to the user operation of the display source end, adapting the access instruction to the port for accessing the storage space, sending the access instruction to the USB interface C of the screen transmission equipment so as to access the preset storage space of the screen transmission equipment, and operating a program of the preset storage space through a system interface of the display source equipment so as to intercept and capture the picture and the audio played by the display source equipment. Therefore, the display source equipment does not need to be pre-installed with a corresponding program, and convenience is provided for a user.

And the program in the preset storage space of the screen transmission device can be operated through the system interface of the display source device to compress and/or encode the audio and video data so as to facilitate transmission. Because the interception code is stored in a U disk simulated by the screen transmission device, after the display source device is connected to the screen transmission device, exe program data stored in the screen transmission device can be viewed through a USB communication protocol port pre-simulated by a USB interface of the screen transmission device, and pictures and/or audio (including sound data and audio adjustment information such as volume, sound channel and the like) currently played by the display source device can be intercepted by running a related program in the screen transmission device.

S204, confirming whether a return request function switch of the display source equipment is turned on (the user can select to turn on or turn off);

in this embodiment, after the connection is successful, whether the current backhaul request function of the display source device is in an on state may be determined by reading backhaul request flag bit information preset by the display source device.

S205, if the mobile terminal is opened, sending a return request instruction to screen transmission equipment;

if the current return request function of the display source equipment is in an open state, generating a return request instruction according to user operation; acquiring a port for transmitting a return request from a communication protocol port provided by a screen transmission device for a display source device; and the data is sent to a USB interface C of the screen transmission equipment and is sent to the display equipment through a USB interface B of the screen transmission equipment.

S206, detecting whether a control signal returned by the USB interface C of the screen transmission equipment is received;

and S207, if the control signal returned by the screen transmission equipment is received, executing a corresponding response action.

In this embodiment, the detection USB interface D receives information from the USB interface C of the screen transmission device, detects a communication protocol port for transmitting the information, and if the detection USB interface D is a port for transmitting the control signal, the returned control signal can be identified in a conventional manner for processing the control signal of the external HID device, and the first device is enabled to execute an action corresponding to the control signal.

It is understood that the execution sequence of steps S204 and S205 and steps S206 to S207 is not limited to the example in the figure, and steps S206 to S207 may be executed first, and then steps S204 and S205 may be executed; or both parts are executed in parallel according to respectively set time intervals.

According to the wired screen transmission method, standard USB equipment is simulated in advance, a plurality of communication protocol ports required by the display source equipment are provided for the display source equipment through a USB interface of the simulated USB equipment, and wired screen transmission connection between the display source equipment and the display equipment is established through the simulated USB equipment; the requirement on the display source equipment is reduced, plug-and-play is realized, the display source equipment and the display equipment can realize the screen transmission display of audio and video data only by one connecting line, the back transmission of control signals of the display equipment can also be realized, the effect of controlling the display source equipment at the display equipment end is realized, the wiring of screen transmission display is simplified, and the wiring difficulty of a user is reduced.

FIG. 6 is a schematic flow chart of a USB cable screen transmission method according to a third embodiment; the present embodiment is applicable to a display device. As shown in fig. 6, the method for USB wired screen transmission in this embodiment includes the following steps.

S31, detecting that the USB device is accessed in the USB interface of the second device, and identifying whether the USB device is the USB device meeting the requirement; the USB equipment is provided with a second USB interface, and the USB equipment is accessed to the USB interface of the second equipment through the second USB interface;

in this embodiment, when it is detected that the USB interface a of the display device has a USB device access, whether the current access is the screen transfer device may be determined according to the PID and/or VID of the USB device. The display device is used for displaying audio and video information, and the attribute of the USB interface A is a USB host. The USB equipment is virtually modeled into a virtual sound card through a USB interface connected with the display source equipment, and the virtual sound card can be automatically identified by a general driver preinstalled in the display source equipment.

S32, if the device is a USB device which meets the requirement, receiving audio and video data forwarded by a second USB interface of the USB device through the USB interface of the second device, and playing corresponding audio and video on the second device;

preferably, after detecting that the screen transmission device meeting the requirement is accessed to the USB interface a of the display device, a connection response signal may be generated and sent to the USB interface B of the screen transmission device to inform the screen transmission device that the display device meets the requirement of audio/video transmission display, and the screen transmission device may determine whether the connection is successful according to the information.

In this embodiment, in order to facilitate transmission, the audio/video data is compressed and/or encoded at the display source, and correspondingly decompressed and/or de-encoded at the display device, and then the corresponding picture and/or audio is played at the display device after the processing.

S33, acquiring a control signal of the first device detected by the second device, and sending the control signal to the second USB interface of the USB device, so as to return to the first device through the first USB interface of the USB device, and instruct the first device to execute an action corresponding to the control signal after receiving the control signal;

the types of the control signal in this embodiment may include: a touch control signal, an infrared remote control signal or a mouse/keyboard control signal; the action corresponding to the control signal can be any action which can be executed at the display source device.

FIG. 7 is a detailed flowchart of a USB cable screen transmission method according to a third embodiment; referring to fig. 7, the steps to be performed by the display device are as follows:

s301, after the system program of the display device runs, whether a USB device (namely, a screen transmission device) with a specific ID is accessed or not is detected.

In this embodiment, the ID is a USB ID (PID or VID) of the screen transfer device preset in the program; therefore, whether the screen transmission equipment is connected to the USB interface A of the display equipment or not is detected.

S302, if the access of the screen transmission equipment is detected, sending data information with a specified format through a USB interface A, and informing that the local end of the screen transmission equipment meets the requirement of audio and video transmission and display;

S303, detecting whether an audio and video file stream is transmitted from a USB interface B of the screen transmission equipment;

the display device can be a customized terminal, so that the signal type transmitted by the USB interface B of the screen transmission device can be automatically identified. Namely, the display device can identify whether the screen transmission device sends audio and video data or transmits back a request instruction or a successful connection instruction.

In this embodiment, the audio/video file stream is data that is subjected to compression and encoding processing.

And S304, if the audio and video file stream transmitted by the screen transmission device is received, decompressing or decoding the audio and video file stream to obtain audio and video data, and further outputting a corresponding picture and a corresponding audio to realize screen transmission display of the display device and the display source device.

Preferably, the display device may further reply a preset message to the screen transmission device, and forward the preset message to the display source device through a communication protocol port pre-simulated by the screen transmission device, so as to notify the display source device that the screen transmission display is successful.

S305, detecting whether a control signal is transmitted back by a USB interface B of the screen transmission equipment;

in this embodiment, the display device may detect information from the USB interface B of the screen transmission device, and identify whether the information is a return request command.

S306, if the control signal return request is detected, acquiring a control signal of the display source device detected by the local terminal, and sending the control signal to the screen transmission device.

The display device obtains a control signal for controlling the display source device, which is detected by the local terminal, by running a preset program, wherein the signal type includes but is not limited to a touch control signal, an infrared remote control signal or a mouse/keyboard control signal.

Through the USB wired screen transmission method of the embodiment, the screen transmission equipment can be simulated into a plurality of types of USB equipment through the USB interface, so that the display source equipment can be free from special drive identification. The screen transmission equipment can also obtain the data stream of the control signal from the display equipment and adapt to the corresponding port provided for the display source equipment for transmission; the code for intercepting the audio and video data is a system interface of the display source equipment, but the corresponding exe program data can be stored in a U disk simulated by the screen transmission equipment. The screen transmission device is also simulated into a USB storage device, and program data or a program downloader used for data communication and capturing audio and video data of the display source device is stored. After the display source device and the screen transmission device are connected through the USB, the USB storage device simulated by the screen transmission device can be accessed to run corresponding exe program data for capturing the picture or audio of the display source device. The display source device can also pack audio and video data according to an agreed protocol by operating corresponding exe program data stored in the screen transmission device, the audio and video data are transmitted to the screen transmission device through a corresponding communication protocol port provided for the display source device by the screen transmission device, and the screen transmission device receives a data packet from the USB interface C and directly transmits the data packet to the display device through the USB interface B without changing the packet content. And the display equipment receives the data packet, analyzes the protocol and the packet content, and then decodes the audio and video data for playing.

The display device software can also acquire a touch operation signal (or other types of control signals) of the user to the display source device through the display device, and the touch operation signal is returned to the screen transmission device through the USB interface A, and the screen transmission device adapts the operation signal to the corresponding communication protocol port, and then submits the operation signal to the display source device for execution. The display source device identifies the transmitted touch operation signal according to the corresponding communication protocol port provided by the USB interface C of the screen device, and converts the touch operation signal into a control event (the process of converting the touch operation signal into the touch event is supported by the operating system of the display source device, and WINDOWS/MAC both have the function), so that the display source device executes an action corresponding to the control signal.

It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present invention is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present invention.

Based on the same idea as the USB wired screen transmission method in the above embodiment, the present invention further provides a USB wired screen transmission device and system, and the device and system can be used to execute the USB wired screen transmission method. For convenience of description, the structural schematic diagram of the embodiment of the USB cable screen device and system only shows the parts related to the embodiment of the present invention, and those skilled in the art will understand that the illustrated structure does not constitute a limitation to the device and system, and may include more or less components than those illustrated, or combine some components, or arrange different components.

Fig. 8 is a schematic structural diagram of a USB wired screen transmission device according to an embodiment of the present invention, and as shown in fig. 8, the USB wired screen transmission device according to the embodiment includes: a port simulation module 510, a connection establishment module 520, a virtual sound card module 530, and an audio/video data forwarding module 540, which are detailed as follows:

the port simulation module 510 is configured to provide a plurality of communication protocol ports to the first device through the first USB interface of the local terminal, where the communication protocol ports are capable of being identified by a generic driver of the first device, the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol ports at least include: the port used for transmitting audio and video data and the port of the simulated virtual sound card;

the connection establishing module 520 is configured to establish a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface;

the virtual sound card module 530 is configured to instruct, through a port of the virtual sound card, the first device to switch the system sound of the first device to a local-end simulated virtual sound card, where the virtual sound card is not connected to any power amplifier device;

the audio/video data forwarding module 540 is configured to detect that the first USB interface has information from the first device, detect a communication protocol port for transmitting the information, and identify the information as audio/video data if the port is used for transmitting the audio/video data; and forwarding the audio and video data to second equipment through a second USB interface of the local terminal, and indicating the second equipment to play corresponding audio and video after receiving the audio and video data.

As a preferred embodiment, after the audio/video data forwarding module 540 identifies the information as audio/video data, it also monitors whether there is a preset trigger control signal for indicating information forwarding, and if it monitors the preset trigger control signal for indicating information forwarding, forwards the audio/video data to the second device through the second USB interface of the local terminal. The trigger control signal comprises an operation signal that a preset control button is pressed down and can also comprise a touch control signal monitored through a preset human-computer interaction interface. Therefore, the user can flexibly control the screen transmission display effect.

Preferably, the communication protocol port further includes: a port for transmitting connection information; correspondingly, the USB wired screen transmission device further includes a connection confirmation module (not shown in the figure) for generating a connection success instruction, adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first device through the first USB interface.

In a preferred embodiment, the communication protocol port further includes a port for transmitting a manipulation signal; correspondingly, the device for transmitting the screen through the USB cable further comprises:

the control signal returning module 550 is configured to adapt the control signal to a port for transmitting the control signal when detecting that the second USB interface has the control signal from the second device, and send the control signal to the first device through the first USB interface, so as to instruct the first device to execute an action corresponding to the control signal after receiving the control signal.

Preferably, the communication protocol port further includes: a port for transmitting a backhaul request; correspondingly, the USB wired screen transmission device further includes a return request module (not shown in the figure) for detecting that the first USB interface has information from the first device, detecting a communication protocol port for transmitting the information, and identifying the information as a return request instruction if the communication protocol port is a port for transmitting a return request; and forwarding the return request instruction to the second equipment through the second USB interface, and instructing the second equipment to return the detected control signal for the first equipment.

Preferably, the communication protocol port further includes: a port for accessing a memory space; correspondingly, the USB wired screen transmission device further includes a storage module 560, configured to detect that the first USB interface has information from the first device, detect a communication protocol port for transmitting the information, and identify the information as a storage space access instruction if the port is a port for accessing a storage space; and displaying the preset storage space to the first equipment, so that a system interface of the first equipment intercepts and captures the picture and the audio played by the first equipment by operating a program of the storage space.

In this embodiment, the attributes of the first USB interface and the second USB interface are both USB device; the first device is a display source device, and the second device is a display device.

Fig. 9 is a schematic configuration diagram of a USB cable screen apparatus of the second embodiment. As shown in fig. 9, the USB wired screen transmission device of the present embodiment includes:

a USB identification module 610, configured to identify, through a pre-installed generic driver, a communication protocol port provided by a USB device accessing a USB interface of a first device, where the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol port at least includes: the port used for transmitting audio and video data and the port of the simulated virtual sound card; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;

the sound switching module 620 is configured to switch a system sound of the first device to a virtual sound card simulated by the USB device through the identified port of the virtual sound card, where the virtual sound card is not connected to any power amplifier device;

the audio/video capture module 630 is configured to capture a picture and an audio played by the first device;

and the audio and video transmitting module 640 is configured to transmit the audio and video data to the first USB interface of the USB device through a designated port of the USB interface of the first device, where the designated port is adapted to a port for transmitting the audio and video data.

Preferably, the communication protocol port further comprises a port for transmitting a manipulation signal; correspondingly, the device for transmitting the screen through the USB cable further comprises:

a control signal receiving module 650, configured to receive information from the first USB interface of the USB device, and detect a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and enabling the first equipment to execute the action corresponding to the control signal.

Preferably, the communication protocol port further includes: a port for accessing a memory space; correspondingly, the audio/video capture module 630: the method specifically comprises the steps of adapting a generated access instruction to a port for accessing a storage space, sending the access instruction to a first USB interface of the USB device through a USB interface of the first device to access a preset storage space of the USB device, and operating a program of the preset storage space through a system interface of the first device to intercept and capture pictures and audio played by the first device.

In this embodiment, the first device is a display source device; the attribute of the first USB interface is USB device.

Fig. 10 is a schematic configuration diagram of a USB cable screen apparatus according to a third embodiment. As shown in fig. 10, the USB wired screen transmission device of the present embodiment includes:

the USB access detection module 710 is configured to detect that a USB device is accessed to the USB interface of the second device, and identify whether the USB device is a USB device that meets the requirement; the USB equipment is provided with a second USB interface, and the USB equipment is accessed to the USB interface of the second equipment through the second USB interface;

in this embodiment, the USB device, through a USB interface connected to the display source device, may virtually model a virtual sound card, and the virtual sound card may be automatically identified by a generic driver pre-installed in the display source device.

The audio/video data receiving module 720 is configured to receive, through a USB interface of a second device, audio/video data forwarded through a second USB interface of the USB device if the USB device meets the requirement, and play corresponding audio/video on the second device;

and a control signal sending module 730, configured to obtain a control signal of the first device detected by the second device, and send the control signal to the second USB interface of the USB device, so as to return to the first device through the first USB interface of the USB device, and instruct the first device to execute an action corresponding to the control signal after receiving the control signal.

In this embodiment, the second device is a display device, and the attribute of the second USB interface is USB device.

It should be noted that, in the implementation of the USB wired screen transmission device in the foregoing example, because the contents of information interaction, execution process, and the like between the modules/units are based on the same concept as that of the foregoing method embodiment of the present invention, the technical effect brought by the above method embodiment of the present invention is the same as that of the foregoing method embodiment of the present invention, and specific contents may refer to descriptions in the method embodiment of the present invention, and are not described herein again.

In addition, in the above exemplary embodiment of the USB cable screen device, the logical division of the functional modules is only an example, and in practical applications, the above functions may be distributed by different functional modules according to needs, for example, due to configuration requirements of corresponding hardware or due to convenience of implementation of software, that is, the internal structure of the USB cable screen device is divided into different functional modules to complete all or part of the above described functions. The functional modules can be realized in a hardware mode or a software functional module mode.

It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which is stored in a computer readable storage medium and sold or used as a stand-alone product. The program, when executed, may perform all or a portion of the steps of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments. It will be understood that the terms "first," "second," and the like as used herein are used herein to distinguish one object from another, but the objects are not limited by these terms.

The above-described examples merely represent several embodiments of the present invention and should not be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A USB wired screen transmission method is characterized by comprising the following steps:

providing a plurality of communication protocol ports for first equipment through a first USB interface of a local terminal, wherein the communication protocol ports can be identified by a universal driver of the first equipment; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port of the virtual sound card;

establishing a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface;

instructing the first device to switch system sound to a virtual sound card simulated at the home terminal through a port of the virtual sound card, wherein the virtual sound card is not connected with any power amplifier device;

2. The USB wired screen transmission method according to claim 1, wherein the communication protocol port further includes a port for transmitting a manipulation signal;

after establishing the USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface, the method further includes:

detecting that the second USB interface has a control signal from the second equipment, adapting the control signal to a port for transmitting the control signal, and sending the control signal to the first equipment through the first USB interface, and instructing the first equipment to execute an action corresponding to the control signal after receiving the control signal.

3. The USB wired screen transmission method according to claim 1, wherein the communication protocol port further comprises: a port for transmitting connection information;

and generating a connection success instruction, adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first equipment through the first USB interface.

4. The USB wired screen transmission method according to claim 1, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

the method for detecting the information from the first device on the first USB interface further comprises the following steps after detecting a communication protocol port for transmitting the information:

if the port is used for transmitting the return request, the information is identified as a return request instruction; and forwarding the return request instruction to the second equipment through the second USB interface, and instructing the second equipment to return the detected control signal for the first equipment.

5. The USB wired screen transmission method according to claim 1, wherein the communication protocol port further comprises: a port for accessing a memory space;

if the port is used for accessing the storage space, the information is identified as a storage space access instruction; and displaying the preset storage space to the first equipment, so that a system interface of the first equipment intercepts and captures the picture and the audio played by the first equipment by operating a program of the storage space.

6. The USB wired screen transmission method according to claim 1, wherein the step of forwarding the audio/video data to a second device through a second USB interface of a home terminal comprises:

and if a preset trigger control signal for indicating information forwarding is monitored, forwarding the audio and video data to second equipment through a second USB interface of the local terminal.

7. The USB wired screen transmission method according to any one of claims 1 to 6, wherein the attributes of the first USB interface and the second USB interface are both USB device;

the first device is a display source device and the second device is a display device.

8. A USB wired screen transmission method is characterized by comprising the following steps:

9. The USB wired screen transmission method according to claim 8, wherein the communication protocol port further includes a port for transmitting a manipulation signal;

after identifying a communication protocol port provided by a USB device connected to the USB interface of the first device through the pre-installed universal driver, the method further comprises the following steps:

receiving information from a first USB interface of the USB equipment through the USB interface of the first equipment, and detecting a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and controlling the first equipment to execute the action corresponding to the control signal.

10. The USB wired screen transmission method according to claim 8, wherein the communication protocol port further comprises: a port for accessing a memory space;

the step of capturing the picture and the audio played by the first device comprises the following steps:

and the generated access instruction is adapted to a port for accessing a storage space, and is sent to a first USB interface of the USB equipment through a first equipment USB interface so as to access a preset storage space of the USB equipment, and a program of the preset storage space is operated through a first equipment system interface so as to intercept and capture pictures and audio played by the first equipment.

11. The USB wired screen transmission method according to claim 8, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

acquiring backhaul request identification bit information preset by first equipment, and determining whether a backhaul request function of the first equipment is in an open state according to the backhaul request identification bit information; if yes, generating a return request instruction;

and adapting the return request instruction to a port for transmitting the return request, and sending the return request instruction to the USB equipment through a USB interface of the first equipment.

12. The USB wired screen transmission method according to claim 10, wherein before adapting the captured audio-video data to the communication protocol port, further comprising:

and operating a program of a preset storage space of the USB device through a first device system interface to compress and/or encode the intercepted audio and video data.

13. The method for transmitting the screen through the USB cable according to any one of claims 8 to 12, wherein the first device is a display source device, and the attribute of the USB interface of the first device is USB host; the attribute of the first USB interface is USB device.

14. A USB wired screen transmission device is characterized by comprising:

the connection establishing module is used for establishing the USB communication connection between the local terminal and the first equipment through the communication protocol port and the first USB interface;

the virtual sound card module is used for indicating the first equipment to switch the system sound of the first equipment to a local-end simulated virtual sound card through a port of the virtual sound card, and the virtual sound card is not connected with any power amplifier equipment;

15. The USB wired screen transfer device according to claim 14, wherein the communication protocol port further includes a port for transmitting a manipulation signal;

the USB wired screen transmission device further comprises:

and the control signal returning module is used for adapting the control signal to a port for transmitting the control signal and sending the control signal to the first equipment through the first USB interface if the second USB interface is detected to have the control signal from the second equipment, and instructing the first equipment to execute an action corresponding to the control signal after receiving the control signal.

16. The USB wired screen transfer device according to claim 14, wherein the communication protocol port further comprises: a port for transmitting connection information;

the USB wired screen transmission device further comprises:

and the connection confirmation module is used for generating a connection success instruction, adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first equipment through the first USB interface.

17. The USB wired screen transfer device according to claim 14, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

the USB wired screen transmission device further comprises:

the return request module is used for detecting that the first USB interface has information from the first equipment and detecting a communication protocol port for transmitting the information; if the port is used for transmitting the return request, the information is identified as a return request instruction; and forwarding the return request instruction to the second equipment through the second USB interface, and instructing the second equipment to return the detected control signal for the first equipment.

18. The USB wired screen transfer device according to claim 14, wherein the communication protocol port further comprises: a port for accessing a memory space;

the USB wired screen transmission device further comprises:

the storage module is used for detecting that the first USB interface has information from the first equipment and detecting a communication protocol port for transmitting the information; if the port is used for accessing the storage space, the information is identified as a storage space access instruction; and displaying the preset storage space to the first equipment, so that a system interface of the first equipment is used for intercepting and capturing pictures and audio played by the first equipment by operating a program of the storage space.

19. A USB wired screen transmission device according to any one of claims 14 to 18, wherein the first USB interface and the second USB interface are both USB devices.

20. A USB wired screen transmission device is characterized by comprising:

the USB identification module is used for identifying a communication protocol port provided by the USB equipment accessed to the USB interface of the first equipment through the pre-installed universal driver; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port of the simulated virtual sound card; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;

21. The USB wired screen transfer device according to claim 20, wherein the communication protocol port further comprises a port for transmitting a manipulation signal;

the control signal receiving module is used for receiving information from a first USB interface of the USB equipment through the USB interface of the first equipment and detecting a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and controlling the first equipment to execute the action corresponding to the control signal.

22. The USB wired screen transfer device according to claim 20, wherein the communication protocol port further comprises: a port for accessing a memory space;

the audio and video capture module: and the system interface is used for adapting the generated access instruction to a port for accessing a storage space, sending the access instruction to a first USB interface of the USB equipment through the USB interface of the first equipment so as to access a preset storage space of the USB equipment, and operating a program of the preset storage space through the system interface of the first equipment so as to intercept and capture pictures and audio played by the first equipment.

23. A USB wired screen transmission device according to any one of claims 20 to 22,

the first equipment is display source equipment, and the attribute of a USB interface of the first equipment is a USB host;

the attribute of the first USB interface is USB device.