WO2018090723A1

WO2018090723A1 - Method and apparatus for realizing wired screen delivery

Info

Publication number: WO2018090723A1
Application number: PCT/CN2017/103471
Authority: WO
Inventors: 庞远杨; 侯旻翔
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2016-10-12
Filing date: 2017-09-26
Publication date: 2018-05-24
Also published as: CN113965799A; CN107948568A; CN113965799B; CN107948568B

Abstract

The present invention relates to a method and apparatus for realizing wired screen delivery. The method comprises: based on a universal driver pre-installed by a first device, providing two or more communication protocol ports for the first device, and establishing a USB communication connection between a local end and the first device via the communication protocol ports and a first USB interface of the local end; when it is detected that there is information from the first device at the first USB interface, detecting a port for transmitting the information, and if the port is a port for transmitting audio and video data, recognizing the information as the audio and video data, and playing the corresponding audio and video at the local end; and acquiring a manipulation signal for the first device detected by the local end, adapting the manipulation signal to a port for transmitting the manipulation signal, and sending same to the first device via the first USB interface. The present invention can simplify the wiring during screen delivery, and reduce the wiring difficulty of a user.

Description

Method and device for realizing wired screen transmission

Technical field

The present invention relates to the field of data transmission technologies, and in particular, to a method and apparatus for implementing wired transmission.

Background technique

The implementation of the screen is that the display source device such as a computer intercepts the screen page and sound data of the system and sends it to the display device, and the display device decodes and displays and plays the transmitted picture and sound. The screen is often used in conferences or teaching areas. Users need to project the audio and video signals of the computer to the large-screen LCD whiteboard or projector for display. The audio and video data on the computer is sent to the display device through the corresponding data line. However, in the traditional screen display mode, the display device only serves as an information display function, and does not have the function of receiving a user operation instruction and returning the display source end, and is inconvenient for the user to perform a demonstration operation.

Based on this, in the screen mode based on the touch screen display device, it is proposed to feed back the touch control signal detected by the display device to the computer end. Correspondingly, a new control signal is needed between the computer and the display device. Connection line. Therefore, two or more connection cables (HDMI cable + USB cable / RS232 cable, VGA cable + audio cable + USB cable or RS232 cable, etc.) are required between the computer and the display device. There is a problem that the wiring is complicated and the professional level of the user is high.

Summary of the invention

Based on this, the method and device for implementing wired screen transmission provided by the embodiments of the present invention can simplify the wiring during the screen display and reduce the difficulty of wiring the user.

An aspect of the present invention provides a method for implementing a wired screen, including:

Providing, by the first USB interface preset by the local end, a plurality of communication protocol ports to the first device, the communication protocol port being capable of being recognized by the universal drive of the first device; the universal drive providing between the first device and the standard USB device a universal communication protocol for communication, the communication protocol port comprising at least a port for transmitting audio and video data and a port for transmitting a control signal;

Establishing a USB communication connection between the local end and the first device by using the communication protocol port and the first USB interface;

Detecting that the first USB interface has information from the first device, detecting a port transmitting the information, if it is a port for transmitting audio and video data, identifying the information as audio and video data; according to the audio and video data in the present Play the corresponding audio and video on the end;

Acquiring the control signal of the first device detected by the local end, adapting the control signal to the port for transmitting the control signal, and transmitting the signal to the first device through the first USB interface, indicating that the first device is receiving An action corresponding to the manipulation signal is performed after the manipulation signal.

Another aspect of the present invention provides a method for implementing wired screen transmission, including:

Identifying, by a pre-installed universal driver, a communication protocol port provided by a second device accessing the second USB interface of the local end, the universal driver providing a universal communication protocol for communication between the local terminal and the standard USB device, the communication protocol port Included at least: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is pre-configured with a first USB interface, and the second device passes the first The USB interface is connected to the second USB interface of the local device, and provides a plurality of communication protocol ports that can be recognized by the universal driving of the first device through the first USB interface;

Intercepting the picture and/or audio played by the local end;

Transmitting the intercepted audio and video data to a first USB interface of the second device through a designated port of the second USB interface of the local end, where the designated port is adapted to a port for transmitting audio and video data;

Receiving information from the first USB interface of the second device, detecting a port transmitting the information; if it is a port for transmitting a manipulation signal, identifying the information as a manipulation signal, and causing the first device to perform the Manipulate the corresponding action of the event signal.

Another aspect of the present invention provides an apparatus for implementing a wired screen, including:

The port simulation module provides a plurality of communication protocol ports to the first device through the first USB interface preset by the local end, and the communication protocol port can be recognized by the universal driver of the first device; the universal driver provides the first device and the standard A universal communication protocol for communication between USB devices, the communication protocol port comprising at least a port for transmitting audio and video data and a port for transmitting a control signal;

a connection establishing module, configured to establish a USB communication connection between the local end and the first device by using the communication protocol port and the first USB interface;

The audio and video data receiving module is configured to detect that the first USB interface has information from the first device, and detect a port that transmits the information, and if it is a port for transmitting audio and video data, identify the information as audio and video data; The corresponding audio and video is played on the local end according to the audio and video data received by the first USB interface;

The control signal returning module is configured to acquire a control signal for the first device detected by the local end, adapt the control signal to a port for transmitting the control signal, and send the first to the first USB interface through the local end And the device instructing the first device to perform an action corresponding to the control signal after receiving the control signal.

a USB identification module, configured to identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the local end, where the universal driver provides a universal communication protocol for communication between the local terminal and the standard USB device. The communication protocol port at least includes: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is pre-configured with a first USB interface, and the second device passes the first USB The interface is connected to the second USB interface of the local device, and provides a plurality of communication protocol ports that can be recognized by the universal driver of the first device through the first USB interface;

An audio and video intercepting module, configured to intercept a picture and/or audio played by the local end;

An audio and video sending module, configured to send the intercepted audio and video data to a first USB interface of the second device by using a designated port of the second USB interface of the local end, the designated port and a port for transmitting audio and video data Adapt

a control signal receiving module, configured to receive information from the first USB interface of the second device, detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a control signal, and The first device performs an action corresponding to the manipulation event signal.

The above technical solution, by simulating the display device into a standard USB device, and providing the display source device with a plurality of communication protocol ports required by the USB interface of the display device, through the communication protocol port, the USB interface of the display device, and the display Source device USB The interface establishes a USB communication connection between the display device and the display source device; when detecting that the USB interface of the display device has information from the display source device, detecting a port transmitting the information, if it is a port for transmitting audio and video data, The information is recognized as audio and video data, and the corresponding audio and video is played on the display device; and the control signal played by the display device to the display source device is obtained, and the control signal is adapted to the port for transmitting the control signal. And transmitting to the display source device through the USB interface of the display device, so that the display device performs an action corresponding to the control signal. Both the display source device and the display device can realize the transmission and display of audio and video data by only one connection line, and at the same time, realize the return transmission of the display device control signal, thereby realizing the effect of controlling the display source device on the display device side, simplifying the effect. The wiring displayed on the screen reduces the difficulty of wiring the user.

DRAWINGS

1 is a schematic diagram of a system environment for implementing a method for implementing wired screen transmission according to the present invention;

2 is a schematic flowchart of a method for implementing wired screen transmission according to an embodiment;

3 is a detailed flowchart of a method for implementing wired screen transmission according to an embodiment;

4 is a schematic flowchart of a method for implementing wired screen transmission in a second embodiment;

5 is a detailed flowchart of a method for implementing a wired screen transmission by a display source device according to a second embodiment;

FIG. 6 is a schematic structural diagram of an apparatus for implementing wired screen transmission according to an embodiment; FIG.

FIG. 7 is a schematic structural diagram of an apparatus for implementing wired screen transmission of the second embodiment.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

1 is a schematic diagram of a system environment for implementing a method for wired screen transmission of the present invention. As shown in FIG. 1, the system environment of the embodiment of the present invention includes a display source device (ie, a first device) and a display device (ie, a second device). The display source device may be a device or a system running an operating system, such as a PC or a mobile phone, and has at least one pre-installed universal driver in the system, and the universal driver provides universal communication between the display source device and the standard USB device. letter of agreement. The display source device is further configured with at least one USB interface (ie, a USB interface B/second USB interface), and the attribute of the USB interface is set to a USB host.

The display device is a device or system running an operating system, such as a large-screen electronic whiteboard, and the display device is provided with a memory and a processor; the display device is further preset with a USB interface (ie, USB interface A/first USB) Interface), the attribute of the USB interface is set to a USB device for interfacing with the USB interface B of the display source device; the processor runs a corresponding processor program, and can recognize the type of information received by the USB interface A; One of the uses of the memory is a downloader for storing a specific program or a specific program that is required to display the source device or the display device.

FIG. 2 is a schematic flowchart of a method for implementing wired screen transmission according to an embodiment of the present invention. In this embodiment, the method is applied to a display device end as an example. The display device includes a first USB interface for connecting to a second USB interface of the display source device.

As shown in FIG. 2, the method for implementing wired screen transmission in this embodiment includes the following steps:

S11, the first device is provided with a plurality of communication protocol ports by using the first USB interface preset by the local end, and the communication protocol port can be recognized by the universal driving of the first device; the universal driving device provides the first device and the standard USB device. a universal communication protocol for communication between, the communication protocol port at least comprising: a port for transmitting audio and video data and a port for transmitting a control signal;

In this embodiment, the local device refers to a display device, and the display device can be simulated into a standard USB device through its USB interface; the first device is a display source device, and the universal driver pre-installed by the display source device can independently drive different types. The standard USB device, the display source device can also be installed with corresponding client software for receiving the user's screen operation.

In this embodiment, the USB interface is a physical concept, and the communication protocol port provided through the USB interface is an abstract concept for the USB connection service. Different communication protocol ports can be distinguished by corresponding port identifiers, for example, by port number. distinguish. In this embodiment, the port identifiers of the communication protocol ports can be recognized by the universal USB driver, and the corresponding processor in the local end also performs various types of information (including audio and video data or control signals) through the port identifier of the communication protocol port. Transceiver, to achieve the transmission and reception of a variety of different types of information through the same physical interface.

Correspondingly, the display device can be simulated as a standard USB device, which means that the display device can enumerate several standard USB communication protocol ports based on a common standard USB communication protocol, and different USB communication protocol ports are distinguished by different port identifiers.

S12. Establish a USB communication connection between the second device and the first device by using the communication protocol port and the first USB interface of the second device.

In this embodiment, the second device is a display device, and the display device can be simulated into several types of standard USB devices and provide corresponding communication protocol ports. And the display device simulates a standard USB device, and the display source device can be recognized by the drive (ie, it can be recognized by the universal USB drive generally provided by the display source device system, and no specific universal drive is needed).

Preferably, the communication protocol port further includes: a port for transmitting connection information. Correspondingly, when the display device confirms that the accessed display source device meets the requirement, the connection success instruction may also be generated; and the connection success instruction is adapted to the port for transmitting the connection information, and is sent to the display through the first USB interface. The source device is configured to notify the display source device that the display device meets the requirements of the audio and video transmission display.

S13, detecting that the first USB interface has information from the first device, detecting a port that transmits the information, and if it is a port for transmitting audio and video data, identifying the information as audio and video data; according to the audio and video data. Playing the corresponding audio and video on the second device;

Preferably, the second device further needs to parse the audio and video data for decompression and/or decoding processing.

S14: Acquire a control signal detected by the second device, adapt the control signal to a port for transmitting a control signal, and send the first control device to the first device, indicating that the first device is receiving the The action corresponding to the manipulation signal is performed after the manipulation signal is described.

The corresponding action of the manipulation event signal may be any action that the first device can perform.

It should be noted that the execution order of the above steps S13 and S14 is not limited to the above sequence, and the execution order of the two parts may be changed, or may be performed simultaneously.

Preferably, the communication protocol port further includes: a port for accessing the storage space. After the display source device and the display device are successfully connected, if the display source device is pre-installed with a software program for intercepting the display screen and/or audio, the current broadcast is intercepted by the software program. The display screen and/or audio are displayed, and then sent to the display device after being packaged; if the display device does not pre-install such a software program, the memory of the display device can be read by accessing the memory (storage space) of the display device. The pre-stored data or program is used to intercept the currently displayed display screen and/or audio software program, and to package it (the display device is equivalent to an external USB flash drive), and the processed audio and video data will be packaged. The video is sent to the corresponding port and sent to the display device via USB interface B. The second way has lower requirements on the display source device, even if it does not pre-install the corresponding program, for the display source device (such as PC), when inserting the above display device, it will be in the "My Computer" root directory. When you see a "removable disk", which is the storage space of the display device, the display source device can run the pre-stored application from the "removable disk", thereby achieving a plug-and-play effect. The display device receives the audio and video data from the USB interface A, performs processing after the playback, and realizes the screen display of the audio and video data.

On the other hand, a control signal for playing back to the display source device detected by the display device may be acquired, and the control signal is adapted to a port for transmitting the control signal, and is transmitted back through the USB interface A of the display device, so that The display source device performs an action corresponding to the manipulation signal. For example, the display device converts the touch event into a HID touch event, which is modeled as an HID touch device, and submits the HID touch event to the display source device system via USB interface A. For the display source device system, the corresponding action is performed according to the received operation event in a manner that conventionally processes the operation event of the HID touch device.

Based on the above-mentioned wired transmission method, on the one hand, various types of USB communication protocol ports that need to be used for common display source devices can be provided, and ordinary display source devices can be protected from drive recognition, and can also be pre-stored data information according to display devices. Completing the corresponding audio and video data interception function, realizing the effect of plug and play; without additional intermediate screen device, only one USB cable can realize the limited screen connection of the display source device and the display device, and at the same time The backhaul of the display device control signal is realized, and the user can control the display source device on the display device side, which simplifies the wiring of the screen display.

It can be understood that the port for transmitting the connection information, the port for transmitting the audio and video information in the embodiment may be the HID1 port and the HID2 port respectively; and the port for transmitting the storage space access instruction may be the Mac type port. In other words, in the embodiment, the display device can be simulated by its USB interface A into multiple types of communication protocol ports that can be recognized by the display source device system, and several communication protocol ports can be displayed. The universal drives of the source devices are independently driven to transmit different data information.

3 is a detailed flowchart of a method for implementing wired screen transmission according to an embodiment; referring to FIG. 3, the display device detects that the USB interface A has information from the display source device, and detects a port that transmits the information, if used for transmission back. Transmitting the requested port, the information is identified as a backhaul request command, and the function of the display device for acquiring the detected manipulation signal to the first device is turned on. Specifically, the steps to be performed by the display device are as follows:

S101. After the display device processor program runs, detect whether the USB interface A is in compliance with the conditional display source device access.

Check whether the USB interface A has a device connection, and if so, further check whether the device is a display source device that meets the requirements. Specifically, whether the accessed device is a qualified display source device can be detected by using a specific ID (PID/VID).

S102. If the display source device is detected to be accessed, the processor program of the display device simulates the display device into a standard USB device through the USB interface A, so that the display source device with the universal driver can be discerned from the drive.

S103. Generate a connection success instruction, and confirm that the screen connection is successful.

In this embodiment, the connection success instruction is adapted to the port for transmitting the connection information, and is sent to the USB interface B of the display source device through the USB interface A, to inform the display source device that the local end meets the requirements of the audio and video transmission display.

S104. Detect whether the USB interface A of the display device has an audio and video file stream from the display source device.

In this embodiment, after detecting that the USB interface A of the display device has information from the display source device, the port for transmitting the information is further detected. If the port for transmitting audio and video data is used, the information may be recognized as audio and video. data.

In this embodiment, the display device further provides a port for accessing the storage space to the display source device. Before the step, if it is detected that the USB interface A of the display device has information from the display source device, detecting the port transmitting the information, if it is a port for accessing the storage space, identifying the information as a storage space access instruction; Displaying the preset storage space of the display device to the display source device such that the display source device system interface is used to intercept the screen and/or audio played by the display source device by running the program of the storage space. The preset storage space stores an exe executable program for intercepting audio and video data or downloads download information of the corresponding program. Therefore, the display source device can realize the function of intercepting the picture or audio played by the display device by accessing the storage space of the display device.

S105. The audio and video file stream received through the USB interface A is decompressed and/or decoded, and the corresponding picture and/or audio is played on the display device end.

As a preferred embodiment, after receiving the audio and video file stream, it also monitors whether there is a preset trigger control signal for indicating the screen display. If the trigger control signal is monitored, the audio and video file stream is decompressed. And/or decoding, and playing the corresponding audio and video on the local end according to the obtained audio and video data. The trigger control signal may be an operation signal that the local preset button is pressed, or may be a specific touch control signal generated on the preset human-machine interaction interface of the local end, that is, the user may trigger through the hardware/software. Trigger mode to control the display of audio and video data on the local end to flexibly control the effect of the screen display.

S106. Detect whether the USB interface A of the display device has a return request command from the display source device.

In this embodiment, if it is detected that the USB interface A of the display device has information from the display source device, detecting the port transmitting the information, if it is the port for transmitting the return request, the information may be identified as a backhaul request. instruction.

S107. If receiving a return request command from the display source device, start a function of the display device for acquiring the detected control signal to the display source device (or a thread running the corresponding function), and obtain the display device end to the display source. The control signal of the device.

S108. Adapt the control signal to a port for transmitting a manipulation signal, and send the signal to the display source device through the USB interface A of the display device, so that the display source device performs an action corresponding to the manipulation signal.

It can be understood that the triggering mechanism for displaying the audio and video data is also applicable to control the sending of the control signal by the local end to flexibly control the effect of the remote control.

It can be understood that the execution order of steps S104-S105 and steps S106-S108 is not limited to the example in the figure, and steps S106-S108 may be performed first, and then steps S104-S105 may be performed; or both parts are set according to respective time intervals. Execute in parallel.

The wired screen method of the embodiment simulates the display device into a standard USB device, and provides a plurality of communication protocol ports required for the display source device through the USB interface of the display device, through the communication protocol port and the display device. The USB interface establishes a USB communication connection between the display device and the display source device; when detecting that the USB interface of the display device has information from the display source device, detecting a port transmitting the information, if it is a port for transmitting audio and video data, The information is recognized as audio and video data, and the corresponding sound is played on the display device. Video; simultaneously obtaining a manipulation signal detected by the display device to play the display source device, adapting the manipulation signal to a port for transmitting the manipulation signal, and transmitting to the display source device through the display device USB interface, so as to display The device performs the action corresponding to the control signal, and implements the manipulation of the display source device at the display device end. No need for additional intermediate screen device, display source device and display device can realize the transmission and display of audio and video data with only one USB cable, and at the same time realize the return of the control signal of the display device, simplifying the display of the screen. Wiring, reducing the difficulty of wiring the user.

FIG. 4 is a schematic flowchart of a method for implementing wired screen transmission in the second embodiment; the method for implementing wired screen transmission in the embodiment is mainly applied to a display source device end. Referring to FIG. 4, the method for implementing wired screen transmission in this embodiment includes the following steps.

Step S21: Identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the first device; the universal driver provides a universal communication protocol for communication between the first device and the standard USB device. The communication protocol port at least includes: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is pre-configured with a first USB interface, and the second device passes the first USB The interface is connected to the second USB interface of the local device, and provides a plurality of communication protocol ports that can be recognized by the universal driver of the first device through the first USB interface;

In this embodiment, the first device is a display source device, the display source device refers to a device used as a display source, and the second device is a display device; the USB interface A of the display device is connected to the USB interface B of the display source device; The attribute of USB interface B is USB host, and the attribute of USB interface A is USB device.

Step S22, intercepting a picture and/or audio played by the first device;

In this embodiment, the manner of intercepting the screen and/or the audio played by the source device may be implemented by running a program stored in the display device. Correspondingly, the communication protocol port further includes: a port for accessing the storage space. For example, the display source device generates a storage space access instruction according to a user operation, adapts the access instruction to a port for accessing the storage space, and sends the USB interface B to the USB interface A of the display device through the USB interface B to access the display device. Presetting the storage space and running the program of the preset storage space through its system interface to intercept the picture and/or audio played by the local end. Thereby, it is not necessary to pre-install the corresponding program in the display source device, and the plug-and-play is realized, which provides convenience for the user.

Step S23: Send the intercepted audio and video data to the first USB interface of the second device by using a designated port of the second USB interface, where the designated port is adapted to the port for transmitting audio and video data;

Preferably, before displaying the audio and video data, the display source device may also perform compression and/or encoding processing on the intercepted audio and video data by using a corresponding program of the preset storage space of the display device through its system interface to facilitate transmission. .

Step S24: Receive information from the first USB interface of the second device, and detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a manipulation signal, and execute the control signal Corresponding action.

It should be noted that the execution order of the above steps S23 and S24 is not limited to the above sequence, and the execution order of the two parts may be changed, or may be performed simultaneously.

Preferably, the user of the display source device can select whether to enable the function of returning the control signal. If the user selects the function of turning back the control signal, the display source device can send the display device through the USB interface B after the connection is successfully established. Return request; corresponding, The communication protocol port further includes: a port for transmitting a backhaul request. Specifically, the method includes: obtaining, by the display source device, a backhaul request identifier bit information, and determining, according to the backhaul request identifier bit information, whether the backhaul request function of the display source device is in an open state; if yes, generating a backhaul request instruction; The return request command is adapted to the port for transmitting the return request, and is sent to the USB interface A of the display device through the USB interface B to notify the display device to transmit back the control signal of the played audio and/or picture.

FIG. 5 is a detailed flowchart of a method for implementing wired screen transmission in the second embodiment; referring to FIG. 5, the steps to be performed on the source device are as follows:

S201, running a universal driver for displaying the source device, and detecting, in the background of the system, whether a USB device (ie, a display device) that meets the set feature is accessed;

Whether the accessed USB device is a display device that conforms to the set feature can be identified by a specific ID (PID and/or VID).

S202, if yes, confirm whether there is a connection success instruction sent by the display device;

In this embodiment, the universal driving of the display source device detects that the USB interface B receives the information from the USB interface A of the display device, and detects the port that transmits the information. If the port is used for transmitting the connection information, according to the signal content, It is recognized whether the information is a connection success instruction.

S203, if received, intercepting a picture and/or audio currently displayed by the display source device, compressing or encoding into a specific file format, and transmitting the image to the connected display device through the USB interface B of the display source device;

Preferably, the display source device may generate a storage space access instruction according to a user operation, obtain a port for accessing the storage space from a port provided by the display device to the display source device, and adapt the access instruction to the storage for accessing the storage device. The port of the space is sent to the USB interface A of the display device through the USB interface B to access the preset storage space of the display device; and the program of the preset storage space is operated by displaying the source device system interface to intercept the display source device. Picture and / or audio. Therefore, the display source device does not need to install the corresponding program in advance, and realizes plug and play, which provides convenience for the user.

The audio and video data may also be compressed and/or encoded by a corresponding program that displays the default storage space of the display device by displaying the source device system interface for transmission. The interception code can be stored in the U disk emulated by the display device. After the display source device is connected to the display device, the data information stored in the display device memory can be viewed through the corresponding communication protocol port, and the system interface is operated through the display source device. The related program intercepts the picture and/or audio (including sound data, including audio adjustment information such as volume and channel) played by the display source device.

S204, confirming whether the return request function switch of the display source device is turned on (the user can select to open or close);

In this embodiment, after the connection is successful, the backhaul request identifier information preset by the display source device may be read to determine whether the return request function of the display source device is in an open state.

S205, if opened, sending the return request command to the display device through the USB interface B of the display source device;

If the current backhaul request function of the source device is displayed as being on, according to generating a return request command; adapting the backhaul request command to the port for transmitting the return request, and sending it to the USB interface B of the display source device to Displays the USB interface A of the device.

S206. Detect whether the USB interface B of the display source device receives the control signal sent back by the USB interface A of the display device.

S207. If receiving a control signal returned by the display device, performing a corresponding response action.

In this embodiment, the USB interface B of the display source device receives the information of the USB interface A from the display device, and detects the port that transmits the information. If the port is used for transmitting the control signal, the external HID device can be processed according to the conventional method. How to manipulate events, identify The feedback signal is returned, and the action corresponding to the manipulation signal is executed.

It can be understood that the execution order of steps S204 and S205 and steps S206-S207 is not limited to the example in the figure, and steps S206-S207 may be performed first, and then steps S204 and S205 may be performed; or both parts are set according to respective time intervals. Execute in parallel.

The wired screen transmission method of the embodiment, by simulating the display device into a standard USB device, provides a plurality of communication protocol ports required for the display source device through the USB interface of the display device to establish a wired transmission screen of the display source device and the display device. Connection; reduces the requirement for display source device, realizes plug and play, and does not require additional intermediate screen device, display source device and display device can realize audio and video data transmission display with only one USB cable At the same time, it can also realize the return of the control signal of the display device, simplify the wiring of the screen display, and reduce the difficulty of wiring the user.

Through the method for implementing wired screen transmission in the above embodiment, the display device can be simulated into several types of USB devices through its USB interface, and the display source device mounted with the universal drive can be free from special drive recognition. The display source device is also capable of obtaining a data stream of the manipulation signal from the display device, and the code for intercepting the audio and video data may be a system interface of the display source device, but the corresponding program data may be saved in the memory of the display device, and the memory of the display device is pre- Program data or a program downloader for data communication and interception of audio and video data of the display source device is stored. After the display source device establishes a USB connection with the display device, the memory of the display device can be accessed to run corresponding program data therein for intercepting the picture or audio of the display source device. The display source device may also package the audio and video data according to the agreed protocol by running the corresponding program data therein, and then transmit the data to the display device through the corresponding communication protocol port, and the display device receives the data packet from the USB interface A, parses the protocol and the package content, Decode audio and video data for playback.

The software on the display device side can also obtain a touch operation (or other control signal) of the user on the played picture or audio, and transmit it back to the display source device through the USB interface A. The display source device can recognize the touch operation signal transmitted according to the corresponding communication protocol port, convert it into a similar HID device-like manipulation event and execute a corresponding response (this process is supported by the display source device operating system, WINDOWS/MAC This function is available), thereby achieving the effect of synchronously adjusting the picture and/or audio played by the display source device.

It should be noted that, for the foregoing method embodiments, for the sake of brevity, they are all described as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence, because In accordance with the present invention, certain steps may be performed in other sequences or concurrently.

Based on the same idea as the method for implementing wired screen transmission in the above embodiments, the present invention also provides an apparatus and system for implementing wired screen transmission, and the apparatus and system can be used to implement the above method for implementing wired screen transmission. For the convenience of the description, in the structural diagram of the device and the system embodiment for implementing the wired screen, only the parts related to the embodiment of the present invention are shown, and those skilled in the art can understand that the illustrated structure does not constitute the device and the system. The definition may include more or fewer components than those illustrated, or some components may be combined, or different component arrangements.

FIG. 6 is a schematic structural diagram of an apparatus for implementing a wired screen according to an embodiment of the present invention. As shown in FIG. 6, the apparatus for implementing a wired screen in this embodiment may be a function in a display device such as a large screen whiteboard. The block specifically includes: a port simulation module 510, a connection establishment module 520, an audio and video data receiving module 530, and a control signal backhaul module 540. The modules are as follows:

The port simulation module 510 is configured to provide, by using a first USB interface preset by the local end, a plurality of communication protocol ports to the first device, where the communication protocol port can be recognized by the universal driver of the first device; the universal driver provides A universal communication protocol for communication between a first device and a standard USB device, the communication protocol port including at least a port for transmitting audio and video data and a terminal for transmitting a control signal mouth;

The connection establishing module 520 is configured to establish a USB communication connection between the second device and the first device by using the communication protocol port, the first USB interface of the second device, and the second USB interface of the first device;

The audio and video data receiving module 530 is configured to detect that the first USB interface has information from the first device, detect a port that transmits the information, and if it is a port for transmitting audio and video data, identify the information as a tone. Video data; playing the corresponding audio and video on the second device according to the audio and video data received by the first USB interface;

As a preferred embodiment, after the audio/video data receiving module 530 identifies the information as audio and video data, if the preset trigger control signal for indicating the screen display is monitored, the audio and video data is used according to the audio and video data. The corresponding audio and video is played. The trigger control signal includes an operation signal that the preset preset control button is pressed, or may be a specific touch control signal generated on the human-machine interaction interface provided by the local end, that is, the user may trigger through a hardware trigger mode/software trigger mode. To control the display of audio and video data on the local end, so that users can flexibly control the effect of the screen display.

The control signal returning module 540 is configured to acquire a control signal detected by the second device, adapt the control signal to a port for transmitting the control signal, and send the signal to the first device through the first USB interface, indicating The first device performs an action corresponding to the manipulation signal after receiving the manipulation signal.

Preferably, the communication protocol port further includes: a port for transmitting connection information; correspondingly, the device for implementing wired screen transmission further includes: a connection confirmation module (not shown), configured to generate a connection successfully. And instructing to adapt the connection success instruction to the port for transmitting the connection information, and sending the first connection to the first device to notify the first device that the second device meets the requirements of the audio and video transmission display.

Preferably, the communication protocol port further includes: a port for transmitting a return request; correspondingly, the device for implementing the wired screen further includes a backhaul request module (not shown) for detecting The first USB interface has information from the first device, and detects a port that transmits the information. If the port is used for transmitting the return request, the second device is configured to acquire the detected function of the first device. .

Preferably, the communication protocol port further includes: a port for accessing the storage space; correspondingly, the device for implementing the wired screen further includes a storage module 550, configured to detect that the first USB interface has the first device The information of the port for transmitting the information, if it is a port for accessing the storage space, the preset storage space of the second device is displayed to the first device, so that the first device system interface passes the program for running the storage space. Used to intercept the picture and/or audio played by the first device.

In this embodiment, the first device is a display source device, and the second device is a display device; the USB device of the second device has a USB device, and the USB interface of the first device has a USB host.

FIG. 7 is a schematic structural diagram of an apparatus for implementing wired screen transmission of the second embodiment. As shown in FIG. 7, the apparatus for implementing wired screen transmission in this embodiment includes:

The USB identification module 610 is configured to identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the first device, where the universal driver provides communication between the first device and the standard USB device a universal communication protocol, the communication protocol port at least comprising: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is pre-configured with a first a USB interface, the second device accesses the second USB interface of the local device through the first USB interface, and provides a plurality of communication protocol ports that can be recognized by the universal driver of the first device through the first USB interface;

The audio and video intercepting module 620 is configured to intercept a picture and/or audio played by the first device;

The audio and video sending module 630 is configured to send the intercepted audio and video data to a first USB interface of the second device by using a designated port of the second USB interface, where the designated port is connected to a port for transmitting audio and video data. adapt.

And a control signal receiving module 640, configured to receive information from the first USB interface of the second device, detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a control signal Executing an action corresponding to the manipulation signal.

Preferably, the communication protocol port further includes: a port for accessing the storage space; correspondingly, the audio and video intercepting module 620 is specifically configured to adapt the generated access instruction to a port for accessing the storage space, and Sending to the first USB interface of the second device by using the second USB interface, accessing the preset storage space of the second device, and running the program of the preset storage space through the first device system interface to intercept the first A picture and/or audio played by a device.

Preferably, the communication protocol port further includes: a port for transmitting a return request; correspondingly, the device for implementing the wired screen further includes: a backhaul request module (not shown) for acquiring And determining, by the backhaul request identifier bit information, whether the backhaul request function of the first device is in an open state; if yes, generating a backhaul request instruction; Configuring a port for transmitting a return request, and sending the second USB interface to the first USB interface of the second device to enable the second device to obtain the detected function of the first device .

It should be noted that, in the implementation of the device for implementing wired screen in the above example, the information interaction, the execution process, and the like between the modules/units are based on the same concept as the foregoing method embodiments of the present invention. The technical effects are the same as those of the foregoing method embodiments of the present invention. For details, refer to the description in the method embodiment of the present invention, and details are not described herein again.

In addition, in the implementation of the foregoing apparatus for implementing wired screen transmission, the logical division of each functional module is merely an example, and the actual application may be considered according to requirements, for example, for configuration requirements of corresponding hardware or convenience of implementation of software. The above-mentioned function allocation is completed by different function modules, that is, the internal structure of the device for implementing wired screen is divided into different functional modules to complete all or part of the functions described above. Each function module can be implemented in the form of hardware or in the form of a software function module.

It will be understood by those skilled in the art that all or part of the processes in the above embodiments may be implemented by a computer program to instruct related hardware, and the program may be stored in a computer readable storage medium as Independent product sales or use. The program, when executed, may perform all or part of the steps of an embodiment of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

In the above embodiments, the descriptions of the various embodiments are all focused, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments. It will be understood that the terms "first", "second", and the like, as used herein, are used herein to distinguish an object, but these are not limited by these terms.

The above-described embodiments are merely illustrative of several embodiments of the invention and are not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims

A method for implementing wired screen transmission, comprising:

Providing, by the first USB interface preset by the local end, a plurality of communication protocol ports to the first device, the communication protocol port being capable of being recognized by the universal drive of the first device; the universal drive providing between the first device and the standard USB device a universal communication protocol for communication; the communication protocol port at least comprising: a port for transmitting audio and video data and a port for transmitting a control signal;

Establishing a USB communication connection between the local end and the first device by using the communication protocol port and the first USB interface;

Detecting that the first USB interface has information from the first device, detecting a port transmitting the information, if it is a port for transmitting audio and video data, identifying the information as audio and video data; according to the audio and video data in the present Play the corresponding audio and video on the end;

Acquiring the control signal of the first device detected by the local end, adapting the control signal to the port for transmitting the control signal, and transmitting the signal to the first device through the first USB interface, indicating that the first device is receiving An action corresponding to the manipulation signal is performed after the manipulation signal.
The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for transmitting connection information;

After the USB communication connection between the local device and the first device is established by using the communication protocol port and the first USB interface, the method further includes:

A connection success instruction is generated, the connection success instruction is adapted to a port for transmitting connection information, and sent to the first device through the first USB interface.
The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

The first USB interface is detected to have information from the first device, and after detecting the port transmitting the information, the method further includes:

If the port is used for transmitting the backhaul request, the information is identified as a backhaul request command, and the function of the local end for acquiring the detected control signal to the first device is enabled.
The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for accessing a storage space;

The first USB interface is detected to have information from the first device, and after detecting the port transmitting the information, the method further includes:

If the port is used to access the storage space, the information is identified as a storage space access instruction; the preset storage space of the local device is displayed to the first device, so that the system interface of the first device is used by the program running the storage space. The screen and/or audio played by the first device is intercepted.
The method for implementing a wired screen according to any one of claims 1 to 4, wherein the first device is a display source device, and the local device is a display device;

The attribute of the first USB interface is a USB device, and the attribute of the second USB interface is a USB host.
The method for implementing a wired screen according to claim 1, wherein the identifying the information as audio and video data further comprises:

The audio and video data is decompressed and/or decomposed.
The method for implementing wired screen according to claim 1, wherein the type of the control signal comprises: a touch control signal or an infrared remote control signal.
The method for implementing a wired screen according to any one of claims 1 to 7, wherein the step of playing the corresponding audio and video on the local end according to the audio and video data comprises:

If the preset trigger control signal for indicating the screen display is monitored, the corresponding audio and video is played on the local end according to the audio and video data.
A method for implementing wired screen transmission, comprising:

Identifying, by a pre-installed universal driver, a communication protocol port provided by a second device accessing the second USB interface of the local end, the universal driver providing a universal communication protocol for communication between the local terminal and the standard USB device, the communication protocol port At least: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is pre-configured with a first USB interface, and the second device accesses the local terminal by using the first USB interface a USB interface, and providing, by the first USB interface, a plurality of communication protocol ports that can be recognized by the universal drive of the first device;

Intercepting the picture and/or audio played by the local end;

Transmitting the intercepted audio and video data to the first USB interface through a designated port of the second USB interface of the local end, where the designated port is adapted to a port for transmitting audio and video data;

Receiving information from the first USB interface of the second device, detecting a port transmitting the information; if it is a port for transmitting a manipulation signal, identifying the information as a manipulation signal, and causing the local end to perform the manipulation The corresponding action of the event signal.
The method for implementing a wired screen according to claim 9, wherein the communication protocol port further comprises: a port for accessing a storage space;

The steps of intercepting the picture and/or audio played by the local end include:

The generated access command is adapted to the port for accessing the storage space, and is sent to the first USB interface of the second device by using the second USB interface of the local end to access the preset storage space of the second device, and The program of the preset storage space is executed through the local system interface to intercept the picture and/or audio played by the local end.
The method for implementing wired screen transmission according to claim 9, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

After the communication protocol port provided by the second device that accesses the second USB interface of the local terminal is identified by the pre-installed universal driver, the method further includes:

Obtaining the backhaul request identifier bit information of the local end, determining whether the backhaul request function of the local end is the open state according to the backhaul request identifier bit information; if yes, generating a backhaul request instruction;

The backhaul request instruction is adapted to the port for transmitting the backhaul request, and is sent to the first USB interface of the second device through the local second USB interface.
The method for implementing wired screen transmission according to claim 10, wherein before the intercepting the audio and video data to the port for transmitting the audio and video data, the method further comprises:

Compressing and/or encoding the intercepted audio and video data by running a corresponding program of the preset storage space through the local system interface Reason.
The method for implementing a wired screen according to any one of claims 9 to 12, wherein the local device is a display source device; and the second device is a display device;

The attribute of the first USB interface is a USB device, and the attribute of the second USB interface is a USB host.
An apparatus for implementing wired screen transmission, comprising:

The port simulation module provides a plurality of communication protocol ports to the first device through the first USB interface preset by the local end, and the communication protocol port can be recognized by the universal driver of the first device; the universal driver provides the first device and the standard A universal communication protocol for communication between USB devices, the communication protocol port comprising at least a port for transmitting audio and video data and a port for transmitting a control signal;

a connection establishing module, configured to establish a USB communication connection between the local end and the first device by using the communication protocol port and the first USB interface;

The audio and video data receiving module is configured to detect that the first USB interface has information from the first device, and detect a port that transmits the information, and if it is a port for transmitting audio and video data, identify the information as audio and video data; The corresponding audio and video is played on the local end according to the audio and video data received by the first USB interface;

The control signal returning module is configured to acquire a control signal for the first device detected by the local end, adapt the control signal to a port for transmitting the control signal, and send the first to the first USB interface through the local end And the device instructing the first device to perform an action corresponding to the control signal after receiving the control signal.
The apparatus for implementing wired screen transmission according to claim 14, wherein the communication protocol port further comprises: a port for transmitting connection information;

The device for implementing wired screen transmission further includes:

The connection confirmation module is configured to generate a connection success instruction, adapt the connection success instruction to a port for transmitting connection information, and send the connection to the first device through the first USB interface of the local end.
The apparatus for implementing wired screen transmission according to claim 14, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

The device for implementing wired screen transmission further includes:

The backhaul request receiving module is configured to detect that the first USB interface of the local end has information from the first device, and detects a port that transmits the information; if the port is used for transmitting the return request, the local end is used to obtain the detection. The function of the control signal to the first device.
The device for implementing wired screen transmission according to claim 14, wherein the communication protocol port further comprises: a port for accessing a storage space;

The device for implementing wired screen transmission further includes:

The storage module is configured to detect that the first USB interface has information from the first device, and detects a port that transmits the information; if the port is used to access the storage space, the preset storage space of the local end is displayed to the first The device causes the first device system interface to intercept the picture and/or audio played by the first device by running the program of the storage space.
The device for implementing wired screen transmission according to any one of claims 14 to 17, wherein the first device is a display source device, The local end is a display device;

The attribute of the first USB interface is a USB device, and the attribute of the second USB interface is a USB host.
An apparatus for implementing wired screen transmission, comprising:

a USB identification module, configured to identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the local end, where the universal driver provides a universal communication protocol for communication between the local terminal and the standard USB device. The communication protocol port at least includes: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is pre-configured with a first USB interface, and the second device passes the first USB The interface is connected to the second USB interface of the local device, and provides a plurality of communication protocol ports that can be recognized by the universal driver of the first device through the first USB interface;

An audio and video intercepting module, configured to intercept a picture and/or audio played by the local end;

An audio and video sending module, configured to send the intercepted audio and video data to a first USB interface of the second device by using a designated port of the second USB interface of the local end, the designated port and a port for transmitting audio and video data Adapt

a control signal receiving module, configured to receive information from the first USB interface of the second device, detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a control signal, and The local end performs an action corresponding to the manipulation event signal.
The device for implementing wired screen transmission according to claim 19, wherein the communication protocol port further comprises: a port for accessing a storage space;

The audio and video intercepting module is configured to adapt the generated access command to a port for accessing the storage space, and send the first USB interface to the second device through the local second USB interface to access the The preset storage space of the second device, and running the program of the preset storage space through the local system interface to intercept the picture and/or audio played by the local end.
The apparatus for implementing wired screen transmission according to claim 19, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

The device for implementing wired screen transmission further includes:

The backhaul request module is configured to obtain the backhaul request identifier bit information preset by the local end, and determine, according to the backhaul request identifier bit information, whether the backhaul request function of the local end is in an open state; if yes, generate a backhaul request instruction; The return request command is adapted to the port for transmitting the backhaul request, and is sent to the first USB interface of the second device through the local second USB interface.
The device for implementing wired screen transmission according to any one of claims 19 to 21, wherein the local device is a display source device, and the second device is a display device;

The attribute of the first USB interface is a USB device, and the attribute of the second USB interface is a USB host.