WO2018090724A1

WO2018090724A1 - Method and apparatus for wired screen transmission

Info

Publication number: WO2018090724A1
Application number: PCT/CN2017/103472
Authority: WO
Inventors: 庞远杨; 侯旻翔
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2016-10-12
Filing date: 2017-09-26
Publication date: 2018-05-24
Also published as: CN107948569A; CN107948569B

Abstract

The present invention relates to a method and apparatus for wired screen transmission. The method comprises: pre-setting an embedded unit for screen transmission at a local end, and providing a first USB interface; providing several communication protocol ports for a first device via the embedded unit; establishing a USB communication connection between the local end and the first device via the communication protocol ports and the first USB interface; when it is detected that there is information from the first device at the first USB interface, detecting, via the embedded unit, a port for transmitting the information, and if the port is a port for transmitting audio and video data, recognizing the information as the audio and video data and forwarding same to an MCU of the local end; acquiring a manipulation signal for the first device detected by the local end, and sending same to the embedded unit; and adapting, via the embedded unit, the manipulation signal to a port for transmitting the manipulation signal, and sending same to the first device via the first USB interface. The present invention can simplify the wiring during screen transmission, and reduce the wiring difficulty of a user.

Description

Method and device for realizing wired screen transmission

Technical field

The present invention relates to the field of data transmission technologies, and in particular, to a method and apparatus for implementing wired transmission.

Background technique

The implementation of the screen is that the display source device such as a computer intercepts the screen page and sound data of the system and sends it to the display device, and the display device decodes and displays and plays the transmitted picture and sound. The screen is often used in conferences or teaching areas. Users need to project the audio and video signals of the computer to the large-screen LCD whiteboard or projector for display. The audio and video data on the computer is sent to the display device through the corresponding data line. However, in the traditional screen display mode, the display device only serves as an information display function, and does not have the function of receiving a user operation instruction and returning the display source end, and is inconvenient for the user to perform a demonstration operation.

Based on this, in the screen mode based on the touch screen display device, it is proposed to feed back the touch control signal detected by the display device to the computer end. Correspondingly, a new control signal is needed between the computer and the display device. Connection line. Therefore, two or more connection cables (HDMI cable + USB cable / RS232 cable, VGA cable + audio cable + USB cable or RS232 cable, etc.) are required between the computer and the display device. There is a problem that the wiring is complicated and the professional level of the user is high.

Summary of the invention

Based on this, the method and device for implementing wired screen transmission provided by the embodiments of the present invention can simplify the wiring during the screen display and reduce the difficulty of wiring the user.

An aspect of the present invention provides a method for implementing a wired screen, including:

An embedded unit for implementing a screen is disposed in advance at the local end, and the embedded unit is provided with a first USB interface, and the embedded unit is communicably connected to the local MCU;

The method for implementing wired screen transmission includes:

Providing, by the embedded unit of the local end, a plurality of communication protocol ports to the first device, the communication protocol port being identifiable by the universal drive of the first device; the universal drive of the first device providing the first device and the standard USB device a universal communication protocol for communication, the communication protocol port comprising at least a port for transmitting audio and video data and a port for transmitting a control signal;

Establishing a USB communication connection between the local end and the first device by using the communication protocol port and the first USB interface;

Detecting that the first USB interface has information from the first device, and detecting, by the embedded unit, a port that transmits the information, if it is a port for transmitting audio and video data, identifying the information as audio and video data, and forwarding Give the local MCU to play the corresponding audio and video on the local end;

Acquiring, by the local end, a control signal for the first device, and sending the control signal to the embedded unit; adapting, by the embedded unit, the control signal to a port for transmitting a control signal, and passing the A USB interface is sent to the first device, and the first device is instructed to perform an action corresponding to the control signal after receiving the control signal.

Another aspect of the present invention provides a method for implementing wired screen transmission, including:

Identifying, by a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the local end; the universal driver provides a universal communication protocol for communication between the local terminal and the standard USB device, the communication protocol port Included at least: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is provided with an embedded unit for implementing a screen, and the embedded unit is provided with a first USB interface, The embedded unit is communicatively coupled to the second device MCU, and the embedded unit provides a plurality of communication protocol ports that can be recognized by the universal driver through the first USB interface;

Intercepting the picture and/or audio played by the local end;

Transmitting the intercepted audio and video data to the first USB interface through a designated port of the second USB interface of the local end, the designated port is adapted to be used for transmitting the audio and video data, to be forwarded by the embedded unit Giving the second device MCU to enable the second device to play the corresponding audio and video;

Receiving, by the second USB interface of the local end, information from the first USB interface, detecting a port for transmitting the information; if the port is for transmitting a control signal, identifying the information as a control signal, causing the local end to perform the The action corresponding to the control signal.

Another aspect of the present invention provides an apparatus for implementing a wired screen, including:

Included in the second device MCU and an embedded unit for implementing a screen, the embedded unit is communicatively coupled to the second device MCU;

The embedded unit includes:

a port simulation module, configured to provide a plurality of communication protocol ports to the first device, the communication protocol port being identifiable by a universal drive of the first device; the universal drive of the first device providing a relationship between the first device and the standard USB device a universal communication protocol for communication, the communication protocol port comprising at least a port for transmitting audio and video data and a port for transmitting a control signal;

a connection establishing module, configured to establish, by using the communication protocol port, the first USB interface of the embedded unit, a USB communication connection between the embedded unit and the first device;

The audio and video data forwarding module is configured to detect that the first USB interface has information from the first device, and detects a port that transmits the information, and if it is a port for transmitting audio and video data, the information is recognized as audio and video data; Forwarding the audio and video data to the second device MCU, so that the second device plays the corresponding audio and video;

The control signal returning module is configured to receive, by using the system communication interface, a control signal of the first device detected by the local device acquired by the second device MCU, and adapt the control signal to a port for transmitting the control signal And sending, by the first USB interface, to the first device, instructing the first device to perform an action corresponding to the control signal after receiving the control signal.

a USB identification module, configured to identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the local end, where the universal driver provides a universal communication protocol for communication between the local terminal and the standard USB device. The communication protocol port includes at least a port for transmitting audio and video data and a port for transmitting a control signal, and an embedded unit for implementing the screen is disposed in the second device, where the embedded unit provides There is a first USB interface, the embedded unit is in communication with the second device MCU, and the second device accesses the local second USB interface through the first USB interface and provides a plurality of communication protocols that can be recognized by the universal driver. Port

An audio and video intercepting module, configured to intercept a picture and/or audio played by the local end;

An audio and video sending module, configured to send the intercepted audio and video data to the first USB interface through a designated port of the second USB interface of the local end, where the designated port is adapted to a port for transmitting audio and video data;

a control signal receiving module, configured to receive information from the first USB interface, and detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a control signal, so that the local end performs the The action corresponding to the control signal.

In the above technical solution, by embedding an embedded unit for realizing a screen in a display device, the embedded unit is simulated as a standard USB device, and the display source device is provided by the USB interface provided by the embedded unit. a plurality of communication protocol ports required to establish a USB communication connection between the display device and the display source device through the communication protocol port; when detecting that the USB interface provided by the embedded unit has information from the display source device, The embedded unit detects the port that transmits the information, and if it is a port for transmitting audio and video data, the information is recognized as audio and video data, and is sent to the display device MCU to play the corresponding audio and video on the display device; Displaying a manipulation signal of the source device, adapting the manipulation signal to a port for transmitting a manipulation signal by the embedded unit, and transmitting to the display source device through a USB interface provided by the embedded unit, so that the display device Performing an action corresponding to the manipulation signal. For the user, the display source device and the display device can realize the transmission and display of the audio and video data only by one USB cable, and at the same time, realize the return of the control signal of the display device, simplify the wiring of the screen display and reduce the wiring. Difficult to wire the user.

DRAWINGS

1 is a schematic diagram of a system environment for implementing a method for implementing wired screen transmission according to the present invention;

2 is a schematic flowchart of a method for implementing wired screen transmission according to an embodiment;

3 is a detailed flowchart of a method for implementing wired screen transmission according to an embodiment;

4 is a schematic flowchart of a method for implementing wired screen transmission in a second embodiment;

5 is a detailed flowchart of a method for implementing a wired screen transmission by a display source device according to a second embodiment;

FIG. 6 is a schematic structural diagram of an apparatus for implementing wired screen transmission according to an embodiment; FIG.

FIG. 7 is a schematic structural diagram of an apparatus for implementing wired screen transmission of the second embodiment.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

1 is a schematic diagram of a system environment for implementing a method for wired screen transmission of the present invention. As shown in FIG. 1, the system environment of the embodiment of the present invention includes a display source device (ie, a first device) and a display device (ie, a second device). The display source device may be a device or a system running an MCU such as a PC or a mobile phone, and the system has at least one pre-installed universal driver therein, and the universal driver provides universal communication between the display source device and the standard USB device. protocol. The display source device is further configured with at least one USB interface (ie, a second USB interface), and the attribute of the USB interface is set to a USB host.

The display device is a device or system running an operating system, such as a large-screen electronic whiteboard. The display device includes an MCU, Also included is an embedded unit (shown in dashed box) for communicating with the MCU, the embedded unit specifically including a memory, a processor, a first system communication interface, and a first USB interface; Running a corresponding processor program, the processor program capable of identifying the type of information received by the first USB interface; one of the uses of the memory is a specific program for storing the display source device or the display device Or a downloader of the specific program; correspondingly, the display device is further provided with a corresponding second system communication interface, and the communication between the embedded unit and the display device MCU is realized by the first system communication interface and the second system communication interface The property of the first USB interface is set to a USB device for connecting to a second USB interface of the display source device.

FIG. 2 is a schematic flowchart of a method for implementing wired screen transmission according to an embodiment of the present invention. In this embodiment, the method is applied to a display device end as an example for description.

As shown in FIG. 2, the method for implementing wired screen transmission in this embodiment includes the following steps:

S11, the first device is provided with a plurality of communication protocol ports by the embedded unit of the local end, the communication protocol port can be recognized by the universal driver of the first device; the universal device of the first device provides the first device and the standard USB device a universal communication protocol for communication between, the communication protocol port at least comprising: a port for transmitting audio and video data and a port for transmitting a control signal;

In this embodiment, the local end refers to a display device, and the embedded unit in the display device can be simulated into several types of standard USB devices, and provides a corresponding communication protocol port; the first device is a display source device, and the display source device The pre-installed universal driver can independently drive different types of standard USB devices, and the corresponding source software can also be installed in the display source device for receiving the user's screen operation.

In this embodiment, the USB interface is a physical concept, and the communication protocol port provided through the USB interface is an abstract concept for the USB connection service. Different communication protocol ports can be distinguished by corresponding port identifiers, for example, by port number. distinguish. In this embodiment, the port identification of each communication protocol port can be recognized by the universal USB driver, and the processor of the embedded unit also performs various types of information (including audio and video data or control signals) through the port identification of the communication protocol port. Transceiver, to achieve the transmission and reception of a variety of different types of information through the same physical interface.

Correspondingly, the embedded unit can be simulated into several types of standard USB devices, which means that the embedded unit can enumerate several standard USB communication protocol ports based on the common standard USB communication protocol, and different USB communication protocol ports use different port identifications. Make a distinction.

S12. Establish a USB communication connection between the local device and the first device by using the communication protocol port and the first USB interface.

In this embodiment, the local end is a display device, and the embedded unit of the local end can be simulated into several types of standard USB devices, and provides a corresponding communication protocol port, and the display source device can be recognized by the drive (ie, by displaying the source device system generally The built-in universal USB driver recognizes it without the need for a specific universal driver.

Preferably, the communication protocol port further includes: a port for transmitting connection information. Correspondingly, after the connection is successful, the display device may further generate a connection success instruction, and send a connection success instruction to the embedded unit; and the connection success instruction is adapted by the embedded unit to transmit connection information. The port is sent to the display source device through the first USB interface to notify the display source device that the connection is successfully established.

S13. The first USB interface is detected to have information from the first device, and the port that transmits the information is detected by the embedded unit. If the port is used for transmitting audio and video data, the information is identified as audio and video data. And forwarded to the local MCU, so that the local end plays the corresponding audio and video;

Preferably, after receiving the audio and video data, the local MCU needs to parse the audio and video data for decompression and/or decoding.

S14: Acquire a control signal that is detected by the local end and is sent to the embedded device, and send the control signal to a port for transmitting a control signal by using the embedded unit, and pass the The first USB interface is sent to the first device, and the first device is instructed to perform an action corresponding to the control signal after receiving the control signal.

The corresponding action of the control signal may be any action that the local end can perform.

It should be noted that the execution order of the above steps S13 and S14 is not limited to the above sequence, and the execution order of the two parts may be changed, or may be performed simultaneously.

Preferably, the communication protocol port further includes: a port for accessing the storage space. After the display source device and the display device are successfully connected, if the display source device is pre-installed with a software program for intercepting the display screen and/or audio, the currently displayed display screen and/or audio is intercepted by the software program, and is performed. After being packaged, it is sent to the display device. If the display source device does not pre-install such a software program, the memory (storage space) of the embedded unit can be accessed through the USB interface, and a program stored in advance in the memory of the embedded unit is used to intercept the currently displayed display screen. And/or audio software program, and packaging the same, and compressing the packaged audio and video data to a corresponding port, and sending the first USB interface to the embedded unit through the second USB interface, The embedded unit is forwarded to the display device MCU. The second method has lower requirements on the display source device, even if it does not pre-install the corresponding program, for the display source device (for example, a PC), when the display device provided with the embedded unit is inserted, The "My Computer" root directory sees a "removable disk", which is the storage space of the embedded unit, thereby showing that the source device can run the pre-stored application from the "removable disk", thereby Achieve plug and play effects. The display device receives the audio and video data from the first USB interface, performs processing, and performs playback to realize the screen display of the audio and video data.

On the other hand, a control signal to the display source device can also be obtained by the display device system program, and the manipulation signal is sent to the system communication interface of the embedded unit; the manipulation signal is adapted by the embedded unit The port for transmitting the control signal is transmitted back through the first USB interface, so that the display source device can convert the manipulation signal into a corresponding manipulation event and perform a corresponding action. For example, the embedded unit converts a touch event of the display device into a HID touch event, which is simulated as an HID touch device, and submits the HID touch event to the display source device system through the first USB interface. For the display source device system, the corresponding action is performed in a manner that conventionally processes the operation event of the HID touch device.

Based on the above-mentioned wired transmission method, on the one hand, various types of USB communication protocol ports that need to be used for common display source devices can be provided, and ordinary display source devices can be protected from drive recognition, and can also operate the memory of the embedded unit. The pre-stored program completes the corresponding audio and video data interception function, realizing the plug-and-play effect; only one USB cable can realize the limited screen connection of the display source device and the display device, and at the same time realize the display device The backhaul of the control signal simplifies the wiring of the screen display.

It can be understood that the port for transmitting the connection information, the port for transmitting the audio and video information in the embodiment may be the HID1 port and the HID2 port respectively; and the port for transmitting the storage space access instruction may be the Mac type port. In other words, in the embodiment, the embedded unit can be simulated by its first USB interface into multiple types of communication protocol ports that can be recognized by the display source device system, and several communication protocols. The ports can be independently driven by the universal drive of the display source device for respectively transmitting different data information.

3 is a detailed flowchart of a method for implementing wired screen transmission according to an embodiment; referring to FIG. 3, the display device detects that the first USB interface has information from the display source device, and detects, by the embedded unit, the information transmitted by the embedded unit. The port, if it is a port for transmitting a return request, identifies the information as a return request command, and sends the information to the display device MCU through the system communication interface, thereby turning on the display device for acquiring the detected manipulation information on the display source device. The function. Specifically, the steps to be performed on the display device side are as follows:

S101. The processor program of the embedded unit in the display device runs, and detects whether the first USB interface meets the conditional display source device access.

Detect whether the first USB interface has a device connection, and if so, further check whether the device is a display source device that meets the requirements. Specifically, whether the accessed device is a qualified display source device can be detected by using a specific ID (PID/VID).

S102. If the display source device is detected to be accessed, the processor program of the embedded unit simulates the device as a standard USB device through the first USB interface, so that the display source device with the universal driver can be discriminated.

S103. The processor program of the embedded unit generates a connection success instruction, and confirms that the screen connection is successful.

The processor program of the embedded unit in the embodiment adapts the connection success instruction to a port for transmitting connection information, and sends the second USB interface to the display source device through the first USB interface to notify the display source. The device has successfully connected the screen.

S104. The processor program of the embedded unit detects whether the first USB interface has an audio and video file stream from the display source device.

In this embodiment, if the processor program of the embedded unit detects that the first USB interface has information from the display source device, further detects a port that transmits the information, and if it is a port for transmitting audio and video data, This information can be identified as audio and video data.

In this embodiment, the embedded unit further provides a port for accessing the storage space to the display source device. Before the step, if the processor program of the embedded unit detects that the first USB interface has information from the display source device, further detecting the port transmitting the information, if it is a port for accessing the storage space, The information is identified as a storage space access instruction; the preset storage space of the embedded unit is displayed to the display source device, so that the display source device system interface is used to intercept the screen played by the display source device by using a program running the storage space. Or audio. The preset storage space stores an exe executable program for intercepting audio and video data or downloads download information of the corresponding program. Therefore, the display source device can perform a function of intercepting a picture or audio played thereon by accessing the storage space.

S105. The processor program of the embedded unit sends the audio and video file stream received through the first USB interface to the display device MCU, and the display device MCU is decompressed and/or decoded, and the corresponding screen is played on the display device side and/or Or audio.

As a preferred implementation manner, after the processor program of the embedded unit recognizes the information as audio and video data, it also monitors whether there is a preset trigger control signal for indicating information forwarding, and if the trigger control is monitored The signal is forwarded to the local MCU to play the corresponding picture and/or audio on the display device. The trigger control signal may be an operation signal that the preset button is pressed, or may be a specific touch control signal generated on the preset human-computer interaction interface, that is, the user may use a hardware trigger mode/software trigger mode. Controlling the forwarding of the audio and video data by the embedded unit to flexibly control the effect of the screen display.

S106. The processor program of the embedded unit detects whether the first USB interface has a return request instruction from the display source device.

In this embodiment, if the processor program of the embedded unit detects that the first USB interface has information from the display source device, further detecting the port transmitting the information, if the port is used for transmitting the return request, This information is identified as a postback request instruction.

S107. If receiving a return request command from the display source device, the processor program of the embedded unit sends the backhaul request command to the display device MCU to enable the display device to return the control information. Function (or run the corresponding thread) to obtain the detected control signal to the display source device.

It can be understood that the above trigger mechanism for forwarding audio and video data is also applicable to triggering the forwarding of the return request command by the embedded unit, that is, the embedded unit can be controlled by the hardware trigger mode/software trigger mode. Request forwarding of instructions.

S108. The display device MCU sends the control signal to the embedded unit, and the control signal is adapted to a port for transmitting a control signal by using a processor program of the embedded unit, and passes through the first USB interface. Sending to the display source device to cause the display source device to perform an action corresponding to the manipulation signal.

It can be understood that the above trigger mechanism for forwarding audio and video data is also applicable to triggering the forwarding of the control signal by the embedded unit, that is, the hardware trigger mode/software trigger mode can also be used to control the forwarding of the control signal by the embedded unit. To flexibly control the effect of remote control.

It can be understood that the execution order of steps S104-S105 and steps S106-S108 is not limited to the example in the figure, and steps S106-S108 may be performed first, and then steps S104-S105 may be performed; or both parts are set according to respective time intervals. Execute in parallel.

The wired screen method of the embodiment is configured by embedding an embedded unit for realizing a screen in the display device, simulating the embedded unit into a standard USB device, and providing a USB interface through the embedded unit. Providing a plurality of communication protocol ports required for the display source device, establishing a USB communication connection between the display device and the display source device through the communication protocol port; and detecting that the USB interface provided by the embedded unit has information from the display source device When the port for transmitting the information is detected by the embedded unit, if it is a port for transmitting audio and video data, the information is recognized as audio and video data, and sent to the display device MCU to play the corresponding sound on the display device. Video; simultaneously obtaining a control signal for the display source device detected by the display device, adapting the manipulation signal to the port for transmitting the manipulation signal through the embedded unit, and providing the USB through the embedded unit The interface is sent to the display source device to cause the display device to perform an action corresponding to the manipulation signal. For the user, the display source device and the display device can realize the transmission and display of the audio and video data only by one USB cable, and at the same time, realize the return of the control signal of the display device, simplify the wiring of the screen display and reduce the wiring. Difficult to wire the user.

FIG. 4 is a schematic flowchart of a method for implementing wired screen transmission in the second embodiment; the method for implementing wired screen transmission in the embodiment is mainly applied to a display source device end. Referring to FIG. 4, the method for implementing wired screen transmission in this embodiment includes the following steps.

Step S21: Identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the first device; the universal driver provides a universal communication protocol for communication between the first device and the standard USB device; The communication protocol port includes at least a port for transmitting audio and video data and a port for transmitting a control signal, and the second device is provided with an embedded unit for implementing a screen, and the embedded unit is provided with a first USB interface, the embedded unit is in communication with the second device MCU, and the second device accesses the local second USB interface through the first USB interface and provides a plurality of communication protocol ports that can be recognized by the universal drive. ;

In this embodiment, the first device is a display source device, the display source device refers to a device used as a display source, and the second device is a display device; the first USB interface is connected to a second USB interface of the display source device; The property of the second USB interface is USB host, first The property of the USB interface is USB device.

Step S22, intercepting a picture and/or audio played by the first device;

In this embodiment, the manner of capturing the picture and/or the audio played by the source device may be: accessing the data or the program stored in the embedded unit, and correspondingly, the communication protocol port further includes: The port of the storage space. Specifically, for example, the display source device generates a storage space access instruction according to a user operation, adapts the access instruction to a port for accessing the storage space, and sends the second USB interface to the first USB interface to access the The preset storage space of the embedded unit, and running the program of the storage space through its system interface to intercept the picture and/or audio played by the local end. Thereby, it is not necessary to pre-install the corresponding program in the display source device, and the plug-and-play is realized, which provides convenience for the user.

Step S23: Send the intercepted audio and video data to the first USB interface through a designated port of the second USB interface, where the designated port is adapted to a port for transmitting audio and video data;

Preferably, the display source device may perform compression and/or encoding processing on the intercepted audio and video data by using a corresponding program running the preset storage space through its system interface before transmitting the audio and video data to facilitate transmission.

Step S24: Receive information from the first USB interface through the second USB interface of the local end, and detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a control signal, so that the local end Performing an action corresponding to the manipulation signal.

Preferably, the user of the display source device can select whether to enable the function of returning the control signal. If the user selects the function of turning back the control signal, the display source device can pass the second USB interface after the USB screen connection is successfully established. Sending a return request to the display device; correspondingly, the communication protocol port further includes: a port for transmitting the return request. Specifically, the method includes: obtaining, by the display source device, a backhaul request identifier bit information, and determining, according to the backhaul request identifier bit information, whether the backhaul request function of the display source device is in an open state; if yes, generating a backhaul request instruction; The return request instruction is adapted to the port for transmitting the return request, and is sent to the first USB interface through the second USB interface to be sent to the display device system through the system communication interface of the embedded unit to notify the display The device performs a return of the control signal.

It should be noted that the execution order of the above steps S23 and S24 is not limited to the above sequence, and the execution order of the two parts may be changed, or may be performed simultaneously.

FIG. 5 is a detailed flowchart of a method for implementing wired screen transmission in the second embodiment; referring to FIG. 5, the steps to be performed on the source device side are as follows:

S201, running a universal driver for displaying the source device, and detecting, in the background of the system, whether a USB device (ie, a display device) that meets the set feature is accessed;

Whether the accessed USB device is a display device that conforms to the set feature can be identified by a specific ID (PID and/or VID).

S202, if yes, confirm whether there is a connection success instruction sent by the embedded unit of the display device;

In this embodiment, the universal driving of the display source device detects that the second USB interface receives the information from the first USB interface, and detects the port that transmits the information. If the port for transmitting the connection information is identifiable according to the signal content, Whether the information is a connection success instruction.

S203. If a connection success instruction is received, intercepting a picture and/or audio currently displayed by the display source device, and compressing or compiling Coded into a specific file format, sent to the embedded unit of the display device through the second USB interface of the display source device;

Preferably, the display source device may generate a storage space access instruction according to a user operation, obtain a port for accessing the storage space from a port provided by the embedded unit of the display device to the display source device, and adapt the access instruction to the The port for accessing the storage space is sent to the first USB interface of the display device through the second USB interface to access the storage space corresponding to the display device end; and the program for running the storage space is displayed by the display source device system interface to intercept the display The picture and/or audio played by the source device. Therefore, the display source device does not need to install the corresponding program in advance, and realizes plug and play, which provides convenience for the user.

The audio and video data can also be compressed and/or encoded by a program that displays the embedded unit running on the source device system interface for transmission. The interception code can be stored in the U disk emulated by the embedded unit of the display device. After the display source device is connected to the first USB interface of the display device, the corresponding memory stored in the display device can be viewed through the corresponding communication protocol port. The display source device system interface runs related programs to intercept the screen and/or audio (including sound data, including audio adjustment information such as volume and channel) played by the display source device.

S204, confirming whether the return request function switch of the display source device is turned on (the user can select to open or close);

In this embodiment, after the connection is successful, the backhaul request identifier information preset by the display source device may be read to determine whether the return request function of the display source device is in an open state.

S205, if opened, transmitting the return request command to the embedded unit of the display device through the second USB interface of the display source device;

If the current backhaul request function of the source device is displayed as being in an open state, according to generating a backhaul request instruction; adapting the backhaul request command to the port for transmitting the backhaul request, and sending through the second USB interface of the display source device To the first USB interface on the display device side.

S206. Detect whether the second USB interface of the display source device receives the control signal sent back by the embedded unit of the display device.

S207, if received, performs a corresponding response action.

In this embodiment, the second USB interface of the display source device receives the information from the first USB interface of the display device, and detects the port that transmits the information. If the port is used for transmitting the control signal, the external processing may be performed according to the conventional processing. The way the HID device manipulates the event, recognizes the returned control signal, and performs the corresponding action.

It can be understood that the execution order of steps S204 and S205 and steps S206-S207 is not limited to the example in the figure, and steps S206-S207 may be performed first, and then steps S204 and S205 may be performed; or both parts are set according to respective time intervals. Execute in parallel.

In the wired screen method of the embodiment, the embedded unit is simulated as a standard USB device by adding an embedded unit for realizing the screen, and the USB interface provided by the embedded unit is the display source device. Providing a plurality of communication protocol ports required to establish a wired screen connection of the display source device and the display device; reducing the requirement on the display source device, implementing plug and play, and only one between the display source device and the display device The USB cable can realize the transmission and display of audio and video data, and at the same time, it can realize the return of the control signal of the display device, simplify the wiring of the screen display, and reduce the difficulty of wiring the user.

Through the method for implementing wired screen transmission in the above embodiment, the display device can be simulated into several types of USB devices through the USB interface provided by the embedded unit, and the display source device mounted with the universal drive can be protected from special drive recognition. The display source device is also capable of obtaining a data stream of the manipulation signal from the display device end, and the code for intercepting the audio and video data may be a system interface of the display source device, but the corresponding program data may be stored in a memory corresponding to the display device end, the memory Pre-stored audio and video data for data communication and interception of display source devices Program data or program downloader. After the display source device establishes a USB connection with the first USB interface of the display device end, the memory can be accessed by running corresponding program data therein for intercepting the picture or audio of the display source device. The display source device may also package the audio and video data according to the agreed protocol by running the corresponding program data, and then transmit the data to the display device through the corresponding communication protocol port, and the display device receives the data packet from the first USB interface through the embedded device. The unit recognizes and forwards to the display device system, and decodes the audio and video data for playback by the display device system program parsing protocol and packet content.

The system software of the display device side can also detect a touch operation (or other control signal) of the user on the display source device, send it to the embedded unit through the system communication interface, adapt to the corresponding port through the embedded unit, and pass the The first USB interface is returned to the display source device. The display source device can recognize the touch operation signal transmitted according to the corresponding communication protocol port, convert it into a similar HID device-like manipulation event and execute a corresponding response (this process is supported by the display device MCU, WINDOWS/MAC This function is enabled, thereby achieving the effect of manipulating the display source device on the display device side.

It should be noted that, for the foregoing method embodiments, for the sake of brevity, they are all described as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence, because In accordance with the present invention, certain steps may be performed in other sequences or concurrently.

Based on the same idea as the method for implementing wired screen transmission in the above embodiments, the present invention also provides an apparatus and system for implementing wired screen transmission, and the apparatus and system can be used to implement the above method for implementing wired screen transmission. For the convenience of the description, in the structural diagram of the device and the system embodiment for implementing the wired screen, only the parts related to the embodiment of the present invention are shown, and those skilled in the art can understand that the illustrated structure does not constitute the device and the system. The definition may include more or fewer components than those illustrated, or some components may be combined, or different component arrangements.

FIG. 6 is a schematic structural diagram of an apparatus for implementing a wired screen according to an embodiment of the present invention. As shown in FIG. 6, the apparatus for implementing a wired screen in this embodiment specifically includes a second device MCU 100 and a device for implementing a screen. The embedded unit 200 is in communication with the second device MCU 100. The second device MCU 100 is configured to receive audio and video data forwarded by the embedded unit, so that the second device plays the corresponding And an audio signal; and a control signal for acquiring a picture and/or audio played on the second device, and sent to the embedded unit; wherein the embedded unit 200 includes: a port simulation module 510, and a connection establishment module 520. The audio and video data forwarding module 530 and the control signal returning module 540 are detailed as follows:

The port emulation module 510 is configured to provide a plurality of communication protocol ports to the first device, where the communication protocol port can be recognized by the universal drive of the first device; the universal drive of the first device provides the first device and the standard USB a universal communication protocol for communication between devices, the communication protocol port including at least: a port for transmitting audio and video data and a port for transmitting a control signal;

The connection establishing module 520 is configured to establish a USB communication connection between the embedded unit 200 and the first device by using the communication protocol port and the first USB interface of the embedded unit 200;

The audio and video data forwarding module 530 is configured to detect that the first USB interface has information from the first device, detect a port that transmits the information, and if it is a port for transmitting audio and video data, identify the information as a tone. Video data; forwarding the audio and video data to a second device MCU;

The control signal returning module 540 is configured to receive a control signal sent by the second device MCU, adapt the control signal to a port for transmitting a control signal, and send the first signal to the first device by using the first USB interface Instructing the first device to receive the manipulation letter The action corresponding to the manipulation signal is executed after the number.

Preferably, the communication protocol port further includes: a port for transmitting connection information; correspondingly, the embedded unit 200 further includes: a connection confirmation module (not shown), configured to generate a connection success instruction and The port is configured to transmit the connection information, and is sent to the first device by using the first USB interface to notify the first device that the connection is successfully established.

Preferably, the communication protocol port further includes: a port for transmitting a return request; correspondingly, the embedded unit 200 further includes a backhaul request module (not shown) for detecting the first USB The interface has information from the first device, detects a port that transmits the information; if it is a port for transmitting a return request, the information is identified as a backhaul request command, and is sent to the second device MCU 100; correspondingly, the The second device MCU 100 is further configured to receive a return request command sent by the embedded unit, and enable a function of the second device for returning the control information.

Preferably, the communication protocol port further includes: a port for accessing the storage space; correspondingly, the embedded unit 200 further includes: a storage module 550, configured to detect that the first USB interface has information from the first device Detecting a port for transmitting the information; if it is a port for accessing the storage space, displaying the preset storage space of the embedded unit to the first device, so that the first device system interface passes the program for running the storage space Used to intercept the picture and/or audio played by the first device.

In this embodiment, the first device is a display source device, and the second device is a display device; the attribute of the first USB interface is a USB device.

FIG. 7 is a schematic structural diagram of an apparatus for implementing wired screen transmission of the second embodiment. As shown in FIG. 7, the apparatus for implementing wired screen transmission in this embodiment includes:

The USB identification module 610 is configured to identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the first device, where the universal driver provides communication between the first device and the standard USB device a universal communication protocol, the communication protocol port at least comprising: a port for transmitting audio and video data and a port for transmitting a control signal; and the second device is provided with an embedded unit for implementing the screen, The embedded unit is provided with a first USB interface, the embedded unit is communicatively coupled to the second device MCU, and the second device accesses the first device and the second USB interface through the first USB interface and provides a plurality of Drive identification communication protocol port;

The audio and video intercepting module 620 is configured to intercept a picture and/or audio played by the first device;

The audio and video sending module 630 is configured to send the intercepted audio and video data to the first USB interface through a designated port of the second USB interface, where the designated port is adapted to be used for transmitting audio and video data.

And a control signal receiving module 640, configured to receive information from the first USB interface, and detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a control signal, and perform corresponding action.

Preferably, the communication protocol port further includes: a port for accessing the storage space; correspondingly, the audio and video intercepting module 620 is specifically configured to generate the access instruction and adapt to a port for accessing the storage space, and Sending to the first USB interface through the second USB interface to access the preset storage space of the embedded unit, and running the program of the storage space through the first device system interface to intercept the picture played by the local end and/or Or audio.

Preferably, the communication protocol port further includes: a port for transmitting a return request; correspondingly, the device for implementing the wired screen further includes: a backhaul request module (not shown) for acquiring The backhaul request identifier information preset by the first device, according to the return request The flag information determines whether the backhaul request function of the first device is in an open state; if yes, generates a backhaul request command; adapts the backhaul request command to a port for transmitting the backhaul request, and passes the second USB interface Sending to the first USB interface for sending to the second device MCU through the embedded unit to enable the function of the second device for returning the control signal.

In this embodiment, the first device is a display source device, and the second device is a display device; the attribute of the first USB interface is a USB device, and the attribute of the second USB interface is a USB host.

It should be noted that, in the implementation of the device for implementing wired screen in the above example, the information interaction, the execution process, and the like between the modules/units are based on the same concept as the foregoing method embodiments of the present invention. The technical effects are the same as those of the foregoing method embodiments of the present invention. For details, refer to the description in the method embodiment of the present invention, and details are not described herein again.

In addition, in the implementation of the foregoing apparatus for implementing wired screen transmission, the logical division of each functional module is merely an example, and the actual application may be considered according to requirements, for example, for configuration requirements of corresponding hardware or convenience of implementation of software. The above-mentioned function allocation is completed by different function modules, that is, the internal structure of the device for implementing wired screen is divided into different functional modules to complete all or part of the functions described above. Each function module can be implemented in the form of hardware or in the form of a software function module.

It will be understood by those skilled in the art that all or part of the processes in the above embodiments may be implemented by a computer program to instruct related hardware, and the program may be stored in a computer readable storage medium as Independent product sales or use. The program, when executed, may perform all or part of the steps of an embodiment of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

In the above embodiments, the descriptions of the various embodiments are all focused, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments. It will be understood that the terms "first", "second", and the like, as used herein, are used herein to distinguish an object, but these are not limited by these terms.

The above-described embodiments are merely illustrative of several embodiments of the invention and are not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims

A method for implementing a wired screen is characterized in that an embedded unit for realizing a screen is provided in advance at the local end, and the embedded unit is provided with a first USB interface, the embedded unit and the local MCU Communication connection

The method for implementing wired screen transmission includes the following steps:

Providing, by the embedded unit of the local end, a plurality of communication protocol ports to the first device, the communication protocol port being identifiable by the universal drive of the first device; the universal drive of the first device providing the first device and the standard USB device a universal communication protocol for communication; the communication protocol port at least comprising: a port for transmitting audio and video data and a port for transmitting a control signal;

Establishing a USB communication connection between the local end and the first device by using the communication protocol port and the first USB interface;

Detecting that the first USB interface has information from the first device, and detecting, by the embedded unit, a port that transmits the information, if it is a port for transmitting audio and video data, identifying the information as audio and video data, and forwarding Give the local MCU to enable the local end to play the corresponding audio and video;

Acquiring, by the local end, a control signal for the first device, and sending the control signal to the embedded unit; adapting, by the embedded unit, the control signal to a port for transmitting a control signal, and passing the A USB interface is sent to the first device, and the first device is instructed to perform an action corresponding to the control signal after receiving the control signal.
The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for transmitting connection information;

After the USB communication connection between the local device and the first device is established by using the communication protocol port and the first USB interface, the method further includes:

Generating a connection success instruction and transmitting to the embedded unit; adapting the connection success instruction to the port for transmitting connection information by the embedded unit, and transmitting to the first device through the first USB interface.
The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

Detecting that the first USB interface has information from the first device, and after detecting, by the embedded unit, the port that transmits the information, the method further includes:

If the port is used for transmitting the backhaul request, the information is identified as a backhaul request command and forwarded to the local MCU to enable the local end to return the control information.
The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for accessing a storage space; the embedded unit further provides a storage space, wherein the storage space is Having at least a program for capturing a picture and/or audio played by the first device;

Detecting that the first USB interface has information from the first device, and after detecting, by the embedded unit, the port that transmits the information, the method further includes:

If the port is used to access the storage space, the information is identified as a storage space access instruction; the storage space of the embedded unit is presented to the first device, so that the first device system interface passes the program that runs the storage space Used to intercept the picture and/or audio played by the first device.
A method for implementing wired screen transmission according to any one of claims 1 to 4, characterized in that

The first device is a display source device, and the local device is a display device;

The property of the first USB interface is a USB device.
The method for implementing a wired screen according to claim 1, wherein the identifying the information as audio and video data and forwarding the data to the local MCU further comprises:

The audio and video data is decompressed and/or decomposed by the local MCU.
The method for implementing wired screen according to claim 1, wherein the type of the control signal comprises: a touch control signal or an infrared remote control signal.
The method for implementing a wired screen according to any one of claims 1 to 7, wherein the step of identifying the information as audio and video data and forwarding the data to the local MCU comprises:

The information is identified as audio and video data, and if the preset trigger control signal for indicating information forwarding is monitored, the identified audio and video data is forwarded to the local MCU.
A method for implementing wired screen transmission, comprising:

Identifying, by a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the local end; the universal driver provides a universal communication protocol for communication between the local terminal and the standard USB device, the communication protocol port Included at least: a port for transmitting audio and video data and a port for transmitting a control signal; the second device is provided with an embedded unit for implementing a screen, and the embedded unit is provided with a first USB interface, The embedded unit is in communication with the second device MCU, and the second device accesses the local second USB interface through the first USB interface and provides a plurality of communication protocol ports that can be recognized by the universal driver;

Intercepting the picture and/or audio played by the local end;

Transmitting the intercepted audio and video data to the first USB interface through a designated port of the second USB interface of the local end, the designated port is adapted to be used for transmitting the audio and video data, to be forwarded by the embedded unit Giving the second device MCU to enable the second device to play the corresponding audio and video;

Receiving, by the second USB interface of the local end, information from the first USB interface, detecting a port for transmitting the information; if the port is used for transmitting a control signal, identifying the information as a control signal, and performing, by the local end, the control The action corresponding to the signal.
The method for implementing wired screen transmission according to claim 9, wherein the communication protocol port further comprises: a port for accessing a storage space; the embedded unit further provides a storage space, wherein the storage space is Storing a program for intercepting pictures and/or audio played by the local end;

The steps of intercepting the picture and/or audio played by the local end include:

The generated access instruction is adapted to the port for accessing the storage space, and is sent to the first USB interface through the second USB interface of the local end to access the storage space of the embedded unit and run through the local system interface. The program of the storage space captures the picture and/or audio played by the local end.
The method for implementing wired screen transmission according to claim 9, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

After the communication protocol port provided by the second device that accesses the second USB interface of the local terminal is identified by the pre-installed universal driver, the method further includes:

Obtaining the backhaul request identifier bit information of the local end, determining whether the backhaul request function of the local end is the open state according to the backhaul request identifier bit information; if yes, generating a backhaul request instruction;

The backhaul request instruction is adapted to the port for transmitting the backhaul request, and is sent to the first USB interface through the local second USB interface to be sent to the second device MCU through the embedded unit.
The method for implementing wired screen transmission according to claim 10, wherein before the intercepting the audio and video data to the port for transmitting the audio and video data, the method further comprises:

The intercepted audio and video data is compressed and/or encoded by a corresponding program that runs the storage space of the embedded unit through the local system interface.
The method for implementing a wired screen according to any one of claims 9 to 12, wherein the local device is a display source device; and the second device is a display device;

The attribute of the first USB interface is a USB device, and the attribute of the second USB interface is a USB host.
An apparatus for implementing a wired screen, comprising: a second device MCU and an embedded unit for implementing a screen, wherein the embedded unit is communicably connected to the second device MCU;

The second device MCU is configured to receive audio and video data forwarded by the embedded unit, to enable the second device to play the corresponding audio and video, and to obtain control of the picture and/or audio played by the second device. Signaling and transmitting to the embedded unit;

The embedded unit includes:

a port simulation module, configured to provide a plurality of communication protocol ports to the first device, the communication protocol port being identifiable by a universal drive of the first device; the universal drive of the first device providing a relationship between the first device and the standard USB device a universal communication protocol for communication, the communication protocol port comprising at least a port for transmitting audio and video data and a port for transmitting a control signal;

a connection establishing module, configured to establish, by using the communication protocol port, the first USB interface of the embedded unit, a USB communication connection between the embedded unit and the first device;

The audio and video data forwarding module is configured to detect that the first USB interface has information from the first device, and detects a port that transmits the information, and if it is a port for transmitting audio and video data, the information is recognized as audio and video data; Transmitting the audio and video data to a second device MCU;

The control signal returning module is configured to receive a control signal sent by the second device MCU, adapt the control signal to a port for transmitting the control signal, and send the first signal to the first device by using the first USB interface, indicating A device performs an action corresponding to the manipulation signal after receiving the manipulation signal.
The apparatus for implementing wired screen transmission according to claim 14, wherein the communication protocol port further comprises: a port for transmitting connection information;

The embedded unit further includes:

And a connection confirmation module, configured to generate a connection success instruction and adapt to a port for transmitting connection information, and send to the first device through the first USB interface.
The apparatus for implementing wired screen transmission according to claim 14, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

The embedded unit further includes:

a backhaul request receiving module, configured to detect that the first USB interface has information from the first device, and detects a port that transmits the information; if the port is used to transmit the backhaul request, the information is identified as a backhaul request command, And sent to the second device MCU;

The second device MCU is further configured to receive a return request command sent by the embedded unit, and enable a function of the second device for returning the control information.
The device for implementing wired screen transmission according to claim 14, wherein the communication protocol port further comprises: a port for accessing a storage space;

The embedded unit further includes:

The storage module is configured to detect that the first USB interface has information from the first device, and detects a port that transmits the information; if the port is used to access the storage space, the preset storage space of the embedded unit is used. Displayed to the first device, the first device system interface is used to intercept the picture and/or audio played by the first device by running the program of the storage space.
The device for implementing wired screen transmission according to any one of claims 14 to 17, wherein the first device is a display source device, and the second device is a display device;

The property of the first USB interface is a USB device.
An apparatus for implementing wired screen transmission, comprising:

a USB identification module, configured to identify, by using a pre-installed universal driver, a communication protocol port provided by a second device that accesses the second USB interface of the local end; the universal driver provides a universal communication protocol for communication between the local terminal and the standard USB device The communication protocol port includes at least a port for transmitting audio and video data and a port for transmitting a control signal, and an embedded unit for implementing the screen is disposed in the second device, where the embedded unit provides There is a first USB interface, the embedded unit is in communication with the second device MCU, and the second device accesses the local second USB interface through the first USB interface and provides a plurality of communication protocols that can be recognized by the universal driver. port;

An audio and video intercepting module, configured to intercept a picture and/or audio played by the local end;

An audio and video sending module, configured to send the intercepted audio and video data to the first USB interface through a designated port of the second USB interface of the local end, where the designated port is adapted to a port for transmitting audio and video data;

a control signal receiving module, configured to receive information from the first USB interface, and detect a port that transmits the information; if it is a port for transmitting a control signal, identify the information as a control signal, so that the local end performs the The action corresponding to the control signal.
The device for implementing wired screen transmission according to claim 19, wherein the communication protocol port further comprises: a port for accessing a storage space;

The audio and video intercepting module: the access instruction for generating and adapting to the port for accessing the storage space, and sending the first USB interface to the first USB interface through the local second USB interface to access the embedded unit Presetting the storage space and running the program of the storage space through the local system interface to intercept the picture and/or audio played by the local end.
The apparatus for implementing wired screen transmission according to claim 19, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;

The device for implementing wired screen transmission further includes:

The backhaul request module is configured to obtain the backhaul request identifier information preset by the local end, and determine whether the backhaul request function of the local end is enabled according to the backhaul request identifier information; if yes, generate a backhaul request command and adapt to The port for transmitting the return request is sent to the first USB interface through the second USB interface of the local end to be sent to the second device MCU through the embedded unit.
The device for implementing wired screen transmission according to any one of claims 19 to 21, wherein the local device is a display source device, and the second device is a display device;

The attribute of the first USB interface is a USB device, and the attribute of the second USB interface is a USB host.