CN115878537A

CN115878537A - Data transmission method and device

Info

Publication number: CN115878537A
Application number: CN202211505870.5A
Authority: CN
Inventors: 严薇南
Original assignee: Guangzhou Shizhen Information Technology Co Ltd
Current assignee: Guangzhou Shizhen Information Technology Co Ltd
Priority date: 2022-11-28
Filing date: 2022-11-28
Publication date: 2023-03-31
Also published as: WO2024114247A1

Abstract

The embodiment of the application discloses a data transmission method and a device thereof; the method comprises the following steps: when the Type-C interface is connected with the terminal equipment, starting to establish handshaking between a DP protocol and a USB2.0 protocol and the terminal equipment; when the DP protocol handshake is successful, judging whether the media data in the DP protocol format is received within preset time; if the media data in the DP protocol format are not received, sending a switching instruction to the terminal equipment, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data; and receiving the media data in the USB2.0 protocol format sent by the terminal equipment, wherein the media data in the USB2.0 protocol format is generated by processing the media data after the screen capture and coding processing of the terminal equipment based on the USB2.0 protocol. Because the wireless screen transmitter can rapidly switch to enter a normal working state without receiving the media data in the DP protocol format, manual switching by a user is not needed, and the problems of complex operation and time waste in the prior art can be solved.

Description

Data transmission method and device

Technical Field

The present application relates to the field of computers, and in particular, to a data transmission method and apparatus.

Background

In a multi-user conference scenario, a user may project content displayed on a display screen of a computer, such as a PPT, onto a larger display, such as an interactive smart tablet or a television, by connecting the computer to a screen transmitter, so that the user can share the content with participants more conveniently.

The existing screen transmission device can be connected with the Type-C interface of a computer through the Type-C interface. However, in an actual use process, when the screen transmission device is connected to a computer and then cannot transmit the content of the computer to the display, a user needs to manually switch a connection interface of the computer or replace one screen transmission device, which results in complex operation and time waste.

Disclosure of Invention

The embodiment of the application provides a data transmission method and a data transmission device, which can solve the problems of complex operation and time waste in the prior art.

The embodiment of the application provides a data transmission method, wherein a wireless screen transmitter comprises a Type-C interface, and the wireless screen transmitter supports DP protocol and USB2.0 protocol communication; the method comprises the following steps: when the Type-C interface is connected with the terminal equipment, starting to establish handshaking between a DP protocol and a USB2.0 protocol and the terminal equipment; when the DP protocol handshake is successful, judging whether the media data in the DP protocol format is received within preset time, wherein the media data in the DP protocol format is generated by processing the media data displayed on the current screen of the terminal equipment based on the DP protocol; if the media data in the DP protocol format are not received, sending a switching instruction to the terminal equipment, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data; and receiving media data in a USB2.0 protocol format sent by the terminal equipment, wherein the media data in the USB2.0 protocol format is generated by processing the media data after the screen capture and encoding processing of the terminal equipment based on the USB2.0 protocol.

The embodiment of the application further provides a data transmission method, which is applied to a wireless screen transmitter, wherein the wireless screen transmitter comprises a Type-C interface, a first data conversion chip and a processor, the Type-C interface is connected with the processor through the first data conversion chip, and the Type-C interface comprises a differential signal pin and a USB2.0 data pin;

the method comprises the following steps:

receiving media data in a DP protocol format sent by terminal equipment through the differential signal pins;

sending the received media data in the DP protocol format to the first data conversion chip;

the first data conversion chip converts the DP protocol format media data into MIPI format data, obtains target parameters according to the DP protocol format media data, and sends the MIPI format data and the target parameters to the processor;

and when the processor does not receive the MIPI format data within a first preset time, or does not obtain the target parameters within a second preset time, or determines that the first data conversion chip does not receive the DP protocol format media data within a third preset time, the processor switches to receive the USB2.0 protocol format media data through the USB2.0 data pin.

The embodiment of the application further provides a data transmission device, which comprises a Type-C interface, a first data conversion chip, a processor, a memory and a wireless module, wherein the Type-C interface comprises a first data pin and a second data pin, the first data pin is connected with the processor through the first data conversion chip, the second data pin is connected with the processor, and the processor is respectively connected with the memory and the wireless module;

the first data pin is used for receiving media data in a DP protocol format, and the second data pin is used for receiving media data in a USB2.0 protocol format;

the first data conversion chip is used for receiving the media data in the DP protocol format, converting the received media data in the DP protocol format into data in the MIPI format, obtaining a target parameter according to the media data in the DP protocol format, and sending the data in the MIPI format and the target parameter to the processor;

the processor is configured to receive the media data in the USB2.0 protocol format through the second data pin when the processor does not receive the data in the MIPI format within a first preset time, or does not obtain the target parameter within a second preset time, or determines that the first data conversion chip does not receive the media data in the DP protocol format within a third preset time.

In the data transmission method provided by the embodiment of the application, when the Type-C interface is connected with the terminal device, a handshake process between the terminal device and the DP protocol and the USB2.0 protocol can be started. And when the handshake is successful, judging whether the media data in the DP protocol format is received within the preset time, wherein the media data in the DP protocol format is generated by processing the media data displayed on the current screen of the terminal equipment based on the DP protocol. If the media data in the DP protocol format is not received, sending a switching instruction to the terminal equipment; the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on currently displayed media data; the wireless screen transmitter receives media data in a USB2.0 protocol format sent by the terminal equipment, and the media data in the USB2.0 protocol format is generated by processing the media data after screen capture and coding processing of the terminal equipment based on the USB2.0 protocol. If the media data in the DP protocol format cannot be received within the preset time, it indicates that the wireless screen transmitter cannot normally operate in the DP transmission mode at present, so the wireless screen transmitter may perform data transmission with the terminal device in the USB2.0 transmission mode to obtain the media data in the USB2.0 protocol format corresponding to the USB2.0 transmission mode. According to the embodiment, the wireless screen transmitter can be automatically switched into the USB2.0 transmission mode under the condition that the wireless screen transmitter cannot normally work in the DP transmission mode, so that manual switching of a user is avoided, the operation is simplified, and the time is saved. Because the wireless screen transmitter can rapidly enter a normal working state under the conditions that a DP transmission mode fails and a USB2.0 transmission mode is normal, manual switching of a user is not needed, and the problems of complex operation and time waste in the prior art can be solved.

In this application, can improve the work efficiency of wireless biography screen ware, save time.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of a scenario shown in an embodiment of the present application;

fig. 2 is a schematic structural diagram of an implementation manner of a wireless screen transmitter provided by an embodiment of the present invention;

fig. 3 is a schematic flowchart of a data transmission method according to an embodiment of the present application;

fig. 4 is a timing diagram of a data transmission method according to an embodiment of the present application;

fig. 5 is a schematic flowchart of a data transmission method according to another embodiment of the present application;

fig. 6 is a schematic flowchart of a data transmission method according to another embodiment of the present application;

fig. 7 is a schematic structural diagram of a data transmission virtual device according to an embodiment of the present application;

fig. 8 is a schematic structural block diagram of a specific implementation of a wireless screen transmitter provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

First, a use scene of the screen transmitter is described, and a scene of the screen transmitter used in a conference is described as an example, specifically, refer to fig. 1.

As shown in fig. 1, fig. 1 is a conference system provided in an embodiment of the present application, where the conference system includes a computer 1, a connecting line 2, a screen transmitter 3, and an interactive tablet 4. Wherein,

the screen transmitter 3 has a function of sharing desktop media data, such as PPT, video or audio, which may also be referred to as a screen projector, a wireless screen projector or a screen transmitter.

Data communication can be carried out between the computer 1 and the screen transmission device 3, for example, a connecting wire 2 can be arranged between the computer 1 and the screen transmission device 3 to be connected with each other in a wired communication mode. The connection line 2 may be a Universal Serial Bus (USB) connection line, a High Definition Multimedia Interface (HDMI) connection line, a Type-C connection line, or a network line. The connecting wire 2 and the screen transmission device 3 can be integrally formed or separately formed. Pass screen ware 3 and Type-C connecting wire integrated into one piece of this application embodiment.

Taking a scene that a user needs to share a conference document in the computer 1 in a conference as an example, due to the limitation of the screen size of the computer 1, after the user can connect the computer 1 with the screen transmitter 3 by using the connecting line 2, the screen transmitter 3 transmits a picture of the conference document displayed in the screen of the computer 1 to an interactive white board (interactive white board) 4 hung on a wall body for displaying.

The interactive tablet 4 may also be referred to as an interactive smart tablet, a smart interactive whiteboard, a large-screen tablet, etc. The hardware part of the interactive flat panel 4 is composed of a touch display module, an intelligent processing system (including a controller) and the like, and is combined together by an integral structural member, and is supported by a special software system, wherein the touch display module comprises a display screen, a touch assembly and a backlight assembly, the backlight assembly is used for providing a backlight light source for the display screen, the display screen generally adopts a liquid crystal display device and is used for displaying pictures, and the touch assembly is arranged on the display screen or at the front end of the display screen and is used for collecting touch operation data of a user and sending the collected touch operation data to the intelligent processing system for processing.

The screen transfer operation can be performed only after the data connection between the interactive tablet 4 and the screen transfer device 3 is established, and the screen transfer refers to displaying the content on one screen on another screen, for example, displaying the content on the computer screen on the interactive tablet 4, or displaying the content on the mobile phone screen on the interactive tablet 4 or the television screen. The screen transmission device 3 is a transmission medium between two screens involved in the screen transmission process, and can establish wired connection with the equipment where one screen is located through an interface and establish wireless connection with the equipment where the two screens are located through a wireless module.

The screen transmitter 3 and the interactive panel 4 may be connected through a wireless communication mode, which includes but is not limited to: wi-Fi, bluetooth, or other short-range wireless communication means, etc.

Secondly, in the above scenario, a problem that the content of the computer cannot be transmitted after the screen transmitter is connected to the computer occurs, and specifically, the analysis is performed with reference to fig. 2.

As shown in fig. 2, fig. 2 is a schematic structural diagram of an implementation manner of a wireless screen transmitter according to an embodiment of the present invention. The screen transmitter 3 may include a Type-C interface 11, a processor 12, a memory 13, and a wireless module 14. The processor 12 is respectively connected with the Type-C interface 11, the memory 13 and the wireless module 14.

For example, when the Type-C interface of a part of computers does not support DP format transmission or a DP channel of the screen transmitter fails, it is easy to cause that the screen transmitter cannot directly transmit audio/video data in the DP format. A common practice of the related art is to equip an interface adapter, and when a user finds that a screen-projecting screen does not appear on the interactive tablet 4 late, the user can manually replace the interface adapter (such as a Type-C interface and a USB2.0 interface adapter) by himself so that the screen transferring device 3 can be inserted into another interface (such as a USB2.0 interface) of the computer 1, or directly prompt the user to replace a new screen transferring device 3, which is cumbersome to operate and poor in user experience.

As shown in fig. 2, the screen reader 3 has a Type-C interface 11, and the Type-C interface 11 of the screen reader 3 may include a bus power supply VBUS pin. The user can insert this Type-C interface 11 into the Type-C interface of computer, and the computer can provide basic operating voltage for passing screen ware 3 through bus power supply VBUS pin of Type-C interface 11, and this operating voltage can be 5V or other voltages, passes screen ware 3 and begins work under the power supply of basic voltage.

The Type-C interface 11 is USB-Type-C, and the USB-Type-C is a hardware interface specification of a Universal Serial Bus (USB), has a faster transmission speed (maximum 10 Gbps) and stronger power transmission (maximum 100W), and is compatible with USB2.0, USB3.0, and DP (DisplayPort).

A differential signal transmission pin in the Type-C interface 11 can be used as a DP interface to transmit DP video data; the USB2.0 data transmission pins D + and D-in the Type-C interface 11 can be connected with corresponding pins in the terminal equipment in a mode of direct plugging or connection with an interface converter, and are used for receiving USB2.0 data output by the terminal equipment.

The processor 12 is a control center of the wireless screen transmitter 3, connects various parts of the whole wireless screen transmitter 3 by using various interfaces and lines, and executes various functions and processes data of the wireless screen transmitter 3 by running or executing software programs and/or modules stored in the memory 13 and calling data stored in the memory 13, thereby performing overall monitoring on the wireless screen transmitter 3.

The memory 13 is configured to store an executable program, where the executable program is configured to be run by a first processor of the terminal device after being downloaded to the terminal device, so that the first processor compresses audio and video data currently output by the first processor to a first display into media data in a USB2.0 protocol format, and outputs the media data in the USB2.0 protocol format from a Type-C socket of the terminal device. It can be understood that, the Type-C interface 11 in this embodiment of the application may receive audio and video data in the USB2.0 protocol format after being encoded and compressed by the terminal device, or may receive audio and video data in the DP protocol format after being uncompressed by the terminal device.

The wireless module 14 is a modular product implemented by wireless communication technology, and can transmit the received signal to the wireless communication network in a wireless manner, so that the signal is captured by a network node in the wireless communication network. Such as a WiFi module, a bluetooth module, or a ZigBee module, which are currently widely used for short-range local area network communication. The wireless module 14 provided in this embodiment may send the audio and video data acquired from the terminal device to other network nodes in the wireless communication network to display a video image. Generally, according to the general interface form in the prior art, the Type-C interface 11 on the wireless screen transmitter 3 is set as a plug, and the video signal interface on the terminal device is a socket. In a meeting scene, people can insert the Type-C interface 11 of the wireless screen transmitter 3 into a video signal interface of a personal computer, and the network node module of the large screen panel for meeting and the wireless module 14 of the wireless screen transmitter 3 are connected in a matching way in the same wireless communication network, so that audio and video data corresponding to a display picture of the personal computer can be transmitted to the large screen panel for meeting, wireless screen transmission is realized, and a driving program does not need to be downloaded on the personal computer.

The wireless screen transmitter can comprise a data conversion chip, the data conversion chip can be connected between a Type-C interface and a processor, the data conversion chip can perform format conversion on DP protocol format media data received by the Type-C interface of the wireless screen transmitter, and the DP protocol format media data is converted into MIPI format data.

Based on this, the present application provides a data transmission method, as shown in fig. 3, the data transmission method is applied to the screen transmitter 3 shown in fig. 1, the screen transmitter 3 can be electrically connected to a computer 1 (i.e. a terminal device), and the computer 1 is specifically described below by taking a computer as an example. The specific flow of the method may include the following steps 101 to 104, please refer to fig. 3 and 4 for details:

101. and when the Type-C interface is connected with the terminal equipment, starting to establish the handshaking between the DP protocol and the USB2.0 protocol and the terminal equipment.

The purpose of establishing handshaking between the DP protocol and the USB2.0 protocol with the terminal device is to acquire media data in the DP protocol format. After the screen transmission device 3 is confirmed to be connected with a computer, the computer can send an inquiry data packet to the screen transmission device 3 through a CC pin of a Type-C interface, and the inquiry data packet can be information defined by a supplier; after receiving the signal, the screen transmitter 3 correspondingly sends response information to the computer through the CC pin, where the response information is used to describe the device attribute of the screen transmitter 3, and specifically may include information about the current working mode or the supported working mode of the screen transmitter 3, a specific power supply range, and the like, and describe that the device type of the screen transmitter 3 is an external storage device. The computer can set the power supply voltage to the screen transmitter 3 according to the power supply range information.

For example, run _ mode may be recorded as a transmission mode number, and if run _ mode is set to 1, the wireless screen transmitter operates in a DP transmission mode; if run _ mode is set to 0, the wireless screen transmitter works in the USB2.0 transmission mode. The DP transmission mode is a specific example of a Type-C transmission mode, and the USB2.0 transmission mode is a specific example of a Type-a transmission mode.

For example, the response message sent by the screen transmitter 3 to the computer may include that the current operating mode of the screen transmitter 3 is the DP transmission mode. After the computer receives the response information sent by the screen transmitter 3, when the computer confirms that the current working mode of the screen transmitter 3 is the DP transmission mode, the Type-C interface of the computer can be set to work in the DP transmission mode, and the pre-installed DP drive of the computer operating system is called. For example, when the computer supports the Type-C interface, the media data in the DP protocol format including audio and video may be transmitted to the differential signal transmission pin pair (as the DisplayPort interface) of the screen transmitter 3 through the differential pin pair in the Type-C interface of the computer.

102. And when the handshake of the DP protocol is successful, judging whether media data in the DP protocol format is received within preset time, and if not, executing step 103.

And the media data in the DP protocol format is generated by processing the media data displayed on the current screen of the terminal equipment based on the DP protocol.

If the media data in the DP protocol format is not received within the preset time, it indicates that the wireless screen transmitter cannot normally operate in the Type-C transmission mode (i.e., the DP transmission mode), so step 103 is executed.

103. And sending a switching instruction to the terminal equipment, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data.

The computer can encode the media data to obtain the media data in the USB2.0 protocol format. The screen transmission device can transmit media data in a USB2.0 protocol format through a USB2.0 data transmission pin D + and a D-in the Type-C. When the screen transmitter transmits the media data in the USB2.0 protocol format, the transmission mode is the Type-A transmission mode.

In the foregoing embodiment, if the media data in the DP protocol format cannot be received within the preset time, it indicates that the wireless screen transmitter cannot normally operate in the Type-C transmission mode currently, so the wireless screen transmitter can perform data transmission with the computer by using the Type-a transmission mode to obtain the corresponding media data in the USB2.0 protocol format. According to the embodiment, the wireless screen transmitter can automatically switch to the Type-A transmission mode under the condition that the wireless screen transmitter cannot normally work in the Type-C transmission mode, so that manual switching of a user is avoided, operation is simplified, and time is saved.

Optionally, in a specific implementation manner, after the step 102, the method provided in the embodiment of the present application may further include the following steps:

if the media data in the DP protocol format are received, judging whether a target parameter is obtained within a preset time period, wherein the target parameter is obtained by identifying and processing the media data in the DP protocol format; and if the target parameter is not acquired, sending a switching instruction to the terminal equipment, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data.

Optionally, in an actual application process of a product, when the data conversion chip cannot identify and obtain the target parameter, the processor cannot process data based on the target parameter, so that the wireless screen transmitter cannot work normally. It can be understood that the target parameters are parameters required for the wireless screen transmitter to normally work in the Type-C transmission mode, namely: after the wireless screen transmitter acquires the target parameters, the wireless screen transmitter can normally work in a Type-C transmission mode. The target parameter may be a resolution parameter of the terminal device, and the target parameter may also be another parameter, and a specific parameter type of the target parameter should not be construed as a limitation to the present application.

The data conversion chip of the embodiment of the application can also calculate the target parameter according to the data in the DP protocol format, and send the target parameter and the data in the MIPI format to the processor together, and the processor performs encoding processing on the data in the MIPI format based on the target parameter.

The data conversion chip is physically connected to the Processor through an Integrated Circuit bus (I-Integrated Circuit, IIC or I2C) and a Mobile Industry Processor Interface (MIPI) signal line, wherein the Integrated Circuit bus is used for transmitting control data such as target parameters, the MIPI signal line is used for transmitting video data such as data in MIPI format, and the Processor controls the data conversion chip to acquire the video data through the MIPI signal line when receiving the target parameters transmitted by the Integrated Circuit bus.

For example, after receiving the media data in the DP protocol format, the Type-C interface of the wireless screen transmitter may send the media data in the DP protocol format to the data conversion chip, and after receiving the media data in the DP protocol format, the data conversion chip may calculate the media data in the DP protocol format to obtain a target parameter, such as resolution. The data conversion chip may also convert the DP protocol format media data to MIPI format data, where the MIPI format data is a data format suitable for the processor, for example, the data conversion chip may convert a video portion in the media data to MIPI format data, and convert an audio portion in the media data to I2S format data. After format conversion of the data conversion chip, the target parameters and the two formatted media data can be provided to the processor. If the wireless screen transmitter does not acquire the target parameters within the preset time period, the wireless screen transmitter is indicated to be incapable of normally working in the Type-C transmission mode within the preset time period, and a switching instruction is sent to the terminal device, wherein the switching instruction is used for enabling the terminal device to perform screen capture and coding processing on currently displayed media data.

Optionally, in a specific embodiment, the step "sending a switching instruction to the terminal device, where the switching instruction is used to enable the terminal device to perform screen capture and encoding processing on currently displayed media data" may specifically include the following steps 121 to 123:

121. and switching the transmission mode from the Type-C transmission mode to a Type-A transmission mode so that the terminal equipment encodes the media data to obtain the media data in the USB2.0 protocol format.

Illustratively, the computer may receive the second application from the wireless screen transmitter. And the second application program is integrated with a screen transmission service program, and the screen transmission service program is used for automatically running the second application program when the wireless screen transmitter is connected with the terminal equipment.

When the computer starts the second application program, if the wireless screen transmitter is switched from the Type-C transmission mode to the Type-A transmission mode, a mode switching instruction is sent to the computer, after the computer receives the mode switching instruction, the computer automatically runs the second application program, screenshot processing is carried out on media data of the computer through the second application program to obtain screen capture data, and the second application program can also encode the screen capture data to obtain the media data in the USB2.0 protocol format. It should be noted that the manner of obtaining the second application program by the computer is not limited to this, for example, the computer may also obtain and install the second application program from other third party devices or a specific website.

Specifically, the memory of the wireless screen transmitter may store the second application program in advance. When the computer receives the second application program from the wireless screen transmitter for the first time, the operation process may be as follows:

as mentioned above, the computer can receive the response information sent by the wireless screen transmitter, and after receiving the response information sent by the wireless screen transmitter, the computer can also display the drive letter corresponding to the external storage device according to the description of the device type. When the computer does not have a second application program (such as the first pairing or connection between the computer and the wireless screen transmitter, or the second application program is uninstalled after the computer is installed with the second application program), the user is required to open the operation of the corresponding disc character of the wireless screen transmitter at the computer end, and then the content stored in the storage space of the wireless screen transmitter is displayed, that is, the icon corresponding to the storage program in the wireless screen transmitter is displayed: such as an icon for the second application. And when double-click or right key operation aiming at the second application program icon is received, loading the second application program stored by the wireless screen transmitter into the memory of the computer through USB2.0 data transmission pins D + and D-in the Type-C interface 11 for the processor of the computer to execute. In some embodiments, when the computer is not installed with the second application program, the wireless screen transmitter may send a pop-up window instruction to the interactive tablet connected with the computer in a matched manner, so that the interactive tablet pops up a prompt box to prompt a user to manually open the corresponding drive letter at the computer terminal, and install the second application program.

The second application program is integrated with a screen transmission service program for automatically running the second application program, and the screen transmission service program can reside in the computer to run in the background after the user installs the second application program for the first time, so that the second application program is automatically started when the computer is inserted into the wireless screen transmitter for the second time, and manual operation of the user is not needed.

When the computer starts the second application program, if the wireless screen transmitter is switched from the Type-C transmission mode to the Type-A transmission mode, a switching instruction is sent to the computer, after the computer receives the switching instruction, the computer automatically runs the second application program, screenshot processing is carried out on media data of the computer through the second application program to obtain screen capture data, and the second application program can also encode the screen capture data to obtain the media data in the USB2.0 protocol format.

It should be noted that the manner of obtaining the second application program by the computer is not limited to this, for example, the computer may also obtain and install the second application program from other third party devices or a specific website.

Optionally, in some specific embodiments, the step 121 may specifically include the following steps: judging whether the terminal equipment is provided with a second application program or not;

if so, sending a switching instruction to the terminal equipment to instruct the terminal equipment to operate the second application program, and coding the media data through the second application program to obtain the media data in the USB2.0 protocol format;

and if not, sending a popup instruction to display equipment in matched connection with the wireless screen transmitter so as to instruct a user to install the second application program.

In the above embodiment, the wireless screen transmitter may first determine whether the terminal device has the second application program installed, and if the terminal device has the second application program installed, the wireless screen transmitter sends a switching instruction to the terminal device, so as to instruct the terminal device to operate the second application program, and then encode and process the media data through the second application program; and if the application program is not installed, displaying a popup window instruction on the display equipment which is connected with the wireless screen transmitter in a matching mode so as to instruct the user to install the second application program. The terminal device can specifically realize the encoding processing of the media data by running the second application program stored in the terminal device, and the method can improve the stability of the encoding processing.

In some embodiments, the second application is integrated with a screen transmission service program, and the screen transmission service program is used for automatically running the second application when the wireless screen transmitter is connected with the terminal device.

Optionally, before the terminal device runs the second application, the wireless screen transmitter may further perform the following steps: and operating an iptables routing rule to realize the switching of the network segments of the screen transfer device.

When the wireless screen transmitter operates in a Type-A transmission mode, a hardware interface for connecting the wireless screen transmitter and the terminal equipment is virtualized to be a wired network card, and the wired network card is provided with a wired network segment of the wired network card; the wireless module in the wireless screen transmission device is provided with a wireless network segment. When the wireless screen transmitter realizes data transmission through a Type-A transmission mode, the transmission path of the media data is as follows: a hardware interface (virtual to be a wired network card) of the wireless screen transmitter, a processor of the wireless screen transmitter, a wireless module of the wireless screen transmitter and the display equipment. Therefore, the wireless screen transmitter can realize the switching from the wired network segment to the wireless network segment by operating the iptables routing rule.

122. And receiving the media data in the USB2.0 protocol format sent by the terminal equipment.

Illustratively, the wireless screen transmitter receives media data in a USB2.0 protocol format sent by the terminal device through the USB2.0 data transmission pin D + and D-in the Type-C interface 11.

123. And transmitting the media data in the USB2.0 protocol format to the display equipment so that the display equipment decodes and displays the media data corresponding to the media data in the USB2.0 protocol format.

After the wireless screen transmitter receives the media data in the USB2.0 protocol format sent by the terminal device, the wireless screen transmitter may transmit the media data in the USB2.0 protocol format to the display device through a wireless module, such as the wireless module 14 shown in fig. 2, and the media data is displayed by the display device.

In the above embodiment, when the target parameter is not received within the preset time period, the wireless screen transmitter automatically switches its own transmission mode, so that the wireless screen transmitter can quickly enter a normal working state under the condition that one working state of two transmission modes fails and one working state is normal, without manual switching by a user, thereby improving the problems of complex operation and time waste in the prior art.

Optionally, in a specific embodiment, after the step "determining whether the target parameter is acquired within the preset time period", the method provided in this embodiment of the present application may further include the following steps S1 to S3:

s1, if the target parameters are received in the preset time period, converting the received media data in the DP protocol format into data in an MIPI format.

As described above, the data conversion chip of the wireless screen transmitter may be connected between the Type-C interface and the processor, and the data conversion chip may perform format conversion on the DP protocol format media data received by the Type-C interface of the wireless screen transmitter, and convert the DP protocol format media data into MIPI format data. For example, after receiving the media data in the DP protocol format, the Type-C interface of the wireless screen transmitter may send the media data in the DP protocol format to the data conversion chip, and after receiving the media data in the DP protocol format, the data conversion chip may convert the format of the data into data in the MIPI format, where the data in the MIPI format is in a data format suitable for the processor, for example, the data conversion chip may convert a video part in the media data into data in the MIPI format, and convert an audio part in the media data into data in the I2S format. The two formatted media data can be provided to the processor after format conversion by the data conversion chip.

S2, encoding the MIPI format data to obtain an encoding result.

The data conversion chip of the wireless screen transmitter sends the data in the MIPI format to the processor in the wireless screen transmitter, and after the processor receives the data in the MIPI format, the data in the MIPI format can be compressed and encoded.

Optionally, in a specific embodiment, the wireless screen transmitter stores a first application program; accordingly, step S2 includes steps S21 to S22 as follows:

and S21, running the first application program.

And S22, coding the data in the MIPI format through the first application program to obtain a coding result.

The memory of the wireless screen transmitter may be pre-stored with a first application program, the processor may obtain the first application program from the memory and execute the first application program, and the first application program may compress and encode the data in the MIPI format.

In the above embodiment, the wireless screen transmitter may execute the first application stored in itself to implement the encoding process on the media data. The first application program stored in the wireless screen transmitter can be customized for the wireless screen transmitter without being compatible with other hardware, so that the error rate is low, and the stability is high.

And S3, transmitting the encoding result to display equipment so that the display equipment decodes and displays the media data corresponding to the encoding result.

The wireless screen transmitter can transmit the coding result to the display device through the communication network through the wireless module. The display device is a screen-transmitting receiving end, such as the interactive flat panel 4 in fig. 1, and the display device may receive the encoding result, decode the encoding result to obtain media data, and then display the media data. The display device can be provided with a receiving box, and the receiving box can be integrated with the display device or designed separately from the display device; the receiving box is used for receiving the media data from the wireless screen transmitter and transmitting the media data to the display device for displaying.

Further, it should be noted that: when a processor of the wireless screen transmitter receives a screen transmission instruction output by a user, the processor starts to compress and encode the received audio media data and the processed video media data (or the audio media data can be unprocessed); before the processor of the wireless screen transmitter does not receive the screen transmitting instruction output by the user, although the media data is received at this time, the received audio and/or video media data is discarded without being compressed or transmitted, so that the resources of the processor of the wireless screen transmitter are saved, that is, step S3 may be a step executed after the screen transmitting instruction is confirmed to be received.

In the foregoing embodiment, if the wireless screen transmitter is in the Type-C transmission mode and acquires the target parameter within the preset time period, the wireless screen transmitter may always operate in the Type-C transmission mode: the media data are collected from the terminal equipment, the wireless screen transmitter is used for coding the media data to obtain a coding result, and the coding result is transmitted to the display equipment. If the wireless screen transmitter receives the target parameters within the preset time period, the screen transmitting work can be continuously carried out in a Type-C transmission mode, and therefore the screen transmitting speed is increased.

Optionally, in a specific embodiment, step 103 may specifically include the following steps 1031 to 1033:

1031. if the media data in the DP protocol format is not received, determining whether a second application program is installed in the terminal device, if so, executing step 1032; if not, step 1033 is performed.

And the second application program is integrated with a screen transmission service program, and the screen transmission service program is used for automatically running the second application program when the wireless screen transmitter is connected with the terminal equipment.

1032. And sending a switching instruction to the terminal equipment to instruct the terminal equipment to operate the second application program, and carrying out screen capture and coding processing on the currently displayed media data through the second application program.

1033. And sending a popup instruction to a display device which is connected with the wireless screen transmitter in a matched mode so as to instruct a user to install the second application program.

In the above embodiment, the wireless screen transmitter may first determine whether the terminal device has the second application program installed, and if so, the wireless screen transmitter sends a switching instruction to the terminal device, so as to instruct the terminal device to operate the second application program, and encode the media data through the second application program; and if the application program is not installed, displaying a popup window instruction on the display equipment which is connected with the wireless screen transmitter in a matching mode so as to instruct the user to install the second application program. The terminal device can specifically realize the encoding processing of the media data by running the second application program stored in the terminal device, and the method can improve the stability of the encoding processing.

Optionally, when the computer is not installed with the second application program, the wireless screen transmitter may send a pop-up window instruction to the interactive tablet connected with the computer in a matched manner, so that the interactive tablet pops up a prompt box to prompt a user to manually open the corresponding drive letter at the computer end, and install the second application program.

104. And receiving the media data in the USB2.0 protocol format sent by the terminal equipment.

The media data in the USB2.0 protocol format is generated by processing the media data after the screen capture and coding of the terminal equipment based on the USB2.0 protocol.

In the data transmission method provided by the embodiment of the application, when the Type-C interface is connected with the terminal device, a handshake process between the terminal device and the DP protocol and the USB2.0 protocol can be started. And when the handshake is successful, judging whether the media data in the DP protocol format is received within the preset time, wherein the media data in the DP protocol format is generated by processing the media data displayed on the current screen of the terminal equipment based on the DP protocol. If the media data in the DP protocol format is not received, sending a switching instruction to the terminal equipment; the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on currently displayed media data; the wireless screen transmitter receives media data in a USB2.0 protocol format sent by the terminal equipment, and the media data in the USB2.0 protocol format is generated by processing the media data after screen capture and coding processing of the terminal equipment based on the USB2.0 protocol. If the media data in the DP protocol format cannot be received within the preset time, it indicates that the wireless screen transmitter cannot normally work in the Type-C transmission mode currently, so that the wireless screen transmitter can perform data transmission with the terminal device by adopting the Type-A transmission mode to acquire the media data in the USB2.0 protocol format corresponding to the Type-A transmission mode. According to the embodiment, the wireless screen transmission device can automatically switch to the Type-A transmission mode under the condition that the wireless screen transmission device cannot normally work in the Type-C transmission mode, so that manual switching of a user is avoided, operation is simplified, and time is saved. Because wireless biography screen ware can be in Type-C transmission mode trouble, and under the normal condition of Type-A transmission mode, get into normal operating condition fast, and need not user's manual switching to can improve prior art complex operation, the problem of time-wasting.

In this embodiment, the method in the embodiment of the present application will be described in detail by taking an example in which the target parameter is a resolution parameter.

As shown in fig. 6, a specific flow of a data transmission method is as follows:

201. and when the Type-C interface of the wireless screen transmitter is connected with the terminal equipment, establishing a handshaking relation between the DP protocol and the USB2.0 protocol and the terminal equipment.

202. Judging whether the resolution parameter is acquired within a preset time period, if so, executing step 203; if not, go to step 206.

203. The media data is collected.

204. And operating a first application program stored in the wireless screen transmitter, and coding the media data through the first application program to obtain a coding result.

205. And transmitting the encoding result to the display equipment so that the display equipment decodes and displays the media data corresponding to the encoding result.

206. And sending a switching instruction to the terminal equipment, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data to obtain a coding result.

207. And receiving the coding result sent by the terminal equipment.

208. And transmitting the encoding result to the display equipment so that the display equipment decodes and displays the media data in the USB2.0 protocol format corresponding to the encoding result. As can be seen from the above, the initial transmission mode of the wireless screen transmitter is a Type-C mode (i.e., a mode in which the DP protocol and the USB2.0 protocol successfully handshake with the terminal device), and in this mode, it is determined whether the wireless screen transmitter maintains the Type-C mode or switches to the Type-a mode (i.e., a mode in which media data in the USB2.0 protocol format is transmitted) according to whether the wireless screen transmitter acquires a resolution parameter within a preset time period, and if the wireless screen transmitter maintains the Type-C mode, the wireless screen transmitter may perform encoding processing on the media data to obtain an encoding result; if the mode is switched to the Type-A mode, the terminal equipment can carry out coding processing on the media data to obtain a coding result, then the coding result is sent to the wireless screen transmitter, and the coding result is transmitted to the display equipment by the wireless screen transmitter. Because wireless biography screen ware can get into normal operating condition fast under two kinds of transmission mode Type-C mode trouble, the normal condition of Type-A mode, and need not user's manual switching to can improve prior art complex operation, the problem of wasted time.

In this application, can improve the work efficiency of wireless biography screen ware, save time. Optionally, in a specific implementation manner, please refer to fig. 5 for details, and fig. 5 shows a method provided by another embodiment of the present application, which specifically includes the following steps A1 to A4:

a1, detecting whether the Type-C interface is connected with the terminal equipment, and if so, executing the step A2.

And A2, carrying out data transmission with the terminal equipment by adopting a Type-C transmission mode to acquire the media data in the DP protocol format.

Optionally, in a specific embodiment, the step A2 may specifically include the following steps a21 to a23:

and A21, collecting the media data in the DP protocol format and converting the media data into data in the MIPI format.

And A22, coding the data in the MIPI format to obtain a coding result.

And A23, transmitting the encoding result to the display device so that the display device decodes and displays the media data corresponding to the encoding result.

In the above embodiment, the media data is collected from the terminal device, and the screen transmitter performs encoding processing on the media data to obtain an encoding result, and transmits the encoding result to the display device.

And A3, judging whether the target parameters can be obtained according to the media data in the DP protocol format within preset time, and if not, executing the step A4.

And A4, switching the transmission mode from the Type-C transmission mode to a Type-A transmission mode to acquire the media data in the USB2.0 protocol format.

Optionally, in a specific embodiment, the step A4 may specifically include the following steps a41 to a43:

and A41, switching the transmission mode from the Type-C transmission mode to a Type-A transmission mode so that the terminal equipment encodes the media data to obtain the media data in the USB2.0 protocol format.

Optionally, in a specific embodiment, the step a41 may specifically include the following steps a411 to a413:

a411, judging whether the terminal equipment is provided with a second application program, if so, executing a step A412; if not, go to step A413.

A412, sending a switching instruction to the terminal device to instruct the terminal device to run the second application program, and performing encoding processing on the media data through the second application program to obtain the media data in the USB2.0 protocol format.

And A413, sending a popup command to a display device connected with the wireless screen transmitter in a matched mode so as to instruct a user to install the second application program.

In the above embodiment, the wireless screen transmitter may first determine whether the terminal device has the second application program installed, and if so, the wireless screen transmitter sends a switching instruction to the terminal device, so as to instruct the terminal device to operate the second application program, and encode the media data through the second application program; and if the application program is not installed, displaying a popup window instruction on the display equipment which is connected with the wireless screen transmitter in a matching mode so as to instruct the user to install the second application program. The terminal device can specifically implement the encoding processing on the media data by running the second application program stored in the terminal device, and the method can improve the stability of the encoding processing.

And A42, receiving the media data in the USB2.0 protocol format sent by the terminal equipment.

And A43, transmitting the media data in the USB2.0 protocol format to a display device, so that the display device decodes and displays the media data corresponding to the media data in the USB2.0 protocol format.

In the foregoing embodiment, in the Type-a transmission mode, the terminal device performs the encoding processing operation on the media data, and after the terminal device performs the encoding result, the terminal device sends the encoding result to the screen transmitter, and the screen transmitter transmits the encoding result to the display device.

In the foregoing embodiment, when the Type-C interface is connected to the terminal device, data transmission may be performed with the terminal device by using a Type-C transmission mode to acquire the media data in the DP protocol format. Then judging whether the target parameter can be obtained according to the media data in the DP protocol format within a preset time; if the media data cannot be acquired, it is indicated that the wireless screen transmitter cannot normally work in the Type-C transmission mode currently, so that the wireless screen transmitter can perform data transmission with the terminal device in the Type-A transmission mode to acquire the media data in the USB2.0 protocol format corresponding to the Type-A transmission mode. According to the embodiment, the wireless screen transmission device can automatically switch to the Type-A transmission mode under the condition that the wireless screen transmission device cannot normally work in the Type-C transmission mode, so that manual switching of a user is avoided, operation is simplified, and time is saved.

Optionally, referring to fig. 8 for details, in an implementation manner, the method provided by the embodiment of the present application is applied to a wireless screen transmitter, where the wireless screen transmitter includes a Type-C interface, a first data conversion chip, and a processor, the Type-C interface is connected to the processor through the first data conversion chip, and the Type-C interface includes a differential signal pin and a USB2.0 data pin; the method comprises the following steps B1 to B4:

b1, receiving media data in a DP protocol format sent by terminal equipment through the differential signal pins;

b2, sending the received media data in the DP protocol format to the first data conversion chip;

b3, the first data conversion chip converts the media data in the DP protocol format into data in the MIPI format, obtains target parameters according to the media data in the DP protocol format, and sends the MIPI format data and the target parameters to the processor;

optionally, the first data conversion chip is connected to the processor through an ICC bus and an MIPI signal line, respectively, and the first data conversion chip sends a notification instruction to the processor through the ICC bus, where the notification instruction is used to inform the processor whether the first data conversion chip receives media data in the DP protocol format within a preset time period; and the first data conversion chip sends the MIPI format data through the MIPI signal wire.

And B4, when the processor does not receive the MIPI format data within a first preset time, or does not obtain the target parameters within a second preset time, or determines that the first data conversion chip does not receive the DP protocol format media data within a third preset time, the processor is switched to receive the USB2.0 protocol format media data through the USB2.0 data pin.

In the embodiment of the application, the wireless screen transmitter is designed to be compatible with two transmission modes, namely a Type-C transmission mode and a Type-A transmission mode, in advance, that is, the wireless screen transmitter can support the transmission of two formats, namely, media data in a DP protocol format and media data in a USB2.0 protocol format. Specifically, a first code, a second code and a third code can be prestored in the wireless screen transmitter, the first code is used for realizing a Type-C transmission mode, so that transmission of media data in a DP protocol format is realized, the second code is used for realizing a Type-A transmission mode, so that transmission of the media data in a USB2.0 protocol format is realized, and the third code is used for realizing transmission mode switching of the wireless screen transmitter, namely switching of a Type-C transmission mode and a Type-A transmission mode. The first code, the second code, and the third code can be stored in a memory, and invoked from the memory by the processor to perform corresponding functions. The third code may include a transmission mode instruction run _ mode, and the wireless screen transmitter implements control over the current data transmission mode by assigning the transmission mode instruction run _ mode, for example, when run _ mode =1, the wireless screen transmitter may be set to perform data transmission in a Type-C transmission mode, and when run _ mode =0, the wireless screen transmitter may be set to perform data transmission in a Type-a transmission mode, which is described in detail below.

Illustratively, when the Type-C interface of the wireless screen reader is plugged into the Type-C interface of the computer, the first data conversion chip in the wireless screen reader establishes a communication process with the computer, including a handshake of the DP protocol and a handshake of the USB2.0 protocol. When the DP protocol between the first data conversion chip and the computer is successfully handshake, the first data conversion chip sets the value of the screen transmission mode instruction run _ mode to 1, and sends the result of the screen transmission mode instruction run _ mode =1 to the processor. And after the DP protocol handshake between the first data conversion chip and the computer is successful, the first data conversion chip receives the DP protocol format media data transmitted by the computer, performs data format conversion on the received DP protocol format media data to obtain MIPI format media data and identifies to obtain target parameters, such as resolution parameters, and sends the MIPI format media data and the target parameters to the processor. Since it takes a certain time for the first data conversion chip to identify the media data in the DP protocol format, the processor receives the result of the screen-transfer mode instruction (run _ mode = 1) first, receives the target parameter after a certain time, and after receiving the run _ mode =1, the media data in the MIPI format, and the target parameter, the processor performs compression coding processing on the media data in the MIPI format according to the target parameter to obtain data after coding processing, and sends the data after coding processing to the wireless module, and the wireless module sends the data to the interactive panel through the wireless communication network, so that the wireless screen-transfer device can normally work in the Type-C transmission mode.

However, if the wireless screen transmitter waits for the target parameter for an unlimited time, the screen transmission process may be lengthened, which may result in a bad experience for the user. Therefore, in the embodiment of the application, when the operating system of the processor is started, the timer is started to count time, and if the target parameter is received within the second preset time, the wireless screen transmitter operates in the Type-C transmission mode as described above. In addition, the processor can generate a notification instruction and send the notification instruction to a second application program installed in the computer, so that the second application program does not perform screenshot, encoding and other operations, the computer cannot send media data in a USB2.0 protocol format to the wireless screen transmitter, and the computer can work in a Type-C transmission mode and does not work in a Type-A transmission mode.

If the processor does not receive the target parameter in the second preset time, the processor sets the value of the screen transmission mode instruction run _ mode to 0, and sends the result of run _ mode =0 to a second application program of the computer, so that the second application program carries out screenshot and coding processing on the current media data of the computer to obtain the media data in the USB2.0 protocol format, and sends the media data in the USB2.0 protocol format to the processor through a USB2.0 data pin, the processor sends the received media data in the USB2.0 protocol format to the wireless module, and the wireless module sends the received media data in the USB2.0 protocol format to the interactive panel through the wireless communication network.

In some embodiments, when the DP protocol between the first data conversion chip and the computer is not successfully handshake, the first data conversion chip sets the value of the pass screen mode instruction run _ mode to 0, and sends run _ mode =0 to the processor. When the processor receives run _ mode =0, the result of run _ mode =0 is sent to a second application program of the computer, so that the second application program carries out screenshot and coding processing on the current media data of the computer to obtain the media data in the USB2.0 protocol format, the media data in the USB2.0 protocol format is sent to the processor through a USB2.0 data pin, the processor sends the received media data in the USB2.0 protocol format to the wireless module, and the wireless module sends the received media data in the USB2.0 protocol format to the interactive panel through a wireless communication network. If the first data conversion chip fails and the handshake with the DP protocol of the computer cannot be successful, it cannot set the value of run _ mode to 0 and send it to the processor, however, if the processor waits for the feedback of the first data conversion chip, the screen transmission process is lengthened, and bad experience is brought to the user. Therefore, in the embodiment of the application, when the operating system of the processor is started, the timer is started to time, if no feedback of the first data conversion chip is received within a third preset time, it is determined that the first data conversion chip does not receive the media data in the DP protocol format, at this time, the processor sets the value of the pass screen mode instruction run _ mode to 0, and sends the result of run _ mode =0 to the second application program of the computer, so that the second application program performs screenshot and encoding processing on the current media data of the computer, obtains the media data in the USB2.0 protocol format, and sends the media data in the USB2.0 protocol format to the processor through the USB2.0 data pin, the processor sends the received media data in the USB2.0 protocol format to the wireless module, and the wireless module sends the media data to the interactive tablet through the wireless communication network.

In some embodiments, when the DP protocol handshake between the first data conversion chip and the computer is successful, the first data conversion chip sets the value of the pass mode instruction run _ mode to 1, and sends the result of run _ mode =1 to the processor, so as to inform the processor: the DP protocol with the computer is successfully handshaking. However, when the received DP protocol format media data cannot be converted into MIPI format data due to the failure of the first data conversion chip, the screen transmission process is lengthened if the processor waits for MIPI format data, which results in poor experience for the user. Therefore, in the embodiment of the application, when an operating system of the processor is started, the timer is started to time, if the MIPI format data are not received within the first preset time, the processor modifies the value of the pass screen mode instruction run _ mode to 0, and sends the result of run _ mode =0 to the second application program of the computer, so that the second application program performs screenshot and encoding processing on the current media data of the computer to obtain the media data in the USB2.0 protocol format, and sends the media data in the USB2.0 protocol format to the processor through the USB2.0 data pin, the processor sends the received media data in the USB2.0 protocol format to the wireless module, and the wireless module sends the received media data in the USB2.0 protocol format to the interactive tablet through the wireless communication network.

Optionally, in a specific embodiment, the step B4 may specifically include the following steps B41 to B42:

and B41, when the processor does not receive the MIPI format data within a first preset time, or does not obtain the target parameter within a second preset time, or determines that the first data conversion chip does not receive the DP protocol format media data within a third preset time, the processor controls to acquire the second application program from the memory and sends the second application program to the terminal equipment through the USB2.0 data pin, so that the terminal equipment runs the second application program, and the second application program is used for performing screenshot and coding processing on the current media data of the terminal equipment to obtain the USB2.0 protocol format media data.

And B42, the processor controls to switch to receive the media data in the USB2.0 protocol format sent by the terminal equipment through the USB2.0 data pin. In the above embodiment, the Type-C interface receives the media data in the DP protocol format and transmits the media data in the DP protocol format to the first data conversion chip. The first data conversion chip converts the media data in the DP protocol format into data in the MIPI format, and the first data conversion chip obtains the target parameters according to the media data in the DP protocol format. And the first data conversion chip sends the MIPI format data and the target parameters to the processor. And when the processor does not receive the MIPI format data within a first preset time, or does not obtain the target parameters within a second preset time, or determines that the first data conversion chip does not receive the DP protocol format media data within a third preset time, the processor switches to receive the USB2.0 protocol format media data through the USB2.0 data pin.

According to the implementation mode, the processor of the wireless screen transmitter can be automatically switched to the transmission mode for receiving the media data in the USB2.0 protocol format under the condition that the processor cannot normally process the MIPI format data and the target parameters, so that manual switching of a user is avoided, operation is simplified, and time is saved.

In order to better implement the above method, the embodiment of the present application further provides a data transmission device, such as the Type-C Type screen transmitter 3 shown in fig. 1, see fig. 8 for details, which may include a Type-C interface 11, a first data conversion chip 51, a processor 12 and a wireless module 14. The Type-C interface 11 includes a first data pin and a second data pin, the first data pin is connected to the processor 12 through the first data conversion chip 51, the second data pin is connected to the processor 12, and the processor 12 is connected to the memory 13 and the wireless module 14, respectively.

In the actual use process of the wireless screen transmitter, the first data conversion chip 51 may be damaged, the communication path between the processor 12 and the first data conversion chip 51 or the communication module in the processor 12 may be damaged, and the terminal device may not support sending of the media data in the DP protocol format, so that the first data conversion chip 51 does not receive the media data in the DP protocol format or other reasons, and the processor 12 may not receive the data in the MIPI format sent by the first data conversion chip 51 in a preset time period, thereby preventing the wireless screen transmitter from being used. In addition, even if the first data conversion chip 51 receives the media data in the DP protocol format, if the first data conversion chip 51 cannot perform an identifier on the media data in the DP protocol format to obtain the target parameter, the wireless screen-transmitting function may be disabled.

Based on this, the first data pin and the second data pin in the embodiment of the present application may both be used to acquire current media data (including currently displayed video data, audio data, and control instructions, etc.) of the terminal device, and data formats of the media data acquired by the first data pin and the second data pin are different. The first data pin is used for receiving the media data in the DP protocol format from the terminal equipment, and the second data pin is used for receiving the media data in the USB2.0 protocol format from the terminal equipment. The first data conversion chip 51 is configured to receive the media data in the DP protocol format, convert the received media data in the DP protocol format into data in the MIPI format, obtain a target parameter according to the media data in the DP protocol format, and send the data in the MIPI format and the target parameter to the processor 12; the processor 12 is configured to receive media data in a USB2.0 protocol format through the second data pin when the data in the MIPI format sent by the first data conversion chip is not received within a preset time period.

It can be understood that, in the embodiment of the present application, the wireless screen transmitter has two data transmission links, that is, the first data pin-first data conversion chip-processor and the second data pin-processor, and if the processor does not receive data in the MIPI format within a preset time period, it indicates that the wireless screen transmitter cannot directly work with one data transmission link, that is, the first data pin-first data conversion chip-processor, and at this time, the wireless screen transmitter may be switched to work with one data transmission link, that is, the second data pin-processor, so as to avoid a situation that the wireless screen transmitter cannot work due to an abnormality of the data transmission link, that is, the first data pin-first data conversion chip-processor.

Illustratively, the Type-C interface of the wireless screen transmitter has 24 pins in total, including two rows of pins with the same function, and the two rows of pins with the same function support forward insertion or backward insertion. The TYPE-C interface includes two pairs of power pins (A9, B4, B9, A4), four pairs of TX/RX pins (A11 and B2, A10 and B3, A4 and B10, A2 and B11, i.e., first data pins), two pairs of USB2.0 data pins, D +/D-pins (A6 and B7, A7 and B6, i.e., second data pins), and a CC pin (A5) for pairing communication at the time of plug-in pairing. Wherein, TX +, TX-, RX + and RX-in each group of pins are differential signal transmission pins, and each group of differential signal transmission pins support to work in a USB mode or a DP (display Port) mode. When the differential signal transmission pin pair works in a USB mode, the signal transmission pin pair transmits a USB3.0 signal; when the differential signaling pin pair operates in the DP mode, the signaling pin pair is used as a DP (display port) interface for transmitting media data in the DP protocol format. Each group of USB D +/D-pins supports the work in a USB2.0 mode and is used for transmitting data in a USB2.0 format.

After a user inserts the Type-C interface of the wireless screen transmitter into the Type-C interface of the terminal device (specifically described below by taking a computer as an example), the computer can power on the wireless screen transmitter through the VBUS pin in the Type-C interface of the wireless screen transmitter to provide a working voltage for the wireless screen transmitter. After the successful connection is confirmed, the computer can send an inquiry data packet to the wireless screen transmitter through a CC pin of the Type-C interface, wherein the inquiry data packet can be self-defined information of a supplier; after receiving the signal, the wireless screen transmitter correspondingly sends response information to the computer through the CC pin, where the response information is used to describe the device attribute of the wireless screen transmitter, and specifically may include information about the current working mode or the supported working mode of the wireless screen transmitter, a specific power supply range, and the like, and describes that the device type of the wireless screen transmitter is an external storage device.

The response message sent by the wireless screen transmitter to the computer may include that the current operating mode of the wireless screen transmitter is the DP transmission mode. After the computer receives the response information sent by the wireless screen transmitter, when the computer confirms that the current working mode of the wireless screen transmitter is the DP transmission mode, the Type-C interface of the computer can be set to work in the DP transmission mode, the pre-installed DP drive of the computer operating system is called, and the media data in the DP protocol format including audio and video is transmitted to the wireless screen transmitter differential signal transmission pin pair (namely, the first data pin) through the differential pin pair in the Type-C interface of the computer.

The wireless screen transmitter differential signal transmission pin is connected with the processor 12 through the first data conversion chip 51, after receiving the media data in the DP protocol format, the first data pin sends the media data in the DP protocol format to the first data conversion chip 51, and the first data conversion chip 51 can convert a video part in the media data in the DP protocol format into data in the MIPI format and convert an audio part in the media data in the DP protocol format into media data in the I2S format. The two formatted media data may be provided to the processor 12 after being format-converted by the first data conversion chip 51. Optionally, the processor 12 is a hardware processor (such as an ARM processor), and the processor 12 can compress and encode the two formatted media data.

In addition, the first data conversion chip 51 may also calculate a target parameter according to the received media data in the DP protocol format, and send the target parameter and the converted data in the MIPI format to the processor, where the processor performs encoding processing on the data in the MIPI format based on the target parameter.

The two pairs of USB D +/D-pins are directly connected to the processor 12, and can acquire the media data in the USB2.0 protocol format from the computer, and directly send the acquired media data in the USB2.0 protocol format to the processor 12.

The processor is configured to switch to perform data transmission with the computer through the USB2.0 data pin to obtain the media data in the USB2.0 protocol format when the processor does not receive the data in the MIPI format within a first preset time, or does not obtain the target parameter within a second preset time, or determines that the first data conversion chip does not receive the media data in the DP protocol format within a third preset time.

It can be understood that when the data in the MIPI format is not received within the first preset time, or the target parameter is not obtained within the second preset time, or it is determined that the first data conversion chip does not receive the media data in the DP protocol format within the third preset time, the wireless screen transmitter cannot normally operate to transmit the wireless screen transmission content to the display device, and at this time, the processor 12 controls to obtain the media data in the USB2.0 protocol format from the computer terminal through the two pairs of USB D +/D-pins.

This process is described in detail below:

the wireless screen transmitter further comprises a memory 13, wherein the memory 13 can be pre-stored with a second application program, and the second application program can be sent to the computer to be run on the computer. When the computer has started the second application program, if the processor of the wireless screen transmitter does not receive the data in the MIPI format within the first preset time, or does not obtain the target parameter within the second preset time, or determines that the first data conversion chip does not receive the media data in the DP protocol format within the third preset time, the computer may send a switching instruction to the computer, after receiving the switching instruction, the computer automatically runs the second application program, and performs screenshot processing on the media data of the computer through the second application program to obtain screen capture data, the second application program may further encode the screen capture data to obtain the media data in the USB2.0 protocol format, and sends the media data in the USB2.0 protocol format to the USB D +/D-pin in the Type-C interface of the computer through the USB D +/D-pin in the Type-C interface of the wireless screen transmitter, and sends the media data in the USB2.0 protocol format to the USB D +/D-pin in the Type-C interface after receiving the media data in the USB2.0 protocol through the USB D +/D-pin in the Type-C interface, the USB D-pin in the Type-C interface, sends the media data in the USB2.0 protocol processor to the USB D +/D-C interface, and sends the processor to the wireless screen capture data such as a wireless network data in the wireless network module in the wireless network 14.0 format, and then sends the wireless network to obtain the wireless network data in the wireless network from the USB2.0 network, so as a wireless terminal, and sends the wireless network data in the wireless network module.

When a second application program is not installed (such as the first pairing or connection between the computer and the wireless screen transmitter, or the second application program is uninstalled after the computer is installed), it is necessary for the user to open the operation of the corresponding disc character of the wireless screen transmitter at the computer end, and further display the content stored in the storage space of the wireless screen transmitter, that is, display the icon corresponding to the storage program in the wireless screen transmitter: such as an icon for the second application. At this time, the user needs to manually double-click or operate the right key for the icon of the second application program, and when the computer receives the double-click or right key operation for the icon of the second application program, the second application program stored in the wireless screen transmitter is loaded to the memory of the computer through the USB2.0 data transmission pins D + and D-in the Type-C interface 11 so as to be executed by the processor of the computer.

The second application program is integrated with a screen transmission service program used for automatically starting the second application program, and after the user installs the second application program for the first time, the screen transmission service program can reside in the computer background to run, so that the second application program is automatically started when the computer is inserted into the wireless screen transmitter for the second time, and manual operation of the user is not needed.

In some embodiments, when the computer does not have the second application program installed, the wireless screen transmitter may send a pop-up window instruction to the interactive tablet connected with the computer in a mutually paired manner, so that the interactive tablet pops up a prompt box to prompt a user to manually open a corresponding drive letter at the computer end, and install the second application program.

It should be noted that the manner of obtaining the second application program by the computer is not limited to this, for example, the computer may also obtain the second application program from other third party devices or a specific website.

In this embodiment of the application, before the terminal device runs the second application program, the wireless screen transmitter may further perform the following steps: and operating an iptables routing rule to realize the switching of the network segments of the screen transfer device.

When the wireless screen transmitter receives a switching instruction, the Type-c interface of the wireless screen transmitter connected with the terminal equipment is virtualized to be a wired network card, the wired network card is provided with a wired network segment of the wired network card, the wireless module 14 of the wireless screen transmitter is provided with a wireless network segment of the wireless module 14, and the wired network segment of the wired network card virtualized from the Type-c interface can be converted into the wireless network segment of the wireless module 14 by operating an iptables routing rule, so that the conversion from the wired network segment to the wireless network segment is realized, the wireless screen transmitter can transmit the received media data in the USB2.0 protocol format to a wireless network through the wireless module, and then the media data are transmitted to corresponding display nodes through the wireless network.

It can be understood that, when the wireless screen transmitter realizes data transmission through the second data pin, the transmission path of the media data is as follows: hardware interface (virtual as wired network card) of the wireless screen transmitter-processor of the wireless screen transmitter-wireless module of the wireless screen transmitter-display node (such as interactive panel).

In this embodiment of the application, after the processor 12 receives the data in the MIPI format, the data in the MIPI format needs to be compressed and encoded, in the encoding process, a target parameter needs to be obtained, the data in the MIPI format is compressed and encoded according to the target parameter, if the target parameter is not received, the processor 12 cannot perform the compression and encoding process, at this time, if the processor 12 does not receive the target parameter within a second preset time, a switching instruction may be sent to the computer, after receiving the switching instruction, the computer may automatically run a second application program, and perform screenshot process on the media data of the computer through the second application program to obtain screen capture data, the second application program may also encode the screen capture data to obtain media data in the USB2.0 protocol format, the computer may send the media data in the USB2.0 protocol format to the processor 12 of the screen transmitter 3 through a second data pin, the processor 12 of the screen transmitter 3 may send the media data in the USB2.0 protocol format to the wireless module 14, and may send other media data in the USB2.0 protocol, such as a video network interface shown in a wireless network.

In the wireless screen transmitter that this application embodiment provided, can be when the unable normal use of Type-C transmission mode automatic switch to Type-A transmission mode, get into normal operating condition fast, and need not user's manual switching to can improve prior art complex operation, the problem of wasted time.

Optionally, the first data conversion chip is connected to the processor through an ICC bus and an MIPI signal line, and the first data conversion chip sends a notification instruction to the processor through the ICC bus, where the notification instruction is used to notify the processor whether the first data conversion chip receives media data in the DP protocol format within a third preset time period.

It is understood that the first data conversion chip 51 is physically connected to the Processor 12 through an Integrated Circuit bus (IIC or I2C) for transmitting control data such as target parameters and a Mobile Industry Processor Interface (MIPI) signal line for transmitting video data such as MIPI format data. The first data conversion chip 51 may send a notification instruction to the processor 12 through the integrated circuit bus, where the notification instruction may notify the processor 12 whether the first data conversion chip 51 receives the media data in the DP protocol format within a third preset time period, and if there is no processor, the first data conversion chip is controlled to switch to obtain the media data in the USB2.0 protocol format from the computer terminal through two pairs of USB D +/D-pins.

the processor is configured to receive media data in a USB2.0 protocol format through the second data pin when the processor does not receive the data in the MIPI format within a first preset time, or does not obtain the target parameter within a second preset time, or determines that the first data conversion chip does not receive the media data in the DP protocol format within a third preset time.

The specific implementation manner of the above steps refers to the content described in the above application embodiments, and is not described herein again.

Referring to fig. 7 for details, an embodiment of the present application further provides a data transmission virtual device, which is applied to a wireless screen transmitter, where the wireless screen transmitter may be electrically connected to a terminal device;

the device comprises:

a start establishing unit 301, configured to start establishing a handshake between a DP protocol and a USB2.0 protocol and a terminal device when the Type-C interface is connected to the terminal device;

a media data determining unit 302, configured to determine whether media data in a DP protocol format is received within a preset time when the DP protocol handshake is successful, where the media data in the DP protocol format is generated by processing media data displayed on a current screen of the terminal device based on the DP protocol;

a first instruction sending unit 303, configured to send a switching instruction to the terminal device when the media data in the DP protocol format is not received, where the switching instruction is used to enable the terminal device to perform screen capture and encoding processing on currently displayed media data;

a media data receiving unit 304, configured to receive media data in a USB2.0 protocol format sent by the terminal device, where the media data in the USB2.0 protocol format is generated by processing the media data after the screen capture and encoding processing of the terminal device based on the USB2.0 protocol.

In one embodiment, the apparatus further comprises:

the target parameter judging unit is used for judging whether a target parameter is acquired within a preset time period when the media data in the DP protocol format is received, wherein the target parameter is obtained by identifying the media data in the DP protocol format;

and the second instruction sending unit is used for sending a switching instruction to the terminal equipment when the target parameter is not acquired, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data.

In one embodiment, the apparatus further comprises:

the format conversion unit is used for converting the received media data in the DP protocol format into MIPI format data when target parameters are received in the preset time period;

the encoding processing unit is used for encoding the MIPI format data to obtain an encoding result;

and the coding transmission unit is used for transmitting the coding result to display equipment so as to enable the display equipment to decode and display the media data corresponding to the coding result.

In a specific embodiment, the second instruction sending unit may specifically include:

the application installation subunit is used for judging whether the terminal equipment is provided with a second application program or not when the media data in the DP protocol format is not received;

the switching instruction sending subunit is configured to send a switching instruction to the terminal device to instruct the terminal device to run the second application program when the second application program is installed in the terminal device, and perform screen capture and encoding processing on currently displayed media data through the second application program;

and the popup command subunit is used for sending a popup command to the display equipment in matched connection with the wireless screen transmitter to indicate a user to install the second application program when the second application program is not installed in the terminal equipment.

The specific implementation of the above device refers to the content described in the above application embodiments, and is not described herein again.

In this application, can improve the work efficiency of wireless biography screen ware, save time. It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, embodiments of the present application provide a computer-readable storage medium, in which a plurality of instructions are stored, where the instructions can be loaded by a processor to execute the steps in any one of the data transmission methods provided in the embodiments of the present application. For example, the instructions may perform the steps of: detecting whether the Type-C interface is connected with the terminal equipment; if so, performing data transmission with the terminal equipment by adopting a Type-C transmission mode to acquire media data in a DP protocol format; judging whether media data in the DP protocol format is received within preset time; if not, performing data transmission with the terminal equipment by adopting a Type-A transmission mode to acquire the media data in the USB2.0 protocol format.

Determining whether the target parameter is acquired within a preset time period, where the storage medium may include: read Only Memory (ROM), random Access Memory (RAM), magnetic or optical disks, and the like.

According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations provided in the embodiments described above.

Since the instructions stored in the storage medium can execute the steps in any data transmission method provided in the embodiments of the present application, beneficial effects that can be achieved by any data transmission method provided in the embodiments of the present application can be achieved, for details, see the foregoing embodiments, and are not described herein again.

The data transmission method, the data transmission device, and the computer-readable storage medium provided by the embodiments of the present application are described in detail above, and specific examples are applied herein to illustrate the principles and implementations of the present application, and the descriptions of the above embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A data transmission method is characterized in that the method is applied to a wireless screen transmitter, wherein the wireless screen transmitter comprises a Type-C interface, and the wireless screen transmitter supports DP protocol and USB2.0 protocol communication;

the method comprises the following steps:

when the Type-C interface is connected with the terminal equipment, starting to establish handshaking between a DP protocol and a USB2.0 protocol and the terminal equipment;

when the handshake of the DP protocol is successful, judging whether media data in a DP protocol format are received within preset time, wherein the media data in the DP protocol format are generated by processing the media data displayed on the current screen of the terminal equipment based on the DP protocol;

if the media data in the DP protocol format are not received, sending a switching instruction to the terminal equipment, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data;

and receiving media data in a USB2.0 protocol format sent by the terminal equipment, wherein the media data in the USB2.0 protocol format is generated by processing the media data after the screen capture and encoding processing of the terminal equipment based on the USB2.0 protocol.

2. The data transmission method according to claim 1, wherein when the DP protocol handshake is successful, it is determined whether media data in a DP protocol format is received within a preset time, and the media data in the DP protocol format is generated by processing the media data currently displayed on the screen of the terminal device based on the DP protocol, and the method further includes:

if the media data in the DP protocol format is received, judging whether a target parameter is obtained within a preset time period, wherein the target parameter is obtained by identifying the media data in the DP protocol format;

and if the target parameter is not acquired, sending a switching instruction to the terminal equipment, wherein the switching instruction is used for enabling the terminal equipment to perform screen capture and coding processing on the currently displayed media data.

3. The method according to claim 2, wherein after determining whether a target parameter is obtained within a preset time period if the media data in the DP protocol format is received, and the target parameter is obtained by performing identification processing on the media data in the DP protocol format, the method further comprises:

if the target parameters are received in the preset time period, converting the received media data in the DP protocol format into MIPI format data;

coding the MIPI format data to obtain a coding result;

and transmitting the encoding result to a display device so that the display device decodes and displays the media data corresponding to the encoding result.

4. The method of claim 3, wherein if the media data in the DP protocol format is not received, sending a switching instruction to the terminal device, where the switching instruction is used to enable the terminal device to perform screen capture and encoding processing on currently displayed media data, and the method includes:

if the media data in the DP protocol format are not received, judging whether a second application program is installed on the terminal equipment or not;

if the terminal equipment is provided with the second application program, sending a switching instruction to the terminal equipment to indicate the terminal equipment to operate the second application program, and carrying out screen capture and coding processing on currently displayed media data through the second application program;

and if the second application program is not installed in the terminal equipment, sending a popup instruction to display equipment which is connected with the wireless screen transmitter in a matched mode so as to indicate a user to install the second application program.

5. The method of claim 4, wherein the second application is integrated with a screen transmission service for automatically running the second application when the wireless screen transmitter is connected with the terminal device.

6. The data transmission method is characterized by being applied to a wireless screen transmitter, wherein the wireless screen transmitter comprises a Type-C interface, a first data conversion chip and a processor, the Type-C interface is connected with the processor through the first data conversion chip, and the Type-C interface comprises a differential signal pin and a USB2.0 data pin;

the method comprises the following steps:

and when the processor does not receive the MIPI format data within first preset time, or does not obtain the target parameters within second preset time, or determines that the first data conversion chip does not receive the media data in the DP protocol format within third preset time, the processor is switched to receive the media data in the USB2.0 protocol format through the USB2.0 data pin.

7. The data transmission method according to claim 6, wherein the first data conversion chip is connected to the processor via an ICC bus and an MIPI signal line, respectively, and the first data conversion chip sends a notification instruction to the processor via the ICC bus, where the notification instruction is used to inform the processor whether the first data conversion chip receives the media data in the DP protocol format within a preset time period;

and the first data conversion chip sends the MIPI format data through the MIPI signal wire.

8. The data transmission method according to claim 6 or 7, wherein the wireless screen transmitter further comprises a memory, and the memory stores a second application program;

when the processor does not receive the MIPI format data within the preset time, or does not obtain the target parameter within the preset time, or determines that the first data conversion chip does not receive the media data in the DP protocol format within the preset time, the processor controls to switch to receive the media data in the USB2.0 protocol format through the USB2.0 data pin, including:

when the processor does not receive the MIPI format data within first preset time, or does not obtain the target parameter within second preset time, or determines that the first data conversion chip does not receive the media data in the DP protocol format within third preset time, the processor controls to obtain the second application program from the memory and sends the second application program to the terminal device through the USB2.0 data pin, so that the second application program is operated on the terminal device, and the second application program is used for carrying out screenshot and coding processing on the current media data of the terminal device to obtain the media data in the USB2.0 protocol format;

and the processor controls and switches to receive the media data in the USB2.0 protocol format sent by the terminal equipment through the USB2.0 data pin.

9. A data transmission device is characterized by comprising a Type-C interface, a first data conversion chip, a processor, a memory and a wireless module, wherein the Type-C interface comprises a first data pin and a second data pin, the first data pin is connected with the processor through the first data conversion chip, the second data pin is connected with the processor, and the processor is respectively connected with the memory and the wireless module;

10. A data transmission device comprising a processor and a memory, said memory storing a plurality of instructions; the processor loads instructions from the memory to perform the steps in the data transmission method according to any one of claims 1 to 9.