CN117221293A - Data transmission method, device, electronic equipment and storage medium - Google Patents

Abstract

This application relates to the field of data processing and provides a data transmission method, device, electronic equipment and storage medium. The method includes: receiving a transmission quality optimization instruction for the cloud desktop, based on the current network performance indicators of the terminal connected to the cloud desktop. and the current application scenario information of the cloud desktop to determine the target transmission quality optimization plan; the target transmission quality optimization plan includes at least one of a transmission channel adjustment plan, a response time window adjustment plan, and a frame rate adjustment plan; the transmission channel adjustment plan includes a USB channel At least one of adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment; perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization plan. This application can effectively reduce the transmission bandwidth when transmitting data between the terminal and the cloud desktop, thereby avoiding problems such as lagging and inability to respond in time, thereby improving the data transmission efficiency in the cloud desktop scenario.

Description

Data transmission methods, devices, electronic equipment and storage media

Technical field

This application relates to the field of data processing, specifically to a data transmission method, device, electronic equipment and storage medium.

Background technique

In the cloud desktop scenario, in addition to audio and video, network transmission channels also include other channels such as mouse pointer, keyboard and mouse control, Universal Serial Bus (USB) transmission, etc. In a weak network environment, in addition to controlling audio and video transmission, The code rate also needs to control the data transmission of other channels. In a weak network environment, traditional technical solutions reduce the final transmission bandwidth by dynamically adjusting the audio and video transmission bit rate, frame rate and other parameters. However, in some scenarios, just adjusting the audio and video transmission channel cannot effectively reduce the bandwidth. In order to solve the user experience problem, there may still be problems such as lag and inability to respond in time, so the current data transmission efficiency in the cloud desktop scenario is low.

Contents of the invention

Embodiments of the present application provide a data transmission method, device, electronic equipment and storage medium to solve the current problems of being unable to solve the problem of lagging and inability to respond in a timely manner through the adjustment of the audio and video transmission channel alone, resulting in the current situation in the cloud desktop scenario. The problem of low data transmission efficiency.

In a first aspect, embodiments of the present application provide a data transmission method, including:

Receive transmission quality optimization instructions for the cloud desktop, and determine the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop;

Determine a target transmission quality optimization plan according to the current network performance indicators and the current application scenario information; the target transmission quality optimization plan includes at least one of a transmission channel adjustment plan, a response time window adjustment plan, and a frame rate adjustment plan; The transmission channel adjustment solution includes at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

Under the target transmission quality optimization scheme, data transmission between the terminal and the cloud desktop is performed.

In one embodiment, determining a target transmission quality optimization solution based on the current network performance indicators and the current application scenario information includes:

Obtain the correlation between pre-established network performance indicators, application scenarios and transmission quality optimization solutions;

Based on the association relationship, a target transmission quality optimization solution associated with the current network performance index and the current application scenario information is determined from each transmission quality optimization solution.

In one embodiment, the application scenarios include at least document editing, web browsing, video playback, and game entertainment.

In one embodiment, the transmission quality optimization solution includes at least one of the following:

Close the USB channel, close the audio transmission channel, reduce the adjusted bit rate of the video transmission channel to the first preset bit rate, adjust the response time window to the first preset duration, and adjust the frame rate to the first preset frame rate;

The USB channel is closed, the audio transmission channel is closed, the bit rate adjusted by the video transmission channel is reduced to the second preset bit rate, the response time window is adjusted to the second preset duration, and the frame rate is adjusted to the second preset frame rate; where, The second preset code rate is less than the first preset code rate; the second preset duration is less than the first preset duration; the second preset frame rate is greater than the first preset frame rate ;

Close the USB channel, close the mouse pointer channel, reduce the adjusted bit rate of the video transmission channel to the third preset bit rate, adjust the response time window to the third preset duration, and adjust the frame rate to the first preset ratio of the current video frame rate ; Wherein, the third preset code rate is less than the second preset code rate; the third preset duration is less than the second preset duration;

The USB channel is closed, the bit rate adjusted by the video transmission channel is reduced to the fourth preset bit rate, the response time window is adjusted to the fourth preset duration, and the frame rate is adjusted to the second preset ratio of the current game frame rate; wherein, the The fourth preset code rate is less than the third preset code rate; the fourth preset duration is less than the third preset duration; and the second preset ratio is smaller than the first preset ratio.

In one embodiment, reducing the bit rate for video transmission channel adjustment is achieved by at least one of the following:

According to the type information of the running application, or according to the type information of the running application and the image information of the running application, determine the transmission mode of the image in the running application from the vector image transmission mode and the bitmap transmission mode;

According to the type information of the running application, or according to the type information and resolution information of the running application, determine the color coding mode of the image in the running application from YUV color coding and RGB color coding;

Obtain a video application whitelist, and perform video redirection on video streams of running applications located in the video application whitelist.

In one embodiment, after determining the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop, the method further includes:

If the packet loss rate in the current network performance index is greater than the preset packet loss rate threshold, the average round-trip delay is greater than the preset delay threshold, and the duration exceeds the preset time threshold, the connection with the terminal is disconnected.

In one embodiment, after determining the target transmission quality optimization solution according to the current network performance index and the current application scenario information, the method further includes:

Obtain the priority information of each transmission channel in the cloud desktop;

Within the target response time window, data transmission of each transmission channel is performed according to the priority information; the target response time window is a response time window adjusted according to the response time window adjustment scheme in the target transmission quality optimization scheme. .

In a second aspect, embodiments of the present application provide a data transmission device, including:

A receiving module, configured to receive the transmission quality optimization instruction of the cloud desktop, and determine the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop;

Determining module, configured to determine a target transmission quality optimization scheme according to the current network performance index and the current application scenario information; the target transmission quality optimization scheme includes a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme. At least one of; the transmission channel adjustment solution includes at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

A transmission module, configured to transmit data between the terminal and the cloud desktop under the target transmission quality optimization scheme.

In a third aspect, embodiments of the present application provide an electronic device, including a processor and a memory storing a computer program. When the processor executes the program, the data transmission method described in the first aspect is implemented.

In a fourth aspect, embodiments of the present application provide a storage medium. The storage medium is a computer-readable storage medium and includes a computer program. When the computer program is executed by a processor, the data transmission method described in the first aspect is implemented.

The data transmission method, device, electronic device and storage medium provided by the embodiments of this application, after receiving the transmission quality optimization instruction of the cloud desktop, use the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop. , determine a target transmission quality optimization plan including at least one of a transmission channel adjustment plan, a response time window adjustment plan, and a frame rate adjustment plan, and perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization plan. Through the transmission quality optimization scheme including USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment, as well as the response time window adjustment scheme, frame rate adjustment scheme and other schemes, the terminal and cloud can be effectively reduced The transmission bandwidth when transmitting data between desktops can avoid problems such as lags and inability to respond in time, thereby improving the efficiency of data transmission in cloud desktop scenarios.

Description of drawings

In order to explain the technical solutions in this application or the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are of the present invention. For some embodiments of the application, those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting creative efforts.

Figure 1 is a schematic flowchart of a data transmission method provided by an embodiment of the present application;

Figure 2 is a schematic diagram of the data transmission process between the cloud desktop and the terminal in the data transmission method provided by the embodiment of the present application;

Figure 3 is a functional module schematic diagram of an embodiment of the data transmission device of the present application;

Figure 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are part of this application. Examples, not all examples. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

The data transmission method, device, electronic device and storage medium provided by the present invention will be described in detail below with reference to the embodiments.

Figure 1 is a schematic flowchart of a data transmission method provided by an embodiment of the present application. Referring to Figure 1, an embodiment of the present application provides a data transmission method, which may include:

Step 100: Receive the transmission quality optimization instruction for the cloud desktop, and determine the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop;

It should be noted that the execution subject of the data transmission method provided by the embodiments of the present application may be a computer device, such as a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (Ultra-mobile personal computer) Personal Computer (UMPC), netbook or personal digital assistant (Personal Digital Assistant, PDA), etc.

The data transmission method of this application can be applied to a cloud desktop management platform, which is used to manage cloud desktops. The platform can be deployed in computer equipment.

Users can access the cloud desktop management platform through the terminal, and then establish a connection relationship with the cloud desktop, thereby controlling the cloud desktop.

In this application, the user can initiate a transmission quality optimization instruction in the cloud desktop management platform through the terminal for instructing to improve the data transmission quality of the cloud desktop.

The network performance indicators in this application may include the packet loss rate and the average round-trip delay, and the application scenario information may at least include document editing, web browsing, video playback, game entertainment, etc.

Among them, within the specified detection time window check_window, for example, t, perform PING heartbeat detection between the terminal and the cloud desktop, and obtain PING's packet loss rate lossP and PING's round-trip delay average delayP within t.

It should be noted that the data transmission process between the cloud desktop and the terminal can be carried out through the video transmission channel Display Channel used to push the desktop change video stream, the audio transmission channel AudioChannel used to transmit uplink and downlink audio data, and the mouse pointer transmission The mouse pointer channel Cursor Channel for displaying graphics data, the USB channel USB Channel for transmitting USB device data, the main channel MainChannel for connection establishment, management, control, etc., and the control event data for transmitting mouse, keyboard, touchpad, etc. Control Channel and other transmission channels such as Other Channel are implemented.

Step 200: Determine the target transmission quality optimization plan based on current network performance indicators and current application scenario information;

In this application, the correlation between network performance indicators, application scenarios and transmission quality optimization solutions can be established in advance.

Therefore, after obtaining the current network performance index and the current application scenario information, the transmission quality optimization solution corresponding to the current network performance index and the current application scenario information can be found as the target transmission quality optimization solution through the above correlation relationship.

It should be noted that the target transmission quality optimization scheme includes at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme. For example, in one embodiment, a transmission channel adjustment scheme, a response time window adjustment scheme, and a frame rate adjustment scheme may be included.

The transmission channel adjustment solution includes at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment. For example, in one embodiment, it may include USB channel adjustment, audio transmission channel adjustment, and video transmission channel adjustment. In another embodiment, it may include USB channel adjustment, mouse pointer channel adjustment, and video transmission channel adjustment.

Step 300: Perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme.

After obtaining the target transmission quality optimization plan, this application can execute the target transmission quality optimization plan, thereby optimizing the transmission quality of data between the cloud desktop and the terminal, and transmit the data to be transmitted in each transmission channel after optimization.

It should be noted that when transmitting the data to be transmitted in each transmission channel, the data can be processed directly according to the order in which the data arrives in each transmission channel, or according to the priority of each transmission channel.

The data transmission method provided by the embodiment of the present application, after receiving the transmission quality optimization instruction of the cloud desktop, determines the transmission channel adjustment plan through the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop. , a target transmission quality optimization scheme for at least one of the response time window adjustment scheme and the frame rate adjustment scheme, and perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme. Through the transmission quality optimization scheme including USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment, as well as the response time window adjustment scheme, frame rate adjustment scheme and other schemes, the terminal and cloud can be effectively reduced The transmission bandwidth when transmitting data between desktops can avoid problems such as lags and inability to respond in time, thereby improving the efficiency of data transmission in cloud desktop scenarios.

In one embodiment, after determining the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop, the method further includes:

Step a1: If the packet loss rate in the current network performance index is greater than the preset packet loss rate threshold, the average round-trip delay is greater than the preset delay threshold, and the duration exceeds the preset time threshold, disconnect the terminal.

Since network performance indicators can include the packet loss rate and the average round-trip delay, the current network performance indicators also include the packet loss rate and the average round-trip delay.

Therefore, the packet loss rate in the current network performance index can be compared with the preset packet loss rate threshold, and the average round-trip delay can be compared with the preset delay threshold. Among them, the preset packet loss rate threshold can be a ratio set according to actual needs, and the preset delay threshold can also be a time value set according to actual needs.

If it is determined that the packet loss rate in the current network performance indicators is greater than the preset packet loss rate threshold and the average round-trip delay is greater than the preset delay threshold, the duration of this situation is monitored.

If it is determined that the duration exceeds the preset time threshold, the connection with the terminal is disconnected, and the network performance indicators can be continuously monitored. When the network performance indicators do not meet the above conditions, the connection with the terminal is restored.

The preset time threshold may be a time value set according to actual needs, for example, it may be 1 minute, 2 minutes, etc.

In this embodiment, when the packet loss rate in the current network performance index is greater than the preset packet loss rate threshold, the average round-trip delay is greater than the preset delay threshold, and the duration exceeds the preset time threshold, the connection with the terminal is disconnected, thereby Avoiding lags and unresponsiveness caused by poor networks can improve user experience.

In one embodiment, the target transmission quality optimization solution is determined based on current network performance indicators and current application scenario information, including:

Step 201: Obtain the correlation between pre-established network performance indicators, application scenarios and transmission quality optimization solutions;

In this application, the correlation between network performance indicators, application scenarios and transmission quality optimization solutions can be established and stored in advance.

In one embodiment, the transmission quality optimization scheme may include transmission quality optimization scheme 1, transmission quality optimization scheme 2, transmission quality optimization scheme 3 and transmission quality optimization scheme 4. The correlation between network performance indicators, application scenarios and transmission quality optimization solutions can be as shown in Table 1 below:

Table 1

Application scenarios lossP delayP Transmission quality optimization solution Document editing 12% 100ms 1 Web browsing 10% 80ms 2 video playback 6% 50ms 3 game entertainment 2% 30ms 4

Therefore, the correlation between network performance indicators, application scenarios and transmission quality optimization solutions can be obtained from the storage information.

It should be noted that in the correlation between network performance indicators, application scenarios and transmission quality optimization solutions in this application, the network cable performance indicators can be set as an indicator range, that is, a packet loss rate range and a round-trip delay average range can be set.

Step 202: Based on the correlation relationship, determine the target transmission quality optimization scheme associated with the current network performance index and the current application scenario information from each transmission quality optimization scheme.

After obtaining the correlation between network performance indicators, application scenarios and transmission quality optimization solutions, this application can use the current network performance indicators and current application scenario information as index conditions, perform information query through the above correlation, and query the pre-built Among each transmission quality optimization plan, whether there is a transmission quality optimization plan associated with the current network performance indicators and current application scenario information, if so, determine it as the target transmission quality optimization plan.

This embodiment can determine the target transmission quality optimization scheme from the pre-constructed transmission quality optimization schemes based on the current network performance indicators and current application scenario information, so as to perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme. . Through the transmission quality optimization scheme including USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment, as well as the response time window adjustment scheme, frame rate adjustment scheme and other schemes, the terminal and cloud can be effectively reduced The transmission bandwidth when transmitting data between desktops can avoid problems such as lags and inability to respond in time, thereby improving the efficiency of data transmission in cloud desktop scenarios.

In one embodiment, the transmission quality optimization solution includes at least one of the following:

Close the USB channel, close the audio transmission channel, reduce the adjusted bit rate of the video transmission channel to the first preset bit rate, adjust the response time window to the first preset duration, and adjust the frame rate to the first preset frame rate;

It should be noted that the first preset code rate may be a code rate value set according to actual environmental requirements; the first preset duration may be a duration value set according to actual environmental requirements; the first preset frame rate may be a value set according to actual environment requirements. The frame rate value that needs to be set.

The above transmission quality optimization solution can be defined as the transmission quality optimization solution 1 of this application. In one embodiment of this application, the transmission quality optimization solution 1 can specifically be to close the USB channel, close the audio transmission channel, and adjust the code rate of the video transmission channel to reduce to 90% of the original bitrate, the response time window to 100ms, and the frame rate to 15fps.

Close the USB channel, close the audio transmission channel, reduce the adjusted bit rate of the video transmission channel to the second preset bit rate, adjust the response time window to the second preset duration, and adjust the frame rate to the second preset frame rate;

It should be noted that in this application, the second preset code rate is less than the first preset code rate; the second preset duration is less than the first preset duration; and the second preset frame rate is greater than the first preset frame rate.

The above transmission quality optimization scheme can be defined as the transmission quality optimization scheme 2 of the present application. In one embodiment of the present application, the transmission quality optimization scheme 2 can specifically be to close the USB channel, close the audio transmission channel, and adjust the code rate of the video transmission channel to reduce to 80% of the original bitrate, the response time window to 80ms, and the frame rate to 18fps.

Close the USB channel, close the mouse pointer channel, reduce the adjusted bit rate of the video transmission channel to the third preset bit rate, adjust the response time window to the third preset duration, and adjust the frame rate to the first preset ratio of the current video frame rate ;

It should be noted that the third preset code rate is less than the second preset code rate; the third preset duration is less than the second preset duration. The first preset ratio may be a ratio value set according to actual environmental requirements.

The above-mentioned transmission quality optimization scheme can be defined as the transmission quality optimization scheme 3 of the present application. In one embodiment of the present application, the transmission quality optimization scheme 3 can specifically include closing the USB channel, closing the mouse pointer channel, and adjusting the code rate of the video transmission channel to reduce to 50% of the original bit rate, the response time window is adjusted to 50ms, and the frame rate is adjusted to 80% of the current video frame rate. As a result, the transmission bandwidth is sharply reduced and the definition is reduced, but the picture can be played normally.

The USB channel is closed, the bit rate adjusted by the video transmission channel is reduced to the fourth preset bit rate, the response time window is adjusted to the fourth preset duration, and the frame rate is adjusted to the second preset ratio of the current game frame rate.

It should be noted that the fourth preset code rate is less than the third preset code rate; the fourth preset duration is less than the third preset duration; and the second preset ratio is less than the first preset ratio.

The above-mentioned transmission quality optimization scheme can be defined as the transmission quality optimization scheme 4 of the present application. In one embodiment of the present application, the transmission quality optimization scheme 4 can specifically close the USB channel and reduce the bit rate adjusted by the video transmission channel to the original bit rate. 30%, the response time window is adjusted to 30ms and the frame rate is adjusted to 60% of the current game frame rate. As a result, the transmission bandwidth is sharply reduced, and the cloud desktop can continue to be used.

This embodiment combines all transmission channels of the cloud desktop to close low-priority channels in different scenarios to save transmission bandwidth by disabling non-critical functions; reduce the bit rate and save transmission bandwidth by reducing the bit rate of video streaming media ; Frame rate reduction, by reducing the number of input frames to the encoder call, reducing the raw data. This improves data transmission efficiency in cloud desktop scenarios.

Further, reducing the bit rate of video transmission channel adjustment is achieved by at least one of the following:

According to the type information of the running application, or based on the type information of the running application and the image information of the running application, determine the transmission mode of the image in the running application from the vector image transmission mode and the bitmap transmission mode;

In this application, cloud screen capture can use vector image and bitmap adaptive transmission technology to reduce bandwidth usage from the source. In scenes with many solid colors, such as Computer-Aided Design (CAD) drawing, vector image transmission can be used to reduce the amount of image transmission information, so the type information of the currently running application is obtained during the image capture process.

It should be noted that in this application, a white list can be set based on applications with more solid colors. After obtaining the type information of the currently running application to determine whether it is on the white list, if it exists, the vector image transmission mode is used as the transmission mode of the image in the running application. . If it does not exist, the image information such as color area classification and area of the image in the running application is obtained, and based on the image information, the appropriate image transmission mode is selected from the vector image transmission mode and the bitmap transmission mode as the transmission mode of the image in the running application.

For example: if it is detected that the running application is CAD drawing software, it will switch to vector image transmission mode.

If the running application is non-professional software, after multi-frame capture, the image content will be recognized by region. If the color classification is single or full-range solid color, vector image transmission mode will be used, otherwise it will revert to bitmap transmission mode.

Determine the color coding mode of the image in the running application from YUV color coding and RGB color coding according to the type information of the running application, or based on the type information and resolution information of the running application;

Among them, YUV is a color coding model based on brightness (Y) and chroma (U, V), also known as brightness-color coding. Y represents the brightness information of the image, while U and V represent the chrominance information of the image. RGB is a color coding model based on the three primary colors of red (R), green (G), and blue (B). The RGB model represents colors as generated by adjusting the brightness and saturation of three components: red, green, and blue.

In this application, the cloud screen capture uses YUV and RGB color coding adaptive technology. In one embodiment, the color encoding format can be fixedly set to YUV in the cloud, which basically meets all scenarios. Compared with RGB color encoding, YUV color encoding can reduce the amount of transmitted data by 50%.

Under RGB color coding, you can continue to subdivide the color depth parameter setting scenes, 8-bit, 16-bit, 32-bit, etc., to meet the different requirements for image fineness in different scenes;

Therefore, the color coding format can be switched in time according to the type information of the running application in the current window, or according to the type information and resolution information of the running application.

For example, if a video application is playing a video with a resolution of 720P and below, YUV color coding is used as the color coding mode of the image in the application; a video application is playing a 3D and other high-definition video with a resolution of 1080P or below, and RGB color coding is used as the application. The color coding mode of images in the application; when editing word and other text editing scenarios, that is, the running application is a document editing application, and YUV color coding is used as the color coding mode of images in the application; when browsing the web, surfing the Internet, etc., that is, the running application is a browser and other applications , YUV color coding is used as the color coding mode of the images in the application; running applications such as gaming and entertainment are game applications, and RGB color coding is used as the color coding mode of the images in the application, etc.

Get the video application whitelist and perform video redirection on the video stream of the running application in the video application whitelist.

In this application, the principle of whitelist adaptation can be adopted, that is, setting a video application whitelist. For commonly used DirectShow players (such as Baofengyingyin, QQ), by intercepting the video stream in the cloud GuestOS, when the user clicks on the video file, it will be directly Transmit the video stream data (not decoded) to the client, and the client plays it directly through the player. This process saves the time loss of decoding and playing in the cloud. In fact, the video file is not decoded and played in the cloud, and is in a black screen state. Before decoding, The data is directly transmitted to the client, and the client integrates and adapts to commonly used players to solve the transmission bandwidth delay optimization problem of most local video playback.

The principle of whitelisting videos is to target the scene where the player plays the video. The Windows platform basically has a DirectShow-like player architecture. When the user clicks on a video file to open, the player will load the file video stream, which has been intercepted and replayed before decoding. The orientation went out, but the file was not decoded locally in Windows in the cloud.

It should be noted that in this application, reducing the bit rate of video transmission channel adjustment can also be achieved by fixing the frame rate.

Since the human eye cannot detect obvious lag above 18fps, a fixed frame rate of 18fps can be set. In some ultra-low latency-sensitive scenes, a fixed frame rate of 60fps can be set and the logic of frame rate calculation can be canceled to reduce resources. consumption.

It should be noted that if a fixed frame rate is used to reduce the bit rate of video transmission channel adjustment, the frame rate adjustment plan will no longer be implemented in the target transmission quality optimization plan, otherwise conflicts will occur.

This embodiment can set corresponding transmission quality optimization solutions in advance for different application scenarios and network performance indicators. Therefore, the transmission channel can be determined through the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop. A target transmission quality optimization plan for at least one of the adjustment plan, the response time window adjustment plan, and the frame rate adjustment plan, and perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization plan. Through the transmission quality optimization scheme including USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment, as well as the response time window adjustment scheme, frame rate adjustment scheme and other schemes, the terminal and cloud can be effectively reduced The transmission bandwidth when transmitting data between desktops can avoid problems such as lags and inability to respond in time, thereby improving the efficiency of data transmission in cloud desktop scenarios.

In one embodiment, after determining the target transmission quality optimization solution based on current network performance indicators and current application scenario information, the method further includes:

Step 400: Obtain the priority information of each transmission channel in the cloud desktop;

In this application, the priority of each channel can be defined in advance based on the amount of transmitted data bytes, delay impact, and user experience impact. The specific priority can be as follows:

1. Main Channel; 2. Control Channel; 3. Cursor Channel; 4. Display Channel; 5. Audio Channel; 6. USB Channel.

That is, Main Channel has the highest priority and USB Channel has the lowest priority. It should be noted that if there are other channels, the priority can be set and adjusted according to actual needs.

Therefore, in this application, the priority information of each transmission channel in the cloud desktop can be obtained.

Step 500: Within the target response time window, perform data transmission on each transmission channel according to the priority information.

After obtaining the priority information of each transmission channel in the cloud desktop, this application can determine the response time window adjusted according to the response time window adjustment plan in the target transmission quality optimization plan, and within the response time window, according to the priority information Perform data transmission on each transmission channel. For example: the video transmission channel and the audio transmission channel have data to be transmitted at the same time, and the video transmission channel has a higher priority than the audio transmission channel, so the data to be transmitted in the video transmission channel is transmitted first.

In one embodiment, the present application can determine whether to enable the code rate adaptive mode. If enabled, perform data transmission on each transmission channel according to the priority information within the target response time window. Otherwise, data transmission is performed in the order in which the data of each transmission channel arrives.

This embodiment can avoid that due to network congestion, the previous channel data has not been processed, the latter channel data cannot respond, and the lag is obvious. The time window is set to be processed according to priority, and user operations can be responded to in a timely manner to ensure overall availability. Window sliding calculation improves data transmission efficiency in cloud desktop scenarios.

Figure 2 is a schematic diagram of the data transmission process between the cloud desktop and the terminal in the data transmission method provided by the embodiment of the present application. Referring to Figure 2, in one embodiment, the client can collect instructions and upload the instructions to the cloud desktop through the network. The cloud desktop can parse the instructions, perform cloud computing based on the parsed content, and perform screen rendering based on the calculation results. . Further, the rendered picture is screen captured and encoded, and audio and video streams, control streams and USB data are transmitted over the network. The client receives the encoded data, decodes it, and displays the decoded data. In addition, the client can also obtain data through USB recognition and transmit the data to the cloud desktop through the network, and the cloud desktop performs corresponding USB operations.

Furthermore, this application also provides a data transmission device.

Referring to Figure 3, Figure 3 is a functional module schematic diagram of an embodiment of the data transmission device of the present application.

The data transmission device includes:

The receiving module 310 is configured to receive the transmission quality optimization instruction of the cloud desktop, and determine the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop;

Determination module 320, configured to determine a target transmission quality optimization solution according to the current network performance index and the current application scenario information; the target transmission quality optimization solution includes a transmission channel adjustment solution, a response time window adjustment solution, and a frame rate adjustment solution. At least one of; the transmission channel adjustment solution includes at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

The transmission module 330 is configured to transmit data between the terminal and the cloud desktop under the target transmission quality optimization scheme.

The data transmission device provided by the embodiment of the present application, after receiving the transmission quality optimization instruction of the cloud desktop, determines the transmission channel adjustment plan through the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop. , a target transmission quality optimization scheme for at least one of the response time window adjustment scheme and the frame rate adjustment scheme, and perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme. Through the transmission quality optimization scheme including USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment, as well as the response time window adjustment scheme, frame rate adjustment scheme and other schemes, the terminal and cloud can be effectively reduced The transmission bandwidth when transmitting data between desktops can avoid problems such as lags and inability to respond in time, thereby improving the efficiency of data transmission in cloud desktop scenarios.

In one embodiment, the receiving module 310 is also used to:

If the packet loss rate in the current network performance index is greater than the preset packet loss rate threshold, the average round-trip delay is greater than the preset delay threshold, and the duration exceeds the preset time threshold, the connection with the terminal is disconnected.

In one embodiment, the determining module 320 is specifically used to:

Obtain the correlation between pre-established network performance indicators, application scenarios and transmission quality optimization solutions;

Based on the association relationship, a target transmission quality optimization solution associated with the current network performance index and the current application scenario information is determined from each transmission quality optimization solution.

In one embodiment, the transmission module 330 is also used to:

Obtain the priority information of each transmission channel in the cloud desktop;

Within the target response time window, data transmission of each transmission channel is performed according to the priority information; the target response time window is a response time window adjusted according to the response time window adjustment scheme in the target transmission quality optimization scheme. .

Figure 4 illustrates a schematic diagram of the physical structure of an electronic device. As shown in Figure 4, the electronic device may include: a processor (processor) 410, a communication interface (Communication Interface) 420, a memory (memory) 430 and a communication bus 440. Among them, the processor 410, the communication interface 420, and the memory 430 complete communication with each other through the communication bus 440. The processor 410 can call the computer program in the memory 430 to perform the steps of the data transmission method, for example, including:

Receive transmission quality optimization instructions for the cloud desktop, and determine the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop;

Determine a target transmission quality optimization plan according to the current network performance indicators and the current application scenario information; the target transmission quality optimization plan includes at least one of a transmission channel adjustment plan, a response time window adjustment plan, and a frame rate adjustment plan; The transmission channel adjustment solution includes at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

Under the target transmission quality optimization scheme, data transmission between the terminal and the cloud desktop is performed.

In addition, the above-mentioned logical instructions in the memory 430 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code. .

On the other hand, embodiments of the present application also provide a storage medium. The storage medium is a computer-readable storage medium. The computer-readable storage medium stores a computer program. The computer program is used to cause the processor to execute the above steps. The steps of the method provided by the embodiment include, for example:

Receive transmission quality optimization instructions for the cloud desktop, and determine the current network performance indicators of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop;

Determine a target transmission quality optimization plan according to the current network performance indicators and the current application scenario information; the target transmission quality optimization plan includes at least one of a transmission channel adjustment plan, a response time window adjustment plan, and a frame rate adjustment plan; The transmission channel adjustment solution includes at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

Under the target transmission quality optimization scheme, data transmission between the terminal and the cloud desktop is performed.

The computer-readable storage medium may be any available medium or data storage device that can be accessed by the processor, including but not limited to magnetic storage (such as floppy disks, hard disks, tapes, magneto-optical disks (MO), etc.), optical storage (such as CDs) , DVD, BD, HVD, etc.), and semiconductor memories (such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid state drive (SSD)), etc.

The device embodiments described above are only illustrative. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in One location, or it can be distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.

Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the part of the above technical solution that essentially contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., including a number of instructions to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application, but not to limit it; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent substitutions are made to some of the technical features; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions in the embodiments of the present application.

Claims (10)

1. A data transmission method, comprising:

receiving a transmission quality optimization instruction aiming at a cloud desktop, and determining a current network performance index of a terminal connected with the cloud desktop and current application scene information of the cloud desktop;

determining a target transmission quality optimization scheme according to the current network performance index and the current application scene information; the target transmission quality optimization scheme comprises at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme; the transmission channel adjustment scheme comprises at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

And under the target transmission quality optimization scheme, data transmission between the terminal and the cloud desktop is performed.

2. The method according to claim 1, wherein the determining a target transmission quality optimization scheme according to the current network performance index and the current application scenario information includes:

acquiring a pre-established association relationship among a network performance index, an application scene and a transmission quality optimization scheme;

and determining a target transmission quality optimization scheme associated with the current network performance index and the current application scene information from all transmission quality optimization schemes based on the association relation.

3. The data transmission method according to claim 2, wherein the application scene includes at least document editing, web browsing, video playing, and game entertainment.

4. The data transmission method according to claim 1, wherein the transmission quality optimization scheme includes at least one of:

closing the USB channel, closing the audio transmission channel, reducing the code rate adjusted by the video transmission channel to a first preset code rate, adjusting the response time window to a first preset duration, and adjusting the frame rate to a first preset frame rate;

Closing the USB channel, closing the audio transmission channel, reducing the code rate adjusted by the video transmission channel to a second preset code rate, adjusting the response time window to a second preset duration and adjusting the frame rate to a second preset frame rate; wherein the second preset code rate is smaller than the first preset code rate; the second preset time period is smaller than the first preset time period; the second preset frame rate is greater than the first preset frame rate;

closing the USB channel, closing the mouse pointer channel, reducing the code rate adjusted by the video transmission channel to a third preset code rate, adjusting the response time window to a third preset duration, and adjusting the frame rate to a first preset proportion of the current video frame rate; wherein the third preset code rate is smaller than the second preset code rate; the third preset time period is smaller than the second preset time period;

closing the USB channel, reducing the code rate adjusted by the video transmission channel to a fourth preset code rate, adjusting the response time window to a fourth preset duration, and adjusting the frame rate to a second preset proportion of the current game frame rate; wherein the fourth preset code rate is smaller than the third preset code rate; the fourth preset time period is smaller than the third preset time period; the second preset proportion is smaller than the first preset proportion.

5. The method of claim 4, wherein reducing the rate of video transmission channel adjustments is accomplished by at least one of:

determining a transmission mode of an image in the running application from a vector diagram transmission mode and a bitmap transmission mode according to the type information of the running application or according to the type information of the running application and the image information of the running application;

determining a color coding mode of an image in the running application from YUV color coding and RGB color coding according to the type information of the running application or according to the type information and resolution information of the running application;

and acquiring a video application white list, and redirecting the video stream of the running application in the video application white list.

6. The data transmission method according to claim 1, further comprising, after determining a current network performance index of a terminal connected to the cloud desktop and current application scenario information of the cloud desktop:

and if the packet loss rate in the current network performance index is larger than a preset packet loss rate threshold, the round trip delay average value is larger than a preset delay threshold and the duration exceeds a preset time threshold, disconnecting the connection with the terminal.

7. The data transmission method according to claim 1, further comprising, after determining a target transmission quality optimization scheme according to the current network performance index and the current application scenario information:

acquiring priority information of each transmission channel in the cloud desktop;

in the target response time window, carrying out data transmission of each transmission channel according to the priority information; the target response time window is a response time window adjusted according to a response time window adjusting scheme in the target transmission quality optimizing scheme.

8. A data transmission apparatus, comprising:

the receiving module is used for receiving a transmission quality optimization instruction of a cloud desktop, and determining a current network performance index of a terminal connected with the cloud desktop and current application scene information of the cloud desktop;

the determining module is used for determining a target transmission quality optimization scheme according to the current network performance index and the current application scene information; the target transmission quality optimization scheme comprises at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme; the transmission channel adjustment scheme comprises at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

And the transmission module is used for carrying out data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme.

9. An electronic device comprising a processor and a memory storing a computer program, characterized in that the processor implements the data transmission method of any one of claims 1 to 7 when executing the computer program.

10. A storage medium, which is a computer-readable storage medium comprising a computer program, characterized in that the computer program, when executed by a processor, implements the data transmission method of any one of claims 1 to 7.