CN117221293A

CN117221293A - Data transmission method, device, electronic equipment and storage medium

Info

Publication number: CN117221293A
Application number: CN202311065954.6A
Authority: CN
Inventors: 池伟; 潘宏波; 许鑫伶
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Hangzhou Information Technology Co Ltd
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Hangzhou Information Technology Co Ltd
Priority date: 2023-08-23
Filing date: 2023-08-23
Publication date: 2023-12-12

Abstract

The application relates to the field of data processing, and provides a data transmission method, a device, electronic equipment and a storage medium, wherein the method comprises the following steps: receiving a transmission quality optimization instruction aiming at a cloud desktop, and determining a target transmission quality optimization scheme according to a current network performance index of a terminal connected with the cloud desktop and current application scene information of the cloud desktop; the target transmission quality optimization scheme comprises at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme; the transmission channel adjustment scheme comprises at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment; and under the target transmission quality optimization scheme, data transmission between the terminal and the cloud desktop is performed. The method and the device can effectively reduce the transmission bandwidth when data transmission is carried out between the terminal and the cloud desktop, thereby avoiding the problems of jamming, incapability of timely responding and the like, and further improving the data transmission efficiency in the cloud desktop scene.

Description

Data transmission method, device, electronic equipment and storage medium

Technical Field

The present application relates to the field of data processing, and in particular, to a data transmission method, apparatus, electronic device, and storage medium.

Background

In a cloud desktop scene, the network transmission channel is provided with other channels such as audio and video, mouse pointer, keyboard and mouse control, universal serial bus (Universal Serial Bus, USB) transmission and the like, and in a weak network environment, the network transmission channel is provided with data transmission of other channels besides the control of audio and video transmission code rate. In the traditional technical scheme, the final transmission bandwidth is reduced by dynamically adjusting parameters such as the transmission code rate and the frame rate of the audio and video under the weak network environment, but in certain scenes, the bandwidth can not be effectively reduced by adjusting the audio and video transmission channel so as to solve the problem of user experience, and the problems of blocking, incapability of timely response and the like still exist, so that the data transmission efficiency in the cloud desktop scene is low currently.

Disclosure of Invention

The embodiment of the application provides a data transmission method, a device, electronic equipment and a storage medium, which are used for solving the problems that the current data transmission efficiency is low in a cloud desktop scene because the problems of blocking, incapability of timely responding and the like are solved only through adjustment of an audio and video transmission channel.

In a first aspect, an embodiment of the present application provides a data transmission method, including:

Receiving a transmission quality optimization instruction aiming at a cloud desktop, and determining a current network performance index of a terminal connected with the cloud desktop and current application scene information of the cloud desktop;

determining a target transmission quality optimization scheme according to the current network performance index and the current application scene information; the target transmission quality optimization scheme comprises at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme; the transmission channel adjustment scheme comprises at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

and under the target transmission quality optimization scheme, data transmission between the terminal and the cloud desktop is performed.

In one embodiment, the determining the target transmission quality optimization scheme according to the current network performance index and the current application scenario information includes:

acquiring a pre-established association relationship among a network performance index, an application scene and a transmission quality optimization scheme;

and determining a target transmission quality optimization scheme associated with the current network performance index and the current application scene information from all transmission quality optimization schemes based on the association relation.

In one embodiment, the application scene at least comprises document editing, web browsing, video playing and game entertainment.

In one embodiment, the transmission quality optimization scheme includes at least one of:

closing the USB channel, closing the audio transmission channel, reducing the code rate adjusted by the video transmission channel to a first preset code rate, adjusting the response time window to a first preset duration, and adjusting the frame rate to a first preset frame rate;

closing the USB channel, closing the audio transmission channel, reducing the code rate adjusted by the video transmission channel to a second preset code rate, adjusting the response time window to a second preset duration and adjusting the frame rate to a second preset frame rate; wherein the second preset code rate is smaller than the first preset code rate; the second preset time period is smaller than the first preset time period; the second preset frame rate is greater than the first preset frame rate;

closing the USB channel, closing the mouse pointer channel, reducing the code rate adjusted by the video transmission channel to a third preset code rate, adjusting the response time window to a third preset duration, and adjusting the frame rate to a first preset proportion of the current video frame rate; wherein the third preset code rate is smaller than the second preset code rate; the third preset time period is smaller than the second preset time period;

Closing the USB channel, reducing the code rate adjusted by the video transmission channel to a fourth preset code rate, adjusting the response time window to a fourth preset duration, and adjusting the frame rate to a second preset proportion of the current game frame rate; wherein the fourth preset code rate is smaller than the third preset code rate; the fourth preset time period is smaller than the third preset time period; the second preset proportion is smaller than the first preset proportion.

In one embodiment, reducing the rate of video transmission channel adjustments is accomplished by at least one of:

determining a transmission mode of an image in the running application from a vector diagram transmission mode and a bitmap transmission mode according to the type information of the running application or according to the type information of the running application and the image information of the running application;

determining a color coding mode of an image in the running application from YUV color coding and RGB color coding according to the type information of the running application or according to the type information and resolution information of the running application;

and acquiring a video application white list, and redirecting the video stream of the running application in the video application white list.

In one embodiment, after determining the current network performance index of the terminal connected to the cloud desktop and the current application scenario information of the cloud desktop, the method further includes:

And if the packet loss rate in the current network performance index is larger than a preset packet loss rate threshold, the round trip delay average value is larger than a preset delay threshold and the duration exceeds a preset time threshold, disconnecting the connection with the terminal.

In one embodiment, after determining a target transmission quality optimization scheme according to the current network performance index and the current application scenario information, the method further includes:

acquiring priority information of each transmission channel in the cloud desktop;

in the target response time window, carrying out data transmission of each transmission channel according to the priority information; the target response time window is a response time window adjusted according to a response time window adjusting scheme in the target transmission quality optimizing scheme.

In a second aspect, an embodiment of the present application provides a data transmission apparatus, including:

the receiving module is used for receiving a transmission quality optimization instruction of a cloud desktop, and determining a current network performance index of a terminal connected with the cloud desktop and current application scene information of the cloud desktop;

the determining module is used for determining a target transmission quality optimization scheme according to the current network performance index and the current application scene information; the target transmission quality optimization scheme comprises at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme; the transmission channel adjustment scheme comprises at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

And the transmission module is used for carrying out data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme.

In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory storing a computer program, where the processor implements the data transmission method according to the first aspect when executing the program.

In a fourth aspect, an embodiment of the present application provides a storage medium, where the storage medium is a computer readable storage medium, including a computer program, where the computer program is executed by a processor to implement the data transmission method according to the first aspect.

According to the data transmission method, the device, the electronic equipment and the storage medium, after the transmission quality optimization instruction of the cloud desktop is received, a target transmission quality optimization scheme comprising at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme is determined through the current network performance index of the terminal connected with the cloud desktop and the current application scene information of the cloud desktop, and data transmission between the terminal and the cloud desktop is performed under the target transmission quality optimization scheme. The transmission bandwidth during data transmission between the terminal and the cloud desktop can be effectively reduced through the transmission quality optimization schemes including the USB channel adjustment, the audio transmission channel adjustment, the video transmission channel adjustment, the mouse pointer channel adjustment, the response time window adjustment, the frame rate adjustment and other schemes, so that the problems of blocking, incapability of timely responding and the like are avoided, and the data transmission efficiency under the cloud desktop scene is further improved.

Drawings

In order to more clearly illustrate the application or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the application, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic flow chart of a data transmission method according to an embodiment of the present application;

fig. 2 is a schematic diagram of a data transmission flow of a cloud desktop and a terminal in the data transmission method provided by the embodiment of the application;

FIG. 3 is a schematic diagram of functional modules of an embodiment of the data transmission device of the present application;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The data transmission method, the device, the electronic equipment and the storage medium provided by the application are described in detail below with reference to the embodiments.

Fig. 1 is a flow chart of a data transmission method according to an embodiment of the present application. Referring to fig. 1, an embodiment of the present application provides a data transmission method, which may include:

step 100, receiving a transmission quality optimization instruction for a cloud desktop, and determining a current network performance index of a terminal connected with the cloud desktop and current application scene information of the cloud desktop;

it should be noted that, the execution main body of the data transmission method provided in the embodiment of the present application may be a computer device, for example, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, an Ultra-mobile Personal Computer (UMPC), a netbook, a personal digital assistant (Personal Digital Assistant, PDA), or the like.

The data transmission method can be applied to a cloud desktop management platform, and the platform is used for managing the cloud desktop. The platform may be deployed in a computer device.

The user can access the cloud desktop management platform through the terminal, and then, a connection relationship can be established with the cloud desktop, so that the cloud desktop can be controlled.

According to the method and the device, a user can initiate a transmission quality optimization instruction for indicating to improve the data transmission quality of the cloud desktop in the cloud desktop management platform through the terminal.

The network performance index in the application can comprise the average value of the packet loss rate and the round trip delay, and the application scene information can at least comprise document editing, web browsing, video playing, game entertainment and the like.

And performing PING heartbeat detection between the terminal and the cloud desktop in a specified detection time window check_window, for example, t, to obtain a packet loss rate lossP of PING and a round trip delay average value delay P of PING in t time.

It should be noted that, the process of data transmission between the cloud desktop and the terminal may be implemented through a video transmission Channel Display Channel for pushing a desktop to change a video stream, an Audio transmission Channel for transmitting uplink and downlink Audio data, a mouse pointer Channel for transmitting mouse pointer Display graphic data, a USB Channel for transmitting USB device data, a Main Channel for connection establishment, management, control, etc., a Control flow Channel for transmitting Control event data of a mouse, a keyboard, a touch pad, etc., and Other transmission channels Other than the Channel Other channels.

Step 200, determining a target transmission quality optimization scheme according to the current network performance index and the current application scene information;

the application can pre-establish the association relation among the network performance index, the application scene and the transmission quality optimization scheme.

Therefore, after the current network performance index and the current application scene information are obtained, the transmission quality optimization scheme corresponding to the current network performance index and the current application scene information can be searched out through the association relation to serve as a target transmission quality optimization scheme.

It should be noted that the target transmission quality optimization scheme includes at least one of a transmission channel adjustment scheme, a response time window adjustment scheme, and a frame rate adjustment scheme. For example, in one embodiment, a transmission channel adjustment scheme, a response time window adjustment scheme, and a frame rate adjustment scheme may be included.

The transmission channel adjustment scheme includes at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment, and mouse pointer channel adjustment. For example, in one embodiment, USB channel adjustments, audio transmission channel adjustments, and video transmission channel adjustments may be included, and in another embodiment, USB channel adjustments, mouse pointer channel adjustments, and video transmission channel adjustments may be included.

And 300, carrying out data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme.

After the target transmission quality optimization scheme is obtained, the method and the device can execute the target transmission quality optimization scheme, so that the transmission quality of data between the cloud desktop and the terminal is optimized, and the data to be transmitted of each transmission channel are transmitted after the optimization.

When the data to be transmitted of each transmission channel is transmitted, the data can be processed directly according to the arrival sequence of the data of each transmission channel, or can be processed according to the priority of each transmission channel.

According to the data transmission method provided by the embodiment of the application, after a transmission quality optimization instruction of a cloud desktop is received, a target transmission quality optimization scheme comprising at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme is determined through the current network performance index of a terminal connected with the cloud desktop and the current application scene information of the cloud desktop, and data transmission between the terminal and the cloud desktop is performed under the target transmission quality optimization scheme. The transmission bandwidth during data transmission between the terminal and the cloud desktop can be effectively reduced through the transmission quality optimization schemes including the USB channel adjustment, the audio transmission channel adjustment, the video transmission channel adjustment, the mouse pointer channel adjustment, the response time window adjustment, the frame rate adjustment and other schemes, so that the problems of blocking, incapability of timely responding and the like are avoided, and the data transmission efficiency under the cloud desktop scene is further improved.

and a step a1, if the packet loss rate in the current network performance index is greater than a preset packet loss rate threshold, the round trip delay average value is greater than a preset delay threshold and the duration exceeds a preset time threshold, disconnecting the connection with the terminal.

Since the network performance index may include a packet loss rate and a round trip delay average, the current network performance index also includes a packet loss rate and a round trip delay average.

Therefore, the packet loss rate in the current network performance index can be compared with a preset packet loss rate threshold, and the round trip delay average value can be compared with a preset delay threshold. The preset packet loss rate threshold may be a ratio set according to actual requirements, and the preset delay threshold may also be a time value set according to actual requirements.

If the packet loss rate in the current network performance index is determined to be greater than the preset packet loss rate threshold value and the round trip delay average value is determined to be greater than the preset delay threshold value, the duration of the condition is monitored.

If the duration exceeds the preset time threshold, the connection with the terminal is disconnected, the network performance index can be continuously monitored, and when the network performance index does not meet the conditions, the connection with the terminal is restored.

The preset time threshold may be a time value set according to actual requirements, for example, may be 1 minute, 2 minutes, or the like.

In the embodiment, when the packet loss rate in the current network performance index is greater than the preset packet loss rate threshold, the round trip delay average value is greater than the preset delay threshold and the duration exceeds the preset time threshold, the connection with the terminal is disconnected, so that the problems of blocking and no response caused by poor network are avoided, and the user experience can be improved.

In one embodiment, determining a target transmission quality optimization scheme according to the current network performance index and the current application scenario information includes:

step 201, obtaining a pre-established association relationship among a network performance index, an application scene and a transmission quality optimization scheme;

the application can pre-establish and store the association relation among the network performance index, the application scene and the transmission quality optimization scheme.

In one embodiment, the transmission quality optimization scheme may include transmission quality optimization scheme 1, transmission quality optimization scheme 2, transmission quality optimization scheme 3, and transmission quality optimization scheme 4. The association relationship among the network performance index, the application scene and the transmission quality optimization scheme can be as shown in the following table 1:

TABLE 1

Application scenario	lossP	delayP	Transmission quality optimization scheme
				Document editing	12％	100ms	1
Web browsing	10％	80ms	2
				Video playing	6％	50ms	3
Game recreation	2％	30ms	4

Therefore, the association relationship among the network performance index, the application scene and the transmission quality optimization scheme can be obtained from the stored information.

In the association relationship between the network performance index, the application scene and the transmission quality optimization scheme, the network performance index can be set as an index range, namely, a packet loss rate range and a round trip delay average value range can be set.

Step 202, determining a target transmission quality optimization scheme associated with the current network performance index and the current application scene information from all transmission quality optimization schemes based on the association relation.

After the association relation among the network performance index, the application scene and the transmission quality optimization scheme is obtained, the present application can take the current network performance index and the current application scene information as index conditions, query information through the association relation, query whether one transmission quality optimization scheme associated with the current network performance index and the current application scene information exists in each pre-constructed transmission quality optimization scheme, and determine the transmission quality optimization scheme as the target transmission quality optimization scheme if the transmission quality optimization scheme exists.

According to the embodiment, a target transmission quality optimization scheme can be determined from all transmission quality optimization schemes constructed in advance according to the current network performance index and the current application scene information, so that data transmission between the terminal and the cloud desktop is performed under the target transmission quality optimization scheme. The transmission bandwidth during data transmission between the terminal and the cloud desktop can be effectively reduced through the transmission quality optimization schemes including the USB channel adjustment, the audio transmission channel adjustment, the video transmission channel adjustment, the mouse pointer channel adjustment, the response time window adjustment, the frame rate adjustment and other schemes, so that the problems of blocking, incapability of timely responding and the like are avoided, and the data transmission efficiency under the cloud desktop scene is further improved.

it should be noted that, the first preset code rate may be a code rate value set according to an actual environment requirement; the first preset duration may be a duration value set according to actual environmental requirements; the first preset frame rate may be a frame rate value set according to actual environmental requirements.

The above transmission quality optimization scheme may be defined as the transmission quality optimization scheme 1 of the present application, and in one embodiment of the present application, the transmission quality optimization scheme 1 may specifically be that a USB channel is turned off, an audio transmission channel is turned off, a code rate adjusted by a video transmission channel is reduced to 90% of an original code rate, a response time window is adjusted to 100ms, and a frame rate is adjusted to 15fps.

Closing the USB channel, closing the audio transmission channel, reducing the code rate adjusted by the video transmission channel to a second preset code rate, adjusting the response time window to a second preset duration and adjusting the frame rate to a second preset frame rate;

it should be noted that, in the present application, the second preset code rate is smaller than the first preset code rate; the second preset time period is smaller than the first preset time period; the second preset frame rate is greater than the first preset frame rate.

The above transmission quality optimization scheme may be defined as the transmission quality optimization scheme 2 of the present application, and in one embodiment of the present application, the transmission quality optimization scheme 2 may specifically be that the USB channel is turned off, the audio transmission channel is turned off, the code rate adjusted by the video transmission channel is reduced to 80% of the original code rate, the response time window is adjusted to 80ms, and the frame rate is adjusted to 18fps.

Closing the USB channel, closing the mouse pointer channel, reducing the code rate adjusted by the video transmission channel to a third preset code rate, adjusting the response time window to a third preset duration, and adjusting the frame rate to a first preset proportion of the current video frame rate;

It should be noted that, the third preset code rate is smaller than the second preset code rate; the third preset time period is smaller than the second preset time period. The first preset proportion may be a proportion value set according to actual environmental requirements.

The above-mentioned transmission quality optimization scheme may be defined as the transmission quality optimization scheme 3 of the present application, and in one embodiment of the present application, the transmission quality optimization scheme 3 may specifically be that the USB channel is turned off, the mouse pointer channel is turned off, the code rate adjusted by the video transmission channel is reduced to 50% of the original code rate, the response time window is adjusted to 50ms, and the frame rate is adjusted to 80% of the current video frame rate. Therefore, the transmission bandwidth is reduced sharply, the definition is reduced, and the picture can be normally played.

Closing the USB channel, reducing the code rate adjusted by the video transmission channel to a fourth preset code rate, adjusting the response time window to a fourth preset duration, and adjusting the frame rate to a second preset proportion of the current game frame rate.

It should be noted that, the fourth preset code rate is smaller than the third preset code rate; the fourth preset time period is smaller than the third preset time period; the second preset proportion is smaller than the first preset proportion.

The above-mentioned transmission quality optimization scheme may be defined as the transmission quality optimization scheme 4 of the present application, and in one embodiment of the present application, the transmission quality optimization scheme 4 may specifically be that the USB channel is turned off, the code rate adjusted by the video transmission channel is reduced to 30% of the original code rate, the response time window is adjusted to 30ms, and the frame rate is adjusted to 60% of the current game frame rate. Therefore, the transmission bandwidth is reduced sharply, and the cloud desktop can be used continuously.

In the embodiment, by combining all the transmission channels of the cloud desktop, closing the low-priority channel under different scenes, and saving the transmission bandwidth by disabling non-critical functions; the code rate is reduced, and the transmission bandwidth is saved by reducing the code rate of the video streaming media; the frame rate is reduced, reducing the raw data by reducing the number of input frames called for by the encoder. Therefore, the data transmission efficiency in the cloud desktop scene is improved.

Further, reducing the rate of video transmission channel adjustment is achieved by at least one of:

according to the application, the cloud screen capture can adopt a vector image and bitmap self-adaptive transmission technology, so that bandwidth occupation is reduced from the source. And vector diagram transmission can be adopted in scenes with more pure colors like Computer-Aided Design (CAD) drawing, so that the information quantity of picture transmission is reduced, and the type information of the current running application is acquired in the process of drawing.

It should be noted that, in the present application, a white list may be set according to applications with more solid colors, and whether the type information of the currently running application is on the white list is determined after the type information is obtained, if a vector image transmission mode is adopted as the transmission mode of the image in the running application. If the image information does not exist, acquiring image information such as image color region classification, area and the like in the running application, and selecting a proper image transmission mode from a vector image transmission mode and a bitmap transmission mode according to the image information to serve as the transmission mode of the image in the running application.

For example: and switching to a vector diagram transmission mode when detecting that the running application is CAD drawing software.

If the running application is non-professional software, after multi-frame image capture, carrying out region identification on the image content, if the color classification is single or the whole domain is pure, adopting a vector image transmission mode, otherwise, reverting to a bitmap transmission mode.

among them, YUV is a color coding model based on luminance (Y) and chrominance (U, V), also called luminance-chrominance coding. Y represents luminance information of an image, and U and V represent chrominance information of the image. RGB is a color coding model based on three primary colors of red (R), green (G), and blue (B). The RGB model represents color as being generated by adjusting the brightness and saturation of the three components red, green, and blue.

In the application, cloud screen capture adopts YUV and RGB color coding self-adaption technology. In one embodiment, the cloud end can be fixedly provided with a color coding format of YUV, all scenes are basically met, and compared with RGB color coding, YUV color coding can reduce the transmission data amount by 50%.

Under RGB color coding, parameters of fine color depth can be continuously set for scenes, 8 bits, 16 bits, 32 bits and the like, so that different requirements of different scenes on image fineness are met;

therefore, the color coding format can be switched in time according to the type information of the running application of the current window or according to the type information and the resolution information of the running application.

For example: the video application is playing 720P and lower resolution video, then YUV color coding is adopted as the color coding mode of the image in the application; video application is playing high-definition video with resolution above 1080P such as 3D, and RGB color coding is adopted as a color coding mode of images in the application; word and other text editing scenes are being edited, namely the running application is a document editing application, and YUV color coding is adopted as a color coding mode of an image in the application; running applications such as surfing the Internet, namely running applications such as a browser, and adopting YUV color coding as a color coding mode of images in the applications; game play is underway, or the like, i.e., a running application is a game application, RGB color coding is employed as a color coding mode of an image in the application, and the like.

The application can adopt the principle of white list adaptation, namely, a video application white list is set, aiming at a common DirectShow player (such as storm video and QQ), video stream is intercepted in a cloud Guest OS, when a user clicks a video file, video stream data (not decoded) is directly transmitted to a client, the client directly plays through the player, the process saves the time loss of decoding and playing in the cloud, the video file is not decoded and played in the cloud, the video file is in a black screen state, the data before decoding is directly transmitted to the client, and the client carries out integrated adaptation aiming at the common player, thereby solving the problem of optimizing the transmission bandwidth time delay of most local video playing.

The principle of the white list video is to aim at a player to play video scenes, the windows platform is basically a direct show type player architecture, when a user clicks a video file to open, the player loads a file video stream, the file video stream is intercepted and redirected before decoding, and the file is not decoded in the cloud windows local.

It should be noted that, in the present application, the reduction of the code rate of the adjustment of the video transmission channel may also be achieved by performing a fixed frame rate.

Since the naked human eye does not feel obvious stuck above 18fps, a fixed frame rate of 18fps can be set, and in some ultra-low delay sensitive scenes, 60fps can be set fixedly, and the logic of frame rate calculation is canceled, so that the resource consumption is reduced.

It should be noted that, if the rate of the video transmission channel adjustment is reduced by adopting the fixed frame rate mode, the frame rate adjustment scheme is not executed in the target transmission quality optimization scheme, otherwise contradiction is generated.

According to the embodiment, corresponding transmission quality optimization schemes can be set in advance for different application scenes and network performance indexes, so that a target transmission quality optimization scheme comprising at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme can be determined through the current network performance index of a terminal connected with a cloud desktop and current application scene information of the cloud desktop, and data transmission between the terminal and the cloud desktop is performed under the target transmission quality optimization scheme. The transmission bandwidth during data transmission between the terminal and the cloud desktop can be effectively reduced through the transmission quality optimization schemes including the USB channel adjustment, the audio transmission channel adjustment, the video transmission channel adjustment, the mouse pointer channel adjustment, the response time window adjustment, the frame rate adjustment and other schemes, so that the problems of blocking, incapability of timely responding and the like are avoided, and the data transmission efficiency under the cloud desktop scene is further improved.

In one embodiment, after determining the target transmission quality optimization scheme according to the current network performance index and the current application scenario information, the method further comprises:

step 400, acquiring priority information of each transmission channel in the cloud desktop;

in the application, priority definition can be carried out on each channel by combining the byte quantity of transmission data, the time delay influence and the user experience influence degree in advance, and the specific priority can be as follows:

1、Main Channel；2、Control Channel；3、Cursor Channel；4、Display Channel；5、Audio Channel；6、USB Channel。

i.e. Main Channel priority is highest and USB Channel priority is lowest. It should be noted that if other channels exist, priority setting and adjustment can be performed according to actual requirements.

Therefore, the priority information of each transmission channel in the cloud desktop can be obtained.

And 500, carrying out data transmission of each transmission channel according to the priority information in the target response time window.

After the priority information of each transmission channel in the cloud desktop is obtained, the response time window adjusted according to the response time window adjusting scheme in the target transmission quality optimizing scheme can be determined, and the data transmission of each transmission channel is carried out according to the priority information in the response time window. For example: the video transmission channel and the audio transmission channel simultaneously have data to be transmitted, and the priority of the video transmission channel is higher than that of the audio transmission channel, so that the data to be transmitted of the video transmission channel are preferentially transmitted.

In one embodiment, the application can determine whether to start the code rate self-adaptive mode, if so, the data transmission of each transmission channel is performed according to the priority information within the target response time window. Otherwise, data transmission is carried out according to the sequence of the data of each transmission channel.

According to the method and the device, the situation that the former channel data are not processed under the condition of network congestion, the latter channel data cannot respond, the blocking feeling is obvious, the time window is set to be processed according to the priority, the user operation can be responded in time, the whole window is guaranteed to be available, and the whole window is used for sliding calculation, so that the data transmission efficiency under a cloud desktop scene is improved.

Fig. 2 is a schematic diagram of a data transmission flow of a cloud desktop and a terminal in the data transmission method according to the embodiment of the present application. Referring to fig. 2, in one embodiment, a user side may collect an instruction and upload the instruction to a cloud desktop through a network, where the cloud desktop may parse the instruction, perform cloud computing according to content obtained by parsing, and perform image rendering according to a computing result. Further, the screen capturing and encoding are carried out on the rendered picture, network transmission such as audio and video stream, control stream and USB data is carried out through a network, the user side receives the encoded data, then decodes the encoded data, and the decoded data is displayed. In addition, the user side can acquire data in a USB identification mode, the data are transmitted to the cloud desktop through the network, and the cloud desktop performs corresponding USB operation.

Further, the application also provides a data transmission device.

Referring to fig. 3, fig. 3 is a schematic functional block diagram of an embodiment of a data transmission device according to the present application.

The data transmission device includes:

the receiving module 310 is configured to receive a transmission quality optimization instruction of a cloud desktop, and determine a current network performance index of a terminal connected to the cloud desktop and current application scenario information of the cloud desktop;

a determining module 320, configured to determine a target transmission quality optimization scheme according to the current network performance index and the current application scenario information; the target transmission quality optimization scheme comprises at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme; the transmission channel adjustment scheme comprises at least one of USB channel adjustment, audio transmission channel adjustment, video transmission channel adjustment and mouse pointer channel adjustment;

and the transmission module 330 is configured to perform data transmission between the terminal and the cloud desktop under the target transmission quality optimization scheme.

According to the data transmission device provided by the embodiment of the application, after a transmission quality optimization instruction of a cloud desktop is received, a target transmission quality optimization scheme comprising at least one of a transmission channel adjustment scheme, a response time window adjustment scheme and a frame rate adjustment scheme is determined through the current network performance index of a terminal connected with the cloud desktop and the current application scene information of the cloud desktop, and data transmission between the terminal and the cloud desktop is performed under the target transmission quality optimization scheme. The transmission bandwidth during data transmission between the terminal and the cloud desktop can be effectively reduced through the transmission quality optimization schemes including the USB channel adjustment, the audio transmission channel adjustment, the video transmission channel adjustment, the mouse pointer channel adjustment, the response time window adjustment, the frame rate adjustment and other schemes, so that the problems of blocking, incapability of timely responding and the like are avoided, and the data transmission efficiency under the cloud desktop scene is further improved.

In one embodiment, the receiving module 310 is further configured to:

In one embodiment, the determining module 320 is specifically configured to:

In one embodiment, the transmission module 330 is further configured to:

Fig. 4 illustrates a physical schematic diagram of an electronic device, as shown in fig. 4, which may include: processor 410, communication interface (Communication Interface) 420, memory 430 and communication bus 440, wherein processor 410, communication interface 420 and memory 430 communicate with each other via communication bus 440. The processor 410 may call a computer program in the memory 430 to perform the steps of a data transmission method, for example comprising:

Further, the logic instructions in the memory 430 described above may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

In another aspect, an embodiment of the present application further provides a storage medium, where the storage medium is a computer readable storage medium, where the computer readable storage medium stores a computer program, where the computer program is configured to cause a processor to execute the steps of the method provided in the foregoing embodiments, where the method includes:

The computer readable storage medium may be any available medium or data storage device that can be accessed by a processor including, but not limited to, magnetic memory (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical memory (e.g., CD, DVD, BD, HVD, etc.), and semiconductor memory (e.g., ROM, EPROM, EEPROM, nonvolatile memory (NAND FLASH), solid State Disk (SSD)), etc.

The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A data transmission method, comprising:

2. The method according to claim 1, wherein the determining a target transmission quality optimization scheme according to the current network performance index and the current application scenario information includes:

3. The data transmission method according to claim 2, wherein the application scene includes at least document editing, web browsing, video playing, and game entertainment.

4. The data transmission method according to claim 1, wherein the transmission quality optimization scheme includes at least one of:

5. The method of claim 4, wherein reducing the rate of video transmission channel adjustments is accomplished by at least one of:

6. The data transmission method according to claim 1, further comprising, after determining a current network performance index of a terminal connected to the cloud desktop and current application scenario information of the cloud desktop:

7. The data transmission method according to claim 1, further comprising, after determining a target transmission quality optimization scheme according to the current network performance index and the current application scenario information:

8. A data transmission apparatus, comprising:

9. An electronic device comprising a processor and a memory storing a computer program, characterized in that the processor implements the data transmission method of any one of claims 1 to 7 when executing the computer program.

10. A storage medium, which is a computer-readable storage medium comprising a computer program, characterized in that the computer program, when executed by a processor, implements the data transmission method of any one of claims 1 to 7.