CN115150638A - Data transmission method, device, equipment and storage medium based on cloud desktop - Google Patents
Data transmission method, device, equipment and storage medium based on cloud desktop Download PDFInfo
- Publication number
- CN115150638A CN115150638A CN202210750533.6A CN202210750533A CN115150638A CN 115150638 A CN115150638 A CN 115150638A CN 202210750533 A CN202210750533 A CN 202210750533A CN 115150638 A CN115150638 A CN 115150638A
- Authority
- CN
- China
- Prior art keywords
- cloud desktop
- picture frame
- current
- picture
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 124
- 238000000034 method Methods 0.000 title claims abstract description 88
- 238000001514 detection method Methods 0.000 claims abstract description 28
- 230000002452 interceptive effect Effects 0.000 claims abstract description 17
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 230000008859 change Effects 0.000 claims description 150
- 230000007704 transition Effects 0.000 claims description 114
- 238000007906 compression Methods 0.000 claims description 62
- 230000006835 compression Effects 0.000 claims description 60
- 230000007246 mechanism Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 11
- 238000012544 monitoring process Methods 0.000 claims description 8
- 230000002829 reductive effect Effects 0.000 abstract description 16
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 7
- 230000000903 blocking effect Effects 0.000 description 6
- 238000005457 optimization Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 230000015556 catabolic process Effects 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000003908 quality control method Methods 0.000 description 1
- 230000008844 regulatory mechanism Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The application relates to the technical field of virtualization, and discloses a data transmission method, a device, equipment and a storage medium based on a cloud desktop, which comprises the following steps: detecting a current interaction scene and a current network environment to obtain a detection result; and if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, adjusting the image quality of the current image frame to be transmitted in the cloud desktop server so as to transmit the adjusted current image frame to the cloud desktop client for displaying. According to the method and the device, under a high-refresh scene and a weak network environment, the image quality of the current image frame to be transmitted is rapidly adjusted, and compared with an original transmission mode, the image frame with the adjusted image quality is transmitted to the cloud desktop client, so that the transmission code rate can be reduced, the network transmission delay can be reduced, and the transmission performance can be improved, so that the image blockage caused by data transmission between the server side and the client side of the cloud desktop can be relieved, and the user experience can be improved.
Description
Technical Field
The invention relates to the technical field of virtualization, in particular to a data transmission method, a data transmission device, data transmission equipment and a storage medium based on a cloud desktop.
Background
With the growing background of desktop clouds, further penetration of tele-office scenarios. Working at different places and places becomes a normal state. In the case of the wide area network, the network types, bandwidths, operators and the like accessed by the users have great differences, so that the network state fluctuation is obvious. The operation of partial high refresh is easy to cause or aggravate network congestion, and brings bad experiences of long response time, blockage and the like to users. In the prior art, most desktop transmission protocols are optimized for coding and transmission links of a wide area network, but are optimized for video playing scenes, so that user experience is not obviously improved in high-refresh scenes except videos. And even the current coding and transmission optimization of video playing scenes still has the technical problems of lag adjustment, incomplete adjustment and the like.
Therefore, how to improve the cloud desktop data transmission performance to improve the user experience is a technical problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
In view of this, the present invention provides a data transmission method, apparatus, device and storage medium based on a cloud desktop, which can improve data transmission performance of the cloud desktop to improve user experience. The specific scheme is as follows:
a first aspect of the present application provides a data transmission method based on a cloud desktop, including:
detecting a current interaction scene and a current network environment to obtain a detection result;
and if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, adjusting the image quality of the current image frame to be transmitted in the cloud desktop server so as to transmit the adjusted current image frame to the cloud desktop client for displaying.
Optionally, the adjusting the image quality of the current picture frame to be transmitted in the cloud desktop server to transmit the adjusted current picture frame to the cloud desktop client includes:
acquiring picture change information of a current picture frame to be transmitted in a cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting preset conditions as a transition picture frame;
and compressing the transition picture frame by using a compression mode with a high compression rate, and transmitting the compressed transition picture frame to a cloud desktop client for display.
Optionally, the picture change information includes at least one of a picture change frequency and a picture change area;
correspondingly, the determining the current picture frame corresponding to the picture change information meeting the preset condition as the transition picture frame includes:
and judging whether at least one of the picture change frequency and the picture change area meets a preset condition, and if so, determining the corresponding current picture frame as the transition picture frame.
Optionally, the picture change information includes a picture change frequency;
correspondingly, the acquiring picture change information of a current picture frame to be transmitted in the cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting the preset condition as a transition picture frame includes:
acquiring a coding request, determining the picture change frequency of a current picture frame according to the coding request, and if the picture change frequency is greater than a first preset threshold value, judging that the corresponding current picture frame is the transition picture frame.
Optionally, the determining, according to the encoding request, the picture change frequency of the current picture frame of the cloud desktop server includes:
and determining the picture change frequency of the current picture frame according to the time interval between the coding requests corresponding to the current picture frame and the adjacent picture frame or the quantity of the coding requests in a first preset time period.
Optionally, the picture change information includes a picture change area;
correspondingly, the acquiring picture change information of a current picture frame to be transmitted in the cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting the preset condition as a transition picture frame includes:
and carrying out picture matching on the current picture frame and the historical picture frame to determine the change area ratio of the current picture frame according to the matching result, and if the change area ratio is greater than a second preset threshold value, judging that the corresponding current picture frame is the transition picture frame.
Optionally, the picture change information includes a picture change frequency and a picture change area;
correspondingly, the method further comprises the following steps:
if the picture change frequency meets a preset condition, judging whether the network condition between the current cloud desktop server side and the current cloud desktop client side is in a congestion state, and if so, judging whether the picture change area meets the preset condition;
if so, determining the corresponding current picture frame as the transition picture frame.
Optionally, the determining whether the network condition between the current cloud desktop server and the cloud desktop client is in a congestion state includes:
and acquiring data packet transmission information through a bottom layer transmission protocol between the cloud desktop server and the cloud desktop client, and judging whether the network condition between the current cloud desktop server and the current cloud desktop client is in a congestion state or not according to the data packet transmission information.
Optionally, after determining the current picture frame corresponding to the picture change information meeting the preset condition as the transition picture frame, the method further includes:
dividing the transition picture frame into a first area and a second area according to the picture content change condition in the transition picture frame; wherein the picture content in the first area changes, and the picture content in the second area does not change;
correspondingly, the compressing the transition picture frame by using a compression mode with a high compression ratio, and transmitting the compressed transition picture frame to a cloud desktop client for display includes:
and performing lossy compression processing on the first area, and transmitting the identification information of the first area and the second area after the compression processing to a cloud desktop client, so that the cloud desktop client can obtain the second area of the local cache according to the identification information, and display the received first area and the obtained second area of the local cache.
Optionally, after dividing the transition picture frame into a first region and a second region according to a picture content change condition in the transition picture frame, the method further includes:
and carrying out lossy compression processing on the non-text part in the first area and carrying out lossless compression processing on the text part in the first area.
Optionally, after obtaining the picture change information of the current picture frame to be transmitted in the cloud desktop server, the method further includes:
determining a current picture frame corresponding to the picture change information which does not meet the preset condition as a non-transition picture frame;
and when the non-transition picture frame is a complete clear frame, compressing the complete clear frame, and transmitting the compressed complete clear frame to a cloud desktop client for display.
Optionally, before the compressing the complete clear frame, the method further includes:
and if the new coding request is not acquired within a second preset time period, determining the picture frame corresponding to the newly acquired coding request as the complete clear frame.
Optionally, the data transmission method based on the cloud desktop further includes:
and monitoring the complete clear frame, if the complete clear frame is not monitored in a third preset time period, stopping the step of compressing the next transition picture frame, and determining the latest picture frame in the cloud desktop server as the complete clear frame to execute a clear mechanism.
A second aspect of the present application provides a data transmission device based on a cloud desktop, including:
the detection module is used for detecting the current interaction scene and the current network environment to obtain a detection result;
and the adjusting module is used for adjusting the image quality of the current image frame to be transmitted in the cloud desktop server side if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, so that the adjusted current image frame is transmitted to the cloud desktop client side for displaying.
A third aspect of the application provides an electronic device comprising a processor and a memory; wherein the memory is used for storing a computer program which is loaded and executed by the processor to realize the cloud desktop-based data transmission method.
A fourth aspect of the present application provides a computer-readable storage medium, where computer-executable instructions are stored, and when the computer-executable instructions are loaded and executed by a processor, the cloud desktop based data transmission method is implemented.
In the method, a current interactive scene and a current network environment are detected to obtain a detection result; and if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, adjusting the image quality of the current image frame to be transmitted in the cloud desktop server so as to transmit the adjusted current image frame to the cloud desktop client for displaying. Therefore, the image quality of the current image frame to be transmitted is rapidly adjusted in a high-refresh scene and a weak network environment, and compared with an original transmission mode, the image frame with the adjusted image quality is transmitted to the cloud desktop client, so that the transmission code rate can be reduced, the network transmission delay can be reduced, and the transmission performance can be improved, so that the image blocking caused by data transmission between the server side and the client side of the cloud desktop can be relieved, and the user experience can be improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a data transmission method based on a cloud desktop according to the present application;
fig. 2 is a flowchart of a specific transition picture frame determination method provided in the present application;
fig. 3 is a flowchart of a specific method for determining a transition picture frame according to the present application;
fig. 4 is a schematic diagram of a specific data transmission method based on a cloud desktop according to the present application;
fig. 5 is a flowchart of a specific data transmission method based on a cloud desktop according to the present application;
fig. 6 is a flowchart of a specific data transmission method based on a cloud desktop according to the present application;
fig. 7 is a schematic diagram of a cloud desktop-based data transmission method in a PPT animation scene provided by the present application;
fig. 8 is an overall architecture diagram of a desktop transport protocol in a PPT animation scenario according to the present application;
fig. 9 is a schematic structural diagram of a data transmission device based on a cloud desktop according to the present application;
fig. 10 is a structural diagram of a data transmission electronic device based on a cloud desktop according to the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the prior art, most desktop transmission protocols are optimized for coding and transmission links of a wide area network, but are optimized for video playing scenes, so that user experience is not obviously improved in high-refresh scenes except videos. And even the current encoding and transmission optimization of video playing scenes still has the technical problems of lag adjustment, incomplete adjustment and the like. In view of the technical defects, the data transmission scheme based on the cloud desktop is provided, the image quality of the current image frame to be transmitted is rapidly adjusted in a high-refresh scene and a weak network environment, and compared with an original transmission mode, the image frame with the adjusted image quality is transmitted to the cloud desktop client, so that the transmission code rate can be reduced, the network transmission delay can be reduced, and the transmission performance can be improved, so that the image blocking caused by data transmission between the server side and the client side of the cloud desktop can be relieved, and the user experience can be improved.
Fig. 1 is a flowchart of a data transmission method based on a cloud desktop according to an embodiment of the present disclosure. Referring to fig. 1, the data transmission method based on the cloud desktop includes:
s11: and detecting the current interaction scene and the current network environment to obtain a detection result.
The cloud desktop is a Virtual Desktop Infrastructure (VDI) built based on a desktop virtualization technology, and can access cross-platform applications and the whole client desktop through a thin client or any other device connected to a network. The cloud desktop server and the cloud desktop client communicate based on a Wide Area Network (WAN), which is also called an extranet or a public Network, and is a remote Network for connecting local Area networks or metropolitan Area networks in different regions for computer communication.
In this embodiment, an execution subject of the data transmission method may be a cloud desktop server side or a third party control system, which is not limited in this embodiment. In this embodiment, a current interaction scene and a current network environment are detected first, and a detection result is finally obtained. The detection of the current interactive scene mainly comprises the detection of the interactive scene between the cloud desktop server and the cloud desktop client, so that whether the interactive scene between the cloud desktop server and the cloud desktop client is a high-refreshing scene or not is judged. Under a high-refresh scene, the interaction between the cloud desktop server and the cloud desktop client is frequent, for example, PPT animation, motion pictures/animations, window dragging, large-amplitude window scrolling and other scenes. The current network environment is mainly detected by detecting the network transmission environment between the cloud desktop server and the cloud desktop client, so that whether the network transmission environment between the cloud desktop server and the cloud desktop client is a weak network environment or not is judged.
It is understood that the weak network environment is not sufficient to support picture transmission in high refresh scenes. The network in the weak network environment may satisfy any one or more of a condition that a time delay of the network is greater than or equal to a preset time delay threshold (i.e., a high time delay condition), a packet loss rate is greater than or equal to a preset packet loss rate threshold (i.e., a high packet loss rate condition), and a jitter rate is greater than or equal to a preset jitter rate threshold (i.e., a high jitter rate condition). For example, when the packet loss rate of the network is greater than or equal to 1% (i.e., the preset packet loss rate threshold), and the jitter rate of the network is greater than or equal to 10% (i.e., the preset jitter rate threshold) or the delay of the network is greater than or equal to 40ms (i.e., the preset delay threshold), it may be determined that the current network is a weak network and the corresponding network environment is a weak network environment. In this embodiment, when the packet loss rate of network transmission between the cloud desktop server and the cloud desktop client is greater than or equal to 1%, and the jitter rate is greater than or equal to 10% or the time delay is greater than or equal to 40ms, the detection result is a weak network environment.
Further, the normal network corresponds to the weak network, and the normal network environment may be a network condition capable of normal data transmission other than the weak network environment. For example, in the case that the packet loss rate of the network is less than 1%, or the packet loss rate is greater than or equal to 1%, the jitter rate is less than 10%, and the delay is less than 40ms, it may be determined that the current network is a normal network. The present embodiment is an image quality adjustment scheme that is adopted in the case where a high interaction scene and a weak network environment coexist, and image quality adjustment is not triggered in a normal network environment.
S12: and if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, adjusting the image quality of the current picture frame to be transmitted in the cloud desktop server so as to transmit the adjusted current picture frame to the cloud desktop client for displaying.
In this embodiment, since the weak network environment is not sufficient to support the image transmission in the high refresh scene, the image quality of the image frame transmitted in the weak network environment needs to be adjusted, so as to change the code rate of the transmitted image frame. Specifically, if the detection result indicates that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, the image quality of the current image frame to be transmitted in the cloud desktop server is adjusted, and finally the adjusted current image frame is transmitted to the cloud desktop client for displaying. Compared with the method for processing the picture frames in all scenes and all environments without difference, the method for processing the picture frames in all environments has the advantages that the user experience can be obviously improved by optimizing and adjusting the transmission link.
Therefore, the embodiment of the application detects the current interactive scene and the current network environment to obtain a detection result; and if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, adjusting the image quality of the current image frame to be transmitted in the cloud desktop server so as to transmit the adjusted current image frame to the cloud desktop client for displaying. According to the method and the device, under a high-refresh scene and a weak network environment, the image quality of the current image frame to be transmitted is rapidly adjusted, and compared with an original transmission mode, the image frame with the adjusted image quality is transmitted to the cloud desktop client, so that the transmission code rate can be reduced, the network transmission delay can be reduced, and the transmission performance can be improved, so that the image blocking caused by data transmission between the server side and the client side of the cloud desktop can be relieved, and the user experience can be improved.
Fig. 2 is a flowchart of a data transmission method based on a cloud desktop according to an embodiment of the present application. Referring to fig. 2, the data transmission method based on the cloud desktop includes:
s21: the method comprises the steps of obtaining picture change information of a current picture frame to be transmitted in a cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting preset conditions as a transition picture frame.
In this embodiment, the picture change information of the current picture frame of the cloud desktop server is obtained, and the current picture frame corresponding to the picture change information meeting the preset condition is determined as the transition picture frame. Wherein the transition picture frame is a picture frame in a high refresh scene.
The picture frame of the cloud desktop server in this embodiment is generally a picture frame in a scene where the server interacts frequently with the client, for example, a PPT animation, a motion picture/animation, a window drag, a large-amplitude window scroll, and the like. Under the scene, the Screen of the picture frame of the cloud desktop server is frequently refreshed, so that the Screen Content (Screen Content) changes, and further the picture change information is generated. And on the premise that the picture change information meets a certain condition, the current picture frame is considered to belong to a picture frame in a high-refresh scene, namely the transition picture frame. The high refresh scene specifically refers to a scene in which the screen content, that is, the picture content, changes quickly and has a large change area in a short time, and the high interaction operation of the user in such a scene often does not pay much attention to the current situation of the details of the transition content, and it can be considered that the picture frame in the scene, that is, the transition picture frame, is highly compressed, so that the transmission code rate is significantly reduced and the sudden blocking feeling is significantly relieved.
Based on this, a specific transition picture frame determination method flowchart provided in the embodiments of the present application is provided. Referring to fig. 3, the transition picture frame determination method includes:
s211: acquiring at least one of picture change frequency and picture change area of a current picture frame to be transmitted in a cloud desktop server;
s212: and judging whether at least one of the picture change frequency and the picture change area meets a preset condition, and if so, determining the corresponding current picture frame as the transition picture frame.
In this embodiment, the picture change frequency reflects a refresh rate of the current screen, and the size of the refresh area of the current screen is reflected by the picture change area. Whether the current picture frame is highly compressed is determined by analyzing the refresh rate and the refresh area size of the current screen, i.e., the current picture frame.
In a first embodiment, the picture change frequency is determined mainly from the coding request, if the picture change information only comprises the picture change frequency. Of course, in addition to the coding request, the picture change frequency may also be determined by parameters such as a screen refresh frame rate, a coding frame rate, and the like, and the process of determining the picture change frequency according to the coding request in this embodiment includes: acquiring a coding request, determining the picture change frequency of a current picture frame according to the coding request, and if the picture change frequency is greater than a first preset threshold value, judging that the corresponding current picture frame is the transition picture frame.
Specifically, firstly, a coding request is obtained, and it is understood that the corresponding coding request is triggered as soon as the screen of the cloud computer is updated. Then, the picture change frequency of the current picture frame is determined according to the coding request. It is understood that the coding request and the picture change frequency have a positive correlation, the more frequent the coding request, the higher the picture change frequency, and the frequency of the coding request can be measured by the request time and the request times. Based on this, the present embodiment determines the picture change frequency of the current picture frame according to the time interval between the coding requests corresponding to the current picture frame and the adjacent picture frame or the number of the coding requests within the first preset time period. For example, the time difference between adjacent encoding requests or the number of encoding requests in the past second is calculated. Further, if the picture change frequency is greater than a first preset threshold, it is determined that the corresponding current picture frame is the transition picture frame. The first preset threshold is determined according to actual requirements, which is not limited in this embodiment.
In the second embodiment, if the picture change information includes only the picture change region, the picture change region is determined mainly by picture matching with the history picture frame. That is, the current frame and the historical frame are subjected to frame matching, so that the ratio of the change area of the current frame is determined according to the matching result, and if the ratio of the change area is greater than a second preset threshold value, the corresponding current frame is determined to be the transition frame. It can be understood that the historical picture frame is a picture frame before the current picture frame, and may be an adjacent picture frame or an interval picture frame, which is not limited in this embodiment of the present application. That is, before encoding, the current picture frame is compared with the recent historical picture frame, the size of the area where the current picture frame really changes is calculated according to the comparison result, a proper threshold value is set, the area size ratio is larger than the threshold value, the picture change content is considered to be more, and an encoding optimization mechanism needs to be started aiming at the current picture frame. Note that, in addition to the above-described manner of obtaining the size of the change region by performing screen comparison with the history screen frame, the size may be obtained by an algorithm such as image similarity calculation.
In a third embodiment, if the picture change information includes both the picture change frequency and the picture change area, it is determined whether the picture changes frequently according to the picture change frequency, and it is further determined whether network congestion occurs currently under the condition that the picture changes frequently, and if network congestion occurs at this time, it is further determined whether the corresponding current picture frame is the transition picture frame according to the picture change area. Network congestion is a network state in a weak network environment. Therefore, the transition picture frame needs to satisfy three conditions of frequent picture change, network congestion and large change area, in other words, the transition picture frame has a fast picture refresh rate, network congestion and a large picture refresh area, as shown in fig. 4. Therefore, the embodiment can further combine the network state information to quickly identify the high refresh scene, relieve the congestion problem of the frequent interaction scene of the cloud desktop in the weak network environment, and improve the user experience in the scene.
Specifically, if the picture change frequency meets a preset condition, it is determined whether a network condition between the current cloud desktop server and the cloud desktop client is in a congestion state, if so, it is determined whether the picture change area meets the preset condition, and if so, the corresponding current picture frame is determined to be the transition picture frame. It is understood that the network condition is generally reflected by the transmission information side of the network, and in this embodiment, the data packet transmission information is obtained through a bottom layer transmission protocol between the cloud desktop server and the cloud desktop client, and whether the network condition between the current cloud desktop server and the current cloud desktop client is in a congestion state is determined according to the data packet transmission information. When the frequent change of the picture is determined, the corresponding interface of the monitoring module is requested to acquire data packet transmission information from a bottom layer transmission Protocol, the data packet transmission information includes but is not limited to the current transmission data volume, the data volume to be transmitted, the received data volume and the like, whether congestion exists is judged according to the data transmission condition, and the information is generally encapsulated through a transmission layer Protocol such as User Datagram Protocol (UDP).
S12: and compressing the transition picture frame by using a compression mode with a high compression rate, and transmitting the compressed transition picture frame to a cloud desktop client for display.
In this embodiment, after the transition picture frame is determined, the transition picture frame is compressed in a compression mode with a high compression rate, and the compressed transition picture frame is transmitted to a cloud desktop client for display. It can be understood that, since the transition picture frame is a detail picture with low user attention, after the transition picture frame is compressed by a compression method with a high compression rate, the transmission code rate can be reduced during transmission. The Compression method with a high Compression ratio may be a Lossy Compression (Lossy Compression) method, which uses the characteristic that human beings are not sensitive to some frequency components in images or sound waves, and allows a certain amount of information to be lost during the Compression process, and although the original data cannot be completely restored, the lost part has a small influence on understanding the original image, but has a much larger Compression ratio.
It should be noted that how the cloud desktop client decodes and displays the compressed transition picture frame does not belong to the limited scope of this embodiment. The decoding process may be performed by a decoding method corresponding to the encoding method, or may be performed by a specific decoding method, which is not limited in the present embodiment.
Therefore, in the embodiment of the application, the picture change information of the current picture frame of the cloud desktop server is obtained, and the current picture frame corresponding to the picture change information meeting the preset condition is determined as the transition picture frame; then the transition picture frame is a picture frame in a high-refresh scene; and finally, compressing the transition picture frame by using a compression mode with a high compression rate, and transmitting the compressed transition picture frame to a cloud desktop client for display. According to the method and the device, the type of the picture frame of the cloud desktop server is judged by setting the preset condition according to the picture change information, so that the picture frame in the high-refresh scene, namely the transition picture frame, can be quickly identified. Meanwhile, the compression mode is rapidly adjusted to a high compression mode aiming at the transition picture frame, so that the transmission code rate can be reduced, the network transmission delay can be reduced, and the transmission performance can be improved when the compressed transition picture frame is transmitted, thereby relieving the picture blockage caused by data transmission between the server side and the client side of the cloud desktop and improving the user experience.
Fig. 5 is a flowchart of a specific data transmission method based on a cloud desktop according to an embodiment of the present application. Referring to fig. 5, the data transmission method based on the cloud desktop includes:
s31: the method comprises the steps of obtaining picture change information of a current picture frame to be transmitted in a cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting preset conditions as a transition picture frame.
In this embodiment, as to the specific process of the step S31, reference may be made to corresponding contents disclosed in the foregoing embodiments, and details are not repeated here.
S32: dividing the transition picture frame into a first area and a second area according to the picture content change condition in the transition picture frame; wherein the picture content in the first area changes, and the picture content in the second area does not change.
S33: and performing lossy compression processing on the first area, and transmitting the identification information of the first area and the second area after the lossy compression processing to a cloud desktop client, so that the cloud desktop client can acquire the second area of the local cache according to the identification information and display the received first area and the acquired second area of the local cache.
In this embodiment, after the transition picture frame is determined, the transition picture frame is further divided into a first area and a second area according to a picture content change condition in the transition picture frame. Wherein the picture content in the first area changes, and the picture content in the second area does not change. It is understood that the transition picture frame does not necessarily have to be a whole picture changed, and a part of the picture may be changed and a part of the picture may not be changed. In this embodiment, the changed region in the transition picture frame is defined as the first region, and the unchanged region is defined as the second region. And performing lossy compression on the first area, namely the changed area, and not performing compression processing on the second area, namely the unchanged area. The compressed first area is transmitted to a cloud desktop client, meanwhile, identification information of the second area needs to be transmitted to the cloud desktop client, after the cloud desktop client receives the identification information of the second area, the Yun Zhuomian client obtains the second area of the local cache according to the identification information, and displays the received first area and the obtained second area of the local cache. The identification information may be position information, such as a position coordinate, of the second region in the transition picture frame, and after receiving the position information, the Yun Zhuomian client may pull a previously received picture of the second region from the local cache, where the transmission code rate is much smaller than a transmission code rate of the cloud desktop server for repeatedly compressing and transmitting the picture. In addition, the identification information may be transmitted to the cloud desktop client in the form of an instruction, which is not limited in this embodiment.
Further, the present embodiment performs lossy Compression processing on the non-text portion in the first region and performs Lossless Compression processing (Lossless Compression) on the text portion in the first region. In which lossless compression utilizes redundancy of data for compression, and original data can be completely restored without causing any distortion. It can be understood that the specific algorithm and quality parameter of the lossy compression or the lossless compression can be flexibly selected according to the actual service requirement, which is not limited in this embodiment. That is, after the optimization mechanism is started according with the transition picture frame in the high refresh scene, only the change area of the current picture frame is adjusted to a lossy compression algorithm by default and appropriate quality parameters are specified. However, considering that some users are sensitive to image quality degradation, in order to ensure the user experience as much as possible, the text area may be selected not to be subjected to lossy compression according to the acceptable degree of the users. That is, only the non-text part in the transition picture frame change region is compressed in a loss way, and the text part still keeps a lossless compression way.
Therefore, in the embodiment of the application, after the picture change information of the current picture frame of the cloud desktop server is obtained and the current picture frame corresponding to the picture change information meeting the preset condition is determined as the transition picture frame, the transition picture frame is divided into the first area with changed picture content and the second area without changed picture content according to the picture content change condition in the transition picture frame. And then performing lossy compression processing on the first region, transmitting identification information of the first region and the second region after the lossy compression processing to a cloud desktop client, acquiring the second region of a local cache by the cloud desktop client according to the identification information, and displaying the received first region and the acquired second region of the local cache. After the high refresh scene is identified, the content changed in the transition picture frame is compressed by adopting a lossy compression algorithm according to proper quality parameters, so that the sensitivity of a user to image quality degradation can be fully considered, and the user experience can be ensured as much as possible.
Fig. 6 is a flowchart of a specific data transmission method based on a cloud desktop according to an embodiment of the present application. Referring to fig. 6, the data transmission method based on the cloud desktop includes:
s41: the method comprises the steps of obtaining picture change information of a current picture frame to be transmitted in a cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting preset conditions as a transition picture frame.
In this embodiment, as to the specific process of the step S41, reference may be made to corresponding contents disclosed in the foregoing embodiments, and details are not repeated here.
S42: and if the new coding request is not acquired within a second preset time period, determining the picture frame corresponding to the newly acquired coding request as a complete clear frame.
In this embodiment, if a new coding request is not acquired within a second preset time period, the picture frame corresponding to the newly acquired coding request is determined as the complete clear frame. Wherein the full clear frame is one of non-transition picture frames. The non-transition picture frame is a current picture frame corresponding to the picture change information which does not meet the preset condition. As mentioned earlier, the coding request may reflect the picture change frequency, i.e. the picture change information. The absence of a new encoding request within the second preset time period represents that no screen picture has changed during this time period. It can be understood that after the user stops interacting, the screen image tends to be still, which indicates that the attention of the user to the image frame is high, and the image frame of this type is determined as the complete clear frame in the non-transition image frame.
S43: and compressing the complete clear frame, and transmitting the compressed complete clear frame to a cloud desktop client for display.
In this embodiment, the transition picture frame is compressed in a lossy compression manner, and the non-transition picture frame needs to be compressed in a corresponding complete clear frame, specifically, a conventional adaptive coding manner may be adopted, and the compressed complete clear frame is transmitted to the cloud desktop client for display. This is a clear mechanism proposed in this embodiment, and after the user stops interacting, the screen image is often still. At this time, no new coding request exists in a short time, and a clearer frame is sent by using resource idle, so that a user can see a clear picture. It should be noted that a high-refresh scene often appears when a user performs an interactive operation, and under the condition of network congestion, the user may often accept that the image quality of the screen content is reduced in the operation execution process, but after the image stops changing, it is necessary to ensure that the user browses a clear image, and therefore, data needs to be reissued to make the image clear.
S44: and monitoring the complete clear frame, if the complete clear frame is not monitored in a third preset time period, stopping the step of compressing the next transition picture frame, and determining the latest picture frame in the cloud desktop server as the complete clear frame to execute a clear mechanism.
In this embodiment, a special condition is considered, a part of the region in the picture is changed all the time, that is, under the condition that the coding request exists all the time, the embodiment monitors the complete clear frame, if the complete clear frame is not monitored in a third preset time period, the step of compressing the next transition picture frame is stopped, and the latest picture frame in the cloud desktop server is determined to be the complete clear frame to execute a clear mechanism. Specifically, a timer can be set to monitor whether a sharpening mechanism is executed, if the sharpening mechanism is not executed for a long time, the next transition picture frame does not execute an encoding algorithm and a quality regulation mechanism, and meanwhile, the latest picture frame (or an encoding request) is used as the complete sharpening frame and is sent to the Yun Zhuomian client after the sharpening mechanism is executed, so that the Yun Zhuomian client can not always sharpen the picture for a long time, and the sharpness of a static area in the picture can be ensured to the maximum extent.
Therefore, on the basis of determining the transition picture frame, the embodiment of the application further determines the complete clear frame by whether a new coding request is acquired within a second preset time period. And executing a high-compression scheme for the transition picture frame, executing a definition mechanism for a complete definition frame in the non-transition picture frame, and ensuring that a user can see a clear picture when the picture is static through the definition mechanism under the condition of obviously relieving sudden blocking feeling of a high-refresh scene in a weak network congestion environment.
The technical scheme in the application is more suitable for data transmission in scenes of PPT animation playing, dynamic image/animation playing, window dragging, large-amplitude window rolling and the like on the cloud desktop. The technical solution in the present application is described below by taking PPT animation as an example, and a specific process is shown in fig. 7.
In order to make the image quality control logic clearer, the overall architecture of the desktop transport protocol is shown in fig. 8, where the main thread is used to perform content processing, monitoring/adjustment, coding initiation/result processing, and data transceiving operations, and the independent coding thread is used to perform coding initiation/result processing operations such as update region identification, coding algorithm decision, and coding. In fig. 7, when a user starts playing PPT on the cloud desktop, for the first PPT page, the monitoring/adjusting module of the main thread first completes determining whether the current frame changes frequently and whether the network is congested, and if it is determined that the current frame changes frequently and the network is congested, the updating region identification module of the independent coding thread completes determining whether the frame updating region of the current frame is larger. If the picture update area is large, the current picture frame is determined as the transition picture frame. Due to limited graphical representation, a large number of transition picture frames are omitted in fig. 7, and finally, coding algorithm adjustment is realized by a coding decision module of an independent coding thread. In addition, a clear mechanism and a timer monitor, the code for sending data is positioned in an independent coding thread, and the judgment of the part with or without a code request is completed in a main thread, namely the main thread and the independent coding thread are involved at the same time.
Therefore, through the cooperative operation of different thread operation modules, whether the transition picture is highly compressed or not can be determined by analyzing the refreshing speed and the refreshing area size of the current screen in the network congestion state, the transmission code rate is obviously reduced, the sudden card pause feeling is obviously relieved, and a clear mechanism is used for ensuring that a user can see a clear picture when the picture is static.
Referring to fig. 9, an embodiment of the present application further discloses a data transmission device based on a cloud desktop, which includes:
the detection module 11 is configured to detect a current interaction scene and a current network environment to obtain a detection result;
the adjusting module 12 is configured to adjust the image quality of a current image frame to be transmitted in the cloud desktop server if the detection result indicates that the current interaction scene is a high-refresh scene and the current network environment is a weak network environment, so as to transmit the adjusted current image frame to the cloud desktop client for display.
Therefore, the embodiment of the application detects the current interactive scene and the current network environment to obtain a detection result; and if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, adjusting the image quality of the current image frame to be transmitted in the cloud desktop server so as to transmit the adjusted current image frame to the cloud desktop client for displaying. According to the method and the device, under a high-refresh scene and a weak network environment, the image quality of the current image frame to be transmitted is rapidly adjusted, and compared with an original transmission mode, the image frame with the adjusted image quality is transmitted to the cloud desktop client, so that the transmission code rate can be reduced, the network transmission delay can be reduced, and the transmission performance can be improved, so that the image blocking caused by data transmission between the server side and the client side of the cloud desktop can be relieved, and the user experience can be improved.
In some embodiments, when the picture change information includes a picture change frequency, the adjusting module 12 specifically includes:
the acquisition submodule is used for acquiring the picture change information of the current picture frame to be transmitted in the cloud desktop server;
the determining submodule is used for determining the current picture frame corresponding to the picture change information meeting the preset condition as a transition picture frame;
a compression submodule for compressing the transition picture frame by a compression method having a high compression rate;
and the transmission submodule is used for transmitting the compressed transition picture frame to a cloud desktop client for display.
In some specific embodiments, when the picture change information includes a picture change frequency, the determining sub-module specifically includes:
an acquisition unit configured to acquire an encoding request;
a first determining unit, configured to determine a picture change frequency of a current picture frame according to the encoding request;
and the first judgment unit is used for judging that the corresponding current picture frame is the transition picture frame if the picture change frequency is greater than a first preset threshold value.
In some embodiments, the first determining unit is specifically configured to determine the picture change frequency of the current picture frame according to a time interval between the coding requests corresponding to the current picture frame and an adjacent picture frame or a number of the coding requests within a first preset time period.
In some specific embodiments, when the picture change information includes a picture change area, the determining sub-module specifically includes:
the matching unit is used for carrying out picture matching on the current picture frame and the historical picture frame;
the second determining unit is used for determining the ratio of the change area of the current picture frame according to the matching result;
and the second judging unit is used for judging that the corresponding current picture frame is the transition picture frame if the change area ratio is greater than a second preset threshold value.
In some specific embodiments, when the screen change information includes a screen change frequency and a screen change area, the cloud desktop-based data transmission apparatus further includes:
the judging unit is used for judging whether the network condition between the current cloud desktop server and the current cloud desktop client is in a congestion state or not if the picture change frequency meets a preset condition, and judging whether the picture change area meets the preset condition or not if the network condition between the current cloud desktop server and the current cloud desktop client is in the congestion state;
a third determining unit, configured to determine, if yes, the corresponding current picture frame as the transition picture frame.
In some specific embodiments, the determining unit is specifically configured to obtain data packet transmission information through a bottom layer transmission protocol between the cloud desktop server and the cloud desktop client, and determine whether a network condition between the current cloud desktop server and the cloud desktop client is in a congestion state according to the data packet transmission information.
In some specific embodiments, the cloud desktop-based data transmission apparatus further includes:
the area dividing module is used for dividing the transition picture frame into a first area and a second area according to the picture content change condition in the transition picture frame; wherein, the picture content in the first area changes, and the picture content in the second area does not change;
a first determining module, configured to determine a current picture frame corresponding to the picture change information that does not satisfy the preset condition as a non-transition picture frame;
a second determining module, configured to determine, if a new coding request is not obtained within a second preset time period, a picture frame corresponding to the newly obtained coding request as the complete clear frame;
the monitoring module is used for monitoring the complete clear frame, stopping the step of compressing the next transition picture frame if the complete clear frame is not monitored in a third preset time period, and determining the latest picture frame in the cloud desktop server as the complete clear frame to execute a clear mechanism;
correspondingly, the compression submodule specifically includes:
a first compression processing unit configured to perform lossy compression processing on the first region;
the second compression processing unit is used for carrying out lossy compression processing on the non-character part in the first area and carrying out lossless compression processing on the character part in the first area;
the third compression processing unit is used for compressing the complete clear frame when the non-transition picture frame is the complete clear frame and transmitting the compressed complete clear frame to the cloud desktop client for displaying;
correspondingly, the transmission sub-module is further configured to transmit the identification information of the first region and the second region after the compression processing to a cloud desktop client, so that the cloud desktop client can obtain the second region of the local cache according to the identification information and display the received first region and the obtained second region of the local cache.
Furthermore, the embodiment of the application also provides electronic equipment. FIG. 10 is a block diagram illustrating an electronic device 20 according to an exemplary embodiment, and the contents of the diagram should not be construed as limiting the scope of use of the present application in any way.
Fig. 10 is a schematic structural diagram of an electronic device 20 according to an embodiment of the present disclosure. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input output interface 25, and a communication bus 26. The memory 22 is configured to store a computer program, and the computer program is loaded and executed by the processor 21 to implement relevant steps in the cloud desktop-based data transmission method disclosed in any of the foregoing embodiments.
In this embodiment, the power supply 23 is configured to provide a working voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and an external device, and a communication protocol followed by the communication interface is any communication protocol applicable to the technical solution of the present application, and is not specifically limited herein; the input/output interface 25 is configured to obtain external input data or output data to the outside, and a specific interface type thereof may be selected according to specific application requirements, which is not specifically limited herein.
In addition, the storage 22 is used as a carrier for resource storage, and may be a read-only memory, a random access memory, a magnetic disk or an optical disk, etc., and the resources stored thereon may include an operating system 221, a computer program 222, data 223, etc., and the storage may be a transient storage or a permanent storage.
The operating system 221 is configured to manage and control each hardware device and the computer program 222 on the electronic device 20, so as to implement the operation and processing of the mass data 223 in the memory 22 by the processor 21, and may be Windows Server, netware, unix, linux, or the like. The computer programs 222 may further include computer programs that can be used to perform other specific tasks in addition to the computer programs that can be used to perform the cloud desktop-based data transmission method performed by the electronic device 20 disclosed in any of the foregoing embodiments. Data 223 may include scene change information collected by electronic device 20.
Further, an embodiment of the present application further discloses a storage medium, in which a computer program is stored, and when the computer program is loaded and executed by a processor, the steps of the data transmission method based on the cloud desktop disclosed in any of the foregoing embodiments are implemented.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
The cloud desktop-based data transmission method, apparatus, device and storage medium provided by the present invention are described in detail above, and a specific example is applied in the present document to explain the principle and the implementation of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (16)
1. A data transmission method based on a cloud desktop is characterized by comprising the following steps:
detecting a current interaction scene and a current network environment to obtain a detection result;
and if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, adjusting the image quality of the current image frame to be transmitted in the cloud desktop server so as to transmit the adjusted current image frame to the cloud desktop client for displaying.
2. The cloud desktop-based data transmission method according to claim 1, wherein the adjusting the image quality of the current picture frame to be transmitted in the cloud desktop server to transmit the adjusted current picture frame to the cloud desktop client comprises:
acquiring picture change information of a current picture frame to be transmitted in a cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting preset conditions as a transition picture frame;
and compressing the transition picture frame by using a compression mode with a high compression rate, and transmitting the compressed transition picture frame to a cloud desktop client for displaying.
3. The cloud desktop-based data transmission method according to claim 2, wherein the screen change information includes at least one of screen change frequency, screen change area;
correspondingly, the determining the current picture frame corresponding to the picture change information meeting the preset condition as the transition picture frame includes:
and judging whether at least one of the picture change frequency and the picture change area meets a preset condition, and if so, determining the corresponding current picture frame as the transition picture frame.
4. The cloud desktop-based data transmission method according to claim 2, wherein the screen change information includes a screen change frequency;
correspondingly, the acquiring picture change information of a current picture frame to be transmitted in the cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting the preset condition as a transition picture frame includes:
acquiring a coding request, determining the picture change frequency of a current picture frame according to the coding request, and if the picture change frequency is greater than a first preset threshold value, judging that the corresponding current picture frame is the transition picture frame.
5. The cloud desktop-based data transmission method of claim 4, wherein the determining the picture change frequency of the current picture frame of the cloud desktop server according to the encoding request comprises:
and determining the picture change frequency of the current picture frame according to the time interval between the coding requests corresponding to the current picture frame and the adjacent picture frame or the quantity of the coding requests in a first preset time period.
6. The cloud desktop-based data transmission method according to claim 2, wherein the screen change information includes a screen change area;
correspondingly, the acquiring picture change information of a current picture frame to be transmitted in the cloud desktop server, and determining the current picture frame corresponding to the picture change information meeting the preset condition as a transition picture frame includes:
and carrying out picture matching on the current picture frame and the historical picture frame to determine the change area ratio of the current picture frame according to the matching result, and if the change area ratio is greater than a second preset threshold value, judging that the corresponding current picture frame is the transition picture frame.
7. The cloud desktop-based data transmission method according to claim 2, wherein the screen change information includes a screen change frequency and a screen change area;
correspondingly, the method further comprises the following steps:
if the picture change frequency meets a preset condition, judging whether the network condition between the current cloud desktop server and the current cloud desktop client is in a congestion state, and if so, judging whether the picture change area meets the preset condition;
if so, determining the corresponding current picture frame as the transition picture frame.
8. The cloud desktop-based data transmission method according to claim 7, wherein the determining whether the network condition between the current cloud desktop server and the cloud desktop client is in a congestion state includes:
and acquiring data packet transmission information through a bottom layer transmission protocol between the cloud desktop server and the cloud desktop client, and judging whether the network condition between the current cloud desktop server and the current cloud desktop client is in a congestion state or not according to the data packet transmission information.
9. The cloud desktop-based data transmission method according to claim 2, wherein after determining a current picture frame corresponding to the picture change information that satisfies the preset condition as a transition picture frame, the method further comprises:
dividing the transition picture frame into a first area and a second area according to the picture content change condition in the transition picture frame; wherein the picture content in the first area changes, and the picture content in the second area does not change;
correspondingly, the compressing the transition picture frame by using a compression mode with a high compression ratio, and transmitting the compressed transition picture frame to a cloud desktop client for display includes:
and performing lossy compression processing on the first area, and transmitting the identification information of the first area and the second area after the lossy compression processing to a cloud desktop client, so that the cloud desktop client can acquire the second area of the local cache according to the identification information and display the received first area and the acquired second area of the local cache.
10. The cloud desktop-based data transmission method according to claim 9, wherein after dividing the transition picture frame into a first region and a second region according to a picture content change condition in the transition picture frame, the method further comprises:
and carrying out lossy compression processing on the non-text part in the first area and carrying out lossless compression processing on the text part in the first area.
11. The cloud desktop-based data transmission method according to any one of claims 2 to 10, wherein after the obtaining of the picture change information of the current picture frame to be transmitted in the cloud desktop server, the method further includes:
determining a current picture frame corresponding to the picture change information which does not meet the preset condition as a non-transition picture frame;
and when the non-transition picture frame is a complete clear frame, compressing the complete clear frame, and transmitting the compressed complete clear frame to a cloud desktop client for display.
12. The cloud desktop-based data transmission method according to claim 11, wherein before the compressing the complete clear frame, the method further comprises:
and if the new coding request is not acquired within a second preset time period, determining the picture frame corresponding to the newly acquired coding request as the complete clear frame.
13. The cloud desktop-based data transmission method of claim 11, further comprising:
and monitoring the complete clear frame, if the complete clear frame is not monitored in a third preset time period, stopping the step of compressing the next transition picture frame, and determining the latest picture frame in the cloud desktop server as the complete clear frame to execute a clear mechanism.
14. A data transmission device based on a cloud desktop is characterized by comprising:
the detection module is used for detecting the current interaction scene and the current network environment to obtain a detection result;
and the adjusting module is used for adjusting the image quality of the current picture frame to be transmitted in the cloud desktop server side if the detection result shows that the current interactive scene is a high-refresh scene and the current network environment is a weak network environment, so that the adjusted current picture frame is transmitted to the cloud desktop client side to be displayed.
15. An electronic device, comprising a processor and a memory; wherein the memory is used for storing a computer program which is loaded and executed by the processor to implement the cloud desktop based data transmission method according to any one of claims 1 to 13.
16. A computer-readable storage medium storing computer-executable instructions which, when loaded and executed by a processor, implement the cloud desktop based data transfer method of any one of claims 1 to 13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210750533.6A CN115150638B (en) | 2022-06-29 | 2022-06-29 | Cloud desktop-based data transmission method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210750533.6A CN115150638B (en) | 2022-06-29 | 2022-06-29 | Cloud desktop-based data transmission method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115150638A true CN115150638A (en) | 2022-10-04 |
| CN115150638B CN115150638B (en) | 2024-07-09 |
Family
ID=83410518
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210750533.6A Active CN115150638B (en) | 2022-06-29 | 2022-06-29 | Cloud desktop-based data transmission method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115150638B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116801034A (en) * | 2023-08-25 | 2023-09-22 | 海马云（天津）信息技术有限公司 | Method and device for storing audio and video data by client |
| CN117237545A (en) * | 2023-11-13 | 2023-12-15 | 武汉泽塔云科技股份有限公司 | Method, system and storage medium for carrying out 3D stereograph based on cloud desktop environment |
| CN117335928A (en) * | 2023-12-01 | 2024-01-02 | 长沙普洛电气设备有限公司 | Engineering data transmission method, system and storage medium |
| CN117591225A (en) * | 2023-12-05 | 2024-02-23 | 太极计算机股份有限公司 | Optimization method and system for rolling dragging window in cloud desktop |
| CN118338065A (en) * | 2024-06-11 | 2024-07-12 | 海马云（天津）信息技术有限公司 | Cloud application picture display dithering optimization method and device |
| WO2024174523A1 (en) * | 2023-02-21 | 2024-08-29 | 华为云计算技术有限公司 | Video processing method and related device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110276653A1 (en) * | 2010-05-10 | 2011-11-10 | Fujitsu Limited | Information processing device, image transmission program, image display program, and image display method |
| CN104394486A (en) * | 2014-11-26 | 2015-03-04 | 中标软件有限公司 | Method and device for processing video stream based on cloud desktop |
| KR20160044732A (en) * | 2014-10-16 | 2016-04-26 | 엔트릭스 주식회사 | System for cloud streaming service, method of cloud streaming service based on still image and apparatus for the same |
| CN108027980A (en) * | 2016-06-30 | 2018-05-11 | 华为技术有限公司 | The method and terminal that picture is shown |
| CN110392098A (en) * | 2019-07-01 | 2019-10-29 | 中国科学院信息工程研究所 | A kind of adaptive virtual desktop transmission method and device |
| CN110401875A (en) * | 2018-04-24 | 2019-11-01 | 深信服科技股份有限公司 | A kind of virtual desktop video pictures method of quality control, system and equipment |
| CN111836075A (en) * | 2019-04-15 | 2020-10-27 | 深信服科技股份有限公司 | Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium |
| CN111836092A (en) * | 2019-04-15 | 2020-10-27 | 深信服科技股份有限公司 | Data processing method and device of virtual desktop and related components |
| CN113747194A (en) * | 2021-03-18 | 2021-12-03 | 上海达龙信息科技有限公司 | Remote video transmission method, transmission device, storage medium and electronic equipment |
| CN113766274A (en) * | 2021-09-23 | 2021-12-07 | 阿里云计算有限公司 | Image encoding method, image decoding method, electronic device, and storage medium |
-
2022
- 2022-06-29 CN CN202210750533.6A patent/CN115150638B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110276653A1 (en) * | 2010-05-10 | 2011-11-10 | Fujitsu Limited | Information processing device, image transmission program, image display program, and image display method |
| KR20160044732A (en) * | 2014-10-16 | 2016-04-26 | 엔트릭스 주식회사 | System for cloud streaming service, method of cloud streaming service based on still image and apparatus for the same |
| CN104394486A (en) * | 2014-11-26 | 2015-03-04 | 中标软件有限公司 | Method and device for processing video stream based on cloud desktop |
| CN108027980A (en) * | 2016-06-30 | 2018-05-11 | 华为技术有限公司 | The method and terminal that picture is shown |
| CN110401875A (en) * | 2018-04-24 | 2019-11-01 | 深信服科技股份有限公司 | A kind of virtual desktop video pictures method of quality control, system and equipment |
| CN111836075A (en) * | 2019-04-15 | 2020-10-27 | 深信服科技股份有限公司 | Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium |
| CN111836092A (en) * | 2019-04-15 | 2020-10-27 | 深信服科技股份有限公司 | Data processing method and device of virtual desktop and related components |
| CN110392098A (en) * | 2019-07-01 | 2019-10-29 | 中国科学院信息工程研究所 | A kind of adaptive virtual desktop transmission method and device |
| CN113747194A (en) * | 2021-03-18 | 2021-12-03 | 上海达龙信息科技有限公司 | Remote video transmission method, transmission device, storage medium and electronic equipment |
| CN113766274A (en) * | 2021-09-23 | 2021-12-07 | 阿里云计算有限公司 | Image encoding method, image decoding method, electronic device, and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 程良;李华;王梦雄;汪斌;: "基于SPICE协议的USB重定向数据压缩方法研究", 昆明理工大学学报(自然科学版), no. 02, 24 April 2018 (2018-04-24) * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024174523A1 (en) * | 2023-02-21 | 2024-08-29 | 华为云计算技术有限公司 | Video processing method and related device |
| CN116801034A (en) * | 2023-08-25 | 2023-09-22 | 海马云（天津）信息技术有限公司 | Method and device for storing audio and video data by client |
| CN116801034B (en) * | 2023-08-25 | 2023-11-03 | 海马云（天津）信息技术有限公司 | Method and device for storing audio and video data by client |
| CN117237545A (en) * | 2023-11-13 | 2023-12-15 | 武汉泽塔云科技股份有限公司 | Method, system and storage medium for carrying out 3D stereograph based on cloud desktop environment |
| CN117237545B (en) * | 2023-11-13 | 2024-02-09 | 武汉泽塔云科技股份有限公司 | Method, system and storage medium for carrying out 3D stereograph based on cloud desktop environment |
| CN117335928A (en) * | 2023-12-01 | 2024-01-02 | 长沙普洛电气设备有限公司 | Engineering data transmission method, system and storage medium |
| CN117335928B (en) * | 2023-12-01 | 2024-01-30 | 长沙普洛电气设备有限公司 | Engineering data transmission method, system and storage medium |
| CN117591225A (en) * | 2023-12-05 | 2024-02-23 | 太极计算机股份有限公司 | Optimization method and system for rolling dragging window in cloud desktop |
| CN117591225B (en) * | 2023-12-05 | 2024-06-11 | 太极计算机股份有限公司 | Optimization method and system for rolling dragging window in cloud desktop |
| CN118338065A (en) * | 2024-06-11 | 2024-07-12 | 海马云（天津）信息技术有限公司 | Cloud application picture display dithering optimization method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115150638B (en) | 2024-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115150638B (en) | Cloud desktop-based data transmission method, device, equipment and storage medium | |
| JP5920006B2 (en) | Screen update control program, screen update control method, and information processing apparatus | |
| US11741292B2 (en) | Adaptive content delivery | |
| US8725947B2 (en) | Cache control for adaptive stream player | |
| US9166881B1 (en) | Methods and apparatus for adaptive bandwidth-based communication management | |
| US10970029B2 (en) | Dynamic user interface and module facilitating content sharing in a distributed computing environment | |
| AU2004305808A1 (en) | Method and apparatus for generating graphical and media displays at a thin client | |
| US9819715B2 (en) | Client side control of adaptive streaming | |
| WO2023151489A1 (en) | Video processing method, apparatus and device, and storage medium | |
| CN115103210B (en) | Information processing method, device, terminal and storage medium | |
| US9307225B2 (en) | Adaptive stereoscopic 3D streaming | |
| CN114389959B (en) | Network congestion control method, device, electronic equipment and storage medium | |
| CN111836092A (en) | Data processing method and device of virtual desktop and related components | |
| US20160155429A1 (en) | Information processing apparatus and terminal device | |
| WO2010110786A1 (en) | Performing remoting operations for different regions of a display surface at different rates | |
| US9626330B2 (en) | Information processing apparatus, and information processing method | |
| EP4038892B1 (en) | Methods, systems, and media for streaming video content using adaptive buffers | |
| CN117591225B (en) | Optimization method and system for rolling dragging window in cloud desktop | |
| KR101473463B1 (en) | System for providing terminal service by providing compressed display information in server based computing system of terminal environment and method thereof | |
| CN117528141A (en) | Video encoding method, video encoding device, electronic device, storage medium, and program product | |
| CN117676225A (en) | Image processing method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |