CN111836075B - Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium - Google Patents
Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN111836075B CN111836075B CN201910299981.7A CN201910299981A CN111836075B CN 111836075 B CN111836075 B CN 111836075B CN 201910299981 A CN201910299981 A CN 201910299981A CN 111836075 B CN111836075 B CN 111836075B
- Authority
- CN
- China
- Prior art keywords
- frame
- interface
- virtual desktop
- image data
- continuous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
Abstract
The application discloses a virtual desktop frame supplementing method, which divides the working state of a virtual desktop into a continuous silent state and a discontinuous silent state in advance, and the common frame with the obvious picture quality problem can be replaced by a new common frame continuously generated in the discontinuous silent state, so that the obvious picture quality problem is difficult to perceive by a user; in a continuous silence state without the generation of new ordinary frames, the apparent picture quality problem in the last ordinary frame, which is unchanged, becomes abnormally significant. Therefore, in consideration of the actual situation in the discontinuous silence state, the present application limits the condition capable of triggering the frame supplement logic to the continuous silence state, and the limited triggering condition enables the picture quality to be better improved with less extra data transmission amount, so that the extra data transmission amount and the picture quality are better balanced. The virtual desktop frame supplementing device, the electronic equipment and the computer readable storage medium have the beneficial effects.
Description
Technical Field
The present disclosure relates to the field of virtual desktops, and in particular, to a method and an apparatus for supplementing a frame on a virtual desktop, an electronic device, and a computer-readable storage medium.
Background
The virtual desktop is a technology supporting enterprise-level realization of remote dynamic access of a desktop system and unified hosting of a data center. Virtual desktop technology allows us to access a desktop system belonging to us individuals in a network through any device, at any time, and at any place. In order to reduce the data transmission amount of the virtual desktop and better utilize the limited bandwidth, a method of combining lossy compression and lossless compression is often adopted in the virtual desktop technology to encode the desktop content.
However, lossy compression also brings a certain degree of picture quality problem while reducing the transmission amount of encoded data, and particularly, a poor video compression algorithm is adopted to obviously reduce the quality of desktop content or cause distortion and other problems, so that a user is often very sensitive to the problems, the use evaluation of the user on a virtual desktop product with the problems is directly reduced, and the product competitiveness is low.
The prior art provides a solution to solve such problems by frame compensation, that is, the occurrence of such problems is reduced by replacing a normal frame, which may have a significant picture quality problem, with an additional frame, but most of the prior art researches on how to generate an additional frame, and the additional frame with higher picture quality inevitably brings a larger amount of additional data transmission, and the additional frame with lower picture quality cannot always solve the problem (because the problem is a picture problem caused by improper use of a lossy compression algorithm).
Therefore, an urgent need exists in the art for a solution to how to achieve a balance between the amount of extra data transmitted and the picture quality by better controlling the timing of transmitting extra frames, so as to improve the picture quality as much as possible without significantly increasing the amount of extra data transmitted.
Disclosure of Invention
The application aims to provide a virtual desktop frame supplementing method, a virtual desktop frame supplementing device, an electronic device and a readable storage medium, and aims to solve the problem of imbalance between extra data transmission quantity and picture quality in the prior art as far as possible by controlling the transmission time of extra frames.
In order to achieve the above object, the present application provides a virtual desktop frame supplementing method, including:
detecting whether an interface of the virtual desktop is in a continuous silent state; the state that the image data of the interface is not changed within a preset time length is the continuous silent state;
when the interface is in the continuous silent state, generating an additional frame according to the latest image data of the interface;
and supplementing the additional frame to a client so that the client replaces the original image data with the image data of the additional frame for display.
Optionally, before generating an additional frame according to the latest image data of the interface, the method further includes:
detecting the picture distortion condition of the last common frame in the continuous silence state to obtain a detection result; wherein the normal frame is a frame distinguished from the additional frame;
and when the picture distortion condition exists in the last common frame according to the detection result, executing the step of generating an additional frame according to the latest image data of the interface.
Optionally, the detecting a picture distortion condition of the last normal frame in the continuous silence state to obtain a detection result includes:
and receiving a detection result obtained by detecting the picture distortion condition of the last common frame in the continuous silence state returned by the client.
Optionally, generating an additional frame according to the latest image data of the interface includes:
compressing the latest image data of the interface by using a first compression algorithm to obtain the additional frame; wherein, the picture quality of the extra frame obtained by the compression by the first compression algorithm is higher than that of the common frame.
Optionally, the virtual desktop frame supplementing method further includes:
and when the interface is detected to jump out of the continuous silent state at any time, initializing the generation operation and/or the complementary sending operation of the additional frame.
In order to achieve the above object, the present application further provides a virtual desktop frame supplementing apparatus, including:
the continuous silent state detection unit is used for detecting whether the interface of the virtual desktop is in a continuous silent state; the state that the image data of the interface is not changed within a preset time length is the continuous silent state;
an additional frame generating unit, configured to generate an additional frame according to the latest image data of the interface when the interface is in the continuous silence state;
and the additional frame reissuing unit is used for reissuing the additional frame to the client so that the client replaces the original image data with the image data of the additional frame for display.
Optionally, the virtual desktop frame supplementing apparatus further includes:
the picture distortion condition detection unit is used for detecting the picture distortion condition of the last common frame in the continuous silent state before generating an additional frame according to the latest image data of the interface to obtain a detection result; wherein the normal frame is a frame distinguished from the additional frame;
and the detection result judging and executing unit is used for executing the step of generating the additional frame according to the latest image data of the interface when the picture distortion condition in the last common frame is determined according to the detection result.
Optionally, the picture distortion condition detecting unit includes:
and the client detection result receiving subunit is used for receiving a detection result which is returned by the client and is obtained after the picture distortion condition of the last common frame in the continuous silence state is detected.
Optionally, the extra frame generating unit includes:
a high-quality additional frame generation subunit, configured to compress the latest image data of the interface by using a first compression algorithm to obtain the additional frame; wherein, the picture quality of the extra frame obtained by the compression by the first compression algorithm is higher than that of the common frame.
Optionally, the virtual desktop frame supplementing apparatus further includes:
and the continuous silent state interrupt processing unit is used for initializing the generation operation and/or the complementary transmission operation of the extra frame when detecting that the interface jumps out of the continuous silent state at any time.
To achieve the above object, the present application also provides an electronic device, including:
a memory for storing a computer program;
and the processor is used for realizing the virtual desktop frame supplementing method when the computer program is executed.
To achieve the above object, the present application further provides a computer-readable storage medium having a computer program stored thereon, where the computer program is executed by a processor to implement the virtual desktop frame supplementing method as described in the above.
According to the technical scheme provided by the application, the working state of the virtual desktop is divided into a continuous silent state and a discontinuous silent state in advance, and the common frame with the obvious picture quality problem is replaced by a new common frame continuously generated in the discontinuous silent state, so that the obvious picture quality problem is difficult to perceive by a user; in a continuous silence state without the generation of new ordinary frames, the apparent picture quality problem in the last ordinary frame, which is unchanged, becomes abnormally significant. Therefore, in consideration of the actual situation in the discontinuous silence state, the present application limits the condition capable of triggering the frame supplement logic to the continuous silence state, and the limited triggering condition enables the picture quality to be better improved with less extra data transmission amount, so that the extra data transmission amount and the picture quality are better balanced. The application also provides a virtual desktop frame supplementing device, electronic equipment and a computer readable storage medium, which have the beneficial effects and are not repeated herein.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a virtual desktop frame supplementing method according to an embodiment of the present application;
fig. 2 is a flowchart of another virtual desktop frame supplementing method according to an embodiment of the present disclosure;
fig. 3 is a block diagram illustrating a structure of a virtual desktop frame supplementing apparatus according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The application aims to provide a virtual desktop frame supplementing method, a virtual desktop frame supplementing device, an electronic device and a readable storage medium, and aims to solve the problem of imbalance between extra data transmission quantity and picture quality in the prior art as far as possible by controlling the transmission time of extra frames.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example one
Referring to fig. 1, fig. 1 is a flowchart of a virtual desktop frame supplementing method according to an embodiment of the present application, which includes the following steps:
s101: detecting whether an interface of the virtual desktop is in a continuous silent state;
the method aims to detect whether a trigger condition for triggering frame supplementing logic is met, namely whether an interface of the virtual desktop is in a continuous silent state.
The continuous silent state is a state in which the silent state is continuous, which means that the silent state has been maintained for a period of time, and the silent state is a state in which the image data of the interface has not changed, in a simple manner, it is detected whether the virtual desktop has no new common frame generated due to no new operation, because no new common frame is generated, which means that the image data currently displayed by the client has been maintained for a certain period of time. It should be noted that the specific time parameter determined as the continuous silence state may be flexibly established according to actual situations, or may be represented by a change of a related parameter capable of representing time, such as a timing period at the same time interval, and the like, and is not limited specifically herein.
As can be seen from the above discussion, if there is an obvious picture quality problem in the last normal frame in the continuous silence state, the picture quality problem will become abnormally obvious because there is no new normal frame to replace the current frame, and therefore, compared with the obvious picture quality problem in the discontinuous silence state with low user perception, the obvious picture quality problem in the continuous silence state is more fatal and important.
Compared with the better effect brought by applying the frame supplementing scheme in the discontinuous silence state, the effect brought by applying the frame supplementing scheme in the continuous silence state is very obvious, and the improvement on the use experience and the satisfaction degree of a user is also obvious. Meanwhile, according to the use rule of the virtual desktop technology, the occupation ratio of the discontinuous silent state is obviously larger than that of the continuous silent state. Therefore, in view of the above points, the application range of the frame complementing scheme is only limited to the continuous silence state, so that the picture quality and the user experience can be obviously improved only by paying less extra data transmission amount, and the large extra data transmission amount caused by a large number of extra frames cannot be significantly increased.
S102: when the interface is in a continuous silent state, generating an additional frame according to the latest image data of the interface;
on the basis of S101, this step is intended to trigger an additional frame generation step in the reissue logic when in a continuous silence state, that is, generate an additional frame according to the latest image data of the interface, specifically, obtain the latest image data on the virtual desktop server interface by taking the canvas, and process the obtained latest image data into the additional frame.
In order to further reduce the sending quantity of extra data on the basis of ensuring the same picture quality improvement effect, whether the last common frame in a continuous silent state has an obvious picture quality problem can be checked, the generation operation of the extra frame is executed when the obvious picture quality problem is determined to exist, and the useless work done when the generation operation of the extra frame is executed when the obvious picture quality problem does not exist is reduced.
Further, the detecting party for detecting whether there is an obvious picture quality problem may be a virtual desktop server issuing each common frame, or may be a virtual desktop client receiving and displaying each common frame, and compared to the server, the client as the detecting party may also include an obvious picture quality problem caused by various unpredictable interference factors in the process of transmitting frame data from the server to the client.
One implementation, including but not limited to, is:
and receiving a detection result obtained after the picture distortion condition of the last common frame in the continuous silence state returned by the client is detected, namely, the client detects the picture distortion condition of the received common frame and returns the detection result to the server, so that the server determines whether an obvious picture quality problem exists according to the received detection result.
Furthermore, the detected picture quality problem can be graded, and the picture quality problem grade which can trigger the frame supplementing logic is correspondingly established, so that under the condition that some picture quality problems which are not obvious exist are filtered, the extra data sending quantity is further reduced.
In order to reduce the sending amount of extra data as much as possible and prevent the extra frame generated here from still having obvious picture quality problems, a lossy compression algorithm which is better than the lossy compression algorithm used in the compression processing of the ordinary frame can be used, even a lossless compression algorithm which does not cause image information loss can be used, and the lossless image data obtained by using the lossless compression algorithm is used as the extra frame.
S103: and supplementing the additional frame to the client so that the client replaces the original image data with the image data of the additional frame for displaying.
On the basis of S102, this step is intended to complement the generated additional frame to the virtual desktop client, so that the client receiving the additional frame replaces the ordinary frame which may have a significant picture quality problem previously with the image data of the additional frame.
Further, when it is detected that the interface jumps out of the continuous silence state at any time, the generation operation and/or the reissue operation of the additional frame is initialized, the generation operation and/or the reissue operation of the additional frame is stopped and no longer executed, and the execution process is cleared, because the jumping out of the continuous silence state indicates that a new normal frame is to be generated, and the client receives the new normal frame, the previously worried problem also does not exist along with the jumping out of the continuous silence state, because the replacement by using the additional frame or the new normal frame is the same in the aspect of eliminating the obvious picture quality problem, and compared with the additional frame, the new normal frame with practical significance has obvious higher priority. In short, any step before the client actually starts to replace the original image data with the image data of the additional frame for display is terminated because the continuous silence state is skipped, and the judgment and execution of the frame complementing logic is terminated until the client is in the continuous silence state again, and the judgment is restarted.
Meanwhile, once the one-time additional frame sending operation is normally finished, the execution interval of the two-time additional frame sending operation can be set so as to reduce the sending amount of the additional data as much as possible. The duration of the execution interval may be set according to actual conditions, and is not specifically limited herein.
In general, if a new picture is updated in the frame supplementing process provided by the application and frame supplementing is interrupted, normally executed frame supplementing logic is terminated, and frame supplementing logic does not need to be triggered again in a short time after one frame supplementing is completed, so that the data volume which is unnecessarily transmitted is reduced.
According to the technical scheme provided by the embodiment, the working state of the virtual desktop is divided into a continuous silent state and a discontinuous silent state in advance, and the common frame with the obvious picture quality problem is replaced by a new common frame continuously generated in the discontinuous silent state, so that the obvious picture quality problem is difficult to perceive by a user; in a continuous silence state without the generation of new ordinary frames, the apparent picture quality problem in the last ordinary frame, which is not changed, becomes abnormally significant. Therefore, in consideration of the actual situation in the discontinuous silence state, the present application limits the condition capable of triggering the frame supplement logic to the continuous silence state, and the limited triggering condition enables the picture quality to be better improved with less extra data transmission amount, so that the extra data transmission amount and the picture quality are better balanced.
Example two
Referring to fig. 2, fig. 2 is a flowchart of another virtual desktop frame supplementing method provided in an embodiment of the present application, and different from the first embodiment, the present embodiment provides a virtual desktop frame supplementing method that takes into account a picture distortion condition in detecting whether there is a last normal frame, so that a trigger condition of a frame supplementing logic is further reduced, and an extra data transmission amount for transmission is further reduced, including the following steps:
s201: detecting whether an interface of the virtual desktop is in a continuous silent state;
the step is the same as S101, and for a detailed explanation, reference may be made to S101, which is not described herein again.
S202: acquiring image data of the last common frame in a continuous silent state;
the step is established on the basis that the judgment result of the step S201 is that the interface is in the continuous silent state, and aims to acquire the image data of the last common frame in the continuous silent state for the subsequent detection and judgment step of the picture distortion condition;
s203: judging whether the last common frame has picture distortion or not according to the image data;
on the basis of S202, this step is intended to determine whether there is a picture distortion condition in the last normal frame according to the image data, wherein if the method for specifically determining whether there is a picture distortion condition in one frame of image data is not the invention point of this application, and there are many mature implementation manners in this field, and detailed explanation is not provided herein.
S204: generating an additional frame according to the latest image data of the interface;
this step is based on the determination result of S203 being that there is a picture distortion condition in the last normal frame, which indicates that the trigger condition of the frame supplement logic is satisfied, so the first operation of the frame supplement logic, that is, the generation operation of the additional frame, will be executed.
S205: the extra frame is sent to the client side, so that the client side replaces the original image data with the image data of the extra frame for display;
this step exists as another operation after the generation operation of the extra frame in the frame complementing logic, i.e., a complementary operation of the extra frame.
S206: the frame fill logic is not triggered.
This step is based on the fact that the determination result of S201 is that the interface is in the discontinuous silence state or the determination result of S203 is that there is no picture distortion in the last normal frame, which indicates that the trigger condition of the frame supplement logic is not satisfied, and therefore the frame supplement logic will not be triggered.
Because the situation is complicated and cannot be illustrated by a list, a person skilled in the art can realize that many examples exist according to the basic method principle provided by the application and the practical situation, and the protection scope of the application should be protected without enough inventive work.
EXAMPLE III
Referring to fig. 3, fig. 3 is a block diagram illustrating a structure of a virtual desktop frame supplementing apparatus according to an embodiment of the present disclosure, where the apparatus may include:
a continuous silent state detection unit 100, configured to detect whether an interface of the virtual desktop is in a continuous silent state; the state that the image data of the interface does not change within the preset time length is a continuous silent state;
an extra frame generating unit 200 for generating an extra frame according to the latest image data of the interface when in a continuous silent state;
the extra frame reissuing unit 300 is configured to reissue the extra frame to the client, so that the client replaces the original image data with the image data of the extra frame for display.
Further, the virtual desktop frame supplementing device may further include:
the picture distortion condition detection unit is used for detecting the picture distortion condition of the last common frame in a continuous silent state before generating an additional frame according to the latest image data of the interface to obtain a detection result; wherein the normal frame is a frame distinguished from the extra frame;
and the detection result judging and executing unit is used for executing the step of generating the additional frame according to the latest image data of the interface when the picture distortion condition exists in the last common frame according to the detection result.
Wherein, the picture distortion condition detecting unit may include:
and the client detection result receiving subunit is used for receiving a detection result obtained by detecting the picture distortion condition of the last common frame in the continuous silence state, which is returned by the client.
Wherein the additional frame generating unit 300 may include:
the high-quality additional frame generating subunit is used for compressing the latest image data of the interface by using a first compression algorithm to obtain an additional frame; wherein, the picture quality of the extra frame compressed by the first compression algorithm is higher than that of the ordinary frame.
Further, the virtual desktop frame complementing device may further include:
and the continuous silent state interrupt processing unit is used for initializing the generation operation and/or the complementary transmission operation of the extra frame when detecting that the interface jumps out of the continuous silent state at any time.
The present embodiment corresponds to the method embodiment described above, and exists as an apparatus embodiment, wherein the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be described in detail here.
Fig. 4 is a block diagram illustrating an electronic device 400 according to an example embodiment. As shown in fig. 4, the electronic device 400 may include a processor 401 and a memory 402, and may further include one or more of a multimedia component 403, an information input/information output (I/O) interface 404, and a communication component 405.
The processor 401 is configured to control the overall operation of the electronic device 400, so as to complete part or all of the steps in the virtual desktop frame supplementing method; the memory 402 is used to store various types of data to support the various steps operations that the processor 401 needs to perform, such data may include, for example, instructions for any application or method operating on the electronic device 400, as well as application-related data, such as state data for determining state, timing data, image data, and so forth. The Memory 402 may be implemented by any type or combination of volatile and non-volatile Memory devices, such as one or more of Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic or optical disk.
The multimedia components 403 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 402 or transmitted through the communication component 405. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 404 provides an interface between the processor 401 and other interface modules, such as a keyboard, mouse, etc. The communication component 405 is used for wired or wireless communication between the electronic device 400 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC for short), 2G, 3G or 4G, or a combination of one or more of them, and thus the corresponding Communication component 405 may include: Wi-Fi module, bluetooth module, NFC module.
In an exemplary embodiment, the electronic Device 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the malicious sample increment method of the above embodiments.
Preferably, the electronic device 400 may be a virtual desktop server to which the technical solution of the present application is applied.
In another exemplary embodiment, a computer-readable storage medium storing program instructions to implement operations corresponding to the program instructions when executed by a processor is also provided. For example, the computer readable storage medium may be the memory 402 including program instructions, which are embodied in a manner that when executed by the processor 401 of the electronic device 400, the malicious sample increment method provided by the above embodiments is completed.
The principle and the implementation of the present application are described herein by applying specific examples, and in order to make the various embodiments have a progressive relationship, each embodiment focuses on the differences from the other embodiments, and the same and similar parts among the various embodiments may be referred to each other. For the apparatus disclosed in the embodiments, reference is made to the corresponding method section. The above description of the embodiments is only intended to help understand the method of the present application and its core ideas. It will be apparent to those skilled in the art that various changes and modifications can be made in the present invention without departing from the principles of the invention, and these changes and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A virtual desktop frame supplementing method is characterized by comprising the following steps:
detecting whether an interface of the virtual desktop is in a continuous silent state; the state that the image data of the interface is not changed within a preset time length is the continuous silent state;
when the interface is in the continuous silent state, generating an additional frame according to the latest image data of the interface;
the additional frame is sent to a client side, so that the client side replaces original image data with the image data of the additional frame for display;
wherein, before generating an additional frame according to the latest image data of the interface, the method further comprises:
detecting the picture distortion condition of the last common frame in the continuous silent state to obtain a detection result; wherein the normal frame is a frame distinguished from the additional frame;
and when the picture distortion condition exists in the last common frame according to the detection result, executing the step of generating an additional frame according to the latest image data of the interface.
2. The method according to claim 1, wherein detecting a picture distortion of a last normal frame in the continuous silence state to obtain a detection result comprises:
and receiving a detection result obtained by detecting the picture distortion condition of the last common frame in the continuous silence state returned by the client.
3. The virtual desktop frame supplementing method of claim 1, wherein generating additional frames from the latest image data of the interface comprises:
compressing the latest image data of the interface by using a first compression algorithm to obtain the additional frame; wherein, the picture quality of the extra frame obtained by the compression by the first compression algorithm is higher than that of the common frame.
4. The virtual desktop frame supplementing method according to any one of claims 1 to 3, further comprising:
and when the interface is detected to jump out of the continuous silent state at any time, initializing the generation operation and/or the complementary sending operation of the additional frame.
5. A virtual desktop frame supplementing device is characterized by comprising:
the continuous silent state detection unit is used for detecting whether the interface of the virtual desktop is in a continuous silent state; the state that the image data of the interface is not changed within a preset time length is the continuous silent state;
an additional frame generating unit, configured to generate an additional frame according to the latest image data of the interface when the interface is in the continuous silence state;
an additional frame reissuing unit, configured to reissue the additional frame to a client, so that the client replaces original image data with image data of the additional frame for display;
the virtual desktop frame supplementing device further comprises:
the picture distortion condition detection unit is used for detecting the picture distortion condition of the last common frame in the continuous silent state before generating an additional frame according to the latest image data of the interface to obtain a detection result; wherein the normal frame is a frame distinguished from the additional frame;
and the detection result judging and executing unit is used for executing the step of generating the additional frame according to the latest image data of the interface when the picture distortion condition exists in the last common frame according to the detection result.
6. The virtual desktop frame complementing apparatus of claim 5, wherein the picture distortion condition detecting unit comprises:
and the client detection result receiving subunit is used for receiving a detection result obtained after the detection of the picture distortion condition of the last common frame in the continuous silence state is returned by the client.
7. The virtual desktop frame supplementing apparatus according to claim 5, wherein the additional frame generating unit includes:
a high-quality additional frame generation subunit, configured to compress the latest image data of the interface by using a first compression algorithm to obtain the additional frame; wherein, the picture quality of the extra frame obtained by the compression by the first compression algorithm is higher than that of the common frame.
8. The virtual desktop frame complementing device of any one of claims 5 to 7, further comprising:
and the continuous silent state interrupt processing unit is used for initializing the generation operation and/or the sending-back operation of the extra frame when detecting that the interface jumps out of the continuous silent state at any time.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the virtual desktop frame supplementing method of any one of claims 1 to 4 when executing the computer program.
10. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements the virtual desktop frame supplementing method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910299981.7A CN111836075B (en) | 2019-04-15 | 2019-04-15 | Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910299981.7A CN111836075B (en) | 2019-04-15 | 2019-04-15 | Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111836075A CN111836075A (en) | 2020-10-27 |
| CN111836075B true CN111836075B (en) | 2022-09-30 |
Family
ID=72914660
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910299981.7A Active CN111836075B (en) | 2019-04-15 | 2019-04-15 | Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111836075B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115150638A (en) * | 2022-06-29 | 2022-10-04 | 深信服科技股份有限公司 | Data transmission method, device, equipment and storage medium based on cloud desktop |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901612A (en) * | 2005-10-28 | 2007-01-24 | 南京Lg同创彩色显示系统有限责任公司 | Image processing device and method for image display device |
| JP2007241736A (en) * | 2006-03-09 | 2007-09-20 | Victor Co Of Japan Ltd | Server device and client device for remote desktop system |
| CN101615374A (en) * | 2009-07-15 | 2009-12-30 | 广东威创视讯科技股份有限公司 | A kind of tableaux device and its implementation of demonstration time controlled |
| CN101883281A (en) * | 2010-06-13 | 2010-11-10 | 北京北大众志微系统科技有限责任公司 | Static image coding method and system for remote display system |
| CN105681791A (en) * | 2016-01-18 | 2016-06-15 | 武汉理工大学 | Self-adaptive remote desktop transmission method and system |
-
2019
- 2019-04-15 CN CN201910299981.7A patent/CN111836075B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901612A (en) * | 2005-10-28 | 2007-01-24 | 南京Lg同创彩色显示系统有限责任公司 | Image processing device and method for image display device |
| JP2007241736A (en) * | 2006-03-09 | 2007-09-20 | Victor Co Of Japan Ltd | Server device and client device for remote desktop system |
| CN101615374A (en) * | 2009-07-15 | 2009-12-30 | 广东威创视讯科技股份有限公司 | A kind of tableaux device and its implementation of demonstration time controlled |
| CN101883281A (en) * | 2010-06-13 | 2010-11-10 | 北京北大众志微系统科技有限责任公司 | Static image coding method and system for remote display system |
| CN105681791A (en) * | 2016-01-18 | 2016-06-15 | 武汉理工大学 | Self-adaptive remote desktop transmission method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111836075A (en) | 2020-10-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3866477A1 (en) | Video processing method and apparatus, electronic device, and computer-readable medium | |
| US10958615B2 (en) | Communication message consolidation with content difference formatting | |
| CN107682752B (en) | Method, device and system for displaying video picture, terminal equipment and storage medium | |
| US11074394B2 (en) | Adaptive content delivery | |
| CN107483401B (en) | Multimedia data transmission method and equipment, storage medium and server thereof | |
| CN113438355A (en) | Communication method, device, equipment and storage medium based on cloud mobile phone | |
| CN111836075B (en) | Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium | |
| CN110889074B (en) | Page display method and device, storage medium and electronic equipment | |
| CN104615432B (en) | Splash screen information processing method and client | |
| CN105337926B (en) | Multi-terminal linkage method and related equipment and system | |
| CN109618198A (en) | Live content reports method and device, storage medium, electronic equipment | |
| CN104836878A (en) | Method, device and system for outputting prompt in communication process | |
| CN116866658A (en) | Video data processing method, device, equipment and medium | |
| CN114095762A (en) | Data transmission method and device, computer equipment and computer readable storage medium | |
| CN115563156A (en) | Method, device and equipment for checking stream data information and storage medium | |
| CN107729136B (en) | Processing priority configuration method and device based on FPGA | |
| CN114153542A (en) | Screen projection method and device, electronic equipment and computer readable storage medium | |
| CN108563485B (en) | Input panel display method and device | |
| CN113066140A (en) | Image encoding method, image encoding device, computer device, and storage medium | |
| CN113064620A (en) | Method and device for processing system data | |
| CN113760417A (en) | Page countdown display method and device | |
| CN111796958A (en) | Transaction anti-hanging method and device under Dubbo frame | |
| CN111459258A (en) | Power consumption management method and device, electronic equipment and medium | |
| CN106790428B (en) | Data transmission method and device | |
| US20140375748A1 (en) | Electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |