CN114095762A - Data transmission method and device, computer equipment and computer readable storage medium - Google Patents
Data transmission method and device, computer equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN114095762A CN114095762A CN202111393206.1A CN202111393206A CN114095762A CN 114095762 A CN114095762 A CN 114095762A CN 202111393206 A CN202111393206 A CN 202111393206A CN 114095762 A CN114095762 A CN 114095762A
- Authority
- CN
- China
- Prior art keywords
- image frame
- data
- preset
- client device
- storage space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
- H04N21/4586—Content update operation triggered locally, e.g. by comparing the version of software modules in a DVB carousel to the version stored locally
Abstract
The invention discloses a data transmission method, a data transmission device, computer equipment and a computer readable storage medium, wherein the method comprises the following steps: the server-side equipment responds to an operation instruction triggered by a user in a cloud desktop application window of the client-side equipment to obtain current display data, namely the data of the current display content of the cloud desktop application window updated by the client-side equipment; obtaining a corresponding image frame according to the current display data, namely rendering the current display data to obtain an image, and storing the image frame in a preset storage space, such as a memory or a cache; and sending the latest image frame with the shortest storage time in the memory or the cache to the client equipment. Based on the method, the data volume sent to the client device by the client device is reduced, and the condition that the current display data needs to be sent to the client device in real time by the server device, so that the cloud desktop application occupies more bandwidth resources is improved.
Description
Technical Field
The present invention relates to the field of data transmission, and in particular, to a data transmission method, apparatus, computer device, and computer-readable storage medium.
Background
When a user uses a cloud desktop application implemented based on SPICE (Simple Protocol for Independent Computing Environment) through a client device, a server device needs to continuously send a large amount of data to the client device to ensure that the cloud desktop application can respond to the user in time. In other words, the cloud desktop application will occupy more bandwidth resources.
Therefore, when the cloud desktop application and other application software needing bandwidth resources run together, the use of the cloud desktop application or other application software by a user can be influenced.
Disclosure of Invention
In view of this, embodiments of the present invention provide a data transmission method, an apparatus, a computer device, and a computer readable storage medium, so as to improve a current situation that a cloud desktop application needs to occupy more bandwidth resources.
In a first aspect, an embodiment of the present invention provides a data transmission method, which is applied to a server device, and includes:
receiving an operation instruction triggered by a user in a cloud desktop application window of client equipment;
executing the operation instruction to obtain current display data;
obtaining a corresponding image frame according to the current display data, and storing the image frame in a preset storage space;
and sending the image frame with the shortest storage time in the preset storage space to the client device so as to enable the cloud desktop application window to display the image frame.
Optionally, in an implementation manner provided by the embodiment of the present invention, the sending, to the client device, the image frame with the shortest storage time in the preset storage space includes:
converting the image frame with the shortest storage time in the preset storage space into corresponding h264 data based on an h264 coding technology;
and sending the h264 data to the client device, so that after the client device decodes the h264 data, the cloud desktop application window is controlled to display an image frame corresponding to the h264 data.
Optionally, in an implementation manner provided by the embodiment of the present invention, the sending, to the client device, the image frame with the shortest storage time in the preset storage space includes:
and selecting the image frame with the shortest storage time from the preset storage space at intervals of preset time, and sending the image frame with the shortest storage time to the client equipment.
Further, in an implementable manner provided by the embodiment of the present invention, the selecting, from the preset storage space, the image frame with the shortest storage time at preset time intervals, and sending the image frame with the shortest storage time to the client device includes:
sequentially writing a preset number of image frames in the preset storage space into a buffer queue;
and sending the image frame corresponding to the tail of the buffer queue to the client device based on a preset time interval.
Further, in an implementation manner provided by the embodiment of the present invention, the method further includes:
counting all the operation instructions received within a preset time length, and determining the change trend of the operation frequency;
when the operating frequency variation trend is increasing, decreasing the preset time interval.
In a second aspect, an embodiment of the present invention provides a data transmission apparatus, which is applied to a server device, and includes:
the receiving module is used for receiving an operation instruction triggered by a user in a cloud desktop application window of the client device;
the execution module is used for executing the operation instruction to obtain current display data;
the storage module is used for obtaining a corresponding image frame according to the current display data and storing the image frame into a preset storage space;
and the transmission module is used for sending the image frame with the shortest storage time in the preset storage space to the client equipment so as to enable the cloud desktop application window to display the image frame.
Optionally, in an implementable manner provided by the embodiment of the present invention, the transmission module includes:
the encoding submodule is used for converting the image frame with the shortest storage time in the preset storage space into corresponding h264 data based on an h264 encoding technology;
and the sending submodule is used for sending the h264 data to the client equipment so as to control the cloud desktop application window to display the image frame corresponding to the h264 data after the client equipment decodes the h264 data.
Optionally, in an implementation manner provided by the embodiment of the present invention, the transmission module is further configured to select, at intervals of a preset time, an image frame with a shortest storage time from the preset storage space, and send the image frame with the shortest storage time to the client device.
In a third aspect, an embodiment of the present invention provides a computer device, including a memory and a processor, where the memory stores a computer program, and the computer program, when running on the processor, executes the data transmission method disclosed in any one of the first aspects.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when running on a processor, executes the data transmission method disclosed in any one of the first aspects.
According to the data transmission method provided by the embodiment of the invention, the server-side equipment receives an operation instruction triggered by a user in a cloud desktop application window of the client-side equipment, such as sliding of a mouse cursor or double-clicking of an application program icon by a mouse; executing the operation instruction to obtain current display data, namely the data of the current display content of the cloud desktop application window updated by the client device; obtaining a corresponding image frame according to the current display data, namely rendering the current display data to obtain an image, and storing the image frame in a preset storage space, such as a memory or a cache; and sending the latest image frame with the shortest storage time in the memory or the cache to the client device so as to enable the cloud desktop application window to display the image frame.
Based on this, after the server device receives the operation instruction to generate the corresponding current display data, only the image frame corresponding to the current display data is stored for the shortest time, namely the latest image frame is sent to the client device, so that the data volume sent to the client device by the client device is reduced, and the condition that the server device needs to send the current display data to the client device in real time in the prior art, and the cloud desktop application occupies more bandwidth resources is improved; moreover, because the server device sends the rendered image, that is, the image frame obtained through the current display data, the computer resources required by the client device to load and render the current display data sent by the server device are avoided, and the load of the client device is further reduced.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings required to be used in the embodiments will be briefly described below, and it should be understood that the following drawings only illustrate some embodiments of the present invention, and therefore should not be considered as limiting the scope of the present invention. Like components are numbered similarly in the various figures.
Fig. 1 is a schematic flow chart illustrating a first data transmission method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a second data transmission method according to an embodiment of the present invention;
fig. 3 is a schematic flow chart illustrating a third data transmission method according to an embodiment of the present invention;
fig. 4 shows a schematic structural diagram of a data transmission apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
Hereinafter, the terms "including", "having", and their derivatives, which may be used in various embodiments of the present invention, are only intended to indicate specific features, numbers, steps, operations, elements, components, or combinations of the foregoing, and should not be construed as first excluding the existence of, or adding to, one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the present invention belong. The terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning that is consistent with their contextual meaning in the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in various embodiments of the present invention.
Fig. 1 and fig. 1 show a schematic flow chart of a first data transmission method provided in an embodiment of the present invention, where the data transmission method provided in the embodiment of the present invention is applied to a server device, and the method includes:
s110, receiving an operation instruction triggered by a user in a cloud desktop application window of the client device.
It can be understood that the embodiment of the present invention is applied to a Server in a C/S (Client-Server) architecture, and is configured to respond to each request sent by a Client device and perform a corresponding data response.
It can also be understood that the specific process of the user triggering the operation instruction may include: the user double clicks an application in the cloud desktop application window through an input device of the client device, such as a mouse, or moves a mouse cursor in the cloud desktop application window, that is, the mouse cursor is regarded as an operation instruction triggered by the user. It should be noted that, in the embodiment of the present invention, it is not limited that the user can only trigger the operation instruction when the cloud desktop application window is displayed, and any operation triggered by the user, which requires the server device to update the cloud desktop application window in the client device through the cloud, is regarded as the operation instruction mentioned in the embodiment of the present invention.
And S120, executing the operation instruction to obtain the current display data.
That is, the server device responds to the operation instruction sent by the client device, and correspondingly changes the current display screen of the desktop of the server device. It should be noted that the current display image of the desktop of the server device can be obtained by rendering the current display data.
And S130, obtaining a corresponding image frame according to the current display data, and storing the image frame into a preset storage space.
It can be understood that, when the client device needs to change the display content of the desktop, the server device sends the current display data to the client device; and the client equipment performs loading rendering according to the current display data to obtain a corresponding image and displays the image in the cloud desktop application window so as to update the picture displayed by the cloud desktop application window.
However, in the update mode of the cloud desktop application window, the server device needs to transmit the current display data to the client device in real time, so as to ensure the image update of the cloud desktop application window of the client device. The transmission of the current display data occupies more bandwidth, so that the use of other application programs requiring occupied bandwidth by users is inevitably influenced.
Based on this, the embodiment of the present invention optimizes the process of "the server device sends the current display data to the client device", so that the server device renders the current display data that needs to be sent to the client device first to obtain the corresponding current display content, that is, the corresponding at least one frame of image frame, and stores the image frame corresponding to the current display data in a preset storage space, such as a memory or a cache of a computer.
In other words, the embodiment of the present invention does not send the obtained current display data to the client device in real time, but renders the current display data into an image in advance and stores the image, so as to send the current display data to the client device in the form of an image frame at a suitable time.
And S140, sending the image frame with the shortest storage time in the preset storage space to the client device so that the image frame is displayed on the cloud desktop application window.
That is, the server device continuously obtains the shortest storage time from the memory or the cache of the computer, that is, the latest image frame is sent to the client device, so that the cloud desktop application window of the client device performs loading rendering according to the latest image frame.
Based on this, after the server device receives the operation instruction to generate the corresponding current display data, only the image frame with the shortest storage time in the image frames corresponding to the current display data is sent to the client device, so that the data volume sent to the client device by the client device is reduced, and the condition that the server device needs to send the current display data to the client device in real time in the prior art, and the cloud desktop application occupies more bandwidth resources is improved; moreover, because the server-side equipment sends the rendered image frames, computer resources required by the client-side equipment for loading and rendering the current display data sent by the server-side equipment are avoided, and further the load of the local equipment is reduced.
Optionally, referring to fig. 2, fig. 2 shows a flowchart of a second data transmission method provided in the embodiment of the present invention, that is, in an implementation manner provided in the embodiment of the present invention, S140 includes:
s141, converting the image frame with the shortest storage time in the preset storage space into corresponding h264 data based on an h264 coding technology;
s142, sending the h264 data to the client device, so that after the client device decodes the h264 data, the cloud desktop application window is controlled to display the image frame corresponding to the h264 data.
That is, the embodiment of the present invention converts the image frame that needs to be sent to the client device into h264 data for transmission; the client device decodes the received h264 to obtain a corresponding image frame, and then display content updating of the cloud desktop application window is completed.
Compared with other compression modes, the data volume obtained by adopting the h264 technology under the same image quality is smaller, so that the bandwidth resource required by image frame transmission can be effectively reduced; in addition, the coding tool corresponding to the h264 standard can solve errors such as packet loss and the like which easily occur in an unstable network environment, and normal rendering of the cloud desktop application window of the client device under an abnormal network condition is ensured.
Optionally, referring to fig. 3, fig. 3 is a flowchart illustrating a third data transmission method according to an embodiment of the present invention, that is, in an implementation manner provided in the embodiment of the present invention, in an optional manner, S140 includes:
and S143, selecting the image frame with the shortest storage time from the preset storage space at intervals of preset time, and sending the image frame with the shortest storage time to the client device.
That is, in this real-time manner, the server device sends a frame of image frame to the client device at preset time intervals. It will be appreciated that the predetermined time interval may be selected and set according to the actual circumstances, such as 1/30 seconds in one possible manner; in another mode, the preset time interval is 1/60 seconds.
It can also be understood that the preset time interval should not be set too small, otherwise, the image frames received by the client device are too many, and the screen is lost; the preset time interval should not be set too large, so that the user may find the unsmooth operation due to the fact that the client device is updated slowly and rarely.
Based on the setting of the preset actual interval, the embodiment of the invention avoids the situation that the user feels that the operation is delayed due to too few displayed image frames of the client device while ensuring that the screen is not lost due to too many processed image frames of the client device, namely, the data transmission quantity is reduced, the user experience is ensured, and the load of the client device is reduced.
Further, S143 includes:
sequentially writing a preset number of image frames in the preset storage space into a buffer queue;
and sending the image frame corresponding to the tail of the buffer queue to the client device based on a preset time interval.
That is, in this embodiment, the embodiment of the present invention extracts a preset number of image frames from all the image frames stored in the computer memory or the buffer memory in order of the storage time, and writes the values into the buffer queue, so as to transmit the image frame at the end of the buffer queue, i.e., the latest image frame, to the client device after a preset time interval, e.g., 1/30 seconds.
It is to be understood that the buffer queue mentioned in the embodiments of the present invention is used for storing a preset number of image frames.
And after the server-side equipment writes the image frames of the preset number newly stored in the preset storage space into the buffer queue, the server-side equipment deletes the old image frames in the buffer queue and continuously sends the newly written image frames to the client-side equipment.
It will also be appreciated that the predetermined number may be set according to practical circumstances, and the embodiment of the present invention does not additionally limit the number of image frames written into the buffer queue.
Therefore, the embodiment of the invention is based on the cache queue, and further ensures that the screen-splash phenomenon caused by processing excessive image frames of the client equipment is avoided, and the condition that the user feels that the operation is delayed because the image frames displayed by the client equipment are too few is avoided.
Furthermore, in an implementation manner provided by the embodiment of the present invention, the method further includes:
counting all the operation instructions received within a preset time length, and determining the change trend of the operation frequency;
when the operating frequency variation trend is increasing, decreasing the preset time interval.
That is, the server device counts the change condition of the user operation frequency, that is, the operation frequency change trend, according to the number of the operation instructions triggered by the user within the preset time duration, if the number of the operation instructions triggered by the user within one minute is gradually increased, that is, the operation frequency change trend is increased, the server device considers that the user is handling some events needing quick response, and further reduces the preset time interval to increase the rate of the sent image frames, so that the update rate of the window of the cloud desktop application of the client device is increased.
It should be noted that the reduction amount of the preset time interval may be set according to actual situations, and the embodiment of the present invention does not limit this.
In addition, it can be understood that when the operation frequency variation trend is unchanged or reduced, the server device may not change the preset time interval, so as to ensure that the cloud desktop application window of the client device can be updated in real time.
It can also be understood that, when the operating frequency trend is decreasing, the server device may also increase the preset time interval to decrease the load of the client device and the server device.
It should be further noted that, when the trend of the operating frequency is constant or decreasing, the amount of change of the preset time interval may be set according to actual situations, and the embodiment of the present invention is not limited.
Corresponding to the data transmission method provided by the embodiment of the present invention, an embodiment of the present invention further provides a data transmission device, referring to fig. 4, and fig. 4 shows a schematic structural diagram of the data transmission device provided by the embodiment of the present invention, where the data transmission device provided by the embodiment of the present invention is applied to a server device 200, and the device includes:
the receiving module 210 is configured to receive an operation instruction triggered by a user in a cloud desktop application window of a client device;
the execution module 220 is configured to execute the operation instruction to obtain current display data;
a storage module 230, configured to obtain a corresponding image frame according to the current display data, and store the image frame in a preset storage space;
a transmission module 240, configured to send the image frame with the shortest storage time in the preset storage space to the client device, so that the cloud desktop application window displays the image frame.
The data transmission device provided in the embodiment of the present application can implement each process of the data transmission method in the method embodiment of fig. 1, and can achieve the same technical effect, and is not described here again to avoid repetition.
Optionally, in an implementation manner provided in the embodiment of the present invention, the transmission module 240 includes:
the encoding submodule is used for converting the image frame with the shortest storage time in the preset storage space into corresponding h264 data based on an h264 encoding technology;
and the sending submodule is used for sending the h264 data to the client equipment so as to control the cloud desktop application window to display the image frame corresponding to the h264 data after the client equipment decodes the h264 data.
Further, in an implementation manner provided by the embodiment of the present invention, the transmission module is further configured to select, every preset time interval, an image frame with a shortest storage time from the preset storage space, and send the image frame with the shortest storage time to the client device.
Further, in an implementation manner provided by the embodiment of the present invention, the transmission module includes:
the writing sub-module is used for sequentially writing the preset number of image frames in the preset storage space into a buffer queue;
and the transmission submodule is used for transmitting the image frame corresponding to the tail of the buffer queue to the client equipment based on a preset time interval.
Furthermore, in an implementation manner provided by the embodiment of the present invention, the method further includes:
the statistical module is used for counting all the operation instructions received in a preset time length and determining the change trend of the operation frequency;
and the interval reducing module is used for reducing the preset time interval when the operation frequency variation trend is increased.
The embodiment of the invention also provides computer equipment, which comprises a memory and a processor, wherein the memory stores a computer program, and the computer program executes the data transmission method disclosed in the embodiment when running on the processor.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed on a processor, performs the data transmission method disclosed in the embodiment.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative and, for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, each functional module or unit in each embodiment of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part of the technical solution that contributes to the prior art in essence can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a smart phone, a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present invention, and shall cover the scope of the present invention.
Claims (10)
1. A data transmission method is applied to a server device and comprises the following steps:
receiving an operation instruction triggered by a user in a cloud desktop application window of client equipment;
executing the operation instruction to obtain current display data;
obtaining a corresponding image frame according to the current display data, and storing the image frame in a preset storage space;
and sending the image frame with the shortest storage time in the preset storage space to the client device so as to enable the cloud desktop application window to display the image frame.
2. The method according to claim 1, wherein the sending the image frame stored in the preset storage space for the shortest time to the client device comprises:
converting the image frame with the shortest storage time in the preset storage space into corresponding h264 data based on an h264 coding technology;
and sending the h264 data to the client device, so that after the client device decodes the h264 data, the cloud desktop application window is controlled to display an image frame corresponding to the h264 data.
3. The method according to claim 1, wherein the sending the image frame with the shortest storage time in the preset storage space to the client device comprises:
and selecting the image frame with the shortest storage time from the preset storage space at intervals of preset time, and sending the image frame with the shortest storage time to the client equipment.
4. The method according to claim 3, wherein the selecting, from the preset storage space, the image frame with the shortest storage time at every preset time interval and sending the image frame with the shortest storage time to the client device includes:
sequentially writing a preset number of image frames in the preset storage space into a buffer queue;
and sending the image frame corresponding to the tail of the buffer queue to the client device based on a preset time interval.
5. The method of claim 3, further comprising:
counting all the operation instructions received within a preset time length, and determining the change trend of the operation frequency;
when the operating frequency variation trend is increasing, decreasing the preset time interval.
6. A data transmission device is applied to a server device, and comprises:
the receiving module is used for receiving an operation instruction triggered by a user in a cloud desktop application window of the client device;
the execution module is used for executing the operation instruction to obtain current display data;
the storage module is used for obtaining a corresponding image frame according to the current display data and storing the image frame into a preset storage space;
and the transmission module is used for sending the image frame with the shortest storage time in the preset storage space to the client equipment so as to enable the cloud desktop application window to display the image frame.
7. The apparatus of claim 6, wherein the transmission module comprises:
the encoding submodule is used for converting the image frame with the shortest storage time in the preset storage space into corresponding h264 data based on an h264 encoding technology;
and the sending submodule is used for sending the h264 data to the client equipment so as to control the cloud desktop application window to display the image frame corresponding to the h264 data after the client equipment decodes the h264 data.
8. The apparatus according to claim 6, wherein the transmission module is further configured to select, at preset time intervals, the image frame with the shortest storage time from the preset storage space, and send the image frame with the shortest storage time to the client device.
9. A computer arrangement comprising a memory and a processor, the memory storing a computer program which, when run on the processor, performs the data transmission method according to any one of claims 1-5.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when run on a processor, performs the data transmission method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111393206.1A CN114095762A (en) | 2021-11-23 | 2021-11-23 | Data transmission method and device, computer equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111393206.1A CN114095762A (en) | 2021-11-23 | 2021-11-23 | Data transmission method and device, computer equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114095762A true CN114095762A (en) | 2022-02-25 |
Family
ID=80303111
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111393206.1A Pending CN114095762A (en) | 2021-11-23 | 2021-11-23 | Data transmission method and device, computer equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114095762A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115643449A (en) * | 2022-09-16 | 2023-01-24 | 阿里巴巴（中国）有限公司 | Video display method, device, equipment, storage medium and system of cloud service |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110131330A1 (en) * | 2009-12-02 | 2011-06-02 | International Business Machines Corporation | Collocating desktop virtual machines to proximity of the user |
| US20130060837A1 (en) * | 2011-09-07 | 2013-03-07 | Microsoft Corporation | Monitoring And Benchmarking Client Performance From The Server-Side |
| US20170116129A1 (en) * | 2015-10-21 | 2017-04-27 | Dell Products L.P. | Systems and methods for pre-population of graphics image cache in virtual desktop environment |
| WO2017193821A1 (en) * | 2016-05-09 | 2017-11-16 | 中兴通讯股份有限公司 | Cloud desktop image processing method, server, client and computer storage medium |
| CN111010582A (en) * | 2019-12-18 | 2020-04-14 | 深信服科技股份有限公司 | Cloud desktop image processing method, device and equipment and readable storage medium |
| CN111629228A (en) * | 2020-04-30 | 2020-09-04 | 西安万像电子科技有限公司 | Data transmission method and server |
| CN112181575A (en) * | 2020-09-30 | 2021-01-05 | 西安万像电子科技有限公司 | Display control system, method and device |
| CN112486450A (en) * | 2021-02-04 | 2021-03-12 | 江苏北弓智能科技有限公司 | Method and device for mobile cloud desktop on-screen interaction |
| CN113286005A (en) * | 2021-05-26 | 2021-08-20 | 北京金山云网络技术有限公司 | Screen capturing method and device, electronic equipment and storage medium |
-
2021
- 2021-11-23 CN CN202111393206.1A patent/CN114095762A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110131330A1 (en) * | 2009-12-02 | 2011-06-02 | International Business Machines Corporation | Collocating desktop virtual machines to proximity of the user |
| US20130060837A1 (en) * | 2011-09-07 | 2013-03-07 | Microsoft Corporation | Monitoring And Benchmarking Client Performance From The Server-Side |
| US20170116129A1 (en) * | 2015-10-21 | 2017-04-27 | Dell Products L.P. | Systems and methods for pre-population of graphics image cache in virtual desktop environment |
| WO2017193821A1 (en) * | 2016-05-09 | 2017-11-16 | 中兴通讯股份有限公司 | Cloud desktop image processing method, server, client and computer storage medium |
| CN107360443A (en) * | 2016-05-09 | 2017-11-17 | 中兴通讯股份有限公司 | A kind of cloud desktop picture processing method, cloud desktop server and client |
| CN111010582A (en) * | 2019-12-18 | 2020-04-14 | 深信服科技股份有限公司 | Cloud desktop image processing method, device and equipment and readable storage medium |
| CN111629228A (en) * | 2020-04-30 | 2020-09-04 | 西安万像电子科技有限公司 | Data transmission method and server |
| CN112181575A (en) * | 2020-09-30 | 2021-01-05 | 西安万像电子科技有限公司 | Display control system, method and device |
| CN112486450A (en) * | 2021-02-04 | 2021-03-12 | 江苏北弓智能科技有限公司 | Method and device for mobile cloud desktop on-screen interaction |
| CN113286005A (en) * | 2021-05-26 | 2021-08-20 | 北京金山云网络技术有限公司 | Screen capturing method and device, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 王成勇等: "多媒体技术及应用", 南京大学出版社, pages: 133 - 138 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115643449A (en) * | 2022-09-16 | 2023-01-24 | 阿里巴巴（中国）有限公司 | Video display method, device, equipment, storage medium and system of cloud service |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7028266B2 (en) | Processing occluded windows during application sharing | |
| US20100322523A1 (en) | Screen data transmitting system, screen data transmitting server, screen data transmitting method and program recording medium | |
| EP3410302B1 (en) | Graphic instruction data processing method, apparatus | |
| US11741292B2 (en) | Adaptive content delivery | |
| CN108965932B (en) | Continuous wheat window display method and device | |
| US20100235583A1 (en) | Adaptive display caching | |
| AU2004305808A1 (en) | Method and apparatus for generating graphical and media displays at a thin client | |
| CN106375866B (en) | Page loading method and terminal | |
| CN114748873B (en) | Interface rendering method, device, equipment and storage medium | |
| CN111343503B (en) | Video transcoding method and device, electronic equipment and storage medium | |
| CN114095762A (en) | Data transmission method and device, computer equipment and computer readable storage medium | |
| CN108933947B (en) | Bullet screen display method and device | |
| CN115150638A (en) | Data transmission method, device, equipment and storage medium based on cloud desktop | |
| CN110392098B (en) | Self-adaptive virtual desktop transmission method and device | |
| CN113973224A (en) | Method for transmitting media information, computing device and storage medium | |
| US20170034030A1 (en) | Monitoring single content page application transitions | |
| CN109831673B (en) | Live broadcast room data processing method, device, equipment and storage medium | |
| US20160127745A1 (en) | Efficient screen image transfer | |
| JP6146230B2 (en) | Relay device, thin client system, relay method, and relay program | |
| CN114071190B (en) | Cloud application video stream processing method, related device and computer program product | |
| CN111836075B (en) | Virtual desktop frame supplementing method and device, electronic equipment and readable storage medium | |
| CN112737971B (en) | Data processing method, device, storage medium and network equipment | |
| US20150089013A1 (en) | Information processing apparatus, and information processing method | |
| CN113066139A (en) | Picture processing method and device, storage medium and electronic equipment | |
| CN113556621B (en) | Method, server, client, device and storage medium for switching code streams |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |