CN117750075A - Method for self-adapting image superdivision under remote desktop environment - Google Patents
Method for self-adapting image superdivision under remote desktop environment Download PDFInfo
- Publication number
- CN117750075A CN117750075A CN202311611188.9A CN202311611188A CN117750075A CN 117750075 A CN117750075 A CN 117750075A CN 202311611188 A CN202311611188 A CN 202311611188A CN 117750075 A CN117750075 A CN 117750075A
- Authority
- CN
- China
- Prior art keywords
- module
- superdivision
- image
- super
- virtual machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000003044 adaptive effect Effects 0.000 claims description 6
- 238000012795 verification Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 abstract description 3
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a self-adaptive image superdivision method in a remote desktop environment, which relates to the technical field of image superdivision. According to the self-adaptive image superdivision method under the remote desktop environment, the resolution of images and videos is adjusted by sensing the competition condition of the current network bandwidth in real time, and the image superdivision and the video transmission are realized by using low bandwidth occupation through the local calculation of the terminal, and the high-resolution images and videos are restored and displayed by using superdivision, so that the bandwidth occupation of the remote desktop is reduced.
Description
Technical Field
The invention relates to the technical field of image superdivision, in particular to a self-adaptive image superdivision method under a remote desktop environment.
Background
With the continuous development of internet technology, people can access office desktops at office places by using a networking terminal to perform offices anytime and anywhere, and thus a product class of remote desktops is generated, wherein the product class comprises desktop clouds, remote application release and other sub-products, the products adopt a mode of transmitting pictures of virtual machines in a remote server to terminal equipment through a network, the mode and ensuring that users can see the pictures of the virtual machines can also ensure the safety of not transmitting remote data to the local places, in the remote desktop field, because pictures or video streams are transmitted in the network, the existing products often compress the pictures or video streams to sacrifice part of experience, mainly the modes of definition and frame rate, and the mode is very unfriendly to users in the office experience of users, especially in the fields of graphic design, architectural design, video creation and the like with higher requirements on image display quality.
In the existing scheme, when the experience and the bandwidth are required to be balanced, two solutions exist: one is to sacrifice the user experience, for example, reduce the resolution and the transmission frame rate to meet the requirement of reducing the bandwidth occupation, and the other is to increase the bandwidth investment and increase the exit bandwidth of the central point to ensure the user experience, so that the user experience and the bandwidth cost are difficult to be simultaneously and evenly considered.
Therefore, it is necessary to provide a method for adaptive image super-division in a remote desktop environment to solve the above-mentioned problems.
Disclosure of Invention
The invention mainly aims to provide a self-adaptive image superdivision method in a remote desktop environment, which can effectively solve the problems in the background technology.
In order to achieve the above purpose, the technical scheme adopted by the invention is as follows:
a self-adaptive image superdivision method under a remote desktop environment comprises a network delay sensing module, a server side dynamic coding module and a terminal local superdivision module.
Preferably, the sensing method of the network delay sensing module comprises the following operation steps:
s1: the method comprises the steps of acquiring a process identifier of a multi-core virtual machine running on a current server, wherein the process identifier is marked as PID;
s2: acquiring the network state of the virtual machine through the PID;
s3: calculating the occupation of the virtual machine to the outlet network and the network delay of the virtual machine to the terminal;
and S4, matching the set threshold value, and transmitting the coding parameters to the dynamic coding module of the server.
Preferably, the dynamic coding method of the server dynamic coding module comprises the following operation steps:
a: the method comprises the steps that according to coding parameters output by a network delay sensing module, dynamic image and video coding is carried out on pictures of a virtual machine, if the network delay sensing module detects that the network occupation of the virtual machine is high and exceeds a set threshold, a server side dynamic coding module carries out low-resolution and low-code rate coding on the pictures of the virtual machine, so that occupation of network bandwidth is reduced, and a server side dynamic coding module transmits a super-division signal to a terminal local super-division control module to inform a coding mode and a super-division requirement of the super-division signal;
b: the network delay sensing module monitors that the network occupation condition of the target virtual machine is lower than a threshold value, sends a message to the server side dynamic coding module, replies normal image and video coding, and sends an oversubscription stop signal to the local oversubscription control module of the notification terminal by the server side dynamic coding module to stop oversubscription operation;
c: the image verification signal is transmitted between the server side dynamic coding module and the terminal local super-division control module, so that the similarity degree of the super-divided image, video and the original virtual machine picture graph is verified, and the authenticity of the super-divided image is ensured.
Preferably, the terminal local superdivision module comprises the following operation steps:
a: receiving instruction information, image data and video data sent by a dynamic coding module of a server;
b: determining whether superdivision is currently executed or not and specific parameters of the superdivision according to the instruction type;
c: performing super-division to generate a clearer image and a clearer video after super-division;
d: the similarity of the super-divided images and the video is checked, and if the check is passed, the super-divided images and the video are output; if the verification is not passed, returning to execute the superdivision again;
e: and outputting the checked image and video.
Preferably, the output end of the network delay sensing module is electrically connected with the input ends of the server side dynamic coding module and the KVM module of the Linux kernel, the network delay sensing module, the server side dynamic coding module and the KVM module of the Linux kernel are the server side, the output end of the terminal body supermodule is electrically connected with the input end of the display output, the input end of the terminal body supermodule is electrically connected with the output end of the terminal body CPU, the terminal body supermodule, the terminal body CPU and the display output are the client side, and the output end of the server side is electrically connected with the input end of the client side.
Advantageous effects
Compared with the prior art, the invention provides a method for self-adapting image superdivision in a remote desktop environment, which has the following beneficial effects:
1. according to the method for self-adapting image superdivision in the remote desktop environment, the network delay sensing module can dynamically adjust image coding and video coding of a virtual machine picture according to the occupation condition of the virtual machine by occupying the virtual machine outlet network and transmitting the virtual machine to the terminal, the image superdivision is dynamically realized at the terminal, and the similarity check can be further carried out between the server coding and the dynamic of the terminal superdivision.
2. The method for self-adapting image superdivision under the remote desktop environment can monitor the occupation of the outlet bandwidth of the remote desktop server in real time, can automatically adjust image coding and video coding, can utilize the local computing power of the terminal to execute the superdivision algorithm, and restore the image and video with low resolution and low bandwidth occupation into the image and video with high resolution.
3. According to the method for the super-division of the self-adaptive image in the remote desktop environment, the contradiction between user experience and bandwidth cost is solved in a remote desktop scene, the soft-hard combined self-adaptive graph super-division method is provided, the resolution of the image and the video is dynamically adjusted by sensing the competition condition of the current network bandwidth in real time, and graph super-division is carried out on the terminal through the local computing power of the terminal, so that the image and the video are transmitted with low bandwidth occupation, and the high-resolution image and the video are restored and displayed with super-division, and the purposes of reducing the bandwidth occupation of the remote desktop and improving the user experience are achieved.
Drawings
FIG. 1 is a system frame diagram of adaptive image superdivision in a remote desktop environment in accordance with the present invention;
FIG. 2 is a flow chart of the operation of the network delay aware module of the present invention;
FIG. 3 is a workflow diagram of a server side dynamic encoding module of the present invention;
fig. 4 is a flowchart of the operation of the terminal body supermodule of the present invention.
Detailed Description
The invention is further described in connection with the following detailed description, in order to make the technical means, the creation characteristics, the achievement of the purpose and the effect of the invention easy to understand.
As shown in fig. 1, a method for self-adapting image superdivision in a remote desktop environment includes a network delay sensing module, a server side dynamic coding module and a terminal local superdivision module, wherein an output end of the network delay sensing module is electrically connected with an input end of the server side dynamic coding module and a KVM module of a Linux kernel, the network delay sensing module, the server side dynamic coding module and the KVM module of the Linux kernel are serving as the server side, an output end of the terminal body superdivision module is electrically connected with an input end of a display output, an input end of the terminal body superdivision module is electrically connected with an output end of a terminal body CPU, the terminal body superdivision module, the terminal body CPU and the display output are clients, and an output end of the server side is electrically connected with an input end of the clients.
As shown in fig. 1-2, the sensing method of the network delay sensing module comprises the following operation steps:
s1: the method comprises the steps of acquiring a process identifier of a multi-core virtual machine running on a current server, wherein the process identifier is marked as PID;
s2: acquiring the network state of the virtual machine through the PID;
s3: calculating the occupation of the virtual machine to the outlet network and the network delay of the virtual machine to the terminal;
and S4, matching the set threshold value, and transmitting the coding parameters to the dynamic coding module of the server.
As shown in fig. 1 and 3, the dynamic coding method of the server dynamic coding module includes the following operation steps:
a: the method comprises the steps that according to coding parameters output by a network delay sensing module, dynamic image and video coding is carried out on pictures of a virtual machine, if the network delay sensing module detects that the network occupation of the virtual machine is high and exceeds a set threshold, a server side dynamic coding module carries out low-resolution and low-code rate coding on the pictures of the virtual machine, so that occupation of network bandwidth is reduced, and a server side dynamic coding module transmits a super-division signal to a terminal local super-division control module to inform a coding mode and a super-division requirement of the super-division signal;
b: the network delay sensing module monitors that the network occupation condition of the target virtual machine is lower than a threshold value, sends a message to the server side dynamic coding module, replies normal image and video coding, and sends an oversubscription stop signal to the local oversubscription control module of the notification terminal by the server side dynamic coding module to stop oversubscription operation;
c: the image verification signal is transmitted between the server side dynamic coding module and the terminal local super-division control module, so that the similarity degree of the super-divided image, video and the original virtual machine picture graph is verified, and the authenticity of the super-divided image is ensured.
As shown in fig. 1 and 4, the terminal local superdivision module includes the following operation steps:
a: receiving instruction information, image data and video data sent by a dynamic coding module of a server;
b: determining whether superdivision is currently executed or not and specific parameters of the superdivision according to the instruction type;
c: performing super-division to generate a clearer image and a clearer video after super-division;
d: the similarity of the super-divided images and the video is checked, and if the check is passed, the super-divided images and the video are output; if the verification is not passed, returning to execute the superdivision again;
e: and outputting the checked image and video.
The invention provides a soft-hard combined self-adaptive graph super-division method, which dynamically adjusts the resolution of images and videos by sensing the competition condition of the current network bandwidth in real time, and performs graph super-division by the local computing power of the terminal, thereby realizing transmission of the images and videos with low bandwidth occupation and restoration of the high resolution images and videos with super-division for display, thereby realizing the purposes of reducing the occupation bandwidth of a remote desktop.
The foregoing has shown and described the basic principles and main features of the present invention and the advantages of the present invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, and that the above embodiments and descriptions are merely illustrative of the principles of the present invention, and various changes and modifications may be made without departing from the spirit and scope of the invention, which is defined in the appended claims. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (5)
1. A self-adaptive image superdivision method under a remote desktop environment comprises a network delay sensing module, a server side dynamic coding module and a terminal local superdivision module.
2. The method for adaptive image superdivision in a remote desktop environment according to claim 1, wherein: the sensing method of the network delay sensing module comprises the following operation steps:
s1: the method comprises the steps of acquiring a process identifier of a multi-core virtual machine running on a current server, wherein the process identifier is marked as PID;
s2: acquiring the network state of the virtual machine through the PID;
s3: calculating the occupation of the virtual machine to the outlet network and the network delay of the virtual machine to the terminal;
and S4, matching the set threshold value, and transmitting the coding parameters to the dynamic coding module of the server.
3. The method for adaptive image superdivision in a remote desktop environment according to claim 1, wherein: the dynamic coding method of the dynamic coding module of the server comprises the following operation steps:
a: the method comprises the steps that according to coding parameters output by a network delay sensing module, dynamic image and video coding is carried out on pictures of a virtual machine, if the network delay sensing module detects that the network occupation of the virtual machine is high and exceeds a set threshold, a server side dynamic coding module carries out low-resolution and low-code rate coding on the pictures of the virtual machine, so that occupation of network bandwidth is reduced, and a server side dynamic coding module transmits a super-division signal to a terminal local super-division control module to inform a coding mode and a super-division requirement of the super-division signal;
b: the network delay sensing module monitors that the network occupation condition of the target virtual machine is lower than a threshold value, sends a message to the server side dynamic coding module, replies normal image and video coding, and sends an oversubscription stop signal to the local oversubscription control module of the notification terminal by the server side dynamic coding module to stop oversubscription operation;
c: the image verification signal is transmitted between the server side dynamic coding module and the terminal local super-division control module, so that the similarity degree of the super-divided image, video and the original virtual machine picture graph is verified, and the authenticity of the super-divided image is ensured.
4. The method for adaptive image superdivision in a remote desktop environment according to claim 1, wherein: the terminal local hyper-division module comprises the following operation steps:
a: receiving instruction information, image data and video data sent by a dynamic coding module of a server;
b: determining whether superdivision is currently executed or not and specific parameters of the superdivision according to the instruction type;
c: performing super-division to generate a clearer image and a clearer video after super-division;
d: the similarity of the super-divided images and the video is checked, and if the check is passed, the super-divided images and the video are output; if the verification is not passed, returning to execute the superdivision again;
e: and outputting the checked image and video.
5. The method for adaptive image superdivision in a remote desktop environment according to claim 1, wherein: the output end of the network delay sensing module is electrically connected with the input ends of the server side dynamic coding module and the KVM module of the Linux kernel, the network delay sensing module, the server side dynamic coding module and the KVM module of the Linux kernel are the server side, the output end of the terminal body superminute module is electrically connected with the input end of the display output, the input end of the terminal body superminute module is electrically connected with the output end of the terminal body CPU, the terminal body superminute module, the terminal body CPU and the display output are the client side, and the output end of the server side is electrically connected with the input end of the client side.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311611188.9A CN117750075A (en) | 2023-11-29 | 2023-11-29 | Method for self-adapting image superdivision under remote desktop environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311611188.9A CN117750075A (en) | 2023-11-29 | 2023-11-29 | Method for self-adapting image superdivision under remote desktop environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117750075A true CN117750075A (en) | 2024-03-22 |
Family
ID=90253540
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311611188.9A Pending CN117750075A (en) | 2023-11-29 | 2023-11-29 | Method for self-adapting image superdivision under remote desktop environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117750075A (en) |
-
2023
- 2023-11-29 CN CN202311611188.9A patent/CN117750075A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113015021B (en) | Cloud game implementation method, device, medium and electronic equipment | |
| US6535238B1 (en) | Method and apparatus for automatically scaling processor resource usage during video conferencing | |
| WO2017219896A1 (en) | Method and device for transmitting video stream | |
| US20220046261A1 (en) | Encoding method and apparatus for screen sharing, storage medium, and electronic device | |
| CN113254130B (en) | Method for adaptively adjusting resolution of cloud desktop | |
| CN113825020B (en) | Video definition switching method, device, equipment, storage medium and program product | |
| WO2023040825A1 (en) | Media information transmission method, computing device and storage medium | |
| WO2023093240A1 (en) | Video data processing method, apparatus and device, and computer storage medium | |
| CN115529300B (en) | System and method for automatically adjusting key frame quantization parameters and frame rate | |
| US9226003B2 (en) | Method for transmitting video signals from an application on a server over an IP network to a client device | |
| WO2015085873A1 (en) | Video code stream obtaining method and apparatus | |
| EP4044615A1 (en) | Method and device for adjusting attribute of video stream | |
| CN116866658A (en) | Video data processing method, device, equipment and medium | |
| CN117750075A (en) | Method for self-adapting image superdivision under remote desktop environment | |
| CN115767149A (en) | Video data transmission method and device | |
| CN101520719A (en) | System and method for sharing display information | |
| CN110798700B (en) | Video processing method, video processing device, storage medium and electronic equipment | |
| EP3185570A1 (en) | Method and apparatus for transmission-based smoothing of rendering | |
| CN112774193A (en) | Image rendering method of cloud game | |
| WO2012154157A1 (en) | Apparatus and method for dynamically changing encoding scheme based on resource utilization | |
| CN110971870A (en) | Data processing method and system for image display | |
| KR101251879B1 (en) | Apparatus and method for displaying advertisement images in accordance with screen changing in multimedia cloud system | |
| CN118055151B (en) | Cloud desktop GPU (graphics processing unit) through virtualization redirection management system and method | |
| US12088643B2 (en) | Videoconferencing with reduced quality interruptions upon participant join | |
| CN113160342B (en) | Encoding method and device based on feedback, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |