CN111399964B - Cloud desktop platform based on video streaming technology - Google Patents
Cloud desktop platform based on video streaming technology Download PDFInfo
- Publication number
- CN111399964B CN111399964B CN202010227245.3A CN202010227245A CN111399964B CN 111399964 B CN111399964 B CN 111399964B CN 202010227245 A CN202010227245 A CN 202010227245A CN 111399964 B CN111399964 B CN 111399964B
- Authority
- CN
- China
- Prior art keywords
- desktop
- video
- cloud desktop
- mouse
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 17
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000009877 rendering Methods 0.000 claims abstract description 13
- 230000005540 biological transmission Effects 0.000 claims description 19
- 238000000034 method Methods 0.000 claims description 8
- 238000012544 monitoring process Methods 0.000 claims description 7
- 238000003908 quality control method Methods 0.000 claims description 7
- 238000004806 packaging method and process Methods 0.000 claims description 2
- 235000013599 spices Nutrition 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to the technical field of cloud desktops, and discloses a Yun Zhuomian platform based on a video streaming technology. The cloud desktop video streaming server is responsible for connection management of the cloud desktop client, acquisition and coding of desktop video streams, acquisition and coding of desktop audio streams and receiving and processing of desktop control streams. The cloud desktop client is responsible for receiving video streams, audio streams and control streams of the cloud desktop video streaming server, decoding and rendering the video streams, decoding and playing the audio streams, and receiving, collecting and processing the control streams. The cloud desktop based on the video streaming has the functions of the traditional cloud desktop, mainly utilizes GPU/VGPU resources in cloud resources, and saves the resource use of a computing CPU compared with the traditional cloud desktop.
Description
Technical Field
The invention relates to the technical field of cloud desktop, in particular to a cloud desktop platform based on a video streaming technology.
Background
The GPU/VGPU is generally used for computing in cloud computing, and has great trouble if being used for displaying (3D rendering and the like, which are generally windows platforms), and the 3D computing capability of the GPU/VGPU in the cloud computing can be utilized and can be realized only by a remote desktop (Yun Zhuomian). Currently, cloud desktop technology is generally implemented based on SPICE, and this mode has the following defects:
(1) The method is deeply integrated with a cloud computing technology, and has low portability;
(2) The capacity of the supported GPU/VGPU is limited, the supported models are few, and some types do not support the GPU/VGPU;
(3) Most cloud desktops cannot support public network access, or the public network access has a large security risk;
(4) The cloud desktop needs to be installed with SPICE software, which occupies high resources of the cloud desktop,
in particular CPU resources;
(5) The transmission data cannot be encrypted, and the security is not high.
Disclosure of Invention
In order to solve the above problem, the present invention provides a cloud desktop platform based on a video streaming technology, which specifically includes:
the cloud desktop management platform is responsible for desktop pool management, desktop management, user management and policy management;
the cloud desktop video streaming server is responsible for connection management of the cloud desktop client, acquisition and encoding of desktop video streams, acquisition and encoding of desktop audio streams and receiving and processing of desktop control streams;
yun Zhuomian client, the cloud desktop client is responsible for receiving the video stream, the audio stream and the control stream of the cloud desktop video streaming server, decoding and rendering the video stream, decoding and playing the audio stream, and receiving, collecting and processing the control stream.
Further, the cloud desktop management platform includes:
creating a cloud desktop user and setting user authority, wherein the cloud desktop user comprises a platform administrator and a common user;
associating one or more cloud platforms;
creating a desktop pool, wherein a desktop can be created in the desktop pool;
setting desktop strategies, wherein the desktop strategies comprise global strategies and single desktop strategies;
cloud desktop monitoring and alarm management.
Further, the connection management of the cloud desktop client that the cloud desktop video streaming server is responsible for includes:
receiving and completing the policy setting function of the cloud desktop management platform, wherein the policy setting function comprises starting or stopping video streaming service, setting video frame rate, setting video code rate and image quality control, and monitoring desktop resolution change;
the video streaming service is started or stopped through a management console of the cloud desktop management platform;
the setting of the video code rate comprises: setting video coding by using the dynamic code rate, compressing the coded video according to the set frame rate and code rate, and enabling the transmission bandwidth to be basically consistent with the dynamic code rate value;
the image quality control comprises the following steps: video coding is performed with high quality picture quality video.
Further, the connection management is implemented by using a connection manager of video streams, audio streams and control streams, the connection manager is configured to monitor a certain designated port and receive connections of video, audio and control of the cloud desktop client, and each connection sends handshake information about the video, audio or control.
Further, in the cloud desktop video streaming server:
the acquisition and encoding of the desktop video stream comprises: copying a desktop through a rapid screen capture and recording technology, then encoding desktop information, and pushing an encoded video stream to the cloud desktop client through video connection of the cloud desktop client;
the acquisition and encoding of the desktop audio stream comprises: and capturing audio output from a desktop operating system through a website application program interface, and pushing the audio to the cloud desktop client after the audio is encoded.
Further, in the cloud desktop video streaming server, the receiving and processing of the desktop control flow includes:
the cloud desktop client acquires a control message, and sends the control message to the cloud desktop video streaming server through the control connection of the cloud desktop client after passing through a packaging protocol; the control message comprises information input by a keyboard, a mouse and external equipment of an operating system;
for the messages input by the keyboard and the mouse, the cloud desktop video streaming server directly inputs the messages into an operating system, and the messages are processed by the operating system;
and virtualizing corresponding external equipment by the desktop for the information input by the external equipment, and then sending the information input by the external equipment to the virtualized external equipment.
Further, the mouse style grabbing and sending method comprises the following steps: the cloud desktop client uses a local mouse, the cloud desktop video streaming server captures the mouse style, and sends the mouse style back to the Yun Zhuomian client through the control connection of the cloud desktop client, and the Yun Zhuomian client switches the mouse style in real time according to the mouse style returned by the cloud desktop video streaming server, so that the mouse styles of the cloud desktop client and the cloud desktop video streaming server are consistent.
Further, the mouse style capturing and sending method further comprises: when the mouse is grabbed, the mouse is grabbed together with the video image and sent to the cloud desktop client, and the cloud desktop client does not display the mouse but operates the mouse in the image as the mouse.
Further, when the mouse pattern is transmitted, the mouse pattern carried by the windows is transmitted through an enumeration value, and when the Yun Zhuomian client receives the enumeration value, the mouse pattern corresponding to the operating system is loaded; for a non-windows mouse style, converting a mouse into a bitmap, and sending the bitmap to the cloud desktop client, wherein the Yun Zhuomian client loads the bitmap as a current mouse;
when the cloud desktop video streaming server checks the mouse style, whether the last mouse style is consistent with the current mouse style or not is compared, if so, the current mouse style cannot be sent to the Yun Zhuomian client, and the cloud desktop client continues to use the last mouse style as the current mouse.
Further, the decoding and rendering of the video stream by the cloud desktop client comprises:
when video connection is established, the encoding format of the current video is obtained from the cloud desktop video streaming server; the video is pushed from the cloud desktop video streaming server, a user-defined protocol packet header is adopted for transmission, and after the video is received, video frames are analyzed out and decoded; and after decoding, playing the video through the renderer.
The invention has the beneficial effects that:
compared with the traditional cloud desktop (based on spice protocol, rdp protocol and the like), the cloud desktop based on the video streaming has the technical innovation characteristic. Partial parameters for controlling the characteristics of the video stream are set and put into a platform background for unified management, such as video stream frame rate, code rate, coding mode and the like, so that the unified management and maintenance are more convenient compared with the traditional video stream control. The video stream coding is mainly realized by using a GPU/VGPU, so that the utilization rate of CPU resources is reduced, most of the resources of the virtual machine can be used for other applications, and the utilization rate of the resources such as the CPU and the like is improved. The video, the audio and the control flow in the cloud desktop based on the video streaming adopt a safe and reliable transmission protocol for data transmission, so that the efficiency is high and the delay is low. The cloud desktop end-to-end overall delay based on video streaming is very low, and under the condition of 60fps, the end-to-end overall delay can reach 30-40ms in a local area network. The invention is based on the mouse control of the cloud desktop of the video streaming, and realizes the pattern synchronization of the desktop end and the local mouse by adopting a brand new mode. The cloud desktop platform based on video streaming supports the access of an internal network and an external network to the cloud desktop, and when a certain desktop needs an external network mode, the external network can be conveniently bound through the management console and accessed from a public network. The cloud desktop product based on the video streaming technology is very easy to transplant, and can be very conveniently applied to the fields of cloud computers, cloud games and the like. Compared with the traditional local application of PC + GPU, the cloud desktop based on the video streaming is low in cost, has the characteristics of cloud computing, can be applied and used in real time, and can be recycled in real time when being used up. In addition, the following advantages are also included:
(1) The invention provides a cloud desktop based on video streaming, which has the function of the traditional cloud desktop and can replace the traditional cloud desktop;
(2) The cloud desktop based on the video streaming mainly utilizes GPU/VGPU resources in cloud resources, and the resource usage of a computing CPU is saved compared with the traditional cloud desktop;
(3) The video streaming based cloud desktop can be a perfect application for GPU/VGPU in cloud resources,
the method is not only capable of perfectly supporting the computing capability of the GPU/VGPU, but also capable of perfectly supporting image processing, 3D rendering and the like, and a common cloud desktop does not have the image processing function of the GPU/VGPU generally;
(4) The video streaming of the cloud desktop based on the video streaming adopts a safe and reliable transmission protocol and has a transmission encryption function, so that the cloud desktop based on the video streaming can be well applied to the Internet;
(5) The cloud desktop based on video streaming has low hardware requirements of the client, wide application range, can be used by a common pc machine, a common android mobile phone and a special android client, and also supports an ISO client;
(6) The cloud desktop based on the video streaming adopts a video technology to realize the cloud desktop, and has technical superiority.
Drawings
Fig. 1 is a flow chart of connection management of a cloud desktop video streaming server;
fig. 2 is a second flow chart of the connection management of the cloud desktop video streaming server;
FIG. 3 is a control message reception and processing flow diagram;
FIG. 4 is a flowchart of the operation of a video streaming client;
figure 5SDL message processing flow diagram.
Detailed Description
In order to more clearly understand the technical features, objects, and effects of the present invention, specific embodiments of the present invention will now be described. It should be understood that the detailed description and specific examples, while indicating the preferred embodiment of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment provides a cloud desktop platform based on a video streaming technology, specifically, including:
the cloud desktop management platform is responsible for desktop pool management, desktop management, user management and policy management;
the cloud desktop video streaming server is responsible for connection management of the cloud desktop client, acquisition and encoding of desktop video streams, acquisition and encoding of desktop audio streams and receiving and processing of desktop control streams;
the client Yun Zhuomian is responsible for receiving the video stream, the audio stream and the control stream of the cloud desktop video streaming server, decoding and rendering the video stream, decoding and playing the audio stream, and receiving, acquiring and processing the control stream. Specifically, the cloud desktop client includes an android client and a Windows client.
In a preferred embodiment, the cloud desktop management platform comprises:
creating a cloud desktop user and setting user authority, wherein the cloud desktop user comprises a platform administrator and a common user;
associating one or more cloud platforms;
creating a desktop pool in which desktops can be created;
setting desktop strategies, wherein the desktop strategies comprise a global strategy and a single desktop strategy;
cloud desktop monitoring and alarm management.
In a preferred embodiment, the connection management of the cloud desktop client in charge of the cloud desktop video streaming server comprises:
and receiving and finishing the strategy setting function of the cloud desktop management platform, wherein the strategy setting function comprises starting or stopping a video streaming service, setting a video frame rate, setting a video code rate and image quality control, and monitoring the change of the desktop resolution. Specifically, the cloud desktop management platform and the cloud computing platform of the cloud desktop are generally deployed in the same network address segment, connection is completed through TCP, and connection is not encrypted due to the fact that the connection is an intranet. Fig. 1 shows a connection management flowchart of the cloud desktop video streaming server according to the preferred embodiment. More specifically:
the video streaming service is started by the management console sending a start command and is stopped by the management console sending a stop command.
The frame rate of the video stream can be set to 30 frames and 60 frames, and in the case of client support, can be set to 120 frames (client decoding and rendering capability support is required, display frequency support is also required, and a common 60hz display cannot realize video display of 120 frames).
The image quality control of the video stream is started, the video coding is carried out with the best quality, the compression rate of the video is relatively low, the quality of the decoded video at the client is good, but the corresponding transmission bandwidth is large.
Setting code rate control, namely setting video coding by using dynamic code rate, compressing the coded video according to the set frame rate and code rate, wherein the transmission bandwidth is basically consistent with the dynamic code rate value.
And setting video coding resolution, wherein when the resolution of the cloud desktop is dynamically changed, part of parameters are different, and the parameters need to be reloaded.
A video stream, audio stream and control stream connection manager is a connection manager developed based on a safe and reliable connection (self-defined TCP/UDP-based safe and reliable connection, which supports transmission encryption), monitors a certain specified port, receives video, audio and control connections of a client, and sends different handshake information differences (video, audio and control) to each connection. In connection management, one client includes three connections, and the flow chart is shown in fig. 2.
When data connection is carried out, whether connection transmission is encrypted or not can be set, and the connection encryption is set to ensure that user data is safer and more suitable for being used on the Internet.
In a preferred embodiment, with respect to the cloud desktop video streaming server:
the method comprises the steps of collecting and coding desktop video streams, copying a desktop through windows DXGI (rapid screen capture and screen recording technology), coding desktop information, and pushing the coded video streams to a client through video connection of the client. And the DXGI screen is copied to support win8 and above products, and the captured frame rate is the set frame rate of the management platform. And coding, supporting hardware and software coding, and if GPU/VGPU hardware coding is adopted for reducing the use of a CPU, coding is carried out by a program in a zero-copy mode, and video format conversion and coding are directly carried out from GPU/VGPU. The coding supports two formats of H264 and H265, and supports default picture quality control coding or code rate control coding.
The desktop audio stream is collected and encoded, audio output is captured from a desktop operating system through a WSAPI (Web application program interface), and the audio is pushed to a cloud desktop client after being encoded.
In a preferred embodiment, with respect to the cloud desktop video streaming server, as shown in fig. 3, the receiving and processing of the desktop control flow includes:
the cloud desktop client acquires the control message, and sends the control message to the cloud desktop video streaming server through the control connection of the cloud desktop client after passing through the encapsulation protocol; the control message includes information input by a keyboard, a mouse, and an external device of the operating system. For messages input by a keyboard and a mouse, the cloud desktop video streaming server directly inputs the messages into an operating system, and the messages are processed by the operating system; and for the information input by the external equipment, virtualizing the corresponding external equipment by the desktop, and then sending the information input by the external equipment to the virtualized external equipment.
The mouse style problem is a difficulty in the whole cloud desktop. For the mouse style problem, there are generally two ways:
firstly, the cloud desktop client uses a local mouse, the cloud desktop video streaming server captures the mouse style and sends the mouse style back to the cloud desktop client through the control connection of the cloud desktop client, and the Yun Zhuomian client switches the mouse style in real time according to the mouse style returned by the cloud desktop video streaming server, so that the mouse styles of the cloud desktop client and the cloud desktop video streaming server are consistent. Because of the local mouse, the user operation has no delay feeling and is consistent with the operation of other local application programs.
And secondly, when the mouse is grabbed, the mouse is grabbed together with the video image, the mouse and the video image are sent to the cloud desktop client, and the cloud desktop client does not display the mouse but operates the mouse in the image as the mouse. The biggest problem of the method is that the video is delayed from the server to the client, and the client sends the mouse information to the server, so that the user feels difficult to control (caused by delay) when operating the mouse, and the problem is more obvious under the condition that the network is not good.
The platform can support the two mouse modes, and the default is the second mouse mode. The mouse has various types, including windows mouse type, application program self-defined color mouse and the like. In order to save transmission bandwidth, when the mouse pattern is transmitted, the mouse pattern carried by the windows is transmitted through the enumerated value, and when the client receives the value, the mouse with the pattern corresponding to the operating system is loaded; and the non-windows mouse converts the mouse into a bitmap and sends the bitmap to the client, and the client loads the bitmap as the current mouse. Because the mouse is changed in real time, when the server side checks the mouse style, whether the last mouse style is consistent with the current mouse style or not is compared, if so, the current mouse style cannot be sent to the client side, and the client side continues to use the last mouse style as the current mouse. This may reduce transmission bandwidth and system resource usage.
In a preferred embodiment, the decoding and rendering of the video stream by the cloud desktop client comprises:
rendering the window through the video;
playing through audio;
connecting the cloud desktop virtual machine through a self-defined TCP/UDP-based safe and reliable connection (supporting transmission encryption), wherein the connection comprises video, audio and control;
video reception, decoding and rendering: when the video connection is established, the encoding format (h 265/h 264) of the current video is obtained from the server side. The video is pushed from the cloud desktop server side, a user-defined protocol packet header is adopted for transmission, and after the video is received, the video frame is analyzed and decoded. Decoding supporting software and hardware, and playing a video through a renderer after decoding;
audio reception, decoding and playback: receiving an audio stream of the cloud desktop server through audio connection, and decoding and playing the audio stream;
the method comprises the steps of obtaining input of a mouse, a keyboard and peripheral equipment of a video rendering stream window, converting input information into a platform-defined control message, sending the platform-defined control message to a server, and processing the control message by the server.
And receiving a control message (mouse style) of the cloud desktop server from the control connection, and processing the control message in real time.
The working flow of the video streaming client of the present embodiment is shown in fig. 4, wherein the SDL message processing flow is shown in fig. 5.
In summary, the cloud desktop based on video streaming according to the present invention has technical innovation characteristics compared to the conventional cloud desktop (based on spice protocol, rdp protocol, etc.). Partial parameters for controlling the characteristics of the video stream are set and put into a platform background for unified management, such as video stream frame rate, code rate, coding mode and the like, so that the unified management and maintenance are more convenient compared with the traditional video stream control. The video stream coding is mainly realized by using a GPU/VGPU, so that the utilization rate of CPU resources is reduced, most of the resources of the virtual machine can be used for other applications, and the utilization rate of the resources such as the CPU and the like is improved. The video, the audio and the control stream in the cloud desktop based on the video streaming adopt a safe and reliable transmission protocol for data transmission, so that the efficiency is high and the delay is low. The cloud desktop end-to-end overall delay based on the video streaming is very low, and under the condition of 60fps, the end-to-end overall delay can reach 30-40ms in a local area network. The invention is based on the mouse control of the cloud desktop of the video streaming, and realizes the pattern synchronization of the desktop end and the local mouse by adopting a brand new mode. The cloud desktop platform based on video streaming supports the access of an internal network and an external network to the cloud desktop, and when a certain desktop needs an external network mode, the external network can be conveniently bound through the management console and accessed from a public network. The cloud desktop product based on the video streaming technology is very easy to transplant, and can be very conveniently applied to the fields of cloud computers, cloud games and the like. Compared with the traditional local application of PC + GPU, the cloud desktop based on the video streaming is low in cost, has the characteristics of cloud computing, can be applied and used in real time, and can be recycled in real time when being used up.
The foregoing is illustrative of the preferred embodiments of this invention, and it is to be understood that the invention is not limited to the precise form disclosed herein and that various other combinations, modifications, and environments may be resorted to, falling within the scope of the concept as disclosed herein, either as described above or as apparent to those skilled in the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (3)
1. A cloud desktop platform based on video streaming technology, comprising:
the cloud desktop management platform is responsible for desktop pool management, desktop management, user management and policy management;
the cloud desktop video streaming server is responsible for connection management of the cloud desktop client, acquisition and encoding of desktop video streams, acquisition and encoding of desktop audio streams and receiving and processing of desktop control streams;
yun Zhuomian client, the cloud desktop client is responsible for receiving the video stream, the audio stream and the control stream of the cloud desktop video streaming server, decoding and rendering the video stream, decoding and playing the audio stream, and receiving, collecting and processing the control stream;
the connection management of the cloud desktop client in charge of the cloud desktop video streaming server comprises the following steps: receiving and completing the policy setting function of the cloud desktop management platform, wherein the policy setting function comprises starting or stopping video streaming service, setting video frame rate, setting video code rate and image quality control, and monitoring desktop resolution change; the video streaming service is started or stopped through a management console of the cloud desktop management platform; the setting of the video code rate comprises: setting video coding by using the dynamic code rate, compressing the coded video according to the set frame rate and the code rate, wherein the transmission bandwidth is consistent with the dynamic code rate value; the image quality control includes: performing video coding by using high-quality picture quality video;
the connection management is realized by using a connection manager of video streams, audio streams and control streams, the connection manager is used for monitoring a certain specified port and receiving the connection of video, audio and control of the cloud desktop client, and each connection sends handshake information about the video, audio or control;
in the cloud desktop video streaming server, the acquisition and encoding of the desktop video stream includes: copying a desktop through a rapid screen capture and recording technology, then encoding desktop information, and pushing an encoded video stream to the cloud desktop client through video connection of the cloud desktop client; the acquisition and encoding of the desktop audio stream comprises: capturing audio output from a desktop operating system through a website application program interface, and pushing the audio to the cloud desktop client after the audio is encoded;
in the cloud desktop video streaming server, the receiving and processing of the desktop control flow include: the cloud desktop client acquires a control message, and sends the control message to the cloud desktop video streaming server through the control connection of the cloud desktop client after passing through a packaging protocol; the control message comprises information input by a keyboard, a mouse and external equipment of an operating system; for the messages input by the keyboard and the mouse, the cloud desktop video streaming server directly inputs the messages into an operating system, and the messages are processed by the operating system; for the information input by the external equipment, virtualizing the corresponding external equipment by the desktop, and then sending the information input by the external equipment to the virtualized external equipment;
the mouse style grabbing and sending method comprises the following steps: the cloud desktop client uses a local mouse, the cloud desktop video streaming server captures the mouse style, and sends the mouse style back to the Yun Zhuomian client through the control connection of the cloud desktop client, and the Yun Zhuomian client switches the mouse style in real time according to the mouse style returned by the cloud desktop video streaming server, so that the mouse styles of the cloud desktop client and the cloud desktop video streaming server are consistent;
the mouse style grabbing and sending mode further comprises the following steps: when the desktop is grabbed, the mouse is grabbed together, the mouse and the video image are sent to the cloud desktop client, and the cloud desktop client does not display the mouse but operates the mouse in the image as the mouse;
when the mouse style is transmitted, the mouse style of the windows is transmitted through an enumeration value, and when the Yun Zhuomian client receives the enumeration value, a style mouse corresponding to an operating system is loaded; for a non-windows mouse style, converting a mouse into a bitmap, and sending the bitmap to the cloud desktop client, wherein the Yun Zhuomian client loads the bitmap as a current mouse; when the cloud desktop video streaming server checks the mouse style, whether the last mouse style is consistent with the current mouse style or not is compared, if so, the current mouse style cannot be sent to the Yun Zhuomian client, and the cloud desktop client continues to use the last mouse style as the current mouse.
2. The cloud desktop platform based on video streaming technology of claim 1, wherein the cloud desktop management platform comprises:
creating a cloud desktop user and setting user authority, wherein the cloud desktop user comprises a platform administrator and a common user;
associating one or more cloud platforms;
creating a desktop pool, wherein a desktop can be created in the desktop pool;
setting desktop strategies, wherein the desktop strategies comprise global strategies and single desktop strategies;
cloud desktop monitoring and alarm management.
3. The cloud desktop platform based on video streaming technology of claim 1, wherein the decoding and rendering of the video stream by the cloud desktop client comprises:
when video connection is established, the encoding format of the current video is obtained from the cloud desktop video streaming server; the video is pushed from the cloud desktop video streaming server, a user-defined protocol packet header is adopted for transmission, and after the video is received, video frames are analyzed out and decoded; and after decoding, playing the video through the renderer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010227245.3A CN111399964B (en) | 2020-03-27 | 2020-03-27 | Cloud desktop platform based on video streaming technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010227245.3A CN111399964B (en) | 2020-03-27 | 2020-03-27 | Cloud desktop platform based on video streaming technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111399964A CN111399964A (en) | 2020-07-10 |
| CN111399964B true CN111399964B (en) | 2023-03-24 |
Family
ID=71434673
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010227245.3A Active CN111399964B (en) | 2020-03-27 | 2020-03-27 | Cloud desktop platform based on video streaming technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111399964B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112463276A (en) * | 2020-12-03 | 2021-03-09 | 南京机敏软件科技有限公司 | Cloud desktop toolbar management method based on Electron technology |
| CN114727045A (en) * | 2020-12-22 | 2022-07-08 | 中兴通讯股份有限公司 | Method for sharing cloud desktop to conference television system, cloud desktop terminal and cloud desktop |
| CN115150111A (en) * | 2021-03-30 | 2022-10-04 | 电科云(北京)科技有限公司 | Cloud desktop and cloud application communication method and system |
| CN115220831A (en) * | 2021-04-21 | 2022-10-21 | 电科云(北京)科技有限公司 | Method and system for providing working mode based on safe working space |
| CN115220832A (en) * | 2021-04-21 | 2022-10-21 | 电科云(北京)科技有限公司 | Security collaboration method and system based on cloud platform |
| CN113296865B (en) * | 2021-05-28 | 2022-09-06 | 贵州海誉科技股份有限公司 | Cloud desktop mouse position sensing and mouse operation event management method |
| CN113556584B (en) * | 2021-07-21 | 2023-07-28 | 北京百度网讯科技有限公司 | Screenshot transmission method and device of cloud mobile phone, electronic equipment and storage medium |
| CN114327722A (en) * | 2021-12-28 | 2022-04-12 | 武汉噢易云计算股份有限公司 | Mobile terminal performance optimization method, device, equipment and readable storage medium |
| CN114567561A (en) * | 2022-01-21 | 2022-05-31 | 广东集东洲信息发展有限公司 | Video processing system based on big data processing |
| CN114827692A (en) * | 2022-04-29 | 2022-07-29 | 深圳市瑞云科技有限公司 | System for operating cloud desktop based on smart television |
| CN115119049B (en) * | 2022-06-22 | 2023-10-17 | 深圳市瑞云科技有限公司 | Dynamic coding method supporting cloud game playing |
| CN115904567A (en) * | 2022-09-23 | 2023-04-04 | 阿里巴巴（中国）有限公司 | Interaction, processing and control method of application service in cloud desktop |
| CN115865909B (en) * | 2023-01-13 | 2023-06-02 | 中科方德软件有限公司 | SPICE protocol-based data transmission method and device and readable storage medium |
| CN116301707B (en) * | 2023-05-18 | 2023-10-24 | 北京庭宇科技有限公司 | Cloud desktop sound collection method based on virtual sound card |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370220A (en) * | 2007-08-16 | 2009-02-18 | 中兴通讯股份有限公司 | Video media monitoring method and system |
| WO2009043291A1 (en) * | 2007-09-26 | 2009-04-09 | Huawei Technologies Co., Ltd. | A method, a system and a stratrgy and control server for implementing stream media service |
| CN105577819A (en) * | 2016-01-26 | 2016-05-11 | 杭州碧创科技有限公司 | Sharing system, sharing method and sharing device for virtual desktop |
| WO2017143718A1 (en) * | 2016-02-26 | 2017-08-31 | 成都赫尔墨斯科技有限公司 | Cloud rendering system, server, and method |
| CN109800042A (en) * | 2018-12-28 | 2019-05-24 | 广东纬德信息科技有限公司 | The graphic display method and system of cloud desktop |
-
2020
- 2020-03-27 CN CN202010227245.3A patent/CN111399964B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370220A (en) * | 2007-08-16 | 2009-02-18 | 中兴通讯股份有限公司 | Video media monitoring method and system |
| WO2009043291A1 (en) * | 2007-09-26 | 2009-04-09 | Huawei Technologies Co., Ltd. | A method, a system and a stratrgy and control server for implementing stream media service |
| CN105577819A (en) * | 2016-01-26 | 2016-05-11 | 杭州碧创科技有限公司 | Sharing system, sharing method and sharing device for virtual desktop |
| WO2017143718A1 (en) * | 2016-02-26 | 2017-08-31 | 成都赫尔墨斯科技有限公司 | Cloud rendering system, server, and method |
| CN109800042A (en) * | 2018-12-28 | 2019-05-24 | 广东纬德信息科技有限公司 | The graphic display method and system of cloud desktop |
Non-Patent Citations (1)
| Title |
|---|
| 基于视频流的云桌面设计与实现;冯健等;《计算机工程》;20131204(第10期);第37-41、52页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111399964A (en) | 2020-07-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111399964B (en) | Cloud desktop platform based on video streaming technology | |
| WO2022028089A1 (en) | Image processing method and device, server, and medium | |
| KR101720654B1 (en) | Data redirection system and method for providing data redirection service | |
| US9510048B2 (en) | Dynamically changing streaming video quality | |
| CN103139609B (en) | The method and apparatus that remote application video playback is optimized | |
| US20160029079A1 (en) | Method and Device for Playing and Processing a Video Based on a Virtual Desktop | |
| CN105338323A (en) | Video monitoring method and device | |
| CN103533034A (en) | Method for seamlessly using cloud terminal local camera in VDI (Virtual Device Interface) virtual desktop | |
| CN110891084A (en) | Thin client remote desktop control system based on autonomous HVDP protocol | |
| CN113489805B (en) | Butt joint method, device, equipment and storage medium of cloud desktop system | |
| WO2014121477A1 (en) | Video redirection method, device and system, and computer readable medium | |
| WO2012151957A1 (en) | Server, client, and method and system for playing video file remotely therewith | |
| CN102664939A (en) | Method and device for mobile terminal of screen mirror image | |
| WO2023040825A1 (en) | Media information transmission method, computing device and storage medium | |
| WO2024037110A1 (en) | Data processing method and apparatus, device, and medium | |
| CN109040786A (en) | Transmission method, device, system and the storage medium of camera data | |
| CN110740352B (en) | SPICE protocol-based difference image display method in video card transparent transmission environment | |
| CN102546803B (en) | Remote desktop communication method based on capability set | |
| CN106658070B (en) | Method and device for redirecting video | |
| CN111093091A (en) | Video processing method, server and system | |
| Hou et al. | A cloud gaming system based on NVIDIA GRID GPU | |
| CN115052043A (en) | Video transmission method, electronic equipment, device and medium of cloud desktop | |
| CN114827692A (en) | System for operating cloud desktop based on smart television | |
| KR20160015123A (en) | System for cloud streaming service, method of cloud streaming service based on still image and apparatus for the same | |
| CN114666561B (en) | Video fusion method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240304 Address after: Room 1101, 11th Floor, Pacific International Building, No.106 Zhichun Road, Haidian District, Beijing, 100000 Patentee after: Beijing Haiyunjiexun Technology Co.,Ltd. Country or region after: China Address before: Room 503, building B3, phase I, R & D building, 62-1 Xuecheng Avenue, Shapingba District, Chongqing 404100 Patentee before: Chongqing Haiyun Jiexun Technology Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right |