CN114629897A

CN114629897A - Data processing method and system

Info

Publication number: CN114629897A
Application number: CN202210228745.8A
Authority: CN
Inventors: 陈湘婷; 闵洪波; 刘侃
Original assignee: Alibaba China Co Ltd
Current assignee: Alibaba China Co Ltd
Priority date: 2022-03-08
Filing date: 2022-03-08
Publication date: 2022-06-14

Abstract

The embodiment of the specification provides a data processing method and a system, wherein the data processing method comprises the following steps: responding to a cloud desktop sharing request of a first client, acquiring a cloud desktop operating instruction transmitted by the first client through a first transmission protocol, wherein the first transmission protocol is a cloud desktop transmission protocol, analyzing the cloud desktop operating instruction based on the first transmission protocol, generating cloud desktop data to be shared according to an analysis result, multicasting the cloud desktop data to be shared to at least two second clients through a second transmission protocol, wherein the cloud desktop data to be shared is used for being analyzed by each second client, rendering and displaying the analysis result, and the second transmission protocol is a protocol supporting multicast.

Description

Data processing method and system

Technical Field

The embodiment of the specification relates to the technical field of cloud computing, in particular to a data processing method.

Background

A cloud desktop (VDI) refers to a terminal system (i.e., a desktop) of a computer is virtualized to achieve security and flexibility of desktop usage, so that a virtual desktop of a data center can be accessed through any device, anywhere, and at any time through a network.

The cloud desktop is a typical application mode under cloud computing, the operations of all clients are centralized together through a virtualization technology, centralized processing is carried out on a cloud desktop server by adopting the principles of centralized operation and distributed display, and a desktop user is only responsible for transmitting and displaying an interface and does not participate in any other operations and applications.

In an actual use scene of the cloud desktop, if the cloud desktop needs to be shared by the cloud desktop server to a plurality of desktop users at the same time, a certain pressure is brought to the network bandwidth of the cloud desktop server, which inevitably causes that the cloud desktop server cannot bear a corresponding load, so that the desktop users have poor use experience due to time delay in the desktop sharing process. Therefore, an effective method is needed to solve such problems.

Disclosure of Invention

In view of this, the embodiments of the present specification provide a data processing method. One or more embodiments of the present specification also relate to a data processing system, a data processing apparatus, a computing device, a computer-readable storage medium, and a computer program, so as to solve the technical problems in the prior art.

According to a first aspect of the embodiments of the present specification, there is provided a data processing method applied to a cloud desktop server, including:

responding to a cloud desktop sharing request of a first client, and acquiring a cloud desktop operation instruction transmitted by the first client through a first transmission protocol, wherein the first transmission protocol is a cloud desktop transmission protocol;

analyzing the cloud desktop operation instruction based on the first transmission protocol, and generating cloud desktop data to be shared according to an analysis result;

and multicasting the to-be-shared cloud desktop data to at least two second clients through a second transmission protocol, wherein the to-be-shared cloud desktop data is used for being analyzed by each second client, and an analysis result is rendered and displayed, and the second transmission protocol is a protocol supporting multicast.

Optionally, sending the cloud desktop data to be shared to at least two second clients through a second transmission protocol, including:

and sending the cloud desktop data to be shared to at least two second clients through a streaming media server through a second transmission protocol, wherein the streaming media server is respectively connected with the cloud desktop server and each second client through the second transmission protocol.

Optionally, the data processing method further includes:

establishing connection with the first client through the first transmission protocol, and establishing a first input data channel of the first client;

correspondingly, the obtaining of the cloud desktop operation instruction transmitted by the first client through the first transmission protocol includes:

and acquiring a cloud desktop operation instruction transmitted by the first client through the first input data channel.

Optionally, the data processing method further includes:

responding to a data updating instruction submitted by the first client aiming at the cloud desktop data to be shared, updating the cloud desktop data to be shared based on the data updating instruction, and sending an updating result to the at least two second clients through the second transmission protocol.

Optionally, the data processing method further includes:

responding to a connection establishment request submitted by a target second client, and judging whether an authorization instruction submitted by the first client aiming at the target second client is received, wherein the authorization instruction is used for authorizing the target second client to update the cloud desktop data to be shared;

if so, establishing connection with the target second client through the first transmission protocol, and establishing a second input data channel of the target second client;

and acquiring a data updating instruction transmitted by the target second client through the second input data channel, and updating the cloud desktop data to be shared based on the data updating instruction.

Optionally, the data processing method further includes:

establishing a multimedia data channel of the first client, and sending an updating result to the first client through the multimedia data channel; and the number of the first and second groups,

and sending the updating result to at least two second clients through the streaming media server by a second transmission protocol.

Optionally, the data processing method further includes:

and establishing connection with a streaming media server through a second transmission protocol, and uploading a connection establishment result to a control server, wherein the connection establishment result comprises address information of the cloud desktop server and the streaming media server.

Optionally, the data processing method further includes:

and sending the cloud desktop data to be shared to the first client through the first transmission protocol.

Optionally, the sending, by the first transmission protocol, the cloud desktop data to be shared to the first client includes:

receiving a cloud desktop data downloading request submitted by the first client, wherein the cloud desktop data downloading request comprises a receiving code rate of cloud desktop data to be shared;

and processing the data of the cloud desktop to be shared based on the receiving code rate, generating a corresponding multimedia fragment, and sending the multimedia fragment to the first client.

Optionally, the second transport protocol comprises a real-time streaming protocol.

According to a second aspect of embodiments herein, there is provided a data processing apparatus comprising:

the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is configured to respond to a cloud desktop sharing request of a first client, and acquire a cloud desktop operation instruction transmitted by the first client through a first transmission protocol, and the first transmission protocol is a cloud desktop transmission protocol;

the generating module is configured to analyze the cloud desktop operation instruction based on the first transmission protocol and generate to-be-shared cloud desktop data according to an analysis result;

the sending module is configured to multicast the to-be-shared cloud desktop data to at least two second clients through a second transmission protocol, wherein the to-be-shared cloud desktop data is used for being analyzed by each second client, and rendering and displaying an analysis result, and the second transmission protocol is a protocol supporting multicast.

According to a third aspect of embodiments herein, there is provided a data processing system comprising:

the system comprises a cloud desktop server, a first client and at least two second clients;

the cloud desktop server is configured to respond to a cloud desktop sharing request of a first client, acquire a cloud desktop operating instruction transmitted by the first client through a first transmission protocol, analyze the cloud desktop operating instruction based on the first transmission protocol, generate to-be-shared cloud desktop data according to an analysis result, and multicast the to-be-shared cloud desktop data to at least two second clients through a second transmission protocol, wherein the first transmission protocol is a cloud desktop transmission protocol, and the second transmission protocol is a protocol supporting multicast;

the at least two second clients are configured to analyze the cloud desktop data to be shared, render and display analysis results.

Optionally, the data processing system further includes: a streaming media server;

correspondingly, the cloud desktop server is further configured to send the cloud desktop data to be shared to the streaming media server through a second transmission protocol;

the streaming media server is configured to send the cloud desktop data to be shared to the at least two second clients through a second transmission protocol;

the at least two second clients are configured to analyze the cloud desktop data to be shared, and render and display an analysis result.

Optionally, the data processing system further includes a management and control server;

the cloud desktop server is configured to establish connection with a streaming media server through the second transmission protocol, and send a connection establishment result to the management and control server, wherein the connection establishment result includes address information of the cloud desktop server and the streaming media server;

the management and control server is configured to receive and store the connection establishment result.

Optionally, the administrative server is further configured to return the connection establishment result to the at least two second clients in response to connection establishment requests submitted by the at least two second clients for the streaming media server;

and the at least two second clients are configured to establish connection with the streaming media server through a second transmission protocol according to the address information of the streaming media server contained in the connection establishment result.

The management and control server is configured to send the connection establishment result to a target second client in response to an authorization instruction submitted by the first client for the target second client, wherein the authorization instruction is used for authorizing the target second client to update the cloud desktop data to be shared;

and the target second client is configured to establish connection with the cloud desktop server according to the address information of the cloud desktop server and the first transmission protocol contained in the connection establishment result, and disconnect the connection with the streaming media server.

Optionally, the first client is further configured to: detecting a consumption result of a target type resource, determining a receiving code rate of cloud desktop data to be shared according to the consumption result, and sending a downloading request of the cloud desktop data to be shared corresponding to the receiving code rate to the cloud desktop server through the first transmission protocol;

the cloud desktop server is further configured to process the cloud desktop data to be shared based on the receiving code rate, generate a corresponding multimedia fragment, and send the multimedia fragment to the first client.

According to a fourth aspect of embodiments herein, there is provided a computing device comprising:

a memory and a processor;

the memory is used for storing computer executable instructions, and the processor is used for executing the computer executable instructions to realize the steps of any one of the data processing methods.

According to a fifth aspect of embodiments herein, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of any one of the data processing methods.

According to a sixth aspect of embodiments herein, there is provided a computer program, wherein the computer program, when executed in a computer, causes the computer to perform the steps of the above-mentioned data processing method.

In one embodiment of the description, a cloud desktop operation instruction transmitted by a first client through a first transmission protocol is acquired by responding to a cloud desktop sharing request of the first client, wherein the first transmission protocol is a cloud desktop transmission protocol, the cloud desktop operation instruction is analyzed based on the first transmission protocol, cloud desktop data to be shared are generated according to an analysis result, the cloud desktop data to be shared are multicast to at least two second clients through a second transmission protocol, the cloud desktop data to be shared are used for being analyzed by each second client, the analysis result is rendered and displayed, and the second transmission protocol is a protocol supporting multicast.

In the embodiment of the description, a cloud desktop sharing and cooperation method combining a first transmission protocol and a second transmission protocol supporting multicast is adopted, so that the processing load of a remote cloud desktop server on multiple connections can be reduced, and the image real-time performance can be enhanced to improve the experience of a user.

Drawings

FIG. 1 is a flow diagram of a data processing method provided in one embodiment of the present description;

FIG. 2 is a schematic diagram of a first data processing procedure provided in one embodiment of the present description;

FIG. 3 is a diagram illustrating a second data processing procedure provided in one embodiment of the present description;

FIG. 4 is an architecture diagram of a data processing system provided in one embodiment of the present description;

FIG. 5 is an interaction diagram of a first data processing process provided by an embodiment of the present specification;

FIG. 6 is an interaction diagram of a second data processing process provided by one embodiment of the present specification;

fig. 7 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present specification;

fig. 8 is a block diagram of a computing device according to an embodiment of the present disclosure.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, as those skilled in the art will be able to make and use the present disclosure without departing from the spirit and scope of the present disclosure.

The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in one or more embodiments of the present specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first can also be referred to as a second and, similarly, a second can also be referred to as a first without departing from the scope of one or more embodiments of the present description. The word "if," as used herein, may be interpreted as "at … …" or "when … …" or "in response to a determination," depending on the context.

First, the noun terms to which one or more embodiments of the present specification relate are explained.

Cloud desktop/cloud application: the cloud computing method is applied, computing and storage are achieved at the cloud end through a transmission protocol, virtual desktop/application services are provided, and the cloud computing method has the advantages of centralized management, safety, reliability, cost saving, greenness, energy saving and the like. The user can break through the limitations of time, place, terminal and application, and can access the cloud desktop to work at any time and any place.

Pushing flow: and the cloud end encodes the collected multimedia resources and then sends the encoded multimedia resources to the streaming media server. Correspondingly, the client obtains the data of the streaming media server through stream pulling, and decoding, rendering and the like are carried out.

RTSP: real Time Streaming Protocol, a text-based Real-Time Streaming Protocol, is an application layer Protocol in a TCP/IP Protocol system, and defines how a one-to-many application program can effectively transmit multimedia data through an IP network, and realize multi-connection video sharing through technologies such as live broadcast, on-demand and multicast.

Spice: simple Protocol for Independent Computing Environment (standalone Computing Environment Simple Protocol), and open-source virtual desktop transmission Protocol, and the multi-user sharing and cooperation requirement of the cloud desktop/cloud application is realized by supporting a mode that a plurality of network devices are simultaneously connected with the cloud desktop/cloud application.

More and more schools and institutions are moving the original offline teaching work to the online. In the teaching mode, the teaching assistant main body generally needs to share the current screen of the teaching assistant main body for other course audiences, for example, a teacher shares a desktop for students to explain classroom knowledge, and the students can practice in classroom by operating the desktop. Many such teaching products are deployed in a public cloud network environment, and if a desktop is shared with a plurality of objects at the same time, the influence of pressure and delay of network bandwidth is inevitable, so that the cost is increased and the experience is reduced.

The connection support capability of the common remote desktop protocol to multiple users is not high, so that when the number of connections is too large, the server cannot bear corresponding load. Although a common multicast protocol can support strong real-time connection, the cooperation is not strong, and the cooperative operation among multiple ends cannot be realized.

Based on this, in a multi-path-based stream pushing manner, by responding to a cloud desktop sharing request of a first client, a cloud desktop operation instruction transmitted by the first client through a first transmission protocol is acquired, where the first transmission protocol is a cloud desktop transmission protocol, the cloud desktop operation instruction is analyzed based on the first transmission protocol, cloud desktop data to be shared is generated according to an analysis result, the cloud desktop data to be shared is multicast to at least two second clients through a second transmission protocol, where the cloud desktop data to be shared is used for being analyzed by each second client, and the analysis result is rendered and displayed, and the second transmission protocol is a protocol supporting multicast.

In the present specification, a data processing method is provided, and the present specification relates to a data processing system, a data processing apparatus, a computing device, a computer-readable storage medium, and a computer program, which are described in detail one by one in the following embodiments.

Fig. 1 shows a flowchart of a data processing method provided in accordance with an embodiment of the present specification, which specifically includes the following steps.

Step 102, responding to a cloud desktop sharing request of a first client, and acquiring a cloud desktop operation instruction transmitted by the first client through a first transmission protocol, wherein the first transmission protocol is a cloud desktop transmission protocol.

The data processing method provided by the embodiment of the specification is applied to a cloud desktop server.

The cloud desktop operation instruction is to perform operations such as moving, deleting and modifying on desktop contents of the cloud desktop; the desktop content of the cloud desktop may be multimedia data including, but not limited to, video data, audio data, picture data, text data, and the like.

In practical application, when a user has a requirement for performing cloud desktop sharing on at least two other users, a cloud desktop sharing request can be sent to a cloud desktop server through a client of the user, so that a first client, namely the client of the user with the requirement for cloud desktop sharing, exists; and the clients of the other at least two users are the second clients.

For example, in an online teaching scene, a first client may be a client of a teacher performing teaching, and a second client may be a client of a student; in a live scene, the first client may be a client of a main broadcast, and the second client may be a client of a user watching a live broadcast.

In specific implementation, before a cloud desktop sharing request of a first client is received, connection with the first client can be established through the first transmission protocol, and a first input data channel of the first client is established;

correspondingly, the cloud desktop operation instruction transmitted by the first client through the first transmission protocol is obtained, and specifically, the cloud desktop operation instruction transmitted by the first client through the first input data channel can be obtained.

In the current practical application scenario, the first client and the second client are both connected with the cloud desktop server through a spice protocol to receive cloud desktop data to be shared. Each client is a flat concept and can operate the cloud desktop at the same time. When any client needs to access the cloud desktop through the public network environment, each connection session needs to transmit the same streaming media data, so that the cloud desktop server bears a larger workload, pressure is caused to network bandwidth, problems of network delay, network jitter and the like are caused, the network bandwidth cost is increased, and the experience is reduced; in addition, for the client that only needs to view the screen content, establishing a redundant input data channel will inevitably cause a waste of resources.

And under the condition that the cloud desktop server establishes connection with each client through a second transmission protocol supporting multicast, the second transmission protocol can transmit the remote multimedia data to a plurality of clients only through one path of bandwidth by means of a network multicast protocol. Therefore, it can be considered to replace the spice protocol with the second transport protocol supporting multicast, but the second transport protocol supporting multicast only supports the client to perform simple video stream control operations, such as play, pause, and speed-up. The content of the video stream cannot be interfered with.

Therefore, the embodiments of the present disclosure adopt a combination of a first transport protocol, i.e., a cloud desktop transport protocol, and a second transport protocol supporting multicast to solve the above problem. The first client may have a need for updating cloud desktop data, that is, the first client needs to interfere with content of a video stream, and the second client does not have the need, for example, in a teaching scene, a teacher needs to turn pages of a teaching courseware or needs to add, delete or adjust courseware content, and a student only needs to watch the courseware content without extra operation.

Based on the method, connection can be established between the first client and the cloud desktop server through a first transmission protocol, namely a cloud desktop transmission protocol, so that the first client can adjust and update the cloud desktop data based on the cloud desktop transmission protocol.

In addition, the first client needs to perform desktop sharing on the at least two second clients, and the cloud desktop server needs to send the cloud desktop data to be shared of the first client to the at least two second clients; or after the first client updates the to-be-shared cloud desktop data, the cloud desktop server further needs to send an update result to the at least two second clients. Therefore, after the connection between the cloud desktop server and the first client is established, an input data channel of the first client can be established in the cloud desktop server, and the input data channel is used for receiving a cloud desktop operation instruction sent by the first client or receiving a data updating instruction sent by the first client.

And 104, analyzing the cloud desktop operation instruction based on the first transmission protocol, and generating to-be-shared cloud desktop data according to an analysis result.

Specifically, the cloud desktop server may send the initial cloud desktop data to the first client, and the first client operates the initial cloud desktop data according to an update requirement of the first client to generate a corresponding cloud desktop operation instruction and send the cloud desktop operation instruction to the cloud desktop server.

The cloud desktop operation instruction can carry a data updating mode of the initial cloud desktop data, such as modifying and deleting the initial cloud desktop data.

After receiving the cloud desktop operation instruction, the cloud desktop server can analyze the cloud desktop operation instruction based on the first transmission protocol to obtain a data updating mode carried in the cloud desktop operation instruction, and update the initial cloud desktop data according to the data updating mode to generate the to-be-shared cloud desktop data.

And 106, multicasting the cloud desktop data to be shared to at least two second clients through a second transmission protocol, wherein the cloud desktop data to be shared is used for being analyzed by each second client, and rendering and displaying an analysis result, and the second transmission protocol is a protocol supporting multicasting.

In particular, the second transport protocol may be a real-time streaming protocol, i.e. the RTSP protocol.

As described above, in the embodiments of the present disclosure, a manner of combining a first transmission protocol and a second transmission protocol supporting multicast is adopted, and a connection is established between a first client and a cloud desktop server through the first transmission protocol, that is, a cloud desktop transmission protocol, and a connection is established between the cloud desktop server and at least two second clients through a second transmission protocol (RTSP protocol).

Therefore, after the cloud desktop server updates the initial cloud desktop data to generate the to-be-shared cloud desktop data, the to-be-shared cloud desktop data can be sent to the at least two second clients through the RTSP.

In practical application, before transmitting the cloud desktop data to be shared, the cloud desktop server may encode the cloud desktop data, and then transmit the encoding result to each second client. And after receiving the coding result, the second client can decode the coding result and then render and display the decoding result.

In specific implementation, the sending the cloud desktop data to be shared to at least two second clients through a second transmission protocol includes:

and sending the to-be-shared cloud desktop data to at least two second clients through a streaming media server by a second transmission protocol, wherein the streaming media server is respectively connected with the cloud desktop server and each second client by the second transmission protocol.

Specifically, in order to reduce the bandwidth pressure of the cloud desktop server, in the embodiment of the present specification, the streaming media server is used as an intermediate medium, and the to-be-shared cloud desktop data or the to-be-updated cloud desktop data of the cloud desktop server is sent to at least two second clients, where a schematic diagram of a specific first data processing process is shown in fig. 2.

The second client does not have the requirement for updating the cloud desktop data, and the second transmission protocol can transmit the remote multimedia data to the plurality of clients only by one path of bandwidth by means of multicast network equipment (the multicast network equipment supports the multicast protocol), so that the processing load of the remote cloud desktop server on the multiple connections is reduced. Therefore, in the case of performing transmission of the cloud desktop data to be shared by using the streaming server, the embodiments of the present specification may establish a connection between the streaming server and each second client through a second transport protocol (RTSP), and establish a connection between the cloud desktop server and the streaming server through the RTSP.

After the RTSP connection is successfully established, the cloud desktop server can encode the generated cloud desktop data to be shared and push the encoding result to the streaming media server. Correspondingly, the second client can obtain the encoding result of the cloud desktop data to be shared in a streaming media server stream pulling mode through the multicast network equipment, then decode the encoding result, and render and display the decoding result.

In specific implementation, a connection is established with a streaming media server through a second transport protocol, and a connection establishment result is uploaded to a control server, wherein the connection establishment result includes address information of the cloud desktop server and the streaming media server.

Specifically, after the cloud desktop server and the streaming media server are connected through a second transmission protocol (RTSP), the connection establishment result can be uploaded to the control server, and the control server records and stores the connection establishment result.

When a cloud desktop sharing request exists in a first client and a connection needs to be established with a cloud desktop server through a first transmission protocol, connection establishment information for establishing the connection based on the first transmission protocol, specifically, address information of the cloud desktop server, can be requested from a management and control server, and the connection can be established with the cloud desktop server based on the address information of the cloud desktop server returned by the management and control server.

Similarly, when the second client needs to receive the cloud desktop data to be shared and needs to establish a connection with the streaming media server through a second transmission protocol (RTSP), the second client may first request RTSP connection information, specifically, address information of the streaming media server, from the management and control server, and establish an RTSP connection with the streaming media server based on the address information of the streaming media server returned by the management and control server.

In specific implementation, after the cloud desktop data to be shared is sent to the second clients, the cloud desktop data to be shared can be updated based on the data update instruction in response to the data update instruction submitted by the first client for the cloud desktop data to be shared, and the update result is sent to the at least two second clients through the second transmission protocol.

Specifically, as described above, the connection between the first client and the cloud desktop server is established based on the first transmission protocol, and the first transmission protocol supports the first client to update the to-be-shared cloud desktop data, so that the first client can submit a data update instruction to the cloud desktop server for the to-be-shared cloud desktop data under the condition that the first client needs to update the to-be-shared cloud desktop data, where the data update instruction may carry a data update mode of the to-be-shared cloud desktop data, such as modifying, deleting, and the like, of the to-be-shared cloud desktop data.

After the cloud desktop server receives the data updating instruction, the cloud desktop server can update the to-be-shared cloud desktop data based on the data updating mode in the data updating instruction, and sends an updating result to the second client.

In practical application, the cloud desktop server may send the update result to the streaming media server, and then the streaming media server sends the update result to the second client.

In addition, except that the first client may adjust and update the cloud desktop data, if a target client of the at least two clients also has a requirement for adjusting and updating the desktop data, the first client may authorize the target second client to authorize the second client to adjust and update the cloud desktop data, and specifically, the following method may be implemented:

Specifically, when the cloud desktop data to be shared or the cloud desktop data to be updated are transmitted to the second client through the streaming media server, the connection is only established between the streaming media server and the second client based on the second transmission protocol, and the connection is not required to be established between the cloud desktop server and the second client.

In addition, since the RTSP cannot modify the cloud desktop content, that is, the second client cannot send the data update instruction to the cloud desktop server through the streaming media server through the RTSP protocol when there is a modification requirement for the cloud desktop content, in this case, the second client may send the connection establishment request to the cloud desktop server based on the first transmission protocol.

The first client needs to authorize the target second client, and the target second client can update the to-be-shared cloud desktop data only under the condition that the authorization is successful.

Therefore, after receiving a request for establishing a connection based on a first transmission protocol from a second client, the cloud desktop server needs to determine whether an authorization instruction sent by the first client for the target second client is received, and authorizes the target second user to adjust and update the to-be-shared cloud desktop data.

And under the condition that the authorization instruction is determined to be received, the connection with the target second client can be established through the first transmission protocol, a second input data channel of the target second client is established, and the target second client can transmit a data updating instruction through the second input data channel and update the to-be-shared cloud desktop data based on the data updating instruction.

A schematic diagram of a second data processing process provided in the embodiment of the present specification is shown in fig. 3. The cloud desktop server is connected with the first client and the target second client respectively based on a first transmission protocol, a first input data channel is established for the first client, a second input data channel is established for the target second client, the first client can transmit a data updating instruction for the initial cloud desktop data through the first input data channel, and similarly, the second client can transmit a data updating instruction for the initial cloud desktop data or the cloud desktop data to be shared through the second input data channel. After receiving a data updating instruction sent by the first client or the second client, the cloud desktop server can update the initial cloud desktop data based on the data updating instruction and send the updated data to the streaming media server, and the streaming media server sends the updated data to the second client by means of multicast network equipment (the multicast network equipment supports a multicast protocol).

In the embodiment of the description, the cloud desktop server only needs to create a small number of streaming media data channels and input data channels, and for the rest of the second clients, the cloud desktop data to be shared are transmitted in a multicast mode through an RTSP (real time streaming protocol), so that the bandwidth pressure of the cloud desktop server is greatly reduced, the data transmission delay is reduced by means of the optimization capacity of the RTSP on the weak network environment, and the use experience of a user is improved.

In addition, the cloud desktop server can also establish a multimedia data channel of the first client, and send an update result to the first client through the multimedia data channel; and (c) a second step of,

Specifically, the cloud desktop server needs to send the initial cloud desktop data to the first client, or after the first client or the target second client updates the initial cloud desktop data or the cloud desktop data to be shared, the cloud desktop server also needs to return an update result to the first client, so that the cloud desktop server can also establish a first streaming media data channel for the first client to send the initial cloud desktop data, the cloud desktop data to be shared, or the update result to the first client through the first streaming media data channel, and a specific schematic diagram is shown in fig. 3.

In addition, under the condition that the first client authorizes the target second client to modify the to-be-shared cloud desktop data, the target second client establishes connection with the cloud desktop data based on the first transmission protocol and disconnects RTSP connection with the streaming media server, so in this case, in order to ensure real-time performance and accuracy of a result displayed by the target second client, in an embodiment of the present specification, a second streaming media data channel may be established for the target second client at the cloud desktop server, so that an update result of the to-be-shared cloud desktop data is sent to the target second client through the second streaming media data channel. And for other second clients, the update result can be sent to the streaming media server through the third streaming media data channel, and then the streaming media server sends the update result to the second clients.

In the embodiment of the present description, through the combination of multiple path plug-flow modes, a sharing and collaboration scheme of a remote desktop is implemented, and meanwhile, multiple remote scene requirements can be supported: sharing screen, remote cooperation and video multicast. In addition, by means of a cloud desktop transmission protocol, multi-client remote cooperation can be supported at the same time; by means of the RTSP protocol and the multicast mode, the cloud desktop can be shared among multiple clients, and the purposes of saving bandwidth and improving instantaneity can be achieved.

In addition, in the cloud desktop sharing stage, the cloud desktop server only needs to create a small number of streaming media data channels and input data channels, and for the rest of the second clients, the cloud desktop data to be shared are transmitted in a multicast mode through an RTSP (real time streaming protocol) protocol, so that the pressure of the cloud desktop server is greatly reduced; by means of the RTSP optimization capability to the weak network environment, the data transmission delay is reduced, and the user experience is improved.

In addition, in the authorized remote cooperation stage, the connection established between the cloud desktop server and the target second client based on the second transmission protocol is switched to the connection established based on the first transmission protocol, so that the remote desktop is operated in a multicast scene.

In specific implementation, the cloud desktop server can send the cloud desktop data to be shared to the first client through the first transmission protocol.

Further, the sending the cloud desktop data to be shared to the first client through the first transmission protocol includes:

Specifically, the first transmission protocol may transmit desktop content (to-be-shared cloud desktop data) of the cloud desktop based on the web. The first client can download the desktop content of the cloud desktop by using an HTTP progressive downloading technology, and when the desktop content is transmitted by using the protocol, the desktop content is not transmitted by downloading or in the form of CBR (constant bit rate) stream, but is transmitted to the first client in the form of a series of multimedia fragments. When the first client plays the multimedia clip, the network condition may change; for example, bandwidth may be reduced or CPU capacity may be affected. Thus, if the network conditions of the first client deteriorate, the first client may request a lower bitrate encoded multimedia clip from the cloud desktop server to compensate for the local network conditions; on the contrary, if the network condition of the first client becomes better, the first client may request a multimedia clip encoded at a higher bit rate, so that the first client can smoothly play the multimedia clip, that is, the desktop content of the cloud desktop is more smoothly displayed without jamming, thereby improving the user experience.

In this embodiment of the specification, the first transmission protocol may support a user to update desktop content of the cloud desktop, so that the first client may establish connection with the cloud desktop server through the first transmission protocol when there is a need to update cloud desktop data, and send a cloud desktop operation instruction to the cloud desktop server through the first transmission protocol, so that the first client may adjust and update the cloud desktop data based on the cloud desktop transmission protocol.

In addition, the second transport protocol may be a real-time streaming protocol, i.e. the RTSP protocol. The RTSP protocol only supports the client to perform simple video stream control operations, such as play, pause, and acceleration, and cannot interfere with the content of the video stream. Therefore, when the first client needs to perform desktop sharing on at least two second clients, that is, the cloud desktop server needs to send the cloud desktop data to be shared of the first client to the at least two second clients, and the second clients do not have a need to update the cloud desktop data, in order to reduce a processing load of the cloud desktop server on connection of the multiple clients, in the embodiment of the present application, the cloud desktop server may establish connection with each second client through an RTSP protocol, and the RTSP protocol is multicast through a network, and in this case, the cloud desktop server only needs one bandwidth, and can multicast the remote multimedia data to the multiple second clients.

In practical application, the first transmission Protocol may be a Streaming media network transmission Protocol (HLS) based on HTTP, and the second transmission Protocol may also be a Real Time Messaging Protocol (RTMP) for performing Real-Time data communication based on TCP, which may be determined according to actual requirements, and is not limited herein.

In the embodiment of the specification, a cloud desktop sharing and cooperation method combining a first transmission protocol and a second transmission protocol supporting multicast is adopted, so that the processing load of a remote cloud desktop server on multiple connections can be reduced, and the image real-time performance can be enhanced to improve the experience of a user.

Fig. 4 is an architecture diagram of a data processing system provided in accordance with an embodiment of the present specification, which specifically includes:

a cloud desktop server 402, a first client 404, and at least two second clients 406;

the cloud desktop server 402 is configured to, in response to a cloud desktop sharing request of a first client 402, obtain a cloud desktop operation instruction transmitted by the first client 402 through a first transmission protocol, analyze the cloud desktop operation instruction based on the first transmission protocol, generate to-be-shared cloud desktop data according to an analysis result, and multicast the to-be-shared cloud desktop data to at least two second clients 406 through a second transmission protocol, where the first transmission protocol is a cloud desktop transmission protocol, and the second transmission protocol is a protocol supporting multicast;

the at least two second clients 406 are configured to analyze the cloud desktop data to be shared, and render and display analysis results.

Optionally, the data processing system further includes: a streaming media server 408;

correspondingly, the cloud desktop server 402 is further configured to send the cloud desktop data to be shared to the streaming media server 408 through a second transmission protocol;

the streaming media server 408 is configured to send the cloud desktop data to be shared to the at least two second clients 406 through a second transmission protocol;

Optionally, the data processing system further includes a management and control server 410;

the cloud desktop server 402 is configured to establish a connection with the streaming media server 408 through the second transport protocol, and send a connection establishment result to the management and control server 410, where the connection establishment result includes address information of the cloud desktop server 402 and the streaming media server 408;

the management and control server 410 is configured to receive and store the connection establishment result.

Optionally, the management server 410 is further configured to return the connection establishment result to the at least two second clients 406 in response to the connection establishment requests submitted by the at least two second clients 406 for the streaming media server 408;

the at least two second clients 406 are configured to establish a connection with the streaming media server 408 through a second transport protocol according to the address information of the streaming media server 408 included in the connection establishment result.

Optionally, the management and control server 410 is configured to send the connection establishment result to the target second client 406 in response to an authorization instruction submitted by the first client 404 for the target second client 406, where the authorization instruction is used to authorize the target second client 406 to update the cloud desktop data to be shared;

the target second client 406 is configured to establish a connection with the cloud desktop server 402 according to the address information of the cloud desktop server 402 and the first transmission protocol included in the connection establishment result, and disconnect the connection with the streaming media server 408.

Optionally, the first client 404 is further configured to: detecting a consumption result of a target type resource, determining a receiving code rate of cloud desktop data to be shared according to the consumption result, and sending a downloading request of the cloud desktop data to be shared, which corresponds to the receiving code rate, to the cloud desktop server 402 through the first transmission protocol;

the cloud desktop server 402 is further configured to process the cloud desktop data to be shared based on the receiving code rate, generate a corresponding multimedia segment, and send the multimedia segment to the first client 404.

Specifically, the first transmission protocol may transmit desktop content of the cloud desktop based on the web. The first client can download the desktop content of the cloud desktop by using an HTTP progressive downloading technology, and when the desktop content is transmitted by using the protocol, the desktop content is not transmitted by downloading or in the form of CBR (constant bit rate) stream, but is transmitted to the first client in the form of a series of multimedia fragments. When the first client plays the multimedia clip, the network condition may change; for example, bandwidth may be reduced or CPU capacity may be affected. Thus, if the network conditions of the first client deteriorate, the first client may request a lower bitrate encoded multimedia clip from the cloud desktop server to compensate for the local network conditions; on the contrary, if the network condition of the first client becomes better, the first client may request a multimedia clip encoded at a higher bit rate, so that the first client can smoothly play the multimedia clip, that is, the desktop content of the cloud desktop is more smoothly displayed without jamming, thereby improving the user experience.

The above is a schematic scheme of a data processing system of the present embodiment. It should be noted that the technical solution of the data processing system and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the data processing system can be referred to the description of the technical solution of the data processing method.

The following will further describe the data processing method by taking an application of the data processing system provided in this specification in an actual scene as an example, with reference to fig. 5. Fig. 5 shows an interaction diagram of a first data processing procedure provided in an embodiment of the present specification, which specifically includes the following steps.

Step 502, the cloud desktop server establishes a connection with a streaming media server through a real-time streaming protocol.

In step 504, the cloud desktop server uploads a connection establishment result to the management and control server, wherein the connection establishment result includes address information of the cloud desktop server and the streaming media server.

And the management and control server records and stores the connection establishment result.

In step 506, the first client requests the cloud desktop transport protocol connection information from the management and control server.

In step 508, the management and control server returns a connection establishment result to the first client.

Step 510, the first client sends a connection establishment request to the cloud desktop server based on the address information of the cloud desktop server in the connection establishment result, and establishes connection with the cloud desktop server through a cloud desktop transmission protocol.

Step 512, the cloud desktop server returns the initial cloud desktop data to the first client.

And 514, operating the initial cloud desktop data by the first client, and sending the generated data operation instruction to the cloud desktop server.

And the cloud desktop server updates the initial cloud desktop data based on the data operation instruction to generate the cloud desktop data to be shared.

In step 516, the second client requests the management and control server for the connection information of the real-time streaming protocol.

In step 518, the management and control server returns the connection establishment result to the second client.

Step 520, the second client sends a connection establishment request to the streaming media server based on the address information of the streaming media server in the connection establishment result, and establishes a connection with the streaming media server through a real-time streaming protocol.

Step 522, the cloud desktop server sends the cloud desktop data to be shared to the streaming media server.

Step 524, the streaming media server returns the cloud desktop data to be shared to the second client.

In the embodiment of the specification, a cloud desktop sharing and cooperation method combining a cloud desktop transmission protocol and a real-time streaming protocol (RTSP) is adopted, so that the processing load of a remote cloud desktop server on multiple connections can be reduced, and meanwhile, the image real-time performance can be enhanced to improve the experience of a user.

The following describes the data processing method by taking an application of the data processing system provided in this specification in an actual scene as an example, with reference to fig. 6. Fig. 6 shows an interaction diagram of a second data processing procedure provided in an embodiment of the present specification, which specifically includes the following steps.

In step 602, the first client determines a target second client to be authorized.

The first client can authorize the target second user to update the to-be-shared cloud desktop data.

In step 604, the first client sends an authorization instruction to the management and control server for the target second client.

Step 606, the management and control server sends the cloud desktop transport protocol connection information to the target second client.

Specifically, the cloud desktop transport protocol connection information is a connection result between the streaming media server and the cloud desktop server, and the connection establishment result includes address information of the cloud desktop server.

Step 608, the target second client sends a connection establishment request to the cloud desktop server based on the address information, and establishes a connection with the cloud desktop server through a cloud desktop transmission protocol.

In step 610, the target second client disconnects from the streaming server.

And the target second client establishes connection with the streaming media server through an RTSP. And after the target second client establishes connection with the cloud desktop server, the connection with the streaming media server is disconnected.

Step 612, the target second client sends a data updating instruction to the cloud desktop server.

And the cloud desktop server updates the to-be-shared cloud desktop data based on the data updating instruction, and generates a corresponding updating result.

And 614, the cloud desktop server sends the updating result to the target second client.

In step 616, the cloud desktop server sends the update result to the first client.

In step 618, the first client sends an authorization stop instruction to the management and control server for the target second client.

Step 620, the management and control server sends an authorization stop event to the target second client.

At step 622, the target second client disconnects from the cloud desktop server.

In step 624, the target second client recovers the connection with the streaming server.

Corresponding to the above method embodiment, the present specification further provides a data processing apparatus embodiment, and fig. 7 shows a schematic structural diagram of a data processing apparatus provided in an embodiment of the present specification. As shown in fig. 7, the apparatus includes:

an obtaining module 702, configured to obtain, in response to a cloud desktop sharing request of a first client, a cloud desktop operation instruction transmitted by the first client through a first transmission protocol, where the first transmission protocol is a cloud desktop transmission protocol;

the generating module 704 is configured to analyze the cloud desktop operation instruction based on the first transmission protocol, and generate to-be-shared cloud desktop data according to an analysis result;

the sending module 706 is configured to multicast the to-be-shared cloud desktop data to at least two second clients through a second transmission protocol, where the to-be-shared cloud desktop data is used for being analyzed by each second client, and rendering and displaying an analysis result, and the second transmission protocol is a protocol supporting multicast.

Optionally, the sending module 706 is further configured to:

sending the to-be-shared cloud desktop data to at least two second clients through a streaming media server through a second transmission protocol, wherein the streaming media server is respectively connected with the cloud desktop server and each second client through the second transmission protocol

Optionally, the data processing apparatus further includes a first establishing module configured to:

accordingly, the obtaining module 702 is further configured to:

Optionally, the data processing apparatus further includes an update module configured to:

Optionally, the data processing apparatus further includes a determining module configured to:

Optionally, the data processing apparatus further includes a second establishing module configured to:

establishing a multimedia data channel of the first client, and sending an updating result to the first client through the multimedia data channel; and (c) a second step of,

Optionally, the data processing apparatus further includes an upload module configured to:

Optionally, the data processing apparatus further includes a processing module configured to:

Optionally, the processing module is further configured to:

The above is a schematic configuration of a data processing apparatus of the present embodiment. It should be noted that the technical solution of the data processing apparatus and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the data processing apparatus can be referred to the description of the technical solution of the data processing method.

FIG. 8 illustrates a block diagram of a computing device 800, according to one embodiment of the present description. The components of the computing device 800 include, but are not limited to, a memory 810 and a processor 820. The processor 820 is coupled to the memory 810 via a bus 830, and the database 850 is used to store data.

Computing device 800 also includes access device 840, access device 840 enabling computing device 800 to communicate via one or more networks 860. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 840 may include one or more of any type of network interface (e.g., a Network Interface Card (NIC)) whether wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.

In one embodiment of the present description, the above-described components of computing device 800, as well as other components not shown in FIG. 8, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 8 is for purposes of example only and is not limiting as to the scope of the description. Those skilled in the art may add or replace other components as desired.

Computing device 800 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), a mobile phone (e.g., smartphone), a wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 800 may also be a mobile or stationary server.

Wherein the processor 820 is configured to execute computer-executable instructions that, when executed by the processor, implement the steps of the data processing method described above.

The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the data processing method.

An embodiment of the present specification further provides a computer-readable storage medium storing computer-executable instructions, which when executed by a processor implement the steps of the data processing method described above.

The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the data processing method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the data processing method.

An embodiment of the present specification further provides a computer program, wherein when the computer program is executed in a computer, the computer is caused to execute the steps of the data processing method.

The above is an illustrative scheme of a computer program of the present embodiment. It should be noted that the technical solution of the computer program and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the computer program can be referred to the description of the technical solution of the data processing method.

The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.

It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts, but those skilled in the art should understand that the present embodiment is not limited by the described acts, because some steps may be performed in other sequences or simultaneously according to the present embodiment. Furthermore, those skilled in the art will appreciate that the embodiments described in this specification are presently preferred and that no acts or modules are required in the implementations of the disclosure.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments.

The preferred embodiments of the present specification disclosed above are intended only to aid in the description of the specification. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the embodiments and the practical application, to thereby enable others skilled in the art to best understand and utilize the embodiments. The specification is limited only by the claims and their full scope and equivalents.

Claims

1. A data processing method is applied to a cloud desktop server and comprises the following steps:

responding to a cloud desktop sharing request of a first client, and acquiring a cloud desktop operating instruction transmitted by the first client through a first transmission protocol, wherein the first transmission protocol is a cloud desktop transmission protocol;

and multicasting the cloud desktop data to be shared to at least two second clients through a second transmission protocol, wherein the cloud desktop data to be shared is used for being analyzed by each second client, and rendering and displaying an analysis result, and the second transmission protocol is a protocol supporting multicast.

2. The data processing method according to claim 1, wherein the sending the cloud desktop data to be shared to at least two second clients through a second transmission protocol includes:

3. The data processing method according to claim 1 or 2, further comprising:

4. The data processing method of claim 1 or 2, further comprising:

5. The data processing method of claim 2, further comprising:

6. The data processing method of claim 5, further comprising:

7. The data processing method of claim 1, further comprising:

8. The data processing method of claim 1, the second transport protocol comprising a real-time streaming protocol.

9. A data processing system comprising:

10. The data processing system of claim 9, further comprising: a streaming media server;

11. The data processing system of claim 9, further comprising a governing server;

12. The data processing system according to claim 11, wherein the administrative server is configured to send the connection establishment result to a target second client in response to an authorization instruction submitted by the first client for the target second client, wherein the authorization instruction is used to authorize the target second client to update the to-be-shared cloud desktop data;

13. A computing device, comprising:

a memory and a processor;

the memory is for storing computer-executable instructions, and the processor is for executing the computer-executable instructions, which when executed by the processor, implement the steps of the data processing method of any one of claims 1 to 9.

14. A computer-readable storage medium storing computer-executable instructions which, when executed by a processor, implement the steps of the data processing method of any one of claims 1 to 9.