WO2023015974A1 - 云桌面会议共享方法、服务器和计算机可读存储介质 - Google Patents
云桌面会议共享方法、服务器和计算机可读存储介质 Download PDFInfo
- Publication number
- WO2023015974A1 WO2023015974A1 PCT/CN2022/091027 CN2022091027W WO2023015974A1 WO 2023015974 A1 WO2023015974 A1 WO 2023015974A1 CN 2022091027 W CN2022091027 W CN 2022091027W WO 2023015974 A1 WO2023015974 A1 WO 2023015974A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- desktop
- stream
- cloud
- server
- conference
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- 230000015654 memory Effects 0.000 claims description 68
- 238000004590 computer program Methods 0.000 claims description 17
- 238000004458 analytical method Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 27
- 238000004891 communication Methods 0.000 description 10
- 235000013599 spices Nutrition 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000013500 data storage Methods 0.000 description 4
- 238000010295 mobile communication Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000011900 installation process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Definitions
- the embodiment of the present application relates to the technical field of virtualized desktop and video conferencing, and in particular relates to a cloud desktop conference sharing method, a server and a computer-readable storage medium.
- the virtualized desktop is based on the VDI architecture based on the KVM architecture.
- Most of the computer terminal systems are placed in the background data center, which can reduce the performance standards of local processing and display devices.
- the VDI architecture has become the mainstream architecture of desktop virtualization due to its advantages of good mobility, modern cloud computing architecture design, centralized management and control, and high data security. Integrating the conference function into the cloud desktop requires communication and heartbeat connection between the terminal and the cloud desktop. At present, the technology of integrating the conference function into the cloud desktop has made some progress.
- cloud meeting and cloud desktop technology can be integrated, the function of starting a meeting in cloud desktop can be realized.
- the current integration of cloud conferences into cloud desktops is still limited.
- Some technical solutions only support sending and receiving camera video streams and microphone audio streams, and if you want to display the content on the cloud desktop for meeting members, it will be limited. As a result, it is impossible to start a cloud conference in the cloud desktop and realize the sharing of desktop stream and audio stream.
- Embodiments of the present application provide a cloud desktop conference sharing method, a server, and a computer-readable storage medium.
- the embodiment of the present application provides a cloud desktop meeting sharing method, which is applied to a cloud desktop server, and the method includes: obtaining the desktop stream, audio stream and meeting information of the cloud desktop; encoding and compressing the audio stream; encoding and compressing the desktop stream to obtain a first desktop stream and a second desktop stream, wherein the image encoding quality of the first desktop stream is higher than the image encoding quality of the second desktop stream; stream, the audio stream, and the meeting information are sent to the data conferencing server, so that the data conferencing server sends the first desktop stream and the audio stream to the cloud desktop client according to the meeting member information, and sends the Send the second desktop stream, the audio stream, and the meeting information to the media server, so that the media conference server sends the second desktop stream and the audio stream to the cloud desktop client according to the meeting member information, wherein, The conference member information is obtained by parsing the conference information by the conference server.
- the embodiment of the present application provides a cloud desktop conference sharing method, which is applied to a cloud desktop client, and the method includes: decoding the first desktop stream, the second desktop stream, and the audio stream, wherein the The first desktop stream is obtained from the data conferencing server, and the second desktop stream is obtained from the media server; by obtaining the window handle of the cloud desktop, the window of the cloud desktop is cropped, so that the first desktop is displayed in the cloud desktop The desktop stream or the second desktop stream; playing the audio stream.
- the embodiment of the present application provides a method for sharing a cloud desktop conference, which is applied to a data conference server, and the method includes: obtaining the first desktop stream, audio stream, and conference information from the cloud desktop server; sending the conference information to the conference server, so that the conference server analyzes the conference information to obtain conference member information; receives the conference member information from the conference server; sends the first desktop stream and the audio stream to the conference server according to the conference member information.
- Cloud desktop client is
- the embodiment of the present application provides a cloud desktop conference sharing method, which is applied to a media server, and the method includes: obtaining a second desktop stream, an audio stream, and conference information from the cloud desktop server; sending the conference information to the conference server , so that the conference server parses and obtains conference member information according to the conference information; receives the conference member information from the conference server; sends the second desktop stream and the audio stream to the cloud according to the conference member information Desktop client.
- the embodiment of the present application provides a cloud desktop server, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the above when executing the computer program.
- a cloud desktop server including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the above when executing the computer program.
- the embodiment of the present application provides a cloud desktop client, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the computer program is implemented when the processor executes the computer program.
- a cloud desktop client including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the computer program is implemented when the processor executes the computer program.
- the embodiment of the present application provides a data conferencing server, including: a memory, a processor, and a computer program stored on the memory and operable on the processor.
- a data conferencing server including: a memory, a processor, and a computer program stored on the memory and operable on the processor.
- the processor executes the computer program, the above-mentioned The cloud desktop conference sharing method described in the third aspect.
- the embodiment of the present application provides a media server, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the above-mentioned first item when executing the computer program.
- a media server including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the above-mentioned first item when executing the computer program.
- the embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer-executable program, and the computer-executable program is used to make the computer perform the above-mentioned first aspect.
- FIG. 1 is a schematic structural diagram of a cloud desktop conference sharing system provided by an embodiment of the present application
- Fig. 2 is a flow chart of a cloud desktop meeting sharing method (cloud desktop server side) provided by an embodiment of the present application;
- Fig. 3 is a flow chart of a cloud desktop conference sharing method (cloud desktop client side) provided by an embodiment of the present application;
- Fig. 4 is a flow chart of a cloud desktop conference sharing method provided by an embodiment of the present application (data conferencing server side);
- Fig. 5 is a flow chart (media server side) of a kind of cloud desktop conference sharing method provided by one embodiment of the present application;
- Fig. 6 is a schematic structural diagram of a cloud desktop server provided by an embodiment of the present application.
- FIG. 7 is a schematic structural diagram of a cloud desktop client provided by an embodiment of the present application.
- Fig. 8 is a schematic structural diagram of a data conferencing server provided by an embodiment of the present application.
- Fig. 9 is a schematic structural diagram of a media conference server provided by an embodiment of the present application.
- multiple means more than two, greater than, less than, exceeding, etc. are understood as not including the original number, and above, below, within, etc. are understood as including the original number. If there is a description of "first”, “second”, etc., it is only for the purpose of distinguishing technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features or implicitly indicating the indicated The sequence relationship of the technical characteristics.
- the virtualized desktop is based on the VDI architecture based on the KVM architecture.
- Most of the computer terminal systems are placed in the background data center, which can reduce the performance standards of local processing and display devices.
- the VDI architecture has become the mainstream architecture of desktop virtualization due to its advantages of good mobility, modern cloud computing architecture design, centralized management and control, and high data security. Integrating the conference function into the cloud desktop requires communication and heartbeat connection between the terminal and the cloud desktop. At present, the technology of integrating the conference function into the cloud desktop has made some progress.
- cloud meeting and cloud desktop technology can be integrated, the function of starting a meeting in cloud desktop can be realized.
- the current integration of cloud conferences into cloud desktops is still limited.
- Some technical solutions only support sending and receiving camera video streams and microphone audio streams, and if you want to display the content on the cloud desktop for meeting members, it will be limited. As a result, it is impossible to start a cloud conference in the cloud desktop and realize the sharing of desktop stream and audio stream.
- the embodiment of the present application provides a cloud desktop conference sharing method, system and computer-readable storage medium, cloud desktop server Obtain the desktop stream, audio stream and conference information of the cloud desktop, and send the conference information and encoded and compressed desktop stream and audio stream to the data conference server and media server; the conference server obtains conference information from the data conference server and media server, according to The conference information parses out the conference member information, and sends the conference member information to the data conference server and the media server; the data conference server sends the coded and compressed desktop stream and audio stream to the cloud desktop client according to the conference member information; Send the encoded and compressed desktop stream and audio stream to the cloud desktop client; the cloud desktop client decodes the encoded and compressed desktop stream and audio stream, and cuts the window of the cloud desktop to display the desktop stream in the cloud desktop.
- the cloud conference function is integrated into the cloud desktop to realize the function of sharing the desktop stream and audio stream, so as to be able to Realize the opening of cloud conferences in the cloud desktop and the sharing of desktop streams and audio streams.
- This application enables multiple users to start a conference to communicate in the same or different cloud desktop environments, and realize fast conferences in office desktops. And enable shared video in the cloud desktop, and send desktop streams and audio streams at the same time, so that users in different scenarios can hold meetings together and share information in the cloud desktop.
- FIG. 1 is a schematic structural diagram of a cloud desktop conference sharing system provided by an embodiment of the present application.
- the cloud desktop conference sharing system includes a cloud desktop server 100, a conference server 200, a data conference server (Data Conference Server, DCS) 300, a media server (Meeting Control Unit, MCU) 400 and a cloud desktop client 500.
- Data Conference Server DCS
- MCU Media Server
- the cloud desktop server 100 obtains the desktop stream, audio stream and conference information of the cloud desktop, and sends the conference information and the coded and compressed desktop stream and audio stream to the data conference server 300 and the media server 400;
- the server 300 and the media server 400 acquire meeting information, parse out the meeting member information according to the meeting information, and send the meeting member information to the data meeting server 300 and the media server 400;
- the data meeting server 300 sends the coded and compressed desktop stream and
- the audio stream is sent to the cloud desktop client 500;
- the media server 400 sends the coded and compressed desktop stream and audio stream to the designated conference member according to the meeting member information, and the cloud desktop client 500 at the receiving end receives the coded and compressed desktop stream and audio stream, Decode the encoded and compressed desktop stream and audio stream, correct the desktop stream and audio stream to synchronize, and crop the window of the cloud desktop, so that the desktop stream can be displayed in the cloud desktop and the audio stream can be played.
- the cloud conference function is integrated into the cloud desktop to realize shared desktop stream and audio stream It can also realize the sending and receiving of desktop stream and audio stream when different terminals and different operating systems access the conference, so as to realize the opening of cloud conference in the cloud desktop and realize the sharing of desktop stream and audio stream.
- the cloud desktop server 100 may include a cloud desktop agent (VDagent) 110, a cloud meeting agent (MsgPlatAgent) 120, a Spice server 130, and a virtual network card 140, so as to realize communication between the cloud desktop and the cloud meeting client 510, The communication between the cloud desktop and the conference server 200, and the communication between the cloud desktop and the DCS/MCU.
- the cloud desktop client 500 can include a cloud conference client 510 in the terminal and a VDI (Virtual Desktop Infrastructure, virtual desktop infrastructure) client 520 on the terminal.
- VDI Virtual Desktop Infrastructure, virtual desktop infrastructure
- the cloud conference client 510 is responsible for communication authentication with the conference server 200 and the media server 400 .
- the conference server 200 is a message exchange hub, communicates with each server, exchanges and transmits information, realizes the communication between the cloud desktop client 500, the data conference server 300, and the media server 400 in the cloud desktop, and can provide management conference switch and conference duration, user Login authentication, main and auxiliary stream information transmission and other functions.
- the data conferencing server may include an image processing module and a sound processing module.
- the cloud desktop server 100 sends images and sounds in the cloud desktop to the data conferencing server 300. After receiving the code stream, the data conferencing server 300 compresses the stream and sends it to a designated receiving terminal On the Internet, the cloud desktop client 500 realizes the transmission of shared images and sounds after decoding and playing.
- the media server 400 receives the main video stream and conference voice of the meeting, compresses them and sends them to the receiving end, and when initiating shared desktop, the media server 400 also plays the role of receiving and sending the desktop stream and the audio in the desktop.
- the cloud desktop server 100 may include a cloud desktop proxy 110 , a cloud conference proxy 120 and a Spice server 130 .
- the cloud desktop agent 110 is used to manage and collect the real-time information of the cloud desktop, and sends the real-time information to the cloud conference agent 120, wherein the real-time information includes conference information;
- the Spice server 130 is used to obtain the desktop stream and the audio stream of the cloud desktop , and encode and compress the desktop stream to obtain the first desktop stream and the second desktop stream, wherein the image encoding quality of the first desktop stream is higher than that of the second desktop stream;
- the cloud conference agent 120 is used to Timestamp the first desktop stream, the second desktop stream, and the audio stream, send the first desktop stream, the audio stream, and the meeting information to the data conferencing server 300, and send the second desktop stream, the audio stream, and the meeting information 400 to the media server.
- the way of encoding and compressing the desktop stream can be encoding in two formats: YUV444 and YUV420 respectively.
- the first desktop stream obtained by encoding and compressing the desktop stream in YUV444 format will be sent to the data conference server 300
- the second desktop stream obtained by encoding and compressing the desktop stream in YUV420 format will be sent to the media server 400.
- Spice server 130 can capture dynamic images in the cloud desktop, and then compress and send the acquired desktop images to the cloud conference agent 120, that is, the work of acquiring and compressing desktop images is all performed on the Spice server 130.
- the cloud conference proxy 120 is used to connect the inside of the cloud desktop and the VDI client 520 of the terminal to realize message exchange between the cloud desktop and the terminal.
- the cloud conference agent 120 also communicates with the data conference server 300 and the media server 400, and is used to send the picture of the cloud desktop to the data conference server 300 and the media server 400 through dynamic screen capture and cutting, and the encoding forms are respectively YUV444 and YUV420,
- the audio transmission in the cloud desktop is sent to the server, and both the desktop stream and the audio stream are timestamped.
- the cloud desktop agent 110 is used to manage and collect various information in the cloud desktop, realize the dynamic real-time communication between the cloud desktop and the terminal, and provide information to the cloud conference agent 120, so as to realize grabbing the window handle in the desktop and adjusting the cloud Functions such as conference occlusion relationship, cloud conference automatic logout when the cloud desktop exits, etc.
- the cloud conference proxy 120 can be adapted according to the type of operating system of the cloud desktop, wherein the type of operating system of the cloud desktop includes but not limited to Windows operating system and Linux operating system.
- Cloud conference agent 120 MsgPlatAgent
- identify the installation components The operating system of the cloud desktop and then adapt the MsgPlatAgent and its related components to realize the opening of cloud conferences in the cloud desktops of different operating systems.
- the cloud desktop server 100 may also include a virtual network card 140, which is used to connect to the network, so as to realize the sending and receiving of protocol messages such as http, sip, and udp.
- a virtual network card 140 which is used to connect to the network, so as to realize the sending and receiving of protocol messages such as http, sip, and udp.
- the data conference server 300 obtains the first desktop stream and the audio stream from the cloud conference agent 120, and sends the first desktop stream and the audio stream to the cloud desktop client 500 according to the meeting member information; Acquire the second desktop stream and audio stream, and send the second desktop stream and audio stream to the cloud desktop client 500 according to the meeting member information.
- the cloud desktop client 500 includes a cloud conference client 510, and the cloud conference client 510 decodes the received first desktop stream and the second desktop stream, and decodes the first desktop stream and the second desktop stream by matching timestamps.
- the desktop stream and the audio stream are corrected to be synchronized, and by obtaining the window handle of the cloud desktop, the window of the cloud desktop is cropped so that the first desktop stream or the second desktop stream is displayed in the cloud desktop.
- the cloud conference client 510 also obtains the Audio channel interface to play audio streams.
- the cloud desktop client can be a computer PC or a mobile phone; audio channel interfaces include but are not limited to speakers and microphones.
- the cloud desktop client it is decided to display the first desktop stream or the second desktop stream according to the decoding capability of the cloud desktop client.
- the cloud desktop client as a computer PC as an example, its decoding ability is relatively strong, and can display the first desktop stream such as YUV444 format; taking the cloud desktop client as a mobile phone end, its decoding ability is relatively weak, and it can display A second desktop stream such as YUV420 format.
- the main functions of the cloud meeting client 510 include the following: sending the user name and password to the meeting server 200 for authentication; receiving the message sent by the cloud meeting agent 120 in the cloud desktop via the VDI client 520 and sending it after processing Give conference server 200 or media server 400; Receive the message of conference server 200 or media server 400, send to the cloud meeting proxy 120 in cloud desktop server 100 after processing then; Receive the window handle information in cloud desktop, carry out to cloud meeting window Clipping to achieve a normal occlusion relationship.
- the cloud conference client 510 when the cloud conference client 510 is installed, it can be installed inside the cloud desktop server 100 and on the cloud desktop client 500.
- the cloud desktop client 500 also includes a VDI client 520, the VDI client 520 is used to obtain the user name and password of the cloud desktop, and pass the user name and password to the cloud meeting client 510, the cloud meeting client 510 sends the user name and password to the conference server 200 for authentication, and then the conference server 200 returns that the authentication is successful and the login to the cloud conference is completed.
- the embodiment of the present application also provides a cloud desktop meeting sharing method, which is applied to a cloud desktop server, and the sharing method includes but is not limited to the following steps:
- Step 201 obtaining the desktop stream, audio stream and meeting information of the cloud desktop
- Step 202 encoding and compressing the audio stream
- Step 203 encoding and compressing the desktop stream to obtain a first desktop stream and a second desktop stream, wherein the image encoding quality of the first desktop stream is higher than the image encoding quality of the second desktop stream;
- Step 204 Send the first desktop stream, audio stream, and meeting information to the data conferencing server, so that the data conferencing server sends the first desktop stream and audio stream to the cloud desktop client according to the meeting member information, and sends the second desktop stream,
- the audio stream and the conference information are sent to the media server, so that the media conference server sends the second desktop stream and the audio stream to the cloud desktop client according to the conference member information, wherein the conference member information is obtained by parsing the conference information by the conference server.
- the cloud desktop server may include a Spice server, a cloud conference proxy, and a cloud desktop proxy.
- the cloud desktop agent manages and collects the real-time information of the cloud desktop, and sends the real-time information to the cloud conference agent.
- the real-time information includes meeting information.
- the meeting server obtains the meeting information from the data meeting server and the media server, and analyzes the meeting members according to the meeting information. information, and send conference member information to the data conference server and media server.
- the Spice server obtains the desktop stream and the audio stream of the cloud desktop, encodes and compresses the desktop stream to obtain a first desktop stream and a second desktop stream, wherein the image encoding quality of the first desktop stream is higher than that of the second desktop stream.
- the cloud conference proxy sends the first desktop stream, audio stream and conference information to the data conference server, and sends the second desktop stream, audio stream and conference information to the media server.
- the way of encoding and compressing the desktop stream can be encoding in two formats: YUV444 and YUV420 respectively.
- the first desktop stream obtained by encoding and compressing the desktop stream in YUV444 format will be sent to the data conference server
- the second desktop stream obtained by encoding and compressing the desktop stream in YUV420 format will be sent to the media server.
- the cloud conference agent can stamp the first desktop stream, the second desktop stream and the audio stream according to the time in the current cloud desktop , so that the cloud desktop client can correct the first desktop stream, the second desktop stream, and the audio stream to be synchronized by matching the timestamps.
- the data conferencing server obtains the first desktop stream and audio stream from the cloud conference proxy, and sends the first desktop stream and audio stream to the cloud desktop client according to the meeting member information;
- the media server obtains the second desktop stream from the cloud conference proxy and audio stream, and send the second desktop stream and audio stream to the cloud desktop client according to the meeting member information.
- the cloud conference function is integrated into the cloud desktop to realize the function of sharing desktop stream and audio stream, so as to realize the opening of cloud conference in the cloud desktop and the sharing of desktop stream and audio stream.
- This application enables multiple users to start a conference to communicate in the same or different cloud desktop environments, and realize fast conferences in office desktops. And enable shared video in the cloud desktop, and send desktop streams and audio streams at the same time, so that users in different scenarios can hold meetings together and share information in the cloud desktop.
- the embodiment of the present application also provides a cloud desktop meeting sharing method, which is applied to the cloud desktop client, and the sharing method includes but is not limited to the following steps:
- Step 301 decoding the first desktop stream, the second desktop stream and the audio stream, wherein the first desktop stream is obtained from a data conferencing server, and the second desktop stream is obtained from a media server;
- Step 302 by obtaining the window handle of the cloud desktop, cropping the window of the cloud desktop, so that the first desktop flow or the second desktop flow is displayed in the cloud desktop;
- Step 303 playing the audio stream.
- the cloud desktop client decodes the first desktop stream obtained from the data conferencing server and the second desktop stream obtained from the media server, and crops the window of the cloud desktop by obtaining the window handle of the cloud desktop, so that The first desktop stream or the second desktop stream is displayed in the cloud desktop, and the cloud conference client also plays the audio stream through the audio channel interface.
- the cloud desktop client may be a computer PC, and audio channel interfaces include but are not limited to speakers and microphones.
- the cloud desktop client it is decided to display the first desktop stream or the second desktop stream according to the decoding capability of the cloud desktop client.
- the cloud desktop client as a computer PC as an example, its decoding ability is relatively strong, and can display the first desktop stream such as YUV444 format; taking the cloud desktop client as a mobile phone end, its decoding ability is relatively weak, and it can display A second desktop stream such as YUV420 format.
- the cloud desktop client can correct the synchronization of the first desktop stream, the second desktop stream and the audio stream by matching timestamps.
- the cloud desktop client can include the cloud conference client, and the main functions of the cloud conference client include the following: sending the user name and password to the conference server for authentication; receiving the cloud conference agent in the cloud desktop via the VDI client The messages of the conference server or media server are processed and sent to the conference server or media server; the messages of the conference server or media server are received, processed and then sent to the cloud conference agent in the cloud desktop server; the window handle information in the cloud desktop is received, and the cloud conference window is processed Clipping to achieve a normal occlusion relationship.
- the cloud conference client can be installed inside the cloud desktop server and on the cloud desktop client during installation.
- the cloud desktop client also includes a VDI client
- the VDI client is used to obtain the user name and password of the cloud desktop, and pass the user name and password to the cloud meeting client, and the cloud meeting client sends the user name and password.
- the password is authenticated to the meeting server, and then the meeting server returns the authentication to successfully complete the login to the cloud meeting. Click the cloud meeting button on the VDI toolbar, and the main interface of the cloud meeting will pop up in the cloud desktop.
- the embodiment of the present application also provides a cloud desktop conference sharing method, which is applied to a data conference server, and the sharing method includes but is not limited to the following steps:
- Step 401 obtaining the first desktop stream, audio stream and meeting information from the cloud desktop server;
- Step 402 sending the meeting information to the meeting server, so that the meeting server can analyze and obtain meeting member information according to the meeting information;
- Step 403 receiving meeting member information from the meeting server
- Step 404 sending the first desktop stream and audio stream to the cloud desktop client according to the meeting member information.
- the data conference server obtains the first desktop stream, audio stream and conference information from the cloud desktop server, sends the conference information to the conference server, so that the conference server can obtain conference member information according to the conference information analysis, and receives conference member information from the conference server. Information, send the first desktop stream and audio stream to the cloud desktop client according to the meeting member information, so that the cloud desktop client can display the first desktop stream and play the audio stream, so as to realize the opening of the cloud conference in the cloud desktop and realize the desktop stream and Sharing of audio streams.
- the embodiment of the present application also provides a cloud desktop conference sharing method, which is applied to a media server, and the sharing method includes but is not limited to the following steps:
- Step 501 obtaining the second desktop stream, audio stream and conference information from the cloud desktop server;
- Step 502 sending the conference information to the conference server, so that the conference server can analyze and obtain conference member information according to the conference information;
- Step 503 receiving meeting member information from the meeting server
- Step 504 sending the second desktop stream and audio stream to the cloud desktop client according to the meeting member information.
- the media server obtains the second desktop stream, audio stream and meeting information from the cloud desktop server, sends the meeting information to the meeting server, so that the meeting server can obtain meeting member information according to the meeting information analysis, and receives meeting member information from the meeting server , send the second desktop stream and audio stream to the cloud desktop client according to the meeting member information, so that the cloud desktop client can display the second desktop stream and play the audio stream, so as to realize the opening of the cloud conference in the cloud desktop and realize the desktop stream and audio Stream sharing.
- the cloud desktop conference sharing system includes a cloud desktop server, a conference server, a data conference server, a media server, and a cloud desktop client.
- the cloud desktop server includes a Spice server, a cloud conference proxy and a cloud desktop proxy
- the cloud desktop client includes a cloud conference client and a VDI client.
- the Spice server will dynamically capture the image in the cloud desktop through the calculation change area, and at the same time obtain the audio output channel in the cloud desktop in real time, and then package the desktop stream and audio stream Encoding and compression, encoding the captured desktop stream in YUV444 and YUV420 formats, the cloud conference proxy obtains the time in the current desktop, and stamps the desktop stream and audio stream with a time stamp (Time Stamp).
- the processing module receives and decodes the sent desktop stream and audio stream, matches the time stamp, uses the mode of video synchronization to audio to correct the audio and video synchronization, and then obtains the handle of the cloud desktop window, crops the window, and displays and shares it in the cloud desktop desktop stream.
- the cloud conference client obtains the audio channel interface on the terminal to play the audio stream.
- the embodiment of the present application also provides a cloud desktop server.
- the cloud desktop server includes: one or more processors and memories, and one processor and memories are taken as an example in FIG. 6 .
- the processor and the memory may be connected through a bus or in other ways, and connection through a bus is taken as an example in FIG. 6 .
- the memory can be used to store non-transitory software programs and non-transitory computer-executable programs, such as the cloud desktop conference sharing method in the above-mentioned embodiments of the present application.
- the processor executes the non-transitory software program and the program stored in the memory, so as to realize the cloud desktop conference sharing method in the above-mentioned embodiment of the present application.
- the memory may include a program storage area and a data storage area, wherein the program storage area may store the operating system and at least one application required by the function; data etc.
- the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage devices.
- the memory may include memory located remotely from the processor, and these remote memories may be connected to the terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
- the non-transitory software programs and programs required to realize the cloud desktop meeting sharing method in the above-mentioned embodiments of the present application are stored in the memory, and when executed by one or more processors, the cloud desktop meeting in the above-mentioned embodiments of the present application is executed.
- the sharing method executes steps 201 to 204 of the method in Figure 2 described above, the cloud desktop server obtains the desktop stream, audio stream and conference information of the cloud desktop, and sends the conference information and the coded and compressed desktop stream and audio stream Send it to the data conference server and media server; the conference server obtains conference information from the data conference server and media server, parses the conference member information according to the conference information, and sends the conference member information to the data conference server and media server; the data conference server The information sends the encoded and compressed desktop stream and audio stream to the cloud desktop client; the media server sends the encoded and compressed desktop stream and audio stream to the cloud desktop client according to the conference member information, so that the cloud desktop client can understand the encoded and compressed The desktop stream and the audio stream are decoded, the desktop stream and the audio stream are corrected to be synchronized, and the window of the cloud desktop is cropped so that the desktop stream is displayed in the cloud desktop and the audio stream is played. Based on this, the cloud conference function is integrated into the cloud desktop to realize the function of sharing
- the embodiment of the present application also provides a cloud desktop client.
- the cloud desktop client includes: one or more processors and memories, and one processor and memories are taken as an example in FIG. 7 .
- the processor and the memory may be connected through a bus or in other ways, and connection through a bus is taken as an example in FIG. 7 .
- the memory can be used to store non-transitory software programs and non-transitory computer-executable programs, such as the cloud desktop conference sharing method in the above-mentioned embodiments of the present application.
- the processor executes the non-transitory software program and the program stored in the memory, so as to realize the cloud desktop conference sharing method in the above-mentioned embodiment of the present application.
- the memory may include a program storage area and a data storage area, wherein the program storage area may store the operating system and at least one application required by the function; data etc.
- the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage devices.
- the memory may include memory located remotely from the processor, and these remote memories may be connected to the terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
- the non-transitory software programs and programs required to realize the cloud desktop meeting sharing method in the above-mentioned embodiments of the present application are stored in the memory, and when executed by one or more processors, the cloud desktop meeting in the above-mentioned embodiments of the present application is executed.
- the sharing method for example, executes steps 301 to 303 of the method in Figure 3 described above, the cloud desktop client decodes the encoded and compressed desktop stream and audio stream, and crops the window of the cloud desktop, so that in the cloud desktop Display the desktop stream, and play the audio stream.
- the cloud conference function is integrated into the cloud desktop to realize the function of sharing desktop stream and audio stream, so as to realize the opening of cloud conference in the cloud desktop and the sharing of desktop stream and audio stream.
- the embodiment of the present application also provides a data conference server.
- the data conferencing server includes: one or more processors and memories, and one processor and memories are taken as an example in FIG. 8 .
- the processor and the memory may be connected through a bus or in other ways, and connection through a bus is taken as an example in FIG. 8 .
- the memory can be used to store non-transitory software programs and non-transitory computer-executable programs, such as the cloud desktop conference sharing method in the above-mentioned embodiments of the present application.
- the processor executes the non-transitory software program and the program stored in the memory, so as to realize the cloud desktop conference sharing method in the above-mentioned embodiment of the present application.
- the memory may include a program storage area and a data storage area, wherein the program storage area may store the operating system and at least one application required by the function; data etc.
- the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage devices.
- the memory may include memory located remotely from the processor, and these remote memories may be connected to the terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
- the non-transitory software programs and programs required to realize the cloud desktop meeting sharing method in the above-mentioned embodiments of the present application are stored in the memory, and when executed by one or more processors, the cloud desktop meeting in the above-mentioned embodiments of the present application is executed.
- the sharing method for example, executes steps 401 to 404 of the method in Fig.
- the data conferencing server acquires the first desktop stream, audio stream and conference information from the cloud desktop server, and sends the conference information to the conference server, so that the conference server According to the meeting information analysis to get the meeting member information, receive the meeting member information from the meeting server, send the first desktop stream and audio stream to the cloud desktop client according to the meeting member information, so that the cloud desktop client can display the first desktop stream and play audio stream, so as to enable cloud conferences in the cloud desktop and share desktop streams and audio streams.
- the embodiment of the present application also provides a media server.
- the media server includes: one or more processors and memories, and one processor and memories are taken as an example in FIG. 9 .
- the processor and the memory may be connected through a bus or in other ways, and connection through a bus is taken as an example in FIG. 9 .
- the memory can be used to store non-transitory software programs and non-transitory computer-executable programs, such as the cloud desktop conference sharing method in the above-mentioned embodiments of the present application.
- the processor executes the non-transitory software program and the program stored in the memory, so as to realize the cloud desktop conference sharing method in the above-mentioned embodiment of the present application.
- the memory may include a program storage area and a data storage area, wherein the program storage area may store the operating system and at least one application required by the function; data etc.
- the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage devices.
- the memory may include memory located remotely from the processor, and these remote memories may be connected to the terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
- the non-transitory software programs and programs required to realize the cloud desktop meeting sharing method in the above-mentioned embodiments of the present application are stored in the memory, and when executed by one or more processors, the cloud desktop meeting in the above-mentioned embodiments of the present application is executed.
- the sharing method for example, executes steps 501 to 504 of the method in Fig.
- the media server acquires the second desktop stream, audio stream and conference information from the cloud desktop server, and sends the conference information to the conference server, so that the conference server according to Analyze the meeting information to obtain meeting member information, receive meeting member information from the meeting server, and send the second desktop stream and audio stream to the cloud desktop client according to the meeting member information, so that the cloud desktop client can display the second desktop stream and play the audio stream , to enable cloud conferences in the cloud desktop and share desktop streams and audio streams.
- the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer-executable program, and the computer-executable program is executed by one or more control processors, for example, as shown in FIG. 5
- the above-mentioned one or more processors can execute the above-mentioned cloud desktop meeting sharing method in the embodiment of the present application, for example, execute the method steps 201 to 204 in FIG. 2 described above, and in FIG. 3 method steps 301 to 303, method steps 401 to 404 in FIG. 4, and method steps 501 to 404 in FIG.
- the conference server obtains conference information from the data conference server and media server, parses the conference member information according to the conference information, and sends the conference member information to the data conference server and the media server;
- the data conferencing server sends the encoded and compressed desktop stream and audio stream to the cloud desktop client according to the conference member information;
- the media server sends the encoded and compressed desktop stream and audio stream to the cloud desktop client according to the conference member information;
- the desktop client decodes the encoded and compressed desktop stream and audio stream, corrects the desktop stream and audio stream to synchronize, and crops the window of the cloud desktop so that the desktop stream is displayed in the cloud desktop and the audio stream is played.
- the cloud conference function is integrated into the cloud desktop to realize the function of sharing the desktop stream and audio stream, and it is possible to realize the sending and receiving of the desktop stream and audio stream when different terminals and different operating systems access the conference, so as to realize Start a cloud meeting in the cloud desktop and realize the sharing of desktop stream and audio stream.
- the embodiment of this application includes: the cloud desktop server acquires the desktop stream, audio stream and conference information of the cloud desktop, and sends the conference information and the coded and compressed desktop stream and audio stream to the data conference server and the media server;
- the server and the media server obtain meeting information, analyze the meeting member information according to the meeting information, and send the meeting member information to the data meeting server and the media server;
- the data meeting server sends the coded and compressed desktop stream and audio stream to the cloud desktop according to the meeting member information client;
- the media server sends the encoded and compressed desktop stream and audio stream to the cloud desktop client according to the meeting member information;
- the cloud desktop client decodes the encoded and compressed desktop stream and audio stream, and cuts the window of the cloud desktop to Display the desktop stream in the cloud desktop and play the audio stream.
- the cloud conference function is integrated into the cloud desktop to realize the function of sharing the desktop stream and audio stream, so as to be able to Realize the opening of cloud conferences in the cloud desktop and the sharing of desktop streams and audio streams.
- This application enables multiple users to start a conference to communicate in the same or different cloud desktop environments, and realize fast conferences in office desktops. And enable shared video in the cloud desktop, and send desktop streams and audio streams at the same time, so that users in different scenarios can hold meetings together and share information in the cloud desktop.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer.
- communication media typically embodies computer readable programs, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
云桌面会议共享方法、服务器和计算机可读存储介质，通过云桌面服务器(100)、会议服务器(200)、数据会议服务器(300)、媒体服务器(400)和云桌面客户端(500)之间的相互配合，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。
Description
相关申请的交叉引用
本申请基于申请号为202110914139.7、申请日为2021年8月10日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
本申请实施例涉及虚拟化桌面和视频会议技术领域，特别是涉及一种云桌面会议共享方法、服务器和计算机可读存储介质。
虚拟化桌面是VDI架构依托于KVM架构，实现将计算机终端系统大部分放置在了后台数据中心里，能够实现降低本地处理显示设备的性能标准。VDI架构凭借其移动性好、符合现代云计算架构设计、集中管控、数据安全性高等优势成为了桌面虚拟化的主流架构。将会议功能融合到云桌面则需要涉及到终端与云桌面之间的通讯以及心跳连接，目前会议功能融合到云桌面上的技术已经得到了一些发展。
在一些情况中，虽然能够将云会议与云桌面技术融合，实现在云桌面内开启会议的功能。但是目前的云会议融合到云桌面的技术仍然有限，一些技术方案只支持在发送和接收摄像头的视频流和麦克风的音频流，而如果想为会议成员展示云桌面上的内容则会受到限制，导致无法实现云桌面内开启云会议并实现桌面流和音频流的共享。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本申请实施例提供了一种云桌面会议共享方法、服务器以及计算机可读存储介质。
第一方面，本申请实施例提供了一种云桌面会议共享方法，应用于云桌面服务器，所述方法包括：获取云桌面的桌面流、音频流和会议信息；对所述音频流编码压缩；对所述桌面流编码压缩，得到第一桌面流和第二桌面流，其中，所述第一桌面流的图像编码质量高于所述第二桌面流的图像编码质量；将所述第一桌面流、所述音频流以及所述会议信息发送给数据会议服务器，以使所述数据会议服务器根据会议成员信息发送所述第一桌面流和所述音频流给云桌面客户端，以及将所述第二桌面流、所述音频流以及所述会议信息发送给媒体服务器，以使所述媒体会议服务器根据会议成员信息发送所述第二桌面流和所述音频流给云桌面客户端，其中，所述会议成员信息由会议服务器对所述会议信息解析而得到。
第二方面，本申请实施例提供了一种云桌面会议共享方法，应用于云桌面客户端，所述方法包括：对第一桌面流、第二桌面流和音频流进行解码，其中，所述第一桌面流从数据会议服务器获得，所述第二桌面流从媒体服务器获得；通过获取云桌面的窗口句柄，裁剪所述云桌面的窗口，以使得在所述云桌面内显示所述第一桌面流或者所述第二桌面流；播放所述音频流。
第三方面，本申请实施例提供了一种云桌面会议共享方法，应用于数据会议服务器，所 述方法包括:从云桌面服务器获取第一桌面流、音频流和会议信息；发送会议信息给会议服务器，以使所述会议服务器根据所述会议信息解析得到会议成员信息；从所述会议服务器接收所述会议成员信息；根据所述会议成员信息发送所述第一桌面流和所述音频流给云桌面客户端。
第四方面，本申请实施例提供了一种云桌面会议共享方法，应用于媒体服务器，所述方法包括:从云桌面服务器获取第二桌面流、音频流和会议信息；发送会议信息给会议服务器，以使所述会议服务器根据所述会议信息解析得到会议成员信息；从所述会议服务器接收所述会议成员信息；根据所述会议成员信息发送所述第二桌面流和所述音频流给云桌面客户端。
第五方面，本申请实施例提供了一种云桌面服务器，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述计算机程序时实现如上第一方面所述的云桌面会议共享方法。
第六方面，本申请实施例提供了一种云桌面客户端，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述计算机程序时实现如上第二方面所述的云桌面会议共享方法。
第七方面，本申请实施例提供了一种数据会议服务器，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述计算机程序时实现如上第三方面所述的云桌面会议共享方法。
第八方面，本申请实施例提供了一种媒体服务器，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述计算机程序时实现如上第四方面所述的云桌面会议共享方法。
第九方面，本申请实施例提供了一种计算机可读存储介质，所述计算机可读存储介质存储有计算机可执行程序，所述计算机可执行程序用于使计算机执行如上第一方面所述的云桌面会议共享方法，或者如上第二方面所述的云桌面会议共享方法，或者如上第三方面所述的云桌面会议共享方法，或者如上第四方面所述的云桌面会议共享方法。
本申请的其它特征和优点将在随后的说明书中阐述，并且，部分地从说明书中变得显而易见，或者通过实施本申请而了解。本申请的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。
附图用来提供对本申请技术方案的进一步理解，并且构成说明书的一部分，与本申请的实施例一起用于解释本申请的技术方案，并不构成对本申请技术方案的限制。
图1为本申请一个实施例提供的一种云桌面会议共享系统的结构示意图；
图2为本申请一个实施例提供的一种云桌面会议共享方法流程图(云桌面服务器侧)；
图3为本申请一个实施例提供的一种云桌面会议共享方法流程图(云桌面客户端侧)；
图4是本申请一个实施例提供的一种云桌面会议共享方法流程图(数据会议服务器侧)；
图5是本申请一个实施例提供的一种云桌面会议共享方法流程图(媒体服务器侧)；
图6是本申请一个实施例提供的一种云桌面服务器的结构示意图；
图7是本申请一个实施例提供的一种云桌面客户端的结构示意图；
图8是本申请一个实施例提供的一种数据会议服务器的结构示意图；
图9是本申请一个实施例提供的一种媒体议服务器的结构示意图。
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本申请，并不用于限定本申请。
应了解，在本申请实施例的描述中，多个(或多项)的含义是两个以上，大于、小于、超过等理解为不包括本数，以上、以下、以内等理解为包括本数。如果有描述到“第一”、“第二”等只是用于区分技术特征为目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量或者隐含指明所指示的技术特征的先后关系。
虚拟化桌面是VDI架构依托于KVM架构，实现将计算机终端系统大部分放置在了后台数据中心里，能够实现降低本地处理显示设备的性能标准。VDI架构凭借其移动性好、符合现代云计算架构设计、集中管控、数据安全性高等优势成为了桌面虚拟化的主流架构。将会议功能融合到云桌面则需要涉及到终端与云桌面之间的通讯以及心跳连接，目前会议功能融合到云桌面上的技术已经得到了一些发展。
在一些情况中，虽然能够将云会议与云桌面技术融合，实现在云桌面内开启会议的功能。但是目前的云会议融合到云桌面的技术仍然有限，一些技术方案只支持在发送和接收摄像头的视频流和麦克风的音频流，而如果想为会议成员展示云桌面上的内容则会受到限制，导致无法实现云桌面内开启云会议并实现桌面流和音频流的共享。
针对一些技术方案中无法实现云桌面内开启云会议并实现桌面流和音频流的共享的问题，本申请实施例提供了一种云桌面会议共享方法、系统和计算机可读存储介质,云桌面服务器获取云桌面的桌面流、音频流和会议信息，并将会议信息和经过编码压缩的桌面流和音频流发给数据会议服务器和媒体服务器；会议服务器从数据会议服务器和媒体服务器获取会议信息，根据会议信息解析出会议成员信息，并发送会议成员信息给数据会议服务器和媒体服务器；数据会议服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端；媒体服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端；云桌面客户端对经过编码压缩的桌面流和音频流进行解码，通过裁剪云桌面的窗口，以使得在云桌面内显示桌面流，并播放音频流。基于此，通过云桌面服务器、会议服务器、数据会议服务器、媒体服务器和云桌面客户端之间的相互配合，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。本申请能够多个用户在相同或不同云桌面环境内，开启会议进行沟通，实现办公桌面内的快速会议。并且在云桌面内开启共享视频，同时发送桌面流和音频流，实现不同场景下的用户一起开会并共享云桌面内的信息。
如图1所示，图1是本申请一个实施例提供的一种云桌面会议共享系统的结构示意图。云桌面会议共享系统包括云桌面服务器100、会议服务器200、数据会议服务器(Data Conference Server，DCS)300、媒体服务器(Meeting Control Unit，MCU)400和云桌面客户端500。其中，云桌面服务器100获取云桌面的桌面流、音频流和会议信息，并将会议信息和经过编码压缩的桌面流和音频流发给数据会议服务器300和媒体服务器400；会议服务器200从数据会议服务器300和媒体服务器400获取会议信息，根据会议信息解析出会议 成员信息，并发送会议成员信息给数据会议服务器300和媒体服务器400；数据会议服务器300根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端500；媒体服务器400根据会议成员信息发送经过编码压缩的桌面流和音频流给指定的会议成员，接收端的云桌面客户端500接收经过编码压缩的桌面流和音频流，对经过编码压缩的桌面流和音频流进行解码，将桌面流与音频流校正至同步，并裁剪云桌面的窗口，以使得在云桌面内显示桌面流，并播放音频流。基于此，通过云桌面服务器100、会议服务器200、数据会议服务器300、媒体服务器400和云桌面客户端500之间的相互配合，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，并且能够实现在不同终端、不同操作系统接入会议是都能够进行桌面流音频流的收发，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。
可以理解的是，云桌面服务器100可以包括云桌面代理(VDagent)110、云会议代理(MsgPlatAgent)120、Spice服务器130以及虚拟网卡140，以实现云桌面与云会议客户端510之间的通讯、云桌面与会议服务器200之间的通讯、云桌面内与DCS/MCU之间通讯。云桌面客户端500可以包括终端内的云会议客户端510以及终端上的VDI(Virtual Desktop Infrastructure，虚拟桌面基础架构)客户端520，VDI客户端520负责云桌面内外的信息交换，实现云桌面与终端的消息互通，云会议客户端510负责与会议服务器200、媒体服务器400通讯鉴权。会议服务器200是消息交换枢纽，与各个服务器通信，交换传递信息，实现云桌面内云桌面客户端500、数据会议服务器300、媒体服务器400之间的通讯，能够提供管理会议开关和会议时长、用户登录鉴权、主辅流信息传递等功能。数据会议服务器可以包括图像处理模块和声音处理模块，云桌面服务器100将云桌面内的图像和声音发送给数据会议服务器300，数据会议服务器300收到码流后进行压缩，发送到指定的接收终端上，云桌面客户端500经过解码和播放，实现共享画面和声音的传递。媒体服务器400是接收会议的主视频流、会议语音，压缩发送给接收端，并且在发起共享桌面时，媒体服务器400也起到了接收和发送桌面流和桌面内音频的作用。
可以理解的是，云桌面服务器100可以包括云桌面代理110、云会议代理120和Spice服务器130。其中，云桌面代理110用于管理和收集云桌面的实时信息，并将实时信息发送给云会议代理120，其中，实时信息包括会议信息；Spice服务器130用于获取云桌面的桌面流和音频流，并对桌面流编码压缩得到第一桌面流和第二桌面流，其中，第一桌面流的图像编码质量高于第二桌面流的图像编码质量；云会议代理120用于根据当前云桌面内的时间给第一桌面流、第二桌面流和音频流打上时间戳，将第一桌面流、音频流以及会议信息发送给数据会议服务器300，以及将第二桌面流、音频流以及会议信息发送给媒体服务器400。需要说明的是，对桌面流编码压缩的方式，可以是分别采用YUV444和YUV420两种格式的编码，此情形下，对桌面流以YUV444格式编码压缩得到的第一桌面流将发送给数据会议服务器300，而对桌面流以YUV420格式编码压缩得到的第二桌面流将发送给媒体服务器400。
可以理解的是，Spice服务器130能够抓取到云桌面内的动态图像，然后将获取的桌面图像压缩和发送给云会议代理120，即获取和压缩桌面图像的工作全部在Spice服务器130上进行。
可以理解的是，云会议代理120用于连接云桌面内部和终端的VDI客户端520，实现云桌面与终端之间的消息交换。云会议代理120还与数据会议服务器300和媒体服务器400通信，用于将云桌面的画面通过动态抓屏和剪裁，发送到数据会议服务器300和媒体服务器400 中，编码形式分别为YUV444和YUV420，同时将云桌面内的音频传输发送到服务器，并在桌面流和音频流都打上时间戳。
可以理解的是，云桌面代理110用于管理并收集云桌面内的各种信息，实现云桌面和终端动态实时通讯，并提供信息给云会议代理120，从而实现抓取桌面内窗口句柄调整云会议遮挡关系、云桌面退出时云会议自动注销等功能。
可以理解的是，云会议代理120能够根据云桌面的操作系统的类型进行适配，其中，云桌面的操作系统的类型包括但不限于Windows操作系统和Linux操作系统。云会议代理120(MsgPlatAgent)，在安装包中可以存在两个版本的MsgPlatAgent，一种适用于Windows操作系统的云桌面，一种适用于Linux操作系统的云桌面，在安装过程中，识别安装组件云桌面的操作系统，然后将适配的MsgPlatAgent及其相关组件，以实现在不同操作系统的云桌面内开启云会议。
可以理解的是，云桌面服务器100还可以包括虚拟网卡140，虚拟网卡140用于连接网络，以实现http、sip、udp等协议消息的收发。
可以理解的是，数据会议服务器300从云会议代理120获取第一桌面流和音频流，根据会议成员信息发送第一桌面流和音频流给云桌面客户端500；媒体服务器400从云会议代理120获取第二桌面流和音频流，根据会议成员信息发送第二桌面流和音频流给云桌面客户端500。
可以理解的是，云桌面客户端500包括云会议客户端510，云会议客户端510对接收的第一桌面流和第二桌面流进行解码，通过匹配时间戳来将第一桌面流、第二桌面流与音频流校正至同步，并通过获取云桌面的窗口句柄，裁剪云桌面的窗口，以使得在云桌面内显示第一桌面流或者第二桌面流，云会议客户端510还通过获取到音频通道接口来播放音频流。需要说明的是，云桌面客户端可以是电脑PC，也可以手机；音频通道接口包括但不限于扬声器和麦克风。
可以理解的是，根据云桌面客户端的解码能力来决定显示第一桌面流还是第二桌面流。以云桌面客户端为电脑PC端为例，其解码能力相对较强，可以显示诸如YUV444格式的第一桌面流；以云桌面客户端为手机端为例，其解码能力相对较弱，可以显示诸如YUV420格式的第二桌面流。
可以理解的是，云会议客户端510的主要作用包括如下：将用户名称和密码发送到会议服务器200鉴权；接收云桌面内云会议代理120发送经VDI客户端520来的消息并经过处理发送给会议服务器200或媒体服务器400；接收会议服务器200或媒体服务器400的消息，经过处理然后发送到云桌面服务器100内的云会议代理120；接收云桌面内的窗口句柄信息，对云会议窗口进行剪裁，实现正常的遮挡关系。需要说明的是，云会议客户端510在安装时，可以安装在云桌面服务器100内部和云桌面客户端500上，当云桌面客户端500储存空间小、运行内存小、CPU性能较差时，在启动VDI打开云桌面时，自动判定决定使用云桌面服务器100内的云会议客户端510还是使用云桌面客户端500上的云会议客户端510，从而实现云会议的流畅使用。
可以理解的是，云桌面客户端500还包括VDI客户端520，VDI客户端520用于获取云桌面的用户名称和密码，并将用户名称和密码传递给云会议客户端510，云会议客户端510发送用户名称和密码给会议服务器200进行鉴权，然后会议服务器200返回鉴权成功完成登录 云会议，点击VDI客户端520工具栏的云会议按钮，云桌面内弹出云会议主界面。
如图2所示，本申请实施例还提供了一种云桌面会议共享方法，应用于云桌面服务器，该共享方法包括但不限于如下步骤：
步骤201，获取云桌面的桌面流、音频流和会议信息；
步骤202，对音频流编码压缩；
步骤203，对桌面流编码压缩，得到第一桌面流和第二桌面流，其中，第一桌面流的图像编码质量高于第二桌面流的图像编码质量；
步骤204，将第一桌面流、音频流以及会议信息发送给数据会议服务器，以使数据会议服务器根据会议成员信息发送第一桌面流和音频流给云桌面客户端，以及将第二桌面流、音频流以及会议信息发送给媒体服务器，以使媒体会议服务器根据会议成员信息发送第二桌面流和音频流给云桌面客户端，其中，会议成员信息由会议服务器对会议信息解析而得到。
可以理解的是，云桌面服务器可以包括Spice服务器、云会议代理和云桌面代理。云桌面代理管理和收集云桌面的实时信息，并将实时信息发送给云会议代理，其中，实时信息包括会议信息，会议服务器从数据会议服务器和媒体服务器获取会议信息，根据会议信息解析出会议成员信息，并发送会议成员信息给数据会议服务器和媒体服务器。Spice服务器获取云桌面的桌面流和音频流，并对桌面流编码压缩得到第一桌面流和第二桌面流，其中，第一桌面流的图像编码质量高于第二桌面流的图像编码质量。云会议代理将第一桌面流、音频流以及会议信息发送给数据会议服务器，以及将第二桌面流、音频流以及会议信息发送给媒体服务器。需要说明的是，对桌面流编码压缩的方式，可以是分别采用YUV444和YUV420两种格式的编码，此情形下，对桌面流以YUV444格式编码压缩得到的第一桌面流将发送给数据会议服务器，而对桌面流以YUV420格式编码压缩得到的第二桌面流将发送给媒体服务器。
可以理解的是，在对桌面流编码压缩得到第一桌面流和第二桌面流之后，云会议代理可以根据当前云桌面内的时间给第一桌面流、第二桌面流和音频流打上时间戳，以使得云桌面客户端可以通过匹配时间戳来将第一桌面流、第二桌面流与音频流校正至同步。
可以理解的是，数据会议服务器从云会议代理获取第一桌面流和音频流，根据会议成员信息发送第一桌面流和音频流给云桌面客户端；媒体服务器从云会议代理获取第二桌面流和音频流，根据会议成员信息发送第二桌面流和音频流给云桌面客户端。基于此，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。本申请能够多个用户在相同或不同云桌面环境内，开启会议进行沟通，实现办公桌面内的快速会议。并且在云桌面内开启共享视频，同时发送桌面流和音频流，实现不同场景下的用户一起开会并共享云桌面内的信息。
如图3所示，本申请实施例还提供了一种云桌面会议共享方法，应用于云桌面客户端，该共享方法包括但不限于如下步骤：
步骤301，对第一桌面流、第二桌面流和音频流进行解码，其中，第一桌面流从数据会议服务器获得，第二桌面流从媒体服务器获得；
步骤302，通过获取云桌面的窗口句柄，裁剪云桌面的窗口，以使得在云桌面内显示第一桌面流或者第二桌面流；
步骤303，播放音频流。
可以理解的是，云桌面客户端对从数据会议服务器获得的第一桌面流和从媒体服务器获 得的第二桌面流进行解码，并通过获取云桌面的窗口句柄，裁剪云桌面的窗口，以使得在云桌面内显示第一桌面流或者第二桌面流，云会议客户端还通过音频通道接口来播放音频流。需要说明的是，云桌面客户端可以是电脑PC，音频通道接口包括但不限于扬声器和麦克风。
可以理解的是，根据云桌面客户端的解码能力来决定显示第一桌面流还是第二桌面流。以云桌面客户端为电脑PC端为例，其解码能力相对较强，可以显示诸如YUV444格式的第一桌面流；以云桌面客户端为手机端为例，其解码能力相对较弱，可以显示诸如YUV420格式的第二桌面流。
可以理解的是，在对第一桌面流、第二桌面流和音频流进行解码之后，云桌面客户端可以通过匹配时间戳来将第一桌面流、第二桌面流与音频流校正至同步。
可以理解的是，云桌面客户端可以包括云会议客户端，云会议客户端的主要作用包括如下：将用户名称和密码发送到会议服务器鉴权；接收云桌面内云会议代理发送经VDI客户端来的消息并经过处理发送给会议服务器或媒体服务器；接收会议服务器或媒体服务器的消息，经过处理然后发送到云桌面服务器内的云会议代理；接收云桌面内的窗口句柄信息，对云会议窗口进行剪裁，实现正常的遮挡关系。需要说明的是，云会议客户端在安装时，可以安装在云桌面服务器内部和云桌面客户端上，当云桌面客户端储存空间小、运行内存小、CPU性能较差时，在启动VDI打开云桌面时，自动判定决定使用云桌面服务器内的云会议客户端还是使用云桌面客户端上的云会议客户端，从而实现云会议的流畅使用。
可以理解的是，云桌面客户端还包括VDI客户端，VDI客户端用于获取云桌面的用户名称和密码，并将用户名称和密码传递给云会议客户端，云会议客户端发送用户名称和密码给会议服务器进行鉴权，然后会议服务器返回鉴权成功完成登录云会议，点击VDI工具栏的云会议按钮，云桌面内弹出云会议主界面。
如图4所示，本申请实施例还提供了一种云桌面会议共享方法，应用于数据会议服务器，该共享方法包括但不限于如下步骤：
步骤401，从云桌面服务器获取第一桌面流、音频流和会议信息；
步骤402，发送会议信息给会议服务器，以使会议服务器根据会议信息解析得到会议成员信息；
步骤403，从会议服务器接收会议成员信息；
步骤404，根据会议成员信息发送第一桌面流和音频流给云桌面客户端。
可以理解的是，数据会议服务器从云桌面服务器获取第一桌面流、音频流和会议信息，发送会议信息给会议服务器，以使会议服务器根据会议信息解析得到会议成员信息，从会议服务器接收会议成员信息，根据会议成员信息发送第一桌面流和音频流给云桌面客户端，以使得云桌面客户端可以显示第一桌面流和播放音频流，以实现云桌面内开启云会议并实现桌面流和音频流的共享。
如图5所示，本申请实施例还提供了一种云桌面会议共享方法，应用于媒体服务器，该共享方法包括但不限于如下步骤：
步骤501，从云桌面服务器获取第二桌面流、音频流和会议信息；
步骤502，发送会议信息给会议服务器，以使会议服务器根据会议信息解析得到会议成员信息；
步骤503，从会议服务器接收会议成员信息；
步骤504，根据会议成员信息发送第二桌面流和音频流给云桌面客户端。
可以理解的是，媒体服务器从云桌面服务器获取第二桌面流、音频流和会议信息，发送会议信息给会议服务器，以使会议服务器根据会议信息解析得到会议成员信息，从会议服务器接收会议成员信息，根据会议成员信息发送第二桌面流和音频流给云桌面客户端，以使得云桌面客户端可以显示第二桌面流和播放音频流，以实现云桌面内开启云会议并实现桌面流和音频流的共享。
以下结合附图和具体实施例进一步介绍本申请提供的云桌面会议共享方法。
参照图1所示，以下实施例以终端性能良好、云桌面操作系统为Windows为例，云桌面会议共享系统包括云桌面服务器、会议服务器、数据会议服务器、媒体服务器和云桌面客户端。其中，云桌面服务器包括Spice服务器、云会议代理和云桌面代理，云桌面客户端包括云会议客户端和VDI客户端。
在云桌面客户端内安装云会议客户端，云桌面内安装云会议代理以及相关组件，登录云桌面时，后台先自动拉起运行云会议客户端，此时云桌面客户端终端VDI获取登录云桌面的用户名称和密码，传递给云桌面客户端的云会议客户端，然后由其通过SIP消息发送到会议服务器来进行鉴权，然后会议服务器返回鉴权成功完成登录云会议，点击VDI客户端工具栏的云会议按钮，云桌面内弹出云会议主界面。
在云会议主界面发起快速会议，入会以后发起桌面共享时，Spice服务器将通过计算变化区域动态抓取云桌面内的图像，同时实时获取云桌面内音频输出通道，然后将桌面流和音频流打包编码压缩，对抓取的桌面流进行YUV444和YUV420两种格式的编码，云会议代理获取当前桌面内的时间，给桌面流和音频流打上时间戳(Time Stamp)。将YUV444的码流发送到数据会议服务器DCS中，YUV420的码流发送到媒体服务器MCU中，音频流也分别发送到DCS和MCU中，同时将会议信息一起发送，然后DCS和MCU将会议信息发送给会议服务器，会议服务器读取会议消息后，将会议里的成员列表发送给DCS和MCU，发送消息给DCS和MCU，让DCS和MCU发送桌面流和音频流给指定的会议成员，接收端的终端处理模块接收发来的桌面流和音频流并解码，匹配时间戳，采用视频同步到音频的模式来校正音画同步，然后通过对云桌面窗口句柄的获取，裁剪窗口，在云桌面内显示共享的桌面流。同时，云会议客户端获取到终端上的音频通道接口来播放音频流。
如图6所示，本申请实施例还提供了一种云桌面服务器。
具体地，该云桌面服务器包括：一个或多个处理器和存储器，图6中以一个处理器及存储器为例。处理器和存储器可以通过总线或者其他方式连接，图6中以通过总线连接为例。
存储器作为一种非暂态计算机可读存储介质，可用于存储非暂态软件程序以及非暂态性计算机可执行程序，如上述本申请实施例中的云桌面会议共享方法。处理器通过运行存储在存储器中的非暂态软件程序以及程序，从而实现上述本申请实施例中的云桌面会议共享方法。
存储器可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储执行上述本申请实施例中的云桌面会议共享方法所需的数据等。此外，存储器可以包括高速随机存取存储器，还可以包括非暂态存储器，例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施方式中，存储器可包括相对于处理器远程设置的存储器，这些远程存储器可以通过网络连接至该终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
实现上述本申请实施例中的云桌面会议共享方法所需的非暂态软件程序以及程序存储在存储器中，当被一个或者多个处理器执行时，执行上述本申请实施例中的云桌面会议共享方法，例如，执行以上描述的图2中的方法步骤201至步骤204，云桌面服务器获取云桌面的桌面流、音频流和会议信息，并将会议信息和经过编码压缩的桌面流和音频流发给数据会议服务器和媒体服务器；会议服务器从数据会议服务器和媒体服务器获取会议信息，根据会议信息解析出会议成员信息，并发送会议成员信息给数据会议服务器和媒体服务器；数据会议服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端；媒体服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端，以使得云桌面客户端对经过编码压缩的桌面流和音频流进行解码，将桌面流与音频流校正至同步，并裁剪云桌面的窗口，以使得在云桌面内显示桌面流，并播放音频流。基于此，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。
如图7所示，本申请实施例还提供了一种云桌面客户端。
具体地，该云桌面客户端包括：一个或多个处理器和存储器，图7中以一个处理器及存储器为例。处理器和存储器可以通过总线或者其他方式连接，图7中以通过总线连接为例。
存储器作为一种非暂态计算机可读存储介质，可用于存储非暂态软件程序以及非暂态性计算机可执行程序，如上述本申请实施例中的云桌面会议共享方法。处理器通过运行存储在存储器中的非暂态软件程序以及程序，从而实现上述本申请实施例中的云桌面会议共享方法。
存储器可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储执行上述本申请实施例中的云桌面会议共享方法所需的数据等。此外，存储器可以包括高速随机存取存储器，还可以包括非暂态存储器，例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施方式中，存储器可包括相对于处理器远程设置的存储器，这些远程存储器可以通过网络连接至该终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
实现上述本申请实施例中的云桌面会议共享方法所需的非暂态软件程序以及程序存储在存储器中，当被一个或者多个处理器执行时，执行上述本申请实施例中的云桌面会议共享方法，例如，执行以上描述的图3中的方法步骤301至步骤303，云桌面客户端对经过编码压缩的桌面流和音频流进行解码，并裁剪云桌面的窗口，以使得在云桌面内显示桌面流，并播放音频流。基于此，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。
如图8所示，本申请实施例还提供了一种数据会议服务器。
具体地，该数据会议服务器包括：一个或多个处理器和存储器，图8中以一个处理器及存储器为例。处理器和存储器可以通过总线或者其他方式连接，图8中以通过总线连接为例。
存储器作为一种非暂态计算机可读存储介质，可用于存储非暂态软件程序以及非暂态性计算机可执行程序，如上述本申请实施例中的云桌面会议共享方法。处理器通过运行存储在存储器中的非暂态软件程序以及程序，从而实现上述本申请实施例中的云桌面会议共享方法。
存储器可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储执行上述本申请实施例中的云桌面会议共享方法所需的数据等。此外，存储器可以包括高速随机存取存储器，还可以包括非暂态存储器， 例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施方式中，存储器可包括相对于处理器远程设置的存储器，这些远程存储器可以通过网络连接至该终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
实现上述本申请实施例中的云桌面会议共享方法所需的非暂态软件程序以及程序存储在存储器中，当被一个或者多个处理器执行时，执行上述本申请实施例中的云桌面会议共享方法，例如，执行以上描述的图4中的方法步骤401至步骤404，数据会议服务器从云桌面服务器获取第一桌面流、音频流和会议信息，发送会议信息给会议服务器，以使会议服务器根据会议信息解析得到会议成员信息，从会议服务器接收会议成员信息，根据会议成员信息发送第一桌面流和音频流给云桌面客户端，以使得云桌面客户端可以显示第一桌面流和播放音频流，以实现云桌面内开启云会议并实现桌面流和音频流的共享。
如图9所示，本申请实施例还提供了一种媒体服务器。
具体地，该媒体服务器包括：一个或多个处理器和存储器，图9中以一个处理器及存储器为例。处理器和存储器可以通过总线或者其他方式连接，图9中以通过总线连接为例。
存储器作为一种非暂态计算机可读存储介质，可用于存储非暂态软件程序以及非暂态性计算机可执行程序，如上述本申请实施例中的云桌面会议共享方法。处理器通过运行存储在存储器中的非暂态软件程序以及程序，从而实现上述本申请实施例中的云桌面会议共享方法。
存储器可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储执行上述本申请实施例中的云桌面会议共享方法所需的数据等。此外，存储器可以包括高速随机存取存储器，还可以包括非暂态存储器，例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施方式中，存储器可包括相对于处理器远程设置的存储器，这些远程存储器可以通过网络连接至该终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
实现上述本申请实施例中的云桌面会议共享方法所需的非暂态软件程序以及程序存储在存储器中，当被一个或者多个处理器执行时，执行上述本申请实施例中的云桌面会议共享方法，例如，执行以上描述的图5中的方法步骤501至步骤504，媒体服务器从云桌面服务器获取第二桌面流、音频流和会议信息，发送会议信息给会议服务器，以使会议服务器根据会议信息解析得到会议成员信息，从会议服务器接收会议成员信息，根据会议成员信息发送第二桌面流和音频流给云桌面客户端，以使得云桌面客户端可以显示第二桌面流和播放音频流，以实现云桌面内开启云会议并实现桌面流和音频流的共享。
此外，本申请实施例还提供了一种计算机可读存储介质，该计算机可读存储介质存储有计算机可执行程序，该计算机可执行程序被一个或多个控制处理器执行，例如，被图5中的一个处理器执行，可使得上述一个或多个处理器执行上述本申请实施例中的云桌面会议共享方法，例如，执行以上描述的图2中的方法步骤201至步骤204，图3中的方法步骤301至步骤303，图4中的方法步骤401至步骤404，图5中的方法步骤501至步骤404，云桌面服务器获取云桌面的桌面流、音频流和会议信息，并将会议信息和经过编码压缩的桌面流和音频流发给数据会议服务器和媒体服务器；会议服务器从数据会议服务器和媒体服务器获取会议信息，根据会议信息解析出会议成员信息，并发送会议成员信息给数据会议服务器和媒体服务器；数据会议服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端；媒体服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端； 云桌面客户端对经过编码压缩的桌面流和音频流进行解码，将桌面流与音频流校正至同步，并裁剪云桌面的窗口，以使得在云桌面内显示桌面流，并播放音频流。基于此，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，并且能够实现在不同终端、不同操作系统接入会议是都能够进行桌面流音频流的收发，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。
本申请实施例包括：云桌面服务器获取云桌面的桌面流、音频流和会议信息，并将会议信息和经过编码压缩的桌面流和音频流发给数据会议服务器和媒体服务器；会议服务器从数据会议服务器和媒体服务器获取会议信息，根据会议信息解析出会议成员信息，并发送会议成员信息给数据会议服务器和媒体服务器；数据会议服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端；媒体服务器根据会议成员信息发送经过编码压缩的桌面流和音频流给云桌面客户端；云桌面客户端对经过编码压缩的桌面流和音频流进行解码，通过裁剪云桌面的窗口，以使得在云桌面内显示桌面流，并播放音频流。基于此，通过云桌面服务器、会议服务器、数据会议服务器、媒体服务器和云桌面客户端之间的相互配合，将云会议功能融合到云桌面内，实现共享桌面流和音频流的功能，从而能够实现云桌面内开启云会议并实现桌面流和音频流的共享。本申请能够多个用户在相同或不同云桌面环境内，开启会议进行沟通，实现办公桌面内的快速会议。并且在云桌面内开启共享视频，同时发送桌面流和音频流，实现不同场景下的用户一起开会并共享云桌面内的信息。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统可以被实施为软件、固件、硬件及其适当的组合。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读程序、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读程序、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
以上是对本申请的一些实施进行了具体说明，但本申请并不局限于上述实施方式，熟悉本领域的技术人员在不违背本申请范围的共享条件下还可作出种种等同的变形或替换，这些等同的变形或替换均包括在本申请权利要求所限定的范围内。
Claims (13)
- 一种云桌面会议共享方法，应用于云桌面服务器，所述方法包括：获取云桌面的桌面流、音频流和会议信息；对所述音频流编码压缩；对所述桌面流编码压缩，得到第一桌面流和第二桌面流，其中，所述第一桌面流的图像编码质量高于所述第二桌面流的图像编码质量；将所述第一桌面流、所述音频流以及所述会议信息发送给数据会议服务器，以使所述数据会议服务器根据会议成员信息发送所述第一桌面流和所述音频流给云桌面客户端，以及将所述第二桌面流、所述音频流以及所述会议信息发送给媒体服务器，以使所述媒体会议服务器根据会议成员信息发送所述第二桌面流和所述音频流给云桌面客户端，其中，所述会议成员信息由会议服务器对所述会议信息解析而得到。
- 根据权利要求1所述的方法，其中，在所述对所述桌面流编码压缩，得到第一桌面流和第二桌面流之后，还包括：根据当前所述云桌面内的时间给所述第一桌面流、所述第二桌面流和所述音频流打上时间戳。
- 一种云桌面会议共享方法，应用于云桌面客户端，所述方法包括：对第一桌面流、第二桌面流和音频流进行解码，其中，所述第一桌面流从数据会议服务器获得，所述第二桌面流从媒体服务器获得；通过获取云桌面的窗口句柄，裁剪所述云桌面的窗口，以使得在所述云桌面内显示所述第一桌面流或者所述第二桌面流；播放所述音频流。
- 根据权利要求3所述的方法，其中，在所述对第一桌面流、第二桌面流和音频流进行解码之后，还包括：通过匹配时间戳来将所述第一桌面流、所述第二桌面流与所述音频流校正至同步。
- 根据权利要求3所述的方法，其中，所述播放所述音频流，包括：通过音频通道接口来播放所述音频流。
- 根据权利要求3所述的方法，还包括：获取所述云桌面的用户名称和密码；发送所述用户名称和所述密码给会议服务器进行鉴权。
- 一种云桌面会议共享方法，应用于数据会议服务器，所述方法包括：从云桌面服务器获取第一桌面流、音频流和会议信息；发送会议信息给会议服务器，以使所述会议服务器根据所述会议信息解析得到会议成员信息；从所述会议服务器接收所述会议成员信息；根据所述会议成员信息发送所述第一桌面流和所述音频流给云桌面客户端。
- 一种云桌面会议共享方法，应用于媒体服务器，所述方法包括：从云桌面服务器获取第二桌面流、音频流和会议信息；发送会议信息给会议服务器，以使所述会议服务器根据所述会议信息解析得到会议成员 信息；从所述会议服务器接收所述会议成员信息；根据所述会议成员信息发送所述第二桌面流和所述音频流给云桌面客户端。
- 一种云桌面服务器，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其中，所述处理器执行所述计算机程序时实现如权利要求1至2中任意一项所述的云桌面会议共享方法。
- 一种云桌面客户端，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其中，所述处理器执行所述计算机程序时实现如权利要求3至6中任意一项所述的云桌面会议共享方法。
- 一种数据会议服务器，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其中，所述处理器执行所述计算机程序时实现如权利要求7所述的云桌面会议共享方法。
- 一种媒体服务器，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其中，所述处理器执行所述计算机程序时实现如权利要求8所述的云桌面会议共享方法。
- 一种计算机可读存储介质，存储有计算机可执行指令，其中，所述计算机可执行指令用于执行如权利要求1至8中任意一项所述的云桌面会议共享方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110914139.7A CN115904281A (zh) | 2021-08-10 | 2021-08-10 | 云桌面会议共享方法、服务器和计算机可读存储介质 |
| CN202110914139.7 | 2021-08-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023015974A1 true WO2023015974A1 (zh) | 2023-02-16 |
Family
ID=85199794
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/091027 WO2023015974A1 (zh) | 2021-08-10 | 2022-05-05 | 云桌面会议共享方法、服务器和计算机可读存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115904281A (zh) |
| WO (1) | WO2023015974A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117714744A (zh) * | 2023-12-15 | 2024-03-15 | 广州速启科技有限责任公司 | 音视频流的数据处理方法及其云后台、云服务器和介质 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117215710B (zh) * | 2023-11-07 | 2024-01-26 | 江西联创精密机电有限公司 | 云桌面训练席位控制方法、装置、存储介质及电子设备 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103873568A (zh) * | 2014-03-04 | 2014-06-18 | 赛特斯信息科技股份有限公司 | 基于云计算实现远程虚拟桌面显示的系统及方法 |
| CN105577819A (zh) * | 2016-01-26 | 2016-05-11 | 杭州碧创科技有限公司 | 一种虚拟化桌面的分享系统、分享方法以及分享装置 |
| US20200293261A1 (en) * | 2019-03-15 | 2020-09-17 | Microsoft Technology Licensing, Llc | User Interaction with Shared Content During a Virtual Meeting |
| CN112288404A (zh) * | 2020-10-29 | 2021-01-29 | 迈普通信技术股份有限公司 | 一种会议管理方法、装置、电子设备及存储介质 |
| CN112672094A (zh) * | 2020-12-23 | 2021-04-16 | 迈普通信技术股份有限公司 | 一种云桌面会议共享方法、装置、电子设备及存储介质 |
| CN113489805A (zh) * | 2021-07-21 | 2021-10-08 | 深圳市创凯智能股份有限公司 | 一种云桌面系统的对接方法、装置、设备及存储介质 |
| CN113573004A (zh) * | 2021-02-07 | 2021-10-29 | 腾讯科技（深圳）有限公司 | 视频会议处理方法、装置、计算机设备及存储介质 |
-
2021
- 2021-08-10 CN CN202110914139.7A patent/CN115904281A/zh active Pending
-
2022
- 2022-05-05 WO PCT/CN2022/091027 patent/WO2023015974A1/zh unknown
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103873568A (zh) * | 2014-03-04 | 2014-06-18 | 赛特斯信息科技股份有限公司 | 基于云计算实现远程虚拟桌面显示的系统及方法 |
| CN105577819A (zh) * | 2016-01-26 | 2016-05-11 | 杭州碧创科技有限公司 | 一种虚拟化桌面的分享系统、分享方法以及分享装置 |
| US20200293261A1 (en) * | 2019-03-15 | 2020-09-17 | Microsoft Technology Licensing, Llc | User Interaction with Shared Content During a Virtual Meeting |
| CN112288404A (zh) * | 2020-10-29 | 2021-01-29 | 迈普通信技术股份有限公司 | 一种会议管理方法、装置、电子设备及存储介质 |
| CN112672094A (zh) * | 2020-12-23 | 2021-04-16 | 迈普通信技术股份有限公司 | 一种云桌面会议共享方法、装置、电子设备及存储介质 |
| CN113573004A (zh) * | 2021-02-07 | 2021-10-29 | 腾讯科技（深圳）有限公司 | 视频会议处理方法、装置、计算机设备及存储介质 |
| CN113489805A (zh) * | 2021-07-21 | 2021-10-08 | 深圳市创凯智能股份有限公司 | 一种云桌面系统的对接方法、装置、设备及存储介质 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117714744A (zh) * | 2023-12-15 | 2024-03-15 | 广州速启科技有限责任公司 | 音视频流的数据处理方法及其云后台、云服务器和介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115904281A (zh) | 2023-04-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12096046B2 (en) | Live streaming method and system, server, and storage medium | |
| WO2023015974A1 (zh) | 云桌面会议共享方法、服务器和计算机可读存储介质 | |
| EP3562163B1 (en) | Audio-video synthesis method and system | |
| CN105991962B (zh) | 连接方法、信息展示方法、装置及系统 | |
| KR102387161B1 (ko) | 비디오 스크린 프로젝션 방법과 장치, 컴퓨터 장비, 및 저장 매체 | |
| CN111935443B (zh) | 一种视频会议实时直播分享到即时通讯工具的方法和装置 | |
| CN110430441B (zh) | 一种云手机视频采集方法、系统、装置及存储介质 | |
| CN105610824B (zh) | 一种基于屏幕镜像及rtsp流媒体框架的屏幕共享方法 | |
| EP3515083B1 (en) | Method and apparatus for performing synchronization operation on contents | |
| CN112073543B (zh) | 一种云视频录制方法、系统和可读存储介质 | |
| CN111092898B (zh) | 报文传输方法及相关设备 | |
| WO2022135005A1 (zh) | 一种基于通话的屏幕共享方法、装置、设备及存储介质 | |
| US10362173B2 (en) | Web real-time communication from an audiovisual file | |
| CN112019877A (zh) | 基于vr设备的投屏方法、装置、设备及存储介质 | |
| CN110062268A (zh) | 一种音视频同屏播放的发送和接收处理方法及装置 | |
| CN112954433B (zh) | 视频处理方法、装置、电子设备及存储介质 | |
| CN114221909B (zh) | 数据传输方法、装置、终端及存储介质 | |
| CN104683734A (zh) | 一种视频监控的内容适配方法、系统及中心服务器、装置 | |
| CN108366044B (zh) | 一种VoIP远程音视频共享方法 | |
| EP2405649B1 (en) | Method and terminal for synchronously recording sounds and images of opposite ends based on circuit domain video telephone | |
| CN116112722B (zh) | 音频播放方法、装置、电子设备及存储介质 | |
| CN113923396B (zh) | 基于视频会议场景下的远程桌面控制方法、装置和介质 | |
| CN117880253B (zh) | 通话字幕处理方法、装置、电子设备及存储介质 | |
| WO2023051705A1 (zh) | 视频通讯方法及装置、电子设备、计算机可读介质 | |
| US20140294367A1 (en) | Information processing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22854971 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |