WO2022134928A1 - 云桌面共享到会议电视系统的方法、云桌面终端及云桌面 - Google Patents
云桌面共享到会议电视系统的方法、云桌面终端及云桌面 Download PDFInfo
- Publication number
- WO2022134928A1 WO2022134928A1 PCT/CN2021/130384 CN2021130384W WO2022134928A1 WO 2022134928 A1 WO2022134928 A1 WO 2022134928A1 CN 2021130384 W CN2021130384 W CN 2021130384W WO 2022134928 A1 WO2022134928 A1 WO 2022134928A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- cloud desktop
- conference
- stream
- desktop client
- cloud
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000012545 processing Methods 0.000 claims abstract description 73
- 230000000977 initiatory effect Effects 0.000 claims abstract description 11
- 238000004590 computer program Methods 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 230000004044 response Effects 0.000 claims description 6
- 238000012546 transfer Methods 0.000 claims description 3
- 238000004886 process control Methods 0.000 claims 2
- 230000005540 biological transmission Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Definitions
- the invention relates to the field of cloud desktop and video conference.
- the cloud desktop desktop stream can be shared to the conference TV terminal, and the desktop can be joined to the conference anytime and anywhere.
- Cloud desktops are being used more and more widely because of their features that can be accessed anytime and anywhere, and are unified and convenient for maintenance and management.
- the terminal is generally deployed in a fixed conference room, and the conference can only be held and joined in the conference room, and if it is necessary to share a personal computer or cloud desktop, only the computer Connect the video conference terminal and share the desktop through the video conference terminal dual stream.
- this method generally adopts the method of taking screenshots in the cloud desktop and then sending the screenshot content encoding to the conference TV system. to share the desktop. There are several drawbacks in this method.
- screenshots will consume a lot of resources during encoding. If the performance of the virtual machine or terminal is poor, the fluency cannot be guaranteed. Second, the resolution of screenshots and then encoding will be difficult to guarantee. For some particularly densely displayed pictures Or for drawing software, the clarity is difficult to guarantee; third, the screenshot method may leave some temporary screenshot files locally, which will bring security problems.
- the technical problem to be solved by the present invention is to provide a method, a cloud desktop terminal and a cloud desktop for fully utilizing the cloud desktop server resources and sharing all the desktop streams to the conference TV terminal through server coding, so as to realize the clear and smooth sharing of the cloud desktop anytime and anywhere.
- the present invention solves the above-mentioned technical problems, and the technical scheme adopted is:
- a method for sharing a cloud desktop to a video conference system is provided, which is characterized by comprising:
- the desktop stream of the cloud desktop client is converted into an auxiliary stream supported by the video conference system;
- the auxiliary stream supported by the converted video conference system is sent to the video conference system through the cloud desktop client.
- a method for sharing a cloud desktop to a conference television system comprising:
- the receiving cloud desktop server converts the desktop stream of the cloud desktop client into an auxiliary stream supported by the video conference terminal.
- a cloud desktop client comprising:
- a cloud desktop comprising a cloud desktop server and N cloud desktop clients, is characterized in that:
- the cloud desktop client includes:
- the cloud desktop server includes:
- the conversion module converts the desktop stream of the cloud desktop client into an auxiliary stream supported by the video conference system, and sends the converted auxiliary stream to the cloud desktop client.
- a computer-readable storage medium stores one or more computer programs, the one or more computer programs when stored by one or more When executed by each processor, the steps of the method for sharing a cloud desktop to a video conference system according to the first aspect of the present application are executed.
- a computer device characterized by comprising a processor and a memory, wherein the memory is used to store a computer program; when the processor executes the computer program stored in the memory when the cloud desktop is shared with the video conference system according to the first aspect of the present application.
- the present invention introduces a conference processing module into the cloud desktop client, and transforms the cloud desktop server.
- the conference processing module is responsible for registering with the video conference system and initiating a call to connect the cloud desktop to the video conference system. Since the conference terminal does not support the desktop stream of the cloud desktop, the RAP/ICE server needs to be modified.
- the cloud desktop server After receiving the desktop sharing message of the conference processing module, the cloud desktop server not only sends the desktop stream, but also encodes an auxiliary stream to send the desktop stream. to the video conferencing system.
- the cloud desktop itself needs to call the virtualization interface on the server side to encode and decode the desktop stream, so combine the cloud desktop with the conference TV system, and let the server of the cloud desktop encode a desktop stream and send it to the conference TV system.
- the GPU graphics card can be used for hard coding, making full use of the cloud desktop server resources. At the same time clarity is also guaranteed. And all the encoding process is completed on the server side, and it will not bring security problems.
- Figure 1 is the overall frame diagram of the system
- FIG. 2 is a structural diagram of a conference processing module
- Figure 3 is the registration process from the conference processing module to the conference AS;
- Fig. 4 is the meeting process module joining the meeting process
- Figure 5 is the flow of the shared desktop stream to the videoconferencing terminal.
- the conference processing module is a module for the cloud desktop client to process conferences, and is responsible for processing conference-related processes.
- the cloud desktop server (also known as the cloud desktop server) is responsible for processing desktop streams, encoding desktop display picture frames into desktop streams and sending them to the cloud desktop client.
- Graphics processing graphics card is a hardware graphics card device on the cloud desktop server. Some servers do not have it. If not, the server uses software encoding. If there is, the cloud desktop server calls the graphics processing graphics card for hardware encoding to improve encoding efficiency.
- the cloud desktop client is responsible for decoding and presenting the desktop stream sent by the cloud desktop server to the client.
- the conference server is responsible for the holding and management of audio and video conferences, and the negotiation of conference media streams.
- the media control unit is responsible for audio and video conference mixing and screen mixing, as well as receiving and sending auxiliary streams.
- the conference TV terminal the hard terminal of the conference, is used to access the conference in the conference room. There is no special description below, and the meaning of each module shall prevail.
- the method for sharing the cloud desktop to the conference television system of the present invention is used for the cloud desktop client to share the desktop to the conference television system, wherein the structural block diagram of the cloud desktop client is shown in Figure 1, including:
- the decoding module is responsible for decoding the desktop stream of the cloud desktop, and sending the decoded image to the client for display.
- the video processing module is responsible for collecting, encoding and sending the local camera image to the conference TV system, and sending the video stream from the conference TV system to the cloud desktop terminal for decoding and display.
- the audio processing module is responsible for collecting and encoding the sound of the local microphone and sending it to the conference TV system, and decoding and playing the audio stream sent by the conference TV system to the terminal.
- the connection module is responsible for establishing and releasing the connection between the cloud desktop client and the cloud desktop server.
- the peripheral processing module is responsible for redirecting external devices to the desktop, such as USB flash drives, printers and other interface devices.
- the composition of the conference processing module is shown in Figure 2, including the following modules:
- Control module responsible for the control of the overall process, including the initiation of cloud desktop client user registration, the initiation of the process of joining a conference, and the notification of the cloud desktop server to send auxiliary streams;
- SIP Session Initiation Protocol, Session Initiation Protocol
- Session Initiation Protocol Session Initiation Protocol
- http Hyper Text Transfer Protocol, Hyper Text Transfer Protocol
- module protocol processing block responsible for the sending and receiving processing of http messages, the conference server returns the audio and video media addresses of the media processing unit and the auxiliary stream sending media addresses to the conference processing module;
- Audio and video processing module After joining the audio and video conference, it is responsible for encoding and decoding the audio stream and video stream;
- Dual-stream processing module initiates the application of auxiliary stream to the cloud desktop server and releases the processing message; after receiving the application for auxiliary stream, the cloud desktop server compiles one H264CIF desktop stream and sends it to the cloud desktop terminal;
- Stream processing module responsible for the processing of the desktop stream. After receiving the H264CIF desktop stream from the cloud desktop server, the desktop stream is sent to the auxiliary stream channel of the media processing unit.
- Conference TV system includes:
- Conference server responsible for the holding and management of audio and video conferences, and the negotiation of conference media streams.
- the media control unit is responsible for audio and video conference mixing and screen mixing, as well as receiving and sending auxiliary streams.
- video conference terminals the hard terminals of the conference, are used to access the conference in the conference room.
- the method for sharing the cloud desktop to the conference television system in the present invention is specifically:
- Step 1 First open an account for the desktop user of the cloud desktop in the conference server of the conference TV system; the conference processing module initiates the registration process to the conference server; hold or join the conference after successful registration;
- Step 2 The conference processing module initiates the process of convening or joining a conference, the conference server responds to the request, and the two network elements complete the media negotiation through the SIP protocol; Stream the media address; after sending the address, the cloud desktop client and the media processing unit interact to transmit audio and video streams;
- Step 3 When the desktop of the cloud desktop client needs to be shared to the conference TV terminal of the conference TV system, the conference processing module initiates an application for auxiliary stream to the conference server; after the application is successful, the conference processing module notifies the cloud desktop server to program a separate H264CIF desktop The stream is sent to the cloud desktop terminal; after the conference processing module receives the desktop stream, it is directly forwarded to the auxiliary stream channel of the media processing unit without decoding. The media processing unit then forwards the auxiliary stream to the conference TV terminal, and the conference TV terminal displays the desktop to the user .
- Step 1 The conference processing module sends a message of obtaining user information to the conference server to obtain the user information and the SIP registration address, and returns the SIP registration address of the conference server after the authentication of the conference server is passed.
- Step 2 The conference processing module sends a SIP registration message to the conference server for registration, and the conference server returns a registration success response after passing the authentication;
- Step 3 The SIP registration is successful, and the conference processing module sends a message to obtain the address book, so that commonly used terminals can be invited to join the conference in subsequent conferences.
- Step 1 The conference processing module initiates a SIP call request to hold or join a conference, and the SIP call request carries the local media communication address; after receiving the call request, the conference server determines if the user is a registered user, and returns an intermediate response such as ringing and a connection response , the response message carries the audio and video media address of the media processing unit and the media address of the conference auxiliary stream;
- Step 2 After the media negotiation is completed, the conference processing module sends the audio and video streams to the media processing unit. At the same time, the media processing unit also sends the audio and video streams after mixing the audio and video to the terminal. After decoding, the terminal can display the audio and video of the conference normally. .
- Step 1 When the cloud desktop client user wants to initiate the sharing of the desktop to the videoconferencing terminal, the conference processing module first sends an auxiliary stream application request to the media processing unit. When the media processing unit determines that no other videoconference terminal currently sends the auxiliary stream, it returns the application success. message to the conference processing module;
- Step 2 After the conference processing module receives the auxiliary stream application success message, it sends a notification message to the cloud desktop server.
- the cloud desktop server receives the message, in addition to the normal desktop stream, it separately encodes the H264CIF format desktop supported by one video conference terminal. The stream is sent to the cloud desktop client.
- the server calls the GPU to perform hardware encoding to improve encoding efficiency. If the server does not have GPU resources, it directly uses the CPU of the cloud desktop server for soft encoding.
- Step 3 After receiving the desktop stream in step 2, the conference processing module sends the auxiliary stream to the media processing unit through the auxiliary stream channel
- Step 4 After receiving the auxiliary stream, the media processing unit forwards the auxiliary stream to the video conference terminal; after receiving the auxiliary stream, the video conference terminal decodes the desktop stream, and the video conference terminal can present the image and operation of the entire desktop.
- an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores one or more computer programs, the one or more computer programs when When one or more processors are running, the steps of the method for sharing a cloud desktop to a video conference system described in the above-mentioned embodiments are executed.
- the above-mentioned computer storage medium may be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk and optical disk. data storage devices, etc.
- the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk and optical disk. data storage devices, etc.
- Another embodiment of the present application also provides a computer device, including a processor and a memory;
- the processor is configured to execute the steps of the method for sharing a cloud desktop to a video conference system as described in the foregoing embodiments, for example, when running the computer program stored in the memory.
- the above-mentioned processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, referred to as CPU), a network processor (Network Processor, referred to as NP), etc.; it can also be a digital signal processor (Digital Signal Processing, referred to as DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.
- CPU Central Processing Unit
- NP Network Processor
- DSP Digital Signal Processing
- ASIC Application Specific Integrated Circuit
- FPGA Field-Programmable Gate Array
- modules described above as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules; they may be located in one place or distributed to multiple network units ; Some or all of the units can be selected according to actual needs to achieve the purpose of the solution in this embodiment.
- each functional module in each embodiment of the present invention may all be integrated in one processing unit, or each module may be separately used as a unit, or two or more modules may be integrated in one unit; the above-mentioned integration
- the unit can be implemented either in the form of hardware or in the form of hardware plus software functional units.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明公开了一种云桌面共享到会议电视系统的方法、云桌面终端及云桌面，云桌面共享到会议电视系统的方包括：建立云桌面客户端与会议电视系统的连接；通过云桌面服务器，将所述云桌面客户端的桌面流转成所述会议电视系统所支持的辅流；通过所述云桌面客户端，将转成的会议电视系统所支持的辅流发送给所述会议电视系统。本发明在云桌面客户端引入会议处理模块，会议处理模块负责到会议电视系统注册并发起呼叫将云桌面接入到会议电视系统，并通过云桌面服务器编码一路辅流发送到会议电视系统，以充分利用云桌面服务器的资源优势进行编码，实现共享桌面到会议电视终端的同时，避免了云桌面终端较差带来桌面流的不清晰和卡顿。
Description
本申请要求享有2020年12月22日提交的名称为“云桌面共享到会议电视系统的方法、云桌面终端及云桌面”的中国专利申请CN202011524056.9的优先权，其全部内容通过引用并入本文中。
本发明涉及云桌面以及视频会议领域，将云桌面和视频会议结合，可以将云桌面桌面流共享给会议电视终端，实现随时随地加入会议共享桌面。
云桌面以其随时随地可以接入，统一方便的维护和管理特性，正在得到应用越来越广泛的应用。而传统的视频会议电视系统，由于终端条件的限制，一般是将终端部署到固定的会议室，召开和加入会议都只能到会议室，并且如果需要共享个人电脑或云桌面，只能将电脑连接会议电视终端并通过会议电视终端双流来共享桌面。虽然现在视频会议也做了一些客户端软件，可以在云桌面内运行软件加入会议然后共享桌面，但是这种方式一般都是采用在云桌面内截屏然后将截屏内容编码发送给会议电视系统的方式来共享桌面。这种方式存在几个弊端，一是截屏在编码会消耗大量资源，如果虚机或终端性能比较差，流畅度难以保证；二是截屏再编码清晰度会难以保证，对于有些特别密集显示的图片或绘图软件而言，清晰度难以保证；三是截屏方式可能会在本地残留些临时截屏文件，会带来安全的问题。
发明内容
本发明所要解决的技术问题是提供一种充分利用云桌面服务器资源，通过服务器编码一路桌面流共享到会议电视终端，实现随时随地的清晰流畅地共享云桌面的方法、云桌面终端及云桌面。
本发明解决上述技术问题，采用的技术方案是：
根据本申请的第一方面，提供一种云桌面共享到会议电视系统的方法，其特征在于， 包括：
建立云桌面客户端与会议电视系统的连接；
通过云桌面服务器，将所述云桌面客户端的桌面流转成所述会议电视系统所支持的辅流；并且
通过所述云桌面客户端，将转成的会议电视系统所支持的辅流发送给所述会议电视系统。
一种云桌面共享到会议电视系统的方法，包括：
建立会议电视系统与云桌面客户端的连接；并且
接收所述云桌面服务器将云桌面客户端的桌面流转成会议电视终端所支持的辅流。
一种云桌面客户端，其特征在于，包括：
会议处理模块，用于：
会议电视系统的注册及将注册后的云桌面客户端接入到会议电视系统；
向会议电视系统发起共享申请或接受会议电视系统发起的共享邀请；
向云桌面服务器发起桌面流转换请求，并接收转换后的辅流；并且
向会议电视系统发送转换后的辅流。
一种云桌面，包括云桌面服务器及N个云桌面客户端，其特征在于：
所述云桌面客户端包括：
会议处理模块，用于：
会议电视系统的注册及将注册后的云桌面客户端接入到会议电视系统；
向会议电视系统发起共享申请或接受会议电视系统发起的共享邀请；
向云桌面服务器发起桌面流转换请求，并接收转换后的辅流；并且
向会议电视系统发送转换后的辅流；
所述云桌面服务器包括：
转换模块，将所述云桌面客户端的桌面流转成所述会议电视系统所支持的辅流，并将转换后的辅流发送给云桌面客户端。
根据本申请的第二方面，提供一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有一个或者多个计算机程序，所述一个或者多个计算机程序当被一个或者 多个处理器执行时，执行如本申请第一方面所述的云桌面共享到会议电视系统的方法的步骤。
根据本申请的第三方面，提供一种计算机设备，其特征在于，包括处理器和存储器，其中，所述存储器用于存放计算机程序；所述处理器当执行存储在所述存储器上的计算机程序时，实现如本申请第一方面所述的云桌面共享到会议电视系统的方法。
与现有技术相比，本发明的有益效果是：
本发明在云桌面客户端引入一个会议处理模块，并改造云桌面服务器。会议处理模块负责到会议电视系统注册并发起呼叫将云桌面接入到会议电视系统。由于会议终端并不支持云桌面的桌面流，RAP/ICE服务器需要改造，在收到的会议处理模块的桌面共享消息后，云桌面服务器除了发送桌面流外，还另外编码一路辅流桌面流发送到会议电视系统。云桌面本身就需要在服务端调用虚拟化接口对桌面流进行编解码处理，所以将云桌面和会议电视系统结合起来，让云桌面的服务端再编一路桌面流发给会议电视系统，就能够实现将桌面共享给会议室的会议电视终端，同时又不会受云桌面客户端的终端资源限制，如果云桌面服务器上有GPU显卡，还能利用GPU显卡进行硬编码，充分利用云桌面服务器资源，同时清晰度也有保证。并且所有的编码过程都是在服务端完成的，也不会带来安全性的问题。
图1是系统整体框架图；
图2是会议处理模块结构图；
图3是会议处理模块到会议AS注册流程；
图4是会议处理模块加入会议流程；
图5是共享桌面流到会议电视终端流程。
为了使本方案的目的、技术优点更加清楚明确，以下结合附图及实例，对本方案进行进一步详细说明。应当理解，基于本发明中的实例，本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
说明书附图中:
会议处理模块，是云桌面客户端处理会议的模块，负责处理会议相关流程的处理。
云桌面服务器(也称云桌面服务端)，负责处理桌面流，将桌面显示图片帧编码为桌面流发送到云桌面客户端。
图形处理显卡，是云桌面服务器上的硬件显卡设备，有的服务器没有，没有时服务器采用软件编码方式，如果有，云桌面服务器调用图形处理显卡进行硬件编码，提高编码效率。
云桌面客户端，负责将云桌面服务器发送的桌面流解码并呈现给客户。
会议服务器，负责音视频会议召开和管理，会议媒体流的协商。
媒体控制单元，负责音视频会议混音混屏以及辅流的接收和发送处理。
会议电视终端，会议的硬终端，用于会议室中接入会议。以下没有特殊说明，各模块的含义皆以此为准。
下面结合附图1，对发明进行详细说明：
本发明云桌面共享到会议电视系统的方法，用于云桌面客户端将桌面共享到会议电视系统，其中云桌面客户端的结构框图如图1所示，包括：
会议处理模块，用于：
会议电视系统的注册及将注册后的云桌面客户端接入到会议电视系统；
向会议电视系统发起共享申请或接受会议电视系统发起的共享邀请；
向云桌面服务器发起桌面流发送请求，并接收共享的桌面流；
向会议电视系统发送转换后的辅流。
解码模块，负责将云桌面的桌面流解码，解码后图像发给客户端展示。
视频处理模块，负责将本地摄像头图像采集并编码发送到会议电视系统，并将会议电视系统发送到云桌面终端的视频流解码展示。
音频处理模块，负责将本地麦克风的声音采集并编码发送到会议电视系统，并将会议电视系统发送到终端的音频码流解码播放。
连接模块，负责云桌面客户端与云桌面服务端的连接建立和释放。
外设处理模块，负责将外部设备的重定向到桌面内，如U盘、打印机等接口设备。
会议处理模块的构成如图2所示，包括下面几个模块：
控制模块：负责总体流程的控制，包括云桌面客户端用户注册的发起，加入会议流程发起，通知云桌面服务器发送辅流；
SIP(Session Initiation Protocol，会话初始协议)协议模块：负责SIP协议包的收发处理，在云桌面客户端的会议处理模块与会议电视系统的媒体处理单元之间建立媒体通道；
http(超文本传输协议，Hyper Text Transfer Protocol)模协议处理块：负责http消息的收发处理，由会议服务器向会议处理模块返回媒体处理单元的音视频媒体地址和辅流发送媒体地址；
音视频处理模块：加入音视频会议后，负责对音频流和视频流进行编解码处理；
双流处理模块：向云桌面服务器发起辅流的申请和释放处理消息的处理；收到辅流申请后，云桌面服务器编一路H264CIF的桌面流发送到云桌面终端；
流处理模块：负责对桌面流的处理，收到云桌面服务器下发H264CIF桌面流后，将桌面流发送给媒体处理单元的辅流通道。
会议电视系统包括：
会议服务器；负责音视频会议召开和管理，会议媒体流的协商。
媒体控制单元，负责音视频会议混音混屏以及辅流的接收和发送处理。
以及
若干个会议电视终端，会议的硬终端，用于会议室中接入会议。
本发明将云桌面共享到会议电视系统的方法，具体为：
建立云桌面客户端与会议电视系统的连接，包括：
步骤1：在会议电视系统的会议服务器中先给云桌面的桌面用户开户；会议处理模块发起到会议服务器的注册流程；注册成功后召开或加入会议；
步骤2：会议处理模块发起召开或加入会议流程，会议服务器响应请求，两个网元通过SIP协议完成媒体的协商；完成媒体的协商后，会议服务器会返回媒体处理单元的音视频媒体地址和辅流发送媒体地址；发送完地址后，云桌面客户端和媒体处理单元之间进行交互传送音频流和视频流；
步骤3：需要将云桌面客户端的桌面共享到会议电视系统的会议电视终端时，会议处理模块发起到会议服务器的辅流申请；申请成功后，会议处理模块通知云桌面服务器单独编一路H264CIF的桌面流发送到云桌面终端；会议处理模块收到桌面流后不解码直接转 发到媒体处理单元的辅辅流通道，媒体处理单元再将辅流转发给会议电视终端，会议电视终端将桌面展示给用户。
会议处理模块到会议服务器注册流程，如图3所示，具体步骤如下：
步骤1：会议处理模块发送获取用户信息消息到会议服务器获取用户信息和SIP注册地址，会议服务器鉴权通过后返回会议服务器SIP注册地址。
步骤2：会议处理模块发送SIP注册消息到会议服务器注册，会议服务器鉴权通过后返回注册成功响应；
步骤3：SIP注册成功，会议处理模块发送消息获取地址簿，以便后续会议中可以邀请常用的终端入会。
会议处理模块加入会议的流程，如图4所示，具体步骤为：
步骤1：会议处理模块发起SIP呼叫请求召开或加入会议，SIP呼叫请求携带本地媒体通信地址；会议服务器收到呼叫请求后，判断用户如果是已注册用户，返回振铃等中间响应以及接通响应，响应消息中携带媒体处理单元的音视频媒体地址以及会议辅流的媒体地址；
步骤2：媒体协商完成后，会议处理模块发送音视频流到媒体处理单元，同时媒体处理单元也会将混音混屏后的音视频流发送到终端，终端解码后可以正常呈现会议声音和图像了。
共享桌面流到会议电视终端的流程，如图5所示，步骤为：
步骤1：云桌面客户端用户要发起共享桌面到会议电视终端时，会议处理模块先发送辅流申请请求到媒体处理单元，媒体处理单元判断当前没有其他会议电视终端发送辅流时，返回申请成功消息给会议处理模块；
步骤2：会议处理模块收到辅流申请成功消息后，发送通知消息到云桌面服务器，云桌面服务器收到消息后，除了正常的桌面流外，另外单独编码一路会议电视终端支持的H264CIF格式桌面流发送给云桌面客户端。
如果服务带有GPU显卡，服务器调用GPU进行硬件编码以提高编码的效率，如果服务器没有GPU资源，直接使用云桌面服务器的CPU进行软编码。
步骤3：会议处理模块收到步骤2的桌面流后，通过辅流通道，将辅流发送给媒体处理单元
步骤4：媒体处理单元收到辅流后，将辅流转发到会议电视终端；会议电视终端收到 辅流后，解码桌面流，此时会议电视终端就能呈现整个桌面的图像和操作。
在上述实施例的基础上，本申请的一个实施例提供了一种计算机可读存储介质，所述计算机可读存储介质存储有一个或者多个计算机程序，所述一个或者多个计算机程序当被一个或者多个处理器运行时，执行上述例如实施例所描述的云桌面共享到会议电视系统的方法的步骤。
可选地，上述计算机存储介质可以是非暂时性计算机可读存储介质，例如，所述非暂时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
本申请的另一个实施例还提供了一种计算机设备，包括处理器和存储器；
存储器，用于存放计算机程序；
处理器，用于运行存储器上所存放的计算机程序时，执行上述例如实施例所描述的云桌面共享到会议电视系统的方法的步骤。
上述处理器可以是通用处理器，包括中央处理器(Central Processing Unit，简称CPU)、网络处理器(Network Processor，简称NP)等；还可以是数字信号处理器(Digital Signal Processing，简称DSP)、专用集成电路(Application Specific Integrated Circuit，简称ASIC)、现场可编程门阵列(Field-Programmable Gate Array，简称FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。
上述作为分离部件说明的模块可以是、或也可以不是物理上分开的，作为模块显示的部件可以是、或也可以不是物理性模块；既可以位于一个地方，也可以分布到多个网络单元上；可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。
另外，在本发明各实施例中的各功能模块可以全部集成在一个处理单元中，也可以是各模块分别单独作为一个单元，也可以两个或两个以上模块集成在一个单元中；上述集成的单元既可以采用硬件的形式实现，也可以采用硬件加软件功能单元的形式实现。
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以所述权利要求的保护范围为准。
Claims (16)
- 一种云桌面共享到会议电视系统的方法，其特征在于，包括：建立云桌面客户端与会议电视系统的连接；通过云桌面服务器，将所述云桌面客户端的桌面流转成所述会议电视系统所支持的辅流；通过所述云桌面客户端，将转成的会议电视系统所支持的辅流发送给所述会议电视系统。
- 根据权利要求1所述的方法，其特征在于，建立云桌面客户端与会议电视系统的连接，包括：所述云桌面客户端发出的请求连接或所述会议电视系统发出的邀请连接；所述云桌面客户端发出的请求连接包括：所述云桌面客户端向所述会议电视系统发起连接请求；所述云桌面客户端接收所述会议电视系统对连接请求的应答；所述云桌面客户端向所述会议电视系统发起共享请求；所述云桌面客户端接收所述会议电视系统对共享请求的应答；所述会议电视系统发出的邀请连接包括：所述云桌面客户端接受所述会议电视系统发起的连接邀请；所述云桌面客户端接受所述会议电视系统发起的连接邀请；所述云桌面客户端接受所述会议电视系统发起的共享邀请；所述云桌面客户端接接受所述会议电视系统发起的共享邀请。
- 根据权利要求2所述的方法，其特征在于，所述云桌面客户端与所述会议电视系统的连接成功后，所述云桌面客户端与所述会议电视系统之间发起共享申请；共享申请成功后，所述云桌面客户端通知所述云桌面服务器对云桌面客户端的桌面流进行格式转换。
- 根据权利要求3所述的方法，其特征在于，所述辅流为数字视频编码标准H264 CIF的桌面流。
- 根据权利要求1-4任一所述的方法，其特征在于，所述会议电视系统收到所述云桌面客户端发送的辅流后，通过媒体通道转发给会议电视终端。
- 一种云桌面共享到会议电视系统的方法，包括：建立会议电视系统与云桌面客户端的连接；接收所述云桌面服务器将云桌面客户端的桌面流转成会议电视终端所支持的辅流。
- 根据权利要求6所述的方法，其特征在于，所述辅流为数字视频编码标准H264 CIF的桌面流。
- 一种云桌面客户端，其特征在于，包括：会议处理模块，用于：会议电视系统的注册及将注册后的云桌面客户端接入到会议电视系统；向会议电视系统发起共享申请或接受会议电视系统发起的共享邀请；向云桌面服务器发起桌面流转换请求，并接收转换后的辅流；向会议电视系统发送转换后的辅流。
- 根据权利要求8所述的云桌面客户端，其特征在于，所述会议处理模块包括：流程控制模块：用于云桌面客户端与会议电视系统间会话发起的控制及通知云桌面服务器进行桌面流转换及发送转换后辅流的控制，其中会话发起包括注册发起及入会流程发起；协议包收发处理模块：用于所述流程控制模块会话发起协议包的收发处理，将所述云桌面客户端接入到会议电视系统；超文本信息传输模块：用于超文本信息的收发处理，将所述会议电视系统接收转换后辅流的地址发给云桌面终端；双流控制模块：用于向所述会议电视系统申请和释放双流令牌，申请令牌后可以向会议电视系统发送辅流；流处理模块：用于将收到云桌面服务器下发的辅流，发送给会议电视系统的辅流通道。
- 根据权利要求9所述的云桌面客户端，其特征在于，所述会议处理模块还包括：音视频模块：加入音视频会议后，用于对音频流和视频流进行编解码处理。
- 根据权利要求9所述的云桌面客户端，其特征在于，所述流处理模块收到的辅流为H264 CIF桌面流。
- 根据权利要求9所述的云桌面客户端，其特征在于，协议包收发处理模块：在所述云桌面客户端的会议处理模块与会议电视系统的多媒体控制单元之间建立媒体通道，将所述云桌面客户端接入到会议电视系统。
- 根据权利要求9所述的云桌面客户端，其特征在于，接收转换后辅流的地址为由会议服务器向会议处理模块返回的多媒体控制单元的音视频媒体地址和辅流发送媒体地址。
- 一种云桌面，包括云桌面服务器及N个云桌面客户端，其特征在于：所述云桌面客户端包括：会议处理模块，用于：会议电视系统的注册及将注册后的云桌面客户端接入到会议电视系统；向会议电视系统发起共享申请或接受会议电视系统发起的共享邀请；向云桌面服务器发起桌面流转换请求，并接收转换后的辅流；向会议电视系统发送转换后的辅流；所述云桌面服务器包括：转换模块，将所述云桌面客户端的桌面流转成所述会议电视系统所支持的辅流，并将转换后的辅流发送给云桌面客户端。
- 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有一个或者多个程序，所述一个或者多个程序当被一个或者多个处理器运行时，执行如权利要求1-7所述的云桌面共享到会议电视系统的方法的步骤。
- 一种计算机设备，其特征在于，包括处理器和存储器，其中，所述存储器配置为存放计算机程序；所述处理器当执行存储在所述存储器上的计算机程序时，实现如权利要求1-7所述的云桌面共享到会议电视系统的方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011524056.9A CN114727045A (zh) | 2020-12-22 | 2020-12-22 | 云桌面共享到会议电视系统的方法、云桌面终端及云桌面 |
| CN202011524056.9 | 2020-12-22 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022134928A1 true WO2022134928A1 (zh) | 2022-06-30 |
Family
ID=82158772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/130384 WO2022134928A1 (zh) | 2020-12-22 | 2021-11-12 | 云桌面共享到会议电视系统的方法、云桌面终端及云桌面 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114727045A (zh) |
| WO (1) | WO2022134928A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117319592A (zh) * | 2023-12-01 | 2023-12-29 | 银河麒麟软件(长沙)有限公司 | 一种云桌面摄像头重定向方法、系统及介质 |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140040360A1 (en) * | 2011-12-07 | 2014-02-06 | Adobe Systems Incorporated | Methods and systems for establishing, hosting and managing a screen sharing session involving a virtual environment |
| CN103650458A (zh) * | 2013-08-16 | 2014-03-19 | 华为技术有限公司 | 媒体流的传输方法、装置与系统 |
| US20150003313A1 (en) * | 2013-06-28 | 2015-01-01 | Vmware, Inc. | Remote desktop sharing for wireless environment |
| CN105357545A (zh) * | 2015-11-03 | 2016-02-24 | 北京英梅吉科技有限公司 | 基于流媒体方式的无线同屏方法及装置 |
| CN105577819A (zh) * | 2016-01-26 | 2016-05-11 | 杭州碧创科技有限公司 | 一种虚拟化桌面的分享系统、分享方法以及分享装置 |
| WO2018010690A1 (zh) * | 2016-07-15 | 2018-01-18 | 中兴通讯股份有限公司 | 视频会议的实现方法、装置及系统、云桌面终端 |
| CN110392047A (zh) * | 2019-07-02 | 2019-10-29 | 华为技术有限公司 | 数据传输方法、装置及设备 |
| CN111399964A (zh) * | 2020-03-27 | 2020-07-10 | 重庆海云捷迅科技有限公司 | 一种基于视频串流技术的云桌面平台 |
-
2020
- 2020-12-22 CN CN202011524056.9A patent/CN114727045A/zh active Pending
-
2021
- 2021-11-12 WO PCT/CN2021/130384 patent/WO2022134928A1/zh unknown
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140040360A1 (en) * | 2011-12-07 | 2014-02-06 | Adobe Systems Incorporated | Methods and systems for establishing, hosting and managing a screen sharing session involving a virtual environment |
| US20150003313A1 (en) * | 2013-06-28 | 2015-01-01 | Vmware, Inc. | Remote desktop sharing for wireless environment |
| CN103650458A (zh) * | 2013-08-16 | 2014-03-19 | 华为技术有限公司 | 媒体流的传输方法、装置与系统 |
| CN105357545A (zh) * | 2015-11-03 | 2016-02-24 | 北京英梅吉科技有限公司 | 基于流媒体方式的无线同屏方法及装置 |
| CN105577819A (zh) * | 2016-01-26 | 2016-05-11 | 杭州碧创科技有限公司 | 一种虚拟化桌面的分享系统、分享方法以及分享装置 |
| WO2018010690A1 (zh) * | 2016-07-15 | 2018-01-18 | 中兴通讯股份有限公司 | 视频会议的实现方法、装置及系统、云桌面终端 |
| CN110392047A (zh) * | 2019-07-02 | 2019-10-29 | 华为技术有限公司 | 数据传输方法、装置及设备 |
| CN111399964A (zh) * | 2020-03-27 | 2020-07-10 | 重庆海云捷迅科技有限公司 | 一种基于视频串流技术的云桌面平台 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117319592A (zh) * | 2023-12-01 | 2023-12-29 | 银河麒麟软件(长沙)有限公司 | 一种云桌面摄像头重定向方法、系统及介质 |
| CN117319592B (zh) * | 2023-12-01 | 2024-03-26 | 银河麒麟软件(长沙)有限公司 | 一种云桌面摄像头重定向方法、系统及介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114727045A (zh) | 2022-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9300705B2 (en) | Methods and systems for interfacing heterogeneous endpoints and web-based media sources in a video conference | |
| EP2863632B1 (en) | System and method for real-time adaptation of a conferencing system to current conditions of a conference session | |
| CN107682657B (zh) | 一种基于WebRTC的多人语音视频通话方法及系统 | |
| US9179100B2 (en) | Video conferencing method and device thereof | |
| US9035991B2 (en) | Collaboration system and method | |
| US20150077509A1 (en) | System for a Virtual Multipoint Control Unit for Unified Communications | |
| WO2006081726A1 (fr) | Système de vidéoconférence multipoint et méthode de traitement de support de celui-ci | |
| CN111935443A (zh) | 一种视频会议实时直播分享到即时通讯工具的方法和装置 | |
| WO2015003532A1 (zh) | 多媒体会议的建立方法、装置及系统 | |
| CN111131754A (zh) | 一种会议管理系统的控制分屏方法及装置 | |
| WO2022134928A1 (zh) | 云桌面共享到会议电视系统的方法、云桌面终端及云桌面 | |
| US9013537B2 (en) | Method, device, and network systems for controlling multiple auxiliary streams | |
| CN110830750A (zh) | 一种基于视联网的数据传输方法和装置 | |
| WO2016206471A1 (zh) | 多媒体业务处理方法、系统及装置 | |
| CN102438119B (zh) | 一种数字电视的音视频通讯系统 | |
| TWI597985B (zh) | 基於網路協議的視頻會議控制系統及方法 | |
| EP2884743A1 (en) | Process for managing the exchanges of video streams between users of a video conference service | |
| WO2019020005A1 (zh) | 视频互动管理方法及系统、计算机可读存储介质 | |
| CN110719435B (zh) | 一种进行终端会议的方法和系统 | |
| CN102291366A (zh) | 一种实现多媒体会议即时聊天的方法和用户设备 | |
| US20120075408A1 (en) | Technique for providing in-built audio/video bridge on endpoints capable of video communication over ip | |
| Ongtang et al. | Client-based Multipoint Media Mixer to Support People with Hearing Impairment in Communication | |
| CN110830752A (zh) | 一种视频会议主机 | |
| CN117596231B (zh) | 通信方法、终端设备、系统及介质 | |
| US10841357B1 (en) | Using transport layer protocol packet headers to encode application layer attributes in an audiovisual over internet protocol (AVoIP) platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21908928 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16/11/2023) |