WO2018006574A1 - 一种视频会议的屏幕共享实现方法 - Google Patents

一种视频会议的屏幕共享实现方法 Download PDF

Info

Publication number
WO2018006574A1
WO2018006574A1 PCT/CN2017/000217 CN2017000217W WO2018006574A1 WO 2018006574 A1 WO2018006574 A1 WO 2018006574A1 CN 2017000217 W CN2017000217 W CN 2017000217W WO 2018006574 A1 WO2018006574 A1 WO 2018006574A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
video conference
shared
svc
screen sharing
Prior art date
Application number
PCT/CN2017/000217
Other languages
English (en)
French (fr)
Inventor
钱晓炯
Original Assignee
钱晓炯
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 钱晓炯 filed Critical 钱晓炯
Publication of WO2018006574A1 publication Critical patent/WO2018006574A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/155—Conference systems involving storage of or access to video conference sessions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • the invention relates to a method for implementing screen sharing of a video conference.
  • the general video conferencing system includes an MCU multi-point controller (which is an implementation of the video conferencing server), a conference room terminal, a PC desktop terminal, a telephone access gateway, and a network gate.
  • MCU multi-point controller which is an implementation of the video conferencing server
  • a variety of different terminals are connected to the MCU multi-point controller for centralized exchange to form a video conference network.
  • the MCU multi-point controller is the core part of the video conferencing system, providing users with connection services for group meetings and multiple groups of conferences.
  • the conference room terminal is used by the conference room provided to the user.
  • the conference room terminal comes with a camera and a remote control keyboard, which can be displayed by a television or a projector.
  • the user can select different devices according to the size of the venue, and the general conference room equipment has video tracking.
  • PC desktop terminal refers to a PC camera that directly holds a video conference on the computer, and generally has a relatively low configuration cost, since the PC is already the standard of office Configuration, the desktop conference terminal does not need to add a lot of hardware investment, and the conference room type terminal only needs to purchase a relatively high-performance PC and video capture card, and the cost is lower than the ordinary hardware video terminal.
  • Video conferencing often requires a shared screen for remote information exchange and sharing.
  • the current practice of the existing video conferencing system is to capture the screen on the software of the PC desktop terminal of the conference participant, and then encode the captured screen as a video stream to the MCU multi-point controller, and the MCU multi-point controller receives the video.
  • the video stream is decoded first, and then encoded according to the actual network bandwidth, and the encoded video stream is broadcast to the PC desktop terminal of other video conference participants.
  • the dedicated video conferencing terminal usually provides a video input interface, and the PC desktop terminal that needs screen sharing can input the video of the PC desktop terminal to the dedicated video conferencing terminal through the interface, and then The shared video is played and shared by the dedicated video conference terminal.
  • the screen sharing software is often built in the hardware or software of the conference room terminal, and it is inconvenient to manage multiple media streams (audio and video) at the same time;
  • the video stream shared by the screen is difficult to adapt to the network of various bandwidths, and the availability is low. Therefore, the MCU multi-point controller must first decode the video stream, and then re-encode and send it to other video conferences according to the actual network bandwidth. participants;
  • the shared video stream needs to be re-encoded after being decoded by the MCU multi-point controller, which consumes a large amount of processing resources, is uneconomical, and brings additional delay.
  • the technical problem to be solved by the present invention is to provide a screen sharing implementation method for a video conference with simple operation, light burden of a video conference server, and no processing delay for the above prior art.
  • the technical solution adopted by the present invention to solve the above technical problem is: a method for implementing screen sharing of a video conference, which is characterized in that: a dedicated screen sharing module is installed on a terminal that needs screen sharing, and the dedicated screen sharing module can share
  • the video image is SVC encoded to form an SVC shared video stream
  • the dedicated screen sharing module sends the SVC shared video stream to the video conference server, and the video conference server does not need to decode and encode the SVC shared video stream, and directly receives the received SVC.
  • the video stream is forwarded to the terminals of other video conference participants.
  • the dedicated screen sharing module includes an operation interface capable of inputting and saving a conference ID or a user ID.
  • the operation interface further includes a “confirm sharing” button for confirming the link between the terminal and the video conference server that needs to share the screen, and confirming the “off” of the link between the terminal and the video conference server that need to share the screen sharing. Share button.
  • the dedicated screen sharing module adopts a “frame-drawing” method to reduce the amount of information sent according to the network bandwidth between the terminal shared by the screen and the video conference server:
  • the 32 frames of a video image are extracted in chronological order, and the labels of the 32 frames are respectively recorded as 1, 2, 3, ... 32, and the 32 frames are divided into 31 layers in the time domain.
  • the correspondence between the serial number of the 32-frame image and the layer number in the time domain is as follows:
  • Sequence number of the frame image Layer number in the time domain 1 1 2 18 3 12 4 26 5 4 6 16 7 8 8 twenty four 9 2 10 20 11 10 12 28 13 6 14 twenty two 15 14 16 30 17 1 18 19 19 13
  • the video frame in the SVC shared video stream needs to be "framed", and the order of "sampling" is in the time domain.
  • the layer numbers are in order from large to small. In this way, the invention can be adapted to different network bandwidth conditions.
  • the dedicated screen sharing module provides only two sets of resolutions in the SVC encoding process of the video image to be shared: the first group is a shared screen 1:1 resolution; the second group is a 90p resolution SVC video, mainly used Display thumbnail video; the first set of high resolution and the second set of low resolution video are SVC, which can be adapted to different network bandwidths by means of frame extraction.
  • the time is also adopted by the “frame-sampling” method.
  • the scalability of the domain that is, when the network bandwidth status between the video conference server and the terminals of other video conference participants is not good, the video frame needs to be "framed", and the sequence of "frames" is also in accordance with the time.
  • the layer numbers in the domain are in order from largest to smallest.
  • the present invention has the advantages that the operation is simple, the video conference server does not need to decode and encode the received shared video stream, and only needs to forward the received shared video stream to the terminals of other video conference participants. Yes, the burden is light and there is no processing delay.
  • FIG. 1 is a schematic diagram of a typical application scenario of screen sharing according to an embodiment of the present invention.
  • FIG. 2 is a flow chart of a screen sharing operation in an embodiment of the present invention.
  • FIG. 3 is a diagram showing a dependence of a video sequence and a sequence of frame drawing according to an embodiment of the present invention.
  • the method for implementing screen sharing of a video conference installs a special on a terminal that needs screen sharing Using a screen sharing module, the dedicated screen sharing module can perform SVC encoding on the video image to be shared to form an SVC shared video stream, and the dedicated screen sharing module sends the SVC shared video stream to the video conference server, and the video conference server does not need to use the SVC.
  • the shared video stream is decoded and encoded, and the received SVC shared video stream is directly forwarded to the terminals of other video conference participants.
  • the dedicated screen sharing module includes an operation interface capable of inputting and saving a conference ID or a user ID.
  • the operation interface further includes a “confirm sharing” button for confirming the link between the terminal and the video conference server that needs to share the screen, and confirming the “off” of the link between the terminal and the video conference server that need to share the screen sharing. Share button.
  • the dedicated screen sharing module adopts a “frame-drawing” method to reduce the amount of information sent according to the network bandwidth between the terminal shared by the screen and the video conference server:
  • the 32 frames of a video image are extracted in chronological order, and the labels of the 32 frames are respectively recorded as 1, 2, 3, ... 32, and the 32 frames are divided into 31 layers in the time domain.
  • the correspondence between the serial number of the 32-frame image and the layer number in the time domain is as follows:
  • Sequence number of the frame image Layer number in the time domain 1 1 2 18 3 12 4 26 5 4 6 16 7 8 8 twenty four 9 2 10 20 11 10 12 28 13 6 14 twenty two 15 14 16 30 17 1 18 19 19 13 20 27 twenty one 5 twenty two 17 twenty three 9 twenty four 25 25 3 26 twenty one 27 11 28 29
  • the video frame in the SVC shared video stream needs to be "framed", and the order of "sampling" is in the time domain.
  • the layer numbers are in order from large to small.
  • the dedicated screen sharing module provides only two sets of resolutions in the SVC encoding process of the video image to be shared: the first group is a shared screen 1:1 resolution; the second group is a 90p resolution SVC video, mainly used Display thumbnail video; the first set of high resolution and the second set of low resolution video are SVC, which can be adapted to different network bandwidths by means of frame extraction.
  • the video conference server Before the video conference server sends the SVC shared video stream to the terminals of other video conference participants, the video conference server also adopts the “frame-sampling” method according to the network bandwidth status between the video conference server and the terminals of other video conference participants.
  • the video frame To achieve the scalability of the time domain, that is, when the network bandwidth status between the video conference server and the terminals of other video conference participants is not good, the video frame needs to be "framed", and the sequence of "frames" is the same.
  • the order of the layer numbers in the time domain from large to small.
  • FIG. 1 there are 3 conference sites participating in the video conference.
  • One mobile phone and one computer participate in the video call at the conference site.
  • the terminal participates in the video call, and installs a dedicated screen sharing module on all the terminals participating in the video; at this time, the computer user in the site 1 wants to share a PPT to the conference, and he opens the dedicated screen sharing module provided by the invention on the computer. You can share the screen on your computer directly into the current meeting. Similarly, if the users of the venue 2 and the venue 3 want to share the screen of any of their computers, they can simply share them through the dedicated screen sharing module.
  • the dedicated screen sharing module is opened on the computer, and the interface prompts to input the conference ID or user ID to join the current conference. If it has been entered before, you can select an already saved ID; the system will pass the conference ID.
  • the SVC video stream of the shared screen is directly sent to the conference server. If the user ID is input, the conference in which the user ID is currently participating may also be queried;
  • the video encoding shared by the screen has the requirement of ensuring the clarity of the screen. Especially when the PPT is used, the font of the screen is relatively small, and the shared end should be able to be clearly seen as the original screen. Therefore, the dedicated screen sharing module of the present invention adopts SVC encoding, and only provides two sets of resolutions in the SVC encoding process of the video images to be shared; the first group is a shared screen 1:1 resolution to avoid distortion; The second group is 70% of the shared screen resolution, allowing the refresh frame rate to be appropriately reduced to accommodate different network bandwidths;
  • the dedicated screen sharing module can also make the standard AVC encoder compatible while improving efficiency; the dedicated screen sharing module provided by the present invention sends the SVC shared video stream.
  • the "snap frame" method is adopted to reduce the amount of information sent:
  • the 32 frames of a video image are extracted in chronological order, and the labels of the 32 frames are respectively recorded as 1, 2, 3, ... 32, and the 32 frames are divided into 31 layers in the time domain.
  • the correspondence between the serial number of the 32-frame image and the layer number in the time domain is as follows:
  • Sequence number of the frame image Layer number in the time domain Stored buffer number 1 1 1 2 18 1 3 12 1 4 26 3 5 4 1 6 16 2 7 8 2 8 twenty four 3 9 2 1 10 20 2 11 10 2 12 28 3 13 6 2 14 twenty two 2 15 14 2 16 30 3 17 1 1
  • the video frame in the SVC shared video stream needs to be "framed", and the order of "sampling" is in the time domain.
  • the layer numbers are in order from large to small.
  • the invention designs a method capable of relatively uniform "pumping frames", thereby realizing the time-stretching of codec, and observing the numerical number of each frame in the figure, respectively, having 1 to 31, the dependence relationship between the frames (predicting ) indicated by the arrow, as shown in Figure 3, it can be found that extracting one frame by the number of the layer number in the time domain from large to small does not affect the entire video sequence, and the process of extracting the frame is in the entire sequence.
  • Medium is uniform;
  • this embodiment provides three buffers, Buff, Buf2, and Buf3, to save history frames, as shown in Table 1 above; when the network status is not good, you can press layers in time domain. The number of frames is removed from the largest to the smallest, without affecting the correctness of the encoding.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本发明涉及一种视频会议的屏幕共享实现方法，其特征在于：在需要屏幕共享的终端上安装一个专用屏幕共享模块，该专用屏幕共享模块能将需要共享的视频图像进行SVC编码，形成SVC共享视频流，该专用屏幕共享模块将SVC共享视频流发送给视频会议服务器，而视频会议服务器无需对SVC共享视频流解码和编码，直接将收到的SVC共享视频流转发给其它视频会议参与方的终端。与现有技术相比，本发明的优点在于：操作简单，视频会议服务器无需对收到的共享视频流解码和编码，只需要将收到的共享视频流转发给其它视频会议参与方的终端即可，负担轻、无处理延迟。

Description

一种视频会议的屏幕共享实现方法 技术领域
本发明涉及一种视频会议的屏幕共享实现方法。
背景技术
一般的视频会议系统包括MCU多点控制器(为视频会议服务器的一种实现方式)、会议室终端、PC桌面型终端、电话接入网关、网闸等几个部分。各种不同的终端都连入MCU多点控制器进行集中交换，组成一个视频会议网络。
MCU多点控制器是视频会议系统的核心部分，为用户提供群组会议、多组会议的连接服务。会议室终端是提供给用户的会议室使用的，会议室终端自带摄像头和遥控键盘，可以通过电视机或者投影仪显示，用户可以根据会场的大小选择不同的设备，一般会议室设备带视频跟踪专用摄像头，可以通过遥控方式前后左右转动从而覆盖参加会议的任何人和物；PC桌面型终端是指直接在电脑上举行视频会议，一般配置费用比较低的PC摄像头，由于PC已经是办公的标准配置，桌面会议终端不需要增加很多的硬件投入，而会议室型终端也只需要购买比较高性能的PC和视频采集卡即可，其成本也低于普通的硬件视频终端。
视频会议过程中往往需要共享屏幕来实现远程的信息交换与共享。现有视频会议系统通常的做法是在会议参与者的PC桌面型终端的软件上抓取屏幕，然后将抓取的屏幕编码为视频流上传给MCU多点控制器，MCU多点控制器接收到视频流后先解码，再根据实际网络带宽情况进行编码，将编码后的视频流广播给其它视频会议参与方的PC桌面型终端。如果是专用的视频会议终端，该专用视频会议终端通常会提供一个视频输入接口，而需要屏幕共享的PC桌面型终端通过此接口可将该PC桌面型终端的视频输入给专用视频会议终端，然后通过该专用视频会议终端将共享视频进行播放实现共享。
现有的视频会议系统存在如下缺点：
1、屏幕共享软件往往是内置在会议室终端的硬件或软件内，要同时管理多个媒体流(音频、视频)，操作不方便；
2、屏幕共享的视频流难以适应各种带宽的网络，可用性低，因此必须要经过MCU多点控制器先将视频流解码后，根据实际网络带宽情况，再重新进行编码后发送给其它视频会议参与方；
3、如果视频会议服务器使用MCU多点控制器，共享的视频流需要在MCU多点控制器进行解码后重新编码，需要消耗大量处理资源，不经济，而且带来额外延迟。
发明内容
本发明所要解决的技术问题是针对上述现有技术提供一种操作简单、视频会议服务器负担轻、无处理延迟的视频会议的屏幕共享实现方法。
本发明解决上述技术问题所采用的技术方案为：一种视频会议的屏幕共享实现方法，其特征在于：在需要屏幕共享的终端上安装一个专用屏幕共享模块，该专用屏幕共享模块能将需要共享的视频图像进行SVC编码，形成SVC共享视频流，该专用屏幕共享模块将SVC共享视频流发送给视频会议服务器，而视频会议服务器无需对SVC共享视频流解码和编码，直接将收到的SVC共享视频流转发给其它视频会议参与方的终端。
所述专用屏幕共享模块包含有能输入和保存会议ID或/用户ID的操作界面。
所述操作界面上还包含有确认连通需要屏幕共享的终端和视频会议服务器之间链路的“确认共享”按键，和确认断开需要屏幕共享的终端和视频会议服务器之间链路的“关闭共享”按键。
所述专用屏幕共享模块在将SVC共享视频流发送给视频会议服务器前，根据需要屏幕共享的终端与视频会议服务器之间的网络带宽情况，采取“抽帧”方式减少发送信息量：
按照时间先后顺序提取一幅视频图像中的32帧图像，将这32帧图像的标号分别记为1、2、3、……32，将这32帧图像在时间域内划分为31个层，这32帧图像的序号与时间域内的层号之间的对应关系如下表：
帧图像的序号 时间域内的层号
1 1
2 18
3 12
4 26
5 4
6 16
7 8
8 24
9 2
10 20
11 10
12 28
13 6
14 22
15 14
16 30
17 1
18 19
19 13
20 27
21 5
22 17
23 9
24 25
25 3
26 21
27 11
28 29
29 7
30 23
31 15
32 31
即：当需要屏幕共享的终端与视频会议服务器之间的网络带宽状态不佳时，需要对SVC共享视频流中的视频图像进行“抽帧”操作，“抽帧”的先后顺序按照时间域内的层号从大到小的顺序进行。该方式，可以使本发明可适应不同网络带宽情况。
所述专用屏幕共享模块在对需要共享的视频图像进行SVC编码过程中，仅提供两组分辨率：第一组为共享屏幕1∶1分辨率；第二组为90p分辨率SVC视频，主要用于显示缩略图视频；第一组高分辨率和第二组低分辨率视频都是SVC，都可以通过抽帧的方式实现适应不同的网络带宽。
所述视频会议服务器在将SVC共享视频流发送给其它视频会议参与方的终端前，根据视频会议服务器与其它视频会议参与方的终端之间的网络带宽状态，同样采取“抽帧”方式实现时间域的伸缩性，即：当视频会议服务器与其它视频会议参与方的终端之间的网络带宽状态不佳时，需要对视频图像进行“抽帧”操作，“抽帧”的先后顺序同样按照时间域内的层号从大到小的顺序进行。
与现有技术相比，本发明的优点在于：操作简单，视频会议服务器无需对收到的共享视频流解码和编码，只需要将收到的共享视频流转发给其它视频会议参与方的终端即可，负担轻、无处理延迟。
附图说明
图1为本发明实施例中屏幕共享典型应用场景示意图。
图2为本发明实施例中屏幕共享操作流程图。
图3为本发明实施例中视频序列的依赖关系及抽帧顺序图。
具体实施方式
以下结合附图实施例对本发明作进一步详细描述。
本发明提供的视频会议的屏幕共享实现方法，在需要屏幕共享的终端上安装一个专 用屏幕共享模块，该专用屏幕共享模块能将需要共享的视频图像进行SVC编码，形成SVC共享视频流，该专用屏幕共享模块将SVC共享视频流发送给视频会议服务器，而视频会议服务器无需对SVC共享视频流解码和编码，直接将收到的SVC共享视频流转发给其它视频会议参与方的终端。
所述专用屏幕共享模块包含有能输入和保存会议ID或/用户ID的操作界面。所述操作界面上还包含有确认连通需要屏幕共享的终端和视频会议服务器之间链路的“确认共享”按键，和确认断开需要屏幕共享的终端和视频会议服务器之间链路的“关闭共享”按键。
所述专用屏幕共享模块在将SVC共享视频流发送给视频会议服务器前，根据需要屏幕共享的终端与视频会议服务器之间的网络带宽情况，采取“抽帧”方式减少发送信息量：
按照时间先后顺序提取一幅视频图像中的32帧图像，将这32帧图像的标号分别记为1、2、3、……32，将这32帧图像在时间域内划分为31个层，这32帧图像的序号与时间域内的层号之间的对应关系如下表：
帧图像的序号 时间域内的层号
1 1
2 18
3 12
4 26
5 4
6 16
7 8
8 24
9 2
10 20
11 10
12 28
13 6
14 22
15 14
16 30
17 1
18 19
19 13
20 27
21 5
22 17
23 9
24 25
25 3
26 21
27 11
28 29
29 7
30 23
31 15
32 31
即：当需要屏幕共享的终端与视频会议服务器之间的网络带宽状态不佳时，需要对SVC共享视频流中的视频图像进行“抽帧”操作，“抽帧”的先后顺序按照时间域内的层号从大到小的顺序进行。
所述专用屏幕共享模块在对需要共享的视频图像进行SVC编码过程中，仅提供两组分辨率：第一组为共享屏幕1∶1分辨率；第二组为90p分辨率SVC视频，主要用于显示缩略图视频；第一组高分辨率和第二组低分辨率视频都是SVC，都可以通过抽帧的方式实现适应不同的网络带宽。
所述视频会议服务器在将SVC共享视频流发送给其它视频会议参与方的终端前，也会根据视频会议服务器与其它视频会议参与方的终端之间的网络带宽状态，同样采取“抽帧”方式实现时间域的伸缩性，即：当视频会议服务器与其它视频会议参与方的终端之间的网络带宽状态不佳时，需要对视频图像进行“抽帧”操作，“抽帧”的先后顺序同样按照时间域内的层号从大到小的顺序进行。
下面结合一个具体的应用场景，详细描述本发明提供的方法的应用：
如图1所示的应用场景中，参与视频会议有3个会场，会场一有一个手机和一台电脑参与视频通话，会场二也有一个手机和一台电脑参与视频通话，会场三有一台会议专用终端参与视频通话，将所有参与视频的终端上均安装一个专用屏幕共享模块；此时会场一中的电脑用户希望共享一个PPT到会议中，他在电脑上打开本发明提供的专用屏幕共享模块，就能直接将电脑上的屏幕共享到当前会议中。同样的，如果会场二、会场三的用户想要共享他们任意一个电脑的屏幕，只需通过专用屏幕共享模块直接共享即可。这种屏幕共享实现方法的好处是，共享电脑无需订阅和发送屏幕共享之外的音视频流，在同一个会场中多设备参与不会产生干扰，同时，这种模块化来直接实现共享屏幕的方式给用户带来极大的便利。
此外，多数电脑并不是专门用来打电话的，由于扬声器和麦克风结构设计等原因，使用电脑参与音频会议的体验往往由于回声问题、扬声器和MIC的增益问题、多个音频IO设备选择问题，导致操作复杂(电脑上的音视频设备设置和检测是一般通信软件的标配功能)，音频效果差，这样会发现许多实际的视频会议场景就变成了PSTN会议电话+视频会议；而本发明提供的方法很好的解决了这些矛盾，利用专有设备的较高质量的音频处理效果，使用方便(无需对音频设备设置、选择和调校)，成本低，效果好(手机或专门的会议终端，音频通话能力经过事先验证)。
专用屏幕共享模块的使用流程参见图2所示：
首先，需要在被共享的电脑上安装专用屏幕共享模块；一般情况下可以在安装会议 系统的完整版本终端应用时，将此专用屏幕共享模块一起安装；
其次，会议过程中，在电脑上打开此专用屏幕共享模块，界面会提示输入会议ID或用户ID加入当前会议，如果之前已经输入过，则可选择一个已经保存的ID；后面系统将通过会议ID直接将共享屏幕的SVC视频流发给会议服务器，如果输入用户ID，也可查询得到此用户ID当前参与的会议；
再次，点击“确定共享”，则将当前电脑的屏幕形成SVC共享视频流共享到会议中，共享过程中具有明确的标识表明本电脑的共享状态；
最后，可随时“关闭共享”，停止发送共享的SVC共享视频流；退出程序之前可反复打开或关闭共享。
屏幕共享的视频编码具有保证屏幕清晰度的需求，特别是讲PPT的时候屏幕的文字字体比较小，被共享端也应该能跟原屏幕一样能够清楚的看到。因此，本发明的专用屏幕共享模块采用SVC编码，且在对需要共享的视频图像进行SVC编码过程中，仅提供两组分辨率；第一组为共享屏幕1∶1分辨率，避免失真；第二组为共享屏幕分辨率的70％，允许刷新帧率适当降低，以便适应不同网络带宽；
为了适应不同的网络状态，所述专用屏幕共享模块在进行SVC编码时，在提高效率的同时，还可以让标准的AVC编码器兼容；本发明提供的专用屏幕共享模块在将SVC共享视频流发送给视频会议服务器前，根据需要屏幕共享的终端与视频会议服务器之间的网络带宽情况，采取“抽帧”方式减少发送信息量：
按照时间先后顺序提取一幅视频图像中的32帧图像，将这32帧图像的标号分别记为1、2、3、……32，将这32帧图像在时间域内划分为31个层，这32帧图像的序号与时间域内的层号之间的对应关系如下表：
帧图像的序号 时间域内的层号 存储的缓冲区号
1 1 1
2 18 1
3 12 1
4 26 3
5 4 1
6 16 2
7 8 2
8 24 3
9 2 1
10 20 2
11 10 2
12 28 3
13 6 2
14 22 2
15 14 2
16 30 3
17 1 1
18 19 1
19 13 1
20 27 3
21 5 1
22 17 2
23 9 2
24 25 3
25 3 1
26 21 2
27 11 2
28 29 3
29 7 2
30 23 2
31 15 2
32 31 3
即：当需要屏幕共享的终端与视频会议服务器之间的网络带宽状态不佳时，需要对SVC共享视频流中的视频图像进行“抽帧”操作，“抽帧”的先后顺序按照时间域内的层号从大到小的顺序进行。
本发明设计了一种能够比较均匀“抽帧”的方法，从而实现编解码的时间可伸缩，观察图中每一帧的数字编号，分别有1～31，各帧之间的依赖关系(预测)由箭头表示，参见图3所示，可以发现：按时间域内的层号从大到小的数字编号来抽去一帧，并不会影响整个视频序列，同时抽去帧的过程在整个序列中是均匀的；
对于图3的帧间预测的实现序列，本实施例提供3个缓冲区——Buff、Buf2、Buf3来保存历史帧，见上述表1；当网络状态不佳事，可以按按照时间域内的层号从大到小的顺序抽掉帧图像，而不影响编码正确性。

Claims (6)

  1. 一种视频会议的屏幕共享实现方法，其特征在于：在需要屏幕共享的终端上安装一个专用屏幕共享模块，该专用屏幕共享模块能将需要共享的视频图像进行SVC编码，形成SVC共享视频流，该专用屏幕共享模块将SVC共享视频流发送给视频会议服务器，而视频会议服务器无需对SVC共享视频流解码和编码，直接将收到的SVC共享视频流转发给其它视频会议参与方的终端。
  2. 根据权利要求1所述的视频会议的屏幕共享实现方法，其特征在于：所述专用屏幕共享模块包含有能输入和保存会议ID或/用户ID的操作界面。
  3. 根据权利要求2所述的视频会议的屏幕共享实现方法，其特征在于：所述操作界面上还包含有确认连通需要屏幕共享的终端和视频会议服务器之间链路的“确认共享”按键，和确认断开需要屏幕共享的终端和视频会议服务器之间链路的“关闭共享”按键。
  4. 根据权利要求1所述的视频会议的屏幕共享实现方法，其特征在于：所述专用屏幕共享模块在将SVC共享视频流发送给视频会议服务器前，根据需要屏幕共享的终端与视频会议服务器之间的网络带宽情况,采取“抽帧”方式减少发送信息量：
    按照时间先后顺序提取一幅视频图像中的32帧图像，将这32帧图像的标号分别记为1、2、3、……32，将这32帧图像在时间域内划分为31个层，这32帧图像的序号与时间域内的层号之间的对应关系如下表：
    帧图像的序号 时间域内的层号 1 1 2 18 3 12 4 26 5 4 6 16 7 8 8 24 9 2 10 20 11 10 12 28 13 6 14 22 15 14 16 30 17 1 18 19 19 13 20 27 21 5
    22 17 23 9 24 25 25 3 26 21 27 11 28 29 29 7 30 23 31 15 32 31
    即：当需要屏幕共享的终端与视频会议服务器之间的网络带宽状态不佳时，需要对SVC共享视频流中的视频图像进行“抽帧”操作，“抽帧”的先后顺序按照时间域内的层号从大到小的顺序进行。
  5. 根据权利要求4所述的视频会议的屏幕共享实现方法，其特征在于：所述专用屏幕共享模块在对需要共享的视频图像进行SVC编码过程中，仅提供两组分辨率：第一组为共享屏幕1∶1分辨率；第二组为90p分辨率SVC视频。
  6. 根据权利要求4所述的视频会议的屏幕共享实现方法，其特征在于：所述视频会议服务器在将SVC共享视频流发送给其它视频会议参与方的终端前，根据视频会议服务器与其它视频会议参与方的终端之间的网络带宽状态，同样采取“抽帧”方式实现时间域的伸缩性，即：当视频会议服务器与其它视频会议参与方的终端之间的网络带宽状态不佳时，需要对视频图像进行“抽帧”操作,“抽帧”的先后顺序同样按照时间域内的层号从大到小的顺序进行。
PCT/CN2017/000217 2016-07-05 2017-03-07 一种视频会议的屏幕共享实现方法 WO2018006574A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610534290.7A CN106101605A (zh) 2016-07-05 2016-07-05 一种视频会议的屏幕共享实现方法
CN201610534290.7 2016-07-05

Publications (1)

Publication Number Publication Date
WO2018006574A1 true WO2018006574A1 (zh) 2018-01-11

Family

ID=57212576

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/000217 WO2018006574A1 (zh) 2016-07-05 2017-03-07 一种视频会议的屏幕共享实现方法

Country Status (2)

Country Link
CN (1) CN106101605A (zh)
WO (1) WO2018006574A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112258912A (zh) * 2020-10-10 2021-01-22 深圳市捷视飞通科技股份有限公司 网络互动教学方法、装置、计算机设备和存储介质
CN112272326A (zh) * 2020-10-21 2021-01-26 上海晨驭信息科技有限公司 一种分布式跨域大屏同步系统
WO2021143391A1 (zh) * 2020-01-17 2021-07-22 华为技术有限公司 基于视频通话的共享屏幕方法及移动设备

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106101605A (zh) * 2016-07-05 2016-11-09 宁波菊风系统软件有限公司 一种视频会议的屏幕共享实现方法
CN108076381B (zh) * 2016-11-11 2020-10-16 华为技术有限公司 视频显示方法、视频转发设备及系统
CN108093197B (zh) * 2016-11-21 2021-06-15 阿里巴巴集团控股有限公司 用于信息分享的方法、系统及机器可读介质
CN109495712A (zh) * 2017-09-13 2019-03-19 上海博取投资管理咨询有限公司 应用于电子商务系统的视频及屏幕共享方法、装置及系统
CN107592576A (zh) * 2017-09-15 2018-01-16 威创集团股份有限公司 一种视频共享方法、系统、共享端及被共享端
CN108600294B (zh) * 2018-02-28 2021-11-19 国云科技股份有限公司 一种云终端屏幕共享系统及方法
CN110248142B (zh) * 2019-06-12 2021-03-23 随锐科技集团股份有限公司 一种快速共享屏幕的方法及系统
CN110475126A (zh) * 2019-06-18 2019-11-19 北京世纪超星信息技术发展有限责任公司 一种用于媒体内容共享过程的界面适配方法
CN110933470B (zh) * 2019-11-29 2022-02-22 杭州当虹科技股份有限公司 一种视频数据的共享方法
CN111629243A (zh) * 2020-06-03 2020-09-04 天津卓朗科技发展有限公司 图像共享方法、装置及电子设备
CN111726561B (zh) * 2020-06-17 2022-07-08 千脉文化传媒(上海)有限公司 异终端同账号的会议方法、系统、设备及存储介质
CN116405631A (zh) * 2020-07-08 2023-07-07 华为技术有限公司 屏幕共享方法、终端和存储介质
CN111935540B (zh) * 2020-08-07 2022-06-28 北京飞讯数码科技有限公司 一种指挥调度终端间的桌面共享方法及系统
CN112468763B (zh) * 2020-11-11 2023-11-24 北京融讯科创技术有限公司 会议电视的视频传输和显示方法、装置、设备及存储介质
CN115333880B (zh) * 2022-08-09 2023-10-20 中国平安人寿保险股份有限公司 线上会议的实现方法和装置、电子设备及存储介质
CN115714846B (zh) * 2022-10-24 2024-03-22 株洲华通科技有限责任公司 视频会议终端的网络传屏方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3370394B2 (ja) * 1993-09-28 2003-01-27 富士通株式会社 電話と連携した電子メールシステム
CN101151878A (zh) * 2005-03-29 2008-03-26 索尼爱立信移动通讯股份有限公司 在手持通信装置之间共享信息的方法和手持通信装置
CN103141087A (zh) * 2011-09-14 2013-06-05 巴可有限公司 会议用电子工具和方法
CN103475902A (zh) * 2013-09-06 2013-12-25 同观科技（深圳）有限公司 一种视频编码及网络传输方法和一种视频转发服务器
CN103581285A (zh) * 2012-07-20 2014-02-12 三星电子株式会社 共享内容的方法和系统、设备和计算机可读记录介质
CN106101605A (zh) * 2016-07-05 2016-11-09 宁波菊风系统软件有限公司 一种视频会议的屏幕共享实现方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2633366C (en) * 2005-12-22 2015-04-28 Vidyo, Inc. System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers
CN102395012B (zh) * 2011-10-31 2017-06-23 康佳集团股份有限公司 利用手机共享电视屏幕遥控电视的方法、系统及手机
CN102510405A (zh) * 2011-11-18 2012-06-20 深圳中兴网信科技有限公司 一种屏幕共享方法及其系统
CN102811368A (zh) * 2012-07-16 2012-12-05 北京邮电大学 一种移动视频直播系统
CN102883135B (zh) * 2012-11-01 2015-08-26 成都飞视美视频技术有限公司 屏幕共享及控制方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3370394B2 (ja) * 1993-09-28 2003-01-27 富士通株式会社 電話と連携した電子メールシステム
CN101151878A (zh) * 2005-03-29 2008-03-26 索尼爱立信移动通讯股份有限公司 在手持通信装置之间共享信息的方法和手持通信装置
CN103141087A (zh) * 2011-09-14 2013-06-05 巴可有限公司 会议用电子工具和方法
CN103581285A (zh) * 2012-07-20 2014-02-12 三星电子株式会社 共享内容的方法和系统、设备和计算机可读记录介质
CN103475902A (zh) * 2013-09-06 2013-12-25 同观科技（深圳）有限公司 一种视频编码及网络传输方法和一种视频转发服务器
CN106101605A (zh) * 2016-07-05 2016-11-09 宁波菊风系统软件有限公司 一种视频会议的屏幕共享实现方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021143391A1 (zh) * 2020-01-17 2021-07-22 华为技术有限公司 基于视频通话的共享屏幕方法及移动设备
CN112258912A (zh) * 2020-10-10 2021-01-22 深圳市捷视飞通科技股份有限公司 网络互动教学方法、装置、计算机设备和存储介质
CN112272326A (zh) * 2020-10-21 2021-01-26 上海晨驭信息科技有限公司 一种分布式跨域大屏同步系统
CN112272326B (zh) * 2020-10-21 2023-07-21 上海晨驭信息科技有限公司 一种分布式跨域大屏同步系统

Also Published As

Publication number Publication date
CN106101605A (zh) 2016-11-09

Similar Documents

Publication Publication Date Title
WO2018006574A1 (zh) 一种视频会议的屏幕共享实现方法
US9300705B2 (en) Methods and systems for interfacing heterogeneous endpoints and web-based media sources in a video conference
US9781386B2 (en) Virtual multipoint control unit for unified communications
WO2018006573A1 (zh) 一种视频会议的屏幕共享实现装置
US9024997B2 (en) Virtual presence via mobile
US8717404B2 (en) Recording a videoconference based on recording configurations
US10250683B2 (en) Server node arrangement and method
US7929011B2 (en) Method and system for handling video signals of conference
US8717408B2 (en) Conducting a private videoconference within a videoconference via an MCU
US8787547B2 (en) Selective audio combination for a conference
US9961303B2 (en) Video conference virtual endpoints
US8717409B2 (en) Conducting a direct private videoconference within a videoconference
CN105376516A (zh) 一种移动视频会议系统及其实现方法
US9398257B2 (en) Methods and systems for sharing a plurality of encoders between a plurality of endpoints
CN102025970A (zh) 自动调整视频会议显示模式的方法及系统
WO2014008506A1 (en) Systems and methods for ad-hoc integration of tablets and phones in video communication systems
CN103888712A (zh) 一种多语同步音视频会议系统
WO2016206471A1 (zh) 多媒体业务处理方法、系统及装置
US8717407B2 (en) Telepresence between a multi-unit location and a plurality of single unit locations
US8704870B2 (en) Multiway telepresence without a hardware MCU
KR20170071251A (ko) 회의 서비스를 제공하는 다중 접속 제어 장치
CN202103782U (zh) 一种具备复合功能会场终端的视频会议系统
Long et al. Research on Method of Large Capacity Conference System Based on Single Server
US20120200659A1 (en) Displaying Unseen Participants in a Videoconference
CN117459674A (zh) 一种视频会议的网络带宽优化方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17823387

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17823387

Country of ref document: EP

Kind code of ref document: A1